Management system, communication system, processing method, and program
The management system streamlines data upload to external storage by managing user access and device operations, reducing the need for device-level authentication and user interaction.
Patent Information
- Application Number
- JP2021048495
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-03-23
- Publication Date
- 2025-07-15
- Estimated Expiration
- 2041-03-23
AI Technical Summary
Conventional methods require user authentication on devices like photographing devices to upload data to external storage, making the process cumbersome.
A management system that manages events by communicating between user terminals and devices, acquires user access information through authentication, stores operation identification and access tokens, and uploads data directly to external storage without device-level authentication.
Reduces the labor required for uploading data by eliminating the need for device-level user authentication and direct user interaction.
Smart Images

Figure 0007707593000001 
Figure 0007707593000002 
Figure 0007707593000003
Abstract
Description
Technical Field
[0001] The present disclosure relates to a management system, a communication system, a processing method, and a program.
Background Art
[0002] There is known a system that distributes in real time a video captured by a photographing device and enables a situation at a base where the photographing device is installed to be viewed in real time at another base.
[0003] Also, a technique for storing data acquired by a device such as a photographing device participating in remote communication in an external storage service is already known. For example, Patent Document 1 discloses a method of storing, in a server device, settings of an external storage service for each user for the purpose of reducing the trouble of selecting an external storage service as a transmission destination, and reading the setting information stored in the server device with an electronic blackboard device.
Prior Art Documents
Patent Documents
[0004]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0005] However, in the conventional method, when uploading data acquired by a device such as a photographing device or an electronic blackboard device participating in an event such as remote communication to an external storage under user authority, processing such as user authentication on the device is required, resulting in a problem that the processing is troublesome.
Means for Solving the Problems
[0006] To solve the above problems, the invention according to claim 1 is a management system for managing a predetermined event executed by communication between a communication terminal used by a user and a device that performs remote communication with the communication terminal. The management system includes an acquisition means for acquiring access information of the user to an external storage by an authentication process of the communication terminal to the management system, an operation request reception means for receiving an operation request from a specific device from the user authenticated by the management system and transmitted from the communication terminal, a storage means for storing in association with each other operation identification information for identifying a device operation related to the received operation request and the access information, Transmission means for transmitting destination information for performing data exchange of data obtained by the device operation related to the received operation request to the communication terminal, and in response to a message transmission request from the communication terminal including the destination information to the specific device, message processing means for transmitting a first message to the specific device an upload means for uploading data acquired by the specific device according to the device operation corresponding to the stored operation identification information to the external storage using the access information associated with the operation identification information. The management system is provided with the above components.
Effect of the Invention
[0007] According to the present invention, there is an effect that the labor of the process when uploading data acquired by a device to an external storage with user authority can be reduced.
Brief Description of the Drawings
[0008]
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10
Figure 11
Figure 12
Figure 13
Figure 14
Figure 15
Figure 16
Figure 17
Mode for Carrying Out the Invention
[0009] Hereinafter, modes for carrying out the invention will be described with reference to the drawings. In the description of the drawings, the same reference numerals are given to the same elements, and duplicate descriptions are omitted.
[0010] ●Embodiment● ●Outline of the Communication System First, with reference to FIG. 1, an overview of the configuration of the communication system according to the embodiment will be described. FIG. 1 is a diagram showing an example of the overall configuration of the communication system. The communication system 1 shown in FIG. 1 is a system that can view the situation of the distribution site in real time by displaying captured images such as videos distributed from a remote distribution site by participating in a predetermined event such as remote communication provided by the management system 5 at a browsing site. Here, the predetermined event includes remote meetings, remote classes, remote medical examinations, consultations or consultations realized by communication between remote sites via the management system 5, or inspections, monitoring or patrols of remote sites.
[0011] As shown in FIG. 1, the communication system 1 includes a communication terminal 10 located at the browsing site, a photographing device 30 located at the site which is the distribution site, a management server 50, and an authorization server 70. The communication terminal 10, the photographing device 30, the management server 50, and the authorization server 70 constituting the communication system 1 can communicate via the communication network 100. The communication network 100 is constructed by the Internet, a mobile communication network, a LAN (Local Area Network), or the like. Note that the communication network 100 may include not only wired communication but also networks based on wireless communication such as 3G (3rd Generation), 4G (4th Generation), 5G (5th Generation), Wi-Fi (Wireless Fidelity) (registered trademark), WiMAX (Worldwide Interoperability for Microwave Access), or LTE (Long Term Evolution).
[0012] The communication terminal 10 is a computer such as a notebook PC (Personal Computer) used by a user at the browsing site. The communication terminal 10 participates in a predetermined event provided by the management server 50, for example, after user authentication by the management server 50. The communication terminal 10 displays the captured image captured by the photographing device 30 installed at the distribution site, and allows the user to view the situation of the distribution site.
[0013] Note that the communication terminal 10 is not limited to a notebook PC, and may be, for example, a desktop PC, a smartphone, a tablet terminal, a wearable terminal, an HMD (head mount display), or an IWB (Interactive White Board: an electronic whiteboard with an electronic blackboard function capable of mutual communication), etc.
[0014] The photographing device 30 is a device installed at a distribution base which is a site such as an office or a factory, and participates in a predetermined event provided by the management server 50. The photographing device 30 is registered in advance in the management server 50, and when the event is started upon a request from a user, it starts the installed application and participates in the event as a participant. The photographing device 30 photographs a subject, a landscape, etc. within the distribution base to acquire a photographed image, and transmits it to the communication terminal 10 participating in the event via the management server 50. Note that the photographed image obtained by the photographing device 30 may be a moving image, a still image, or both a moving image and a still image. Further, the photographed image may include audio together with the image.
[0015] Here, the photographing device 30 is an example of a device that participates in an event provided by the management server 50. The device that participates in the event is not limited to a photographing device, and may be a videoconference terminal, an IWB (Interactive White Board: an electronic whiteboard with an electronic blackboard function capable of mutual communication), or a moving body such as a robot that moves within the distribution base.
[0016] Further, the distribution base where the photographing device 30 is installed is not limited to an office or a factory, etc., and may be, for example, an outdoor base such as a business office, a construction site, a substation, a farm, a field, an orchard, cultivated land, or a disaster site, or an indoor base such as a school, a warehouse, a commercial facility, a hospital, or a nursing facility. That is, the distribution base where the photographing device 30 is installed may be any base where there is a need to execute an event such as a remote meeting or inspection with the users present at the viewing base.
[0017] The management server 50 is a server computer that provides and manages events executed between the communication terminal 10 and the imaging device 30. The management server 50 manages and controls the communication between the communication terminal 10 and the imaging device 30, and relays the image data transmitted and received. The authorization server 70 is a server computer that performs authentication and authorization processes for users who participate in events and the like provided by the management server 50. In addition, the authorization server 70 is also in cooperation with an external storage service that provides the external storage 90, and stores the authorization tokens (access information to the external storage 90) of users who contract with the external storage 90.
[0018] Here, the management server 50 and the authorization server 70 constitute the management system 5. Note that the management system 5 may be, for example, a computer that aggregates all or part of the functions of the management server 50 and the authorization server 70. Also, each of the management server 50 and the authorization server 70 may be configured such that each function is realized by being distributed among a plurality of computers. Furthermore, although the management server 50 and the authorization server 70 are described as server computers existing in a cloud environment, they may be servers existing in an on-premises environment.
[0019] The external storage 90 is a storage service (or online storage) provided by an external service via the communication network 100. The external storage 90 is, for example, a storage destination for storing data files on the cloud, and a user who contracts with the external storage service can store and view data using their own authorization token.
[0020] Here, an example of a usage scenario of the communication system 1 will be described with reference to FIGS. 2 and 3. FIGS. 2 and 3 are diagrams for explaining an outline of an example of the communication system.
[0021] First, FIG. 2 shows an example of remote communication between a photographing device 30 (30A to 30C) installed at a viewing site and a communication terminal 10A used by an administrator A who is a user at the viewing site.
[0022] The viewing site shown in FIG. 2 is, for example, a site such as a factory or a warehouse where a predetermined operation is being performed by a plurality of workers. As shown in FIG. 2, a plurality of photographing devices 30 (30A to 30C) are installed at the viewing site. Among these, the photographing device 30A and the photographing device 30B are fixedly installed, for example, on a workbench or the like within the site, and perform photographing processing of the periphery of the installation position. In addition, the photographing device 30C is provided on a robot that travels in Site A, and performs photographing while the robot is traveling. The photographing devices 30 (30A to 30C) transmit the acquired photographed images so that they can be displayed on the communication terminal 10A used by the administrator A in an event being executed with the administrator A. In addition, the administrator A, who is a user at the remote viewing site A, uses the communication terminal 10A to perform remote communication with the photographing device 30 installed at the distribution site, thereby viewing the photographed images of the inside of the site or performing maintenance management of the distribution site.
[0023] In addition, as shown in FIG. 3, a configuration in which a plurality of users located at different viewing sites participate in an event and perform remote communication with the photographing device 30 installed at the distribution site may be used. FIG. 3 shows an example in which the administrator A who is a user at the viewing site A and the administrator B who is a user at the viewing site B participate in the same event and perform remote communication with the photographing device 30 installed at the distribution site using the communication terminals 10A and 10B, respectively.
[0024] In the usage scenes shown in FIGS. 2 and 3, similar to the case where a user participates in an event such as a web conference using a communication terminal, devices such as photographing devices are also participating in the event as one participation site. In such a case, there is a demand to have a device at a remote location take a photo according to an instruction from a user participating in the event and upload the photo to an external storage with which the user has a contract.
[0025] However, conventionally, when uploading data acquired by a device such as a photographing device participating in an event such as a remote conference to an external storage of a specific user, it is necessary to provide the device itself with the user's authentication information and directly upload the data from the device to the external storage with user authority, or to transfer the data from the device to the communication terminal used by the user and then upload it. Therefore, in the process of uploading the data acquired by the device to the external storage with user authority, processing such as user authentication on the device is required, resulting in a problem that the processing is time-consuming.
[0026] Therefore, based on a request from a user who is a contractor of the external storage 90, the communication system 1 causes the management server 50 to acquire an authorization token for accessing the external storage 90 with user authority, and transmits information for specifying the authorization token together with the data acquired by the photographing device 30 to the management server 50. More specifically, on the premise that the management server 50 operates as an OAuth 2.0 resource server and can acquire the user's access token, the management server 50 temporarily stores the authorization token and provides it to the external storage 90 together with the data acquired from the photographing device 30, enabling the data to be uploaded without passing the user's access information to the external storage 90 such as the authorization token to the photographing device 30.
[0027] Thereby, the communication system 1 can directly upload the data acquired from the device to the external storage 90 without performing device operations by the user and user authentication on the device. For example, image data and the like acquired from a device installed at a distribution site as shown in FIGS. 2 and 3 can be uploaded to the external storage 90 contracted by a user at a viewing site, reducing the labor required for the user's upload process.
[0028] ●Hardware Configuration Next, with reference to FIGS. 4 to 6, the hardware configuration of each device or terminal constituting the communication system according to the embodiment will be described. Note that the hardware configuration shown in FIGS. 4 to 6 may have components added or deleted as necessary.
[0029] ○ Hardware Configuration of Communication Terminal ○ First, with reference to FIG. 4, the hardware configuration of communication terminal 10 will be described. FIG. 4 is a diagram showing an example of the hardware configuration of a communication terminal. Communication terminal 10 is constructed by a computer and includes, as shown in FIG. 4, a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, an HD (Hard Disk) 104, an HDD (Hard Disk Drive) controller 105, a display 106, an external device connection I / F (Interface) 107, a network I / F 108, a bus line 110, a keyboard 111, a pointing device 112, a sound input / output I / F 113, a microphone 114, a speaker 115, a camera 116, a DVD-RW (Digital Versatile Disk Rewritable) drive 117, and a media I / F 119.
[0030] Among these, the CPU 101 controls the operation of the entire communication terminal 10. The ROM 102 stores programs used for driving the CPU 101 such as the IPL (Initial Program Loader). The RAM 103 is used as a work area for the CPU 101. The HD 104 stores various data such as programs. The HDD controller 105 controls the reading or writing of various data to and from the HD 104 according to the control of the CPU 101. The display 106 is a type of display means for displaying various information such as a cursor, menu, window, characters, or images. Note that the display 106 may be a touch panel display having an input means. The external device connection I / F 107 is an interface for connecting various external devices. The network I / F 108 is an interface for performing data communication using the communication network 100. The bus line 110 is an address bus, data bus, or the like for electrically connecting each component such as the CPU 101 shown in FIG. 4.
[0031] Also, the keyboard 111 is a type of input means having a plurality of keys for inputting characters, numerical values, various instructions, etc. The pointing device 112 is a type of input means for selecting or executing various instructions, selecting a processing target, or moving a cursor, etc. Note that the input means may be not only the keyboard 111 and the pointing device 112, but also a touch panel or a voice input device, etc. The audio input / output I / F 113 is a circuit that processes the input / output of audio signals between the microphone 114 and the speaker 115 according to the control of the CPU 101. The microphone 114 is a type of built-in sound collecting means for inputting voice. The speaker 115 is a type of built-in output means for outputting voice signals. The camera 116 is a type of built-in imaging means for imaging a subject to obtain image data. Note that the microphone 114, the speaker 115, and the camera 116 may be external devices instead of being built-in to the communication terminal 10. The DVD-RW drive 117 controls the reading or writing of various data with respect to the DVD-RW 118 as an example of a removable recording medium. Note that the removable recording medium is not limited to the DVD-RW, and may be a DVD-R or a Blu-ray (registered trademark) Disc (Blu-ray disk), etc. The media I / F 119 controls the reading or writing (storage) of data with respect to a recording medium 121 such as a flash memory.
[0032] ○Hardware Configuration of the Imaging Device○ Next, the hardware configuration of the imaging device 30 will be described with reference to FIG. 5. FIG. 5 is a diagram showing an example of the hardware configuration of the imaging device. FIG. 3 shows an example of an omnidirectional imaging device that captures a subject, a landscape, etc. and acquires an omnidirectional image. Note that the imaging device 30 may be a normal digital camera or a camera that acquires a normal planar image such as a smartphone, or may be a wide-angle camera capable of acquiring a wide-angle image having an angle of view equal to or greater than a predetermined value. Further, hereinafter, the imaging device 30 is an omnidirectional (all-round) imaging device using two imaging elements, but the number of imaging elements may be two or more. Also, it is not necessarily an apparatus dedicated to omnidirectional imaging, and a substantially the same function as the imaging device 30 may be achieved by attaching an after-market omnidirectional imaging unit to a normal digital camera, a smartphone, or the like.
[0033] As shown in FIG. 5, the imaging device 30 includes an imaging unit 301, an image processing unit 304, an imaging control unit 305, a microphone 308, an audio processing unit 309, a CPU (Central Processing Unit) 311, a ROM (Read Only Memory) 312, an SRAM (Static Random Access Memory) 313, a DRAM (Dynamic Random Access Memory) 314, an operation unit 315, an input / output I / F (Interface) 316, a short-range communication circuit 317, an antenna 317a of the short-range communication circuit 317, an electronic compass 318, a gyro sensor 319, an acceleration sensor 320, and a network I / F 321.
[0034] Among these, the imaging unit 301 includes wide-angle lenses 302a and 302b (so-called fish-eye lenses) each having an angle of view of 180° or more for forming a hemispherical image (hereinafter referred to as lens 302 when there is no need to distinguish them), and two imaging elements 303a and 303b provided corresponding to each lens. The imaging elements 303a and 303b are image sensors such as CMOS (Complementary Metal Oxide Semiconductor) sensors or CCD (Charge Coupled Device) sensors that convert the optical images formed by the lenses 302a and 302b into image data of electrical signals and output them, a timing generation circuit that generates horizontal or vertical synchronization signals and pixel clocks of this image sensor, and a register group in which various commands or parameters necessary for the operation of this imaging element are set, etc.
[0035] The imaging elements 303a and 303b of the imaging unit 301 are each connected to the image processing unit 304 via a parallel I / F bus. On the other hand, the imaging elements 303a and 303b of the imaging unit 301 are each connected to the imaging control unit 305 via a serial I / F bus (such as an I2C bus). The image processing unit 304, the imaging control unit 305, and the audio processing unit 309 are connected to the CPU 311 via the bus 310. Further, the bus 310 is also connected to a ROM 312, an SRAM 313, a DRAM 314, an operation unit 315, an input / output I / F 316, a short-range communication circuit 317, an electronic compass 318, a gyro sensor 319, an acceleration sensor 320, a network I / F 321, etc.
[0036] The image processing unit 304 takes in the image data output from the imaging elements 303a and 303b through the parallel I / F bus, performs predetermined processing on each of the image data, and then synthesizes these image data to create data of an orthographic cylindrical projection image.
[0037] The imaging control unit 305 generally sets commands and the like in the register groups of the imaging elements 303a and 303b using the I2C bus, with the imaging control unit 305 as the master device and the imaging elements 303a and 303b as slave devices. The necessary commands and the like are received from the CPU 311. Also, the imaging control unit 305 similarly uses the I2C bus to capture status data and the like of the register groups of the imaging elements 303a and 303b and send it to the CPU 311.
[0038] In addition, the imaging control unit 305 instructs the imaging elements 303a and 303b to output image data at the timing when the shutter button of the operation unit 315 is pressed. Depending on the imaging device 30, it may have a preview display function using a display (for example, the display of an external terminal such as a smartphone that performs short-range communication with the imaging device 30 using the short-range communication circuit 317) or a function corresponding to video display. In this case, the output of image data from the imaging elements 303a and 303b is continuously performed at a predetermined frame rate (frames / minute).
[0039] Also, as will be described later, the imaging control unit 305 also functions as synchronization control means for synchronizing the output timing of the image data of the imaging elements 303a and 303b in cooperation with the CPU 311. Note that in this embodiment, the imaging device 30 is not provided with a display unit (display), but a display unit may be provided. The microphone 308 converts sound into sound (signal) data. The sound processing unit 309 captures the sound data output from the microphone 308 through the I / F bus and performs predetermined processing on the sound data.
[0040] The CPU 311 controls the overall operation of the imaging device 30 and executes necessary processing. The ROM 312 stores various programs for the CPU 311. The SRAM 313 and DRAM 314 are work memories that store programs executed by the CPU 311, data during processing, and the like. In particular, the DRAM 314 stores image data during processing in the image processing unit 304 and data of the processed orthographic cylindrical projection images.
[0041] The operation unit 315 is a general term for various operation buttons, power switches, shutter buttons, and touch panels that combine display and operation functions. The user inputs various shooting modes, shooting conditions, etc. by operating the operation unit 315.
[0042] The input / output I / F 316 is a general term for interface circuits (such as USB I / F) with external media such as SD cards or personal computers, etc. The input / output I / F 316 can be either wireless or wired. The data of the orthographic cylindrical projection image stored in the DRAM 314 is recorded on an external medium via the input / output I / F 316, or transmitted to an external terminal (device) via the input / output I / F 316 as required.
[0043] The short-distance communication circuit 317 communicates with an external terminal (device) by short-distance wireless communication technologies such as NFC (Near Field Communication), Bluetooth (registered trademark), or Wi-Fi via the antenna 317a provided in the imaging device 30. The short-distance communication circuit 317 can transmit the data of the orthographic cylindrical projection image to the external terminal (device).
[0044] The electronic compass 318 calculates the orientation of the imaging device 30 from the earth's magnetism and outputs orientation information. This orientation information is an example of related information (metadata) conforming to Exif and is used for image processing such as image correction of the captured image. Note that the related information also includes each data such as the shooting date and time of the image and the data volume of the image data. Further, the gyro sensor 319 is a sensor that detects changes in angles (Roll angle, Pitch angle, Yaw angle) accompanying the movement of the imaging device 30. The change in angle is an example of related information (metadata) conforming to Exif and is used for image processing such as image correction of the captured image. Furthermore, the acceleration sensor 320 is a sensor that detects acceleration in three axial directions. The imaging device 30 calculates the attitude (angle with respect to the gravity direction) of its own device (imaging device 30) based on the acceleration detected by the acceleration sensor 320. By providing the acceleration sensor 320, the accuracy of image correction of the imaging device 30 is improved. The network I / F 321 is an interface for performing data communication using the communication network 100 such as the Internet via a router or the like.
[0045] ○ Hardware Configuration of Management Server ○ Next, the hardware configuration of the management server 50 will be described with reference to FIG. 6. FIG. 6 is a diagram showing an example of the hardware configuration of the management server. Each hardware configuration of the management server 50 is indicated by a reference numeral in the 500s. The management server 50 is constructed by a computer and, as shown in FIG. 6, includes a CPU 501, a ROM 502, a RAM 503, an HD 504, an HDD controller 505, a display 506, an external device connection I / F 508, a network I / F 509, a bus line 510, a keyboard 511, a pointing device 512, a DVD-RW drive 514, and a media I / F 516.
[0046] Among these, the CPU 501 controls the operation of the entire management server 50. The ROM 502 stores programs used to drive the CPU 501 such as the IPL. The RAM 503 is used as the work area of the CPU 501. The HD 504 stores various data such as programs. The HDD controller 505 controls the reading or writing of various data to and from the HD 504 according to the control of the CPU 501. The display 506 displays various information such as a cursor, menu, window, characters, or images. Note that the display 506 may be a touch panel display having an input means. The external device connection I / F 508 is an interface for connecting various external devices. The network I / F 509 is an interface for performing data communication using the communication network 100. The bus line 510 is an address bus, data bus, etc. for electrically connecting each component such as the CPU 501 shown in FIG. 6.
[0047] Also, the keyboard 511 is a type of input means having a plurality of keys for inputting characters, numerical values, various instructions, etc. The pointing device 512 is a type of input means for selecting or executing various instructions, selecting a processing target, or moving a cursor, etc. Note that the input means may be not only the keyboard 511 and the pointing device 512 but also a touch panel or a voice input device, etc. The DVD-RW drive 514 controls the reading or writing of various data to and from the DVD-RW 513 as an example of a removable recording medium. Note that the removable recording medium is not limited to the DVD-RW and may be a DVD-R or a Blu-ray Disc, etc. The media I / F 516 controls the reading or writing (storage) of data to and from the recording medium 515 such as a flash memory.
[0048] ○Hardware Configuration of the Authorization Server○ FIG. 6 is a diagram showing an example of the hardware configuration of the authorization server. Each hardware configuration of the authorization server 70 is indicated by a reference numeral in the 700s in parentheses. The authorization server 70 is constructed by a computer and has the same configuration as the management server 50 as shown in FIG. 6, so the description of each hardware configuration is omitted.
[0049] Note that each of the above programs may be in an installable format or an executable format file and may be recorded on a computer-readable recording medium and distributed. Examples of the recording medium include CD-R (Compact Disc Recordable), DVD (Digital Versatile Disk), Blu-ray Disc, SD card, USB memory, etc. Further, the recording medium can be provided as a program product (Program Product) domestically or abroad. For example, the management system 5 realizes the processing method according to the present invention when the program according to the present invention is executed.
[0050] ●Functional configuration Next, with reference to FIGS. 7 to 11, the functional configuration of the communication system according to the embodiment will be described. FIG. 7 is a diagram showing an example of the functional configuration of the communication system. Note that FIG. 7 shows those of the devices or terminals shown in FIG. 1 that are related to the processing or operations described later.
[0051] ○Functional configuration of the communication terminal○ First, with reference to FIG. 7, the functional configuration of the communication terminal 10 will be described. The communication terminal 10 has a transmission / reception unit 11, a reception unit 12, a display control unit 13, a determination unit 14, and a storage / read unit 19. Each of these units is a function or means realized by any of the components shown in FIG. 4 operating according to an instruction from the CPU 101 according to the communication terminal program expanded from the HD 104 onto the RAM 103. Further, the communication terminal 10 has a storage unit 1000 constructed by the ROM 102, HD 104, or recording medium 121 shown in FIG. 4.
[0052] The transmission / reception unit 11 is mainly realized by the processing of the CPU 101 with respect to the network I / F 108, and transmits and receives various data or information to and from other devices or terminals via the communication network 100.
[0053] The reception unit 12 is mainly realized by the processing of the CPU 101 with respect to the keyboard 111 or the pointing device 112, and receives various selections or inputs from the user.
[0054] The display control unit 13 is mainly realized by the processing of the CPU 101, and causes the display 106 to display various screen data by accessing the management server 50 using a web browser. Specifically, the display control unit 13 accesses the management server 50, for example, by starting and executing an application or a browser installed in the communication terminal 10. Then, the display control unit 13 downloads a WebAPP (Web Application) that includes at least HTML (HyperText Markup Language) and includes CSS (Cascading Style Sheets) or JAVA SCRIPT (registered trademark), etc., and causes the display 106 to display various image data generated by the WebAPP. The display control unit 13 causes the display 106 to display, for example, image data generated by the HTM L to Thus generated image data on the display 106.
[0055] The determination unit 14 is realized by the processing of the CPU 101 and makes various determinations.
[0056] The storage / reading unit 19 is mainly realized by the processing of the CPU 101, and stores various data (or information) in the storage unit 1000 and reads out various data (or information) from the storage unit 1000.
[0057] ○Functional Configuration of the Imaging Device○ Next, the functional configuration of the imaging device 30 will be described with reference to FIG. 7. The imaging device 30 includes a transmission / reception unit 31, an app activation unit 32, an imaging control unit 33, and a storage / reading unit 39. Each of these units is a function or means realized by any of the components shown in FIG. 5 operating according to instructions from the CPU 311 according to a program for the imaging device developed from the SRAM 313 onto the DRAM 314. Further, the imaging device 30 has a storage unit 3000 constructed by the ROM 312, SRAM 313, and DRAM 314 shown in FIG. 5. The storage unit 3000 stores the GUID (Globally Unique Identifier) of the device itself.
[0058] The transmission / reception unit 31 is mainly realized by the processing of the CPU 311 and communicates various data or information with other devices or terminals. Further, the transmission / reception unit 31 uses the network I / F 321 to perform data communication with other devices or terminals via the communication network 100.
[0059] The app activation unit 32 is mainly realized by the processing of the CPU 311 and activates an application to participate in an event provided by the management server 50 in response to a request from the management server 50. The imaging device 30 participates in an event provided by the management server 50 by activating the application installed by the app activation unit 32.
[0060] The imaging control unit 33 is mainly realized by the processing of the CPU 311 for the imaging unit 301, the image processing unit 304, and the imaging control unit 305, and captures a subject such as a landscape and acquires captured image data.
[0061] The memory / reading unit 39 is mainly realized by the processing of the CPU 311, and stores various data (or information) in the storage unit 3000 and reads out various data (or information) from the storage unit 3000. Further, the shooting image data acquired by the shooting process of the shooting control unit 33 is stored in the storage unit 3000. The shooting time of the shooting image is associated as metadata with the shooting image data stored in the storage unit 3000.
[0062] ○Functional Configuration of Management Server○ Next, the functional configuration of the management server 50 will be described with reference to FIG. 7. The management server 50 includes a transmission / reception unit 51, a determination unit 52, an authorization processing unit 53, an operation information generation unit 54, a message processing unit 55, an upload processing unit 56, and a memory / reading unit 59. Each of these units is a function or means realized by the operation of any of the components shown in FIG. 6 according to an instruction from the CPU 501 according to the management server program expanded from the HD 504 onto the RAM 503. Further, the management server 50 has a storage unit 5000 constructed by the ROM 502, the HD 504, or the recording medium 515 shown in FIG. 6.
[0063] The transmission / reception unit 51 is mainly realized by the processing of the CPU 501 with respect to the network I / F 509, and transmits and receives various data or information to and from other devices or terminals via the communication network 100.
[0064] The determination unit 52 is realized by the processing of the CPU 501 and makes various determinations. The authorization processing unit 53 is mainly realized by the processing of the CPU 501 and performs authentication processing for users using the authorization server 70.
[0065] The operation information generation unit 54 is mainly implemented by the processing of the CPU 501, and generates operation information regarding an operation requested for a device such as the imaging device 30 based on an operation request for the device transmitted from the communication terminal 10. For example, the operation information generation unit 54 generates operation information in which operation identification information for identifying a device operation corresponding to the received operation request is associated with an authorization token for the external storage 90 of the user who is the request source. The management server 50 stores the operation information generated by the operation information generation unit 54, and uses the authorization token included in the stored operation information in a subsequent process.
[0066] The message processing unit 55 is mainly implemented by the processing of the CPU 501, and executes processing for performing arbitrary message exchange among participants participating in an event. For example, in response to a message transmission request transmitted from the communication terminal 10 used by a user who is a participant in the event, the message processing unit 55 transmits a message to a device such as the imaging device 30 that is another participant in the event.
[0067] The upload processing unit 56 is mainly implemented by the processing of the CPU 501, and uploads data acquired in response to a device operation such as the imaging device 30 to the external storage 90 to which the user who is the request source has access authority, using the authorization token included in the operation information generated by the operation information generation unit 54.
[0068] The storage / reading unit 59 is mainly implemented by the processing of the CPU 501, and stores various data (or information) in the storage unit 5000 and reads out various data (or information) from the storage unit 5000. Note that the storage unit 5000 may be configured as an external storage device of the management server 50.
[0069] ○User information management table FIG. 8 is a conceptual diagram showing an example of a user information management table. In the storage unit 5000, a user information management DB 5001 configured by a user information management table as shown in FIG. 8 is constructed.
[0070] The user information management table manages user identification information (user ID and user name) for identifying users managed by the management server 50, and user information associated with an authorization token for the external storage 90. Among these, the authorization token is access information for accessing the external storage 90 with which the user contracts, that is, the external storage 90 to which the user has access rights. That is, the authorization token is uniquely specified for each user. The user information management table stores, as user information, an authorization token, which is access information for accessing the external storage 90, in association with each user.
[0071] ○ Device management table FIG. 9 is a conceptual diagram showing an example of the device management table. The device management table is a table for managing devices such as the imaging device 30 registered in the management server 50. In the storage unit 5000, a device management DB 5002 configured by a device management table as shown in FIG. 9 is constructed.
[0072] The device management table manages, in association with each site ID for identifying a distribution site, a device ID and a device name for identifying a device installed at the distribution site. When an event in which a predetermined distribution site participates starts, the management server 50 starts an application installed on each device managed in the device management table, and uses the started application to make each device participate in the event.
[0073] ○ Operation information management table FIG. 10 is a conceptual diagram showing an example of the operation information management table. The operation information management table is a table for managing operation information regarding operations requested for devices such as the imaging device 30. In the storage unit 5000, an operation information management DB 5003 configured by an operation information management table as shown in FIG. 10 is constructed.
[0074] The operation information management table manages by associating operation identification information (operation ID) that identifies the device operations requested of the device, device ID that identifies the device for which the device operation is requested, and an authorization token for the external storage 90 of the user who is the requester of the device operation. The management server 50 stores the operation information generated by the operation information generation unit 54 in response to a request from the user in the operation information management table.
[0075] ○Function Configuration of Authorization Server○ Next, the function configuration of the authorization server 70 will be described with reference to FIG. 7. The authorization server 70 includes a transmission / reception unit 71, an authentication unit 72, and a storage / reading unit 79. Each of these units is a function or means realized by operating any of the components shown in FIG. 6 according to an instruction from the CPU 701 according to the authorization server program expanded from the HD 704 onto the RAM 703. Further, the authorization server 70 has a storage unit 7000 constructed by the ROM 702, HD 704, or recording medium 715 shown in FIG. 6.
[0076] The transmission / reception unit 71 is mainly realized by the processing of the CPU 701 for the network I / F 709, and transmits and receives various data or information to and from other devices or terminals via the communication network 100. The authentication unit 72 is realized by the processing of the CPU 701, and performs authentication processing of the users managed by the authorization server 70.
[0077] The storage / reading unit 79 is mainly realized by the processing of the CPU 701, and stores various data (or information) in the storage unit 7000 and reads out various data (or information) from the storage unit 7000.
[0078] ○Authentication Information Management Table FIG. 11 is a conceptual diagram showing an example of the authentication information management table. In the storage unit 7000, an authentication information management DB 7001 configured by an authentication information management table as shown in FIG. 11 is constructed.
[0079] The authentication information management table manages user identification information (user ID and user name) that identifies users managed by the authorization server 70, and the authentication information of users associated with passwords. For example, in the authentication information management table shown in FIG. 11, for example, it is shown that the user ID of the user with the user name "Alice" is "A001" and the password is "a0101". Note that the user identification information only needs to include either the user ID or the user name that identifies the user.
[0080] ●Processing or operations of the embodiment ○User authentication processing○ Subsequently, with reference to FIGS. 12 to 17, the processing or operations of the communication system according to the embodiment will be described. First, with reference to FIG. 12, the authentication processing for a user to participate in an event executed via the management server 50 using the communication terminal 10 will be described. FIG. 12 is a sequence diagram showing an example of user authentication processing. As a premise, the communication system 1 will be described on the assumption that the management server 50 transfers authentication to the authorization server 70 based on the OAuth 2.0 / OpenID Connect process and the use of the external storage 90 is also authorized. FIG. 12 shows an example of the case where, in order to start an event such as remote communication, the communication terminal 10 accesses the management system 5 for authentication and authorization and starts the event. Also, FIG. 12 describes an example of performing the authentication and authorization processing for the user "Alice" using the communication terminal 10A.
[0081] First, the reception unit 12 of the communication terminal 10A receives a predetermined input operation of the user (step S11). Specifically, the reception unit 12, for example, starts an application or a browser installed on the communication terminal 10A and receives the input of a predetermined URL (Uniform Resource Locator).
[0082] Next, the transmission / reception unit 11 of the communication terminal 10A transmits a screen display request for requesting participation in a predetermined event to the management server 50 (step S12). Then, the authorization processing unit 53 of the management server 50 redirects the received screen display request to the communication terminal 10A that is the request source (step S13).
[0083] Next, the transmission / reception unit 11 of the communication terminal 10A transmits a login request for a predetermined event to the authorization server 70 (step S14). As a result, the transmission / reception unit 71 of the authorization server 70 receives the login request transmitted from the communication terminal 10A. Next, the transmission / reception unit 71 of the authorization server 70 transmits login screen information to the communication terminal 10A that is the request source (step S15). As a result, the transmission / reception unit 11 of the communication terminal 10A receives the login screen information transmitted from the authorization server 70.
[0084] Next, the display control unit 13 of the communication terminal 10A causes the display 106 to display a login screen based on the login screen information received in step S15 (step S16). Then, when the user inputs authentication information to the login screen, the reception unit 12 receives the input of the authentication information (step S17). In this case, the user "Alice" inputs her own user identification information (user ID or user name) and password, and the reception unit 12 receives the input user identification information and password as authentication information.
[0085] Next, the transceiver unit 11 transmits the authentication information entered on the login screen in step S17 to the authorization server 70 (step S18). As a result, the transceiver unit 71 of the authorization server 70 receives the authentication information transmitted from the communication terminal 10A. Next, the authentication unit 72 of the authorization server 70 searches the authentication information management DB 7001 (see FIG. 11) using the user identification information and password included in the authentication information received in step S18 as search keys. Then, the authentication unit 72 performs authentication by determining whether a set of the same user identification information and password is managed in the authentication information management DB 7001 (step S19). Hereinafter, the case where the user "Alice" is determined by the authentication unit 72 to be a user with legitimate usage rights will be described.
[0086] Next, the transceiver unit 71 of the authorization server 70 transmits an authentication success notification indicating that the authentication of the user "Alice" has been successful to the communication terminal 10A which is the transmission source of the authentication information (step S20). As a result, the transceiver unit 11 of the communication terminal 10A receives the authentication success notification transmitted from the authorization server 70.
[0087] Next, the transceiver unit 11 of the communication terminal 10A communicates with the management server 50 to participate in the authenticated event (step S21). When the event starts, the communication terminal 10A causes an event screen 200 described later to be displayed via the browser.
[0088] Also, the authorization processing unit 53 of the management server 50 sends an authorization token acquisition request to the authorization server 70 to request the acquisition of an authorization token (access_token) for the external storage 90 of the user "Alice" who participated in the event (step S22). As a result, the transmission / reception unit 71 of the authorization server 70 receives the authorization token acquisition request transmitted from the management server 50. Then, the authorization server 70 transmits the authorization token for the external storage 90 of the user "Alice" and the user identification information for identifying the user "Alice" to the source management server 50 (step S23). As a result, the authorization processing unit 53 of the management server 50 receives the authorization token and the user identification information transmitted from the authorization server 70.
[0089] Then, the storage / reading unit 59 of the management server 50 stores the user information associating the authorization token and the user identification information received in step S23 in the user information management DB 5001 (step S23).
[0090] In this way, the communication system 1 performs the authentication process for the user participating in the event using the management system 5 and stores the authorization token (access_token) for the external storage of the authenticated user. Note that devices such as the imaging device 30 participate in the event by starting an application and directly communicating with the management server 50 in response to a request from the management server 50 when the event is started.
[0091] ○ File upload process ○ Next, with reference to FIGS. 13 to 17, a process of uploading a captured image by a photographing device 30, which is an example of a device, to an external storage in response to a request from the communication terminal 10A participating in an event will be described. FIGS. 13 and 14 are sequence diagrams showing an example of a file upload process to an external storage. Here, the communication terminal 10A participates in remote inspection of the site where the photographing device 30, which is an example of an event, is installed, by means of the authentication process for the user "Alice" shown in FIG. 12. It will be described that a plurality of photographing devices 30 (for example, photographing device 30A, photographing device 30B) and other communication terminals 10 (for example, communication terminal 10B) also participate in the event in which the communication terminal 10A participates. The communication terminals 10 and the photographing devices 30 participating in the event transmit and receive the captured images taken at each site via the management server 50.
[0092] First, the display control unit 13 of the communication terminal 10A causes the event screen 200 to be displayed on the display 106 by participating in the event through the authentication process shown in FIG. 12. FIGS. 15 and 16 are diagrams showing screen examples of the event screen. The event screen 200 shown in FIG. 15 is a display screen displayed in an event realized by remote communication via the management server 50 between the communication terminal 10 used by the user who is an event participant and devices such as the photographing device 30 which is an event participant. The event screen 200 includes a site image display area 210 for displaying the captured images of each site participating in the event, a participant display area 230 for displaying the participants participating in the event, and an operation request button 250 to be pressed when a device operation is requested.
[0093] Among these, the base image display area 210 includes the captured images of each base captured by a communication terminal 10 used by a user participating in the event or a device such as a photographing device 30 participating in the event. In the example shown in FIG. 15, in the base image display area 210, a captured image 215a captured by the photographing device 30A which is "deviceA" and a captured image 215b captured by the communication terminal 10A used by the user "Alice" are displayed. Further, the participant display area 230 includes information that can identify a participant, such as a participant name (user name or device name) indicating a participant participating in the event, or an icon of the participant. In the example shown in FIG. 15, the participant display area indicates that the users "Alice", "deviceA", "deviceB" and the user "Mary" are participating in the event.
[0094] Note that, in FIG. 15, an example is shown in which captured images of two participants are displayed in the base image display area 210, but the number of captured images displayed in the base image display area 210 is not limited to this. For example, the base image display area 210 may display captured images from all participants participating in the event, or may display captured images of participants selected by the user based on the user name etc. displayed in the participant display area 230.
[0095] Next, the reception unit 12 receives an operation instruction to a device such as the imaging device 30 when the user presses the operation request button 250 on the event screen 200 (step S32). Specifically, when the user presses the operation request button 250, the display control unit 13 displays a device selection screen 260 as shown in FIG. 16. The device selection screen 260 is a display screen for selecting a device for executing a capture operation of a captured image for uploading an image data file of the captured image data, which is an example of a device operation, to the external storage 90. The device selection screen 260 includes a selection area 265 for selecting a device for instructing a device operation, an "OK" button 268 to be pressed when giving an operation instruction to the device, and a "Close" button 269 to be pressed when canceling the operation instruction to the device. The reception unit 12 receives an operation instruction to the selected device when the user selects the user name or device name displayed in the selection area 265 and presses the "OK" button 268.
[0096] Here, not only devices such as the imaging device 30 but also users "Alice" and "Mary" are displayed as selectable in the selection area 265. However, the communication terminal 10 used by other users other than the user "Alice" who uses the communication terminal 10A can be regarded as a device similar to the imaging device 30. That is, the device in the broad sense in the present embodiment includes a terminal or device not authenticated by the user giving the operation instruction.
[0097] The example shown in FIG. 16 shows a state where the user has selected the imaging device 30A which is "deviceA". Hereinafter, an example in the case of giving a device operation request to the imaging device 30A according to an operation instruction from the user "Alice" will be described.
[0098] The transmitting / receiving unit 11 transmits an operation information generation request for requesting the generation of operation information regarding an operation requested for the imaging device 30A to the management server 50 (step S33). This operation information generation request includes user identification information (user ID or user name) of the authenticated user, device identification information (device ID or device name) for identifying the imaging device 30A for which the request was accepted in step 32, and information indicating the content of the operation to be executed on the imaging device 30A. The operation information generation request here is, for example, a request for generating operation information regarding an operation of a capture request for a captured image with respect to the imaging device 30A. Thereby, the transmitting / receiving unit 51 of the management server 50 receives the operation information generation request transmitted from the communication terminal 10A.
[0099] Next, the storage / reading unit 59 of the management server 50 reads out an authorization token (access_token) associated with the received user identification information by searching the user information management DB5001 (see FIG. 8) using the user identification information received in step S33 as a search key (step S34). Next, the operation information generation unit 54 generates an operation ID for specifying the operation to be executed on the imaging device 30 (step S35). Further, the operation information generation unit 54 generates operation information associating the device identification information received in step S33, the authorization token read out in step S34, and the operation ID generated in step S35. Then, the operation information generation unit 54 stores the generated operation information in the operation information management DB5003 (see FIG. 10) via the storage / reading unit 59 (step S36). In this way, the management server 50 stores the authorization token for accessing the external storage 90 of the user in association with the operation ID so that it can be used in the processing of subsequent steps.
[0100] Next, the transceiver unit 51 transmits destination information, which is a temporary storage destination for data for exchanging operation results of the imaging device 30A, to the communication terminal 10A (step S37). This destination information is uniquely identified for each device operation corresponding to the device operation request received in step S32. The destination information is, for example, a URL indicating a destination on the management server 50. As a result, the transceiver unit 11 of the communication terminal 10A receives the destination information transmitted from the management server 50.
[0101] Next, the transceiver unit 11 of the communication terminal 10A transmits a message transmission request to the imaging device 30A to the management server 50 (step S38). This message transmission request includes a device ID (D001) that identifies the imaging device 30A, which is the transmission destination of the message, an operation command requested for the imaging device 30A, and the destination information received in step S37. As a result, the transceiver unit 51 of the management server 50 receives the message transmission request transmitted from the communication terminal 10A.
[0102] Next, the message processing unit 55 of the management server 50 transmits a message (an example of the first message) corresponding to the message transmission request received in step S38 to the imaging device 30A identified by the device ID indicated in the received message transmission request (step S39). This message includes the operation command and the destination information included in the message transmission request received in step S38. As a result, the transceiver unit 31 of the imaging device 30A receives the message transmitted from the management server 50.
[0103] Next, the imaging device 30A performs processing based on the operation command indicated in the message received in step S39 (step S40). In this case, since the received operation command is "capture", the imaging device 30A performs imaging processing by the imaging control unit 33.
[0104] Next, the transmission / reception unit 31 of the imaging device 30A uses the destination information indicated in the message received in step S39 to transmit the image data file of the captured image data obtained by the process in step S40 to the management server 50 (step S41). As a result, the transmission / reception unit 51 of the management server 50 receives the image data file transmitted from the imaging device 30A.
[0105] Next, the storage / reading unit 59 of the management server 50 reads out the authorization token (access_token) associated with the operation ID generated in step 53 from the operation information management DB5003 (step S42). Then, the upload processing unit 56 transmits a file upload request to the external storage 90 (step S43). This file upload request includes the authorization token read in step S42 and the image data file received in step S41.
[0106] The external storage 90 performs an authentication process using the authorization token transmitted from the management server 50. Since this authorization token is the authorization token corresponding to the user "Alice", it is authenticated using the authentication information of "Alice". Then, the external storage 90 stores the image data file transmitted from the management server 50 in the folder of the authenticated "Alice".
[0107] Then, the external storage 90 transmits an upload completion notification to the management server 50 (step S44). As a result, the transmission / reception unit 51 of the management server 50 receives the upload completion notification transmitted from the external storage 90.
[0108] Next, the transmission / reception unit 51 of the management server 50 transmits a process completion notification to the imaging device 30A that transmitted the image data file in step S41 (step S45). As a result, the transmission / reception unit 31 of the imaging device 30A receives the process completion notification transmitted from the management server 50.
[0109] Next, the transmission / reception unit 31 of the imaging device 30A transmits a message transmission request to the communication terminal 10A to the management server 50 (step S46). This message transmission request includes the operation command and destination information included in the message received in step S39, and information indicating that the device operation has been completed. As a result, the transmission / reception unit 51 of the management server 50 receives the message transmission request transmitted from the imaging device 30A.
[0110] Next, in response to the message transmission request received in step S46, the message processing unit 55 of the management server 50 transmits a message (an example of the second message) indicating that the upload of the image data file by the imaging device 30A has been completed to the communication terminal 10A used by the user "Alice" identified by the user ID indicated in the received message transmission request (step S47). As a result, the transmission / reception unit 11 of the communication terminal 10A receives the message transmitted from the management server 50. Then, the communication terminal 10A can notify the user "Alice" that the device operation requested has been completed by displaying a predetermined display screen indicating that the upload has been completed in response to the received message.
[0111] Also, the communication terminal 10A performs a browsing process on the uploaded file by accessing the external storage 90 according to the access authority of the user "Alice" (step S48). FIG. 17 is a diagram showing an example of a file browsing screen. The display control unit 13 of the communication terminal 10A accesses the external storage 90 according to the access authority of the user "Alice" and displays the file browsing screen 400 shown in FIG. 17 on the display 106.
[0112] The file browsing screen 400 includes a list display area 410 that shows a list of data files uploaded to the folder of user "Alice" on the external storage 90, and an "Open" button 420 that is pressed when viewing the content of the uploaded file. Among these, the list display area 410 includes the file names of the uploaded data files and the upload date and time.
[0113] When user "Alice" selects a predetermined data file shown in the list display area 410 and presses the "Open" button 420, the display control unit 13 displays the selected data file. The example shown in FIG. 17 shows a state where the uploaded file "deviceAyyyy.jpg" is selected.
[0114] In this way, the communication system 1 temporarily stores the authorization token for the user's external storage 90 in the management server 50 in response to a device operation request from a user participating in the event. Then, the management server 50 uses the temporarily stored authorization token to upload the data obtained by the requested device operation to the user's external storage 90.
[0115] ● Effects of the Embodiment As described above, the communication system 1 can upload the data obtained by the device to the external storage 90 to which the user has the authority only by the selection operation of the device participating in the event, so the labor required for the user's upload process can be reduced.
[0116] In addition, the communication system 1 can directly upload the data obtained from the device to the user's external storage 90 without performing a device operation by the user and user authentication on the device, so the upload process can be performed without passing the access information to the external storage 90 such as the user's authorization token to the device.
[0117] ● Summary ● As described above, the management system according to an embodiment of the present invention is a management system 5 that manages a predetermined event executed by communication between a communication terminal 10 used by a user and a device (for example, a photographing device 30) that performs remote communication with the communication terminal 10. The management system 5 receives an operation request from a user authenticated by the management system 5 and transmitted from the communication terminal 10 for a specific device, and stores operation identification information (for example, operation ID) that identifies a device operation related to the received operation request, and an authorization token (an example of access information) for the user's external storage 90 in association with each other. Then, the management system 5 uploads data acquired by a specific device according to the device operation corresponding to the stored operation identification information to the external storage 90 using the authorization token associated with the operation identification information. Thereby, the management system 5 can reduce the labor of the process when uploading the data acquired by the device to the external storage with the user authority.
[0118] In addition, the management system according to an embodiment of the present invention generates operation information in which operation identification information (e.g., operation ID), an authorization token (an example of access information), and device identification information (e.g., device ID) for identifying a specific device are associated based on a received operation request, and stores the generated operation information. Further, the management system 5 transmits destination information (e.g., URL) for performing data exchange obtained by a device operation related to the received operation request to the communication terminal 10, and in response to a message transmission request from the communication terminal 10 including the destination information to a specific device, transmits a first message to the specific device. Furthermore, the management system 5 receives data obtained by a device operation corresponding to the transmitted first message from the specific device, and uploads the received data to the external storage 90 using the stored authorization token. As a result, the management system 5 can directly upload data obtained from the device to the external storage 90 of the user without performing a device operation by the user and user authentication on the device, so that the upload process can be performed without passing access information such as the user's authorization token to the external storage 90 to the device.
[0119] Furthermore, a communication system according to an embodiment of the present invention is a communication system 1 including a management system 5 and a communication terminal 10, wherein the communication terminal 10 displays a captured image captured by a device (e.g., a photographing device 30) installed at a remote site on a display 10 6 (an example of a display unit), accepts selection of a specific device that instructs a capture request for the displayed captured image, and transmits an operation request for the accepted specific device to the management system 5. As a result, the communication system 1 can cause the user to upload data obtained by the device to the external storage 90 to which the user has authority only by a selection operation of a device participating in an event, so that the labor required for the user's upload process can be reduced.
[0120] Also, in the communication system according to an embodiment of the present invention, the communication terminal 10 causes the display 106 (an example of a display unit) to display a browsing screen of data uploaded to the external storage 90 (an example of the file browsing screen 400) based on an authorization token (an example of access information) of a user authenticated by the management system 5. Thereby, in the communication system 1, a user having an access right can access the external storage 90 to browse data directly uploaded from the device.
[0121] ●Supplementary● Each function of the embodiment described above can be realized by one or more processing circuits. Here, the "processing circuit" in the present embodiment refers to a processor programmed to execute each function by software like a processor implemented by an electronic circuit, and an ASIC (Application Specific Integrated Circuit), DSP (digital signal processor), FPGA (field programmable gate array), SOC (System on a chip), GPU (Graphics Processing Unit) designed to execute each function described above, and devices such as conventional circuit modules.
[0122] Also, the various tables of the embodiment described above may be generated by the learning effect of machine learning, and the data of each associated item may be classified by machine learning so that the tables may not be used. Here, machine learning is a technology for enabling a computer to acquire a learning ability like a human. That is, the computer autonomously generates an algorithm necessary for judgment such as data identification from learning data taken in advance and applies this to new data for prediction. The learning method for machine learning may be any one of supervised learning, unsupervised learning, semi-supervised learning, reinforcement learning, and deep learning, and further, a learning method combining these learning methods may be used, and the learning method for machine learning is not limited.
[0123] Although the management system, communication system, processing method, and program according to an embodiment of the present invention have been described so far, the present invention is not limited to the above-described embodiment, and can be changed within the scope that those skilled in the art can conceive, such as addition, change, or deletion of other embodiments. As long as the functions and effects of the present invention are achieved in any aspect, it is included in the scope of the present invention.
Explanation of Reference Numerals
[0124] 1 Communication system 5 Management system 10 Communication terminal 11 Transmission / reception unit (an example of operation request transmission means) 12 Reception unit 13 Display control unit (an example of display control means) 30 Imaging device 31 Transmission / reception unit 33 Imaging control unit 50 Management server 51 Transmission / reception unit (an example of operation request reception means, an example of transmission means, an example of data reception means) 54 Operation information generation unit (an example of operation information generation means) 55 Message processing unit (an example of message processing means) 56 Upload processing unit (an example of upload processing means) 70 Authorization server 90 External storage 200 Event screen 400 File viewing screen (an example of viewing screen) 5000 Storage unit (an example of storage means)
Claims
1. A management system for managing a predetermined event executed by communication between a communication terminal used by a user and a device that performs remote communication with the communication terminal, an acquisition means for acquiring access information of the user to an external storage by an authentication process of the management system by the communication terminal; an operation request receiving means for receiving an operation request from a user authenticated by the management system, which is transmitted from the communication terminal, for a specific device; a storage means for storing operation identification information for identifying a device operation related to the received operation request and associating the access information; a transmission means for transmitting destination information for performing data exchange of the data acquired by the device operation related to the received operation request to the communication terminal; a message processing means for transmitting a first message to the specific device in response to a message transmission request from the communication terminal including the destination information to the specific device; an upload processing means for uploading data acquired by the specific device according to the device operation corresponding to the stored operation identification information to the external storage using the access information associated with the operation identification information; A management system comprising:
2. The management system according to claim 1, further comprising: an operation information generation means for generating operation information in which the operation identification information, the access information, and device identification information for identifying the specific device are associated based on the received operation request; The storage means stores the generated operation information. A management system.
3. The management system according to claim 1 or 2, further comprising: a data receiving means for receiving data acquired by the device operation in response to the transmitted first message from the specific device; The upload processing means uploads the received data to the external storage using the access information. A management system.
4. The management system according to claim 3, wherein when receiving a data upload completion notification from the external storage, the message processing means transmits a second message indicating that the device operation has been completed to the communication terminal in response to a message transmission request from the specific device to the communication terminal.
5. The operation requirement is a capture requirement for a captured image taken by the device, The upload processing means uploads the captured image data obtained by the device operation to the external storage. The management system according to any one of claims 1 to 4.
6. A communication system comprising a management system that manages a predetermined event executed by communication between a communication terminal used by a user and a device that performs remote communication with the communication terminal, An acquisition means for acquiring access information of the user to the external storage by an authentication process of the management system by the communication terminal; An operation request receiving means for receiving an operation request from a specific device from a user authenticated by the management system, transmitted from the communication terminal; A storage means for storing in association an operation identification information for identifying a device operation related to the received operation request and the access information; A transmission means for transmitting destination information for data exchange of the device operation related to the received operation request to the communication terminal; A message processing means for transmitting a first message to the specific device in response to a message transmission request from the communication terminal including the destination information to the specific device; An upload processing means for uploading data obtained by the specific device according to the device operation corresponding to the stored operation identification information to the external storage using the access information associated with the operation identification information; A communication system comprising.
7. The communication system according to claim 6, further comprising: The communication terminal is provided, The communication terminal is A display control means for displaying a captured image taken by the device on a display unit; A reception means for receiving a selection of the specific device for instructing a capture request of the displayed captured image; An operation request transmission means for transmitting the operation request for the specific device received to the management system; A communication system comprising.
8. The communication system according to claim 7, The display control means displays a browsing screen of the data uploaded to the external storage on the display unit based on the access information of the user authenticated by the management system. A communication system.
9. A processing method executed by a management system that manages a predetermined event executed by communication between a communication terminal used by a user and a device that performs remote communication with the communication terminal, an acquisition step of acquiring access information of the user to an external storage by an authentication process of the communication terminal to the management system; and an operation request reception step of receiving an operation request from a user authenticated by the management system, which is transmitted from the communication terminal, for a specific device; a storage control step of storing, in a storage unit, by associating operation identification information for identifying a device operation related to the received operation request and the access information; a transmission step of transmitting, to the communication terminal, destination information for performing an exchange of data acquired by the device operation related to the received operation request; a message processing step of transmitting a first message to the specific device in response to a message transmission request from the communication terminal including the destination information to the specific device; an upload processing step of uploading data acquired by the specific device according to the device operation corresponding to the stored operation identification information to the external storage using the access information associated with the operation identification information; A processing method for executing the above.
10. A program for causing a computer to execute the processing method according to Claim 9.
Citation Information
Patent Citations
Subject Matter Management Network
JP2007529826A
Imaging device, image provision server device, and image provision program
JP2013017050A
Information management server, information upload system, information upload method, and information upload program
JP2014071494A
Information processing system, electronic blackboard device, and program
JP2019134399A
Communication device, communication system, communication method, and communication program
WO2017090185A1