Information processing method, information processing device, and information system

Abstract

To enable an electronic device that does not support encrypted communication to be controlled via a network while ensuring security.SOLUTION: When an information processing device 20 receives a notification from a server device 30 indicating that the control information of an electronic device 10 has been acquired, the information processing device 20 acquires the control information described in the first WebAPI by communicating with the server device 30 according to the https protocol using the first WebAPI, and generates control information described in the second WebAPI from the acquired control information. The information processing device 20 transmits the control information described in the second WebAPI to the electronic device 10 by communicating with the electronic device 10 according to the http protocol using the second WebAPI.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to an information processing method, an information processing device, and an information system. [Background technology]

[0002] Various technologies have been proposed for controlling electronic devices such as projectors via a network. For example, Patent Document 1 discloses a projection screen control method in which, when multiple computers are connected to a single projector, the screen projected by the projector can be operated from all of the computers. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2011-215530 Summary of the Invention [Problem to be solved by the invention]

[0004] When controlling electronic devices such as projectors via a network, there are cases where security cannot be ensured sufficiently, for example, when the electronic device to be controlled does not support encrypted communication. Because it is costly to replace electronic devices with new ones that support encrypted communication, there was a need for a way to ensure security while continuing to use electronic devices that do not support encrypted communication. [Means for solving the problem]

[0005] One aspect of the information processing method of the present disclosure includes, when receiving a notification from a server device indicating that control information of an electronic device has been acquired, an information processing device acquiring the control information described in the first WebAPI by communicating with the server device using a first WebAPI in accordance with the https protocol; the information processing device generating control information described in a second WebAPI different from the first WebAPI from the control information described in the first WebAPI; and the information processing device transmitting the control information described in the second WebAPI to the electronic device by communicating with the electronic device using the second WebAPI in accordance with the http protocol.

[0006] Furthermore, one aspect of an information processing device of the present disclosure includes at least one processor, and when the at least one processor receives a notification from a server device indicating that control information of an electronic device has been acquired, the at least one processor acquires the control information described in the first WebAPI by communicating with the server device using a first WebAPI according to the https protocol, generates control information described in a second WebAPI different from the first WebAPI from the control information described in the first WebAPI, and transmits the control information described in the second WebAPI to the electronic device by communicating with the electronic device using the second WebAPI according to the http protocol.

[0007] Furthermore, one aspect of the information system of the present disclosure includes an information processing device that communicates with a server device according to the https protocol using a first WebAPI and communicates with an electronic device according to the http protocol using a second WebAPI different from the first WebAPI, and a terminal device that communicates with the server device using a third WebAPI, wherein the terminal device transmits control information of the electronic device to the server device using the third WebAPI, and when the information processing device receives a notification from the server device indicating that the control information of the electronic device has been acquired, the information processing device communicates with the server device using the first WebAPI to acquire the control information described in the first WebAPI, generates control information described in the second WebAPI from the control information described in the first WebAPI, and communicates with the electronic device using the second WebAPI to transmit the control information described in the second WebAPI to the electronic device. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a diagram illustrating an example of the configuration of an information system 1 according to an embodiment of the present disclosure. [Figure 2] FIG. 2 is a diagram illustrating an example of the configuration of a server device 30. [Figure 3] FIG. 10 is a diagram illustrating an example of a management table TBL. [Figure 4] FIG. 10 is a diagram showing an example of a standby screen G1. [Figure 5] FIG. 10 is a diagram showing an example of a switching screen G2. [Figure 6] FIG. 2 is a diagram illustrating an example of the configuration of an information processing device 20. [Figure 7] 1 is a diagram showing a process flow in an information processing method executed in the information system 1. FIG. DETAILED DESCRIPTION OF THE INVENTION

[0009] The embodiments described below are subject to various technically preferable limitations, but the embodiments of the present disclosure are not limited to the following embodiments. 1. Embodiment Fig. 1 is a diagram illustrating a configuration example of an information system 1 according to an embodiment of the present disclosure. As shown in Fig. 1, the information system 1 includes an electronic device 10, a terminal device 40, a server device 30, and an information processing device 20. Each of the information processing device 20, the terminal device 40, and the server device 30 is connected to a network NW such as the Internet. The electronic device 10 is connected to the information processing device 20.

[0010] The electronic device 10 is, for example, a projector. The electronic device 10 displays an image represented by image data supplied from, for example, a personal computer by projecting the image onto a projection screen. Hereinafter, a source of image data supplied to the electronic device 10 is referred to as a source. In this embodiment, the electronic device 10 includes three HDMI (High-Definition Multimedia Interface) terminals as input terminals for connecting sources. The HDMI terminals are not shown, but may be referred to as HDMI1, HDMI2, and HDMI3 below. HDMI is a registered trademark. The electronic device 10 also stores a device ID (e.g., a character string representing a serial number) as identification information for uniquely identifying the electronic device 10. The electronic device 10 in this embodiment has a function for performing communication compliant with the HyperText Transfer Protocol (http) protocol, but does not have a function for performing encrypted communication compliant with HyperText Transfer Protocol Secure (https). In this embodiment, communication between the terminal device 40 and the server device 30 and communication between the server device 30 and the information processing device 20 both use https. On the other hand, communication between the electronic device 10 and the information processing device 20 is performed according to HTTP.

[0011] In this embodiment, communication between the terminal device 40 and the server device 30, communication between the server device 30 and the information processing device 20, and communication between the electronic device 10 and the information processing device 20 are all realized by WebAPI. Hereinafter, the WebAPI for realizing communication between the terminal device 40 and the server device 30 and communication between the server device 30 and the information processing device 20, i.e., communication according to https, will be referred to as a "WebAPI for server device." Furthermore, the WebAPI for realizing communication between the electronic device 10 and the information processing device 20 will be referred to as a "WebAPI for projector."

[0012] The "WebAPI for server devices" that realizes communication between the server device 30 and the information processing device 20 is an example of a first WebAPI in the present disclosure. The "WebAPI for server devices" that realizes communication between the server device 30 and the terminal device 40 is an example of a third WebAPI in the present disclosure. The "WebAPI for projectors" that realizes communication between the information processing device 20 and the electronic device 10 is an example of a second WebAPI in the present disclosure.

[0013] The information processing device 20 is a computer device that operates according to, for example, the Android OS (Operating System), and controls the operation of the electronic device 10 according to control information provided from the server device 30 via the network NW. In this embodiment, the information processing device 20 is a device separate from the electronic device 10, but the information processing device 20 may also be included in the electronic device 10.

[0014] The terminal device 40 is, for example, a smartphone, and in the information system 1, it serves as an operating device for operating the electronic device 10. Although detailed illustration is omitted in FIG. 1 , the terminal device 40 includes a touch panel display for displaying and inputting various types of information, and a camera for capturing various images. The terminal device 40 also includes a web browser, and can access various websites using the web browser. Although two terminal devices 40 are shown in FIG. 1 , the number of terminal devices 40 included in the information system 1 may be one, or may be three or more.

[0015] The server device 30 is a device that provides shared services for the electronic device 10 and manages the control rights of the electronic device 10. In this embodiment, by associating the terminal device 40 with the electronic device 10 via the server device 30 and the information processing device 20, it becomes possible to perform operations such as source switching on the electronic device 10 using the terminal device 40 while ensuring security. The following description will focus on the server device 30 and the information processing device 20, which prominently exhibit the features of the present disclosure.

[0016] 2 is a diagram showing an example of the configuration of the server device 30. As shown in FIG. 2, the server device 30 includes a processing device 310, a communication device 320, and a storage device 350.

[0017] The processing device 310 is one or more processors. The processing device 310 is, for example, a CPU (Central Processing Unit). The processing device 310 functions as the control center of the server device 30 by operating in accordance with the program PRB stored in the storage device 350. The communication device 320 is a device that performs wireless or wired communication with other devices, and includes, for example, an interface circuit. Specific examples of other devices that communicate with the communication device 320 include the terminal device 40 and the information processing device 20.

[0018] The storage device 350 is a recording medium that can be read by the processing device 310. The storage device 350 includes, for example, a nonvolatile memory and a volatile memory. The nonvolatile memory is, for example, a ROM (Read Only Memory), an EPROM (Erasable Programmable Read Only Memory), or an EEPROM (Electrically Erasable Programmable Read Only Memory). The volatile memory is, for example, a RAM (Radom Access Memory). The nonvolatile memory of the storage device 350 stores various programs and a management table TBL.

[0019] FIG. 3 is a diagram showing an example of the management table TBL. The management table TBL stores data for associating users of the terminal devices 40 with the electronic devices 10. More specifically, as shown in FIG. 3, the management table TBL stores a device ID that uniquely identifies the electronic device 10 and a first password (e.g., a random number sequence) for associating a user with the electronic device 10, in association with each other. Furthermore, when a user is associated with the electronic device 10, the management table TBL stores a user ID, which is identification information that uniquely identifies the user and was used when logging in to the shared service, in association with the device ID and the first password. The user ID is identification information for uniquely identifying a user in the shared service.

[0020] Examples of various programs stored in nonvolatile memory include a kernel program and a program PRB. The kernel program is not shown in FIG. 2 . When the server device 30 is powered on, the processing device 310 reads the kernel program from the nonvolatile memory to the volatile memory and starts executing the read kernel program. The processing device 210, which operates according to the kernel program, starts executing another program when instructed to do so. For example, when instructed to start executing a program PRB, the processing device 310 reads the program PRB from the nonvolatile memory to the volatile memory and starts executing the program PRB read into the volatile memory.

[0021] The processing device 310 operating in accordance with the program PRB functions as a first management unit 311, a first transmission unit 312, a second management unit 313, a second transmission unit 314, and a WebAPI relay unit 315 shown in Fig. 2. In other words, each of the first management unit 311, the first transmission unit 312, the second management unit 313, the second transmission unit 314, and the WebAPI relay unit 315 shown in Fig. 2 is a software module realized by operating the processing device 210 in accordance with the program PRB. The roles of each of the first management unit 311, the first transmission unit 312, the second management unit 313, the second transmission unit 314, and the WebAPI relay unit 315 shown in Fig. 2 are as follows.

[0022] The first management unit 311 generates a first password upon receiving the device ID of the electronic device 10 from the information processing device 20 via the network NW. The first management unit 311 associates the generated first password with the device ID received via the network NW. Specifically, the first management unit 311 associates the first password with the device ID received via the network NW and writes them in the management table TBL.

[0023] The first transmission unit 312 transmits the first password to the information processing device 20 by communicating with the information processing device 20 using the communication device 320. Upon receiving the first password, the information processing device 20 causes the electronic device 10 to output a standby screen G1 including the first password. In other words, the electronic device 10 displays the standby screen G1 on a projection target. FIG. 4 is a diagram illustrating an example of the standby screen G1. As illustrated in FIG. 4, the standby screen G1 includes an input box A1 for inputting a code string, address information A2, a PIN (Personal Identification Number) A3 added to the address information A2 in the form of a query string, and a QR code A4 obtained by encoding the address information A2 and the PIN code A3 together in a format compliant with ISO / IEC 18004. The address information A2 is, for example, the URL of the server device 30. The PIN code A3 is an example of a first password. The QR code is a registered trademark. A second password (described later in detail) is entered into the input box A1. The standby screen G1 is an example of information including the first password. In the standby screen G1, either the address information A2 and PIN code A3 or the QR code A4 may be omitted.

[0024] The user of the terminal device 40 uses the camera of the terminal device 40 to have the terminal device 40 read the QR code A4 included in the standby screen G1. The terminal device 40 decodes the QR code A4 to obtain address information A2 and a first password. The user of the terminal device 40 uses a web browser to access the portal site indicated by the address information A2 and logs in to the shared service using their own user ID and a password they have set. The terminal device 40 also transmits the first password obtained by decoding the QR code A4 to the server device 30 together with their own user ID.

[0025] When the second management unit 313 receives the user ID and first password of a terminal device 40 from the terminal device 40 that has logged in to the shared service, the second management unit 313 associates the user ID with the device ID that is stored in the management table TBL in association with the first password. Specifically, the second management unit 313 writes the user ID in the management table TBL in association with the first password and the device ID. Hereinafter, associating the user ID that uniquely identifies the user of the terminal device 40 with the device ID, in other words, associating the user of the terminal device 40 with the electronic device 10, is referred to as "pairing." There may be multiple users paired with the electronic device 10 for each projector, which allows multiple users to switch between using the electronic device 10.

[0026] The second transmission unit 314 transmits a common key for generating a second password to the terminal device 40 paired with the electronic device 10 by the second management unit 313, and stores the common key in the management table TBL in association with the user ID of the user paired with the electronic device 10. In this embodiment, the common key is a random hash character string. The hash character string is generated in the server device 30 because it must be unique for each pairing.

[0027] Upon receiving the shared key, the terminal device 40 generates and displays a second password based on the shared key and a predetermined encryption algorithm. In this embodiment, the encryption algorithm is the TOTP (Time-based One-Time Password) algorithm, but other encryption algorithms may be used. While the TOTP standard recommends that the second password be updated approximately every 30 seconds, the second password may be updated every 60 to 120 seconds due to the shared use of projectors. The user of the terminal device 40 enters the second password displayed on the terminal device 40 by operating the information processing device 20. Because this input is not made over a network, it is not susceptible to eavesdropping by a MitM (Man-in-the-Middle). While the TOTP sequence is inherently disposable and therefore resistant to eavesdropping, inputting it over a network raises concerns about brute force attacks. Therefore, it is desirable to directly input the second password into the information processing device 20, such as by operating the information processing device 20. A brute force attack is an attack that increases the probability of successful authentication by attempting multiple different inputs in a short period of time. Furthermore, since direct input to a physical device must be performed at the location where the physical device is installed, direct input to a physical device is expected to be more effective in deterring unauthorized use of the physical device than input over a network. For this reason, in this embodiment, direct input is used to input the second password to the information processing device 20.

[0028] The information processing device 20, which is displaying the standby screen G1 on the electronic device 10, communicates with the server device 30 in response to the input of the second password, and causes the server device 30 to authenticate the input second password. Specifically, the information processing device 20 transmits the input second password to the server device 30. The server device 30 authenticates the second password based on whether the received second password can be restored based on any of the common keys stored in the management table TBL and the encryption algorithm. That is, when a password is generated based on any of the common keys stored in the management table TBL and the same encryption algorithm as that used by the information processing device 20, if the second password is restored, authentication is successful, but if the second password is not restored, authentication is unsuccessful.

[0029] If the authentication of the second password is successful, the WebAPI relay unit 315 communicates with the terminal device 40 used by the user corresponding to the common key used to generate the second password, thereby redirecting the display screen of the terminal device 40 to a switching screen G2 for switching the source of the electronic device 10. FIG. 5 is a diagram showing an example of the switching screen G2. A user viewing the switching screen G2 can select a source for the electronic device 10 from HDMI1, HDMI2, and HDMI3 by selecting one of the check boxes A5 provided on the switching screen G2. FIG. 5 shows that HDMI1 has been selected as the source for the electronic device 10. A user viewing the switching screen G2 of FIG. 5 can switch the source for the electronic device 10 from HDMI1 to HDMI2 by selecting the check box corresponding to HDMI2. The terminal device 40, which has been instructed to switch the source by operating the switching screen G2, transmits control information instructing the source switching to the server device 30.

[0030] When the WebAPI relay unit 315 receives control information written in the WebAPI for the server device that instructs switching of the source from the terminal device 40, it notifies the information processing device 20 that the control information has been received. This notification includes the user ID of the user of the terminal device 40 that sent the control information. The WebAPI relay unit 315 also converts the control information received from the terminal device 40 into control information written in the WebAPI for the projector, and transmits the converted control information to the information processing device 20 in response to a request from the information processing device 20. In this embodiment, the WebAPI relay unit 315 includes the processing result of the conversion process from the WebAPI for the server device to the WebAPI for the projector, i.e., the control information instructing switching of the source written in the WebAPI for the projector, in the return value in Johnson format in response to the WebAPI call for the server device issued from the information processing device 20. The above is the configuration of the server device 30.

[0031] Fig. 6 is a diagram showing an example of the configuration of the information processing device 20. As shown in Fig. 6, the information processing device 20 includes a processing device 210, a communication device 220, an input device 240, and a storage device 250. The processing device 210 is one or more processors, similar to the processing device 310. Specifically, the processing device 210 is a CPU (Central Processing Unit). The processing device 210 functions as the control center of the information processing device 20 by operating in accordance with a program PRA stored in the storage device 250.

[0032] The communication device 220, like the communication device 320, has an interface circuit and performs wireless or wired communication with other devices. Specific examples of other devices that communicate with the communication device 220 include the electronic device 10 and the server device 30. The input device 240 is, for example, a receiving device that receives an operation signal from a remote control for remotely operating the information processing device 20, and provides data representing the user's operation on the remote control to the processing device 210. In this embodiment, the input device 240 is used to input a second password. The information processing device 20 does not need to be equipped with the input device 240. For example, the information processing device 20 may accept input of a second password via the communication device 220, which is an operation signal from an operator provided in the electronic device 10, or an operation signal received in the electronic device 10 via a light-receiving unit of a remote control provided outside the information processing device 20.

[0033] The storage device 250 is a recording medium readable by the processing device 210. The storage device 250 includes, for example, a nonvolatile memory and a volatile memory. The nonvolatile memory is, for example, a ROM, an EPROM, or an EEPROM. The volatile memory is, for example, a RAM. Various programs are stored in the nonvolatile memory of the storage device 250. Examples of the various programs stored in the nonvolatile memory include a kernel program and a program PRA. The kernel program is not shown in FIG. 6. The kernel program is a program that causes the processing device 210 to execute the OS.

[0034] When power supply to the information processing device 20 is started, the processing device 210 reads the kernel program from the nonvolatile memory to the volatile memory and starts executing the read kernel program. The processing device 210, operating in accordance with the kernel program, reads the program PRA from the nonvolatile memory to the volatile memory and starts executing the program PRA read into the volatile memory. The processing device 210, operating in accordance with the program P, functions as a first acquisition unit 211, a display control unit 212, an authentication unit 213, a second acquisition unit 214, a generation unit 215, and a control unit 216 shown in FIG. 6. In other words, each of the first acquisition unit 211, the display control unit 212, the authentication unit 213, the second acquisition unit 214, the generation unit 215, and the control unit 216 shown in FIG. 6 is a software module realized by operating the processing device 210 in accordance with the program PRA. The roles of the first acquisition unit 211, display control unit 212, authentication unit 213, second acquisition unit 214, generation unit 215, and control unit 216 shown in FIG. 6 are as follows.

[0035] The first acquisition unit 211 transmits the device ID of the electronic device 10 to the server device 30 using the communication device 220, and acquires the first password returned from the server device 30.

[0036] The display control unit 212 causes the electronic device 10 to display the standby screen G1 including the first password acquired by the first acquisition unit 211.

[0037] The authentication unit 213 accepts input of the second password and transmits the second password input into the input box A1 to the server device 30, thereby causing the server device 30 to authenticate the second password. As described above, when the server device 30 succeeds in authenticating the second password, it redirects the display screen on the terminal device 40 to the switching screen G2 described above. As described above, when the server device 30 receives control information described in the WebAPI for server devices from the terminal device 40, it notifies the information processing device 20 by using WebSocket that the control information has been received.

[0038] When the second acquisition unit 214 receives a notification from the server device 30 indicating that the control information for the electronic device 10 has been acquired, the second acquisition unit 214 determines whether the user ID included in the notification is the same as the user ID of a user already paired with the electronic device 10. If the user ID included in the notification is the same as the paired user ID, the second acquisition unit 214 acquires, from the server device 30, control information equivalent to the control information transmitted from the terminal device 40. The control information transmitted from the terminal device 40 is control information described in the WebAPI for the server device. The control information equivalent to the control information transmitted from the terminal device 40 is control information converted by the server device 30, i.e., control information described in the WebAPI for the projector.

[0039] The generation unit 215 generates control information written in the WebAPI for projectors from the control information acquired by the second acquisition unit 214. In this embodiment, the control information written in the WebAPI for projectors, which is the control information converted by the server device 30, is included in the Johnson format in the return value in response to the WebAPI call for the server device issued from the second acquisition unit 214, and therefore the generation unit 215 acquires the converted control information from the return value.

[0040] The control unit 216 accesses the electronic device 10 using a WebAPI call for projectors, thereby transmitting control information described in the WebAPI for projectors to the electronic device 10. The electronic device 10 receives the control information transmitted from the information processing device 20 and executes processing based on the received control information. For example, when the control information received by the electronic device 10 from the information processing device 20 instructs switching the source to HDMI2, the electronic device 10 switches the source of image data representing an image to be projected to HDMI2. The above is the configuration of the information processing device 20.

[0041] Next, the operation of this embodiment will be described with reference to FIG. 7. FIG. 7 is a diagram showing the flow of processing in an information processing method executed in the information system 1. As shown in FIG. 7, this information processing method includes each process from a first transmission process SA100 to a control process SA250. The execution entity and processing content of each process from the first transmission process SA100 to the control process SA250 are as follows. The information processing device 20 executes the first transmission process SA100, for example, when power supply to the information processing device 20 is started. In the first transmission process SA100, the processing device 210 of the information processing device 20 functions as a first acquisition unit 211. In the first transmission process SA100, the processing device 210 acquires the device ID of the electronic device 10 from the electronic device 10 and transmits the acquired device ID to the server device 30.

[0042] The processing device 310 of the server device 30 executes a first association process SA110 upon receiving the device ID via the network NW. In the first association process SA110, the processing device 310 functions as a first management unit 311. In the first association process SA110, the processing device 310 generates the first password described above, associates the first password with the received device ID, and stores the first password in the management table TBL, thereby associating the first password with the device ID.

[0043] In a second transmission process SA120 that is executed in the server device 30 subsequent to the first association process SA110, the processing device 310 functions as a first transmission unit 312. In the second transmission process SA120, the processing device 310 transmits a first password to the information processing device 20. In FIG. 6, the first password is abbreviated as "first PWD".

[0044] Upon receiving the first password, the information processing device 20 executes a standby screen display process SA130. In the standby screen display process SA130, the information processing device 20 functions as the display control unit 212 described above, and causes the electronic device 10 to display the standby screen G1.

[0045] The user of the terminal device 40 instructs the terminal device 40 to use its camera to read the QR code A4 included in the standby screen G1 output by the electronic device 10. This instruction triggers the terminal device 40 to execute a first acquisition process SA140. In the first acquisition process SA140, the terminal device 40 decodes the QR code A4 included in the image captured by the camera to acquire address information A2 and a PIN code A3, which is a first password. The terminal device 40 then uses a web browser to access the access destination indicated by the address information A2 (i.e., the portal site for the shared service) and prompts the user to log in to the shared service. The terminal device 40 determines whether the user has previously accessed the portal site based on whether a user ID is stored in web storage, and if this is the user's first access, redirects the portal site screen and prompts the user to log in using their own user ID. After completing the login to the shared service, the terminal device 40 executes a third transmission process SA150.

[0046] In the third transmission process SA150, the terminal device 40 transmits the first password and the user ID of the terminal device 40 acquired in the first acquisition process SA140 to the server device 30. Upon receiving the first password and the user ID, the processing device 310 of the server device 30 executes the second association process SA160.

[0047] In the second association process SA160, the processing device 310 functions as a second management unit 313. In the second association process SA160, the processing device 310 associates the received user ID with the device ID stored in the management table TBL in association with the received first password.

[0048] In a fourth transmission process SA170 executed in the server device 30 following the second association process SA160, the processing device 310 functions as a second transmission unit 314. In the fourth transmission process SA170, the processing device 310 transmits a common key for generating a second password to the terminal device 40 paired with the electronic device 10, and stores the common key in the management table TBL in association with the user ID of the user paired with the electronic device 10.

[0049] Upon receiving the common key, the terminal device 40 executes second password display processing SA180. Like the first password, the second password is abbreviated as "second PWD" in FIG. 7. In second password display processing SA180, the terminal device 40 receives the common key transmitted from the server device 30 via the network NW, generates a second password based on the common key and a predetermined encryption algorithm, and displays the generated second password. The user of the terminal device 40 can input the second password displayed on the terminal device 40 into the information processing device 20.

[0050] The processing device 210 of the information processing device 20 executes the authentication process SA190 when the second password is input into the input box A1 by an input operation on the input device 240. In the authentication process SA190, the processing device 210 functions as the authentication unit 213 and transmits the input second password to the server device 30, thereby authenticating the second password.

[0051] When the processing device 310 of the server device 30 successfully authenticates the second password transmitted from the information processing device 20, it executes redirection processing SA200. In redirection processing SA200, the processing device 310 functions as a WebAPI relay unit 315 and causes the terminal device 40 to display the switching screen G2 described above. When an input instructing the electronic device 10 to switch the source is made in the terminal device 40 while the switching screen G2 is displayed, the terminal device 40 executes third transmission processing SA210. In the third transmission processing SA210, the terminal device 40 transmits control information instructing the server device 30 to switch the source.

[0052] In a sixth transmission process SA220 subsequent to the redirection process SA200, the processing device 310 functions as a WebAPI relay unit 315. In the sixth transmission process SA220, upon receiving control information instructing source switching from the terminal device 40, the processing device 310 notifies the information processing device 20 that the control information has been received.

[0053] In a second acquisition process SA230 executed in the information processing device 20 subsequent to the authentication process SA190, the processing device 210 functions as a second acquisition unit 214. In the second acquisition process SA230, when the processing device 210 receives a notification from the server device 30, the processing device 210 determines whether the user ID included in the notification is the same as the user ID already paired with the electronic device 10. If the user ID included in the notification is the same as the paired user ID, the processing device 210 communicates with the server device 30 using a WebAPI call for the server device, thereby acquiring, from the server device 30, control information equivalent to the control information transmitted from the terminal device 40. In this embodiment, the control information acquired in the second acquisition process SA230 is converted control information.

[0054] In a generation process SA240 that is executed in the information processing device 20 subsequent to the second acquisition process SA230, the processing device 210 functions as a generation unit 215. In the generation process SA240, the processing device 210 generates control information described in the WebAPI for projectors from the control information acquired in the second acquisition process SA230.

[0055] In control processing SA250, which is executed in the information processing device 20 subsequent to the generation processing SA240, the processing device 210 functions as the control unit 216. In control processing SA250, the processing device 210 accesses the electronic device 10 using a WebAPI call for projectors, thereby transmitting control information described in the WebAPI for projectors to the electronic device 10. The electronic device 10 receives the control information transmitted from the information processing device 20 and executes processing based on the received control information. In this embodiment, the electronic device 10 switches the source of image data representing an image to be projected to HDMI2.

[0056] According to this embodiment, even if the electronic device 10 does not support encrypted communication, for example, because it does not have a communication function that complies with https, the electronic device 10 can acquire control information as a WebAPI for projectors generated from control information described in a WebAPI for server devices via an information processing device 20 that supports encrypted communication. Therefore, even if the electronic device 10 does not support encrypted communication, security can be ensured in control via a network. Furthermore, since the existing electronic device 10 can be used without having to purchase a new electronic device, this leads to a reduction in waste and reduces the environmental impact.

[0057] According to this embodiment, remote control of the electronic device 10 can be safely started by a single operation using two simple number sequences, namely, a first password and a second password, and thereafter the electronic device 10 can be safely remotely controlled over a network in real time operation using WebSocket. Therefore, compared to the technology disclosed in Patent Document 1, this embodiment has the advantage that the electronic device 10 can be remotely controlled over a network with fewer steps.

[0058] Note that, because the WebAPI call for remotely controlling the electronic device 10 goes through the server device 30, recording it makes it possible to take statistics on the control of the electronic device 10 or to understand differences in usage among users, which can be used to provide advice for efficient operation of the electronic device 10. Furthermore, since the present embodiment has a zero-trust configuration using a disposable number sequence, there is no risk that a password for remote control will be leaked and control of the electronic device 10 will be seized, and since authentication is performed using a user ID, there is an effect that only users with control rights can safely control the electronic device 10 via the WebAPI.

[0059] 2. Transformation The above embodiment can be modified as follows. (1) The above embodiment is an example of application of the present disclosure to manual remote control of a projector. However, the present disclosure is also applicable to automatic control of a projector in digital signage, and also to scenario-based automatic control of a projector performed from a terminal device 40. A specific example of scenario-based automatic control of a projector is automatic control of a projector during a presentation or distance learning. For example, the display timing of each of multiple images used in a presentation or distance learning is determined based on a scenario and registered in advance in the server device 30, and the server device 30 issues a WebAPI call instructing the display of each image at the pre-registered display timing. Furthermore, the present disclosure also makes it possible to provide web content that automatically controls various projector functions, such as powering on / off, source switching, audio control, or motorized lens control, remotely from the terminal device 40. Furthermore, while the electronic device 10 in the above embodiment is a projector, the present disclosure can be applied to any electronic device as long as it executes processing based on control information received over a network. That is, the processing based on the control information is not limited to displaying an image, but may also be, for example, outputting sound, calculating information, or storing information.

[0060] (2) In the above embodiment, the conversion process from the server-apparatus-oriented WebAPI to the projector-oriented WebAPI is executed by the server apparatus 30. However, the generation unit 215 may also execute this conversion process. That is, the generation process SA240 may include the conversion process from the server-apparatus-oriented WebAPI to the projector-oriented WebAPI. This conversion process may also be executed by the terminal apparatus 40. When the terminal apparatus 40 executes the conversion process, the terminal apparatus 40 may generate nested control information written in the server-apparatus-oriented WebAPI, including the result of converting the control information written in the server-apparatus-oriented WebAPI to the control information written in the projector-oriented WebAPI, and transmit this to the server apparatus 30. Note that the server-apparatus-oriented WebAPI between the server apparatus 30 and the information processing apparatus 20 and the server-apparatus-oriented WebAPI between the server apparatus 30 and the terminal apparatus 40 may be the same or different. If the two are different, the terminal device 40 may further include the above result in the result of converting the control information described in the WebAPI for the server device between the server device 30 and the terminal device 40 into the WebAPI for the server device between the server device 30 and the information processing device 20.

[0061] (3) In each of the above embodiments, the first acquisition unit 211, the display control unit 212, the authentication unit 213, the second acquisition unit 214, the generation unit 215, and the control unit 216 are software modules. However, any one, any two, any three, any four, any five, or all of the first acquisition unit 211, the display control unit 212, the authentication unit 213, the second acquisition unit 214, the generation unit 215, and the control unit 216 may be a hardware module such as an ASIC (Application Specific Integrated Circuit). Even if at least one of the first acquisition unit 211, the display control unit 212, the authentication unit 213, the second acquisition unit 214, the generation unit 215, and the control unit 216 is a hardware module, the same effects as those of the above embodiments can be achieved.

[0062] (4) The program PRA may be manufactured as a standalone program or provided free of charge or for a fee. Specific examples of providing the program PRA include providing the program PRA by writing it to a computer-readable recording medium such as a flash ROM, or providing the program PRA by downloading it via a telecommunications line such as the Internet. By operating a general computer in accordance with the program PRA provided in these ways, it becomes possible to cause the computer to execute the display method of the present disclosure.

[0063] 3. Summary of this disclosure The present disclosure is not limited to the above-described embodiments and modifications, and can be realized in various forms without departing from the spirit thereof. For example, the present disclosure can also be realized in the following forms. The technical features in the above embodiments corresponding to the technical features in each form described below can be replaced or combined as appropriate to solve some or all of the problems of the present disclosure or to achieve some or all of the effects of the present disclosure. Furthermore, if a technical feature is not described as essential in this specification, it can be deleted as appropriate. A summary of this disclosure is provided below.

[0064] (Appendix 1) The information processing method of the present disclosure includes, when receiving a notification from a server device indicating that control information of an electronic device has been acquired, an information processing device communicating with the server device using a first WebAPI according to the https protocol to acquire the control information described in the first WebAPI, the information processing device generating control information described in a second WebAPI different from the first WebAPI from the control information described in the first WebAPI, and the information processing device communicating with the electronic device using the second WebAPI according to the http protocol to transmit the control information described in the second WebAPI to the electronic device.The information processing method of the present disclosure makes it possible to control an electronic device over a network while ensuring security, even if the electronic device does not support encrypted communication compliant with the https protocol.

[0065] (Appendix 2) In a more preferred embodiment of the information processing method, generating the control information written in the second WebAPI includes converting the control information written in the first WebAPI into the control information written in the second WebAPI. This embodiment also makes it possible to control an electronic device over a network while ensuring security, even if the electronic device does not support encrypted communication compliant with the HTTPS protocol.

[0066] (Appendix 3) In another preferred embodiment of the information processing method, the control information described in the first WebAPI includes a result of converting the control information described in the first WebAPI into control information described in the second WebAPI, and generating the control information described in the second WebAPI includes obtaining the result from the control information described in the first WebAPI. This embodiment also makes it possible to control an electronic device over a network while ensuring security, even if the electronic device does not support encrypted communication compliant with the HTTPS protocol.

[0067] (Appendix 4) In a further preferred embodiment of the information processing method, the server device converts the control information written in the first WebAPI into control information written in the second WebAPI. This embodiment also makes it possible to control an electronic device over a network while ensuring security, even if the electronic device does not support encrypted communication compliant with the HTTPS protocol.

[0068] (Appendix 5) Another more preferred embodiment of the information processing method is the information processing method described in (Supplementary Note 3), further including: a terminal device that communicates with the server device using a third WebAPI converting control information described in the first WebAPI into control information described in the second WebAPI; and the terminal device transmitting, to the server device, control information described in the third WebAPI, including the result of converting the control information described in the first WebAPI into control information described in the second WebAPI. This embodiment also makes it possible to control electronic devices over a network while ensuring security, even if the electronic devices do not support encrypted communication compliant with the HTTPS protocol.

[0069] (Appendix 6) Another preferred embodiment of the information processing method is the information processing method described in any one of (Supplementary Note 1) to (Supplementary Note 5), further including the electronic device executing control based on control information described in the second WebAPI. This embodiment also makes it possible to control an electronic device via a network while ensuring security, even if the electronic device does not support encrypted communication compliant with the https protocol.

[0070] (Appendix 7) An information processing device according to the present disclosure includes at least one processor, and when the at least one processor receives a notification from a server device indicating that control information for an electronic device has been acquired, the at least one processor executes the following operations: acquires control information described in the first WebAPI by communicating with the server device using a first WebAPI according to the https protocol; generates control information described in a second WebAPI different from the first WebAPI from the control information described in the first WebAPI; and transmits the control information described in the second WebAPI to the electronic device by communicating with the electronic device using the second WebAPI according to the http protocol. By connecting an electronic device that does not support encrypted communication compliant with the https protocol to a network via the information processing device according to the present disclosure, it becomes possible to control the electronic device via the network while ensuring security.

[0071] (Appendix 8) The information system of the present disclosure includes an information processing device that communicates with a server device according to the https protocol using a first WebAPI and communicates with an electronic device according to the http protocol using a second WebAPI different from the first WebAPI, and a terminal device that communicates with the server device using a third WebAPI, wherein the terminal device transmits control information for the electronic device to the server device using the third WebAPI, and when the information processing device receives a notification from the server device indicating that the control information for the electronic device has been acquired, the information processing device communicates with the server device using the first WebAPI to acquire the control information described in the first WebAPI, generates control information described in the second WebAPI from the control information described in the first WebAPI, and communicates with the electronic device using the second WebAPI to transmit the control information described in the second WebAPI to the electronic device. The information system of the present disclosure makes it possible to control an electronic device over a network while ensuring security, even if the electronic device does not support encrypted communication. [Explanation of symbols]

[0072] 1...information system, 10...electronic device, 20...information processing device, 30...server device, 40...terminal device, NW...network, 210, 310...processing device, 211...first acquisition unit, 212...display control unit, 213...authentication unit, 214...second acquisition unit, 215...generation unit, 216...control unit, 311...first management unit, 312...first transmission unit, 313...second management unit, 314...second transmission unit, 315...WebAPI relay unit, 220, 320...communication device, 240...input device, 250, 350...storage device, TBL...management table, NW...network, PRA, PRB...program.

Claims

1. When receiving a notification from the server device indicating that the control information of the electronic device has been acquired, the information processing device communicates with the server device using a first Web API in accordance with the https protocol to acquire the control information described in the first Web API; The information processing device generates control information described in a second Web API different from the first Web API from the control information described in the first Web API; The information processing device transmits control information described in the second Web API to the electronic device by performing communication with the electronic device according to the HTTP protocol using the second Web API; An information processing method, including:

2. generating the control information described in the second Web API includes converting the control information described in the first Web API into the control information described in the second Web API; The information processing method according to claim 1 .

3. the control information described in the first Web API includes a result of converting the control information described in the first Web API into control information described in the second Web API; generating the control information described in the second Web API includes obtaining the result from the control information described in the first Web API; The information processing method according to claim 1 .

4. The server device converts the control information described in the first Web API into control information described in the second Web API. The information processing method according to claim 3 .

5. A terminal device that communicates with the server device using a third Web API converts control information described in the first Web API into control information described in the second Web API; The method further includes transmitting, by the terminal device, control information described in the third Web API, including a result of converting the control information described in the first Web API into control information described in the second Web API, to the server device. The information processing method according to claim 3 .

6. The electronic device further executes control based on control information described in the second Web API. The information processing method according to any one of claims 1 to 5.

7. at least one processor; The at least one processor When a notification indicating that control information of the electronic device has been acquired is received from the server device, acquiring the control information described in the first Web API by communicating with the server device according to the https protocol using the first Web API; generating control information described in a second Web API different from the first Web API from the control information described in the first Web API; transmitting control information described in the second Web API to the electronic device by performing communication with the electronic device according to the HTTP protocol using the second Web API; An information processing device that executes the above.

8. an information processing device that communicates with a server device according to the https protocol using a first Web API and communicates with an electronic device according to the http protocol using a second Web API different from the first Web API; and a terminal device that communicates with the server device using a third Web API; the terminal device transmits control information of the electronic device to the server device using the third Web API; The information processing device includes: When receiving a notification from the server device indicating that the control information of the electronic device has been acquired, acquiring the control information described in the first Web API by communicating with the server device using the first Web API; generating control information described in the second Web API from control information described in the first Web API; and transmitting control information described in the second Web API to the electronic device by communicating with the electronic device using the second Web API. Information systems.

Images