Communication device, communication method, and communication program

Abstract

To provide a communication device, and a communication method and communication program thereof that implement protocol and network functions supported by a program execution engine in a web browser and bi-directional communication by introducing a proxy function in the communication device and having the proxy function perform communication that the web browser does not support due to communication function restrictions, as a proxy.SOLUTION: A device 1 that executes a program with communication in a program execution engine 101 of a web browser 10, which includes the program execution engine with restrictions on communication functions, has a proxy function 11 deployed and has the proxy function 11 handle communication functions which the web browser 10 does not support due to the communication function restrictions, as a proxy.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a communication device, a communication method, and a communication program, and more particularly to a communication device, a communication method, and a communication program for executing a program involving communication in a web browser equipped with a program execution engine with limited communication functions. [Background technology]

[0002] The program execution engine of a web browser places restrictions on the communication functions that a program can use, limiting some communication functions such as some protocols, two-way communication, and waiting for communication from external devices.

[0003] Non-Patent Document 1 discloses WebSocket as a standardized protocol technology for creating a bidirectional communication channel on a single TCP connection. WebSocket is a protocol that establishes a TCP connection using a pre-established HTTP connection using HTTP used on the Web, and bidirectionally exchanges non-HTTP messages in frames with shorter header lengths than HTTP between a web browser and a web server.

[0004] Patent Document 1 discloses a technology that consolidates communication paths in the browser by running a local proxy within the browser running on the device, and realizes functions such as proxy authentication for applications running within the terminal and processing of page data to be displayed on the browser. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Patent No. 4353487 [Non-patent literature]

[0006] [Non-Patent Document 1] IETF RFC 6455 Summary of the Invention [Problem to be solved by the invention]

[0007] The WebSocket technology disclosed in Non-Patent Document 1 uses HTTP to establish a connection, which places restrictions on communication between a web server and a web browser. Therefore, it cannot be used for communication between web browsers or for connecting to database servers that do not support HTTP.

[0008] In Patent Document 1, HTTP is assumed for communication via a local proxy, and the local proxy does not convert protocols or change destination information. As a result, it is not possible to achieve communication from a program running on a program execution engine in a web browser using a protocol other than HTTP that is not supported by the program execution engine, or to achieve two-way communication by directly connecting to a program from an external device.

[0009] As such, the following issues exist in order for a program executed by a program execution engine within a web browser to achieve two-way communication with an external device.

[0010] First, a means is needed to extend the protocols and network functions available to programs executed in the program execution engine within a web browser.

[0011] Secondly, when a message is sent from an external device to a program executed by a program execution engine in a web browser, a means is required to notify the program of the message contents.

[0012] The object of the present invention is to solve the above technical problems and to provide a communication device, a communication method and a communication program for the same, which realizes the protocol and network functions supported by the program execution engine in the web browser and two-way communication by placing a proxy function within the communication device and having the proxy function perform communications that the web browser cannot handle due to communication function constraints. [Means for solving the problem]

[0013] In order to achieve the above object, the present invention places a proxy function within the device and performs processing such as protocol conversion and destination information change on messages sent and received between external devices, thereby compensating for communication functions that web browsers cannot support due to communication function constraints, thereby making it possible to exchange messages using protocols and communication methods that are not provided by the program execution engine.

[0014] Messages sent by a program running on a web browser are sent using HTTP between the device and a proxy function running within the device, and the proxy function performs processes such as protocol conversion and destination changes to communicate with external devices using the desired protocol.

[0015] The present invention can be realized not only as a communication device equipped with such a characteristic processing unit, but also as a communication method for a communication device that has such characteristic processing as steps, or as a communication program for a communication device that causes a computer to execute such steps. [Effects of the Invention]

[0016] According to the present invention, the following effects can be achieved.

[0017] (1) By using a proxy function placed within the device to process messages, a program running within a web browser can exchange messages with external devices using protocols that are not provided by the program execution engine.

[0018] (2) The proxy function placed within the device processes and temporarily stores messages, allowing a program running within a web browser to receive messages sent from an external device.

[0019] (3) A proxy function located within the device processes the message and forwards it to a pre-established two-way communication channel, allowing a program running within a web browser to receive messages sent from an external device.

[0020] (4) By adding additional information when a program sends a message to the proxy function, it becomes possible to select the content and method of message processing, such as the destination and the protocol to be used, in the proxy function.

[0021] (5) An identifier is assigned to the program, allowing the proxy function to distinguish between multiple programs running within the web browser, and the external device sends a message to the identified program. Therefore, even if the connection established between the program execution engine and the proxy function is discarded, the message can be sent to the correct program based on the identifier.

[0022] (6) The proxy function can obtain the control method of its own message processing unit from an external server, so that even if there are many devices, the control method can be changed collectively from an external server.

[0023] (7) By providing a control interface for the proxy function, the control method can be changed from an external device or a program executed in a web browser, making it possible to change the content and method of message processing performed by the proxy function on a program-by-program basis. [Brief explanation of the drawings]

[0024] [Figure 1]1 is a functional block diagram showing the configuration of a main part of a communication device according to an embodiment of the present invention; [Figure 2A] This is a sequence flow (part 1) showing the procedure for a program to send a message to an external device. [Figure 2B] This is a sequence flow (part 2) showing the procedure for a program to send a message to an external device. [Figure 3] FIG. 10 is a functional block diagram of programmatic message reception (Push). [Figure 4A] This is a sequence flow (part 1) showing the procedure for receiving (Pushing) a message by a program. [Figure 4B] This is a sequence flow (part 2) that shows the procedure for receiving (Pushing) a message by a program. [Figure 5] FIG. 10 is a functional block diagram of programmatic message reception (polling). [Figure 6A] This is a sequence flow (part 1) that shows the procedure for receiving a message (polling) by a program. [Figure 6B] This is a sequence flow (part 2) that shows the procedure for receiving messages (polling) by a program. [Figure 6C] This is a sequence flow (part 3) that shows the procedure for receiving messages (polling) by a program. [Figure 6D] This is a sequence flow (part 4) showing the procedure for receiving messages (polling) by a program. [Figure 7] FIG. 1 is a diagram showing an example of a scene in which the present invention is used. DETAILED DESCRIPTION OF THE INVENTION

[0025] Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings. Fig. 1 is a functional block diagram showing the configuration of the main parts of a communication device 1 according to an embodiment of the present invention, which includes a web browser 10 and a proxy function 11. A web server 2 and an external device 3 are connected to the device 1 via a network.

[0026] Such a device 1 can be configured by implementing an application (program) that realizes each function detailed below on a general-purpose computer or server equipped with a CPU, ROM, RAM, bus, interface, etc. Alternatively, it can be configured as a dedicated machine or a single-function machine in which part of the application is implemented as hardware or software.

[0027] The web browser 10 includes a program execution engine 101 for executing programs loaded from the web server 2. The program execution engine 101 is a conventional engine that executes programs written in ECMAScript, JavaScript, Web Assembly (WASM), or other widely used web standard technologies.

[0028] The programs P1 and P2 are obtained from the Web server 2, loaded into the program execution engine 101, and execute the predetermined processing described in the programs. When executing processing, the programs P1 and P2 can exchange messages with the external device 3 by calling the communication functions of the program execution engine 101 via an interface provided by the program execution engine 101. However, there are restrictions on the communication functions that the programs P1 and P2 can use, and they are limited to communication functions for which the program execution engine 101 provides an interface (hereinafter referred to as browser-compatible communication functions).

[0029] Browser-compatible communication functions include protocols such as HTTP (Hypertext Transfer Protocol) used for web communication and WebSocket, a standard for two-way communication between web servers and web browsers over HTTP. Browser-compatible communication functions are, in principle, limited to client-type communication functions that connect to external servers, and therefore cannot directly connect to programs P1 and P2 from external device 3.

[0030] The proxy function 11 mainly comprises a local transmission / reception unit 111, a message processing unit 112, and a remote transmission / reception unit 113, and can compensate for the restricted communication functions by executing communication functions that the web browser does not support due to the restrictions of the communication functions.

[0031] The local transmission / reception unit 111 listens on one or more ports of a local loopback address within the device, and executes the server function of the protocol included in the browser-compatible communication function. The programs P1 and P2 send messages to the port on which the local transmission / reception unit of the local loopback address listens on behalf of the external device 3. At this time, the programs P1 and P2 add additional information to the message content, such as destination information of the external device 3 that is the original connection destination and the converted protocol, and can notify the proxy function 11 of the necessary information.

[0032] The local transmitting / receiving unit 111 transfers messages received from the programs P1 and P2 to the message processing unit 112. The message processing unit 112 performs message processing such as protocol conversion and destination change in accordance with predetermined processing content or additional information added by the programs P1 and P2, and transfers the message to the remote transmitting / receiving unit 113.

[0033] The remote transmission / reception unit 113 sends the message processed by the message processing unit 112 from the network interface of the device 10. This makes it possible to send a message to the external device 3 using any protocol that the Web browser 10 does not support. The remote transmission / reception unit 113 can also execute a server function that uses any protocol that the Web browser 10 does not support, and wait for a connection from the external device 3.

[0034] 2A and 2B are sequence flows showing the steps of sending a message to the external device 3 by the program P1.

[0035] At time t1, a user of device 1 accesses a URL for launching program P1 on web server 2 from web browser 10, and at time t2, web browser 10 requests program P1 from web server 2. At time t3, web server 2 responds to the request by providing program P1 to web browser 10.

[0036] At time t4, the web browser 10 requests the program execution engine 101 to start the program P1, and the program execution engine 101 starts the program P1 at time t5. The program P1 executes a predetermined process at time t6, and requests the program execution engine 101 to call a communication function at time t7.

[0037] At time t8, the program execution engine 101 responds to the call request and transmits a message by HTTP to the local transmission / reception unit 111. The local transmission / reception unit 111 transfers the message to the message processing unit 112 at time t9.

[0038] At time t10, the message processing unit 112 changes the destination of the message to the external device 3, converts the protocol from HTTP to MQTT, and transfers the message to the remote transmission / reception unit 113 at time t11. The remote transmission / reception unit 113 transmits the transferred message to the external device 3 by MQTT at time t12.

[0039] At time t13, the external device 3 transmits a message response by MQTT to the remote transmission / reception unit 113. The remote transmission / reception unit 113 transfers the message response to the message processing unit 112 at time t14.

[0040] At time t15, the message processing unit 112 changes the destination of the transferred message response to program P1, converts the protocol from MQTT to HTTP, and sets a response code. Any code can be set as the response code depending on the content of the received response message. For example, if a PUBACK message, which means that a message has been received in MQTT, is received as a response, 200 OK, indicating a successful request, can be set as the HTTP response code. Furthermore, if a response message is not received within a certain period of time, 408 Request Timeout can be set as the HTTP response code. The response message is transferred from the message processing unit 112 to the local transmitting / receiving unit 111 at time t16.

[0041] At time t17, the local transmission / reception unit 111 transfers the response message to the program execution engine 101 using the HTTP protocol. At time t18, the program execution engine 101 responds with a communication function to the program P1. At time t19, the program P1 processes the response result.

[0042] According to this embodiment, a program running in a web browser can exchange messages with an external device 3 using a protocol not provided by the program execution engine, by having the proxy function 11 located in the device 1 process messages.

[0043] Fig. 3 is a functional block diagram of message reception by program P1, and Figs. 4A and 4B are sequence flows showing the steps of message reception. Here, an example will be described in which device 1 receives a message sent by external device 3 through a push operation. In this embodiment, the HTTP server function is activated in advance in local transmission / reception unit 111, and the MQTT server function is activated in remote transmission / reception unit 113.

[0044] At time t31, the user of device 1 accesses a URL for launching program P1 on web server 2 from web browser 10, and at time t32, web browser 10 requests program P1 from web server 2. At time t33, web browser 10 acquires program P1 sent by web server 2 in response to the request.

[0045] At time t34, the web browser 10 requests the program execution engine 101 to start the program P1, and the program execution engine 101 starts the program P1 at time t35. At time t36, the program P1 requests the program execution engine 101 to call a communication function, and the program execution engine 101 transmits a program registration message to the local transmission / reception unit 111 by HTTP at time t37.

[0046] At time t38, the local transmission / reception unit 111 registers the program in the message processing unit 112. At time t39, the message processing unit 112 transmits a program registration message response to the local transmission / reception unit 111. At time t40, the local transmission / reception unit 111 transmits the program registration message response to the program execution engine 101 by HTTP.

[0047] The program execution engine 101 returns the registration result to the program P1 at time t41. The program P1 requests a WebSocket from the program execution engine 101 at time t42. The program execution engine 101 sends a WebSocket connection request to the local transmission / reception unit 111 by HTTP at time t43. The local transmission / reception unit 111 sends a WebSocket connection response to the program execution engine 101 by HTTP at time t44. The program execution engine 101 reports the establishment of the WebSocket to the program P1 at time t45.

[0048] Thereafter, when the external device 3 requests the remote transmitter / receiver 113 to establish a connection by MQTT at time t51 in order to transmit a message, the remote transmitter / receiver 113 replies with a connection establishment response by MQTT at time t52. The external device 3 transmits a message M1 by MQTT to the remote transmitter / receiver 113 at time t53. In this embodiment, as shown in FIG. 3 , the message M1 is transmitted with the protocol "MQTT", the destination "Device 1", the identifier "86f021", and the data "abc".

[0049] At time t54, the remote transmitting / receiving unit 113 transfers the message M1 to the message processing unit 112. As shown in Fig. 3 , at time t55, the message processing unit 112 converts the protocol of the message M1 from MQTT to WebSocket and changes the destination to program P1 [local host:35001], and at time t56, transfers the message m1, whose protocol and destination have been modified, to the local transmitting / receiving unit 111.

[0050] The local transmission / reception unit 111 transmits the received message m1 to the program execution engine 101 via WebSocket at time t57. The program execution engine 101 notifies the program P1 of the message m1 at time t58. The program P1 processes the message m1 at time t59 and transmits the processing result to the program execution engine 101 via WebSocket at time t60.

[0051] At time t61, the program execution engine 101 transmits the processing result to the local transmission / reception unit 111 via WebSocket. At time t62, the local transmission / reception unit 111 transfers the processing result to the message processing unit 112. At time t63, the message processing unit 112 changes the destination of the processing result to the external device 3, converts the protocol to MQTT, and transfers the result to the remote transmission / reception unit 113 at time t64. At time t65, the remote transmission / reception unit 113 responds to the external device 3 by MQTT to notify that the message response has been completed.

[0052] Fig. 5 is another functional block diagram of message reception by program P1, and Figs. 6A to 6D are sequence flows showing the steps of message reception. Here, an example will be described in which device 1 receives a message sent by external device 3 through a Polling operation. In this embodiment, an HTTP server function is activated in advance in local transmitting / receiving unit 111, and an MQTT server function is activated in remote transmitting / receiving unit 113.

[0053] At time t71, the user of device 1 accesses a URL for launching program P1 on web server 2 from web browser 10, and at time t72, web browser 10 requests program P1 from web server 2. At time t73, web browser 10 acquires program P1 sent by web server 2 in response to the request.

[0054] At time t74, the Web browser 10 requests the program execution engine 101 to start the program P1, and the program execution engine 101 starts the program P1 at time t75.

[0055] At time t76, program P1 requests program execution engine 101 to call a communication function. At time t77, program execution engine 101 responds to the call request and transmits a program registration message by HTTP to local transmission / reception unit 111. At time t78, local transmission / reception unit 111 registers the program in message processing unit 112.

[0056] At time t79, the message processing unit 112 transmits a program registration message response to the local sending and receiving unit 111. At time t80, the local sending and receiving unit 111 transmits a program registration message response by HTTP to the program execution engine 101. At time t81, the program execution engine 101 transmits a registration result response to the program P1.

[0057] Thereafter, at time t91, the external device 3 requests the device 1 to establish a connection using MQTT in order to send a message, and at time t92 the remote transmission / reception unit 113 replies with a connection establishment response using MQTT. At time t93, the external device 3 transmits a message to the remote transmission / reception unit 113 using MQTT. In this embodiment, as shown in Fig. 5, a message M1 is transmitted whose protocol is "MQTT", whose destination is "device 1", whose identifier is "86f021", and whose data is "abc".

[0058] At time t94, the remote transmitting / receiving unit 113 transfers the message M1 to the message processing unit 112. At time t95, the message processing unit 112 extracts the identifier "86f021" and the data "abc" from the message M1, as shown in FIG. 5, and stores them in the message cache 114 at time t96. Furthermore, at time t97, the message processing result is notified to the remote transmitting / receiving unit 113. Note that if the notified processing result is a failure, the remote transmitting / receiving unit 113 terminates the processing without responding.

[0059] Thereafter, the program P1 repeatedly requests the program execution engine 101 to call a communication function at a predetermined interval, and repeatedly receives messages by Polling. In this embodiment, when the program P1 requests the program execution engine 101 to call a communication function at time t101, at time t102, the program execution engine 101 transmits a reception confirmation message to the local transmission / reception unit 111 by HTTP. At time t103, the local transmission / reception unit 111 transmits a reception confirmation to the message processing unit 112.

[0060] At time t104, when message processing unit 112 requests message cache 114 to retrieve a message, if the message is stored in message cache 114, message cache 114 sends a message response to message processing unit 112 at time t105. At time t106, message processing unit 112 changes the destination of the message to program P1 and adds an HTTP header to the message response. The message is transferred to local sending / receiving unit 111 at time t107.

[0061] At time t108, the local transmission / reception unit 111 transmits the message to the program execution engine 101 by HTTP. At time t109, the program execution engine 101 transmits a communication function response to the program P1. At time t110, the program P1 processes the response result.

[0062] After transmitting the message to the local transmission / reception unit 111 at time t107, the message processing unit 112 notifies the remote transmission / reception unit 113 of the message transmission result at time t111. The remote transmission / reception unit 113 transmits a message transmission completion response to the external device 3 by MQTT at time t112.

[0063] On the other hand, if no message is stored in the message cache 114, the message cache 114 notifies the message processor 112 at time t113 that there is no message.

[0064] At time t114, the message processing unit 112 notifies the local sending and receiving unit 111 that there are no messages. At time t115, the local sending and receiving unit 111 notifies the program execution engine 101 by HTTP that there are no messages. At time t116, the program execution engine 101 transmits a communication function response to the program P1.

[0065] According to this embodiment, the proxy function 11 located within the device 1 processes and temporarily stores messages, so that messages sent from the external device 3 can be received by a program running within the web browser 10.

[0066] 7 is a diagram showing an example of a usage scenario of the present invention, in which a user owns a smartphone 4 and a personal computer 5 as the device 1. A VR program is installed in the smartphone 4 along with a web browser and proxy function, and a video processing server program is installed in the personal computer 5 along with a web browser and proxy function.

[0067] The VR program on the smartphone 4 runs on a web browser, and by using a proxy function, it can send and receive video and control signals to and from the camera 6 (an IoT device) using MQTT, which is not supported by web browsers. It can also use a proxy function to link with applications on cloud-based container virtualization platforms using the gRPC protocol, which is not supported by web browsers. It can also send and receive data and messages to and from the PC 5 using HTTP.

[0068] Similarly, the video processing server program on PC 5 also runs on a web browser and can send and receive various data and messages with Camera 6 using MQTT, with the container virtualization platform on the cloud using the gRPC protocol, and with PC 5 using HTTP.

[0069] The use of the proxy function 11 is not limited to proxy processing that enables sending and receiving of messages, etc., but can also be used to provide encryption and authentication functions for messages sent by programs P1 and P2. This eliminates the need to implement encryption and authentication functions for each program, and allows the proxy function 11 to process them all at once.

[0070] In addition, the proxy function 11 may be provided with a function to permit or prohibit the sending of a message based on the destination and content of the message that the programs P1 and P2 are attempting to send, and a function to send the message that the programs P1 and P2 are sending to multiple destinations that are registered in advance.

[0071] In the above embodiment, WebSocket is used as an example of a bidirectional communication channel, but the present invention is not limited to this and can be similarly realized using other bidirectional communication channel technologies such as WebRTC.

[0072] According to the above embodiment, by implementing a proxy function in a device equipped with a web browser, communication functions such as protocols that are restricted by the web browser's program execution engine, two-way communication, and communication standby from external devices can be used. This makes it possible to contribute to Goal 9 "Build resilient infrastructure and promote inclusive and sustainable industrialization" and Goal 11 "Make cities inclusive, safe, resilient, and sustainable" of the United Nations' Sustainable Development Goals (SDGs). [Explanation of symbols]

[0073] 1...device, 2...web server, 3...external device, 10...web browser, 11...proxy function, 101...program execution engine, 111...local transmission / reception unit, 112...message processing unit, 113...remote transmission / reception unit, 114...message cache

Claims

1. A communication device that executes a program involving two-way communication using a web browser equipped with a program execution engine with limited communication capabilities, Implement a proxy function that acts as a proxy for two-way communication with external devices via the network that web browsers cannot handle due to the limitations of the communication functions. Acquire the program, The program notifies the proxy function of additional information regarding destination changes and protocol conversions for two-way communications; the proxy function processes the redirection and protocol conversion based on the additional information; A communication device characterized in that the proxy function processes redirection and protocol conversion to cause the external device to receive communications from the program to the proxy function and to cause the program to receive communications from the external device to the proxy function.

2. The communication device according to claim 1 , wherein the proxy function provides the program with a function for receiving messages via Push.

3. The communication device according to claim 2 , wherein the proxy function converts an incoming message in a protocol that is not supported by the web browser into an incoming message in a protocol that is supported by the web browser.

4. The communication device according to claim 1 , wherein the proxy function provides the program with a message reception function by polling.

5. 5. The communication device according to claim 4, wherein the proxy function provides a server function for caching received messages, and responds to a polling request from the program by reading the cached received messages.

6. The communication device according to claim 5, wherein the proxy function converts the protocol of the cached received message into a protocol supported by a web browser.

7. The communication device of claim 1 , wherein the proxy function provides encryption functionality for outgoing messages.

8. The communication device of claim 1 , wherein the proxy function provides authentication functionality for outgoing messages.

9. 2. The communication device according to claim 1, wherein the proxy function allows or prohibits the sending of a message that a program is attempting to send based on the destination and content of the message.

10. 2. The communication device according to claim 1, wherein the proxy function transmits a message that a program intends to send to a plurality of destinations that are registered in advance.

11. A communication method for a communication device that executes a program involving two-way communication in a web browser equipped with a program execution engine with limited communication capabilities, comprising: Implement a proxy function that acts as a proxy for two-way communication with external devices via a network that the web browser cannot handle due to the limitations of the communication function. obtaining the program; a step in which the program notifies the proxy function of additional information regarding destination redirection and protocol conversion of two-way communication; said proxy function processing said redirection and protocol conversion based on said additional information; A communication method for a communication device, characterized in that the proxy function processes destination changes and protocol conversions that cause the external device to receive communications from the program to the proxy function and cause the program to receive communications from the external device to the proxy function.

12. A communication program for a communication device that executes a program involving two-way communication in a web browser equipped with a program execution engine with limited communication capabilities, Implement a proxy function that acts as a proxy for two-way communication with external devices via a network that the web browser cannot handle due to the limitations of the communication function. obtaining the program; a step in which the program notifies the proxy function of additional information regarding destination change and protocol conversion for two-way communication; the proxy function processes the redirection and protocol conversion based on the additional information; A communication program for a communication device, characterized in that the proxy function processes destination changes and protocol conversions that cause the external device to receive communications from the program to the proxy function and cause the program to receive communications from the external device to the proxy function.

Images