Information and communication network system and information and communication method
Patent Information
- Application Number
- JP2022029929
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2022-02-28
- Publication Date
- 2025-04-25
- Estimated Expiration
- 2042-02-28
AI Technical Summary
Conventional data communication systems are unreliable in disaster-stricken areas due to system failures and power outages, and they require a communication carrier or the Internet, which may not be available during emergencies.
An information communication network system utilizing AR markers for data transmission between relay devices and slave terminal devices, enabling wireless or wired communication without relying on the Internet, using a power-efficient system with batteryless wireless transmission and data conversion methods.
Enables secure, low-cost, and reliable information transmission in disaster scenarios by using AR markers as a communication medium, allowing for secure data conversion and analysis of communication distance, even without a power source, and preventing unauthorized access.
Smart Images
Figure 00000016_0000 
Figure 00000017_0000 
Figure 00000018_0000
Abstract
Description
[Technical Field]
[0001] The present invention relates to an information communication network system and an information communication method. [Background technology]
[0002] With the development of IoT (Internet of Things) and the Internet, data communication has become commonplace, both wirelessly and via wired lines. However, risks to the security of data communication and the stability of the communication system itself have long been pointed out, and efforts have been made to improve encryption and authentication methods. However, while these communications are convenient and highly reliable infrastructures, if a management system or base station goes down due to a sudden problem such as a disaster, they can become difficult to use in disaster-stricken areas.
[0003] In a situation like the above, a technology that can be applied is proposed in the past, in which a QR code (registered trademark) is read remotely using a camera, the resulting read image is displayed on a monitor fixed to the QR code reader, and the vehicle is identified (for example, the technology described in Non-Patent Document 1).
[0004] Other technologies disclosed include a technology that superimposes AR content when an AR marker is detected in a camera frame image, and a technology that allows an operator to record an image superimposed on the camera image using a terminal, send the resulting video file to a server, and have an administrator receive and check the video file from the server (for example, the technology described in Patent Document 1). [Prior art documents] [Patent documents]
[0005] [Patent Document 1] Patent No. 6582626 [Non-patent literature]
[0006] [Non-Patent Document 1] "Remote QR Code Reading with CP-01 Plus / Remote QR Code Bulk Reading in Excel," A&F Corporation website, February 24, 2022, Internet search: https: / / www.af-corporation.com / %E9%81%A0%E9%9A%94%EF%BD%91%EF%BD%92%E3%82%B3%E3%83%BC%E3%83%89 / Summary of the Invention [Problem to be solved by the invention]
[0007] In the above-mentioned conventional technologies, the information of physical codes or markers read by a camera is transmitted or displayed on a monitor. Using these conventional technologies, it is possible to convert information into data and transfer it. However, this does not solve the problem that, in the event of a system failure, the information cannot be accessed when it tries to enter the Internet.
[0008] If a network that does not go through the Internet is constructed, data transfer becomes possible even in places where communication is not possible due to the effects of electromagnetic waves emitted by machines, etc., during disasters. However, in this case, the system will have to operate with a limited power supply. Therefore, if the disaster area where the network should be constructed has high power consumption or a power outage, the network for transmitting information will not be able to operate.
[0009] Therefore, an object of the present invention is to realize an information communication network that does not require a communication carrier or the Internet. [Means for solving the problem]
[0010] In one embodiment, the information and communication network system includes a relay device having a display, an image capture device, and a repeater, and multiple sets of slave terminal devices that communicate between ends via the relay device. In the transmitting relay device, the repeater generates transmission AR marker image data corresponding to the transmission information and displays the transmission AR marker corresponding to the generated transmission AR marker image data on the display. In the receiving relay device, the repeater causes the image capture device to capture the transmission AR marker displayed on the display of the transmitting relay device, thereby acquiring transmission AR marker image data corresponding to the transmission AR marker, and extracts and receives the transmission information from the acquired transmission AR marker image data. The slave terminal devices operate with low power consumption or no power supply and perform communication operations to communicate the transmission information with the relay device via a wireless or wired communication method. [Effects of the Invention]
[0011] According to the present invention, it is possible to realize an information and communication network that does not require a communication carrier or the Internet. The information and communication network according to the present invention can be utilized as a means of transmitting information when infrastructure is down during a disaster. According to the present invention, by using an AR marker as an information communication medium, the information sender can use a physical medium such as cardboard, thereby transmitting information at low cost without requiring a power source. According to the present invention, it is possible to realize an information and communication network with improved security through unique data conversion. According to the present invention, by using an AR marker as an information communication medium, it is possible to analyze the communication distance and identify the communication location. According to the present invention, by transmitting a combination of radio waves and images, it becomes possible to provide information only to limited people. [Brief explanation of the drawings]
[0012] [Figure 1]1 is a block diagram of an information communication network system according to an embodiment. [Figure 2] FIG. 10 is a sequence diagram showing an operation sequence when transmission information is transmitted from the slave terminal devices 102 (#A, #B) on the transmitting side to the management-side slave terminal device 102 (#C) on the receiving side. [Figure 3] FIG. 10 is an operational sequence diagram when processing contents are transmitted from the management-side slave terminal device 102(#C) on the transmitting side to the slave terminal device 102(#A) on the receiving side. [Figure 4] FIG. 10 is a diagram showing a data conversion operation when transmission information is transmitted from the slave terminal devices 102 (#A, #B) on the transmitting side to the management-side slave terminal device 102 (#C) on the receiving side. [Figure 5] This figure shows the data conversion operation when processing contents are transmitted from the transmitting side management side slave terminal device 102(#C) to the receiving side slave terminal device 102(#A), and the receiving side slave terminal device 102(#A) then returns the processing results to the transmitting side management side slave terminal device 102(#C). [Figure 6] FIG. 2 is a diagram illustrating an example of the hardware configuration of a slave terminal device 102(#A) in FIG. [Figure 7] FIG. 2 is a diagram illustrating an example of the hardware configuration of a slave terminal device 102(#B) in FIG. [Figure 8] FIG. 2 is a diagram illustrating an example of the hardware configuration of the management-side slave terminal device 102(#C) in FIG. DETAILED DESCRIPTION OF THE INVENTION
[0013] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present invention (hereinafter referred to as "the present embodiment") will be described in detail below with reference to the drawings. Fig. 1 is a block diagram of an information communication network system 100 according to the present embodiment.
[0014] 1, an information communication network system 100 includes multiple sets (#1, #2) of relay devices 101, each set including a display 103, an image capture device 104, and a relay (wireless communication module) 105. Note that while only relay devices 101 #1 and #2 are illustrated in FIG. 1, relaying may be performed by more relay devices 101.
[0015] In the case of a small-scale relay device 101, the display device 103 has a function of displaying, on a high-brightness A4-sized display, one or more AR markers corresponding to the AR marker image data output from the repeater 105. In the case of a medium- to large-scale relay device 101, the display device 103 has a function of displaying, on a large-screen display, for example, about 1 meter by 1 meter, one or more AR markers corresponding to the AR marker image data output from the repeater 105.
[0016] In the case of a small-scale relay device 101, the imager 104 has a function of capturing an image with sufficient resolution of an AR marker displayed in A4 size on the display 103 of the relay device 101 installed several hundred meters away. In the case of a medium- to large-scale relay device 101, the imager 104 has a function of capturing an image with sufficient resolution of an AR marker displayed in, for example, 1 meter x 1 meter size on the display 103 of the relay device 101 installed several kilometers away.
[0017] The relay device 101 has a function of transmitting, receiving, and relaying transmission information via an AR marker in accordance with an operation sequence described later.
[0018] In preparation for disasters, etc., the power source of the relay device 101, not specifically shown, is normally supplied with commercial power, but in the event of a power outage due to a disaster or the like, emergency power is supplied from a private generator, allowing the relay of information and communications in the information and communications network system 100 to be maintained.
[0019] In the information and communication network system 100 of Figure 1, relay devices 101 transmit transmission information 110 represented by an AR marker displayed on the display of a display device 103 of one relay device 101 while the imaging device 104 of the adjacent relay device 101 captures the image of the AR marker.
[0020] AR markers are image marks expressed as photographs, illustrations, etc., and various pieces of information are associated with multiple types of AR markers in advance, and the correspondence between these pieces of information is shared (stored) in advance between the transmitting side and the receiving side. In this embodiment, these AR markers are applied to information transmission.
[0021] For example, request information such as a request for rescue or food assistance in the event of a disaster is associated with multiple AR markers. When a disaster occurs, relay device 101 (#1) installed in the local government where the disaster occurred acts as a transmitter, and uses the AR marker to transmit transmission information 110 (#1) such as a disaster rescue request to an adjacent relay device 101 (#2) on the receiving side, which is located at a distance of several hundred meters to several kilometers. Then, the adjacent relay device 101 (#2) acts as a new transmitter relay device, and uses the AR marker to transmit transmission information 110 (#2) to a further receiver relay device. In this way, rescue request information from the local government where the disaster occurred finally reaches a receiver relay device at the disaster rescue headquarters.
[0022] In this manner, in this embodiment, the transmission information represented by the AR markers is transmitted one after another in a bucket brigade style, based on the principle of an ancient signal fire. As a result, even if the communication carriers of mobile phones, smartphones, etc. or the Internet go down and become unusable during a disaster or other such event, the relay device 101 of the information and communication network system 100 in FIG. 1 , which does not use a communication carrier or the Internet or require radio waves, can form an emergency network capable of transmitting the minimum level of lifeline information, etc. The information and communication network system 100 realized by this embodiment can be called a "digital signal fire."
[0023] In FIG. 1, the information communication network system 100 further includes, at its end, one or more terminal devices, i.e., slave terminal devices 102 (#A, #B, #C), which operate with low power consumption or no power supply.
[0024] Here, for example, in the transmitting side relay device 101 (#1), the repeater 105 (#1) receives the transmission information 110 (#1) from the transmitting side slave terminal device 102 (#A, #B) via a wireless or wired electronic communication method.
[0025] Also, for example, in the receiving side relay device 101 (#2), the repeater 105 (#2) transmits the transmission information 110 (#2) to the receiving side slave terminal device (management side slave terminal device) 102 (#C), which is the terminal device, by wireless or wired electronic communication method.
[0026] Here, for example, the slave terminal devices 102 (#A, #B) communicate transmission information 110 (#1) with the relay device 101 (#1) using a wireless electronic communication method without power supply. As the wireless electronic communication method without power supply, for example, the EnOcean battery-less wireless transmission method by EnOcean GmbH (Munich, Germany) can be adopted. This makes it possible to transmit important information such as disaster relief requests from the slave terminal devices 102 (#A, #B) to the relay device 101 (#1) even in the event that a local government office or the like is affected by a disaster and loses power.
[0027] The management side slave terminal device 102 (#C) installed at a disaster relief headquarters or the like can communicate transmission information 110 (#2) with the receiving side relay device 101 (#2), for example, by the EnOcean battery-less wireless transmission method described above, or, if power is available, by a short-range wireless electronic communication method such as Bluetooth (USA registered trademark) or a wired electronic communication method such as a local area network. A personal computer (not shown) or the like is connected to the management side sub-terminal device 102 (#C) via, for example, a USB (Universal Serial Bus) interface, and information communication based on transmission information 110 can be performed between the management side sub-terminal device 102 (#A, #B).
[0028] Furthermore, in Figure 1, the information and communication network system 100 can further be equipped with an AR marker board installation device 107 as a terminal device, for example, on the roof of a local government building, which installs multiple types of large transmission AR marker boards 106 with an area of several meters square or more corresponding to multiple types of transmission information 110, such as disaster relief requests, requests for drinking water, requests for food, and requests for blankets.
[0029] Here, for example, in the relay device 101(#1), the repeater 105(#1) causes the imager 104 to capture an image of the transmission AR marker indicated by the transmission AR marker board 106 installed in the AR marker board installation device 107, and acquires corresponding transmission AR marker image data 111(#1).The repeater 105(#1) then extracts and receives transmission information 110(#1) corresponding to the transmission AR marker board 106 from the acquired transmission AR marker image data 111(#1).
[0030] In this way, a large transmission AR marker board 106 made of a physical medium such as cardboard installed in an AR marker board installation device 107 makes it possible to transmit important information such as disaster relief requests to a relay device 101 (#1) or the like several kilometers away, even in the event that a local government office building or the like is hit by a disaster and loses power.
[0031] Here, in the relay device 101 (#1), the repeater 105 measures the position or distance of the transmitting AR marker board 106 installed in the AR marker board installation device 107 via the autofocus lens of the imager 104, etc., and can add this to the received transmission information 110. This makes it possible, for example, to analyze the distance to a disaster site and identify the disaster site.
[0032] Furthermore, although not shown, a louver for limiting the range in which the transmission AR marker board 106 is visible can be provided on the front side of the AR marker board installation device 107 where the transmission AR marker board 106 is installed. This makes it possible to make the transmission AR marker board 106 invisible from outside the directional range in which the relay device 101 (#1) is installed, thereby preventing acts such as unauthorized reading of the transmission information 110 displayed by the transmission AR marker board 106 by persons other than those involved.
[0033] Furthermore, it is possible to provide the following portable information receiving terminal device 108 as a terminal device, which is assumed to be used together with the above-mentioned AR marker board installation device 107. This portable information receiving terminal device 108 captures an image of the reception confirmation AR marker 114 (#1) displayed on the display 103 (#1) of the relay device 101 (#1) using the built-in camera 108-1, and acquires reception confirmation AR marker image data 113 corresponding to the captured reception confirmation AR marker 114 (#1), thereby being able to display on the built-in liquid crystal display 108-2 that the transmission information 110 (#1) corresponding to the transmission AR marker board 106 has been correctly received by the relay device 101 (#1). This allows the administrator of the transmission AR marker board 106 to check whether a disaster relief request or the like has been correctly transmitted. In addition, the portable information receiving terminal device 108 captures an image of the transmission AR marker 112 (#1) displayed on the display 103 (#1) of the relay device 101 (#1) using the built-in camera 108-1, and obtains transmission AR marker image data 111 corresponding to the captured transmission AR marker 112 (#1), thereby receiving the transmission information 110 sent from the relay device 101 (#1) and displaying it on the built-in liquid crystal display 108-2. This allows affected local governments to receive transmission information 110 from, for example, a disaster relief headquarters, simply by preparing a handy portable information receiving terminal device 108, even if communication carriers and the Internet are damaged and cannot be used.
[0034] In the information communication network system 100 of Fig. 1, the transmitting-side relay device 101 (#1) and the receiving-side relay device 101 (#2) can also operate as the receiving-side relay device and the transmitting-side relay device, respectively. This makes it possible to realize two-way communication operations, namely, information transmission from the transmitting-side slave terminal devices 102 (#A, #B) to the receiving-side management-side slave terminal device 102 (#C), and information transmission in the reverse direction, from the transmitting-side management-side slave terminal device 102 (#C) to, for example, the receiving-side slave terminal device 102 (#A). For example, a disaster relief request can be sent from a sub-terminal device 102(#A) installed in a local government in a disaster-stricken area to a management sub-terminal device 102(#C) installed at a disaster relief headquarters, and in response, the management sub-terminal device 102(#C) can reply to the sub-terminal device 102(#A) with the specific details, date and time of the disaster relief support.
[0035] FIG. 2 is a sequence diagram showing an operation sequence when transmission information 110 is transmitted from the transmitting side slave terminal device 102(#A), for example, to the receiving side management side slave terminal device 102(#C). First, in the relay device 101(#1), the relay 105(#1) receives the transmission information 110(#1) from the slave terminal device 102(#A) by wireless or wired communication (sequence S201).
[0036] The repeater 105(#1) receives the received transmission information 110(#1) after converting it into data as described below, and stores it in an internal memory (not shown) for a predetermined period of time (sequence S202). In consideration of the possibility that each repeater device 101 may break down in the event of a disaster, the transmission information 110 is stored in each repeater 105 for a predetermined period of time.
[0037] Next, in the transmitting relay device 101(#1), the repeater 105(#1) converts the transmission information 110(#1) as described below, and generates transmission AR marker image data 111(#1) corresponding to the converted code (sequence S203).
[0038] Next, the repeater 105(#1) outputs the generated transmission AR marker image data 111(#1) to the display 103(#1), causing the display 103(#1) to display the corresponding transmission AR marker 112(#1) (sequence S204).
[0039] Meanwhile, in the receiving relay device 101(#2), the relay device 105(#2) issues an image capture instruction to the image capture device 104(#2). As a result, the image capture device 104(#2) captures the transmission AR marker 112(#1) displayed on the display device 103(#1) of the transmitting relay device 101(#1) (sequence S205).
[0040] Next, the repeater 105(#2) acquires the transmission AR marker image data 111(#2) corresponding to the transmission AR marker 112(#1) from the image capturer 104(#2) (sequence S206).
[0041] The repeater 105 (#2) extracts and receives the transmission information 110 (#2) from the acquired transmission AR marker image data 111 (#2) by data conversion (described later), and stores it in an internal memory (not shown) for a predetermined period of time (sequence S207).
[0042] The repeater 105(#2) generates reception confirmation AR marker image data 113(#2) indicating that the transmission information 110(#2) has been correctly received (sequence S208).
[0043] Next, the repeater 105(#2) outputs the generated reception confirmation AR marker image data 113(#2) to the display 103(#2), causing the display 103(#2) to display the corresponding reception confirmation AR marker 114(#2) (sequence S209).
[0044] In response to this, in the relay device 101(#1) on the transmitting side, the relay device 105(#1) issues an image capture instruction to the image capture device 104(#1). As a result, the image capture device 104(#1) captures an image of the reception confirmation AR marker 114(#2) displayed on the display device 103(#2) of the relay device 101(#2) on the receiving side (sequence S210).
[0045] Next, the repeater 105(#1) acquires the reception confirmation AR marker image data 113(#1) corresponding to the reception confirmation AR marker 114(#2) from the image capturer 104(#1) (sequence S211).
[0046] When the repeater 105(#1) correctly receives the reception confirmation AR marker image data 113(#1), it clears the display of the transmission AR marker 112(#1) on the display 103(#1) (sequence S212).
[0047] The receiving relay device 101 (#2) transmits the transmission information 110 (#2) received from the transmitting relay device 101 (#1) in sequence S207 to the management side slave terminal device 102 (#C) using the wireless or wired electronic communication method described above (sequence S213). This allows the management-side slave terminal device 102(#C) to receive, for example, transmission information 110 of a disaster relief request from the slave terminal device 102(#A). The management-side slave terminal device 102(#C) passes the transmission information 110 to a higher-level device such as a personal computer connected via a USB interface (not shown).
[0048] FIG. 3 is an operational sequence diagram when processing content (for example, evacuation instructions from a disaster relief headquarters) is transmitted from the transmitting-side management-side slave terminal device 102(#C) to the receiving-side slave terminal device 102(#A). First, in the relay device 101(#2), the repeater 105(#2) receives transmission information 110(#2) from the management-side slave terminal device 102(#C) by wireless or wired communication (sequence S301). Note that, prior to communication with the relay device 101(#2), the management-side slave terminal device 102(#C) has been handed over transmission information 110(#2) including processing details instructed to the slave terminal devices 102(#A, #B) from a host device such as a personal computer connected via a USB interface (not shown).
[0049] The repeater 105(#2) receives the original transmission information 110(#2) and stores it in an internal memory (not shown) for a predetermined period of time (sequence S302).
[0050] Next, in the transmitting relay device 101(#2), the repeater 105(#2) performs data conversion on the transmission information 110(#2) (described later) and generates transmission AR marker image data 111(#2) corresponding to the data-converted code (sequence S303).
[0051] Next, the repeater 105(#2) outputs the generated transmission AR marker image data 111(#2) to the display 103(#2), causing the display 103(#2) to display the corresponding transmission AR marker 112(#2) (sequence S304).
[0052] Meanwhile, in the receiving relay device 101(#1), the relay device 105(#1) issues an image capture instruction to the image capture device 104(#1). As a result, the image capture device 104(#1) captures the image of the transmission AR marker 112(#2) displayed on the display device 103(#2) of the transmitting relay device 101(#2) (sequence S305).
[0053] Next, the repeater 105(#1) acquires the transmission AR marker image data 111(#1) corresponding to the transmission AR marker 112(#2) from the image capturer 104(#1) (sequence S306).
[0054] The repeater 105(#1) extracts and receives the original transmission information 110(#1) from the acquired transmission AR marker image data 111(#1), and stores it in an internal memory (not shown) for a predetermined period of time (sequence S307).
[0055] The repeater 105(#1) generates reception confirmation AR marker image data 113(#1) indicating that the transmission information 110(#1) has been correctly received (sequence S308).
[0056] Next, the repeater 105(#1) outputs the generated reception confirmation AR marker image data 113(#1) to the display 103(#1), and displays the corresponding reception confirmation AR marker 114(#1) on the display 103(#1) (sequence S309).
[0057] In response to this, in the relay device 101(#2) on the transmitting side, the relay device 105(#2) issues an image capture instruction to the image capture device 104(#2). As a result, the image capture device 104(#2) captures an image of the reception confirmation AR marker 114(#1) displayed on the display device 103(#1) of the relay device 101(#1) on the receiving side (sequence S310).
[0058] Next, the repeater 105(#2) acquires the reception confirmation AR marker image data 113(#2) corresponding to the reception confirmation AR marker 114(#1) from the image capturer 104(#2) (sequence S311).
[0059] When the repeater 105(#2) correctly receives the reception confirmation AR marker image data 113(#2), it clears the display of the transmission AR marker 112(#2) on the display 103(#2) (sequence S312).
[0060] In the receiving relay device 101 (#1), the repeater 105 (#1) transmits the transmission information 110 (#1) received from the transmitting relay device 101 (#2) in sequence S307 to the slave terminal device 102 (#A) using, for example, the EnOcean batteryless wireless transmission method described above (sequence S313).
[0061] As a result, the slave terminal device 102(#A) receives the transmission information 110(#1) storing the processing content instructed by the management-side slave terminal device 102(#C) (sequence S314).
[0062] If, as a result of the above processing, the slave terminal device 102(#A) returns a processing result (e.g., evacuation to a safe place completed) to the management side slave terminal device 102(#C), an operation sequence similar to that shown in Figure 2 is executed when transmitting transmission information 110 from the slave terminal device 102(#A) to the management side slave terminal device 102(#C) (sequence S315).
[0063] When transmission information 110 is transmitted between the slave terminal device 102 (#A, #B) and the management side slave terminal device 102 (#C) described in Figures 2 and 3, the transmission information 110 is converted into data to ensure security.
[0064] Fig. 4 is a diagram showing the data conversion operation when transmission information is transmitted from the transmitting slave terminal device 102 (#A, #B) to the receiving management slave terminal device 102 (#C) in accordance with the operation sequence described in Fig. 2. In Fig. 4, the parts assigned the same sequence numbers as in Fig. 2 correspond to the sequences of the same numbers in Fig. 2.
[0065] First, consider a case where the slave terminal device 102(#A) in FIG. 1 is, for example, an RFID (Radio Frequency Identifier) reader. The information and communication network system 100 in FIG. 1 can be used not only as an emergency network in the event of a disaster, but also as a network for various reports from a manufacturing site in a factory to the management department. RFID tags, which identify products and store product status information, are often used on various manufactured products and goods in a factory. Therefore, for example, the information and communication network system 100 in FIG. 1 can be established in a manufacturing factory, and a system can be constructed in which the slave terminal device 102(#A) reads the contents of the RFID tags attached to the manufactured products and goods and notifies the management-side slave terminal device 102(#C) in a management building, etc. This configuration makes it possible to establish a secure network that does not go through the Internet. In this embodiment, a base-90 code, for example, compressed and converted using a combination of uppercase and lowercase letters of the alphabet (0 to 9) and symbols, is written on the RFID tag to be read. By using a compressed and converted code, it is possible to express as much information as possible with a single digit. Furthermore, by including symbols, the code becomes incomprehensible to unfamiliar people, thereby increasing security against information leaks. Furthermore, by arbitrarily determining the corresponding code, it is possible to create a code with different meanings.
[0066] Next, when the slave terminal device 102(#A) reads the RFID, the slave terminal device 102(#A) transmits the compressed RFID code as is to the relay device 101(#1) as transmission information 110 (sequence S201 in Figures 2 and 4).
[0067] On the other hand, consider a case where the slave terminal device 102(#B) in Fig. 1 is, for example, a wireless select switch. In this case, the selection result by the switch processing is converted into, for example, a compressed conversion code, and the converted code is transmitted to the relay device 101(#1) as the transmission information 110 (sequence S201 in Figs. 2 and 4).
[0068] The repeater 105(#1) of the repeater device 101(#1) converts the compressed conversion code received from the slave terminal device 102(#A) back into the original decimal value using the data conversion unit 109(#1), which is a circuit or software library built into the repeater 105(#1), and stores the resulting transmission information 110(#1) in an internal memory (not shown) for a predetermined period of time (sequence S202 in Figures 2 and 4).
[0069] In this way, the slave terminal devices 102 (#A, #B) communicate the transmission information 110 (#1) with the relay device 101 (#1) while converting the transmission information 110 (#1) between the original decimal value and the compressed conversion code. As a result, the security of the transmission information 110 can be improved.
[0070] Next, in the relay device 101(#1), the repeater 105(#1) performs the following data conversion when generating the transmission AR marker image data 111(#1) from the transmission information 110(#1) in sequence S203 of FIG. 2 described above. That is, the data conversion unit 109(#1) built into the repeater 105(#1) converts the transmission information 110(#1), which was converted back to decimal in sequence S202 of FIG. 2 and FIG. 4, into a code from a 586-base number determined by the AR marker ID. The repeater 105 then generates the transmission AR marker image data 111(#1) including the converted code and displays the corresponding transmission AR marker 112(#1) on the display 103(#1) (sequences S203 and S204 of FIG. 2 and FIG. 4). Each pixel of the transmission AR marker 112(#1) has, for example, multiple gradation information as brightness information. For example, if each pixel has 1024 levels of brightness information, one digit of the 586-based number determined by the AR marker ID can be assigned to the brightness of one pixel. In this way, in this embodiment, by assigning the code of the transmission information 110 converted into the ID of the AR marker 112 to each pixel of the transmission AR marker 112, it becomes possible to transmit a large amount of transmission information 110 (#1) using one transmission AR marker 112.
[0071] Meanwhile, in the receiving relay device 101(#2), the relay device 105(#2) uses the image capture device 104(#2) to capture and read the transmission AR marker 112(#1) displayed on the display device 103(#1) of the transmitting relay device 101(#1) (sequence S205 in Figures 2 and 4). Next, the relay device 105(#2) acquires transmission AR marker image data 111(#2) including the ID code of the AR marker corresponding to the transmission AR marker 112(#1) (sequence S206 in Figures 2 and 4).
[0072] Then, the data conversion unit 109 (#2) built into the repeater 105 (#2) performs data conversion from the transmission AR marker image data 111 (#2) to the original decimal transmission information 110 (#2), and stores it in an internal memory (not shown) for a predetermined period of time (sequence S207 in Figures 2 and 4).
[0073] Thereafter, when the repeater 105(#2) of the receiving repeater 101(#2) executes sequences S208 and S209 in Fig. 2 to generate the reception confirmation AR marker image data 113(#2) and display the reception confirmation AR marker 114(#2) on the display 103(#2), no special data conversion is performed. This is because the reception confirmation code is a simple code and therefore reduces the processing load. Furthermore, when the repeater 105 (#1) of the transmitting repeater 101 (#1) executes the sequences S210, S211, and S212 of Figure 2 to read the above-mentioned reception confirmation AR marker 114 (#2) displayed on the display 103 (#2) of the receiving repeater 101 (#2), generate the corresponding reception confirmation AR marker image data 113 (#1), decode the reception confirmation code from there, and clear the display of the transmission AR marker 112 (#1) displayed on the display 103 (#1), no special data conversion is performed for the reasons described above.
[0074] Fig. 5 is a diagram showing the data conversion operation when processing contents are transmitted from the transmitting-side management-side slave terminal device 102(#C) to the receiving-side slave terminal device 102(#A) in accordance with the operation sequence described in Fig. 3. In Fig. 5, parts assigned the same sequence numbers as in Fig. 3 correspond to the sequences of the same numbers in Fig. 3.
[0075] First, the management-side slave terminal device 102(#C) converts the processing command code to be issued to the slave terminal device 102(#A), which is received from a personal computer (not shown) or the like via a USB interface or the like, into a compressed code, for example, a base-90 code, and then transmits the converted code to the relay device 101(#2) as transmission information 110(#2) (sequence S301 in Figures 3 and 5).
[0076] The repeater 105(#2) of the repeater 101(#2) converts the compressed conversion code received from the management-side slave terminal device 102(#C) into the original decimal transmission information 110(#2) using its built-in data conversion unit 109(#2).The repeater 105(#2) then stores the transmission information 110(#2) in an internal memory (not shown) for a predetermined period of time (sequence S302 in FIGS. 3 and 5).
[0077] In this way, the management-side slave terminal device 102 (#C) communicates the transmission information 110 with the relay device 101 (#2) while converting the transmission information 110 between the original decimal value and the compressed conversion code. As a result, the security of the transmission information 110 can be improved.
[0078] Next, in the relay device 101(#2), the relay 105(#2) performs the following data conversion when generating transmission AR marker image data 111(#2) from the transmission information 110(#2) in sequence S303 of FIG. 2 described above. That is, the data conversion unit 109(#2) built into the relay 105(#2) converts the transmission information 110(#2), which was converted back to its original decimal number in sequence S302 of FIG. 3 and FIG. 5, into an ID code of the AR marker. The relay 105 then generates transmission AR marker image data 111(#2) including the converted code and displays the corresponding transmission AR marker 112(#2) on the display 103(#2) (sequences S303 and S304 of FIG. 3 and FIG. 5).
[0079] Meanwhile, in the receiving relay device 101(#1), the relay device 105(#1) uses the image capture device 104(#1) to capture and read the transmission AR marker 112(#2) displayed on the display device 103(#2) of the transmitting relay device 101(#2) (sequence S305 in Figures 3 and 5). Next, the relay device 105(#1) acquires transmission AR marker image data 111(#1) including the ID code of the AR marker corresponding to the transmission AR marker 112(#2) (sequence S306 in Figures 3 and 5).
[0080] Then, the data conversion unit 109(#1) built into the repeater 105(#1) performs data conversion from the transmission AR marker image data 111(#1) to the original decimal transmission information 110(#1), and stores it in an internal memory (not shown) for a predetermined period of time (sequence S307 in Figures 3 and 5).
[0081] Thereafter, when the repeater 105 (#1) of the receiving repeater device 101 (#1) executes sequences S308 and S309 of FIG. 3 to generate reception confirmation AR marker image data 113 (#1) and display the reception confirmation AR marker 114 (#1) on the display 103 (#1), no special data conversion is performed for the same reasons as in the case of sequences S208 and S209 of FIG. 4. Furthermore, when the repeater 105 (#2) of the transmitting repeater 101 (#2) executes the sequences S310, S311, and S312 of Figure 3 to read the above-mentioned reception confirmation AR marker 114 (#1) displayed on the display 103 (#1) of the receiving repeater 101 (#1), generate the corresponding reception confirmation AR marker image data 113 (#2), decode the reception confirmation code from there, and clear the display of the transmission AR marker 112 (#2) displayed on the display 103 (#2), no particular data conversion is performed, as is the case when the sequences S210, S211, and S212 of Figure 4 are executed.
[0082] Furthermore, in accordance with sequence S313 in Figure 3 described above, when the repeater 105 (#1) in the receiving relay device 101 (#1) transmits the transmission information 110 (#1) received from the transmitting relay device 101 (#2) in sequence S307 to the slave terminal device 102 (#A), the data conversion unit 109 (#1) built into the repeater 105 (#1) may transmit the transmission information 110 (#1) as it was when sequence S306 was executed, or may compress and convert the transmission information 110 (#1) converted back to decimal in sequence S307 and transmit it (sequence S313 in Figures 3 and 5).
[0083] Thereafter, in accordance with sequence S314 of FIG. 3 described above, when the slave terminal device 102(#A) executes processing and returns the processing result to the management-side slave terminal device 102(#C), an operation sequence similar to that of FIG. 2 described above when transmitting transmission information 110 from the slave terminal device 102(#A) to the management-side slave terminal device 102(#C) is executed in sequence S315 of FIG. 3, and therefore a data conversion process similar to that of FIG. 4 described above may be executed (sequence S315 of FIGS. 3 and 5).
[0084] Fig. 6 is a diagram showing an example of the hardware configuration of the slave terminal device 102(#A) in Fig. 1. This configuration example is an example in which the slave terminal device 102(#A) is an RFID reader, as described above with reference to Fig. 4.
[0085] This slave terminal device 102(#A) transmits transmission information 110(#1) to the relay device 101(#1) in Fig. 1 using a no-power supply wireless communication method. As the no-power supply wireless communication method, for example, the EnOcean battery-less wireless transmission method described above can be adopted.
[0086] In FIG. 6, an energy harvesting (environmental power generation) power management circuit 601 supplies sufficient power to operate circuits 602 to 605 by managing weak power generated by, for example, light from a solar power generation unit or an LED flashlight (not shown) or the force of pressing a switch (dashed lines in FIG. 6).
[0087] In addition, the EnOcean wireless interface circuit 602 realizes the operation of transmitting transmission information 110(#1) including data read by this slave terminal device 102(#A) from the RFID tag to the repeater device 101(#1) in Figure 1 without requiring an external power supply.
[0088] In Figure 6, radio waves received by antenna 603 from an RFID tag (not shown) are demodulated by demodulation circuit 604 and then wirelessly transmitted from EnOcean wireless interface circuit 602 to relay device 101 (#1) in Figure 1 under the control of control circuit 605.
[0089] Even in the event of a disaster, the slave terminal device 102(#A) having the configuration of Figure 6 can transmit important information such as disaster relief requests to the management side slave terminal device 102(#C) at a disaster relief headquarters, etc., via the information and communication network system 100 of Figure 1 without requiring an external power supply.
[0090] Fig. 7 is a diagram showing an example of the hardware configuration of the slave terminal device 102(#B) in Fig. 1. This slave terminal device 102(#B) transmits transmission information 110(#1) including various on / off information to and from the relay device 101(#1) in Fig. 1 using, for example, the EnOcean battery-less wireless transmission method, similar to the example of the slave terminal device 102(#A).
[0091] In FIG. 7, a switch unit 701 includes one or more switch pads for indicating on / off information for emergency doors, shutters, private generators, and the like.
[0092] The energy harvesting (environmental power generation) power management circuit 702 supplies sufficient power to operate the circuits 701 and 703 by managing the weak power generated by, for example, the force of pressing each switch pad of the switch section 701.
[0093] In addition, the EnOcean wireless interface circuit 703 realizes the operation of transmitting transmission information 110 (#1) including various on / off information output by the switch unit 701 to the relay device 101 (#1) in Figure 1 without requiring an external power supply.
[0094] Fig. 8 is a diagram showing an example of the hardware configuration of the management-side slave terminal device 102(#C) in Fig. 1. This management-side slave terminal device 102(#C) communicates transmission information 110(#2) with the relay device 101(#2) in Fig. 1 using, for example, the EnOcean battery-less wireless transmission method, similar to the example of the slave terminal devices 102(#A, #B).
[0095] In Figure 8, similar to the example in Figure 6, an energy harvesting (environmental power generation) power management circuit 801 supplies operational power to circuits 802 and 803 by managing weak power generated by light from, for example, a solar power generation unit or an LED flashlight (not shown).
[0096] In FIG. 8, the EnOcean wireless interface circuit 802 realizes the communication operation of the transmission information 110(#2) with the relay device 101(#2) without requiring an external power supply.
[0097] In FIG. 8, the USB interface circuit 803 realizes the communication operation of the transmission information 110 (#2) with a personal computer or the like (not shown) without requiring an external power supply.
[0098] Finally, a description will be given of an example of the hardware configuration of the relay device 101 in Fig. 1. If the relay device 101 is small-scale, it can be configured by combining commonly available products on the market.
[0099] For example, the display 103 in FIG. 1 can be realized by a general computer display monitor 901 of about 30 to 60 inches.
[0100] The image pickup device 104 in FIG. 1 can be realized by a commercially available video camera 902 with a zoom lens function.
[0101] 1 can be realized by a commercially available one-board microcomputer. Note that by making the one-board microcomputer itself compatible with energy harvesting power sources, it is possible to realize a relay device 101 that operates with low power consumption.
[0102] With this configuration, the information communication network system 100 of FIG. 1 can be realized at very low cost.
[0103] The present invention can be utilized as various information and communication network systems other than the emergency network for disasters described in this embodiment. Specifically, for example, as mentioned above, it can be used as a network for various reports from the manufacturing site within a factory to the management department. Furthermore, for example, by utilizing the information and communication network system 100 according to this embodiment in a sales store for product inquiries and replenishment requests from the sales department where the slave terminal device 102(#A) is installed to the warehouse department where the management side slave terminal device 102(#C) is installed, and for replies in the reverse direction, the slave terminal device 102(#A) and the management side slave terminal device 102(#C) can be operated with low power consumption or no power supply without using a communication carrier or the Internet. This makes it possible to build a low-cost, highly secure in-store information and communication network system using data conversion. Furthermore, for example, it will be possible to build information and communication network systems within schools, research facilities, hospitals, financial institutions, government offices, etc., which are low-cost, have high security through data conversion, and are hack-free because they are not connected to communication carriers or the Internet. [Explanation of symbols]
[0104] 100 Information and Communication Network Systems 101 Relay device 102 Sub-terminal device 102(#C) Management side terminal device 103 Display 104 Imager 105 Repeater 106 Transmission AR marker board 107 AR marker board installation device 108 Portable information receiving terminal device 108-1 Camera 108-2 LCD display 109 Data Conversion Unit 110 Transmission Information 111 AR marker image data for transmission 112 Transmission AR Marker 113 AR marker image data for receipt confirmation 114 AR marker for reception confirmation
Claims
1. An information and communication network system comprising a plurality of sets of relay devices, each set having a display, an image capture device, and a repeater, and end devices that communicate with each other via the relay devices, In the relay device on the transmitting side, the relay generates transmission AR marker image data corresponding to the transmission information, and displays the transmission AR marker corresponding to the generated transmission AR marker image data on the display; In the relay device on the receiving side, the relay causes the image capture device to capture the transmission AR marker displayed on the display device of the relay device on the transmitting side, thereby acquiring the transmission AR marker image data corresponding to the transmission AR marker, and extracts and receives the transmission information from the acquired transmission AR marker image data; The terminal device operates with low power consumption or no power supply, and communicates the transmission information with the relay device by wireless or wired electronic communication method. An information and communication network system that performs communication operations.
2. generating, in the relay device on the receiving side, reception confirmation AR marker image data indicating that the transmission information has been correctly received, and displaying, on the display device, a reception confirmation AR marker corresponding to the generated reception confirmation AR marker image data; In the transmitting relay device, the relay causes the image capture device to capture the reception confirmation AR marker displayed on the display device of the receiving relay device, thereby acquiring the reception confirmation AR marker image data corresponding to the reception confirmation AR marker, and clears the display of the transmission AR marker on the display device when the reception confirmation AR marker image data is correctly received.
2. The information and communication network system according to claim 1, further comprising a communication operation.
3. 3. The information communication network system according to claim 1, wherein the end device is a slave terminal device that communicates the transmission information with the relay device by a wireless electronic communication method without power supply.
4. 4. An information and communication network system according to claim 1, wherein the end device is a slave terminal device that communicates the transmission information with the relay device using a short-range wireless electronic communication method or a wired electronic communication method.
5. the terminal device is an AR marker board installation device that installs a plurality of types of large transmission AR marker boards, each having an area of several meters square or more, corresponding to a plurality of types of transmission information, at a terminal of the information communication network system, 5. The information and communication network system according to claim 1, wherein in one of the receiving-side relay devices, the relay causes the imager to capture the transmission AR marker indicated by the transmission AR marker board installed in the AR marker board installation device, acquires the transmission AR marker image data corresponding to the transmission AR marker, and extracts and receives the transmission information corresponding to the transmission AR marker board from the acquired transmission AR marker image data.
6. 6. The information and communication network system according to claim 5, wherein in one of the receiving-side relay devices, the relay device measures the position or distance of the transmitting AR marker board installed in the AR marker board installation device via the imager, and adds the position or distance to the received transmission information.
7. 7. The information and communication network system according to claim 5, further comprising a louver installed in front of the AR marker board installation device where the transmission AR marker board is installed, the louver limiting the range in which the transmission AR marker board can be seen.
8. 8. The information and communication network system according to claim 5, wherein the terminal device is a portable information receiving terminal device that receives and displays information by capturing an AR marker displayed on a display of the relay device and acquiring AR marker image data corresponding to the captured AR marker.
9. 9. The information communication network system according to claim 1, wherein the transmitting relay device and the receiving relay device perform bidirectional communication operations, also operating as the receiving relay device and the transmitting relay device, respectively.
10. 10. The information and communication network system according to claim 1, wherein each of the transmitting relay device and the receiving relay device stores the transmission information or the AR marker image data for transmission for a predetermined period of time.
11. the repeater of the transmitting-side repeater device performs data conversion on the transmission information and generates transmission AR marker image data corresponding to the data-converted transmission information; the repeater of the receiving-side repeater device performs a data conversion process on the data-converted transmission information extracted from the acquired transmission AR marker image data to return it to the original transmission information.
11. An information and communication network system according to any one of claims 1 to 10.
12. the repeater of the transmitting-side repeater converts the transmission information expressed in decimal numbers into the data-converted transmission information expressed by the ID of an AR marker, thereby converting the transmission information into data; The repeater of the receiving-side repeater device performs a data conversion process to convert the data-converted transmission information extracted from the acquired transmission AR marker image data back into the original transmission information expressed in decimal. The information and communication network system according to claim 11.
13. 4. The information and communication network system according to claim 3, wherein at least one of the slave terminal devices executes communication of the transmission information between the relay device and the relay device while converting the transmission information between its original decimal value and a compressed conversion code.
14. 1. An information communication method in an information communication network system including a plurality of sets of relay devices, each set including a display device, an image capture device, and a relay device, and slave terminal devices that perform end-to-end communication via the relay devices, comprising: In the relay device on the transmitting side, the relay generates transmission AR marker image data corresponding to the transmission information, and displays the transmission AR marker corresponding to the generated transmission AR marker image data on the display; In the relay device on the receiving side, the relay device causes the image capture device to capture the transmission AR marker displayed on the display device of the relay device on the transmitting side, acquires the transmission AR marker image data corresponding to the transmission AR marker, extracts the transmission information from the acquired transmission AR marker image data, and receives the transmission information; the slave terminal device operates with low power consumption or no power supply, and communicates the transmission information with the relay device by a wireless or wired communication method. An information communication method for performing a communication operation.