Information display device, information sharing method, and information sharing system
The information display device system addresses the challenge of sharing and synchronizing sensing data across multiple devices by using a data acquisition and display control unit to associate identification and selection information, enhancing coordination and efficiency in applications like fleet management.
Patent Information
- Application Number
- JP2021125645
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-07-30
- Publication Date
- 2025-06-24
- Estimated Expiration
- 2041-07-30
AI Technical Summary
Existing information display devices lack the capability to efficiently share and synchronize the display of sensing data across multiple devices, making it difficult for users to know what information is being displayed on other devices.
An information display device system that includes a data acquisition unit to collect selection type data indicating which sensing data is being displayed, and a display control unit that displays identification information and selection information in association with each other, allowing other devices to know which sensing data is being displayed.
Enables seamless sharing and synchronization of sensing data across multiple information display devices, allowing users to easily determine which data is being displayed on other devices, thereby improving coordination and efficiency in applications such as fleet management.
Smart Images

Figure 0007697842000001 
Figure 0007697842000002 
Figure 0007697842000003
Abstract
Description
Technical Field
[0001] The present invention relates to an information display device, an information sharing method, and an information sharing system.
Background Art
[0002] Patent Document 1 describes a display device that can efficiently inform a user of the relationship between information acquired by an unmanned aircraft and a target object to be detected.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] By the way, when there are a plurality of information display devices, it is convenient for a user using one information display device to know what information is being displayed on other information display devices.
[0005] The present invention has been made in view of the above problems, and its main object is to provide an information display device, an information sharing method, and an information sharing system that can know what information is being displayed on other information display devices.
Means for Solving the Problems
[0006] To solve the above problems, an information display device according to one aspect of the present invention includes: a data acquisition unit that acquires selection type data indicating which sensing data among a plurality of sensing data sensed by the plurality of moving bodies is being selected for display by a first information display device disposed on a first moving body among the plurality of moving bodies; and a display control unit that, based on the selection type data, displays identification information representing the first information display device and selection information indicating the sensing data being selected by the first information display device in association with each other. According to this, it becomes possible to know which sensing data is being displayed on the first information display device.
[0007] In the above aspect, the information display device may be disposed on a second moving body among the plurality of moving bodies. According to this, it becomes possible to know on the second moving body which sensing data is being displayed on the first information display device.
[0008] In the above aspect, the identification information representing the first information display device may include identification information representing the first moving body. According to this, it becomes possible to know which sensing data is being displayed on the first moving body.
[0009] In the above aspect, the data acquisition unit may further acquire display status data indicating the display status of the sensing data being selected, together with the selection type data, and the display control unit may further display status information indicating the display status of the sensing data being selected in association with the identification information and the selection information. According to this, it becomes possible to further know the display status of the sensing data.
[0010] In the above aspect, the display status data may represent the communication status of wireless communication when the first information display device acquires the plurality of sensing data. According to this, it becomes possible to know the display status of the sensing data based on the communication status.
[0011] In the above aspect, the communication status of the wireless communication may be a packet loss rate. According to this, it becomes possible to know the display status of the sensing data based on the packet loss rate.
[0012] In the above aspect, the sensing data may include image data. According to this, it becomes possible to easily understand which sensing data is being displayed.
[0013] In the above aspect, the sensing data may include image data generated by sensing with a fish finder, sonar, radar, or camera. According to this, it becomes possible to easily understand which sensing data is being displayed.
[0014] In the above aspect, the selection information indicating the sensing data being selected by the first information display device may be a reduced image of the image data. According to this, it becomes possible to easily understand which sensing data is being displayed.
[0015] In the above aspect, the display control unit may superimpose and display a symbol indicating the display status of the selected sensing data on the reduced image. According to this, it becomes possible to know the display status of the sensing data from the symbol displayed on the reduced image.
[0016] In the above aspect, the sensing data may include video data, and the display status data may represent the playback status of the video data. According to this, it becomes possible to know the display status of the sensing data based on the playback status.
[0017] In the above aspect, the display control unit may display the identification information and the selection information in association with each other in a list. According to this, it becomes possible to display the identification information and the selection information in an easy-to-understand manner.
[0018] In the above aspect, the display control unit may further display, in the list, detection information representing the sensing data sensed by the plurality of moving objects in association therewith. According to this, it becomes possible to more clearly display the detection information.
[0019] In the above aspect, the plurality of moving objects may be a plurality of ships constituting a fleet that cooperates in fishing. According to this, it becomes possible to know which ship among the plurality of ships constituting the fleet is displaying which sensing data.
[0020] Further, an information display device according to another aspect of the present invention includes: a data acquisition unit that acquires at least one of a plurality of sensing data sensed by a plurality of moving objects; a display control unit that displays the sensing data selected from the plurality of sensing data; and a transmission processing unit that transmits selection type data indicating which of the plurality of sensing data is being selected. According to this, it becomes possible to notify which sensing data is being displayed.
[0021] In the above aspect, the data acquisition unit may acquire the plurality of sensing data by direct wireless communication with another information display device. According to this, it becomes possible to directly acquire the sensing data.
[0022] In the above aspect, the data acquisition unit may acquire the plurality of sensing data by wireless communication via a relay device. According to this, it becomes possible to acquire the sensing data via the relay device.
[0023] In addition, in the information sharing method according to another aspect of the present invention, at least one of a plurality of sensing data sensed by a plurality of moving bodies is acquired by a first information display device disposed on a first moving body among the plurality of moving bodies, the first information display device displays the sensing data selected from the plurality of sensing data, the first information display device transmits selection type data indicating which sensing data among the plurality of sensing data the first information display device is selecting, a second information display device acquires the selection type data, and the second information display device displays the identification information representing the first information display device and the selection information indicating the sensing data being selected by the first information display device in association with each other. According to this, it becomes possible to know which sensing data is being displayed on the first information display device.
[0024] In addition, an information sharing system according to another aspect of the present invention includes a data acquisition unit that acquires at least one of a plurality of sensing data sensed by a plurality of moving bodies, a display control unit that displays the sensing data selected from the plurality of sensing data, and a transmission processing unit that transmits selection type data indicating which sensing data among the plurality of sensing data is being selected, the first information display device disposed on a first moving body among the plurality of moving bodies, a data acquisition unit that acquires the selection type data, and a display control unit that, based on the selection type data, displays the identification information representing the first information display device and the selection information indicating the sensing data being selected by the first information display device in association with each other. According to this, it becomes possible to know which sensing data is being displayed on the first information display device.
Brief Description of the Drawings
[0025]
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10
Embodiments for Carrying Out the Invention
[0026] Hereinafter, embodiments of the present invention will be described with reference to the drawings.
[0027] [System Overview] FIG. 1 is a block diagram showing a configuration example of an information sharing system 100 according to an embodiment. The information sharing system 100 includes a plurality of information display devices 1A and 1B. The number of information display devices 1A and 1B is not limited to two, and there may be three or more. In the following description, the information display devices 1A and 1B are also collectively referred to as "information display device 1".
[0028] In this embodiment, the plurality of information display devices 1A and 1B are respectively arranged on a plurality of ships SH1 and SH2. The ships SH1 and SH2 are an example of a moving body. Not limited to this, the moving body may be a vehicle or the like. The ships SH1 and SH2 are, for example, a plurality of fishing boats constituting a fleet that cooperates in fishing.
[0029] In the following description, from the perspective of the information display device 1, the ship on which it is arranged is referred to as the "own ship", and the other ships are referred to as "other ships". That is, for the information display device 1A, the ship SH1 is the "own ship", and the ship SH2 is the "other ship". For the information display device 1B, the ship SH1 is the "other ship", and the ship SH2 is the "own ship".
[0030] The information display device 1 includes a control unit 10, a display unit 12, and an operation unit 13. In this embodiment, the information display device 1 is a stationary terminal installed, for example, in a ship's steering room or the like. However, the information display device 1 may be a mobile terminal such as a smartphone or a tablet, for example.
[0031] The control unit 10 is a computer including a CPU, a RAM, a ROM, a non-volatile memory, an input / output interface, and the like. The CPU of the control unit 10 executes information processing according to a program loaded from the ROM or the non-volatile memory into the RAM. The program may be supplied via an information storage medium or may be supplied via a communication network.
[0032] The display unit 12 is a display device such as a liquid crystal display or an organic EL display, for example. The operation unit 13 is a pointing device such as a touch panel or a trackball, for example.
[0033] A wireless communication unit 2 and a sensing unit 3 are connected to the information display device 1. The wireless communication unit 2 has an antenna 21 and realizes wireless communication between a plurality of information display devices 1A, 1B.
[0034] Specifically, the wireless communication unit 2 realizes wireless communication using, for example, a wireless LAN based on IEEE 802.11. For example, the wireless communication unit 2 realizes direct wireless communication between a plurality of information display devices 1A, 1B in an ad-hoc mode. Alternatively, the wireless communication unit 2 may realize wireless communication via an access point in an infrastructure mode.
[0035] Or, the wireless communication unit 2 may realize wireless communication via a base station constituting a mobile communication network such as 5G or LTE, for example.
[0036] The sensing unit 3 is a sensing device such as a radar, a fish finder, a sonar, a plotter device, or a camera, and generates sensing data representing the sensing result. The sensing unit 3 is not limited to one, and there may be a plurality of them.
[0037] The sensing data is, for example, video data. The video data includes a plurality of time-series image data (still images). Not limited to this, the sensing data may be image data or other data.
[0038] The radar emits radio waves around the own ship and receives the reflected waves, and generates echo data based on the received signal. The radar generates video data or image data based on the echo data as sensing data.
[0039] The fish finder and the sonar emit ultrasonic waves into the water by an ultrasonic vibrator installed at the bottom of the ship and receive the reflected waves, and generate underwater detection data based on the received signal. The fish finder and the sonar generate video data or image data based on the underwater detection data as sensing data.
[0040] The plotter device detects the position of the own ship based on the radio waves received from the GNSS (Global Navigation Satellite System), and generates plot data in which the position of the own ship is plotted on an electronic nautical chart. The plotter device generates position data representing the position of the own ship as sensing data. The plotter device generates video data or image data based on the plot data as sensing data.
[0041] The camera is a digital camera, and generates video data or image data obtained by imaging the outside from the own ship as sensing data. Further, the camera may include an image recognition unit that estimates the position and type of a target included in the captured image by an object detection model.
[0042] [Display on the information display screen] FIG. 2 is a diagram showing a display example of an information display screen 30 displayed on the display unit 12 of the information display device 1. FIG. 3 is a diagram showing an example of a screen division table for displaying the information display screen 30. The screen division table is constructed in the non-volatile memory of the control unit 10.
[0043] As shown in FIG. 2, the information display screen 30 is divided into one main area M and a plurality of sub-areas S1 to S3. The main area M is an area for displaying the sensing data generated by the sensing unit 3 of the own ship or other ships in real time.
[0044] The sub-areas S1 to S3 are areas for sequentially displaying time-series thumbnail images generated based on the sensing data of the own ship or other ships. The thumbnail image is a reduced image obtained by reducing the image data of the sensing data.
[0045] In the main area M, the sensing data corresponding to the thumbnail image selected from the sub-areas S1 to S3 is displayed. The number or position of the sub-areas S1 to S3 is not limited to the illustrated example. The number or position of the sub-areas S1 to S3 may be changeable by the user.
[0046] As shown in FIG. 3, in the screen division table, the source and location of the sensing data are associated with each of the main area M and the sub-areas S1 to S3. The source represents the type of the sensing unit 3. The location represents the ship on which the sensing unit 3 is installed.
[0047] In the illustrated example, the sensing data of the own ship's radar is displayed in the main area M, the thumbnail image of the own ship's radar is displayed in the sub-area S1, the thumbnail image of the fish finder of the other ship 1 is displayed in the sub-area S2, and the thumbnail image of the plotting device of the other ship 2 is displayed in the sub-area S3.
[0048] [Switching the display of the main area] Next, the process related to the switching of the display of the main area M in the information sharing method according to the embodiment realized in the information sharing system 100 will be described.
[0049] FIG. 4 is a diagram for explaining the switching of the display of the main area M. The thumbnail images displayed in the sub-areas S1 to S3 are buttonized and can be selected by the user. The selection by the user may be, for example, a selection by touch or a selection by click.
[0050] When one of the thumbnail images displayed in the sub-areas S1 to S3 is selected, the sensing data corresponding to the selected thumbnail image is displayed in the main area M. For example, when a thumbnail image received from another ship is selected, the sensing data corresponding to the selected thumbnail image is acquired from the other ship and displayed in the main area M.
[0051] FIGS. 5 and 6 are flowcharts showing an example of the procedure for switching the display of the main area M. The control unit 10 of the information display device 1 executes the information processing shown in the figure according to a program.
[0052] In the description of this example, the information display device 1 on the side providing the sensing data is referred to as the "first information display device", and the information display device 1 on the side receiving the sensing is referred to as the "second information display device". Each information display device 1 can be either the first information display device or the second information display device.
[0053] As shown in FIG. 5, first, the first information display device acquires sensing data from the sensing unit 3 (S11). Next, the first information display device generates a thumbnail image based on the acquired sensing data (S12).
[0054] Next, the first information display device transmits the generated thumbnail image to the second information display device (S13). Specifically, the second information display device periodically transmits a request for a thumbnail image for display in sub-regions S1 to S3 to the first information display device, and in response, the first information display device sequentially transmits the time-series thumbnail images to the second information display device.
[0055] When the second information display device receives a thumbnail image from the first information display device, it displays the received thumbnail image in one of sub-regions S1 to S3 of the information display screen 30 (see FIG. 2) (S21).
[0056] Next, when the second information display device detects an operation by the user to select one of the thumbnail images displayed in sub-regions S1 to S3 (S22: YES), it transmits a data request for requesting sensing data corresponding to the selected thumbnail image to the first information display device (S23).
[0057] When the first information display device receives a data request from the second information display device (S14: YES), it transmits the sensing data to the second information display device (S15). Note that even if the first information display device starts transmitting the sensing data, it continues to generate and transmit the periodic thumbnail images.
[0058] When the second information display device receives the sensing data from the first information display device, it displays the received sensing data in the main region M of the information display screen 30 (S24). When the sensing data is video data, for example, streaming is used for the transfer and playback of the video data.
[0059] As shown in FIG. 6, next, when an operation to cancel the display of the sensing data in the main region M is detected (S25: YES), the second information display device transmits a stop request for stopping the transmission of the sensing data to the first information display device (S26). The operation to cancel the display is, for example, an operation by the user to select another one of the thumbnail images displayed in sub-regions S1 to S3.
[0060] When the first information display device receives a stop request from the second information display device (S16: YES), it stops transmitting the sensing data (S17). Note that even if the first information display device stops transmitting the sensing data, it continues to generate and transmit regular thumbnail images. Thus, a series of processes ends.
[0061] According to the embodiment described above, the information display screen 30 displayed by the information display device 1 can integrally grasp the sensing data obtained by a plurality of ships. According to this, it becomes possible to improve the efficiency of fishing work in a plurality of ships constituting a fleet that fishes in cooperation.
[0062] [Display of Shared Management Screen] Hereinafter, the process related to the display of the shared management screen 40 among the information sharing methods according to the embodiment realized in the information sharing system 100 will be described.
[0063] When a plurality of ships constituting a fleet fish in cooperation, not only integrally display the plurality of sensing data obtained by the plurality of ships as described above, but it is also convenient to be able to share in real time which of the plurality of sensing data is being displayed on other ships.
[0064] However, since wireless communication using wireless LAN or the like at sea is unstable, problems may occur in the display of sensing data. For example, when the sensing data is video data, the start of playback may be delayed or block noise may occur. For this reason, it is further required to share whether the sensing data is being correctly displayed on other ships.
[0065] In the present embodiment, the shared management screen 40 described below solves these problems.
[0066] FIG. 7 is a diagram showing a display example of the shared management screen 40. The shared management screen 40 is, for example, superimposed and displayed as a pop-up on the information display screen 30 (see FIG. 2), but is not limited thereto. The information display screen 30 and the shared management screen 40 may be switched and displayed, or may be displayed in different areas within the screen of the display unit 12.
[0067] The shared management screen 40 includes ship display rows 41, 42, a source display column 43, and a selection display column 44, and is displayed in the form of a list.
[0068] The plurality of ship display rows 41, 42 correspond to the plurality of information display devices 1A, 1B. That is, the plurality of ship display rows 41, 42 correspond to the plurality of ships SH1, SH2. Hereinafter, it is assumed that the ship display row 41 corresponds to the own ship and the ship display row 42 corresponds to the other ship.
[0069] In the illustrated example, two ship display rows 41, 42 corresponding to two ships SH1, SH2 are provided, but are not limited thereto. Three or more ship display rows may be provided according to the number of communicable ships.
[0070] The ship display rows 41, 42 include identifiers representing the information display devices 1A, 1B (or ships SH1, SH2), such as {0}, {1}, etc. The ship display rows 41, 42 also include character strings representing the ship names of the ships SH1, SH2.
[0071] Furthermore, the ship display rows 41, 42 also include character strings representing the types of the sensing units 3 (sources of sensing data) provided on the ships SH1, SH2, such as fish finders, radars, etc.
[0072] The source display column 43 is a column for displaying the types of sources of sensing data. Thumbnail images 513, 523 representing the types of sources are arranged in the frames corresponding to the ship display rows 41, 42 in the source display column 43.
[0073] The thumbnail images 513 and 523 arranged in the source display column 43 are buttonized to accept the selection of the source. On the thumbnail images 513 and 523, an identifier 63 representing the information display device 1 to which the source belongs, such as {0}, {1}, etc., is superimposed.
[0074] In the illustrated example, a thumbnail image 513 representing the sensing data of the fish finder is arranged in the frame corresponding to the ship display row 41 of the source display column 43, and a thumbnail image 523 representing the sensing data of the radar is arranged in the frame corresponding to the ship display row 42 of the source display column 43.
[0075] The selection display column 44 is a column for displaying the type of sensing data being selected on each information display device 1. Thumbnail images 514 and 524 representing the type of sensing data being selected are arranged in the frames corresponding to the ship display rows 41 and 42 of the selection display column 44.
[0076] Specifically, the thumbnail images 514 and 524 arranged in the selection display column 44 represent the type of sensing data being displayed in the main area M of the information display screen 30 (see FIG. 2). On the thumbnail images 514 and 524, an identifier 64 representing the information display device 1 to which the source of the sensing data being selected belongs, such as {0}, {1}, etc., is superimposed.
[0077] In the illustrated example, thumbnail images 514 and 524 representing the sensing data of the fish finder are arranged in both frames corresponding to the ship display rows 41 and 42 of the selection display column 44, and the identifier 64 of {0} is superimposed. This indicates that the sensing data sensed by the own ship is being displayed on both the own ship and other ships.
[0078] A check box 45 for switching whether to apply the source change is provided in each frame of the selection display column 44. Also, an all check box 46 for collectively switching all the check boxes 45 is provided above the selection display column 44.
[0079] As shown in the illustrated example, when the thumbnail image 513 corresponding to the own ship in the source display column 43 is pressed with the checkbox 45 of the frame corresponding to the own ship in the selection display column 44 checked, the sensing data obtained by the own ship corresponding to the pressed thumbnail image 513 is displayed in the main area M of the own ship information display screen 30.
[0080] Also, when the thumbnail image 513 corresponding to the own ship in the source display column 43 is pressed with the checkbox 45 of the frame corresponding to another ship in the selection display column 44 checked, the sensing data obtained by the own ship corresponding to the pressed thumbnail image 513 is transmitted to the other ship and displayed in the main area M of the other ship information display screen 30.
[0081] Furthermore, a status display column 7 for indicating the display status of the selected sensing data is provided in the selection display column 44. The status display column 7 is superimposed on the thumbnail image 524 corresponding to another ship in the selection display column 44. Display status symbols 7a to 7c for indicating the display status of the selected sensing data are displayed in the status display column 7.
[0082] For example, the display status symbol 7a represents the playback status where the sensing data, which is video data, is before streaming playback. The display status symbols 7b and 7c represent a communication status with a relatively high packet loss rate. When the packet loss rate increases, it changes from the display status symbol 7b to the display status symbol 7c.
[0083] Note that when the status display column 7 including the display status symbols 7a to 7c is not displayed in the selection display column 44, it indicates that the display status of the selected sensing data is good.
[0084] FIG. 8 is a block diagram showing a configuration example of the control unit 10 of the information display device 1. In this figure, mainly shown are the functional units that implement the functions related to the display of the information display screen 30 and the sharing management screen 40 among the functions implemented by the control unit 10. The control unit 10 includes a data acquisition unit 15, a display control unit 16, a selection reception unit 17, and a transmission processing unit 18. These functional units are realized by the CPU of the control unit 10 executing information processing according to a program.
[0085] First, the function related to the display of the information display screen 30 (see FIG. 2) will be described.
[0086] The data acquisition unit 15 acquires at least one of a plurality of sensing data sensed by a plurality of ships SH1, SH2.
[0087] Specifically, the data acquisition unit 15 acquires the sensing data sensed by the sensing unit 3 of its own ship from the sensing unit 3, and generates a thumbnail image based on the sensing data. In addition, the data acquisition unit 15 acquires the sensing data sensed by the sensing unit 3 of another ship and the thumbnail image generated based on it via the wireless communication unit 2.
[0088] The display control unit 16 displays the information display screen 30 on the display unit 12 based on the sensing data and the thumbnail image acquired by the data acquisition unit 15.
[0089] The selection reception unit 17 receives the selection of the sensing data based on the input signal from the operation unit 13. Specifically, the selection reception unit 17 detects the operation of the user who selects one of the thumbnail images displayed in the sub-regions S1 to S3 of the information display screen 30 (see the upper figure in FIG. 4). That is, the selection of the thumbnail image corresponds to the selection of the sensing data.
[0090] The display control unit 16 displays the sensing data selected from the plurality of sensing data on the display unit 12. Specifically, the display control unit 16 displays the selected sensing data in the main area M of the information display screen 30 (see the lower figure in FIG. 4).
[0091] The transmission processing unit 18 transmits, via the wireless communication unit 2, selection type data indicating which of the plurality of sensing data is being selected. That is, the transmission processing unit 18 transmits, as selection type data, information regarding the sensing data displayed in the main area M of the information display screen 30.
[0092] In addition, the transmission processing unit 18 transmits, via the wireless communication unit 2, display status data indicating the display status of the currently selected sensing data.
[0093] Specifically, the display status data is data representing the communication status of wireless communication when the information display device 1 of the own ship acquires sensing data from the information display device 1 of another ship. The communication status is, for example, the packet loss rate. Also, the display status data may be data representing the playback status such as before or during playback when streaming and playing back sensing data that is video data.
[0094] The transmission processing unit 18 periodically transmits, in response to a request from the information display device 1 of another ship, a data set including a thumbnail image, selection type data, display status data, etc. as status data.
[0095] Next, the functions related to the display of the shared management screen 40 (see FIG. 7) will be described.
[0096] The data acquisition unit 15 acquires, via the wireless communication unit 2, the selection type data transmitted from the information display device 1 of another ship. Also, the data acquisition unit 15 acquires, via the wireless communication unit 2, the display status data transmitted from the information display device 1 of another ship.
[0097] The display control unit 16 displays, on the display unit 12, a shared management screen 40 in which the identification information representing each information display device 1 and the selection information indicating the sensing data being selected in each information display device 1 are associated with each other in the form of a list based on the selection type data acquired by the data acquisition unit 15.
[0098] For example, the identification information is an identifier representing the information display devices 1A, 1B, such as {0}, {1}, etc., which are displayed in the ship display rows 41, 42 of the shared management screen 40. Further, the identification information may include a character string representing the ship names of the ships SH1, SH2.
[0099] For example, the selection information is thumbnail images 514, 524 representing the types of the sensing data being selected, which are displayed in the selection display column 44 of the shared management screen 40. The thumbnail images 514, 524 are reduced images of the image data included in the sensing data. Not limited to this, the selection information may be a character string or the like representing the type of the sensing data.
[0100] In the present embodiment, the identification information is displayed in the ship display rows 41, 42 of the shared management screen 40, and the selection information is displayed in the selection display column 44, thereby associating the identification information and the selection information with each other.
[0101] Based on the display status data acquired by the data acquisition unit 15, the display control unit 16 further associates status information indicating the display status of the sensing data being selected with the identification information and the selection information, and displays them on the display unit 12.
[0102] For example, the status information is display status symbols 7a to 7c that are superimposed and displayed in a status display column 7 provided on the thumbnail image 524 corresponding to other ships in the selection display column 44 of the shared management screen 40.
[0103] For example, the display status data is data representing the playback status such as before or during playback when streaming and playing back the sensing data that is video data. When it is before the playback of the sensing data, the display status symbol 7a is displayed.
[0104] Further, the display status data may be data representing the communication status of wireless communication when the information display device 1 of another ship acquires sensing data. When the packet loss rate is relatively high, the display status symbol 7b or 7c is displayed. As the data representing the communication status of wireless communication, data representing the communication status of wireless communication in the information display device 1 of the own ship may be used.
[0105] The display control unit 16 further associates and displays, in a list, the detection information representing the sensing data sensed by each ship on the display unit 12. For example, the detection information is the thumbnail images 513 and 523 representing the types of sensing data, which are displayed in the source display column 43 of the shared management screen 40.
[0106] FIG. 9 is a flowchart showing an example of the procedure for updating the display of the shared management screen 40. The control unit 10 of the information display device 1 functions as the data acquisition unit 15, the display control unit 16, the selection reception unit 17, and the transmission processing unit 18 by executing the information processing shown in the figure according to the program.
[0107] In the description of this example, the information display device 1 on the side providing the status data is referred to as the "first information display device", and the information display device 1 on the side receiving the status data is referred to as the "second information display device". The information display device 1 can be either the first information display device or the second information display device.
[0108] First, every time a predetermined time elapses (S41: YES), the second information display device transmits a status request to the first information display device (S42).
[0109] When the first information display device receives a status request from the second information display device (S31: YES), it transmits status data to the second information display device. The transmission and reception of the status request and the status data are performed according to a communication protocol such as HTTP, for example.
[0110] The status request includes a thumbnail image, selected type data, display status data, etc. The thumbnail image is the latest thumbnail image among the thumbnail images periodically generated from the sensing data obtained by the sensing unit 3 of the first information display device.
[0111] The selected type data is data indicating which sensing data is displayed in the main area M of the information display screen 30 in the first information display device. The display status data is data indicating the display status of the currently selected sensing data.
[0112] When the second information display device receives the status data from the first information display device (S43: YES), it determines whether there has been a change in the selection of the sensing data in the first information display device (S44). Whether there has been a change in the selection is determined by comparing the acquired selected type data with the previously selected type data.
[0113] If there has been a change in the selection of the sensing data (S44: YES), the second information display device updates the thumbnail image corresponding to the first information display device among the thumbnail images 514, 524 displayed in the selection display column 44 of the shared management screen 40 with the newly acquired thumbnail image (S45).
[0114] On the other hand, if there has been no change in the selection of the sensing data (S44: NO), the second information display device proceeds to the next step without updating the thumbnail images 514, 524 displayed in the selection display column 44 of the shared management screen 40.
[0115] Next, the second information display device determines the display status of the currently selected sensing data in the first information display device based on the display status data (S46).
[0116] When the display status is poor (S47: YES), the second information display device provides a status display column 7 on the thumbnail image corresponding to the first information display device among the thumbnail images 514 and 524 displayed in the selection display column 44 of the shared management screen 40, and displays the corresponding one of the display status symbols 7a to 7c (S48).
[0117] On the other hand, when the display status is not poor (S47: NO), the second information display device ends the process without displaying the status display column 7 and the display status symbols 7a to 7c.
[0118] According to the embodiment described above, it is possible to share which of the plurality of sensing data is being displayed on other ships. Furthermore, it is also possible to share whether the sensing data is being correctly displayed on other ships. These are particularly useful when a plurality of ships constituting a fleet cooperate in fishing.
[0119] [Other Embodiments] FIG. 10 is a diagram for explaining another embodiment. As shown in the figure, the plurality of information display devices 1A and 1B may transmit and receive data via a relay server 200.
[0120] For example, one of the information display devices 1A and 1B periodically uploads status data including a thumbnail image, selection type data, and display status data to the relay server 200, and the other of the information display devices 1A and 1B periodically downloads the status data from the relay server 200 and displays the shared management screen 40 (see FIG. 9).
[0121] Although the embodiments of the present invention have been described above, the present invention is not limited to the embodiments described above, and it goes without saying that various changes are possible for those skilled in the art.
Explanation of Reference Numerals
[0122] 1A, 1B Information display device, 10 Control unit, 12 Display unit, 13 Operation unit, 15 Data acquisition unit, 16 Display control unit, 17 Selection reception unit, 18 Transmission processing unit, 2 Wireless communication unit, 21 Antenna, 3 Sensing unit, 30 Information display screen, M Main area, S1 to S3 Sub-areas, 40 Shared management screen, 41, 42 Ship display rows, 43 Source display column, 44 Selection display column, 45 Check box, 46 All check box, 513, 514, 523, 524 Thumbnail images, 63, 64 Identifiers, 7 Status display bar, 7a to 7c Display status symbols, 100 Information sharing system, 200 Relay server, SH1, SH2 Ships
Claims
1. A data acquisition unit that acquires selection type data indicating which sensing data among a plurality of sensing data sensed by the plurality of moving bodies is being selected for display by a first information display device disposed on a first moving body among the plurality of moving bodies; A display control unit that, based on the selection type data, displays the identification information representing the first information display device and the selection information indicating the sensing data being selected by the first information display device in association with each other; An information display device comprising:
2. The information display device is disposed on a second moving body among the plurality of moving bodies, The information display device according to claim 1.
3. The identification information representing the first information display device includes the identification information representing the first moving body, The information display device according to claim 1 or 2.
4. The data acquisition unit further acquires display status data indicating the display status of the sensing data being selected, together with the selection type data, The display control unit further associates and displays status information indicating the display status of the sensing data being selected with the identification information and the selection information, The information display device according to any one of claims 1 to 3.
5. The display status data represents the communication status of wireless communication when the first information display device acquires the plurality of sensing data, The information display device according to claim 4.
6. The communication status of the wireless communication is the packet loss rate, The information display device according to claim 5.
7. The sensing data includes image data, The information display device according to any one of claims 1 to 6.
8. The sensing data includes image data generated by sensing with a fish finder, sonar, radar, or camera, The information display device according to claim 7.
9. The selection information indicating the sensing data being selected by the first information display device is a reduced image of the image data, The information display device according to claim 7 or 8.
10. The display control unit superimposes and displays a symbol indicating the display status of the sensing data being selected on the reduced image, The information display device according to claim 9.
11. The sensing data includes video data, The display status data represents the playback status of the video data, The information display device according to any one of claims 4 to 6.
12. The display control unit displays the identification information and the selection information in association with each other in a list. An information display device according to any one of claims 1 to 11.
13. The display control unit further displays, in the list, detection information representing the sensing data sensed by the plurality of moving objects in association with each other. The information display device according to claim 12.
14. The plurality of moving objects are a plurality of ships constituting a fleet that cooperates in fishing. The information display device according to any one of claims 1 to 13.
15. A data acquisition unit that acquires at least one of a plurality of sensing data sensed by a plurality of moving objects, A display control unit that displays the sensing data selected from the plurality of sensing data, A transmission processing unit that transmits selection type data indicating which of the plurality of sensing data is being selected, An information display device comprising:
16. The data acquisition unit acquires the plurality of sensing data by direct wireless communication with another information display device. The information display device according to claim 15.
17. The data acquisition unit acquires the plurality of sensing data by wireless communication via a relay device. The information display device according to claim 15.
18. At least one of a plurality of sensing data sensed by the plurality of moving objects is acquired by a first information display device disposed on a first moving object among the plurality of moving objects, The first information display device displays the sensing data selected from the plurality of sensing data, The first information display device transmits selection type data indicating which of the plurality of sensing data the first information display device is selecting, A second information display device acquires the selection type data, The second information display device displays the identification information representing the first information display device and the selection information indicating the sensing data being selected by the first information display device in association with each other. An information sharing method.
19. A data acquisition unit that acquires at least one of a plurality of sensing data sensed by a plurality of moving objects, A display control unit that displays the sensing data selected from the plurality of sensing data, A transmission processing unit that transmits selection type data indicating which of the plurality of sensing data is being selected, A first information display device disposed on a first moving body among the plurality of moving bodies, which comprises; A data acquisition unit that acquires the selection type data; A display control unit that, based on the selection type data, associates and displays identification information representing the first information display device and selection information indicating sensing data being selected by the first information display device with each other; A second information display device that comprises; An information sharing system that comprises.
Citation Information
Patent Citations
Radar display system for ship
JP2000206231A
Composite video display device for vessel
JP2002163800A
Intership communication system of fishing fleet
JP2006006217A
Auxiliary monitoring device for preventing ship collision at sea by using laser range finder and laser camera
JP2011123853A
Display device, search system, display method, and program
JP2018008574A