Information sharing system, information sharing method, wide-field image management device, and program

Abstract

This invention provides an information sharing system, an information sharing method, a wide-field image management device, and a program that support effective information sharing using wide-field images. [Solution] An information sharing system comprising a communication device and a wide-field image management device connected to each other via a network, wherein the communication device and the wide-field image management device are connected to each communication application installed on the terminal devices of multiple users belonging to the same communication group via a network, the communication device controls communication including at least chat between the communication applications of the multiple users, and the wide-field image management device connects to a browser launched by the communication application on each terminal device and provides the browser with wide-field images stored in the storage unit for viewing.

Description

Technical Field

[0001] The present disclosure relates to an information sharing system, an information sharing method, a wide-angle image management device, and a program.

Background Art

[0002] As communication tools for promoting efficient communication, business systems and groupware having functions such as posting, messages, bulletin boards, chats, calendars, task management, etc. are known. In place of or in addition to business systems and groupware, SNS (Social Networking Service) may be used. There are also systems in which a business system or groupware and SNS are linked or integrated. Further, in such communication tools, not only simple text but also various files such as documents, images, videos, voices, CAD, etc. can be shared.

[0003] For example, Patent Document 1 describes a system provided with a chat function that enables exchanges (transmission and reception) of comments (text), images, URLs, etc. between users who share a calendar in a calendar sharing application that shares a calendar on a network.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] On the other hand, in recent years, wide-field images with a wide field of view, such as 360-degree images (also called omnidirectional images or all-around images) that capture a wide area, have become known. Wide-field images include areas that are not included in the field of view of a normal camera, and therefore contain a significantly richer amount of information. If multiple people can view such wide-field images simultaneously and communicate via chat or voice, more effective information sharing can be expected.

[0006] This disclosure aims to support effective information sharing using wide-field images. [Means for solving the problem]

[0007] One aspect of the present disclosure is an information sharing system comprising a communication device and a wide-field image management device that are connected competently via a network, wherein the communication device and the wide-field image management device are competently connected via the network to each communication application installed on terminal devices of multiple users belonging to the same communication group, the communication device controls communication, including at least chat, between the communication applications of the multiple users, and the wide-field image management device connects to a browser launched by the communication application on each terminal device and provides the browser with a wide-field image stored in a storage unit for viewing. [Effects of the Invention]

[0008] This disclosure can support effective information sharing using wide-field images.

[0009] Other issues, configurations, and effects not mentioned above will be clarified by the following description of the embodiments. [Brief explanation of the drawing]

[0010] [Figure 1]Figure 1 shows an example of the configuration of an information sharing system according to one embodiment. [Figure 2] Figure 2 is a flowchart showing an example of the posting process in an information sharing system. [Figure 3] Figure 3 shows an example of a UI screen related to the posting process displayed on a terminal device. [Figure 4] Figure 4 is a flowchart showing an example of the browsing process in an information sharing system. [Figure 5] Figure 5 shows an example of a UI screen related to browsing processing displayed on a terminal device. [Figure 6] Figure 6 is a flowchart showing an example of the editing process in an information sharing system. [Figure 7] Figure 7 shows an example of a UI screen related to editing processes displayed on a terminal device. [Figure 8] Figure 8 is a flowchart showing another example of the posting process in an information sharing system. [Figure 9] Figure 9 shows another example of a UI screen related to the posting process displayed on a terminal device. [Figure 10] Figure 10 is a diagram illustrating the relationship between communication groups and image sharing groups. [Figure 11] Figure 11 shows an example of the data structure of image information. [Figure 12] Figure 12 shows another example of an image data structure. [Figure 13] Figure 13 shows an example of a UI screen related to browsing processing displayed on a terminal device. [Modes for carrying out the invention]

[0011] Hereinafter, an embodiment relating to this disclosure will be described with reference to the drawings. In all drawings used to describe the embodiment, the same reference numerals will be used for identical components, and repeated descriptions will be omitted. In addition, in the following embodiment, the components (including element steps, etc.) are not necessarily essential unless specifically stated or considered to be clearly essential in principle. Furthermore, when referring to "consisting of A," "being made of A," "having A," or "including A," other elements are not excluded unless specifically stated that only that element is referred to. Similarly, in the following embodiment, when referring to the shape, positional relationship, etc. of components, etc., it includes those that are substantially similar or approximate to their shape, etc., unless specifically stated or considered to be not in principle.

[0012] Figure 1 shows an example configuration of an information sharing system according to one embodiment. The information sharing system 1 comprises a plurality of terminal devices 2, a communication device 3, and a wide-field image management device 4, each connected to each other via a network 5. Each terminal device 2 is used by a user. In this embodiment, the plurality of users belong to the same communication group (for example, a chat group).

[0013] The information sharing system 1 provides a communication function between users (e.g., chat, message, voice call, video call, etc.) for a plurality of users. In addition, the information sharing system 1 provides a function of sharing a wide-angle image between users for a plurality of users. The wide-angle image is an image (still image) having a wide viewing angle with a wide imaging range, such as a 360-degree image in which the entire 360-degree circumference is imaged (also referred to as an omnidirectional image, a panoramic image, or a full-surround image). The 360-degree image is typically in a form (equirectangular image) in which an omnidirectional image captured by a 360-degree camera is unfolded onto a rectangular plane with an aspect ratio of 2:1, but other forms may also be used. The wide-angle image includes portions that are not included in the angle of view of a normal camera and has a significantly larger amount of information. Each user can perform effective information sharing by using the communication function and the function of sharing the wide-angle image. For example, at a manufacturing site of a large structure such as construction or shipbuilding, efficient information sharing can be expected by communicating while sharing the wide-angle image of the structure between users for the purpose of inspection, confirmation, investigation, etc.

[0014] The terminal device 2 can be composed of a general computer such as a personal computer, a smartphone, a tablet terminal, a wearable terminal, etc., which includes a processor such as a CPU (Central Processing Unit), a memory such as a DRAM (Dynamic Random Access Memory), a storage such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive), input devices such as a keyboard, a mouse, a touch panel, a camera, etc., output devices such as a display and a voice output device, and a communication module such as a NIC (Network Interface Card) (none of which are shown). The terminal device 2 can also be composed of a plurality of computers. The memory and the storage correspond to memory resources.

[0015] The communication device 3 and the wide-view image management device 4 can each be configured by a general computer such as a server computer including a processor such as a CPU, a memory such as a DRAM, a storage such as a HDD or SSD, an input device such as a keyboard, a mouse, a touch panel, a camera, etc., an output device such as a display or an audio output device, and a communication module such as a NIC (all not shown). The communication device 3 and the wide-view image management device 4 can also each be configured by a plurality of computers. The memory and the storage correspond to memory resources.

[0016] The terminal device 2 has a program (for example, the dedicated application 211 of this embodiment, also referred to as a communication application) that operates on an OS (Operating System) installed, and by this program, the user can use the communication function and the shared function of the wide-view image provided by the information sharing system 1. The predetermined program can also be configured by a plurality of programs.

[0017] The communication device 3 and the wide-view image management device 4 each have a predetermined program (for example, the dedicated server program of this embodiment) installed that operates on an OS, and by this program, the user can use the communication function and the shared function of the wide-view image provided by the information sharing system 1. The predetermined program can also be configured by a plurality of programs.

[0018] The network 5 is a communication network such as a LAN (Local Area Network), a WAN (Wide Area Network), the Internet, a mobile phone network, etc. Note that the network 5 may be a VPN (Virtual Private Network) etc. on the communication network.

[0019] The terminal device 2 has functional blocks of a processing unit 21, a storage unit 22, a communication IF (Interface) 23, an input IF 24, and an output IF 25.

[0020] The processing unit 21 is implemented by the computer's processor. The functions of the processing unit 21 are realized by the computer's processor executing the application 211 loaded into memory. Some or all of the functions of the processing unit 21 may be implemented as hardware, such as by an integrated circuit. Furthermore, some or all of the functions of the processing unit 21 may be implemented by multiple computers arranged in a distributed manner.

[0021] Application 211 comprises a communication processing unit 212 and a browser processing unit 213.

[0022] The communication processing unit 212 communicates with the communication device 3 via the communication IF 23 and executes the main functions of the communication tool (e.g., chat, messaging, voice calls, video calls, bulletin boards, calendars, task management, etc.). The communication processing unit 212 displays, for example, a UI (User Interface) screen (chat screen) for chatting on the output IF 25, such as a display. The communication processing unit 212 also accepts user input to the chat screen via the input IF 24, such as a keyboard, touch panel, microphone, or camera, and executes the corresponding processing.

[0023] The browser processing unit 213 has the functionality of a web browser operating within the application 211, and communicates with the communication device 3 or the wide-field image management device 4 via the communication IF 23 to perform the function of sharing wide-field images. For example, the browser processing unit 213 overlays a UI screen (view screen) for viewing and editing wide-field images onto the chat screen and displays it on the output IF 25, such as a display. The browser processing unit 213 also accepts user operations on the view screen via the input IF 24, such as a keyboard or touch panel, and executes the corresponding processing. Of course, the view screen is not limited to being overlaid on the chat screen; it may be partially overlaid on the chat screen, or displayed without being overlaid on the chat screen (the same applies in the following description).

[0024] In this embodiment, the browser processing unit 213 is described as a web browser operating within application 211, but it is not limited to this. The browser processing unit 213 may be another application outside of application 211, such as a general-purpose web browser.

[0025] The storage unit 22 can be implemented by the computer's memory and storage. The storage unit 22 may also be implemented by external memory resources of the terminal device 2. The communication IF 23 is implemented by the computer's communication module. The communication IF 23 communicates various data and information via the network 5 to the communication device 3, the wide-field image management device 4, and other computers. The input IF 24 is implemented by the computer's input device. The output IF 25 is implemented by the computer's output device.

[0026] The communication device 3 has a functional block comprising a processing unit 31, a storage unit 32, and a communication IF 33.

[0027] The processing unit 31 is implemented by a computer processor. The processing unit 31 has functional blocks including a communication control unit 311 and a posting coordination unit 312. These functional blocks are implemented by the computer processor executing a predetermined program loaded into memory. Some or all of these functional blocks may be implemented as hardware using integrated circuits or the like. Furthermore, some or all of these functional blocks may be implemented by multiple computers arranged in a distributed manner.

[0028] The communication control unit 311 controls the main functions of the communication tool (e.g., chat, messaging, voice calls, video calls, bulletin boards, calendars, task management, etc.). This embodiment is mainly characterized by the chat function and its related functions. Below, we will mainly describe the chat function and its related functions, and omit detailed descriptions of other functions.

[0029] The communication control unit 311 controls the chat function and its peripheral functions. For example, the communication control unit 311 receives chat messages entered by one user from application 211 via communication IF 33 and sends them to another user's application 211 via communication IF 33. The communication control unit 311 records the history of sending and receiving chat messages in the storage unit 32. In this way, the chat function is realized.

[0030] The posting linkage unit 312 controls the process of linking the posting of wide-field images to the wide-field image management device 4. For example, when the posting linkage unit 312 receives a posting of a wide-field image from the application 211 via the communication control unit 311 based on an operation by a user (poster), it notifies the wide-field image management device 4 of the posting via the communication IF 33. The posting linkage unit 312 also receives access information to the posted wide-field image from the wide-field image management device 4, generates a link to the wide-field image, and sends the link to the poster's and other users' applications 211 via the communication control unit 311.

[0031] The memory unit 32 can be implemented using the computer's memory and storage. The memory unit 32 stores the posting destination information 321. The memory unit 32 may also store information and data other than the information described above.

[0032] The communication interface 33 is implemented by a computer's communication module. The communication interface 33 communicates various data and information via the network 5, connecting to each terminal device 2, the wide-field image management device 4, and other computers.

[0033] The wide-field image management device 4 has functional blocks including a processing unit 41, a storage unit 42, and a communication IF 43.

[0034] The processing unit 41 is implemented by a computer processor. The processing unit 41 has functional blocks for submission reception 411 and image sharing processing unit 412. These functional blocks are implemented by the computer processor executing a predetermined program loaded into memory. Some or all of these functional blocks may be implemented as hardware using integrated circuits or the like. Furthermore, some or all of these functional blocks may be implemented by multiple computers arranged in a distributed manner.

[0035] The submission reception unit 411 controls the process of receiving wide-field images submitted via the communication device 3. For example, the submission reception unit 411 acquires the submitted wide-field image notified by the communication device 3 via the communication IF 43 and stores it in the storage unit 42. The submission reception unit 411 also issues access information to the wide-field image and notifies the communication device 3.

[0036] The image sharing processing unit 412 controls sharing processes, including viewing and editing wide-field images. For example, when the image sharing processing unit 412 receives a request for a linked wide-field image from application 211 via communication IF 43 based on an operation by a user (viewer), it reads the wide-field image from storage unit 42 and sends it to the viewer's application 211, that is, makes it available for viewing. Also, when the image sharing processing unit 412 receives drawing data on the wide-field image from application 211 based on an operation by a user (viewer), it stores the drawing data in storage unit 42 in association with the wide-field image and sends the drawing data to another user's application 211.

[0037] The storage unit 42 can be implemented using the computer's memory and storage. The storage unit 42 stores image information 421. The storage unit 42 may also store information and data other than the information described above. In the image information 421, for example as shown in Figure 11, an image ID, image file, access information, and group ID are associated and stored for each wide-field image. The image ID is an identifier for identifying the wide-field image. The access information is access information (URL, etc.) to the wide-field image. The group ID will be described in detail later. In addition, compressed files for each object drawn on the wide-field image are stored in association with the wide-field image in the image information 421. The compressed files will be described in detail later.

[0038] The communication interface 43 is implemented by the computer's communication module. The communication interface 43 communicates various data and information via the network 5, connecting with each terminal device 2, communication device 3, and other computers.

[0039] Figure 2 is a flowchart showing an example of the posting process in an information sharing system. Figure 3 shows an example of a UI screen related to the posting process displayed on a terminal device.

[0040] (Step S01) Terminal device 2 accepts submissions. Specifically, the communication processing unit 212 accepts submissions of wide-field images from users (submitter) on the chat screen. The method of accepting submissions of wide-field images is not limited, but the communication processing unit 212 accepts, for example, the specification of a reference location for the wide-field image in an input field on the chat screen. The reference location may be within terminal device 2 or on a device outside terminal device 2. The communication processing unit 212 can obtain the wide-field image file from the specified reference location. The communication processing unit 212 may generate a reduced image of the submitted wide-field image and display it as a message object 610 on the chat timeline of the chat screen 600, as shown in Figure 3(a).

[0041] (Step S02) Terminal device 2 notifies of the post. Specifically, the communication processing unit 212 transmits the post event (including the wide-field image which is the posted content) received in step S01 to communication device 3.

[0042] (Step S03) Communication device 3 requests confirmation of the posted content. Specifically, when communication control unit 311 receives a post notified from terminal device 2, it stores the wide-field image, which is the posted content, in storage unit 32. Communication control unit 311 also instructs posting linkage unit 312 to confirm the posted content and hands over the processing. Posting linkage unit 312 sends a request for confirmation of the posted content to wide-field image management device 4. The request includes, for example, the image ID (identifier such as file name) and reference destination of the wide-field image stored in storage unit 32. The request is sent, for example, through an API (Application Programming Interface) provided by wide-field image management device 4. The URL of the API is pre-registered in the posting destination information 321 of storage unit 32.

[0043] (Step S04) The wide-field image management device 4 downloads the submitted content. Specifically, the submission reception unit 411, called by the API, retrieves the wide-field image file corresponding to the image ID from the reference included in the received request and stores it in the storage unit 42 as image information 421 along with the image ID. The submission reception unit 411 may assign its own image ID to the wide-field image management device 4.

[0044] (Step S05) The wide-field image management device 4 determines whether it can accept wide-field images. Specifically, the submission acceptance unit 411 determines whether the file of the wide-field image acquired in step S04 is a file compatible with the system. For example, it checks the file format, version, etc., by referring to the metadata contained in the file.

[0045] (Step S06) If the wide-field image management device 4 determines that it cannot accept the wide-field image (NO in step S05), it discards the downloaded content. Specifically, the submission acceptance unit 411 deletes the image information 421 from the storage unit 42. In this case, the submission acceptance unit 411 may also notify the submission coordination unit 312 that it could not accept the wide-field image file.

[0046] (Step S07) If the wide-field image management device 4 determines that it can accept wide-field images (YES in step S05), it requests the generation of a submission destination link. Specifically, the submission reception unit 411 issues access information to the wide-field image stored in the storage unit 42 and associates it with the image information 421 of the wide-field image as management information. The access information can be, for example, a URL that uses the wide-field image management device 4 as the request destination address and includes the image ID of the wide-field image as a parameter. The submission reception unit 411 also sends a request containing the issued access information for the wide-field image to the communication device 3.

[0047] (Step S08) Communication device 3 generates a link to the posted image. Specifically, the posting coordination unit 312 uses the access information for the wide-field image included in the received request to generate link information to the posted wide-field image, outputs it to the communication control unit 311, and hands it over for processing. The link information can be, for example, a URL that uses communication device 3 as the request destination address and includes the access information for the wide-field image as a parameter. The communication control unit 311 sends the generated link information as a chat message to the terminal devices 2 of the poster and other users.

[0048] (Step S09) Each terminal device 2 of the poster and other users displays the destination link. Specifically, when the communication processing unit 212 receives a chat message containing link information, it displays the message object 620 containing the received link information on the chat timeline of the chat screen 600, as shown in Figure 3(b). On the chat screen 600, the poster's own message object is displayed on one side (e.g., the right side), and message objects from other users are displayed on the other side (e.g., the left side). Figure 3 shows the poster's screen (the same applies to Figures 5, 7, and 9).

[0049] Figure 4 is a flowchart showing an example of the browsing process in an information sharing system. Figure 5 shows an example of a UI screen related to the browsing process displayed on a terminal device.

[0050] (Step S51) Terminal device 2 accepts execution of the destination link. Specifically, the communication processing unit 212 accepts an execution operation of the link from the user (viewer) to the message object 620 containing link information to the wide-field image on the chat screen. The communication processing unit 212 also starts the browser processing unit 213, outputs the link information to the browser processing unit 213, and hands over the processing. As shown in Figure 5(a), the browser processing unit 213 may display a view screen 630 for viewing and editing the wide-field image superimposed on the chat screen 600. However, the wide-field image is not displayed on the view screen 630. It may also display that data acquisition is in progress.

[0051] (Step S52) Terminal device 2 accesses the linked destination. Specifically, the browser processing unit 213 sends a request to communication device 3 containing link information (a URL that includes access information to the wide-field image as a parameter, with communication device 3 as the request destination address), i.e., the linked destination URL.

[0052] (Step S53) Communication device 3 performs a redirect. Specifically, when communication control unit 311 receives a request from terminal device 2, it extracts the parameters contained in the destination URL (a URL that uses the wide-field image management device 4 as the request destination address and includes the image ID of the wide-field image as a parameter), and sends these parameters to terminal device 2 as the redirect destination URL.

[0053] (Step S54) Terminal device 2 accesses the redirect destination. Specifically, the browser processing unit 213, upon receiving the redirect destination URL, sends a request containing the redirect destination URL to the wide-field image management device 4.

[0054] (Step S55) The wide-field image management device 4 determines whether or not to join a new group. Specifically, in this embodiment, the image sharing processing unit 412 manages users who are viewing (accessing) a wide-field image as a group of participants (also called an image sharing group) on a wide-field image basis. For example, if there is one or more users accessing a certain wide-field image, it generates a group ID corresponding to the wide-field image (image ID) and associates the group ID with the image information 421 of the wide-field image as management information. On the other hand, if the number of users accessing the wide-field image becomes zero, it deletes the group ID associated with the image information 421 of the wide-field image. In step S55, the image sharing processing unit 412, which received the request sent in step S54, refers to the storage unit 42 and determines whether or not a group ID is already associated with the image information 421 corresponding to the image ID included in the received request.

[0055] (Step S56) If no group ID is associated (YES in step S55), the wide-field image management device 4 decides to join a new group. The image sharing processing unit 412 generates a group ID corresponding to the requested image ID and associates the group ID with the image information 421 of the wide-field image as management information.

[0056] (Step S57) If the group ID is already associated (NO in step S55), the wide-field image management device 4 decides to join an existing group. The image sharing processing unit 412 obtains the group ID associated with the image information 421 corresponding to the requested image ID.

[0057] (Step S58) The wide-field image management device 4 connects to the terminal device 2. Specifically, the image sharing processing unit 412 establishes a connection with the browser processing unit 213 at the redirect destination URL accessed in step S54 (which includes the image ID of the wide-field image as a parameter). This enables the browser processing unit 213 of the terminal device 2 and the wide-field image management device 4 to communicate without going through the communication device 3. The image sharing processing unit 412 also establishes and maintains a constant connection (real-time connection) with the browser processing unit 213, which is used for push delivery (step S86 in Figure 6), described later. Requests for constant connection are sent from the browser processing unit 213 to the wide-field image management device 4 using asynchronous communication such as Ajax.

[0058] (Step S59) The wide-field image management device 4 transmits an image. Specifically, the image sharing processing unit 412 transmits the wide-field image file corresponding to the requested image ID, which is stored in the storage unit 42, to the terminal device 2.

[0059] (Step S60) Terminal device 2 displays the image. Specifically, if the browser processing unit 213 has received the wide-field image file and has not displayed the view screen 630 in step S51, it displays the view screen 630 for viewing and editing the wide-field image superimposed on the chat screen 600, as shown in Figure 5(b). The browser processing unit 213 also displays the wide-field image 640 on the view screen 630.

[0060] Here, the display processing of wide-field images will be explained. A 360-degree image, which is a wide-field image, is, for example, a spherical image captured by a 360-degree camera, which is then unfolded onto a rectangular plane with an aspect ratio of 2:1 (equirectangular image). To enable users to view this image without distortion, the browser processing unit 213 maps the 360-degree image onto the surface of a virtual sphere by back projection using isometric projection. A virtual camera is set at the center of the sphere with a predetermined viewing direction and field of view, and the display image is acquired using perspective projection (perspective projection transformation). Initial values ​​(for example, default values, values ​​from the last time the image was displayed, etc.) may be set in the wide-field image file for the predetermined viewing direction and field of view. The browser processing unit 213 displays the acquired display image as a wide-field image 640 on the view screen 630. The viewing direction and field of view can be changed by user operation, so if they are changed, the virtual camera settings are changed, and the display image is acquired again using perspective projection.

[0061] The program for the above display processing can, for example, be included in the web page information containing the wide-field image file provided by the image sharing processing unit 412 in step S59. The browser processing unit 213 is equipped with the necessary libraries for the above display processing, and can execute the program for display processing. In other words, in this embodiment, image processing can be performed on the client side (browser processing unit 213) instead of the server side (image sharing processing unit 412), thereby reducing the processing load on the server side.

[0062] The same applies to the editing process described in Figure 6 below. The program for the editing process can be described, for example, in the web page information containing the wide-field image file provided by the image sharing processing unit 412 in step S59. The browser processing unit 213 is equipped with the necessary libraries for the editing process, which enables it to execute the program for the editing process.

[0063] Figure 6 is a flowchart illustrating an example of the editing process in an information sharing system. Figure 7 is a diagram showing an example of the UI screen related to the editing process displayed on a terminal device. As a prerequisite, it is assumed that multiple users are each viewing the same wide-field image as viewers using terminal device 2 (they are participating in the same image sharing group) (see the viewing process in Figure 4).

[0064] (Step S81) Terminal device 2 accepts edits. Specifically, in this embodiment, various objects can be drawn on the view screen 630 by editing operations performed by the user (first viewer). Objects include, for example, shapes such as straight lines, curves, circles, and rectangles, as well as text boxes, callouts, etc. Each object is drawn on a virtual layer superimposed on the wide-field image 640. When the drawing is confirmed by the user's editing operation, the browser processing unit 213 acquires the drawn object image (including various data necessary for redrawing, such as identifier, image data, position, and range). The object image may include the viewing direction and field of view at the time of drawing. The wide-field image 640 and the objects are perspective-projected images. As shown in Figure 7, the browser processing unit 213 displays the object image 650 superimposed on the wide-field image 640 on the view screen 630.

[0065] (Step S82) Terminal device 2 performs inverse perspective projection and projection onto a plane. Specifically, the browser processing unit 213 maps the object image acquired in step S81 onto the surface of a virtual sphere using inverse perspective projection (inverse perspective projection transformation), and then acquires a 360-degree image in the form of an equirectangular image by projecting from the sphere onto a plane using equirectangular projection.

[0066] (Step S83) Terminal device 2 performs compression processing. Specifically, the browser processing unit 213 reduces the data size by applying a predetermined compression process to the 360-degree image of the object acquired in step S82. The compression processing may be performed by converting the 360-degree image of the object into a file format that allows transparency processing and lossless compression, such as PNG (Portable Network Graphics). By processing transparency, areas other than the area where the object is drawn can be made transparent pixels. The image size (number of pixels in the width and height) of the image before and after compression may be made to match. The browser processing unit 213 may also include the viewing direction and field of view when the object image was drawn in the compressed file.

[0067] (Step S84) Terminal device 2 uploads the compressed file to wide-field image management device 4. Specifically, browser processing unit 213 sends the compressed file of the 360-degree image of the object generated in step S83 to wide-field image management device 4.

[0068] (Step S85) The wide-field image management device 4 stores compressed files. Specifically, the image sharing processing unit 412, upon receiving a compressed file of a 360-degree image of an object, assigns a compressed file number to identify the compressed file, associates the compressed file and the compressed file number with the image information 421 corresponding to the image ID being viewed, and stores them in the storage unit 42. The compressed file number is assigned to each wide-field image (each group), for example, by counting up in the order in which they were uploaded. This makes it possible to manage the number of compressed files of objects associated with a wide-field image.

[0069] (Step S86) The wide-field image management device 4 pushes the compressed file number. Specifically, the image sharing processing unit 412 pushes the compressed file number stored in the storage unit 42 in step S85 to the respective browser processing units 213 of other viewers who are viewing the same wide-field image as the viewer who edited it in step S81 (they have established a constant connection (real-time connection) for the same image ID (step S58 in Figure 4)) via the constant connection. In other words, the compressed file number of the object drawn by the first viewer is distributed to other viewers (second viewer) who are participating in the same image sharing group.

[0070] (Step S87) and (Step S88) Each terminal device 2 of other viewers downloads the compressed file. Specifically, the browser processing unit 213, which has received the compressed file number of the object's 360-degree image, sends the compressed file number to the image sharing processing unit 412 with respect to the currently viewed image ID, using asynchronous communication such as Ajax, and requests the compressed file corresponding to the compressed file number. The image sharing processing unit 412 sends the compressed file corresponding to the requested compressed file number, which is stored in the storage unit 42 in association with the image information 421 corresponding to the currently viewed image ID, to the requesting browser processing unit 213.

[0071] Furthermore, the browser processing unit 213 may record the compressed file numbers of previously downloaded compressed files, and in step S86, the image sharing processing unit 412 may push the largest compressed file number associated with the currently viewed image ID. Then, in steps S87 and S88, the browser processing unit 213 may identify compressed file numbers that are not recorded (i.e., compressed file numbers that have not been downloaded (are not possessed)) from among the numbers less than or equal to the largest compressed file number received, and send each identified compressed file number to the image sharing processing unit 412 to download the corresponding compressed files. In this way, compressed files that could not be obtained due to, for example, a communication failure can be obtained all at once.

[0072] (Step S89) Each terminal device 2 of other viewers performs the decompression process. Specifically, the browser processing unit 213, which receives a compressed file of a 360-degree image of an object, obtains the 360-degree image of the object by applying a predetermined decompression process to the compressed file. For example, the decompression process may be performed by converting a file that has been converted to a transparent and lossless compression file format such as PNG into image processing data to be projected onto a sphere. The image size (number of pixels in the vertical and horizontal directions) of the image before and after decompression may be made to match. The viewing direction and field of view range when the object image is drawn may also be obtained. Note that the decompression process may be performed as a preprocessing step in the image processing to be projected onto a sphere in step S90.

[0073] (Step S90) Each terminal device 2 of the other viewers performs projection onto a sphere and perspective projection. Specifically, the browser processing unit 213 maps the 360-degree image of the object onto the surface of a virtual sphere by projection onto a sphere using isometric projection, sets a virtual camera at the center of the sphere with a predetermined viewing direction and field of view, and acquires a display image of the object using perspective projection. The predetermined viewing direction and field of view can be set to the viewing direction and field of view of the display image of the currently displayed wide-field image. Alternatively, the viewing direction and field of view when the object image obtained from the compressed file is rendered may be set. In this case, the virtual camera settings are also changed for the wide-field image, and the display image is acquired again using perspective projection.

[0074] (Step S91) Each terminal device 2 of other viewers displays the editing results. Specifically, the browser processing unit 213 draws the display image of the object acquired in step S90 onto a virtual layer superimposed on the wide-field image 640 that is currently being displayed. As shown in Figure 7, the browser processing unit 213 displays the object image 650 superimposed on the wide-field image 640 on the view screen 630. If the display image for the wide-field image is acquired again in step S90, the display of the wide-field image 640 is also updated.

[0075] As is clear from the above explanation of the editing process, in the viewing process (Figure 4), if an object is associated with the wide-field image, the object will be superimposed on the wide-field image and displayed. Specifically, in step S59, the image sharing processing unit 412 sends the wide-field image file corresponding to the requested image ID, stored in the storage unit 42, and all compressed files associated with the wide-field image to the terminal device 2. In step S60, the browser processing unit 213, having received the wide-field image file and all compressed files, obtains a display image of the wide-field image by applying a back projection of the isometric rectangular projection onto a sphere and a perspective projection transformation to the wide-field image file, and obtains a display image of each object by applying a decompression process and a back projection of the isometric rectangular projection onto a sphere and a perspective projection transformation to each compressed file.

[0076] Furthermore, the browser processing unit 213 may record the compressed file numbers of previously downloaded compressed files, and in step S59, the image sharing processing unit 412 may send the largest compressed file number associated with the requested image ID. Then, in step S60, the browser processing unit 213 may identify compressed file numbers that are not recorded among the numbers less than or equal to the largest received compressed file number, and send each identified compressed file number to the image sharing processing unit 412 to download the corresponding compressed files. In this way, compressed files that have not yet been obtained can be acquired all at once.

[0077] In the example in Figure 6, steps S86 to S91 are not executed for the browser processing unit 213 of the viewer who performed the editing. However, in order to simplify the program processing by making it common to all processes, steps S86 to S91 may also be executed for the browser processing unit 213 of the viewer who performed the editing. Also, in the example in Figure 6, compression and decompression are performed on the 360-degree image of the object, but these processes may be omitted. In this case, step S83 is omitted, the file of the 360-degree image of the object is sent in step S84, and the file and file number are stored in step S85. In addition, the file number of the file is sent in step S86, and step S89 is omitted. The browser processing unit 213 may decide whether or not to perform compression and decompression depending on the data size of the 360-degree image of the object and the type of object.

[0078] An embodiment of the present disclosure has been described above. According to this embodiment, effective information sharing using wide-field images can be supported. For example, a bidirectional communication function and a wide-field image sharing function are provided simultaneously. This enables efficient information sharing for users. For example, wide-field images are posted, viewed, and edited through communication tools (terminal devices and communication devices) used by the user. This improves convenience. For example, image processing related to the display of wide-field images and object images is performed on the client side (browser) rather than on the server side. This reduces the processing load on the server side (processing load of CPU, memory, GPU, etc.). For example, object images drawn through editing are compressed on the client side before being shared. This reduces communication load and server-side processing load. For example, the compressed file of the object image includes the gaze direction and field of view range, and is used in the display processing of multiple terminal devices. This ensures that the object image is displayed to other users in the gaze direction and field of view range of the user who drew it.

[0079] Next, we will explain other examples of the submission process. In the example of the submission process described above (Figures 2 and 3), the submitted wide-field images are acquired by the wide-field image management device 4 via the communication device 3. On the other hand, in the other examples of the submission process described below, the submitted wide-field images are acquired by the wide-field image management device 4 without going through the communication device 3.

[0080] Figure 8 is a flowchart showing another example of the posting process in an information sharing system. Figure 9 shows another example of the UI screen related to the posting process displayed on a terminal device.

[0081] (Step S21) Terminal device 2 accepts the start of a post. Specifically, the communication processing unit 212 receives an instruction from the user (poster) to start posting a wide-field image on the chat screen. The communication processing unit 212 accepts the operation of the image posting button 660 on the chat timeline of the chat screen 600, for example, as shown in Figure 9(a). The communication processing unit 212 activates the browser processing unit 213 and outputs predetermined link information (a URL that includes access information to the wide-field image management device 4 (redirect destination address) as a parameter, with communication device 3 as the request destination address) to the browser processing unit 213, and hands over the processing. The browser processing unit 213 may display a view screen 630 for posting a wide-field image superimposed on the chat screen 600, as shown in Figure 9(b). It may also display a message prompting the user to post.

[0082] (Step S22) Terminal device 2 accesses the link destination. Specifically, the browser processing unit 213 sends a request to communication device 3 containing link information (a URL that includes access information to the wide-field image management device 4 (redirect destination address) as a parameter, with communication device 3 as the request destination address), i.e., the link destination URL.

[0083] (Step S23) Communication device 3 performs a redirect. Specifically, when communication control unit 311 receives a request from terminal device 2, it extracts the parameters contained in the link destination URL (a URL that includes the wide-field image management device 4 as the request destination address) and sends these parameters to terminal device 2 as the redirect destination URL.

[0084] (Step S24) Terminal device 2 accesses the redirect destination. Specifically, the browser processing unit 213, upon receiving the redirect destination URL, sends a request containing the redirect destination URL to the wide-field image management device 4. As a result, the submission receiving unit 411 establishes a connection with the browser processing unit 213.

[0085] (Step S25) Terminal device 2 accepts submissions. Specifically, the browser processing unit 213 accepts submissions of wide-field images from users (contributors) on the view screen 630 for submitting wide-field images, for example, as shown in Figure 9(b). The method for accepting submissions of wide-field images is not limited, but the browser processing unit 213 accepts, for example, the specification of the reference destination for the wide-field image on the view screen 630. The reference destination may be within terminal device 2 or on a device outside of terminal device 2. The browser processing unit 213 can obtain the wide-field image file from the specified reference destination.

[0086] (Step S26) Terminal device 2 uploads the posted content. Specifically, the browser processing unit 213 sends the wide-field image file, which is the posted content received in step S25, to the wide-field image management device 4.

[0087] (Step S27) The wide-field image management device 4 stores the submitted content. Specifically, the submission reception unit 411, which is connected to the browser processing unit 213, retrieves the uploaded wide-field image file and stores it in the storage unit 42 as image information 421 along with the image ID. The image ID may be transmitted from the browser processing unit 213 along with the wide-field image file, or the submission reception unit 411 may assign its own unique image ID to the wide-field image management device 4.

[0088] (Step S28) The wide-field image management device 4 determines whether it can accept wide-field images. Specifically, the submission acceptance unit 411 determines whether the wide-field image file acquired in step S27 is a file compatible with the system. For example, it checks the file format, version, etc., by referring to the metadata contained in the file.

[0089] (Step S29) If the wide-field image management device 4 determines that it cannot accept the wide-field image (NO in step S28), it discards the submitted content. Specifically, the submission acceptance unit 411 deletes the image information 421 from the storage unit 42. In this case, the submission acceptance unit 411 may also notify the browser processing unit 213 that it could not accept the wide-field image file.

[0090] (Step S30) If it is determined that a wide-field image can be accepted (YES in step S28), the wide-field image management device 4 generates a reduced image. Specifically, the submission acceptance unit 411 generates a reduced image of the submitted wide-field image.

[0091] (Step S31) The wide-field image management device 4 requests the posting of a reduced image and the generation of a link to the posting destination. Specifically, the posting reception unit 411 sends the request for posting the image along with the generated reduced image to the communication device 3. The posting reception unit 411 also issues access information to the wide-field image stored in the storage unit 42 and associates it with the image information 421 of the wide-field image as management information. The access information can be, for example, a URL that uses the wide-field image management device 4 as the request destination address and includes the image ID of the wide-field image as a parameter. The posting reception unit 411 also sends the request containing the issued access information for the wide-field image to the communication device 3.

[0092] (Step S32) Communication device 3 posts a reduced image and generates a link to the post. Specifically, the posting coordination unit 312 outputs the received reduced image to the communication control unit 311 and hands it over for processing. The communication control unit 311 sends the reduced image as a chat message to the terminal devices 2 of the poster and other users. The posting coordination unit 312 also generates link information to the posted wide-field image using the access information of the wide-field image included in the received request, outputs it to the communication control unit 311, and hands it over for processing. The link information can be, for example, a URL that uses communication device 3 as the request destination address and includes the access information of the wide-field image as a parameter. The communication control unit 311 sends the generated link information as a chat message to the terminal devices 2 of the poster and other users.

[0093] (Step S33) Each terminal device 2 of the poster and other users displays a thumbnail image and a link to the destination. Specifically, when the communication processing unit 212 receives a chat message containing a thumbnail image, it displays the message object 610 containing the received thumbnail image on the chat timeline of the chat screen 600, as shown in Figure 9(c). Also, when the communication processing unit 212 receives a chat message containing link information, it displays the message object 620 containing the received link information on the chat timeline of the chat screen 600, as shown in Figure 9(c).

[0094] The above describes other examples of the posting process. With this posting process, it is not necessary to store wide-field images in the communication device, thus reducing the data usage of the communication device's memory resources. In addition, when wide-field images are posted via the communication device, the risk of loss of metadata and other information in the wide-field image file due to processing on the server constituting the communication device (e.g., image decoding and encoding) can be avoided.

[0095] Next, we will describe other variations that handle video. In the embodiments described above, the wide-field image is a still image. On the other hand, in the other variations described below, the wide-field image is a video. The video of the wide-field image consists of multiple frames, with each 360-degree image being one frame. The video of the wide-field image is generated, for example, by the video recording function of a 360-degree camera and provided in a video file format such as MP4. The following will focus on the differences from the embodiments described above.

[0096] Image information 421 stores, for example, an image ID, image file, access information, and group ID associated with each wide-field image (video in this modified example; the same applies hereafter for this modified example), as shown in Figure 12. Image information 421 also stores segmented images, obtained by dividing multiple frames constituting the wide-field image at predetermined intervals, associated with the wide-field image. Furthermore, image information 421 stores compressed files for each object drawn on the segmented images, associated with the segmented images.

[0097] Regarding the submission process in Figure 2, in step S04, the submission receiving unit 411 refers to the acquired wide-field image file and acquires images (divided images) at predetermined intervals from multiple frames constituting the wide-field image. The predetermined interval is not limited to matching the frame rate (i.e., all frames), but may be longer than the frame rate. The submission receiving unit 411 also stores each acquired divided image file in the storage unit 42, along with the divided image ID, in association with the image information 421 of the wide-field image.

[0098] Regarding the viewing process in Figure 4, in step S59, the image sharing processing unit 412 selects one of the segmented images associated with the wide-field image corresponding to the requested image ID, which is stored in the storage unit 42, and sends the file of the selected segmented image to the terminal device 2. The method of selecting the segmented image is not limited, but for example, the first frame in chronological order in a video can be selected. The image sharing processing unit 412 also generates reduced images of each segmented image (i.e., each frame) associated with the wide-field image and sends these reduced images to the terminal device 2.

[0099] In step S60, the browser processing unit 213, having received the split image files and thumbnail images, displays the split image 640 on the view screen 630, for example, as shown in Figure 13. It also displays a list 670 of thumbnail images on the view screen 630. In the list 670, it is desirable that the thumbnail images be arranged chronologically in the video. Here, in the list 670 of thumbnail images, the viewer can select any of the thumbnail images. If a thumbnail image corresponding to a split image different from the currently displayed split image is selected, the browser processing unit 213 sends the image ID of the split image corresponding to the selected thumbnail image to the image sharing processing unit 412 as a request. The image sharing processing unit 412 sends the file of the split image corresponding to the requested image ID of the split image, which is stored in the storage unit 42, to the terminal device 2. Upon receiving the selected split image file, the browser processing unit 213 updates and displays the split image 640 on the view screen 630.

[0100] Regarding the editing process in Figure 6, in step S85, the image sharing processing unit 412, which receives a compressed file of a 360-degree image of an object, assigns a compressed file number to identify the compressed file, associates the compressed file and the compressed file number with the image ID of the segmented image being viewed, and stores them in the storage unit 42. The compressed file number is assigned to each segmented image, for example, by counting up in the order in which they were uploaded. This makes it possible to manage the number of compressed files of objects associated with each segmented image.

[0101] In step S86, the image sharing processing unit 412 pushes the compressed file number stored in the storage unit 42 in step S85 to the respective browser processing units 213 of other viewers who are viewing the same segmented image as the viewer who edited it in step S81. That is, it distributes the compressed file number of the object drawn by the first viewer to other viewers (second viewers) who are participating in the same image sharing group and viewing the same segmented image.

[0102] Regarding the submission process in Figure 8, in step S27, the submission receiving unit 411 refers to the acquired wide-field image file and acquires images (divided images) at predetermined intervals from multiple frames constituting the wide-field image. The predetermined interval is not limited to matching the frame rate, but may be longer than the frame rate. The submission receiving unit 411 also stores each acquired divided image file in the storage unit 42, associating it with the image information 421 of the wide-field image, along with the divided image ID.

[0103] The above describes other variations for handling videos. Even if the submitted wide-field image is a video, it can be managed as a series of split images (i.e., still images of the wide-field image) separated from the video, and by making the selected split images viewable and editable, effective information sharing can be supported.

[0104] Figure 10 is a diagram illustrating the relationship between communication groups and image sharing groups.

[0105] In this embodiment, as described above (steps S55-S58 in Figure 4), the image sharing processing unit 412 manages users who are viewing (accessing) a wide-field image as a group of participants (also called an image sharing group) on a wide-field image basis. This allows image sharing groups to be managed independently of communication groups. For example, as shown in Figure 10, two users belonging to communication group A1 can join image sharing group B1, and two other users belonging to communication group A1 can join image sharing group B2. However, to avoid communication disruption, the image sharing processing unit 412 may perform mutual exclusion control to prevent the creation of multiple image sharing groups (to prevent access to multiple wide-field images) at the same time.

[0106] In the above embodiment, wide-field images are shared from the wide-field image management device 4 to users belonging to communication groups managed by the communication device 3. However, the wide-field image management device 4 can also share wide-field images to users belonging to communication groups outside the management of the communication device 3 (i.e., groups managed by other communication tools), or to individual users who do not belong to any communication group outside the management of the communication device 3. Specifically, an access URL (a URL that uses the wide-field image management device 4 as the request address and includes the image ID of the wide-field image as a parameter) is provided to users outside the management of the communication device 3. Users who are provided with the access URL can view and edit the wide-field image by accessing the access URL using the browser of their terminal device (similar to steps S54-S60 in Figure 4 and steps S81-S91 in Figure 6).

[0107] In the above-described embodiment, a browser view screen is opened separately from the chat screen, allowing the user to view and edit wide-field images in parallel with the chat. Similarly, if voice calls or video calls are used as communication functions, the chat screen may also serve as the voice call screen or video call screen. The user can view and edit wide-field images in parallel with the voice call or video call. In other words, this disclosure is applicable not only to chat functions but also to communication functions (communication functions such as chat, messaging, voice calls, and video calls).

[0108] The redirection method is not limited to the method described in the above-described embodiment. Other redirection methods may be used as long as the communication processing unit 212 or browser processing unit 213 of the terminal device 2 can be appropriately redirected to and access the submission reception unit 411 or image sharing processing unit 412 of the wide-field image management device 4.

[0109] This disclosure is not limited to the embodiments and variations described above, and many further modifications are possible. For example, the embodiments and variations described above are described in detail for the purpose of explaining this disclosure clearly, and are not necessarily limited to having all the configurations described. Furthermore, it is possible to replace parts of one variation with other variations or to combine variations.

[0110] Furthermore, each of the above configurations, functions, processing units, and processing means may be implemented in hardware, either partially or entirely, by designing them as integrated circuits, for example. Alternatively, each of the above configurations and functions may be implemented in software by a processor interpreting and executing programs that implement each function. Information such as programs, tables, and files that implement each function can be stored in memory, recording devices such as hard disks and SSDs, or recording media such as IC cards, SD cards, and DVDs. Also, control lines and information lines are shown only if deemed necessary for explanation, and not all control lines and information lines are necessarily shown in the actual product. In practice, it can be assumed that almost all configurations are interconnected.

[0111] Each aspect of this disclosure can also be specified as follows: [E1] An information sharing system comprising a communication device and a wide-field image management device that are connected to communicate via a network, The communication device and the wide-field image management device are connected via the network to communicate with each of the communication applications installed on the terminal devices of multiple users belonging to the same communication group. The communication device controls communication, including at least chat, between the communication applications of the multiple users. The wide-field image management device connects to a browser launched by the communication application on each terminal device and provides the wide-field images stored in the storage unit to the browser for viewing. Information sharing system. [E2] The information sharing system described in E1, The communication device receives the submission of the wide-field image from the communication application of the poster among the multiple users, and transmits the submission to the wide-field image management device. The wide-field image management device acquires the posted wide-field images from the communication device and stores them in the storage unit, issues access information to the posted wide-field images and transmits it to the communication device. The communication device generates a link to the posted wide-field image using the transmitted access information and displays the link in the communication application of the poster and other users among the multiple users. Information sharing system. [E3] The information sharing system described in E1, The communication device receives an access request to the wide-field image management device from the browser of the poster among the multiple users, and redirects the browser to the wide-field image management device. The wide-field image management device receives the submission of the wide-field image from the submitter's browser, retrieves the submitted wide-field image from the browser and stores it in the storage unit, issues access information to the submitted wide-field image and transmits it to the communication device. The communication device generates a link to the posted wide-field image using the transmitted access information and displays the link in the communication application of the poster and other users among the multiple users. Information sharing system. [E4] An information sharing system as described in E2 or E3, The communication device receives a request from the browser of a viewer among the multiple users to access the link to the wide-field image, and redirects the browser to the wide-field image management device. The wide-field image management device establishes a first connection with the redirected viewer's browser, and via this first connection, transmits the wide-field image stored in the storage unit corresponding to the link to the viewer's browser for display. Information sharing system. [E5] The information sharing system described in E4, In addition to the first connection with the redirected viewer's browser, the wide-field image management device establishes a second connection, which is a permanent connection with the viewer's browser, and the second connection is used for push notifications to the viewer's browser. Information sharing system. [E6] The information sharing system described in E5, The wide-field image management device is The first viewer among the multiple users receives an object image from the browser of the first viewer, which is drawn on a virtual layer on the wide-field image by the operation of the first viewer, and which has undergone inverse perspective projection transformation and projection from a sphere to a plane using isometric projection, and stores it in association with the wide-field image stored in the storage unit. The identifier of the object image stored in the storage unit is pushed to the browser of the second viewer among the multiple users via the second connection, and the object image stored in the storage unit is transmitted to the browser of the second viewer via the first connection. Information sharing system. [E7] The information sharing system described in E5, The wide-field image management device is The first viewer among the multiple users receives an object image from their browser, which has been drawn on a virtual layer on the wide-field image by the operation of the first viewer, which has been subjected to inverse perspective projection transformation and projection from a sphere to a plane using isometric projection, and has also been subjected to compression processing, and stores it in association with the wide-field image stored in the memory unit. The identifier of the object image stored in the storage unit is pushed to the browser of the second viewer among the multiple users via the second connection, and the object image stored in the storage unit is transmitted to the browser of the second viewer via the first connection. Information sharing system. [E8] An information sharing system as described in E2 or E3, If the aforementioned wide-field image is a video, The wide-field image management device stores in the storage unit a plurality of segmented images, each segmented from the wide-field image, in association with the posted wide-field image. The communication device receives a request from the browser of a viewer among the multiple users to access the link to the wide-field image, and redirects the browser to the wide-field image management device. The wide-field image management device establishes a first connection with the redirected viewer's browser, and via this first connection, transmits to the viewer's browser any one of the segmented images associated with the wide-field image stored in the storage unit corresponding to the link, for display. Information sharing system. [E9] The information sharing system described in E1, The aforementioned communication group is managed by the aforementioned communication device, The wide-field image management device is connected to the browser of another user outside the management of the communication device via the network, enabling communication between them. The wide-field image management device connects to the browser of the other user and provides the wide-field images stored in the storage unit to the browser for viewing. Information sharing system. [E10] An information sharing method using an information sharing system that includes a communication device and a wide-field image management device connected to communicate via a network, The communication device and the wide-field image management device are connected via the network to communicate with each of the communication applications installed on the terminal devices of multiple users belonging to the same communication group. The communication device controls communication, including at least chat, between the communication applications of the multiple users. The wide-field image management device connects to a browser launched by the communication application on each terminal device and provides the wide-field images stored in the storage unit to the browser for viewing. How to share information. [E11] A wide-field image management device that is connected to a communication device via a network, The communication device and the wide-field image management device are connected via the network to communicate with each of the communication applications installed on the terminal devices of multiple users belonging to the same communication group. The communication device controls communication, including at least chat, between the communication applications of the multiple users. The wide-field image management device connects to a browser launched by the communication application on each terminal device and provides the wide-field images stored in the storage unit to the browser for viewing. Wide-field image management system. [E12] A program that enables a computer connected to a communication device via a network to function as a wide-field image management device, The communication device and the computer are connected via the network to communicate with each of the communication applications installed on the terminal devices of multiple users belonging to the same communication group. The communication device controls communication, including at least chat, between the communication applications of the multiple users. The aforementioned program, Each of the aforementioned terminal devices connects to a browser launched by the communication application, and causes the computer to perform the process of providing the wide-field images stored in the memory unit to the browser in a viewable format. program. [E13] A program that enables a computer connected to a communication device and a wide-field image management device via a network to function as a terminal device, A communication processing unit that provides communication, including at least chat, with other terminal devices via the aforementioned communication device, The computer functions as a browser processing unit, which connects to the wide-field image management device via a browser operating within the program, acquires wide-field images from the wide-field image management device, and displays them in the browser. program. [Explanation of Symbols]

[0112] 1 Information sharing system, 2 Terminal device, 3 Communication device, 4 Wide-field image management device, 5 Network, 21 Processing unit, 22 Storage unit, 23 Communication IF, 24 Input IF, 25 Output IF, 31 Processing unit, 32 Storage unit, 33 Communication IF, 41 Processing unit, 42 Storage unit, 43 Communication IF, 211 Application, 212 Communication processing unit, 213 Browser processing unit, 311 Communication control unit, 312 Posting linkage unit, 321 Posting destination information, 411 Posting reception unit, 412 Image sharing processing unit, 421 Image information, 600 Chat screen, 610 Message object, 620 Message object, 630 View screen, 640 Wide-field image or segmented image, 650 Object image, 660 Image posting button, 670 List of thumbnail images

Claims

1. An information sharing system comprising a communication device and a wide-field image management device that are connected communicably via a network, The communication device and the wide-field image management device are connected via the network to communicate with each of the communication applications installed on the terminal devices of multiple users belonging to the same communication group. The communication device controls communication, including at least chat, between the communication applications of the multiple users. The wide-field image management device connects to a browser launched by the communication application on each terminal device and provides the wide-field images stored in the storage unit to the browser for viewing. In the process of posting the wide-field image, The communication device receives the submission of the wide-field image from the communication application of the poster among the multiple users, and transmits the submission to the wide-field image management device. The wide-field image management device acquires the posted wide-field images from the communication device and stores them in the storage unit, issues access information to the posted wide-field images and transmits it to the communication device. The communication device generates a link to the posted wide-field image using the transmitted access information and displays the link in the communication application of the poster and other users among the multiple users. Information sharing system.

2. An information sharing system comprising a communication device and a wide-field image management device that are connected communicatively via a network, The communication device and the wide-field image management device are connected via the network to communicate with each of the communication applications installed on the terminal devices of multiple users belonging to the same communication group. The communication device controls communication, including at least chat, between the communication applications of the multiple users. The wide-field image management device connects to a browser launched by the communication application on each terminal device and provides the wide-field images stored in the storage unit to the browser for viewing. In the process of posting the wide-field image, The communication device receives an access request to the wide-field image management device from the browser of the poster among the multiple users, and redirects the browser to the wide-field image management device. The wide-field image management device receives the submission of the wide-field image from the submitter's browser, retrieves the submitted wide-field image from the browser and stores it in the storage unit, issues access information to the submitted wide-field image and transmits it to the communication device. The communication device generates a link to the posted wide-field image using the transmitted access information and displays the link in the communication application of the poster and other users among the multiple users. Information sharing system.

3. An information sharing system comprising a communication device and a wide-field image management device that are connected communicatively via a network, The communication device and the wide-field image management device are connected via the network to communicate with each of the communication applications installed on the terminal devices of multiple users belonging to the same communication group. The communication device controls communication, including at least chat, between the communication applications of the multiple users. The wide-field image management device connects to a browser launched by the communication application on each terminal device and provides the wide-field images stored in the storage unit to the browser for viewing. The aforementioned communication group is managed by the aforementioned communication device, The wide-field image management device is connected to the browser of another user outside the management of the communication device via the network, enabling communication between them. The wide-field image management device connects to the browser of the other user and provides the wide-field images stored in the storage unit to the browser for viewing. Information sharing system.

4. An information sharing system according to claim 1 or 2, The communication device receives a request from the browser of a viewer among the multiple users to access the link to the wide-field image, and redirects the browser to the wide-field image management device. The wide-field image management device establishes a first connection with the redirected viewer's browser, and via this first connection, transmits the wide-field image stored in the storage unit corresponding to the link to the viewer's browser for display. Information sharing system.

5. The information sharing system according to claim 4, In addition to the first connection with the redirected viewer's browser, the wide-field image management device establishes a second, always-on connection with the viewer's browser, and the second connection is used for push notifications to the viewer's browser. Information sharing system.

6. The information sharing system according to claim 5, The wide-field image management device is The first viewer among the multiple users receives an object image from the browser of the first viewer, which is drawn on a virtual layer on the wide-field image by the operation of the first viewer, and which has undergone inverse perspective projection transformation and projection from a sphere to a plane using isometric projection, and stores it in association with the wide-field image stored in the storage unit. The identifier of the object image stored in the storage unit is pushed to the browser of the second viewer among the multiple users via the second connection, and the object image stored in the storage unit is transmitted to the browser of the second viewer via the first connection. Information sharing system.

7. The information sharing system according to claim 5, The wide-field image management device is The first viewer among the multiple users receives an object image from their browser, which has been drawn on a virtual layer on the wide-field image by the operation of the first viewer, which has been subjected to inverse perspective projection transformation and projection from a sphere to a plane using isometric projection, and has also been subjected to compression processing, and stores it in association with the wide-field image stored in the storage unit. The identifier of the object image stored in the storage unit is pushed to the browser of the second viewer among the multiple users via the second connection, and the object image stored in the storage unit is transmitted to the browser of the second viewer via the first connection. Information sharing system.

8. An information sharing system according to claim 1 or 2, If the aforementioned wide-field image is a video, The wide-field image management device stores in the storage unit a plurality of segmented images, each segmented from the wide-field image, in association with the posted wide-field image. The communication device receives a request from the browser of a viewer among the multiple users to access the link to the wide-field image, and redirects the browser to the wide-field image management device. The wide-field image management device establishes a first connection with the redirected viewer's browser, and via this first connection, transmits to the viewer's browser one of the segmented images associated with the wide-field image stored in the storage unit corresponding to the link, for display. Information sharing system.

9. An information sharing method using an information sharing system that includes a communication device and a wide-field image management device connected to communicate via a network, The communication device and the wide-field image management device are connected via the network to communicate with each of the communication applications installed on the terminal devices of multiple users belonging to the same communication group. The communication device controls communication, including at least chat, between the communication applications of the multiple users. The wide-field image management device connects to a browser launched by the communication application on each terminal device and provides the wide-field images stored in the storage unit to the browser for viewing. In the process of posting the wide-field image, The communication device receives the submission of the wide-field image from the communication application of the poster among the multiple users, and transmits the submission to the wide-field image management device. The wide-field image management device acquires the posted wide-field images from the communication device and stores them in the storage unit, issues access information to the posted wide-field images and transmits it to the communication device. The communication device generates a link to the posted wide-field image using the transmitted access information and displays the link in the communication application of the poster and other users among the multiple users. How to share information.

10. An information sharing method using an information sharing system that includes a communication device and a wide-field image management device connected to communicate via a network, The communication device and the wide-field image management device are connected via the network to communicate with each of the communication applications installed on the terminal devices of multiple users belonging to the same communication group. The communication device controls communication, including at least chat, between the communication applications of the multiple users. The wide-field image management device connects to a browser launched by the communication application on each terminal device and provides the wide-field images stored in the storage unit to the browser for viewing. In the process of posting the wide-field image, The communication device receives an access request to the wide-field image management device from the browser of the poster among the multiple users, and redirects the browser to the wide-field image management device. The wide-field image management device receives the submission of the wide-field image from the submitter's browser, retrieves the submitted wide-field image from the browser and stores it in the storage unit, issues access information to the submitted wide-field image and transmits it to the communication device. The communication device generates a link to the posted wide-field image using the transmitted access information and displays the link in the communication application of the poster and other users among the multiple users. How to share information.

11. An information sharing method using an information sharing system that includes a communication device and a wide-field image management device connected to communicate via a network, The communication device and the wide-field image management device are connected via the network to communicate with each of the communication applications installed on the terminal devices of multiple users belonging to the same communication group. The communication device controls communication, including at least chat, between the communication applications of the multiple users. The wide-field image management device connects to a browser launched by the communication application on each terminal device and provides the wide-field images stored in the storage unit to the browser for viewing. The aforementioned communication group is managed by the aforementioned communication device, The wide-field image management device is connected to the browser of another user outside the management of the communication device via the network, enabling communication between them. The wide-field image management device connects to the browser of the other user and provides the wide-field images stored in the storage unit to the browser for viewing. How to share information.

Images