Screen sharing system, screen sharing method, screen sharing program, and operation terminal

Abstract

To provide a screen sharing system, a screen sharing method and a screen sharing program capable of improving user's convenience to a display object to be shared and displayed by a plurality of user terminals, and to provide an operation terminal.SOLUTION: A detection processing part 112 detects a selection position selected by a user B to a shared screen of a user terminal 1B if a display screen including one or more windows for displaying a display object in a user terminal 1A of a user A is shared with the user terminal 1B of the user B. A specification processing part 114 specifies a window, out of the one or more windows, corresponding to the selection position to be detected by the detection processing part 112. An output processing part 115 outputs information of a storage place of the display object displayed in the window specified by the specification processing part 114, to the user terminal 1B.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present disclosure relates to a technique for sharing a screen among multiple user terminals. [Background technology]

[0002] It has become common for multiple users to use their own user terminals to have online conversations (online meetings, web meetings, etc.). A conversation application, which is general-purpose software for carrying out the online meetings, is provided with a function for sharing a screen between multiple user terminals. Conventionally, a technique for sharing a screen between multiple user terminals has been proposed (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2015-52896 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, conventional technologies are inconvenient because they do not allow users to turn pages or edit the screen (documents) displayed on the user's terminal with which the screen is shared during an online meeting, for example.

[0005] An object of the present disclosure is to provide a screen sharing system, a screen sharing method, a screen sharing program, and an operation terminal that can improve user convenience regarding a display object that is shared and displayed on multiple user terminals. [Means for solving the problem]

[0006] A screen sharing system according to one aspect of the present disclosure includes a detection processor, a specification processor, and an output processor. When a display screen including one or more windows displaying a display target on a first user terminal of a first user is shared with a second user terminal of a second user, the detection processor detects a selection position selected by the second user on the shared screen of the second user terminal. The specification processor specifies a window corresponding to the selection position detected by the detection processor among the one or more windows. The output processor outputs information on a storage location of the display target displayed in the window specified by the specification processor to the second user terminal.

[0007] A screen sharing method according to another aspect of the present disclosure is a method in which, when a display screen including one or more windows displaying a display object on a first user terminal of a first user is shared with a second user terminal of a second user, one or more processors execute the following steps to detect a selection position selected by the second user on the shared screen of the second user terminal, identify a window among the one or more windows that corresponds to the selection position, and output information on the storage location of the display object displayed in the window to the second user terminal.

[0008] A screen sharing program according to another aspect of the present disclosure is a program for causing one or more processors to execute the following steps when a display screen including one or more windows displaying a display object on a first user terminal of a first user is shared with a second user terminal of a second user: detect a selection position selected by the second user on the shared screen of the second user terminal; identify a window among the one or more windows that corresponds to the selection position; and output information on the storage location of the display object displayed in the window to the second user terminal.

[0009] An operation terminal according to another aspect of the present disclosure includes a detection processing unit, a specification processing unit, and an output processing unit. The detection processing unit detects a selection position selected by the target user on a shared screen of the user terminal. The specification processing unit specifies a window corresponding to the selection position detected by the detection processing unit among the one or more windows. The output processing unit outputs information on a storage location of the display object displayed in the window specified by the specification processing unit to the user terminal. Effect of the Invention

[0010] According to the present disclosure, it is possible to provide a screen sharing system, a screen sharing method, a screen sharing program, and an operation terminal that can improve user convenience regarding a display object that is shared and displayed on multiple user terminals. [Brief description of the drawings]

[0011] [Figure 1] FIG. 1 is a schematic diagram showing a schematic configuration of a conversation system according to an embodiment of the present disclosure. [Diagram 2] FIG. 2 is a functional block diagram showing a configuration of a chat system according to an embodiment of the present disclosure. [Diagram 3] FIG. 3 is a diagram illustrating an example of a display screen displayed on a user terminal according to an embodiment of the present disclosure. [Figure 4] FIG. 4 is a diagram illustrating an example of a display screen displayed on a user terminal according to an embodiment of the present disclosure. [Diagram 5] FIG. 5 is a diagram illustrating an example of a display screen displayed on a user terminal according to an embodiment of the present disclosure. [Figure 6] FIG. 6 is a diagram showing an example of a storage location information table registered in the chat system according to an embodiment of the present disclosure. [Figure 7] FIG. 7 is a diagram showing an example of a display target information table registered in the chat system according to an embodiment of the present disclosure. [Figure 8] FIG. 8 is a diagram showing an example of a shared screen information table registered in the chat system according to an embodiment of the present disclosure. [Figure 9] FIG. 9 is a diagram illustrating an example of a display screen displayed on a user terminal according to an embodiment of the present disclosure. [Figure 10] FIG. 10 is a flowchart illustrating an example of a procedure of a registration process executed in the chat system according to an embodiment of the present disclosure. [Figure 11] FIG. 11 is a flowchart for explaining an example of a procedure of a screen sharing process executed in the chat system according to an embodiment of the present disclosure. [Figure 12] FIG. 12 is a diagram illustrating an example of a display screen displayed on a user terminal according to another embodiment of the present disclosure. [Figure 13] FIG. 13 is a diagram illustrating an example of a display screen displayed on a user terminal according to another embodiment of the present disclosure. [Figure 14] FIG. 14 is a diagram showing an example of a display screen displayed on a user terminal according to another embodiment of the present disclosure. [Figure 15] FIG. 15 is a diagram showing an example of a display screen displayed on a user terminal according to another embodiment of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. Note that the following embodiments are examples of the present disclosure and do not limit the technical scope of the present disclosure.

[0013] The screen sharing system according to the present disclosure is applied to a conversation system that allows online conversation (online meeting, Web meeting, etc.) using multiple user terminals. The format of the online meeting is not limited, and may be, for example, a television conversation system in which conversation is conducted while transmitting and receiving facial images of each user using images captured by a camera connected to the user terminal, or a virtual conversation system in which conversation is conducted while displaying and moving user icons in a virtual space.

[0014] The chat system can also be applied to, for example, web meetings (online meetings) in which multiple users chat using user terminals such as laptops and smartphones while being in different locations (such as an office conference room or at home.) The chat system also includes a server that provides an online meeting service using a chat application, which is general-purpose software for executing the online meeting.

[0015] [Conversation System 10] 1 is a schematic diagram showing a schematic configuration of a conversation system 10 according to an embodiment of the present disclosure. The conversation system 10 includes a user terminal 1 and a server 2. The conversation system 10 is a system that supports online meetings in which a plurality of users participate.

[0016] FIG. 1 shows a location Ra of user A and a location Rb of user B. At each location, one user terminal 1 owned by each user is located. FIG. 1 shows an example in which user A and user B hold an online meeting at different locations (such as a conference room or a home). FIG. 1 also shows, as user terminals 1, a user terminal 1A used by user A and a user terminal 1B used by user B. There may be three or more users participating in the online meeting, and there may be three or more user terminals 1.

[0017] The chat system 10 enables multiple users to hold online meetings at remote locations by executing a chat application installed on each user terminal 1. The chat application is general-purpose software, and multiple users participating in the same meeting select a common chat application.

[0018] For example, user A and user B start the conversation application on their own user terminal 1A and user terminal 1B, respectively.

[0019] The conversation system 10 may be configured such that each location is connected to a microphone speaker device, a camera, and the like that can be connected to the user terminal 1, and that two-way communication of audio and camera images is possible. The microphone speaker device and the camera may be built into the user terminal 1.

[0020] The server 2 is constructed, for example, from one or more server devices (for example, cloud servers).

[0021] The user terminal 1 and the server 2 are connected to each other via a network N1. The network N1 is a communication network such as the Internet, a LAN, a WAN, or a public telephone line.

[0022] [Server 2] 2, the server 2 includes a control unit 21, a storage unit 22, an operation display unit 23, and a communication unit 24. The server 2 may be one or more virtual servers (cloud servers), or may be one or more physical servers.

[0023] The communication unit 24 is a communication unit that connects the server 2 to the network N1 by wire or wirelessly, and executes data communication with other devices (such as the user terminal 1) via the network N1 in accordance with a predetermined communication protocol.

[0024] The operation display unit 23 is a user interface that includes a display unit, such as a liquid crystal display or an organic EL display, that displays various information, and an operation unit, such as a mouse, a keyboard, or a touch panel, that accepts operations.

[0025] The storage unit 22 is a non-volatile storage unit such as a hard disk drive (HDD), a solid state drive (SSD), or a flash memory that stores various types of information. A control program for causing the control unit 21 to execute various processes is stored in the storage unit 22. For example, the control program is non-temporarily recorded on a computer-readable recording medium such as a CD or a DVD, and is read by a reading device (not shown) such as a CD drive or a DVD drive provided in the server 2 and stored in the storage unit 22. The control program may be distributed from a cloud server and stored in the storage unit 22.

[0026] For example, an online meeting program for executing an online meeting service is stored in the storage unit 22. The online meeting program executes the online meeting in response to execution of a conversation application installed in the user terminal 1. The server 2 of this embodiment provides an online meeting service of a conversation application, which is a type of general-purpose software.

[0027] The storage unit 22 also stores user information (user IDs, passwords, etc.) relating to users who can use the conversation application.

[0028] The control unit 21 has control devices such as a CPU, a ROM, and a RAM. The CPU is a processor that executes various arithmetic operations. The ROM stores in advance control programs such as a BIOS and an OS for causing the CPU to execute various processes. The RAM stores various information, and is used as a temporary storage memory (work area) for the various processes executed by the CPU. The control unit 21 controls the server 2 by executing, by the CPU, various control programs that are stored in advance in the ROM or the memory unit 22.

[0029] The control unit 21 includes various processing units. The control unit 21 functions as the various processing units by executing various processes according to the control program. Some or all of the processing units included in the control unit 21 may be configured with electronic circuits. The control program may be a program for causing a plurality of processors to function as the various processing units.

[0030] Specifically, the control unit 21 executes a conversation application in each of the multiple user terminals 1 to conduct an online meeting. The control unit 21 starts the online meeting based on login information acquired from the user terminal 1. For example, when user A starts a conversation application in user terminal 1A and performs a login operation, the user terminal 1A transmits login information including a user ID and a password to the server 2. The control unit 21 acquires the login information from user terminal 1A and authenticates user A, and then starts the online meeting.

[0031] Also, for example, when user A ends the conversation application in user terminal 1A (ends the online meeting), user terminal 1A transmits an end request to server 2. When control unit 21 receives the end request from user terminal 1A, it ends (logs off) the online meeting.

[0032] User A and user B who wish to participate in the online meeting perform an operation to log in to the conversation application on their own user terminals 1A and 1B. Once a user has logged in and been authenticated to the conversation application, the user is able to talk with other users.

[0033] [User device 1] 2, the user terminal 1 includes a control unit 11, a storage unit 12, an operation display unit 13, and a communication unit 14. The user terminal 1 is an operation terminal (information processing device) such as a notebook computer, a smartphone, or a tablet terminal. Each user terminal 1 may have the same configuration.

[0034] The communication unit 14 is a communication unit for connecting the user terminal 1 to the network N1 by wire or wirelessly, and for executing data communication with other devices (eg, the server 2) via the network N1 in accordance with a predetermined communication protocol.

[0035] The operation display unit 13 is a user interface that includes a display unit such as a liquid crystal display or an organic EL display that displays various information, and an operation unit such as a mouse, a keyboard, or a touch panel that accepts operations. The operation display unit 13 accepts operations from the user.

[0036] The storage unit 12 is a non-volatile storage unit such as an HDD, SSD, or flash memory that stores various types of information. The storage unit 12 stores control programs such as a screen sharing program for causing the control unit 11 to execute a screen sharing process (see Figs. 10 and 11) described below. For example, the screen sharing program is non-temporarily recorded on a computer-readable recording medium such as a CD or DVD, and is read by a reading device (not shown) such as a CD drive or DVD drive provided in the user terminal 1 and stored in the storage unit 12. The screen sharing program may be distributed from a cloud server (e.g., server 2) and stored in the storage unit 12.

[0037] The storage unit 12 also has installed therein one or more conversation applications for providing an online meeting service.

[0038] The control unit 11 has control devices such as a CPU, a ROM, and a RAM. The CPU is a processor that executes various arithmetic operations. The ROM stores in advance control programs such as a BIOS and an OS for causing the CPU to execute various processes. The RAM stores various information and is used as a temporary storage memory (work area) for the various processes executed by the CPU. The control unit 11 controls the user terminal 1 by causing the CPU to execute various control programs that are pre-stored in the ROM or the memory unit 12. The control unit 11 also functions as a processing unit that executes the conversation application.

[0039] Specifically, the control unit 11 includes various processing units such as a registration processing unit 111, a detection processing unit 112, a reception processing unit 113, a specification processing unit 114, an output processing unit 115, and an execution processing unit 116. The control unit 11 functions as the various processing units by executing various processes according to the control program with the CPU. Some or all of the processing units included in the control unit 11 may be configured with electronic circuits. The control program may be a program for causing a plurality of processors to function as the various processing units.

[0040] Furthermore, the control unit 11 executes various processes related to the online meeting according to the conversation application. Specifically, when the control unit 11 receives an operation (login operation) by the user to start the conversation application, it transmits a start request to the server 2. When the server 2 authenticates the start request, the control unit 11 displays a conversation screen on the user terminal 1 to start the online meeting. Fig. 3 shows an example of a conversation screen M1 corresponding to the conversation application (online meeting service). The conversation screen M1 is displayed at an arbitrary position within a display screen P1 (display area) of the user terminal 1 (here, the user terminal 1A).

[0041] The control unit 11 causes the operation display unit 13 (display) to display the conversation screen M1 in response to an instruction from the server 2. User A and user B can each view the conversation screen M1 on their own user terminal 1A and user terminal 1B.

[0042] Furthermore, the control unit 11 transmits and receives the conversation voice via the server 2. For example, when the control unit 11 of the user terminal 1A of the user A acquires the speech voice of the user A through a microphone, it transmits it to the server 2, the server 2 transmits the speech voice of the user A to the user terminal 1B of the user B, and the control unit 11 of the user terminal 1B outputs the speech voice of the user A from a speaker. When the control unit 11 of the user terminal 1B of the user B acquires the speech voice of the user B through a microphone, it transmits it to the server 2, the server 2 transmits the speech voice of the user B to the user terminal 1A of the user A, and the control unit 11 of the user terminal 1A outputs the speech voice of the user B from a speaker. In this way, the users A and B can have a conversation (online meeting).

[0043] Furthermore, when the control unit 11 receives an operation (termination operation) by the user to terminate the conversation application, it transmits an end request to the server 2. When the server 2 authenticates the end request, the control unit 11 terminates the online meeting in the user terminal 1.

[0044] Each user participating in the online meeting starts the online meeting by launching a conversation application on his / her own user terminal 1. Also, each user ends the online meeting by closing the conversation application on his / her own user terminal 1.

[0045] Here, in the online meeting, a user can share the display screen of his / her user terminal 1 with the user terminal 1 of another user. For example, in the conversation screen M1 shown in FIG. 3, user A can press the screen sharing button K1 to share the display screen P1 (see FIG. 4) of the user terminal 1A. Here, the display screen P1 (the entire display of the user terminal 1A) includes the display screens (windows) of the materials F1 and F2. FIG. 5 shows a state in which the display screen P1 to be shared is displayed (screen shared) on the conversation screen M1 of the user terminal 1B. The shared object may be the entire display screen P1 of the user terminal 1A, or a part of the display object (e.g., the material F2) included in the display screen P1. When the screen is shared between the user terminal 1A and the user terminal 1B, the display contents of the user terminal 1B to be the screen shared are updated according to the operation of the user terminal 1A that is the screen sharing source. For example, when user A advances the page of the material F2 to the next page on the user terminal 1A, the image of the next page is displayed on the conversation screen M1 of the user terminal 1B.

[0046] In the conventional technology, the screen sharing function is inconvenient for user B because user B cannot, for example, advance to the next page of document F2 to be shared or download the file of document F2 by himself. In contrast, the user terminal 1 according to this embodiment has a configuration that can improve the user's convenience regarding the display target to be shared. The above configuration will be described in detail below. Note that the configuration of each processing unit will be described below by distinguishing between user terminal 1A and user terminal 1B.

[0047] Specifically, the registration processing unit 111 of the user terminal 1A associates and registers information on the storage location of the display object selected by the user A in the user terminal 1A with identification information of the window in which the display object is displayed on the display screen. For example, when the user A presses the screen sharing button K1 (see FIG. 3) in the user terminal 1A to select the display screen P1 (see FIG. 4) including the display objects, materials F1 and F2, the registration processing unit 111 associates and registers in the storage location information table T1 information on the storage location of the material F1 (URL, file path, etc.) with identification information (window ID) of the window in which the material F1 is displayed (display area), and associates and registers in the storage location information table T1 information on the storage location of the material F2 (URL, file path, etc.) with identification information (window ID) of the window in which the material F2 is displayed.

[0048] 6 shows an example of storage location information table T1. Window ID "0001" indicates identification information of a window displaying document F1, and window ID "0002" indicates identification information of a window displaying document F2. In the "URL" column of storage location information table T1, a file path indicating the storage location of the data (file) of document F1 is registered. The storage location may be the memory unit 12 of the user terminal 1, or an external device (such as a cloud server or a data server) capable of data communication with the user terminal 1.

[0049] Furthermore, the registration processing unit 111 further registers the identification information of a window included in the display screen, and the display position and display size information of the window in the display screen in association with each other. For example, the registration processing unit 111 acquires the position (XYZ coordinates) of the window displaying the document F1 in the display screen P1 and the size of the window, and registers them in the display target information table T2 in association with the identification information (window ID) of the window. Similarly, the registration processing unit 111 acquires the position (XYZ coordinates) of the window displaying the document F2 in the display screen P1 and the size of the window, and registers them in the display target information table T2 in association with the identification information (window ID) of the window. The XY coordinates indicate the position in the up, down, left, and right directions when the display screen is the XY plane, and the Z coordinate indicates the position in the front and back directions with respect to the display screen. The range of the window (display range) is specified by the XY coordinates and the display size.

[0050] An example of the display target information table T2 is shown in Fig. 7. Here, the display position (XYZ coordinates) and display size of the window displaying document F1 are registered in association with window ID "0001", and the display position (XYZ coordinates) and display size of the window displaying document F2 are registered in association with window ID "0002". In the example shown in Fig. 4, the window of document F2 is located in the front right side of the display screen P1, and the window of document F1 is located in the rear left side of the display screen P1.

[0051] Furthermore, the registration processing unit 111 further registers information of the screen being shared in the shared screen information table T3 (see FIG. 8) when a screen is being shared among a plurality of user terminals 1. In the example shown in FIG. 5, the entire display (display screen P1) of the user terminal 1A, the screen of the document F1 (window ID "0001"), and the screen of the document F2 (window ID "0002") are shared, so the registration processing unit 111 registers this information in the shared screen information table T3 (see FIG. 8).

[0052] When a display screen including one or more windows displaying display targets on the screen sharing source user terminal 1A is shared with the screen sharing destination user terminal 1B, the detection processing unit 112 of the user terminal 1B detects the selection position selected by user B on the shared screen of the user terminal 1B. For example, as shown in Fig. 9, when the display screen P1 of the user terminal 1A is shared with the user terminal 1B, if the user B selects a document F2 on the shared screen (e.g., by clicking with the mouse), the detection processing unit 112 detects the selection position (e.g., XY coordinates) on the display screen P1 of the user terminal 1B.

[0053] When user B selects a shared screen of user terminal 1B, which is a screen sharing destination, the reception processing unit 113 of user terminal 1B accepts a selection operation by user B to select whether to display the display target on user terminal 1B or to download the display target to user terminal 1B. For example, as shown in FIG. 9, when user B selects (e.g., clicks with a mouse) document F2 on the shared screen of user terminal 1B, the reception processing unit 113 displays a selection screen Q1 for user B to select whether to display (launch) document F2 on user terminal 1B or to download document F2 from a storage location to user terminal 1B, and accepts the selection operation of user B. For example, the selection screen Q1 includes selection buttons for "Open" and "Download," and user B selects one of them. FIG. 9 shows an example in which user B selects "Open."

[0054] The identification processing unit 114 of the user terminal 1A identifies a window that corresponds to the selection position detected by the detection processing unit 112 from among one or more windows displayed on the screen sharing source user terminal 1A. For example, when user B selects material F2 on the shared screen of user terminal 1B (see FIG. 9) and the detection processing unit 112 detects the selection position on the display screen P1, the identification processing unit 114 refers to the display target information table T2 (see FIG. 7) and identifies a window in which the selection position is included in a display range identified by the XY coordinates and display size. Here, the identification processing unit 114 identifies a window with window ID "0002".

[0055] Output processing unit 115 of user terminal 1A outputs to user terminal 1B, the screen sharing destination, information on the storage location of the display object displayed in the window identified by identification processing unit 114. In this case, because identification processing unit 114 identifies the window with window ID "0002", output processing unit 115 refers to storage location information table T1 (see FIG. 6) and outputs information on the URL associated with window ID "0002" to user terminal 1B.

[0056] When the information on the storage location is acquired (received) in the user terminal 1B, which is the screen sharing destination, the execution processing unit 116 of the user terminal 1B executes a process in accordance with the selection operation of the user B in the user terminal 1B. In the above example, since the user B selects "Open" for the document F2 (see FIG. 9), when the execution processing unit 116 receives the URL associated with the window ID "0002" from the user terminal 1A, the execution processing unit 116 accesses the URL, opens the file of the document F2, and displays it on the user terminal 1B. For example, if the file of the document F2 is in the file format of a document application, the execution processing unit 116 starts the document application in the user terminal 1B and displays the document F2. In addition, the execution processing unit 116 displays the document F2 in a display area different from the conversation screen M1 in the user terminal 1B.

[0057] As another example, when user B selects "download" for document F2, the execution processing unit 116, upon receiving a URL associated with window ID "0002" from user terminal 1A, accesses the URL and downloads the file of document F2 from the storage location to user terminal 1B. For example, the execution processing unit 116 downloads the file of document F2 stored in the memory unit 12 of user terminal 1A or a cloud server to user terminal 1B.

[0058] As described above, during screen sharing, the user terminal 1 of the screen sharing destination accesses and displays or downloads the display object, allowing the user to perform desired operations (such as turning pages, editing, etc.) on the display object.

[0059] In the above example, the user terminal 1A is the screen sharing source of the shared screen, and the user terminal 1B is the screen sharing destination of the shared screen. However, the user terminal 1B may be the screen sharing source of the shared screen, and the user terminal 1A may be the screen sharing destination of the shared screen. In this case, the registration processing unit 111 of the user terminal 1B executes a process of registering the storage location information table T1 (see FIG. 6), the display target information table T2 (see FIG. 7), and the shared screen information table T3 (see FIG. 8). The detection processing unit 112 of the user terminal 1A detects the selection position selected by the user A on the shared screen of the user terminal 1A, and the reception processing unit 113 of the user terminal 1B accepts the selection operation selected by the user A on the selection screen Q1 of the user terminal 1A. The identification processing unit 114 of the user terminal 1B identifies a window corresponding to the selection position, and the output processing unit 115 of the user terminal 1B outputs information (URL) of the storage location of the display target displayed in the identified window to the user terminal 1A of the screen sharing destination. Then, the execution processing unit 116 of the user terminal 1A executes processing (display, download, etc.) according to the selection operation by the user A.

[0060] That is, each user terminal 1 includes a registration processing unit 111, a detection processing unit 112, a reception processing unit 113, a specification processing unit 114, an output processing unit 115, and an execution processing unit 116, and executes the above-mentioned processes.

[0061] [Screen sharing process] An example of the procedure of the screen sharing process executed in the chat system 10 will now be described.

[0062] The present disclosure can be understood as a screen sharing method (an example of the screen sharing method of the present disclosure) that executes one or more steps included in the screen sharing process. One or more steps included in the screen sharing process described here may be omitted as appropriate. The steps in the screen sharing process may be executed in a different order as long as the same operational effect is achieved.

[0063] Additionally, although the following description takes as an example a case in which the control unit 11 of the user terminal 1 executes each step in the screen sharing process, in other embodiments, one or more processors may execute each step in the screen sharing process in a distributed manner.

[0064] The screen sharing process includes a registration process for registering a file to be shared. Fig. 10 shows an example of the registration process executed by the control unit 11 of the user terminal 1 that is the source of screen sharing. Here, it is assumed that an online meeting has started in which a conversation application is executed in the user terminal 1A and the user terminal 1B. The user terminal 1 that is the source of screen sharing is assumed to be the user terminal 1A, and the user terminal 1 that is the destination of screen sharing is assumed to be the user terminal 1B.

[0065] In step S1 of FIG. 10, the control unit 11 of the user terminal 1A determines whether or not it has received an operation to select a file to be shared from user A. For example, user A presses the screen sharing button K1 on the conversation screen M1 shown in FIG. 3 to select display screen P1 (see FIG. 4). User A may also select materials F1 and F2. When the control unit 11 receives an operation to select a file to be shared from user A (S1: Yes), it transitions the process to step S2. The control unit 11 waits until it receives an operation to select a file to be shared from user A (S1: No). Here, it is assumed that user A has selected display screen P1 including materials F1 and F2.

[0066] In step S2, the control unit 11 acquires the storage location (file path, URL) of the selected file. Here, the control unit 11 acquires the URL of the material F1 and the URL of the material F2 displayed on the display screen P1.

[0067] Next, in step S3, the control unit 11 causes the selected file to be displayed on the display screen P1 of the user terminal 1A. For example, the control unit 11 causes the user terminal 1A to display the display screen P1 shown in Fig. 4. Furthermore, when a file to be shared is selected in the user terminal 1A, the control unit 11 of the user terminal 1B obtains an image of the shared screen (display screen P1) and displays it on the user terminal 1B (see Fig. 5).

[0068] Next, in step S4, the control unit 11 associates and registers information on the storage location of the shared object selected by user A on the user terminal 1A with identification information of the window displaying the shared object on the display screen. For example, the control unit 11 associates and registers information on the storage location (URL) of the document F1 included in the display screen P1 with the window ID of the window displaying the document F1 in the storage location information table T1, and associates and registers information on the storage location (URL) of the document F2 with the window ID of the window displaying the document F2 in the storage location information table T1 (see FIG. 6).

[0069] In addition, the control unit 11 acquires the position (XYZ coordinates) of the window displaying each document within the display screen P1 and the size of the window, and registers these in the display target information table T2 (see FIG. 7) in association with the window ID of the window.

[0070] Moreover, the control unit 11 registers information about the screen being shared in a shared screen information table T3 (see FIG. 8).

[0071] In this manner, the control unit 11 executes the registration process for registering information (storage location, display position, etc.) of the display target (shared target) selected by the user in the screen sharing mode.

[0072] 11 shows an example of a screen sharing process executed between a user terminal 1A that is a screen sharing source and a user terminal 1B that is a screen sharing destination. Here, it is assumed that a display screen P1 of the user terminal 1A is shared and displayed on the user terminal 1B (see FIG. 5).

[0073] In step S11, the control unit 11 of the user terminal 1B determines whether or not a file acquisition request has been received from the user B. For example, when the user B selects (mouse clicks) the document F2 on the display screen P1 in the user terminal 1B, the control unit 11 determines that the acquisition request has been received. If the control unit 11 receives the acquisition request (S11: Yes), the process proceeds to step S12.

[0074] Next, in step S12, the control unit 11 of the user terminal 1B detects the selection position selected by the user B on the shared screen of the user terminal 1B. For example, as shown in Fig. 9, when the user B selects (mouse clicks) the document F2 on the shared screen, the control unit 11 detects the selection position (XY coordinates) in the area of ​​the display screen P1 of the user terminal 1B.

[0075] Next, in step S13, control unit 11 of user terminal 1B outputs position information (coordinate information) of the detected selected position to user terminal 1A.

[0076] Next, in step S14, the control unit 11 of the user terminal 1A receives the location information output from the user terminal 1B.

[0077] Next, in step S15, control unit 11 of user terminal 1A determines whether or not a target window exists. Specifically, control unit 11 determines whether or not a file window exists at a position on display screen P1 of user terminal 1A that corresponds to the position information. If control unit 11 determines that a target window exists (S15: Yes), it identifies the target window and transitions the process to step S16. On the other hand, if control unit 11 determines that a target window does not exist (S15: No), it displays an error in step S151.

[0078] For example, when user B selects document F2 on the shared screen of user terminal 1B and control unit 11 of user terminal 1B detects the selection position on display screen P1, control unit 11 of user terminal 1A refers to display target information table T2 (see FIG. 7) and identifies a window whose display range includes the selection position. Here, control unit 11 identifies a window with window ID "0002."

[0079] In step S16, control unit 11 of user terminal 1A acquires information on the storage location of the display target displayed in the identified target window. Here, control unit 11 refers to storage location information table T1 (see FIG. 6) and acquires information on the URL associated with window ID "0002."

[0080] Next, in step S17, control unit 11 of user terminal 1A outputs the acquired storage location information (URL) to user terminal 1B, the screen sharing destination. Here, control unit 11 outputs URL information associated with window ID "0002" to user terminal 1B.

[0081] Next, in step S18, control unit 11 of user terminal 1B receives a URL from user terminal 1A. Here, control unit 11 receives information on the URL associated with window ID "0002."

[0082] Next, in step S19, the control unit 11 of the user terminal 1B accesses the URL and displays the target file. For example, the control unit 11 accesses the URL, opens the file of the document F2, and displays it on the user terminal 1B.

[0083] In this manner, the user terminal 1A and the user terminal 1B present access information (URL) of the shared object in response to a user operation on the shared screen, enabling an operation (display, download, etc.) on the shared object.

[0084] As described above, the conversation system 10 of this embodiment, when a display screen including one or more windows displaying a display target on a first user terminal (screen sharing source terminal) of a first user is shared with a second user terminal (screen sharing destination terminal) of a second user, detects a selection position selected by the second user on the shared screen of the second user terminal, identifies a window among the one or more windows that corresponds to the detected selection position, and outputs information (URL, file path, etc.) of the storage location of the display target displayed in the identified window to the second user terminal.

[0085] According to the above configuration, for example, when a screen is being shared between user terminal 1A and user terminal 1B, if user B, the screen sharing destination, selects a file to be shared (document F2), access information for document F2 is presented on user terminal 1B, so user B can access document F2 on user terminal 1B during screen sharing. This allows user B to display document F2 on a screen separate from the shared screen, advance to the next page of document F2, or download document F2 to user terminal 1B, improving convenience for user B.

[0086] [Other embodiments] The conversation system 10 according to the present disclosure is not limited to the above-mentioned embodiment. As another embodiment of the conversation system 10 according to the present disclosure, the output processing unit 115 may output information (access information) of the storage location of the shared object to the user terminal 1B when the user B has a preset authority. For example, when the user B who is the screen sharing destination belongs to the same group as the user A who is the screen sharing source, the output processing unit 115 outputs the access information to the user terminal 1B, and when the user B belongs to a different group from the user A, the output processing unit 115 rejects the access information by not outputting it to the user terminal 1B.

[0087] Also, for example, output processing unit 115 outputs the access information to user terminal 1B when user B's job title is a certain level or higher (e.g., manager, group leader, etc.), and rejects the access information by not outputting it to user terminal 1B when user B's job title is less than a certain level (e.g., non-managerial, group member, etc.). That is, output processing unit 115 permits the presentation of the access information when user B's attribute is a predetermined attribute.

[0088] In another embodiment, when user B does not have the preset authority, control unit 11 of user terminal 1B may display a message indicating that user B does not have the authority. When user B does not have the authority but requests access information, control unit 11 outputs a request to obtain access information to user terminal 1A.

[0089] In another embodiment, the control unit 11 of the user terminal 1A may display a message on the user terminal 1A to allow the user B to select whether to permit or deny the presentation of the access information when the user B does not have the preset authority. The output processing unit 115 outputs the access information to the user terminal 1B when the user A permits it, and rejects it without outputting the access information to the user terminal 1B when the user A rejects it. In the above configuration, the output processing unit 115 may upload the file to be shared to an external device (such as a cloud server or a data server) when the user A permits it, and then output information on the storage location of the file (access information) to the user terminal 1B.

[0090] In another embodiment, the authority may be given for each file to be shared. For example, when the authority is given to the document F2, the user having the authority is permitted to present the access information, and the user not having the authority is denied the presentation of the access information.

[0091] In the above embodiment, an embodiment in which user A and user B have an online conversation has been shown, but in another embodiment, a specific user may use a chat.

[0092] For example, when a user selects a specific file (e.g., document F3) from a file storage location on user terminal 1, control unit 11 launches and displays the file (see FIG. 12). Next, control unit 11 detects information about the foreground window displaying document F3. Next, control unit 11 associates the detected window information with the storage location (URL) of document F3 and registers them in storage location information table T1 (see FIG. 6).

[0093] Next, when the control unit 11 receives an operation from the user to specify a window for the file to be shared, the control unit 11 refers to the storage location information table T1 and acquires a URL corresponding to the specified window. The control unit 11 displays an icon image C1 of the acquired URL in association with the specified window (see FIG. 12). Next, for example, when the user drags and drops the icon image C1 onto a chat screen, the control unit 11 displays the URL on the chat application.

[0094] This makes it possible to easily share URLs in the chat section, even during a web conference, and automatically grant access permissions to the target file to web conference participants.

[0095] The file may be stored in a data server such as a cloud server. In this case, when the data server detects an access from the user terminal 1, it identifies the connected user terminal 1 from the user ID and notifies the user terminal 1 of the URL information of the target file.

[0096] In the above embodiment, a television conversation system is taken as an example, but as another embodiment, a virtual conversation system may be used. In the virtual conversation system, for example, as shown in FIG. 13, a common virtual office screen is displayed on each user terminal 1. FIG. 13 shows a user terminal 1B on which a plurality of shared screens are displayed. In the user terminal 1B, user B can freely move each shared screen (object image) within the virtual office. When user B selects a file (document F5) that he / she wants to acquire in the user terminal 1B and selects "Open" on the selection screen Q1, the control unit 11 opens and displays the file (document F2) on the virtual office screen.

[0097] As another embodiment, in the virtual conversation system, the control unit 11 may automatically move to a room in the virtual office related to the material being shared when screen sharing is started.

[0098] First, when screen sharing starts, the control unit 11 identifies the material related to the window whose screen is being shared. Next, the control unit 11 identifies the room on the virtual office to which the identified material is associated. Next, the control unit 11 moves to the identified room while continuing the screen sharing and the call. The control unit 11 also automatically moves the room of other users who are in a call with the screen-sharing user. The control unit 11 highlights the icon image indicating the material being shared on the screen in the destination room by using a thick frame, blinking, etc.

[0099] For example, as shown in Fig. 14, when screen sharing is started while displaying a document F10 in room R1, the control unit 11 moves to room R2 which manages the document F10, continues displaying the screen sharing, and changes the background to that of room R2, as shown in Fig. 15. The control unit 11 also moves the user who was talking at the time the screen sharing started in room R1 to the same room R2, so that the conversation can be continued. The control unit 11 also highlights the icon image C1 indicating the document F10 being shared.

[0100] In addition, when there are multiple related rooms, the control unit 11 may determine the destination room based on who is the user currently on the call. Also, the control unit 11 may be configured not to change the layout of the screen sharing window and user icons so that the user does not feel uncomfortable when moving between rooms.

[0101] According to the above configuration, by moving to a different room, other users can open and refer to the same materials as those being shared on the screen in the room. In addition, other materials in the room to which the user moves can also be referenced, and even if other users are working in the room, the user can join in the conversation, making it easier to share information.

[0102] In the above-described embodiments, each user terminal 1 is configured to include processing units such as the registration processing unit 111, the detection processing unit 112, the reception processing unit 113, the identification processing unit 114, the output processing unit 115, and the execution processing unit 116 to execute each process, but in other embodiments, each of the processing units may be included in the server 2. In this case, the server 2 executes a process of registering the storage location information table T1 (see FIG. 6), the display target information table T2 (see FIG. 7), and the shared screen information table T3 (see FIG. 8). The server 2 also detects the selection position selected by the user B on the shared screen of the user terminal 1B, and accepts the selection operation selected by the user B on the selection screen Q1 displayed on the user terminal 1B. The server 2 also identifies a window corresponding to the selection position, and outputs information on the storage location of the display target displayed in the identified window to the user terminal 1B. The server 2 then causes the user terminal 1B to execute a process corresponding to the selection operation of the user B.

[0103] In another embodiment, some of the registration processing unit 111, detection processing unit 112, reception processing unit 113, identification processing unit 114, output processing unit 115, and execution processing unit 116 may be included in the user terminal 1, and the other parts may be included in the server 2.

[0104] That is, the screen sharing system of the present disclosure may be configured by the user terminal 1 alone, may be configured by the server 2 alone, or may be configured by the user terminal 1 and the server 2.

[0105] [Disclosure Note] The following will provide an overview of the disclosure extracted from the above-described embodiment. Note that the configurations and processing functions described in the following supplementary notes can be selected and combined as desired.

[0106] <Appendix 1> a detection processing unit that detects a selection position selected by a second user on a shared screen of a second user terminal when a display screen including one or more windows displaying a display object on a first user terminal of a first user is shared with a second user terminal of a second user; an identification processing unit that identifies a window that corresponds to the selection position detected by the detection processing unit, from among the one or more windows; an output processing unit that outputs information on a storage location of the display object displayed in the window identified by the identification processing unit to the second user terminal; A screen sharing system comprising:

[0107] <Appendix 2> a registration processing unit that registers information on a storage location of the display target selected by the first user in the first user terminal and identification information of a window that displays the display target on the display screen in association with each other; 2. A screen sharing system as described in claim 1.

[0108] <Appendix 3> The registration processing unit further registers identification information of the window included in the display screen in association with position information of a display position and a display size of the window within the display screen. 6. A screen sharing system as described in claim 2.

[0109] <Appendix 4> a reception processing unit that, when the second user selects a shared screen of the second user terminal, receives a selection operation by the second user to select whether to display the display target on the second user terminal or to download the display target to the second user terminal, in the second user terminal; an execution processing unit that executes a process in accordance with the selection operation in the second user terminal when the information on the storage location is acquired in the second user terminal; 4. The screen sharing system according to claim 1, further comprising:

[0110] <Appendix 5> When the reception processing unit receives an instruction from the second user to display the display target on the second user terminal, the execution processing unit displays the display target on a screen different from the shared screen on the second user terminal. 5. A screen sharing system as described in claim 4.

[0111] <Appendix 6> The output processing unit outputs the information on the storage location to the second user terminal when the first user gives permission. 6. A screen sharing system according to any one of appendixes 1 to 5.

[0112] <Appendix 7> The output processing unit uploads the display target to a server when the first user gives permission, and then outputs information on the storage location of the display target to the second user terminal. 7. The screen sharing system of claim 6.

[0113] <Appendix 8> The output processing unit outputs the information of the storage location to the second user terminal when the second user has a preset authority. A screen sharing system according to any one of appendixes 1 to 7.

[0114] <Appendix 9> The output processing unit outputs the information on the storage location to the second user terminal when the second user belongs to the same group as the first user or when an attribute of the second user is a predetermined attribute. A screen sharing system according to any one of appendixes 1 to 8. [Explanation of symbols]

[0115] 1: User device 2: Server 10: Conversation system 11: Control section 12: Storage section 13: Operation display section 21: Control section 22: Storage section 23: Operation display section 111: Registration processing unit 112: Detection processing unit 113: Reception processing unit 114: Specific Processing Unit 115: Output processing section 116: Execution processing unit C1: Icon image K1: Screen sharing button M1: Conversation screen P1:Display screen Q1: Selection screen T1: Storage location information table T2: Display target information table T3: Shared screen information table

Claims

1. a detection processing unit that detects a selection position selected by a second user on a shared screen of a first user terminal of a second user terminal when a display screen including one or more windows displaying a display object on a first user terminal of a first user is shared with a second user terminal of a second user; an identification processing unit that identifies a window that corresponds to the selection position detected by the detection processing unit, from among the one or more windows; an output processing unit that outputs information on a storage location of the display object displayed in the window identified by the identification processing unit to the second user terminal; A screen sharing system comprising:

2. a registration processing unit that registers information on a storage location of a display object selected by the first user in the first user terminal and identification information of a window that displays the display object on the display screen in association with each other; The screen sharing system according to claim 1 .

3. The registration processing unit further registers identification information of the window included in the display screen in association with position information of a display position and a display size of the window within the display screen. The screen sharing system according to claim 2 .

4. a reception processing unit that, when the second user selects a shared screen of the second user terminal, receives a selection operation by the second user to select whether to display the display target on the second user terminal or to download the display target to the second user terminal, in the second user terminal; an execution processing unit that executes a process in accordance with the selection operation in the second user terminal when the information on the storage location is acquired in the second user terminal; The screen sharing system of claim 1 , further comprising:

5. When the reception processing unit receives an instruction from the second user to display the display target on the second user terminal, the execution processing unit displays the display target on a screen different from the shared screen on the second user terminal. The screen sharing system according to claim 4 .

6. The output processing unit outputs the information on the storage location to the second user terminal when the first user permits it. The screen sharing system according to claim 1 .

7. The output processing unit uploads the display object to a server when the first user gives permission, and then outputs information on the storage location of the display object to the second user terminal. The screen sharing system according to claim 6.

8. The output processing unit outputs the information of the storage location to the second user terminal when the second user has a preset authority. The screen sharing system according to claim 1 .

9. The output processing unit outputs the information on the storage location to the second user terminal when the second user belongs to the same group as the first user or when an attribute of the second user is a predetermined attribute. The screen sharing system according to claim 1 .

10. When a display screen including one or more windows displaying a display object on a first user terminal of a first user is shared with a second user terminal of a second user, detecting a selection position selected by the second user on the shared screen of the second user terminal; identifying a window that corresponds to the selection position among the one or more windows; outputting information on a storage location of the display object displayed in the window to the second user terminal; A screen sharing method executed by one or more processors.

11. When a display screen including one or more windows displaying a display object on a first user terminal of a first user is shared with a second user terminal of a second user, detecting a selection position selected by the second user on the shared screen of the second user terminal; identifying a window that corresponds to the selection position among the one or more windows; outputting information on a storage location of the display object displayed in the window to the second user terminal; A screen sharing program for executing on one or more processors.

12. a detection processing unit that detects a selection position selected by a target user on a shared screen of a user terminal when a display screen including one or more windows displaying a display target is shared on the user terminal of the target user; an identification processing unit that identifies a window that corresponds to the selection position detected by the detection processing unit, from among the one or more windows; an output processing unit that outputs information on a storage location of the display object displayed in the window specified by the specification processing unit to the user terminal; An operation terminal comprising:

Images