Information processing system, information processing method, server device and program

Abstract

To provide an information processing system which can further facilitate grasping of correspondence between different kinds of pieces of speech information received from a plurality of users and a progress schedule.SOLUTION: An information processing system includes a plurality of user terminals, and a server device which records speech information in which input is received from a plurality of users who perform information sharing to the plurality of user terminals. The server device comprises a speech information reception unit which receives different kinds of pieces of speech information in which the input is received from the plurality of users to the plurality of user terminals, and a screen information transmission unit which transmits screen information on a screen which displays the different kinds of pieces of speech information in association with a progress schedule to the plurality of user terminals. The user terminal comprises a screen information reception unit which receives the screen information from the server device, and a screen display unit which displays the different kinds of pieces of speech information on the screen in association with the progress schedule, by using the received screen information.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The present invention relates to an information processing system, an information processing method, a server device, and a program. [Background technology]

[0002] 2. Description of the Related Art There is a known technique for improving the efficiency of event management by using a computer to create a schedule and manage the progress of a party or the like, and making it possible to adjust for delays in progress (see, for example, Patent Document 1). Summary of the Invention [Problem to be solved by the invention]

[0003] For example, when staff members share information at a party or other event, they may use voice notifications such as walkie-talkie functions. However, with conventional information sharing between staff members, it was not easy for the staff members who used the voice notifications to understand the correspondence between the contents of the voice notifications and the schedule of the event.

[0004] An object of one embodiment of the present invention is to provide an information processing system that can more easily grasp the correspondence between different types of speech information received from a plurality of users and a progress schedule. [Means for solving the problem]

[0005] One embodiment of the present invention is an information processing system including a plurality of user terminals and a server device that records speech information inputted into the plurality of user terminals from a plurality of users who share information, wherein the server device has a speech information receiving unit that receives different types of speech information inputted into the plurality of user terminals from the plurality of users, and a screen information transmitting unit that transmits screen information of a screen that displays the different types of speech information in association with a progress schedule to the plurality of user terminals, and the user terminal has a screen information receiving unit that receives the screen information from the server device, and a screen display unit that uses the received screen information to display the different types of speech information on a screen in association with the progress schedule. Effect of the Invention

[0006] According to an embodiment of the present invention, it is possible to more easily grasp the correspondence between different types of speech information received from a plurality of users and the progress schedule. [Brief description of the drawings]

[0007] [Figure 1] 1 is a configuration diagram of an example of an information processing system according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a diagram illustrating a hardware configuration of an example of a smartphone. [Diagram 3] FIG. 5 is a diagram illustrating an example of a hardware configuration of a computer 500 according to the present embodiment. [Figure 4] 1 is a functional configuration diagram of an example of an information processing system according to an embodiment of the present invention. [Diagram 5] FIG. 4 is a flowchart illustrating an example of a processing procedure of the information processing system according to the embodiment. [Figure 6] FIG. 13 is a diagram illustrating an example of how to manage staff at an event. [Figure 7] FIG. 13 is an image diagram of an example of a screen for inputting information related to an event. [Figure 8] FIG. 13 is an image diagram of an example of a screen on which information about an event progress schedule is input. [Figure 9]FIG. 13 is an image diagram of an example of a screen on which a shared memo is selected and displayed. [Figure 10] FIG. 2 is a diagram illustrating an example of a table in which information related to an event is stored. [Figure 11] FIG. 11 is a sequence diagram of an example of processing during an event in the information processing system according to the embodiment. [Figure 12] FIG. 13 is a diagram illustrating an example of a table during an event in which information related to an event is stored. [Figure 13] FIG. 13 is an image diagram of an example of a screen on which speech information is displayed in association with a progress schedule during an event. [Figure 14] FIG. 13 is an image diagram of an example of a screen in which a report / trouble option is selected and displayed. [Figure 15] FIG. 13 is an image diagram of an example of a screen on which a personal memo is selected and displayed. [Figure 16] 1 is a configuration diagram of an example of an information processing system according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings. In the embodiment, an example will be described in which a plurality of users, such as event staff, share information at an event such as a banquet that proceeds according to a schedule.

[0009] [First embodiment] <System configuration> 1 is a configuration diagram of an example of an information processing system 1 according to the present embodiment. In the information processing system 1 according to the present embodiment, a server device 10, a user terminal 12, a display device 14-1, and a display device 14-2 are communicatively connected via a network 18. The network 18 is the Internet, a LAN (Local Area Network), or the like.

[0010] The user terminals 12 include a user terminal 12-1 operated by a manager, a user terminal 12-2 operated by a chief, and a user terminal 12-3 operated by a leader. Note that the manager, the chief, and the leader shown in this embodiment are examples of multiple users who share information.

[0011] The user terminal 12 includes an information processing terminal such as a smartphone, a tablet terminal, or a mobile phone, and an intercom. An intercom is also called an intercom, which is an abbreviation of intercommunication. An intercom is a communication device that allows voice calls by wearing an earphone microphone or a headset, for example. The information processing terminal and the intercom are connected to be able to communicate with each other via wire or wirelessly. When using the microphone and speaker of the information processing terminal, the intercom may be omitted. The user terminal 12 accepts input of different types of speech information from the user. The different types of speech information will be described in detail later.

[0012] The input of speech information to the user terminal 12 is voice input. The input of speech information to the user terminal 12 may be made by using a button operation and a voice command by the user on the intercom. The input of speech information to the user terminal 12 may also be an operational input in which text is input by the user's keyboard operation and handwriting input.

[0013] The server device 10 is an example of an information processing device that receives and records different types of speech information input to the user terminal 12 by users who wish to share information. The server device 10 generates screen information for a screen described below that displays different types of speech information input by multiple users to the user terminal 12 in association with an event progress schedule. The server device 10 transmits the screen information to the multiple user terminals 12, thereby causing the user terminal 12 to display a screen described below that displays different types of speech information input by multiple users (shared notes, personal notes, reports / trouble, or notifications, described below) in association with the event progress schedule.

[0014] The server device 10 may function as a web server and provide screen information of a web page for users to be displayed on the multiple user terminals 12 to the multiple user terminals 12. The server device 10 may transmit the screen information to the display device 14-1 or 14-2, thereby causing the display device 14-1 or 14-2 to display a screen described below in which different types of speech information input by the multiple users are associated with a progress schedule of the event.

[0015] The server device 10 is, for example, a PC (Personal Computer) or a workstation, etc. The server device 10 may be a printer, a scanner, a facsimile, a multifunction peripheral, a projector, a display device having an electronic whiteboard function, an output device such as digital signage, a HUD (Head Up Display) device, an industrial machine, an imaging device, a sound collecting device, a medical device, a network home appliance, an automobile (Connected Car), a game machine, etc.

[0016] The display device 14-1 is, for example, a PC. The display device 14-1 is used by a user, for example, before the start of an event, to input speech information or display a screen described later. The display device 14-2 is, for example, a digital signage. The display device 14-2 is provided, for example, in the backyard of a venue where an event is held, and displays a screen described later during the event.

[0017] The configuration of the information processing system 1 shown in FIG. 1 is just an example. There are various system configuration examples of the server device 10 depending on the use and purpose. For example, the server device 10 may be configured with one or more computers. The server device 10 may be realized as a cloud computing service. The service provided by the server device 10 may be provided as one or more services.

[0018] <Hardware configuration> 《Smartphone》 The user terminal 12 may be realized by using a smartphone 400 having a hardware configuration shown in Fig. 2. Fig. 2 is a diagram showing an example of the hardware configuration of the smartphone 400.

[0019] The smartphone 400 includes a CPU (Central Processing Unit) 401, a ROM (Read Only Memory) 402, a RAM (Random Access Memory) 403, an EEPROM 404, a CMOS (Complementary Metal Oxide Semiconductor) sensor 405, an image sensor I / F 406, an acceleration and orientation sensor 407, a media I / F 409, and a GPS receiver 411.

[0020] The CPU 401 controls the overall operation of the smartphone 400. The ROM 402 stores the CPU 401 and programs used to drive the CPU 401, such as the IPL. The RAM 403 is used as a work area for the CPU 401. The EEPROM 404 reads and writes various data, such as smartphone programs, under the control of the CPU 401.

[0021] The CMOS sensor 405 is a type of built-in imaging means that captures an image of a subject (mainly a self-portrait) under the control of the CPU 401 to obtain image data. Note that imaging means such as a CCD (Charge Coupled Device) sensor may be used instead of a CMOS sensor. The imaging element I / F 406 is a circuit that controls the driving of the CMOS sensor 405. The acceleration / direction sensor 407 is an electronic magnetic compass that detects geomagnetism, a gyrocompass, an acceleration sensor, or other such sensor. The media I / F 409 controls the reading or writing (storing) of data from or to a recording medium 408 such as a flash memory. The GPS receiver 411 receives GPS signals from GPS satellites.

[0022] The smartphone 400 also includes a long-distance communication circuit 412, a CMOS sensor 413, an image sensor I / F 414, a microphone 415, a speaker 416, an audio input / output I / F 417, a display 418, an external device connection I / F (Interface) 419, a short-distance communication circuit 420, an antenna 420a of the short-distance communication circuit 420, and a touch panel 421. The long-distance communication circuit 412 is a circuit that communicates with other devices via the network 18. The CMOS sensor 413 is a type of built-in imaging means that captures an object under the control of the CPU 401 to obtain image data. The image sensor I / F 414 is a circuit that controls the driving of the CMOS sensor 413. The microphone 415 is a built-in circuit that converts sound into an electrical signal. The speaker 416 is a built-in circuit that converts an electrical signal into physical vibrations to generate sounds such as music and voice.

[0023] The audio input / output I / F 417 is a circuit that processes input and output of audio signals between the microphone 415 and the speaker 416 under the control of the CPU 401. The display 418 is a type of display means such as a liquid crystal or organic EL (Electro Luminescence) that displays an image of a subject, various icons, and the like.

[0024] The external device connection I / F 419 is an interface for connecting various external devices. The short-distance communication circuit 420 is a communication circuit such as NFC (Near Field Communication) or Bluetooth (registered trademark). The touch panel 421 is a type of input means for operating the smartphone 400 by a user pressing the display 418. The smartphone 400 includes a bus line 410. The bus line 410 is an address bus, a data bus, or the like for electrically connecting the components such as the CPU 401 shown in FIG. 2.

[0025] "computer" The server device 10, the display device 14-1, and the display device 14-2 shown in Fig. 1 are realized by a computer 500 having a hardware configuration shown in Fig. 3. Fig. 3 is a diagram showing an example of the hardware configuration of the computer 500 according to this embodiment.

[0026] The computer 500 includes a CPU 501, a ROM 502, a RAM 503, a HD 504, a HDD (Hard Disk Drive) controller 505, a display 506, an external device connection I / F 508, a network I / F 509, a data bus 510, a keyboard 511, a pointing device 512, a DVD-RW (Digital Versatile Disk Rewritable) drive 514, and a media I / F 516.

[0027] The CPU 501 controls the overall operation of the computer 500 according to a program. The ROM 502 stores programs such as an IPL used to drive the CPU 501. The RAM 503 is used as a work area for the CPU 501. The HD 504 stores various data such as programs. The HDD controller 505 controls the reading and writing of various data from and to the HD 504 according to the control of the CPU 501.

[0028] The display 506 displays various information such as a cursor, a menu, a window, characters, or an image. The external device connection I / F 508 is an interface for connecting various external devices. In this case, the external device is, for example, a USB (Universal Serial Bus) memory. The network I / F 509 is an interface for data communication using the network 18. The data bus 510 is an address bus, a data bus, or the like for electrically connecting each component such as the CPU 501.

[0029] The keyboard 511 is a type of input means having a plurality of keys for inputting characters, numbers, various instructions, etc. The pointing device 512 is a type of input means for selecting and executing various instructions, selecting a processing target, moving a cursor, etc. The DVD-RW drive 514 controls reading and writing of various data from a DVD-RW 513 as an example of a removable recording medium. Note that the medium is not limited to a DVD-RW, and may be a DVD-R or the like. The media I / F 516 controls reading and writing (storing) of data from a recording medium 515 such as a flash memory.

[0030] It should be noted that the hardware configuration shown in FIG. 3 is merely an example, and it is not necessary for the configuration to include all of the components shown in FIG. 3, or the configuration may include components other than those shown in FIG.

[0031] <Functional configuration> Fig. 4 is a functional configuration diagram of an example of the information processing system 1 according to the present embodiment. Note that the functional configuration diagram of Fig. 4 appropriately omits configurations that are not necessary for the description of the present embodiment. The server device 10, the user terminal 12, the display device 14-1, and the display device 14-2 shown in Fig. 1 realize the functional configuration of Fig. 4 by, for example, the smartphone 400 in Fig. 2 or the computer 500 in Fig. 3 executing an OS (Operating System) and a program.

[0032] 4 includes an utterance information receiving unit 30, a screen information generating unit 32, a screen information transmitting unit 34, a call function unit 36, a text converting unit 38, and a storage unit 40. The user terminal 12 includes an utterance information input accepting unit 50, an utterance information transmitting unit 52, a screen information receiving unit 54, a screen display unit 56, and a voice transmitting / receiving unit 58. The display device 14-1 includes an operation accepting unit 70, an information transmitting unit 72, a screen information receiving unit 74, and a screen display unit 76. The display device 14-2 includes a screen information receiving unit 90 and a screen display unit 92.

[0033] The utterance information input receiving unit 50 of the user terminal 12 receives input of different types of utterance information from a user who owns the user terminal 12. The utterance type or notification destination of the utterance information to be input is specified by using a button operation, a voice command, or the like.

[0034] The speech information sending unit 52 sends different types of speech information input by the users to the server device 10. The screen information receiving unit 54 receives from the server device 10 screen information of a screen described below that displays different types of speech information input by a plurality of users to the user terminal 12 in association with a progress schedule of the event.

[0035] The screen display unit 56 displays different types of speech information input by a plurality of users to the user terminal 12 on the screen in association with the event progress schedule, using the screen information received from the server device 10. The voice transmission / reception unit 58 transmits and receives voice data for the voice call function.

[0036] The speech information receiving unit 30 of the server device 10 receives different types of speech information input by multiple users to multiple user terminals 12 from the user terminals 12. The screen information generating unit 32 generates screen information for a screen described below that displays the received speech information in association with a progress schedule of the event.

[0037] The screen information transmission unit 34 transmits the generated screen information to the multiple user terminals 12. The screen information transmission unit 34 may transmit the screen information at predetermined time intervals, or may transmit the screen information when a change occurs on the screen.

[0038] The call function unit 36 ​​realizes a voice call function in cooperation with the voice transmission / reception units 58 of the multiple user terminals 12. The call function unit 36 ​​provides a voice notification function, a voice recording function, and a voice command function.

[0039] The text conversion unit 38 converts voice data of utterances of multiple users using the voice call function into text data. The speech information receiving unit 30 receives the speeches of multiple users converted into text by the text conversion unit 38 as speech information. The storage unit 40 stores information such as IP addresses required to realize the voice call function, information on the event progress schedule, and different types of speech information input by users before the start of the event and during the event.

[0040] The operation reception unit 70 of the display device 14-1 receives various operations from the user. The operation reception unit 70 receives input of speech information from the user before the start of the event. The operation reception unit 70 also receives input of information on the progress schedule of the event before the start of the event.

[0041] The information sending unit 72 sends information such as the event progress schedule, shared memos, and personal memos input from users before the start of the event to the server device 10. The screen information receiving unit 74 receives from the server device 10 screen information of a screen described below that displays different types of speech information input by multiple users to the user terminal 12 in association with the event progress schedule.

[0042] The screen display unit 76 uses the screen information received from the server device 10 to display on the screen different types of speech information input by a plurality of users to the user terminal 12 in association with the event progress schedule.

[0043] The screen information receiving unit 90 of the display device 14-2 receives from the server device 10 screen information of a screen described below that displays different types of speech information input by multiple users to the user terminal 12 in association with the event progress schedule.

[0044] The screen display unit 92 uses the screen information received from the server device 10 to display on the screen different types of speech information input by a plurality of users to the user terminal 12 in association with the event progress schedule.

[0045] <Processing> Fig. 5 is a flow chart of an example of a processing procedure of the information processing system 1 according to this embodiment. In the following, an example in which event staff management is performed using a configuration as shown in Fig. 6 will be described. Fig. 6 is a diagram of an example that describes event staff management.

[0046] As shown in Figure 6, the event staff are classified into managers, chiefs, leaders, and food service staff. The manager shown in Figure 6 manages three chiefs and coordinates the overall progress of the event. The chiefs, following instructions from the manager, manage three to four leaders and progress the event. The leaders, following instructions from the chiefs, manage about ten food service staff and progress the event. The food service staff, following instructions from the leaders, serve food and progress the event.

[0047] 6, the manager, chief, and leader each have a user terminal 12 and share information using the user terminal 12. The leader and the waiter may communicate verbally, for example, or may share information using a display device 14-2 provided in the backyard of the venue.

[0048] Among the positioning of the event staff shown in Fig. 6, for example, the positioning of the leader may be performed as follows: For example, an ID with a validity period (for example, one day) is generated for each leader position as a barcode or two-dimensional code, and the leader staff member reads the ID into the user terminal 12-3 he / she carries, making the leader positioning easy.

[0049] For example, a manager of a facility such as a hotel that has received an order to hold an event performs processing before the start of the event in step S10. For example, the manager of the event shown in Fig. 6 registers information related to the event that has been discussed with the organizer in the server device 10. The information related to the event includes information on the schedule of the event's progress.

[0050] Fig. 7 is an image diagram of an example of a screen for inputting information about an event. A screen 1000 in Fig. 7 includes a first display field 1002 and a second display field 1004. The first display field 1002 is a display field that shows a schedule of the event's progress. The second display field 1004 is a display field that shows speech information in association with the time axis of the schedule. By inputting information into a speech bubble 1012 in the second display field 1004 and pressing an "Enter schedule" button 1010 in the first display field 1002, the manager can display, for example, the screen 1000 in Fig. 8.

[0051] Fig. 8 is an image diagram of an example of a screen on which information on an event progress schedule has been input. In screen 1000 of Fig. 8, the event progress schedule is displayed in first display field 1002 according to information input in speech bubble 1012 in second display field 1004. Note that the event progress schedule displayed in first display field 1002 of Fig. 8 is appropriately modified by the manager.

[0052] After inputting the shared memo, the manager can select "Shared Memo" from the pull-down selection field 1006 in FIG. 8 as shown in FIG. 9 to display shared memo balloons 1012-1 to 1012-4 in the second display field 1004. FIG. 9 is an image diagram of an example of a screen on which the shared memo is selected and displayed. The shared memo may be input in association with a time schedule item (e.g., start of dinner) on the progress schedule displayed in the first display field 1002, or may be input by specifying the date and time. The shared memo input in association with a time schedule item on the progress schedule does not lose the correspondence between the time schedule item and the shared memo even if the progress of the event changes.

[0053] For example, after the process of step S10, the storage unit 40 of the server device 10 stores information related to events as shown in Fig. 10. Fig. 10 is a diagram showing an example of a table in which information related to events is stored.

[0054] The information about the event shown in Fig. 10 includes time schedule items, date and time, speech type, speech content, and speaker as data items. The table shown in Fig. 10 is an example in which a record is added by inputting a shared memo by a user.

[0055] A time schedule item is an item included in the progress schedule of an event (e.g., toast, start of dinner, etc.). The date and time is an example of information used to display the progress schedule in association with speech information. For example, if a shared memo is entered before the start of an event, the date and time item is used to display shared memo balloons 1012-1 to 1012-4 in the second display field 1004 in association with the progress schedule, as in the screen 1000 shown in Fig. 9. It is assumed that items included in the progress schedule have scheduled start times and scheduled end times set.

[0056] The speech type is information indicating whether the speech information is a shared memo, a personal memo, a report / trouble, or a notification. A shared memo is speech information displayed in a balloon in the second display field 1004 on the screen 1000 of all user terminals 12, and is an example of speech information shared by all users. A shared memo is an example of speech information that is displayed in a balloon in the second display field 1004 on the screen 1000 of a specified user terminal 12 after specifying a user terminal 12 to which the notification is to be sent.

[0057] The personal memo is speech information displayed in a speech bubble in the second display field 1004 on the screen 1000 of the user terminal 12 of the staff member who entered it, and is an example of speech information used personally by each staff member. The report / trouble is speech information displayed in a speech bubble in the second display field 1004 on the screen 1000 of the user terminal 12 of the staff member to whom the report is to be sent, and is an example of report-related speech information. The notification is speech information displayed in a speech bubble in the second display field 1004 on the screen 1000 of the user terminals 12 of all staff members, and is speech information other than the shared memo, personal memo, and report / trouble entered during the event.

[0058] The spoken content is the content of a shared memo, a personal memo, a report / trouble, or a notification, and is the content displayed in a speech bubble in the second display field 1004 of the screen 1000 of the user terminal 12. The different types of spoken information include speech information specifying a user who will share information, speech information shared by all users, speech information used personally by each user, and report-related speech information. The different types of spoken information include two or more of speech information specifying a user who will share information (for example, a shared memo specifying a notification destination), speech information shared by all users (for example, a shared memo or a notification), speech information used personally by each user (for example, a personal memo), and report-related speech information (for example, a report / trouble). The speaker is information indicating the staff member who inputted the speech information.

[0059] 5, the information processing system 1 according to this embodiment performs processing during the event in step S12. During the event, the information processing system 1 according to this embodiment receives spoken information of shared notes, personal notes, reports / trouble, or notifications input to the user terminal 12, for example, as shown in Fig. 11, and displays the information in a speech bubble in the second display field 1004 on the screen 1000 of the user terminal 12, thereby sharing information.

[0060] Fig. 11 is a sequence diagram of an example of processing during an event in the information processing system 1 according to the present embodiment. Note that, although Fig. 11 shows an example in which the manager and the leader input the speech information, the chief may input the speech information.

[0061] In step S10, the manager inputs speech information from the user terminal 12-1 by voice input or operation input. The manager specifies the speech type or notification destination of the input speech information by using button operations or voice commands. The speech information input receiving unit 50 of the user terminal 12-1 receives the input of the speech information from the manager.

[0062] In step S12, the utterance information transmitting unit 52 of the user terminal 12-1 transmits the utterance information that has been input to the server device 10. The utterance information receiving unit 30 of the server device 10 receives the utterance information from the utterance information transmitting unit 52 of the user terminal 12-1. The utterance information receiving unit 30 of the server device 10 adds the received utterance information as a record in the table of FIG. 10. In addition, the screen information generating unit 32 of the server device 10 generates screen information for the screen 1000 based on the information related to the event in the table of FIG. 10. In steps S14 to S18, the screen information transmitting unit 34 of the server device 10 transmits the screen information to the user terminals 12-1 to 12-3.

[0063] In steps S20 to S24, the screen information receiving units 54 of the user terminals 12-1 to 12-3 receive the screen information from the server device 10, and display the screen 1000 using the received screen information. Note that transmission of the screen information to the display devices 14-1 and 14-2 is omitted in Fig. 11. The display devices 14-1 and 14-2 that have received the screen information from the server device 10 display the screen 1000 using the received screen information.

[0064] In step S26, the leader inputs the speech information from the user terminal 12-3 by voice input or operation input. The leader specifies the speech type or notification destination of the input speech information by using a button operation or a voice command. The speech information input receiving unit 50 of the user terminal 12-3 receives the input of the speech information from the leader.

[0065] In step S28, the utterance information transmitting unit 52 of the user terminal 12-3 transmits the utterance information that has been input to the server device 10. The utterance information receiving unit 30 of the server device 10 receives the utterance information from the utterance information transmitting unit 52 of the user terminal 12-3. The utterance information receiving unit 30 of the server device 10 adds the received utterance information as a record in the table of FIG. 10. In addition, the screen information generating unit 32 of the server device 10 generates screen information for the screen 1000 based on the information related to the event in the table of FIG. 10. In steps S30 to S34, the screen information transmitting unit 34 of the server device 10 transmits the screen information to the user terminals 12-1 to 12-3.

[0066] In steps S36 to S40, the screen information receiving units 54 of the user terminals 12-1 to 12-3 receive the screen information from the server device 10, and display the screen 1000 using the received screen information. Note that transmission of the screen information to the display devices 14-1 and 14-2 is omitted in Fig. 11. The display devices 14-1 and 14-2 that have received the screen information from the server device 10 display the screen 1000 using the received screen information.

[0067] By performing processing of the sequence diagram shown in FIG. 11 during an event, a record is added to the table of FIG. 10 stored in the storage unit 40 of the server device 10, resulting in a table such as that shown in FIG.

[0068] Fig. 12 is a diagram showing an example of a table during an event in which information related to the event is stored. The information related to the event shown in Fig. 12 is added as a record of speech information input by a manager, a chief, or a leader to the user terminal 12 during the event. The item "date and time" of the record added during the event is information indicating the date and time when the manager, the chief, or the leader input the speech information.

[0069] As shown in FIG. 12, in the storage unit 40 of the server device 10, speech information input by the staff member carrying the user terminal 12 is added as a record in a table as the event progresses.

[0070] In the information processing system 1 according to this embodiment, during an event, the screen information generating unit 32 of the server device 10 generates screen information from information related to the event shown in Fig. 12 and transmits it in real time to the user terminal 12, the display device 14-1, and the display device 14-2. The user terminal 12, the display device 14-1, and the display device 14-2 that receive the screen information during the event can display, for example, a screen 1000 shown in Fig. 13 in real time.

[0071] Fig. 13 is an image diagram of an example of a screen on which speech information is displayed in association with a progress schedule during an event. A line 1014 displayed in a first display field 1002 in Fig. 13 represents the current time. In a second display field 1004 in Fig. 13, "Timeline" is selected from a pull-down selection field 1006.

[0072] When "Timeline" is selected from the pull-down selection field 1006, the second display field 1004 additionally displays speech information input by the staff before the start of the event and speech information input by the staff during the event in real time in speech bubbles 1012-10 to 1012-17. That is, the screen display units 56, 76, and 92 in the display devices 14-1 and 14-2 display speech information input by multiple users before the start of the event and during the event that proceeds according to the progress schedule on the screen. Also, the speech bubbles 1012-10 to 1012-17 in the second display field 1004 are displayed in real time in association with the time axis of the progress schedule. That is, the screen display units 56, 76, and 92 in the user terminal 12, display device 14-1, and display device 14-2 display speech information in real time in association with the time axis of the progress schedule.

[0073] The second display field 1004 displays a timeline near the time indicated by the line 1014 displayed in the first display field 1002. The second display field 1004 may display more speech information balloons 1012-10 to 1012-17 etc. in a reduced size to provide an overall bird's-eye view, or may display a timeline away from the time indicated by the line 1014 in a scrollable manner. The line 1014 displayed in the first display field 1002 may be information indicating the time period of the timeline displayed in the second display field 1004.

[0074] Therefore, the event staff can check the progress of the event by viewing the screen 1000 of Fig. 13. The event staff can easily check the progress of the event and understand the next action. The speech information balloons 1012-10 to 1012-17 displayed in the second display field 1004 may be displayed in different colors according to the type of speech, to visually differentiate different types of speech information.

[0075] In addition, in the second display field 1004 in Figure 13, the speech information entered by the user (the staff member associated with the user terminal 12 displaying the screen 1000 in Figure 13) is displayed on the right side, and the speech information entered by persons other than the user is displayed on the left side.

[0076] 13, a user can select "Shared Memo," "Personal Memo," or "Report / Trouble" from a pull-down selection field 1006 to selectively display a shared memo, personal memo, or report / trouble balloon in the second display field 1004 during an event. That is, the screen display units 56, 76, and 92 in the user terminal 12, display device 14-1, and display device 14-2 can selectively display speech information to be displayed in the second display field by type in accordance with an operation received from the user.

[0077] Returning to Fig. 5, the information processing system 1 according to this embodiment performs processing after the end of the event in step S14. The information processing system 1 according to this embodiment records the speech information input by the event staff before the start of the event and during the event as shown in the table of Fig. 12, so that even after the event ends, the speech information can be associated with the event progress schedule and displayed on the screen 1000. For example, even after the event ends, the information processing system 1 according to this embodiment can reproduce and display the timeline screen 1000 shown in Fig. 13.

[0078] For example, as shown in screen 1000 of Fig. 14, a manager can select "Report / Trouble" from pull-down selection field 1006 and selectively display report-related speech bubbles, such as troubles that occurred during the event, in second display field 1004. Fig. 14 is an image diagram of an example of a screen where Report / Trouble is selected and displayed. Screen 1000 of Fig. 14 can be used for creating reports after an event, sharing information about troubles that occurred during an event, and for business improvement, etc.

[0079] Also, for example, the chief can select "My Memo" from the pull-down selection field 1006 and select and display the My Memo balloon in the second display field 1004, as shown on screen 1000 in Fig. 15. Fig. 15 is an image diagram of an example of a screen on which the My Memo is selected and displayed. Screen 1000 in Fig. 15 can be used to check the contents of the My Memo after the event.

[0080] Therefore, the information processing system 1 according to the present embodiment can centrally manage everything from preparations for an event to progress during the event and post-event reports. Also, the information processing system 1 according to the present embodiment can support the progress of the event.

[0081] [Second embodiment] In the information processing system 1 of the first embodiment, a server device 10 provides a voice call function to a plurality of user terminals 12 and converts speech of a plurality of users into text. As shown in FIG. 16, an information processing system 2 of the second embodiment has a configuration in which a call system 16 is added to the information processing system 1 of FIG. 1. FIG. 16 is a configuration diagram of an example of the information processing system 2 according to this embodiment. Note that the second embodiment is similar to the first embodiment except for some parts, and therefore a description thereof will be omitted as appropriate.

[0082] The call system 16 provides a voice call function to a plurality of user terminals 12, and transmits speech information of a plurality of users to the server device 10. The call system 16 may use a voice call function provided by a company that provides a voice call service using an intercom or an information processing terminal.

[0083] For example, the server device 10 of the second embodiment may receive speech information including text-converted speech content from the call system 16, and add records to the tables shown in Figs. 10 and 12. In this case, the speech information receiving unit 30 of the server device 10 receives, as speech information, speeches of multiple users obtained by converting speeches of multiple users using the voice call function into text from the call system 16 that provides the voice call function to multiple user terminals 12. Also, for example, the server device 10 of the second embodiment may receive speech information including voice data of the speech content from the call system 16, convert the voice data of the speech content by the text conversion unit, and then add records to the tables shown in Figs. 10 and 12. In this case, the server device 10 has a text conversion unit 38 that converts speeches of multiple users using the voice call function received from the call system 16 that provides the voice call function to multiple user terminals 12 into text, and the speech information receiving unit 30 receives, as speech information, speeches of multiple users converted into text by the text conversion unit 38.

[0084] For example, a company or the like that has already introduced a voice call function provided by a company that provides a voice call service using an intercom or an information processing terminal already owns a user terminal 12. The information processing system 2 of the second embodiment may be realized in a configuration in which a server device 10, a display device 14-1, and a display device 14-2 are additionally provided to a company or the like that has already introduced a voice call function provided by a company that provides a voice call service using an intercom or an information processing terminal, and an application for the user terminal 12 is also provided.

[0085] According to the information processing system 1 of the second embodiment, by providing a server device 10, a display device 14-1, a display device 14-2, and an application for a user terminal 12 to a company or the like that has already introduced a voice call function, different types of speech information input by multiple users to the user terminal 12 can be displayed on the screen in association with a schedule of the event progress.

[0086] Each function of the above-described embodiments can be realized by one or more processing circuits. Here, the term "processing circuit" in this specification includes a processor programmed to execute each function by software, such as a processor implemented by an electronic circuit, and a device such as an ASIC (Application Specific Integrated Circuit), a DSP (digital signal processor), an FPGA (field programmable gate array), or a conventional circuit module designed to execute each function described above.

[0087] The group of devices described in the examples merely shows one of a number of computing environments for implementing the embodiments disclosed herein. The present invention is not limited to the present embodiment, and the components in the present embodiment include those that can be easily conceived by a person skilled in the art, those that are substantially the same, and those that are within the scope of what is called equivalent. Furthermore, various omissions, substitutions, modifications, and combinations of the components can be made without departing from the spirit of the present embodiment. [Explanation of symbols]

[0088] 1, 2 Information Processing System 10. Server device 12 User terminal 14-1, 14-2 Display device 16 Call System 18 Network 30 Speech information receiving unit 32 Screen information generation section 34 Screen information transmission unit 36 Call function unit 38 Text conversion section 40 Storage section 50 Speech information input reception unit 52 Speech information transmission unit 54 Screen information receiving unit 56 Screen display section 58 Audio transmission / reception section 70 Operation reception section 72 Information Transmission Unit 74, 90 Screen information receiving unit 76, 92 Screen display section 1000 screens 1002 First display column 1004 Second display column 1012 Speech bubble [Prior art documents] [Patent documents]

[0089] [Patent Document 1] JP 2000-029941 A

Claims

1. An information processing system including a plurality of user terminals and a server device that records speech information input to the plurality of user terminals from a plurality of users who share information, The server device includes: an utterance information receiving unit that receives different types of utterance information input from the plurality of users to the plurality of user terminals; a screen information transmitting unit that transmits screen information of a screen that displays the different types of speech information in association with a progress schedule to the plurality of user terminals; having The user terminal includes: a screen information receiving unit that receives the screen information from the server device; a screen display unit that uses the received screen information to display the different types of speech information on a screen in association with the progress schedule; An information processing system having the above configuration.

2. The different types of speech information include the speech information that specifies the user who will share information, the speech information that will be shared among all the users, the speech information that each of the users will use personally, and the speech information related to reports.

2. The information processing system according to claim 1.

3. the screen display unit displays the screen including a first display field of the progress schedule and a second display field that displays the speech information in association with a time axis of the progress schedule; The second display section displays the different types of speech information in a visually different manner.

3. The information processing system according to claim 2.

4. The screen display unit selectively displays the speech information to be displayed in the second display field for each of the types in accordance with an operation received from the user.

4. The information processing system according to claim 3.

5. The server device includes: a call function unit that provides a voice call function to the plurality of user terminals; a text conversion unit that converts speech of the plurality of users who use the voice call function into text; and The speech information receiving unit receives the text-converted utterances of the plurality of users as the speech information.

5. An information processing system according to claim 1.

6. The speech information receiving unit receives, from a call system that provides a voice call function to the plurality of user terminals, utterances of the plurality of users that use the voice call function, converted into text, as the utterance information.

5. An information processing system according to claim 1.

7. The server device includes: A text conversion unit converts speech of the plurality of users using the voice call function received from a call system that provides a voice call function to the plurality of user terminals into text, The speech information receiving unit receives, as the speech information, the utterances of the plurality of users that have been converted into text by the text conversion unit.

5. An information processing system according to claim 1.

8. The screen display unit displays the speech information in real time in association with the timeline of the schedule.

5. An information processing system according to claim 1.

9. a display device that displays the speech information on a screen in association with the schedule; The information processing system according to claim 1 , further comprising:

10. The user terminal accepts input of the speech information by voice input or operation input.

5. An information processing system according to claim 1.

11. The screen display unit displays, on the screen, the speech information input by the plurality of users before and during the event that proceeds according to the schedule.

5. An information processing system according to claim 1.

12. An information processing method performed by an information processing system including a plurality of user terminals and a server device that records speech information input to the plurality of user terminals from a plurality of users who share information, comprising: a speech information receiving step in which the server device receives different types of speech information input from the plurality of users to the plurality of user terminals; a screen information transmission step in which the server device transmits screen information of a screen that displays the different types of speech information in association with a progress schedule to the plurality of user terminals; a screen information receiving step in which the user terminal receives the screen information from the server device; a screen display step of the user terminal displaying the different types of speech information on a screen in association with the progress schedule by using the received screen information; An information processing method comprising the steps of:

13. A server device that communicates with a plurality of user terminals via a network and records speech information input to the plurality of user terminals from a plurality of users who share information, an utterance information receiving unit that receives different types of utterance information input from the plurality of users to the plurality of user terminals; a screen information transmitting unit that transmits screen information of a screen that displays the different types of speech information in association with a progress schedule to the plurality of user terminals; A server device having the above configuration.

14. A server device that communicates with a plurality of user terminals via a network and records speech information input to the plurality of user terminals from a plurality of users who share information, a speech information receiving step of receiving different types of speech information input from the plurality of users to the plurality of user terminals; a screen information transmission step of transmitting screen information of a screen displaying the different types of speech information in association with a progress schedule to the plurality of user terminals; A program that executes the following.

Images