Information processing device, information processing system, information processing method, and program
The system addresses the challenge of monitoring user participation in video distribution by setting audio and image-based start conditions for secondary content display, enabling better engagement analysis.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- RICOH CO LTD
- Filing Date
- 2022-07-29
- Publication Date
- 2026-07-07
AI Technical Summary
In video distribution systems like webinars, it is difficult for organizers to grasp the participation status of users, such as whether they are watching, concentrating, or identifying points of interest, due to the one-way information processing nature where participants do not transmit video and audio back to the organizer.
An information processing system that includes setting start conditions for displaying secondary content on user terminals, receiving operation content from users, and generating screen data to display participation status, utilizing audio or image cues to determine when to start displaying the secondary content.
This system makes it easier for organizers to understand user participation status by analyzing user interactions, such as question responses and engagement, providing insights into user engagement levels.
Smart Images

Figure 0007885618000001 
Figure 0007885618000002 
Figure 0007885618000003
Abstract
Description
Technical Field
[0001] The present invention relates to an information processing apparatus, an information processing system, an information processing method, and a program.
Background Art
[0002] In recent years, video distribution such as webinars using Internet lines has become widespread. In video distribution such as webinars, a one-way information processing system is used in which participants view the video (streaming) distributed by the organizer and do not transmit the video and audio on the participant side to the organizer side.
[0003] For example, Patent Document 1 discloses a technique for distributing a video recording a lecture at a learning school or the like and allowing students to take the lecture by viewing the video.
Summary of the Invention
Problems to be Solved by the Invention
[0004] In video distribution such as webinars, since participants view the video distributed by the organizer and do not transmit the video and audio on the participant side to the organizer side, it is difficult for the organizer to grasp the participation status of users such as participants (for example, whether they are really watching, concentrating, or points of interest) compared to an event held by gathering at a venue. Such problems are not limited to webinars, but also exist in the same way in various content distribution services provided by organizers such as live broadcasts and other events. Note that Patent Document 1 evaluates the degree of concentration of users on video viewing and does not solve the above-described problems.
[0005] One embodiment of the present invention has been made in view of the above problems, and an object thereof is to make it easier to grasp the participation status of a user displaying the distributed content.
Means for Solving the Problems
[0006] One embodiment of the present invention includes: setting receiving means for receiving the setting of start condition information to start displaying second content on a first user terminal that is displaying the first content that has been delivered; operation content receiving means for receiving operation content for the second content received from the user of the first user terminal that displays the second content based on the start condition information; and screen data generating means for generating screen data that displays the user's participation status based on the operation content and displaying it on the second user terminal. Furthermore, the start condition information is characterized in that the timing for starting the display of the second content is set by the audio played or the image displayed by the first content. It is an information processing device. [Effects of the Invention]
[0007] This makes it easier to understand the participation status of users who are viewing the distributed content. [Brief explanation of the drawing]
[0008] [Figure 1] This is a diagram illustrating an example of an information processing system according to this embodiment. [Figure 2] This is a hardware configuration diagram of an example of a computer according to this embodiment. [Figure 3] This is a functional configuration diagram of an example of an information processing system according to this embodiment. [Figure 4] This is a sequence diagram of an example of the processing procedure of the information processing system according to this embodiment. [Figure 5] This is a sequence diagram of an example of the processing procedure of the information processing system according to this embodiment. [Figure 6] This is a sequence diagram of an example of the processing procedure of the information processing system according to this embodiment. [Figure 7] This is a sequence diagram of an example of the processing procedure of the information processing system according to this embodiment. [Figure 8] This is an example image of the question list screen. [Figure 9] This is an example image of a question registration screen. [Figure 10] This is an example image of a question registration screen. [Figure 11] It is an image diagram of an example of a screen for specifying a person to be questioned. [Figure 12] It is a configuration diagram of an example of question information. [Figure 13] It is a flowchart of an example of the process in step S23. [Figure 14] It is a flowchart of an example of the process in step S23. [Figure 15] It is a flowchart of an example of the process in step S24. [Figure 16] It is a configuration diagram of an example of user attribute information. [Figure 17] It is an image diagram of an example of the participant screen displayed on the participant terminal. [Figure 18] It is a configuration diagram of an example of answer information. [Figure 19] It is an image diagram of an example of the question answer status screen displayed on the administrator terminal. [Figure 20] It is a sequence diagram of an example of the processing procedure of the information processing system according to the present embodiment. [Figure 21] It is an image diagram of an example of the question registration screen.
Mode for Carrying Out the Invention
[0009] Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. [First Embodiment] [System Configuration] FIG. 1 is a configuration diagram of an example of the information processing system according to the present embodiment. The information processing system 1 according to the present embodiment has a configuration in which a service providing system 10, a participant terminal 14, and an administrator terminal 15 are communicably connected via a network 18 such as the Internet or a LAN (Local Area Network).
[0010] The service providing system 10 provides a service for supporting the holding of an event such as a webinar as described below. The service providing system 10 in FIG. 1 includes an information processing apparatus 11 that provides a content providing service, and an information processing apparatus 12 that provides an event support service.
[0011] The participant terminal 14 is a user terminal (an example of a first user terminal) operated by a participant who participates in the event. Also, a participant who participates in the event is an example of a user of the first user terminal. The participant terminal 14 displays a video (an example of a first content) distributed from the information processing apparatus 11 that provides the content providing service. The information processing apparatus 11 that provides the content providing service may distribute a still image. In the present embodiment, an example in which a video is distributed will be described.
[0012] Further, the participant terminal 14 displays a question screen (an example of a second content) distributed from the information processing apparatus 12 that provides the event support service. The participant terminal 14 is equipped with a web browser or an application that displays the distributed video and question screen.
[0013] The participant watches the video displayed on the participant terminal 14 and participates in the event. Also, when a question screen is displayed on the participant terminal 14, the participant performs an operation on the question screen as described below. The participant terminal 14 that receives an operation on the question screen from the participant transmits the operation content on the question screen to the information processing apparatus 12 that provides the event support service.
[0014] Participant terminals 14 include notebook PCs (Personal Computers), desktop PCs, smartphones, tablet devices, mobile phones, or PDAs. Participant terminals 14 may also include printers, scanners, fax machines, multifunction peripherals (MFPs), projectors, display devices with electronic whiteboard functionality, digital signage output devices, HUD (Head-Up Display) devices, industrial machinery, imaging devices, sound collection devices, medical equipment, networked home appliances, automobiles (Connected Cars), game consoles, etc.
[0015] The administrator terminal 15 is a user terminal (an example of a second user terminal) operated by an administrator such as the event organizer. The administrator is also an example of a user of the second user terminal. The administrator terminal 15 receives settings from the administrator, including the content of the questions to be displayed on the question screen and information on the start conditions (start condition information) for starting the display of the question screen on the participant terminal 14, and transmits this information to the information processing device 12 that provides event support services.
[0016] The administrator terminal 15 may be a notebook PC, desktop PC, smartphone, tablet, mobile phone, or PDA. Alternatively, the administrator terminal 15 may be a printer, scanner, fax machine, multifunction device, projector, display device with electronic whiteboard functionality, digital signage or other output device, HUD device, industrial machinery, imaging device, sound collection device, medical equipment, networked home appliance, automobile, game console, etc.
[0017] The information processing device 11, which provides content delivery services, distributes videos to the participant terminals 14. The information processing device 12, which provides event support services, receives and stores from the administrator terminal 15 the content of the questions to be displayed on the question screen and the start condition information for starting the display of the question screen on the participant terminals 14.
[0018] The information processing device 12, which provides event support services, starts displaying the question screen to the participant terminal 14 when the participant terminal 14, which is currently viewing a video distributed from the information processing device 11 that provides content services (participating in the event), meets the start conditions. The information processing device 12, which provides event support services, receives the operation content of the question screen received from the participant terminal 14.
[0019] The information processing device 12, which provides event support services, generates data for a screen described later that displays the participant's participation status (for example, whether they are actually watching, whether they are paying attention, or what points they found interesting) based on the participant's actions on the question screen received from the participant terminal 14, and displays this data on the administrator terminal 15.
[0020] Note that the configuration of the information processing system 1 shown in Figure 1 is just one example. The service provision system 10 in Figure 1 may be implemented using a single computer or multiple computers, or it may be implemented using a cloud service. Also, there may be one or more participant terminals 14 and administrator terminals 15.
[0021] <Hardware Configuration> "computer" The information processing device 11, information processing device 12, participant terminal 14, and administrator terminal 15 shown in Figure 1 are implemented by, for example, a computer 500 with the hardware configuration shown in Figure 2. Figure 2 is a hardware configuration diagram of an example of a computer according to this embodiment.
[0022] Computer 500 is equipped with a CPU (Central Processing Unit) 501, ROM (Read Only Memory) 502, RAM (Random Access Memory) 503, HD 504, HDD (Hard Disk Drive) controller 505, display 506, external device connection I / F (Interface) 508, network I / F 509, data bus 510, keyboard 511, pointing device 512, DVD-RW (Digital Versatile Disk Rewritable) drive 514, and media I / F 516.
[0023] Of these components, the CPU 501 controls the operation of the entire computer 500 according to the program. The ROM 502 stores programs used to drive the CPU 501, such as the IPL. The RAM 503 is used as the work area for the CPU 501. The HD 504 stores various data, such as programs. The HDD controller 505 controls the reading or writing of various data to the HD 504 according to the control of the CPU 501.
[0024] The display 506 displays various information such as cursors, menus, windows, characters, or images. The external device connection interface 508 is an interface for connecting various external devices. In this case, external devices include, for example, USB (Universal Serial Bus) memory. The network interface 509 is an interface for data communication using the network 18. The data bus 510 is an address bus, data bus, etc., for electrically connecting various components such as the CPU 501.
[0025] The keyboard 511 is a type of input means equipped with multiple keys for inputting characters, numbers, and various instructions. The pointing device 512 is a type of input means for selecting and executing various instructions, selecting processing targets, and moving the cursor. The DVD-RW drive 514 controls the reading or writing of various data to the DVD-RW 513, which is an example of a removable recording medium. Note that it is not limited to DVD-RW, but may also be DVD-R, etc. The media interface 516 controls the reading or writing (storage) of data to the recording medium 515, such as flash memory.
[0026] Note that the hardware configuration shown in Figure 2 is just one example, and it is not necessary to include all of the components shown in Figure 2, or to include components other than those shown in Figure 2.
[0027] <Functional Configuration> Figure 3 is a functional configuration diagram of an example of an information processing system according to this embodiment. Note that components unnecessary for the explanation of this embodiment have been appropriately omitted from the functional configuration diagram in Figure 3.
[0028] The service provision system 10 realizes the functional configuration shown in Figure 3 by executing an OS (Operating System) and programs on, for example, the information processing devices 11 and 12 shown in Figure 1.
[0029] The service provision system 10 in Figure 3 includes a content provision unit 30, a content data storage unit 32, a setting reception unit 34, a question information storage unit 36, a judgment unit 38, a question display control unit 40, an operation content reception unit 42, an answer information storage unit 44, a screen data generation unit 46, a screen data transmission unit 48, and a user attribute information storage unit 50.
[0030] Furthermore, participant terminal 14 implements the functional configuration shown in Figure 3 by executing the OS and programs. Participant terminal 14 has an input unit 60 and an output unit 62. In addition, administrator terminal 15 implements the functional configuration shown in Figure 3 by executing the OS and programs. Administrator terminal 15 has an input unit 80 and an output unit 82.
[0031] The content delivery unit 30 distributes videos to the participant terminals 14. The content data storage unit 32 stores the video data to be distributed to the participant terminals 14. The setting reception unit 34 receives settings from the administrator operating the administrator terminal 15, including the content of the questions to be displayed on the question screen and the start condition information to start displaying the question screen on the participant terminals 14. The content of the questions to be displayed on the question screen and the start condition information to start displaying the question screen on the participant terminals 14, as set by the administrator operating the administrator terminal 15, are stored in the question information storage unit 36.
[0032] The determination unit 38 determines whether the participant terminal 14, which is displaying the distributed video, meets the start conditions. The question display control unit 40 starts displaying the question screen to the participant terminal 14 that meets the start conditions. The operation content receiving unit 42 receives the operation content for the question screen received from the participant operating the participant terminal 14. The answer information storage unit 44 stores the answer information, as described below, based on the operation content received from the participant.
[0033] The screen data generation unit 46 generates data for the question response status screen, which will be described later, displaying the participation status of participants currently participating in the event, based on the operations received from the participants. The screen data transmission unit 48 transmits the question response status screen data to the administrator terminal 15, causing the question response status screen, described later, to be displayed on the administrator terminal 15. The user attribute information storage unit 50 stores the user attribute information, described later.
[0034] The input unit 60 of the participant terminal 14 receives operations from the participant, such as displaying the participant screen described later and inputting answers to the question screen. The output unit 62 displays the participant screen and the question screen, etc., as described later.
[0035] The input unit 80 of the administrator terminal 15 receives operations from the administrator to display the question registration screen, the question target selection screen, and the question response status screen, as described later. The input unit 80 also receives operations from the administrator to input information on the question registration screen, the question target selection screen, and the question response status screen, as described later. The output unit 82 displays the question registration screen, the question target selection screen, and the question response status screen, as described later.
[0036] Although Figure 3 shows an example where the service provision system 10 has a decision unit 38, the decision program may be transmitted to the participant terminal 14 so that the functions of the decision unit 38 are implemented on the participant terminal 14.
[0037] <Processing> Figures 4 to 7 are sequence diagrams of an example of the processing procedure of the information processing system according to this embodiment. In step S10, the administrator operates the administrator terminal 15 to display screens such as the question list screen 1000 shown in Figure 8, the question registration screen 1100 shown in Figures 9 and 10, and the question target person specification screen 1200 shown in Figure 11.
[0038] Figure 8 is an illustrative image of an example of the question list screen. Figure 9 is an illustrative image of an example of the question registration screen. Figure 10 is an illustrative image of an example of the question registration screen. Figure 11 is an illustrative image of an example of the question targeter selection screen.
[0039] The question list screen 1000 in Figure 8 displays a list of manual questions that the administrator can start manually during the event, and a list of automatic questions that are started automatically during the event according to the start condition information. The administrator can display the question registration screen 1100 in Figure 9 or Figure 10 by pressing the "Add New Question" button 1002 on the question list screen 1000 displayed on the administrator terminal 15.
[0040] The administrator can switch between displaying the question registration screen 1100 in Figure 9, which is used to register manual questions, and the question registration screen 1100 in Figure 10, which is used to register automatic questions, by operating the question type selection field 1102 on the question registration screen 1100 in Figures 9 and 10.
[0041] Administrators can register manual questions by entering the question title and answer choices on the question registration screen 1100 in Figure 9 and pressing the registration button. Administrators can also register automated questions from the question registration screen 1100 in Figure 10. For example, from the question registration screen 1100 in Figure 10, administrators can register the content of the question to be generated on the question screen of an automated question, the display period information for that automated question, and the start condition information for starting the display of the question screen of that automated question.
[0042] The question title, answer format, and comment input registered on the question registration screen 1100 are examples of question content. The display period registered on the question registration screen 1100 is an example of display period information representing the time from the start to the end of the display of the automated question. The question start conditions and target audience registered on the question registration screen 1100 are examples of start condition information that starts the display of the automated question screen.
[0043] The administrator can switch between displaying the question start condition registration field 1104 on the question registration screen 1100, showing the field for registering the question start condition for periodic start and the field for registering the question start condition for content reference. Figure 10 shows an example where the display field 1106 for registering the question start condition for content reference is displayed. An example where the display field for registering the question start condition for periodic start is displayed will be described later.
[0044] The display field 1106 for registering the start conditions for content reference questions in Figure 10 is a field for administrators to register the start conditions for displaying the question screen. The display field 1106 for registering the start conditions for content reference questions shows an example where the administrator registers keywords so that the start conditions for displaying the question screen are determined by audio played on the participant terminal 14 depending on the content.
[0045] Furthermore, the display field 1106 for registering the start conditions for content reference questions shows an example in which the administrator registers at least one of a keyword and a condition image so that the start conditions for displaying the question screen are determined by the video (image) displayed on the participant terminal 14 depending on the content.
[0046] Furthermore, by pressing the "Specify target audience" button 1108 on the question registration screen 1100, the administrator can display the target audience selection screen 1200 shown in Figure 11. By operating the target audience selection screen 1200 shown in Figure 11, the administrator can set conditions for specifying the target audience.
[0047] For example, in the participant selection screen 1200 shown in Figure 11, by manipulating field 1202, it is possible to switch between specifying participants based on their attributes and specifying them based on their answers to the questions. The participant selection screen 1200 in Figure 11 is an example where three conditions have been registered, and participants who meet all three conditions are specified as participants.
[0048] Returning to step S10 in Figure 4, the administrator operates the administrator terminal 15 and inputs the content of the questions to be generated on the question screen of the automated questions, the display period information for displaying those automated questions, and the start condition information for starting the display of the question screen of the automated questions, and requests registration. In step S12, the administrator terminal 15 transmits the content of the questions to be generated on the question screen of the automated questions, the display period information for displaying those automated questions, and the start condition information for starting the display of the question screen of the automated questions, which were entered by the administrator, to the information processing device 12 that provides event support services.
[0049] In step S13, the information processing device 12 that provides event support services saves the content of the questions generated on the question screen of the automated questions received from the administrator terminal 15, the display period information for displaying the automated questions, and the start condition information for starting the display of the question screen of the automated questions, for example, as question information as shown in Figure 12.
[0050] Figure 12 is a diagram illustrating an example of question information. For example, the question information for question ID "0006" in Figure 12 is an example of question information where the question start condition for content reference is registered as the item "Start Condition".
[0051] In step S14-1, the participant performs an operation on the participant terminal 14 to open the participant screen. In step S14-2, the participant terminal 14 requests participant screen data from the information processing device 12 that provides event support services. In step S14-3, the information processing device 12 that provides event support services sends the participant screen data to the participant terminal 14. In step S15, the participant terminal 14 displays the participant screen. In step S16, the information processing device 11 that provides content provision services sends a video (content) to the participant terminal 14 that displays the participant screen and plays it. The participant views the video displayed on the participant terminal 14. In step S17, the information processing device 12 that provides event support services obtains the question start condition from the question information item "Start Condition" in Figure 12.
[0052] Note that the execution order of steps S14 to S17 is not limited to the order shown in the sequence diagram in Figure 4; any of the processes may be executed first, or they may be executed simultaneously.
[0053] If a keyword is registered in the display field 1106 for registering the start conditions of a question for content reference on the question registration screen 1100 in Figure 10, to be judged by voice, the information processing device 12 that provides event support services requests the information processing device 11 that provides content provision services to transfer the question screen in step S18. The information processing device 11 that provides content provision services transfers the data of the question screen to the information processing device 12 that provides event support services in step S19.
[0054] Furthermore, if at least one of a keyword and a conditional image is registered in the display field 1106 for registering the content reference question start conditions on the question registration screen 1100 in Figure 10 so that the user makes a decision based on a video (image), the information processing device 12 that provides event support services performs the process in step S20. In step S20, the information processing device 12 that provides event support services sends the decision program, at least one of the keyword and the conditional image, and a similarity threshold to the participant terminal 14. In step S21, the participant terminal 14 executes the decision program.
[0055] The sequence diagram in Figure 5 shows an example in which the information processing device 12 providing event support services makes an audio judgment as to whether or not the question start conditions are met, and the participant terminal 14 makes a video (image) judgment as to whether or not the question start conditions are met, but the system is not limited to this example.
[0056] The decision of whether or not the conditions for starting a question are met, based on both audio and video (image) data, may be made by the information processing device 12 providing the event support service, or by the participant terminal 14. Alternatively, the decision of whether or not the conditions for starting a question are met, based on audio data, may be made by the participant terminal 14, while the decision of whether or not the conditions for starting a question are met, based on video (image) data, may be made by the information processing device 12 providing the event support service.
[0057] The processes in steps S23 to S28 are repeated until the end of the event. In step S23, the information processing device 12 or the participant terminal 14 that provides event support services determines whether the video displayed on the participant's screen satisfies the question start conditions acquired in step S17. Details of the process in step S23 will be described later.
[0058] If the information processing device 12 providing event support services determines that the video displayed on the participant's screen satisfies the question start conditions acquired in step S17, and furthermore, if the question start conditions specify a target participant, the information processing device 12 identifies the participant who will be the target participant in step S24. Details of the process in step S24 will be described later.
[0059] If the question start conditions specify a target audience, the participant terminal 14 of the participant identified as the target audience will be the one to display the question screen. If the question start conditions do not specify a target audience, the participant terminal 14 of any participant participating in the event will be the one to display the question screen.
[0060] In step S25, the information processing device 12 providing event support services starts displaying the question screen on the participant terminal 14. In step S26, the participant operating the participant terminal 14 enters their answers to the questions displayed on the question screen. The question screen may ask for responses to a vote or survey, or it may ask for an evaluation of the event.
[0061] In step S27, the participant terminal 14 transmits the information processing device 12, which provides event support services, the details of the participant's actions on the question screen. The information of the participant's actions on the question screen includes not only the answer to the question displayed on the question screen, but also the elapsed time from when the question screen was displayed until the participant entered their answer, and whether or not the participant performed any actions on the question screen.
[0062] In step S28, the information processing device 12 that provides event support services stores the response information described below based on the operation content of the question screen received from the participant on the participant terminal 14.
[0063] The processing from step S29 onward is performed, for example, after the event has ended. However, the processing from step S29 onward may also be performed during the event. In step S29, the administrator performs an operation on the administrator terminal 15 to open the question response status screen, which will be described later. In step S30, the administrator terminal 15 requests the data for the question response status screen from the information processing device 12 that provides event support services.
[0064] In step S31, the information processing device 12 that provides event support services generates data for the question answer status screen. In step S32, the information processing device 12 that provides event support services responds to the administrator terminal 15 with data for the question answer information screen. In step S33, the administrator terminal 15 displays the question answer information screen for the administrator to view.
[0065] If a keyword is registered in the display field 1106 for registering the start conditions of a question for content reference on the question registration screen 1100 in Figure 10, the information processing device 12 that provides event support services performs the process of step S23 in Figure 6, for example, as shown in Figure 13.
[0066] Figure 13 is a flowchart of an example of the process in step S23. In step S50, the information processing device 12 that provides event support services acquires audio data of the video being displayed on the participant screen by the participant terminal 14. In step S52, the information processing device 12 that provides event support services transmits the audio data to the speech recognition service. The speech recognition service may be provided in the service provision system 10, or it may be provided in another information processing device that is available via the network 18.
[0067] In step S54, the information processing device 12 that provides event support services receives the text of the speech recognition result from the speech recognition service. In step S56, the information processing device 12 that provides event support services determines whether the keyword registered to be judged by voice in the display field 1106 for registering the question start conditions for content reference on the question registration screen 1100 in Figure 10 is included in the text of the speech recognition result.
[0068] If the registered keyword is included in the text of the speech recognition result, the information processing device 12 providing the event support service determines in step S58 that the video displayed on the participant screen satisfies the question start condition. If the registered keyword is not included in the text of the speech recognition result, the information processing device 12 providing the event support service determines in step S60 that the video displayed on the participant screen does not satisfy the question start condition.
[0069] Furthermore, if keywords and conditional images are registered in the display field 1106 for registering the question start conditions for content reference on the question registration screen 1100 in Figure 10, so that the participant can make a decision based on the video (image), the participant terminal 14 performs the process of step S23 in Figure 6, for example, as shown in Figure 14.
[0070] Figure 14 is a flowchart of an example of the process in step S23. In step S70, the participant terminal 14 acquires image data of the video displayed on the participant's screen. In step S72, the participant terminal 14 uses technologies such as OCR (Optical Character Recognition / Reader) to recognize the text portion of the image data and extract keywords contained in the image.
[0071] In step S74, the participant terminal 14 determines whether the keywords registered to be judged by video (image) in the display field 1106 for registering the question start conditions for content reference on the question registration screen 1100 in Figure 10 are included in the keywords extracted in step S72.
[0072] If the registered keyword is included in the keywords extracted in step S72, the participant terminal 14 notifies the information processing device 12 providing event support services in step S82 that the video currently displayed on the participant screen satisfies the question start conditions. If the registered keyword is not included in the keywords extracted in step S72, the participant terminal 14 performs the process in step S76.
[0073] In step S76, the participant terminal 14 calculates the similarity between the image acquired in step S70 and the condition image registered in the display field 1106 for registering the content reference question start conditions on the question registration screen 1100 in Figure 10, which is to be judged by video (image).
[0074] In step S78, the participant terminal 14 determines whether the similarity calculated in step S76 is equal to or greater than a threshold. If the similarity calculated in step S76 is equal to or greater than a threshold, the participant terminal 14 notifies the information processing device 12, which provides event support services, in step S82 that the video currently displayed on the participant screen satisfies the question start conditions.
[0075] If the similarity calculated in step S76 is not equal to or greater than the threshold, the participant terminal 14 notifies the information processing device 12, which provides event support services, in step S80 that the video currently displayed on the participant screen does not meet the question start conditions.
[0076] The process in step S24 of Figure 6 is carried out as shown in Figure 15, for example. Figure 15 is a flowchart of an example of the process in step S24. In step S90, the information processing device 12 that provides event support services determines whether the condition to specify the question target from participant attributes has been selected. If the condition to specify the question target from participant attributes has not been selected, the information processing device 12 that provides event support services skips the processes in steps S92 to S94.
[0077] If the condition to specify the target of the question based on participant attributes is selected, the information processing device 12 that provides event support services performs the processing in steps S92 to S94. In step S92, the information processing device 12 that provides event support services obtains the attribute values of the specified participant attributes from, for example, the user attribute information shown in Figure 16, which shows the information of each participant.
[0078] Figure 16 is a diagram illustrating an example of user attribute information. The user attribute information in Figure 16 includes items such as user ID (identification information), gender, age group, and occupation. In step S94, the information processing device 12, which provides event support services, identifies participants whose attribute values match, for example, from the user attribute information in Figure 16. Participants whose attribute values match, as identified in step S94, become the subjects of the survey.
[0079] In step S96, the information processing device 12 that provides event support services determines whether the condition to specify the target of the question based on the answer to the question has been selected. If the condition to specify the target of the question based on the answer to the question has not been selected, the information processing device 12 that provides event support services skips the process in step S98.
[0080] If the condition to specify the target of the question based on the answer to the question is selected, the information processing device 12 that provides event support services performs the process in step S98. In step S98, the information processing device 12 that provides event support services identifies the participant who answered the specified question as the target of the question.
[0081] Figure 17 is an illustrative diagram of an example of a participant screen displayed on a participant's terminal. The participant screen 1300 in Figure 17 has a display area 1302 that displays a video (an example of the first content) distributed from the information processing device 11 that provides content provision services. The participant screen 1300 in Figure 17 also has a display area 1304 that displays a question screen (an example of the second content) distributed from the information processing device 12 that provides event support services.
[0082] When the conditions for starting a question are met, the question screen is displayed in the display area 1304 of the participant screen 1300 displayed on the participant terminal 14. Participants can input their answers to the question screen displayed on the participant screen 1300 of the participant terminal 14. For example, the question screen displayed in the display area 1304 in Figure 17 is an example of a screen that accepts some kind of evaluation from participants, such as an evaluation of the event, as an answer. Participants can input their answers to the questions displayed on the question screen. The participant terminal 14 transmits the operation content of the question screen received from the participant to the information processing device 12 that provides event support services. Note that the question screen displayed in the display area 1304 in Figure 17 will automatically stop being displayed after the display period registered in the question registration screen 1100 has elapsed. Since the question screen displayed in the display area 1304 in Figure 17 will automatically stop being displayed after the display period has elapsed, if the participant terminal 14 is not viewing the participant screen 1300, it will not be possible to answer the questions displayed on the question screen, which is expected to improve participation.
[0083] The information processing device 12, which provides event support services, stores the operation content of the question screen received from the participant terminal 14 by the participant, for example, as shown in the answer information in Figure 18. Figure 18 is a diagram illustrating an example of the answer information configuration.
[0084] The response information in Figure 18 includes the following items: Question ID, Question display start date and time, Question display end date and time, Response acceptance start date and time, Response acceptance end date and time, Response result display start date and time, Response result display end date and time, Response result pattern for each question, Response rate, Participant ID (identification information), Response date and time, Time taken to respond, Response result pattern for each participant, and Response result options.
[0085] Based on the response information in Figure 18, the information processing device 12 providing event support services can obtain the elapsed time from when the question screen is displayed on the participant screen 1300 on the participant terminal 14 until each participant enters their answer. In addition, the information processing device 12 providing event support services can obtain information on whether or not each participant has performed any actions on the question screen displayed on the participant screen 1300 on the participant terminal 14.
[0086] Furthermore, the information processing device 12, which provides event support services, can obtain answers to questions displayed on the question screen of the participant screen 1300 for each participant on the participant terminal 14, so that it is possible to select conditions for specifying the target of the questions based on the answers to the questions.
[0087] The information processing device 12, which provides event support services, can use the response information in Figure 18 to generate data for a question response status screen 1400, such as the one shown in Figure 19, and display the question response status screen 1400 on the administrator terminal 15.
[0088] Figure 19 is an illustrative image of an example of a question response status screen displayed on the administrator terminal. The upper part of the question response status screen 1400 in Figure 19 shows a graph for each question, showing the period during which responses were accepted and the period from when the participant was able to input a response until the participant actually entered the response. The participants to be included in the graph display can be selected from the participant selection pull-down menu.
[0089] In the upper graph of Figure 19, the white horizontal bars represent the period during which responses to the questions were accepted. The black horizontal bars in the upper graph of Figure 19 represent the period from when it became possible to input responses to when participants actually entered their responses.
[0090] For example, in Figure 19, the black horizontal bar for "Question 3" is not displayed, indicating that the participant included in the graph did not answer "Question 3". Conversely, the black horizontal bars for questions other than "Question 3" are displayed, indicating that the participant included in the graph answered questions other than "Question 3". In addition, the black horizontal bars in the upper graph of Figure 19 represent the time from when it becomes possible to input an answer to when a participant actually inputs an answer, and can therefore be said to represent the response speed of the participants to the questions.
[0091] Furthermore, the lower part of the question response status screen 1400 in Figure 19 displays a graph showing the connection time of the participant terminal 14 for the participant selected for the graph display, the response submission time for each question, and the response rate. In the lower part of the graph in Figure 19, the connection time of the participant terminal 14 for the participant selected for the graph display is represented by a white horizontal bar. For example, in Figure 19, the white horizontal bars are displayed consecutively, indicating that the participant terminal 14 was continuously connected to the event.
[0092] Furthermore, in the lower graph of Figure 19, the white triangles indicate the submission time of each participant's response to each question. For example, in Figure 19, the participant included in the graph did not submit a response to "Question 3," and as shown in the dotted area 1402, no white triangle is displayed. In addition, the lower graph of Figure 19 shows the response rate for each question for the participants included in the graph, along with the participant's response speed to the questions. The dotted area 1402 indicates that the participant did not submit a response to "Question 3" during the period when responses were being accepted.
[0093] From the question response status screen 1400 in Figure 19, the administrator can check whether the user kept their participant terminal 14 connected to the service provision system 10 from the beginning to the end of the event, whether they answered all questions, and whether the response speed to the questions was consistent.
[0094] By viewing the question response status screen 1400 in Figure 19, administrators can more easily understand the level of participant engagement in the event, such as whether participants were actually watching and whether they were watching attentively.
[0095] According to this embodiment, the start condition information for initiating the display of the question screen can be set in advance, eliminating the need for operations to display the question screen during the event, and making it easier for administrators to communicate with participants.
[0096] Furthermore, according to this embodiment, since the answer to the question can be specified as a condition for designating the target audience, it becomes possible to ask questions that target a specific group of people, making it easier to ask questions that reveal what interests the participants. [Second Embodiment] In the first embodiment, an example was described in which a question start condition for content referencing is registered by operating the question start condition selection field 1104 on the question registration screen 1100 in Figure 10. The second embodiment is an example in which a question start condition for periodic start is registered by operating the question start condition selection field 1104 on the question registration screen 1100 in Figure 10. Note that the second embodiment has some overlap with the first embodiment, so some explanations will be omitted as appropriate.
[0097] In the second embodiment, the process in step S22 of Figure 20 is performed instead of steps S18 to S20 in Figure 5. Figure 20 is a sequence diagram of an example of the processing procedure of the information processing system according to this embodiment. Figure 21 is an image diagram of an example of a question registration screen.
[0098] Administrators can register automated questions from the question registration screen 1100 in Figure 21. For example, administrators can register the content of the questions to be generated on the automated question screen, the display period information for displaying those automated questions, and the start condition information for starting the display of the automated question screen from the question registration screen 1100 in Figure 21.
[0099] The question title, answer format, and comment input registered on the question registration screen 1100 are examples of question content. The display period registered on the question registration screen 1100 is an example of display period information representing the time from the start to the end of the display of the automated question. The question start conditions and target audience registered on the question registration screen 1100 are examples of start condition information that starts the display of the automated question screen.
[0100] The administrator can switch between displaying the question start condition registration field 1104 on the question registration screen 1100, showing the display field for registering the question start condition for periodic start and the display field for registering the question start condition for content reference. Figure 21 shows an example where the display field 1110 for registering the question start condition for periodic start is displayed.
[0101] The display field 1110 in Figure 21 for registering the start conditions for regularly scheduled questions is a field for administrators to register the start conditions for displaying the question screen. The display field 1110 for registering the start conditions for regularly scheduled questions shows an example in which administrators register the start conditions for displaying the question screen to be determined by the start time and interval time.
[0102] If a keyword is registered in the display field 1110 for registering the periodic start condition of the question registration screen 1100 in Figure 21, to be judged by voice, the information processing device 12 that provides event support services performs the process in step S22. In step S22, the information processing device 12 that provides event support services starts referencing the timer and the current time necessary to determine whether the elapsed time of the event and the current time satisfy the periodic start condition of the question. Other processes are the same as in the first embodiment, so their explanation is omitted.
[0103] According to this embodiment, it is possible to register the conditions for starting questions at regular intervals. For example, by starting the automatic display of a question screen with a display period, as shown in Figure 17, at regular intervals (e.g., every 10 minutes), and obtaining responses from participants, it is possible to estimate the level of participant engagement with the event without increasing the workload of the administrator during the event.
[0104] Each of the functions of the embodiments described above can be realized by one or more processing circuits. Hereinafter, "processing circuit" as used herein includes processors programmed to execute each function by software, such as processors implemented by electronic circuits, as well as devices such as ASICs (Application Specific Integrated Circuits), DSPs (digital signal processors), FPGAs (field programmable gate arrays), and conventional circuit modules designed to execute each of the functions described above.
[0105] The apparatus described in the examples represents only one of several computing environments for carrying out the embodiments disclosed herein. The present invention is not limited by these embodiments, and the components in these embodiments include those readily conceivable to those skilled in the art, those substantially identical, and those within the scope of so-called equivalents. Furthermore, various omissions, substitutions, modifications, and combinations of components can be made without departing from the spirit of these embodiments.
[0106] Examples of the present invention are as follows: <1> A setting reception means that accepts the setting of start condition information to start displaying the second content on the first user terminal that is currently displaying the first content that has been delivered, An operation content receiving means for receiving operation content for the second content received from a user of the first user terminal that displays the second content based on the start condition information, A screen data generation means generates screen data to display the user's participation status based on the aforementioned operation and displays it on a second user terminal, An information processing device having <2> The screen data generation means generates screen data that displays the user's participation status, indicating whether or not an operation was performed on the second content, or the elapsed time from when the second content was displayed on the first user terminal until the user of the first user terminal provided the details of the operation on the second content. The aforementioned <1> The information processing device described. <3> The aforementioned start condition information is that the timing for starting the display of the second content is set by the audio played or the image displayed by the first content. The aforementioned <1> or <2> The information processing device described. <4> The aforementioned start condition information is that the timing for starting the display of the second content is set using time information. The aforementioned <1> or <2> The information processing device described. <5> The setting acceptance means further accepts the setting of display period information from the start to the end of display of the second content on the first user terminal, The operation content receiving means receives operation content for the second content received from the user of the first user terminal that displayed the second content based on the start condition information and the display period information. The aforementioned <1> ~ <4> An information processing device as described in any one of the following items. <6> The second content is data from a screen that accepts responses from the user of the first user terminal. The aforementioned <1> ~ <5> An information processing device as described in any one of the following items. <7> An information processing system in which an information processing device, a first user terminal, and a second user terminal are connected in a communication manner, The aforementioned information processing device is A setting reception means that accepts the setting of start condition information to start displaying the second content on the first user terminal that is currently displaying the first content that has been delivered, An operation content receiving means for receiving operation content for the second content received from a user of the first user terminal that displays the second content based on the start condition information, A screen data generation means generates screen data to display the user's participation status based on the aforementioned operation and displays it on a second user terminal, It has, The second user terminal is, Output means for displaying the participation status of the aforementioned users on a screen, An information processing system having <8> The screen data generation means generates screen data that displays the user's participation status, indicating whether or not an operation was performed on the second content, or the elapsed time from when the second content was displayed on the first user terminal until the user of the first user terminal provided the details of the operation on the second content. The aforementioned <7> The information processing system described. <9> The aforementioned start condition information is that the timing for starting the display of the second content is set by the audio played or the image displayed by the first content. The aforementioned <7> or <8> The information processing system described. <10> The aforementioned start condition information is that the timing for starting the display of the second content is set using time information. The aforementioned <7> or <8> The information processing system described. <11> The setting acceptance means further accepts the setting of display period information from the start to the end of display of the second content on the first user terminal, The operation content receiving means receives operation content for the second content received from the user of the first user terminal that displayed the second content based on the start condition information and the display period information. The aforementioned <7> ~ <10> An information processing system as described in any one of the following items. <12> The second content is data from a screen that accepts responses from the user of the first user terminal. The aforementioned <7> ~ <11> An information processing system as described in any one of the following items. <13> An information processing method performed by an information processing device, A setting acceptance procedure that accepts the setting of start condition information to start displaying the second content on the first user terminal that is currently displaying the first content that has been delivered, An operation content receiving procedure for receiving operation content for the second content from a user of the first user terminal that displays the second content based on the start condition information, A screen data generation procedure that generates screen data to display the user's participation status based on the aforementioned operation and displays it on a second user terminal, An information processing method having <14> The screen data generation procedure generates screen data that displays the user's participation status, indicating whether or not an operation was performed on the second content, or the elapsed time from when the second content is displayed on the first user terminal until the user of the first user terminal provides the details of the operation on the second content. The aforementioned <13> The information processing method described. <15> The aforementioned start condition information is that the timing for starting the display of the second content is set by the audio played or the image displayed by the first content. The aforementioned <13> or <14> The information processing method described. <16> The aforementioned start condition information is that the timing for starting the display of the second content is set using time information. The aforementioned <13> or <14> The information processing method described. <17> The aforementioned setting acceptance procedure further accepts the setting of display period information from the start to the end of display of the second content on the first user terminal, The operation content receiving procedure involves receiving operation content for the second content from the user of the first user terminal that displayed the second content based on the start condition information and the display period information. The aforementioned <13> ~ <16> The information processing method described in any one of the following items. <18> The second content is data from a screen that accepts responses from the user of the first user terminal. The aforementioned <13> ~ <17> The information processing method described in any one of the following items. <19> In an information processing device, A setting acceptance procedure for accepting the setting of start condition information to initiate the display of the second content on the first user terminal that is currently displaying the first content that has been delivered. An operation content receiving procedure for receiving operation content for the second content, which is received from a user of the first user terminal that displays the second content based on the start condition information, A screen data generation procedure that generates screen data to display the user's participation status based on the aforementioned operation and displays it on a second user terminal. A program to execute. [Explanation of Symbols]
[0107] 1. Information Processing System 10. Service Delivery System 11-12 Information Processing Equipment 14 Participant terminals 15 Administrator terminal 18 Network 30 Content Provision Department 32 Content data storage unit 34. Settings Reception Section 36 Question Information Storage Unit 38 Judgment Department 40 Question Display Control Unit 42 Operation details receiving unit 44 Answer information storage section 46 Screen data generation unit 48 Screen data transmission unit 50 User attribute information storage unit 60, 80 Input section 62, 82 Output section [Prior art documents] [Patent Documents]
[0108] [Patent Document 1] Japanese Patent Publication No. 2020-123884
Claims
1. A setting reception means that accepts the setting of start condition information to start displaying the second content on a first user terminal that is currently displaying the first content that has been delivered, An operation content receiving means for receiving operation content for the second content received from a user of the first user terminal that displays the second content based on the start condition information, A screen data generation means generates screen data to display the user's participation status based on the aforementioned operation and displays it on a second user terminal, It has, The aforementioned start condition information is that the timing for starting the display of the second content is set by the audio played or the image displayed by the first content. An information processing device characterized by the following.
2. The screen data generation means generates screen data that displays the user's participation status, indicating whether or not an operation was performed on the second content, or the elapsed time from when the second content was displayed on the first user terminal until the user of the first user terminal provided the details of the operation on the second content. The information processing apparatus according to claim 1, characterized in that
3. The aforementioned start condition information is that the timing for starting the display of the second content is set using time information. An information processing apparatus according to claim 1 or 2, characterized by the above.
4. The setting reception means further receives the setting of display period information from the start to the end of display of the second content on the first user terminal, The operation content receiving means receives operation content for the second content received from the user of the first user terminal that displayed the second content based on the start condition information and the display period information. An information processing apparatus according to claim 1 or 2, characterized by the above.
5. The second content is data from a screen that accepts responses from the user of the first user terminal. An information processing apparatus according to claim 1 or 2, characterized by the above.
6. An information processing system in which an information processing device, a first user terminal, and a second user terminal are connected in a communication manner, The aforementioned information processing device is A setting reception means that accepts the setting of start condition information to start displaying the second content on a first user terminal that is currently displaying the first content that has been delivered, An operation content receiving means for receiving operation content for the second content received from a user of the first user terminal that displays the second content based on the start condition information, A screen data generation means generates screen data to display the user's participation status based on the aforementioned operation and displays it on a second user terminal, It has, The second user terminal is, Output means for displaying the participation status of the aforementioned users on a screen, It has, The aforementioned start condition information is that the timing for starting the display of the second content is set by the audio played or the image displayed by the first content. An information processing system characterized by the following.
7. The screen data generation means generates screen data that displays the user's participation status, indicating whether or not an operation was performed on the second content, or the elapsed time from when the second content was displayed on the first user terminal until the user of the first user terminal provided the details of the operation on the second content. The information processing system according to claim 6, characterized by the following:
8. The aforementioned start condition information is that the timing for starting the display of the second content is set using time information. The information processing system according to claim 6 or 7, characterized by the above.
9. The setting reception means further receives the setting of display period information from the start to the end of display of the second content on the first user terminal, The operation content receiving means receives operation content for the second content received from the user of the first user terminal that displayed the second content based on the start condition information and the display period information. The information processing system according to claim 6 or 7, characterized by the above.
10. The second content is data from a screen that accepts responses from the user of the first user terminal. The information processing system according to claim 6 or 7, characterized by the above.
11. An information processing method performed by an information processing device, A setting acceptance procedure that accepts the setting of start condition information to start displaying the second content on the first user terminal that is currently displaying the first content that has been delivered, An operation content receiving procedure for receiving operation content for the second content, which is received from a user of the first user terminal that displays the second content based on the start condition information, A screen data generation procedure that generates screen data to display the user's participation status based on the aforementioned operation and displays it on a second user terminal, It has, The aforementioned start condition information is that the timing for starting the display of the second content is set by the audio played or the image displayed by the first content. An information processing method characterized by the following.
12. The screen data generation procedure generates screen data that displays the user's participation status, indicating whether or not an operation was performed on the second content, or the elapsed time from when the second content is displayed on the first user terminal until the user of the first user terminal provides the details of the operation on the second content. The information processing method according to claim 11, characterized by the above.
13. The aforementioned start condition information is that the timing for starting the display of the second content is set using time information. The information processing method according to claim 11 or 12, characterized by the above.
14. The aforementioned setting acceptance procedure further accepts the setting of display period information from the start to the end of display of the second content on the first user terminal, The operation content receiving procedure involves receiving operation content for the second content from the user of the first user terminal that displayed the second content based on the start condition information and the display period information. The information processing method according to claim 11 or 12, characterized by the above.
15. The second content is data from a screen that accepts responses from the user of the first user terminal. The information processing method according to claim 11 or 12, characterized by the above.
16. In an information processing device, A setting acceptance procedure for accepting the setting of start condition information to start displaying the second content on the first user terminal that is currently displaying the first content that has been delivered. An operation content receiving procedure for receiving operation content for the second content, which is received from a user of the first user terminal that displays the second content based on the start condition information, A screen data generation procedure that generates screen data to display the user's participation status based on the aforementioned operation and displays it on a second user terminal. Make it run, The aforementioned start condition information is that the timing for starting the display of the second content is set by the audio played or the image displayed by the first content. A program characterized by the following.
17. The screen data generation procedure generates screen data that displays, as the user's participation status, whether or not an operation was performed on the second content, or the elapsed time from when the second content is displayed on the first user terminal until the user of the first user terminal provides the details of the operation on the second content. The program according to claim 16, characterized by the following:
18. The setting acceptance procedure further accepts the setting of display period information from the start to the end of display of the second content on the first user terminal, The operation content receiving procedure involves receiving operation content for the second content from the user of the first user terminal that displayed the second content based on the start condition information and the display period information. The program according to claim 16 or 17, characterized by the following:
19. The second content is data from a screen that receives response operations from the user of the first user terminal. The program according to claim 16 or 17, characterized by the following: