Information processing device and information processing system

Abstract

To provide an information processing apparatus and an information processing system that enable a provider of content to confirm or collect information on whether a user is performing a specific action.SOLUTION: An information processing apparatus includes an action detection unit that detects an action of a user, an action evaluation unit that evaluates whether the action of the user detected by the action detection unit is a specific action, a timer unit that measures a time, and a control unit that transmits to an external information processing apparatus information of an evaluation result of the action of the user by the action evaluation unit and information of a time at which the user performs the action.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present invention relates to an information processing apparatus and an information processing system.

Background Art

[0002] Conventionally, there is known an apparatus that evaluates whether a user performs a boosting operation in accordance with content such as music being played. For example, Patent Document 1 describes an apparatus that, when a specific operation is performed by a user in a support part set in a part of a music piece, evaluates the operation of the user as a support operation and displays an evaluation result on a display.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, since the apparatus described in Patent Document 1 displays the evaluation result of the user's operation on a display, the content provider cannot confirm whether the user is performing a specific operation. Further, in the invention described in Patent Document 1, since each apparatus evaluates the user's operation, information regarding the evaluation of the operations of a plurality of users cannot be collected. Therefore, an overall picture of the evaluation results of the operations of a plurality of users cannot be grasped either.

[0005] The present disclosure has been made in view of the above problems. An object of the present disclosure is to provide an information processing apparatus and an information processing system that enable a content provider to confirm or collect information on whether a user is performing a specific operation.

Means for Solving the Problems

[0006] An information processing device in one embodiment of the present disclosure includes: an action detection unit that detects user actions; an action evaluation unit that evaluates whether the user actions detected by the action detection unit are specific actions; a time measurement unit that measures time; and a control unit that transmits information on the evaluation results of the user actions by the action evaluation unit and information on the time the user performed the actions to an external information processing device.

[0007] An information processing system in one form of the present disclosure comprises a plurality of information processing devices and an external information processing device, each of the plurality of information processing devices detects a user's action, evaluates whether the user's action is a specific action, transmits information of the evaluation result of the user's action and information of the time the user performed the action to the external information processing device, and stores the evaluation result information and the time information received from each of the plurality of information processing devices. [Brief explanation of the drawing]

[0008] [Figure 1] A functional block diagram showing an example of the schematic configuration of an information processing system according to one embodiment. [Figure 2] Figure 1 is a sequence diagram showing an example of processing performed by the information processing system. [Figure 3] This flowchart shows the process executed by the information processing device in the first processing example. [Figure 4] This flowchart shows the processes that the server device executes in the second processing example. [Figure 5] This flowchart shows the process executed by the information processing device in the third processing example. [Figure 6] This flowchart shows the processes performed by the server device in the third processing example. [Modes for carrying out the invention]

[0009] Embodiments of this disclosure will be described below with reference to the drawings. In the drawings, identical or equivalent components are denoted by the same reference numerals, and descriptions of identical or equivalent components will be omitted where necessary.

[0010] Figure 1 is a block diagram showing an example of the configuration of an information processing system 1 according to one embodiment. As shown in Figure 1, the information processing system 1 according to one embodiment comprises a plurality of information processing devices and a server device 20.

[0011] Figure 1 illustrates three information processing devices 10A, 10B, and 10C as multiple information processing devices. However, the information processing system 1 does not necessarily have to consist of three information processing devices; one or more devices are sufficient. Hereafter in this specification, when multiple information processing devices are not distinguished, they will simply be referred to as "information processing device 10".

[0012] As shown in Figure 1, multiple information processing devices 10 are each connected to a server device 20 via a network 30, enabling information communication. The server device 20 provides content to the information processing devices 10 via the network. The content may include video content or audio content. The information processing devices 10 output the content provided by the server device 20. In addition, while outputting content, the information processing devices 10 detect the actions of the user viewing the content. The information processing devices 10 evaluate the detected user actions and transmit the evaluation results to the server device 20.

[0013] The information processing device 10 is a device used by a user when viewing content. The information processing device 10 may be composed of any device capable of performing the processing described in this embodiment. Specifically, the information processing device 10 may be composed of a device capable of outputting content and detecting user actions. For example, the information processing device 10 may be composed of a display device equipped with a display unit, such as a television receiver, a computer, or a smartphone.

[0014] In Figure 1, the information processing device 10 is illustrated as being composed of a single device. However, the information processing device 10 may be composed of, for example, two or more devices combined. For example, the information processing device 10 may be composed of a display device such as a television receiver, a computer, or a smartphone, and an auxiliary device capable of communicating information with the display device. The auxiliary device may be, for example, a holding device that the user holds when viewing content. The holding device may be used together with the display device, for example, a remote controller for the display device. Alternatively, the holding device may be a tool that the user uses when viewing content, for example, a penlight.

[0015] The information processing device 10 may be configured without including a display device. For example, the information processing device 10 may consist only of a penlight. In this case, the penlight may be configured to output sound content.

[0016] As shown in Figure 1, the information processing device 10 may include, as functional units, a device control unit 11, a device storage unit 12, a device communication unit 13, an operation detection unit 14, an operation evaluation unit 15, a timing unit 16, and a content output unit 17. In Figure 1, these functional units are only shown for the information processing device 10A, but the other information processing devices 10B and 10C may also have similar functional units. In addition to the functional units shown in Figure 1, the information processing device 10 may further include functional units necessary depending on the function performed by each information processing device 10.

[0017] The device control unit 11 controls and manages the entire information processing device 10, including each functional unit of the information processing device 10. The device control unit 11 performs various controls, such as operating a control program stored in the device storage unit 12. For example, the device control unit 11 can be constituted by a control device such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit). The device control unit 11 causes the content output unit 17 to output content based on, for example, a content signal received by the device communication unit 13 from the server device 20 via the network 30. Further, the device control unit 11 transmits information on the evaluation result of the operation by the operation evaluation unit 15 (hereinafter, also simply referred to as "evaluation result information") from the device communication unit 13 to the server device 20 via the network 30.

[0018] The device storage unit 12 is a storage medium capable of storing programs and data. The device storage unit 12 can be constituted by, for example, a semiconductor memory or a magnetic memory. Specifically, the device storage unit 12 can be constituted by, for example, an EEPROM (Electrically Erasable Programmable Read-Only Memory). The device storage unit 12 may store, for example, a program for operating the device control unit 11.

[0019] The device communication unit 13 executes information communication with an external device. In the present embodiment, the device communication unit 13 executes information communication with the server device 20 via the network 30. The device communication unit 13 transmits and receives various information by information communication. For example, the device communication unit 13 receives a content signal from the server device 20. Further, for example, the device communication unit 13 transmits to the server device 20 the evaluation result information of the user's operation by the operation evaluation unit 15 and the information on the time when the user executed the operation.

[0020] The motion detection unit 14 detects the user's motion. In the present embodiment, the motion detection unit 14 detects the user's motion during content viewing. The motion detection unit 14 may include any mechanism capable of detecting the user's motion.

[0021] For example, the motion detection unit 14 may include an imaging unit such as a camera that captures the user's motion. For example, when at least a part of the information processing apparatus 10 is constituted by a display device, the display device may include an imaging unit as the motion detection unit 14.

[0022] For example, the motion detection unit 14 may include at least one of an acceleration sensor that detects the acceleration of the motion detection unit 14 or an angular velocity sensor that detects the angular velocity of the motion detection unit 14. For example, when at least a part of the information processing apparatus 10 is constituted by a holding device, the holding device may include an acceleration sensor or an angular velocity sensor as the motion detection unit 14.

[0023] Therefore, the motion detection unit 14 may include at least one of an imaging unit, an acceleration sensor, and an angular velocity sensor. However, the imaging unit, the acceleration sensor, and the angular velocity sensor are merely examples of the motion detection unit 14. Therefore, the motion detection unit 14 may be configured to include a mechanism such as a sensor capable of detecting the user's motion other than the imaging unit, the acceleration sensor, and the angular velocity sensor.

[0024] The motion evaluation unit 15 evaluates whether the user's motion detected by the motion detection unit 14 is a specific motion. For example, information regarding a specific motion may be stored, for example, in the device storage unit 12. The motion evaluation unit 15 may evaluate whether the user's motion detected by the motion detection unit 14 is a specific motion by referring to the information regarding the specific motion stored in the device storage unit 12.

[0025] For example, if the motion detection unit 14 includes an imaging unit, the motion evaluation unit 15 extracts the user's actions from the image captured by the imaging unit. The motion evaluation unit 15 compares the extracted user's actions with the actions stored in the device storage unit 12 to determine whether the user's actions are specific actions. For example, the motion evaluation unit 15 calculates the similarity between the extracted user's actions and the actions stored in the device storage unit 12, and if the similarity is greater than or equal to a predetermined value, it may evaluate the user's actions as specific actions.

[0026] For example, if the motion detection unit 14 includes an acceleration sensor or an angular velocity sensor, the motion evaluation unit 15 determines whether the user's action is a specific action based on the acceleration or angular velocity detected by the acceleration sensor or angular velocity sensor, respectively. In this case, the device storage unit 12 stores information about the specific action, specifically the change pattern of acceleration or angular velocity when the specific action is performed. The motion evaluation unit 15 determines whether the acceleration or angular velocity detected by the acceleration sensor or angular velocity sensor included in the motion detection unit 14 corresponds to the change pattern stored in the device storage unit 12. If the acceleration or angular velocity detected by the acceleration sensor or angular velocity sensor included in the motion detection unit 14 corresponds to the change pattern stored in the device storage unit 12, the motion evaluation unit 15 may evaluate the user's action as a specific action.

[0027] A specific action may include any action that a user may perform while viewing content. For example, a specific action may include raising a hand, waving a hand back and forth or from side to side, etc.

[0028] The operation evaluation unit 15 may be composed of a control device such as a CPU or MPU. In this case, the operation evaluation unit 15 is provided as a separate mechanism independent of the device control unit 11. The operation evaluation unit 15 may be included in the device control unit 11 and configured as a mechanism integrated with the device control unit 11. In this case, the device control unit 11 encompasses the functions of the operation evaluation unit 15.

[0029] The timekeeping unit 16 measures time. Specifically, the timekeeping unit 16 keeps track of the current time. The timekeeping unit 16 may be composed of, for example, an RTC (Real Time Clock).

[0030] The content output unit 17 outputs video content or audio content. The content output unit 17 may be composed of any mechanism capable of outputting video content or audio content.

[0031] For example, the content output unit 17 may be composed of a display device that displays video. The display device may be composed of well-known displays such as a liquid crystal display (LCD), an organic electro-luminescence display (OELD), or an inorganic electro-luminescence display (IELD). In this case, the content output unit 17 can output by displaying video content.

[0032] For example, the content output unit 17 may consist of a speaker that outputs sound. In this case, the content output unit 17 can output sound content.

[0033] The content output unit 17 may also include both a display device and a speaker. In this case, the content output unit 17 can output content that includes both video and sound.

[0034] The server device 20 is an example of an external information processing device. However, the external information processing device is not limited to the server device 20 and may consist of any device capable of performing the processing described in this embodiment. The external information processing device may consist of, for example, a computer. In this embodiment, the external information processing device will be described as the server device 20.

[0035] Multiple information processing devices 10 and an external information processing device are connected to each other in a way that enables information communication. In this embodiment, multiple information processing devices 10 and a server device 20 are connected to each other in a way that enables information communication via a network 30.

[0036] The server device 20 is managed by the content provider. The server device 20 provides content to the user. The server device 20 also receives evaluation result information of the user's actions from multiple information processing devices 10. In Figure 1, the server device 20 is illustrated as being composed of a single device. However, the server device 20 may be composed of two or more devices combined. For example, the server device 20 may consist of a first device that provides content to the user and a second device that receives evaluation result information from multiple information processing devices 10.

[0037] In this embodiment, the server device 20 provides content to multiple information processing devices 10 simultaneously. That is, the multiple information processing devices 10 output the same content at the same time. As a result, each user of the information processing device 10 views the same content at the same time. The content may be, for example, a live stream of a concert, a stage performance, or an event, or it may be a recorded video of such a performance delivered at a specific time.

[0038] As shown in Figure 1, the server device 20 includes a server control unit 21, a server storage unit 22, and a server communication unit 23 as functional units.

[0039] The server control unit 21 controls and manages the entire server device 20, including each functional unit of the server device 20. The server control unit 21 performs various controls, for example, by operating control programs stored in the server storage unit 22. For example, the server control unit 21 can be configured with control devices such as a CPU or MPU. The server control unit 21 provides the content stored in the server storage unit 22 to the information processing device 10. The server control unit 21 can also execute predetermined information processing based on evaluation result information received from the information processing device 10. Details of the information processing performed by the server control unit 21 will be described later.

[0040] The server storage unit 22 is a storage medium capable of storing programs and data. The server storage unit 22 can be configured as, for example, a semiconductor memory or a magnetic memory. Specifically, the server storage unit 22 can be configured as, for example, an EEPROM. The server storage unit 22 may store, for example, a program for operating the server control unit 21. The server storage unit 22 may also store information about the content to be provided to the information processing device 10. Furthermore, the server storage unit 22 may store evaluation result information received by the server device 20 from the information processing device 10.

[0041] The server communication unit 23 performs information communication with external devices. In this embodiment, the server communication unit 23 performs information communication with multiple information processing devices 10 via the network 30. The server communication unit 23 sends and receives various types of information through information communication. For example, the server communication unit 23 transmits content signals to the information processing devices 10. Also, for example, the server communication unit 23 receives from the multiple information processing devices 10 the evaluation result information of the user's actions by the action evaluation unit 15 and information about the time the user performed the action.

[0042] Next, an example of processing performed by the information processing system 1 shown in Figure 1 will be described. Figure 2 is a sequence diagram showing an example of processing performed by the information processing system 1.

[0043] First, the server device 20 provides content to the information processing device 10. Specifically, the server device 20 transmits a content signal containing content information to the information processing device 10 (step S11). The server device 20 may transmit a content signal to the information processing device 10 if it receives a content request signal from the information processing device 10 requesting the provision of content.

[0044] The information processing device 10 outputs content from the content output unit 17 based on the content signal received from the server device 20 (step S12). For example, the information processing device 10 outputs video or sound.

[0045] Furthermore, while the information processing device 10 is outputting content, the motion detection unit 14 detects the user's actions while viewing the content (step S13).

[0046] The information processing device 10 uses an operation evaluation unit 15 to evaluate whether the user's operation detected by the operation detection unit 14 is a specific operation (step S14).

[0047] The information processing device 10 transmits to the server device 20 information regarding the evaluation result of the user's operation by the operation evaluation unit 15 and information regarding the time the user performed the operation (hereinafter also simply referred to as "time information") (step S15). At this time, the time information may be transmitted to the server device 20 together with the evaluation result information as a timestamp attached to the evaluation result. In other words, the evaluation result information may have a timestamp attached as time information.

[0048] Furthermore, the information processing device 10 may execute step S15 only if certain conditions are met. In other words, the information processing device 10 may send evaluation result information and time information to the server device 20 only if certain conditions are met. For example, the information processing device 10 may send evaluation result information and time information to the server device 20 only if the operation evaluation unit 15 evaluates the user's operation as a specific operation.

[0049] When the server device 20 receives evaluation result information and time information from the information processing device 10, it stores this evaluation result information and time information in association with each other in the server storage unit 22 (step S16).

[0050] Furthermore, the server device 20 may, if necessary, perform predetermined information processing based on the evaluation result information and time information received from the information processing device 10 (step S17).

[0051] Next, we will explain specific examples of processes performed by the information processing system 1, referring to the flowchart.

[0052] [Example 1 of processing] The first processing example is an example in which the information processing device 10 sends evaluation result information to the server device 20 when the operation evaluation unit 15 determines that the user's action is a specific action. Figure 3 is a flowchart of the process executed by the information processing device 10 in the first processing example. The information processing device 10 may execute the flow shown in Figure 3 while outputting content provided by the server device 20.

[0053] First, the device control unit 11 determines whether or not user movement has been detected by the motion detection unit 14 (step S21). For example, if the motion detection unit 14 includes an imaging unit, the device control unit 11 may analyze the image captured by the imaging unit and determine whether or not the user included in the image is moving. For example, if the motion detection unit 14 includes an acceleration sensor or an angular velocity sensor, the device control unit 11 may determine whether or not a change in acceleration or angular velocity has been detected by the acceleration sensor or angular velocity sensor. Note that step S21 corresponds to step S13 in Figure 2.

[0054] If the device control unit 11 determines that no user action has been detected (No. in step S21), it terminates this flow. In this case, the device control unit 11 may execute the flow in Figure 3 again from the beginning. The device control unit 11 may repeatedly execute the flow in Figure 3, for example, while outputting content.

[0055] On the other hand, if the device control unit 11 determines that the motion detection unit 14 has detected a user action (Yes in step S21), the motion evaluation unit 15 evaluates whether the user action detected by the motion detection unit 14 is a specific action (step S22). The motion evaluation unit 15 may evaluate whether the user action detected by the motion detection unit 14 is a specific action by referring to information about specific actions stored in the device storage unit 12, for example, as described above. Note that step S22 corresponds to step S14 in Figure 2.

[0056] If the operation evaluation unit 15 evaluates that the user's operation is not a specific operation (No. in step S22), it terminates this flow. In this case, the device control unit 11 may execute the flow in Figure 3 again from the beginning. The device control unit 11 may repeatedly execute the flow in Figure 3, for example, while outputting content.

[0057] On the other hand, if the operation evaluation unit 15 evaluates the user's action as a specific action (Yes in step S22), the device control unit 11 transmits specific action execution information and time information to the server device 20 (step S23). Here, specific action execution information is information indicating that the user performed a specific action. Specific action execution information is an example of evaluation result information. In other words, specific action execution information means evaluation result information when it indicates that the user performed a specific action. Time information is information about the time the user performed the specific action. Time information is associated with specific action execution information by, for example, referring to the timing unit 16. Time information may be attached to specific action execution information as, for example, a timestamp. Note that step S23 corresponds to step S15 in Figure 2.

[0058] After the device control unit 11 transmits specific operation execution information and time information to the server device 20, it may execute the flow in Figure 3 again from the beginning. The device control unit 11 may repeatedly execute the flow in Figure 3, for example, while outputting content.

[0059] Multiple information processing devices 10 output the same content simultaneously and execute the flow shown in Figure 3. Therefore, when a user viewing content using an information processing device 10 performs a specific action, the information processing device 10 used by that user transmits information about the specific action and time information to the server device 20. As explained in step S16 of Figure 2, the server device 20 may store the specific action information (evaluation result information) and time information received from the information processing device 10 in the server storage unit 22 in association with each other. In this way, the specific action information and time information transmitted from multiple information processing devices 10 are aggregated in the server device 20. Therefore, according to the information processing system 1, the content provider can confirm or collect information on whether or not a user is performing a specific action.

[0060] In the flow shown in Figure 3, the information processing device 10 may perform processing in real time while outputting content. Specifically, the operation evaluation unit 15 may evaluate the user's actions in real time, and the device control unit 11 may transmit specific action execution information as an evaluation result from the operation evaluation unit 15 to the server device 20 in real time. In this way, by having the information processing device 10 perform processing in real time, the content provider can confirm or collect information in real time whether or not the user is performing a specific action while the content is being distributed.

[0061] In the first processing example, the server device 20 does not perform step S17 in Figure 2. In other words, in the first processing example, the server device 20 does not perform predetermined information processing based on specific operation execution information and time information.

[0062] [Second processing example] The second processing example is an example in which the server device 20 performs predetermined information processing based on evaluation result information and time information received from the information processing device 10. Specifically, the second processing example is an example in which the server device 20 notifies the content provider when the time at which the user performed a specific action is a specific timing.

[0063] Figure 4 is a flowchart showing the process executed by the server device 20 in the second processing example. The server device 20 may execute the flow shown in Figure 4 while providing content to the information processing device 10.

[0064] In the second processing example, the information processing device 10 may perform the same processing as described in the first processing example. In other words, in the second processing example as well, the information processing device 10 may perform the flow shown in Figure 3.

[0065] In the second processing example, as shown in Figure 4, the server control unit 21 of the server device 20 determines whether or not it has received specific operation execution information and time information from the information processing device 10 (step S31). As explained in the flow chart in Figure 3, the information processing device 10 sends specific operation execution information and time information to the server device 20 when it determines that the user's action is a specific action. In step S31, the server control unit 21 determines whether or not it has received the specific operation execution information and time information sent from the information processing device 10 in this manner.

[0066] If the server control unit 21 determines that it has not received specific operation execution information and time information (No. in step S31), it terminates this flow. In this case, the server control unit 21 may execute the flow in Figure 4 again from the beginning. The server control unit 21 may repeatedly execute the flow in Figure 4, for example, while providing content.

[0067] On the other hand, if the server control unit 21 determines that it has received specific operation information and time information (Yes in step S31), it stores the received specific operation information and time information in the server storage unit 22 (step S32). Step S32 corresponds to step S16 in Figure 2.

[0068] Furthermore, the server control unit 21 determines, based on the specific operation execution information and time information, whether the time at which the user performed the operation evaluated as a specific operation is a specific timing (step S33). Specifically, the server control unit 21 determines, based on the received time information, whether the time at which the user performed the specific operation is a specific timing.

[0069] Here, the specific timing is a timing defined within the provided content. The specific timing is defined for each piece of content and may be stored, for example, in the server memory unit 22. For example, if the content is a song, the specific timing may be set as a specific part of the song. For content other than songs, a specific time period may be set as the specific timing, depending on the content.

[0070] The server control unit 21 can determine whether the time at which a user performed a specific action falls within a specific timing stored in the server storage unit 22 by determining whether the time indicated by the received time information falls within a specific timing stored in the server storage unit 22. For example, if the time indicated by the received time information falls within a specific timing stored in the server storage unit 22, the server control unit 21 determines that the time at which the user performed the specific action is within a specific timing. On the other hand, if the time indicated by the received time information does not fall within a specific timing stored in the server storage unit 22, the server control unit 21 determines that the time at which the user performed the specific action is not within a specific timing.

[0071] The server control unit 21 terminates this flow if it determines that the time at which the user performed a specific action is not at a specific timing (No in step S33). In this case, the server control unit 21 may execute the flow in Figure 4 again from the beginning. The server control unit 21 may repeatedly execute the flow in Figure 4, for example, while providing content.

[0072] On the other hand, if the server control unit 21 determines that the time when the user performed a specific action corresponds to a specific timing (Yes in step S33), it notifies the content provider that the user performed a specific action at a specific timing (step S34). The server control unit 21 can make the notification in any way that is recognizable to the content provider. For example, the server control unit 21 can make the notification from a notification unit (not shown) provided in the server device 20. The notification unit may consist of, for example, a display screen, an indicator lamp, or a speaker. In this case, the notification unit can make the notification by displaying on the display screen, lighting or flashing an indicator lamp, or outputting sound from a speaker. The server control unit 21 may also make the notification by transmitting information to a terminal device used by the provider, which is connected to the server device 20 in a manner that enables information communication. For example, the server control unit 21 transmits a signal to the terminal device that causes the terminal device to execute a notification informing it that the user performed a specific action at a specific timing. The terminal device executes the notification based on the signal. This makes it possible to notify the content provider that the user performed a specific action at a specific timing.

[0073] Steps S33 and S34 correspond to step S17 in Figure 2. In other words, the process executed in steps S33 and S34 is an example of the information processing described in step S17 of Figure 2.

[0074] After issuing the notification in step S34, the server control unit 21 may execute the flow in Figure 4 again from the beginning. The server control unit 21 may repeatedly execute the flow in Figure 4, for example, while providing content.

[0075] By having the server device 20 execute the flow shown in Figure 4, the content provider can confirm or collect information on whether or not the user is performing a specific action, and can also confirm whether or not the user is performing a specific action at a specific time.

[0076] Furthermore, if the server control unit 21 receives specific operation execution information and time information from multiple information processing devices 10, it may execute the flow described in Figure 4 for all of the received specific operation execution information and time information.

[0077] Furthermore, the server device 20 may execute the flow shown in Figure 4 in real time while delivering content. This allows the content provider to check in real time whether or not the user is performing a specific action at a specific time.

[0078] [Third processing example] The third processing example is an example in which the information processing device 10 transmits evaluation result information to the server device 20 regardless of whether the user's action is a specific action or not. In the third processing example, the server device 20 performs predetermined information processing based on the received evaluation result information. Details of the third processing example will be explained with reference to Figures 5 and 6.

[0079] Figure 5 is a flowchart showing the process executed by the information processing device 10 in the third processing example. The information processing device 10 may execute the flow shown in Figure 5 while outputting content provided by the server device 20.

[0080] In the third processing example, the initial steps S21 and S22 are the same as steps S21 and S22 in Figure 3 described in the first processing example. That is, the device control unit 11 of the information processing device 10 determines whether or not user action has been detected by the action detection unit 14 (step S21). If the device control unit 11 determines that user action has not been detected (No in step S21), it terminates this flow. In this case, the device control unit 11 may execute the flow in Figure 5 again from the beginning. On the other hand, if the device control unit 11 determines that user action has been detected by the action detection unit 14 (Yes in step S21), the action evaluation unit 15 evaluates whether or not the user action detected by the action detection unit 14 is a specific action (step S22).

[0081] If the operation evaluation unit 15 evaluates the user's action as a specific action (Yes in step S22), the device control unit 11 transmits specific action execution information and time information to the server device 20 (step S23).

[0082] On the other hand, in the third processing example, even if the operation evaluation unit 15 evaluates that the user's action is not a specific action (No. in step S23), the device control unit 11 also transmits evaluation result information and time information to the server device 20. In this case, the device control unit 11 transmits non-specific operation execution information and time information to the server device 20 (step S24). Non-specific operation execution information is information indicating that the user's action is not a specific action. Non-specific operation execution information is an example of evaluation result information. In other words, non-specific operation execution information means evaluation result information that indicates that the action performed by the user is not a specific action. Time information is associated with non-specific operation execution information by referring to, for example, the timing unit 16. Time information may be attached to non-specific operation execution information as, for example, a timestamp.

[0083] Thus, in the third processing example, steps S23 and S24 correspond to step S15 in Figure 2.

[0084] In step S23 or step S24, the device control unit 11 may send specific operation information or non-specific operation information and time information to the server device 20, and then execute the flow in Figure 5 again from the beginning. The device control unit 11 may repeatedly execute the flow in Figure 5, for example, while outputting content.

[0085] Figure 6 is a flowchart showing the process executed by the server device 20 in the third processing example. The server device 20 may execute the flow shown in Figure 6 while providing content to the information processing device 10.

[0086] In the third processing example, the server control unit 21 of the server device 20 determines whether or not it has received evaluation result information and time information from the information processing device 10 (step S41). The evaluation result information here includes specific operation execution information and non-specific operation execution information. That is, as explained with reference to Figure 5, the information processing device 10 transmits specific operation execution information and time information when the user's operation is a specific operation, and transmits non-specific operation execution information and time information when the user's operation is not a specific operation. Therefore, the evaluation result information that is transmitted differs depending on whether or not the user's operation is a specific operation. Accordingly, in step S41, the server control unit 21 determines whether or not it has received specific operation execution information and time information, or non-specific operation execution information and time information, from the information processing device 10.

[0087] If the server control unit 21 determines that it has not received evaluation result information and time information (No. in step S41), it terminates this flow. In this case, the server control unit 21 may execute the flow in Figure 6 again from the beginning. The server control unit 21 may repeatedly execute the flow in Figure 6, for example, while providing content.

[0088] On the other hand, if the server control unit 21 determines that it has received evaluation result information and time information (Yes in step S41), it stores the received evaluation result information and time information in the server storage unit 22 (step S42). Step S42 corresponds to step S16 in Figure 2.

[0089] Furthermore, the server control unit 21 calculates the percentage of users who performed a specific action based on the evaluation result information (step S43). Specifically, the server control unit 21 receives evaluation result information and time information from multiple information processing devices 10. Based on the specific action execution information and non-specific action execution information received from the multiple information processing devices 10 as evaluation result information, the server control unit 21 calculates the percentage of users who performed a specific action. For example, the server control unit 21 can calculate the percentage of users who performed a specific action by calculating the ratio of the number of users who performed a specific action to the total number of users. Specifically, the server control unit 21 can calculate the percentage of users who performed a specific action by calculating the ratio of the number of specific action execution information to the sum of the number of non-specific action execution information received. This is because specific action execution information is information sent when a user is evaluated as having performed a specific action, and non-specific action execution information is information sent when a user's action is evaluated as not being a specific action.

[0090] The server control unit 21 then notifies the content provider of the calculation result in step S43 (step S44). The notification can be made by various methods, for example, as described in step S34 of Figure 4. The notification allows the content provider to confirm the percentage of users who performed a specific action.

[0091] Steps S43 and S44 correspond to step S17 in Figure 2. In other words, the process executed in steps S43 and S44 is an example of the information processing described in step S17 of Figure 2.

[0092] Furthermore, the server control unit 21 can also calculate the percentage of users who performed a specific action at a specific time by using time information in addition to evaluation result information. The server control unit 21 is not limited to the examples shown herein, and may perform appropriate processing based on the evaluation result information and time information to calculate information required by the content provider.

[0093] Furthermore, the server device 20 may execute the flow shown in Figure 6 in real time while delivering content. This allows the content provider to check in real time the percentage of users who performed a specific action.

[0094] The information processing system 1 according to the above embodiment can be applied to a variety of content. For example, if the content is a live music stream, the information processing system 1 allows the content provider to use the information processing device 10 to check the actions and reactions of users watching the live music stream. Also, for example, if the content is a quiz program, the information processing system 1 allows the content provider to use the information processing device 10 to check the answers of users watching the program. Specifically, if the quiz in the program is in a multiple-choice format, the content provider can check which option a user participating in the quiz has selected by specifying an action for each option. The information processing system 1 can be used with a variety of content other than those shown here.

[0095] In the above embodiment, a holding device held and used by the user was shown as an example of an accessory device, but the accessory device is not limited to this. For example, the accessory device may be a wearable device that the user wears on their body when viewing content. The wearable device is, for example, a device that the user wears on their wrist, ankle, arm, torso, or head. If the information processing device 10 is configured to include a wearable device, the wearable device may be equipped with a motion detection unit 14. In this case, the motion detection unit 14 may be, for example, an acceleration sensor or an angular velocity sensor.

[0096] Furthermore, in the above embodiment, it was described that multiple information processing devices 10 output the same content at the same time. However, the information processing system 1 can be used in other cases as well. For example, a user may view content provided by the server device 20 on the information processing device 10 at a viewing time of their choosing. As described in this embodiment, the information processing device 10 evaluates the detected user's actions and transmits the evaluation result information to the server device 20. In this case, information on whether or not the user is performing a specific action can be stored in the server device 20.

[0097] While this disclosure has been described based on the drawings and embodiments, it should be noted that those skilled in the art will find it easy to make various modifications and alterations based on this disclosure. Therefore, it should be noted that these modifications and alterations are within the scope of this disclosure. For example, the functions included in each functional part or step can be rearranged in a logically consistent manner, and multiple functional parts or steps can be combined into one or separated. [Explanation of Symbols]

[0098] 1. Information Processing System 10A, 10B, 10C Information Processing Devices 11. Device Control Unit 12 Device storage 13. Device Communication Unit 14 Motion detection unit 15. Operation Evaluation Unit 16 Timing section 17 Content Output Section 20 Server device (external information processing device) 21 Server Control Unit 22 Server Storage Unit 23 Server Communication Section 30 Networks

Claims

1. It comprises multiple information processing devices connected to each other in a manner that enables information communication, and an external information processing device. Each of the plurality of information processing devices detects a user's action, evaluates whether the user's action is a specific action, and transmits to the external information processing device information, which includes either specific action execution information indicating that the user performed the specific action, or non-specific action execution information indicating that the user's action is not the specific action, along with information about the time the user performed the action. The external information processing device stores the evaluation result information and the time information received from each of the plurality of information processing devices. When each of the plurality of information processing devices determines that the user's action is not the specified action, it transmits non-specific action execution information indicating that the user's action is not the specified action, and the time information to the external information processing device. The external information processing device calculates the percentage of users who performed the specific operation based on the specific operation information and non-specific operation information received from each of the plurality of information processing devices. Information processing system.

2. The information processing system according to claim 1, wherein the external information processing device determines, based on the specific operation execution information and the time information, whether the time at which the user performed the operation evaluated as a specific operation is a specific timing.

Images