Information processing device, information processing method, and information processing program

Abstract

To improve usability for users of various kinds of online services.SOLUTION: An information processing apparatus includes an acquisition unit, an estimation unit, and an execution unit. The acquisition unit acquires detection results of a sensor mounted on a first device that a user is wearing. The estimation unit estimates context of the user at the time when the acquisition unit acquires the detection results of the sensor, on the basis of a status of use of a second device that the user is using. The execution unit derives an estimated detection result estimated as a detection result of the sensor at the time when the estimation unit estimates the context, and executes calibration to control a service that the user is using, on the basis of the derived estimated detection result and the detection results of the sensor acquired by the acquisition unit.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present application relates to an information processing apparatus, an information processing method, and an information processing program. [Background Art]

[0002] Conventionally, technologies have been proposed for providing services by using information on instruments and devices worn by users of various online services. For example, as a related technology, in a navigation service for users moving on foot, a technology for correctly detecting an output azimuth from an azimuth sensor attached to a headset has been proposed. [Prior Art Literature] [Patent Literature]

[0003] [Patent Literature 1] Japanese Unexamined Patent Publication No. 2006-133132 [Summary of the Invention] [Problem to be Solved by the Invention]

[0004] However, in conventional technologies, there is considerable room for improvement in improving the usability of users of various online services.

[0005] The present application has been made in view of the above, and an object thereof is to provide an information processing apparatus, an information processing method, and an information processing program capable of improving the usability of users of various online services. [Means for Solving the Problem]

[0006] The information processing device according to the present application comprises an acquisition unit, an estimation unit, and an execution unit. The acquisition unit acquires the detection results of sensors mounted on a first device worn by the user. The estimation unit estimates the user's context at the time the sensor detection results were acquired by the acquisition unit, based on the usage status of the second device being used by the user. The execution unit derives an estimated detection result, which is estimated as the sensor detection result at the time the context was estimated by the estimation unit, and performs calibration to control the service being used by the user based on the derived estimated detection result and the sensor detection result acquired by the acquisition unit. [Effects of the Invention]

[0007] According to one embodiment of the present invention, it is possible to improve the usability for users of various online services. [Brief explanation of the drawing]

[0008] [Figure 1] Figure 1 is a diagram illustrating the overview of the information processing performed by the information processing device according to the embodiment. [Figure 2] Figure 2 shows an example of a hypothetical scenario for deriving the estimated detection results according to the embodiment. [Figure 3] Figure 3 shows an example of the configuration of a terminal device according to this embodiment. [Figure 4] Figure 4 shows an example of the configuration of an information processing device according to the present invention. [Figure 5] Figure 5 is a diagram showing an overview of the service usage history information stored in the usage history storage unit according to the embodiment. [Figure 6] Figure 6 is a diagram showing an overview of the correspondence information stored in the correspondence information storage unit according to the embodiment. [Figure 7] Figure 7 is a flowchart showing an example of the processing procedure for information processing performed by the information processing apparatus according to the present invention. [Figure 8] Figure 8 is a hardware configuration diagram showing an example of a computer that implements the functions of an information processing device according to an embodiment or each modified example. [Modes for carrying out the invention]

[0009] The following describes in detail, with reference to the drawings, the embodiments for implementing the information processing apparatus, information processing method, and information processing program according to the present application (hereinafter referred to as "embodiments"). Note that these embodiments do not limit the information processing apparatus, information processing method, and information processing program according to the present application. Furthermore, each embodiment can be appropriately combined as long as the processing content is not inconsistent. Also, the same parts are denoted by the same reference numerals in each of the following embodiments, and redundant descriptions are omitted.

[0010] [Embodiment] [1. System configuration according to the embodiment] The following describes an overview of the information processing performed by the information processing device 100 according to this embodiment. Figure 1 is a diagram showing an overview of the information processing performed by the information processing device 100 according to this embodiment.

[0011] First, before describing the overview of the information processing performed by the information processing device 100 according to this embodiment, we will explain an example configuration of the information processing system SYS, which includes the information processing device 100 according to this embodiment, with reference to Figure 1.

[0012] As shown in Figure 1, the information processing system SYS comprises a terminal device 10, a wearable device 50, and an information processing device 100. The terminal device 10, the wearable device 50, and the information processing device 100 are connected by wired or wireless means to a predetermined network such as the Internet (for example, network N shown in Figure 4). The terminal device 10, the wearable device 50, and the information processing device 100 can communicate with each other through the predetermined network. Note that the configuration of the information processing system SYS shown in Figure 1 is just an example, and it may include other terminal devices other than the terminal device 10, other wearable devices other than the wearable device 50, and other information processing devices other than the information processing device 100.

[0013] Terminal device 10 is an information processing terminal used by user U, who is a user of various online services. For example, various online services are provided through a platform operated by a service provider, which is managed by the information processing device 100. For example, terminal device 10 can be a smartphone, a desktop PC (Personal Computer), a notebook PC, a tablet device, a mobile phone, or a PDA (Personal Digital Assistant). Figure 1 illustrates the case where terminal device 10 is a smartphone.

[0014] Furthermore, the terminal device 10 may be connected to a predetermined network by a communication function for performing wireless communication. For example, the terminal device 10 may have a communication function for performing wireless communication networks such as LTE (Long Term Evolution), 4G (4th Generation), or 5G (5th Generation), or short-range wireless communication such as Bluetooth (registered trademark) or Wi-Fi (Local Area Network).

[0015] Furthermore, the terminal device 10 can display web content provided by the information processing device 100, for example, using a web browser or application. When the terminal device 10 receives control information from the information processing device 100 or the like to implement the information display process, it will perform the display process according to the control information.

[0016] User U can operate the terminal device 10 to use service content such as websites and web content for various online services displayed via a web browser. Alternatively, User U may download a dedicated application program for using various online services (hereinafter referred to as a "user application") from the information processing device 100 and install it on the terminal device 10. In this case, User U can use service content for various online services configured for the user application by operating the user application.

[0017] Alternatively, the terminal device 10 may communicate with the wearable device 50 using various wireless communication technologies such as Bluetooth (registered trademark) and WiFi (registered trademark) (Wireless Fidelity). Note that the terminal device 10 may communicate with the wearable device 50 using a technology different from wireless communication technology, as long as information can be transmitted and received between the terminal device 10 and the wearable device 50.

[0018] The wearable device 50 is, for example, a device that can be worn by User U, and may be, for example, an earphone, a headset, a head-mounted display, a smart device (such as smart glasses or a smart watch), or the like. According to FIG. 1, an example is illustrated where the wearable device 50 is a device worn on the head of User U.

[0019] The wearable device 50 includes a sensor 51. The wearable device 50 transmits information collected by the sensor 51 to the terminal device 10. For example, the wearable device 50 may collect position information detected by the sensor 51, acceleration information, angular velocity information, geomagnetic information, pressure information, audio information, vibration-related information, temperature-related information, atmospheric pressure-related information, humidity-related information, illuminance-related information, and the like.

[0020] Furthermore, the wearable device 50 may have a communication function for sending and receiving information with the terminal device 10. The wearable device 50 may communicate with the terminal device 10 using various conventional wireless communication technologies such as Bluetooth® or WiFi® as appropriate. In other words, the wearable device 50 may communicate with the terminal device 10 using any function as long as it is capable of sending and receiving information with the terminal device 10. The wearable device 50 may also have a communication function for sending and receiving information with the information processing device 100.

[0021] The information processing device 100 is an information processing device that performs information processing according to the embodiment. The information processing device 100 is typically a server device, but may be implemented as a mainframe or workstation. Furthermore, when the information processing device 100 is implemented as a server device, it may be implemented as a single server device, or as a cloud system in which multiple server devices and multiple storage devices work together. In addition, the information processing device 100 also functions as an information processing device that performs processing to provide various online services to each user, including user U.

[0022] Furthermore, the information processing device 100 may acquire detection results from the sensors mounted on the wearable device 50 by communicating with the terminal device 10. Alternatively, if the wearable device 50 has a communication function for communicating with the information processing device 100, the information processing device 100 may acquire detection results from the sensors mounted on the wearable device 50 directly by communicating with the wearable device 50.

[0023] The various online services provided by the information processing device 100 to users may include internet access, search services, SNS (Social Networking Service), e-commerce services, electronic payment services, online games, online banking services, online trading services, hotel reservation services, ticket reservation services, video streaming services, music streaming services, news streaming services, map information services, route search services, route guidance services, route information services, train operation information services, weather information services, and web conferencing services. Furthermore, these various online services may also include API (Application Programming Interface) services corresponding to various applications.

[0024] [2. Information Processing in the Property] The following describes the overview of the information processing performed by the information processing device 100 according to the embodiment, using Figure 1 as an example. As shown in Figure 1, the information processing device 100 has a usage history storage unit 121 that stores the service usage history of user U, and a correspondence information storage unit 122 that shows the correspondence between the detection results of sensors mounted on the wearable device 50 and the context of user U.

[0025] The information processing device 100 acquires the detection result of a sensor if any of the sensors mounted on the wearable device 50 has reached a preset adjustment cycle (step S01). The cycle for uploading the sensor detection results from the wearable device 50 may be set by the user U when activating the wearable device 50, or it may be automatically set by the functions of an application program pre-installed on the wearable device 50.

[0026] Furthermore, the information processing device 100 estimates the context of user U based on the usage status of the terminal device 10 by user U (step S02).

[0027] For example, the usage status of the terminal device 10 may include situations where application programs (hereinafter referred to as "apps") for using various online services such as search services, SNS (Social Networking Service), and video distribution services are running. The usage status of these various online services can be identified based on the service usage history stored in the usage history storage unit 121. Furthermore, the usage status of the terminal device 10 may also include the detection results of various sensors installed in the terminal device 10.

[0028] The information processing device 100 can estimate the context of user U based on the user U's service usage history and the detection results of various sensors installed in the terminal device 10. For example, if user U is playing video content using a video streaming service app and the terminal device 10 is maintaining a certain posture, the information processing device 100 estimates that user U is watching the video content being played on the terminal device 10 (looking at the terminal device 10) as the context of user U.

[0029] Furthermore, if user U is watching video content being played on terminal device 10, it is assumed that user U's face is almost directly facing the display surface of terminal device 10. Based on this assumption, the information processing device 100 can further estimate the orientation of user U's face as part of user U's context. At this time, the information processing device 100 may also take into account the orientation of terminal device 10 (detection result of sensors mounted on terminal device 10) to determine the orientation of user U's face. Note that the orientation of the face may include the front, right, left, etc.

[0030] Furthermore, the information processing device 100 derives an estimated detection result, which is estimated as a detection result of the sensors mounted on the wearable device 50 when estimating the context of user U (step S03). Figure 2 is a diagram showing an example of a hypothetical scenario when deriving the estimated detection result according to the embodiment. In Figure 2, it is assumed that user U is watching video content being played on the terminal device 10.

[0031] As shown in Figure 2, for example, if it is estimated that user U is watching video content being played on terminal device 10, it is assumed that user U's face and the display surface of terminal device 10 are almost directly facing each other. Based on this assumption, the information processing device 100 derives an estimated detection result that is estimated to be output as a detection result by sensors 51-1 and 51-2 (see Figure 1) mounted on the wearable device 50.

[0032] For example, the information processing device 100 estimates the left-right direction of user U's face based on the positional information of the attachment devices 50-1 and 50-2. The information processing device 100 also estimates the front-to-back direction of user U's face from among the directions orthogonal to the display surface of the terminal device 10. In this case, the information processing device 100 may also use the direction of the surface of the terminal device 10 estimated from the orientation of the terminal device 10 detected by the sensor of the terminal device 10. The information processing device 100 also estimates the direction of user U's face (forward direction) from among the front-to-back directions of user U's face, with the side of the terminal device 10 being the direction of user U's face (forward direction). The information processing device 100 then derives the detection result of the sensor 51 as the estimated detection result when a detection result corresponding to the estimated direction of user U's face (forward direction) is output.

[0033] Furthermore, the information processing device 100 performs calibration to control the service being used by user U based on the detection result and estimated detection result of the sensor 51 (step S04). Here, the calibration performed by the information processing device 100 means information processing that specifically estimates the situation of user U based on the difference between the actual detection result of the target sensor and the estimated detection result of the target sensor, and controls the service being used by user U in accordance with the estimated specific situation of user U.

[0034] For example, in the case shown in Figure 2, the information processing device 100 acquires the difference between the detection result of the sensor 51 and the estimated detection result for a certain period of time, and identifies the change in the orientation of user U's face over time from the acquired difference. If the information processing device 100 determines that the time during which user U's face is not directly facing the display surface of the terminal device 10 exceeds a certain period of time, it estimates that user U is relatively uninterested in the video content being viewed. In this case, the information processing device 100 may pause the video content being viewed by user U and issue a notification suggesting the playback of other video content.

[0035] Furthermore, in the case shown in Figure 2, if the information processing device 100 determines that the user U's face is not directly facing the display surface of the terminal device 10 for a certain period of time or less, it estimates that the user U is relatively interested in the video content being viewed. In this case, the information processing device 100 may, for example, issue a notification introducing other similar video content when the user U pauses the video content being played.

[0036] Furthermore, if information indicating the correspondence between the estimated context of user U and the estimated detection result derived from the detection result of the mounted sensor of the wearable device 50 at the time of estimation of user U's context is not registered, the information processing device 100 registers it in the corresponding information storage unit 122. As a result, the next time a similar context is estimated as the context of user U, the information processing device 100 can use the registered information registered in the corresponding information storage unit 122.

[0037] In this way, the information processing device 100 estimates the specific situation of user U from the difference between the actual detection result detected by the sensor 51 mounted on the wearable device 50 worn by user U and the estimated detection result of the sensor 51 corresponding to the estimated content of user U based on the usage status of the terminal device 10, and can control the service that user U is using in accordance with the estimated specific situation of user U. As a result, the information processing device 100 can improve the usability for users of various online services.

[0038] [3. Configuration of each device according to the embodiment] (3-1. Configuration of terminal device 10) An example of the functional configuration of the terminal device 10 will be explained using Figure 3. Figure 3 is a diagram showing an example of the configuration of the terminal device 10 according to the embodiment. As shown in Figure 3, the terminal device 10 comprises a communication unit 11, a display unit 12, an input unit 13, a positioning unit 14, a sensor unit 20, a control unit 30 (controller), and a storage unit 40.

[0039] (Communications Section 11) The communication unit 11 is connected to a predetermined network (for example, network N shown in Figure 4) by wire or wireless connection, and transmits and receives information with the information processing device 100 via network N. For example, the communication unit 11 can be implemented using a NIC (Network Interface Card) or an antenna.

[0040] (Display section 12) The display unit 12 is implemented by a display device that displays various information about the online services being used by user U. For example, the display unit 12 may be a liquid crystal display (LCD) or an organic electro-luminescent display (OLED). Alternatively, the display unit 12 may be configured as a touchscreen display capable of receiving touch operations from user U.

[0041] (Input section 13) The input unit 13 is implemented by an input device that accepts various operations from the user U. The input unit 13 has, for example, buttons for inputting characters or numbers. If the display unit 12 described above is configured as a touchscreen display, the input unit 13 may be implemented as part of the display unit 12. The input unit 13 may also have a voice input function that accepts voice input from the user U.

[0042] (Positioning unit 14) The positioning unit 14 receives signals (radio waves) transmitted from GPS (Global Positioning System) satellites and, based on the received signals, acquires position information (for example, latitude and longitude) indicating the current position of the terminal device 10, which is itself. In other words, the positioning unit 14 determines the position of the terminal device 10. Note that GPS is just one example, and the unit may be configured to receive signals from satellites of other systems included in GNSS (Global Navigation Satellite System).

[0043] Furthermore, the positioning unit 14 can determine its position using various methods other than GPS. For example, the positioning unit 14 may use the various communication functions of the terminal device 10 as an auxiliary positioning means for position correction. In addition, the positioning unit 14 may combine and use the positioning means described below when determining its position.

[0044] For example, the positioning unit 14 may determine the location of the terminal device 10 by utilizing the Wi-Fi® communication function of the terminal device 10 or the communication network provided by each telecommunications company. Specifically, the positioning unit 14 determines the location of the terminal device 10 by performing Wi-Fi communication or the like and determining the distance to nearby base stations or access points.

[0045] For example, the positioning unit 14 may determine the location using the Bluetooth® function of the terminal device 10. Specifically, the positioning unit 14 determines the location of the terminal device 10 by connecting to a beacon transmitter connected via the Bluetooth function.

[0046] For example, the positioning unit 14 may determine the position of the terminal device 10 based on the geomagnetic pattern of the structure that has been measured in advance and the geomagnetic sensor provided by the terminal device 10.

[0047] For example, the positioning unit 14 may determine the location based on the location where the terminal device 10 was used, along with information on payments and other transactions made by the terminal device 10. Specifically, if the terminal device 10 has the functionality of an RFID (Radio Frequency Identification) tag equivalent to a contactless IC card used at train station ticket gates or stores, or if it has the functionality to read RFID tags, the location where the terminal device 10 was used will be recorded along with information on payments and other transactions made by the terminal device 10. The positioning unit 14 then determines the location of the terminal device 10 by acquiring this information. In this case, the location may be determined by an optical sensor or an infrared sensor provided by the terminal device 10.

[0048] (Sensor unit 20) The sensor unit 20 includes various sensors mounted on the terminal device 10. In the example shown in Figure 3, the sensor unit 20 includes an acceleration sensor 21, a gyro sensor 22, a barometric pressure sensor 23, a temperature sensor 24, a sound sensor 25, a light sensor 26, a magnetic sensor 27, and an image sensor (camera) 28. The sensors 21 to 28 described above are just examples of sensors mounted on the terminal device 10, and the sensor unit 20 may include one or more of the sensors 21 to 28, or it may include other sensors such as a humidity sensor other than those illustrated in Figure 3 in addition to or instead of the sensors 21 to 28.

[0049] The acceleration sensor 21 is, for example, a 3-axis acceleration sensor and detects the physical movement of the terminal device 10, such as its direction of movement, velocity, and acceleration. The gyro sensor 22 detects the physical movement of the terminal device 10, such as its tilt in the three axes, based on its angular velocity. The barometric pressure sensor 23 detects the atmospheric pressure around the terminal device 10, for example.

[0050] Since the terminal device 10 is equipped with the aforementioned acceleration sensor 21, gyroscope sensor 22, barometric pressure sensor 23, etc., its position can be determined using technologies such as pedestrian dead-reckoning (PDR) that utilize these sensors 21 to 23. This makes it possible to obtain indoor location information that is difficult to obtain with positioning systems such as GPS.

[0051] Furthermore, the terminal device 10 can calculate the user U's step count, walking speed, and distance walked using a pedometer that utilizes an acceleration sensor 21. The terminal device 10 can also determine the user U's direction of movement, gaze direction, and body tilt using a gyro sensor 22. In addition, the terminal device 10 can determine the altitude and floor number of the user U based on the atmospheric pressure detected by the barometric pressure sensor 23.

[0052] Additionally, the temperature sensor 24 detects, for example, the ambient temperature around the terminal device 10. The sound sensor 25 detects, for example, ambient sound around the terminal device 10. The light sensor 26 detects, for example, the illuminance around the terminal device 10. The magnetic sensor 27 detects, for example, the Earth's magnetic field around the terminal device 10. The image sensor 28 captures, for example, an image of the area around the terminal device 10.

[0053] The terminal device 10 can improve the positioning accuracy of its location based on the surrounding environment and conditions, including the detection results of the temperature sensor 24 and other sensors mentioned above.

[0054] (Control Unit 30) The control unit 30 includes, for example, a microcomputer having a CPU (Central Processing Unit), ROM (Read Only Memory), RAM, input / output ports, and various circuits. Alternatively, the control unit 30 may be composed of hardware such as an integrated circuit (ASIC) or FPGA (Field Programmable Gate Array). The control unit 30 comprises a transmission unit 31, a reception unit 32, and a processing unit 33.

[0055] (Transmitter 31) The transmission unit 31 can transmit various information, such as information input by the user U using the input unit 13, various information detected by the sensors 21-28 mounted on the terminal device 10, and location information of the terminal device 10 determined by the positioning unit 14, to the information processing device 100 via the communication unit 11.

[0056] (Receiving unit 32) The receiving unit 32 can receive various types of information provided by the information processing device 100, as well as requests for various types of information from the information processing device 100, via the communication unit 11.

[0057] (Processing 33) The processing unit 33 can control the entire terminal device 10, including the display unit 12. For example, the processing unit 33 displays various information transmitted by the transmission unit 31 and various information received from the information processing device 100 by the reception unit 32 by outputting them to the display unit 12.

[0058] (Storage unit 40) The storage unit 40 is implemented by, for example, semiconductor memory elements such as RAM (Random Access Memory) and flash memory, or by storage devices such as HDD (Hard Disk Drive), SSD (Solid State Drive), and optical discs. Various programs and various data are stored in this storage unit 40.

[0059] (3-2. Configuration of the information processing device 100) The following describes an example of the functional configuration of the information processing device 100 according to the embodiment. Figure 4 is a diagram showing an example of the configuration of the information processing device 100 according to the embodiment. As shown in Figure 4, the information processing device 100 has a communication unit 110, a storage unit 120, and a control unit 130.

[0060] (Regarding Communications Unit 110) The communication unit 110 is implemented, for example, by a NIC (Network Interface Card). The communication unit 110 is connected to the network N by wire or wireless connection. The information processing device 100 transmits and receives information with other devices, such as the terminal device 10, via the network N.

[0061] (Regarding memory unit 120) The storage unit 120 stores, for example, programs and data used for control and calculations by the control unit 130. For example, the storage unit 120 can be implemented using semiconductor memory elements such as RAM (Random Access Memory) or flash memory, or storage devices such as hard disks or optical discs. For example, the storage unit 120 has a usage history storage unit 121 and a corresponding information storage unit 122. Note that the storage unit 120 is not limited to the example shown in Figure 4, and can appropriately store data necessary for executing the information processing according to the embodiment.

[0062] (Usage history storage unit 121) The usage history storage unit 121 stores information regarding the service usage history of each user of various online services (for example, user U shown in Figure 1). Figure 5 is a diagram showing an overview of the service usage history information stored in the usage history storage unit 121 according to this embodiment.

[0063] As shown in Figure 5, the service usage history information stored in the usage history storage unit 121 has multiple items, such as a "User ID" item and a "Usage History" item. These items in the usage history information are interconnected.

[0064] The "User ID" field stores the User ID, which is user identification information used to identify each individual user of the online service. The "Usage History" field stores information regarding each user's service usage history for the online service.

[0065] Figure 5 shows an example where "Usage History EX001" is stored as the service usage history of a user identified by user ID "U#001".

[0066] (Corresponding information storage unit 122) The correspondence information storage unit 122 stores correspondence information for each user of various online services, which associates the detection results of sensors (for example, sensor 51 shown in Figure 1) mounted on wearable devices (for example, wearable device 50 shown in Figure 1) worn by the user (for example, user U shown in Figure 1) with the user's context. Figure 6 is a diagram showing an overview of the correspondence information stored in the correspondence information storage unit 122 according to this embodiment.

[0067] As shown in Figure 6, the correspondence information stored in the correspondence information storage unit 122 has multiple items, such as the "User ID" item, the "Sensor" item, the "Detection Result" item, and the "Context" item. These items in the correspondence information are interconnected.

[0068] The "User ID" field stores the User ID, which is user identification information used to identify each user of the online service. The "Sensor" field stores information indicating the type of sensor installed on the user's wearable device. The "Detection Result" field stores information indicating the detection result of the sensor installed on the user's wearable device. For example, the "Detection Result" field stores the estimated detection result, which is estimated as the detection result of the sensor installed on the wearable device when estimating the user's context. The "Context" field stores information indicating the user's context at the time the detection result of the sensor installed on the user's wearable device was obtained. For example, the "Context" field stores information indicating the estimated context, which is estimated based on the usage status of the user's terminal device when the detection result of the sensor installed on the user's wearable device was obtained.

[0069] Figure 6 shows an example where the "Detection Result EX001" of "Sensor EX-C1," one of the sensors on a wearable device worn by a user identified by user ID "U#001," is associated with the user's "Context EX001," and the "Detection Result EX002" of "Sensor EX-C1" is associated with the user's "Context EX002." For example, in the case shown in Figure 2, if the sensor 51 shown in Figure 2 is an accelerometer, then "Sensor EX-C1" is an accelerometer, "Detection Result EX001" is the "accelerometer detection result," and "Context EX001" is "Watching video content."

[0070] (Regarding the control unit 130) The control unit 130 is implemented by a CPU (Central Processing Unit) or MPU (Micro Processing Unit) executing various programs stored in the memory device inside the information processing device 100 using RAM as the working area. Alternatively, the control unit 130 may be implemented by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

[0071] The control unit 130 shown in Figure 4 has an acquisition unit 131, an estimation unit 132, and an execution unit 133, and each of these units realizes or executes the functions and operations of the information processing described below. The control unit 130 may have multiple internal configurations divided into processing units that realize or execute the functions and operations of the information processing described below. Furthermore, the control unit 130 is not limited to the configuration shown in Figure 4, and may have other configurations as long as they perform the information processing described later, and may have other functional units other than those shown in Figure 4.

[0072] (Acquisition part 131) The acquisition unit 131 acquires the detection results of sensors mounted on the wearable device (an example of the "first device") that the user is wearing.

[0073] (Estimation part 132) The estimation unit 132 estimates the user's context at the time the sensor detection result was acquired by the acquisition unit 131, based on the usage status of the terminal device (an example of the "second device") that the user is using.

[0074] For example, the estimation unit 132 may estimate the user's context at the time the sensor detection result was acquired by the acquisition unit 131, based on the user's service usage history.

[0075] Furthermore, for example, the estimation unit 132 may take into account the detection results detected by the sensor mounted on the terminal device 10 to estimate the user's context at the time the acquisition unit 131 acquired the sensor detection results.

[0076] (Execution section 133) The execution unit 133 derives an estimated detection result, which is estimated as a result of sensor detection during context estimation by the estimation unit 132, and performs calibration using the detection result based on the derived estimated detection result and the sensor detection result acquired by the acquisition unit 131.

[0077] For example, the execution unit 133 estimates the specific situation of user U from the difference between the actual detection result detected by the sensor 51 mounted on the wearable device 50 worn by user U and the estimated detection result of the sensor 51 corresponding to the estimated content of user U based on the usage status of the terminal device 10, and controls the service that user U is using in accordance with the estimated specific situation of user U.

[0078] For example, in the case shown in Figure 2, the execution unit 133 acquires the difference between the detection result of the sensor 51 and the estimated detection result for a certain period of time, and identifies the change in the orientation of user U's face over time from the acquired difference. The information processing device 100 then determines that if the time during which user U's face is not directly facing the display surface of the terminal device 10 exceeds a certain period of time, it estimates that user U is relatively uninterested in the video content being viewed. In this case, the execution unit 133 may pause the video content being viewed by user U and send a notification to the terminal device 10 via the communication unit 110 suggesting the playback of other video content.

[0079] Furthermore, in the case shown in Figure 2, if the execution unit 133 determines that the user U's face is not directly facing the display surface of the terminal device 10 for a certain period of time or less, it estimates that the user U is relatively interested in the video content being viewed. In this case, the execution unit 133 may, for example, send a notification to the terminal device 10 via the communication unit 110 introducing other similar video content when the user U pauses the video content being played.

[0080] [4. Processing procedure according to the embodiment] The following describes the information processing procedure performed by the information processing device 100 according to this embodiment. Figure 7 is a flowchart of an example of a processing procedure performed by the information processing device 100 according to this embodiment. The processing procedure shown in Figure 7 is performed by the control unit 130 of the information processing device 100. The processing procedure shown in Figure 7 is repeatedly performed while the information processing device 100 is running.

[0081] As shown in Figure 7, the estimation unit 132 determines whether or not the detection result of a sensor mounted on the attachment device 50 has been acquired by the acquisition unit 131 (step S101).

[0082] If the estimation unit 132 determines that the sensor detection result has been acquired by the acquisition unit 131 (step S101; Yes), it estimates the context of user U based on the usage status of the terminal device 10 by user U (step S102).

[0083] Furthermore, the estimation unit 132 determines whether or not the detection result of the target sensor corresponding to the estimation context (the sensor that detected the detection result in step S101) is not registered in the user U correspondence information stored in the correspondence information storage unit 122 (step S103).

[0084] If the estimation unit 132 determines that the detection result of the target sensor corresponding to the estimation context is not registered (step S103; Yes), it derives the estimated detection result of the target sensor when estimating the context of user U (step S104).

[0085] The execution unit 133 performs calibration using the detection results of the target sensor, based on the actual detection results of the target sensor acquired by the acquisition unit 131 and the estimated detection results of the target sensor (step S105).

[0086] The estimation unit 132 associates the information indicating the estimation context with the estimated detection result of the target sensor, registers it in the corresponding information storage unit 122 as corresponding information corresponding to user U (step S106), and ends the processing procedure shown in Figure 7.

[0087] In step S103 described above, if the estimation unit 132 determines that the detection result of the target sensor corresponding to the estimation context is not unregistered (step S103; No), it obtains the registration information of the target sensor corresponding to the estimation context from the corresponding information storage unit 122 (step S107).

[0088] The execution unit 133 performs calibration using the detection results of the target sensor based on the actual detection results of the target sensor acquired by the acquisition unit 131 and the registration information of the target sensor (step S108), and then terminates the processing procedure shown in Figure 7.

[0089] [5. Variant] The information processing apparatus, information processing method, and information processing program according to this application may be implemented in various different forms other than the embodiments described above. Modifications of the above embodiments will be described below.

[0090] (5-1. System Configuration) In the above embodiment, an example was described in which the information processing device 100 performs the information processing according to the embodiment, but the terminal device 10 may also perform the information processing according to the embodiment. In this case, the control unit 30 of the terminal device 10 may have functional units corresponding to each part of the control unit 130 of the information processing device 100.

[0091] Furthermore, although the above embodiment describes an example in which the information processing system SYS is composed of a physically separate terminal device 10 and a wearable device 50, the information processing system SYS may also be composed of a device in which the terminal device 10 and the wearable device 50 are physically integrated.

[0092] (5-2. Regarding estimated detection results) In the above embodiment, the information processing device 100 may estimate the detection result detected by the sensor 51 mounted on the wearable device 50 in the user's situation based on the user's situation when the user's context is estimated.

[0093] For example, the execution unit 133 may derive an estimated detection result corresponding to the orientation of the user's face when the user's context is estimated by the estimation unit 132, and perform calibration based on the estimated detection result and the sensor detection result acquired by the acquisition unit 131. If the user is watching video content using a video streaming service, the execution unit 133 may automatically adjust the position of the subtitle information superimposed on the video content the user is watching based on the difference between the sensor detection result and the estimated detection result corresponding to the orientation of the user's face.

[0094] Furthermore, the execution unit 133 may, for example, derive an estimated detection result corresponding to the user's posture when the user's context is estimated by the estimation unit 132, and perform calibration based on the estimated detection result and the sensor detection result acquired by the acquisition unit 131. If the user is in a web conference using a web conferencing service, the execution unit 133 may adjust the screen size and volume of the web conference based on the difference between the sensor detection result and the estimated detection result corresponding to the user's posture.

[0095] Furthermore, the execution unit 133 may, for example, derive an estimated detection result corresponding to the user's actions when the user's context is estimated by the estimation unit 132, and perform calibration based on the estimated detection result and the sensor detection result acquired by the acquisition unit 131. If the user is listening to music content using a music distribution service, the execution unit 133 may change the music content being played according to the user's actions based on the difference between the sensor detection result and the estimated detection result corresponding to the user's actions. For example, if the user is running, the music content may be automatically changed to a faster tempo or a slower tempo to match the running speed.

[0096] Furthermore, the execution unit 133 may, for example, use the user's service usage history when deriving the estimated detection result, which is estimated as the detection result of the sensor 51 when the user's context is estimated by the estimation unit 132. For example, if the execution unit 133 estimates that the user is watching a movie based on the user's service usage history, it may obtain information on the positional relationship between the seat and the screen in the movie theater from the service usage history, identify the orientation of the user's face from the obtained information, and derive the estimated detection result of the sensor 51 mounted on the wearable device 50 based on the identified orientation of the face.

[0097] (5-3. Regarding the updating of sensor detection results in the correspondence information) In the above embodiment, the information processing device 100 may include an update unit that updates the detection results of sensors stored in the corresponding information storage unit 122. For example, the update unit acquires the detection result of the sensor 51 mounted on the wearable device 50 when a reference context is detected among the contexts of user U. The update unit then updates the detection result of the sensor corresponding to the reference context among the information indicating the correspondence relationship associated with user U stored in the corresponding information storage unit 122, based on the detection result of the sensor 51 when the reference context was detected. At this time, the information processing device 100 may use the detection result of the sensor 51 when the reference context was detected to update the detection result of the sensor corresponding to the context related to the reference context. For example, if it is pre-set that user U is driving a vehicle as the reference context, the detection result of the sensor 51 at this time is acquired. The update unit then assumes that when user U is driving a vehicle, user U's face is facing forward. Therefore, the detection result of sensor 51 at this time may be used to update the detection result of sensor 51 corresponding to other relevant contexts in which user U's face is assumed to be facing forward. For example, other relevant contexts in which user U's face is assumed to be facing forward include when user U is running.

[0098] [6. Effects] The information processing device 100 according to this embodiment includes an acquisition unit 131, an estimation unit 132, and an execution unit 133. The acquisition unit 131 acquires the detection results of sensors mounted on a first device worn by the user. The estimation unit 132 estimates the user's context at the time the sensor detection results were acquired by the acquisition unit 131, based on the usage status of the second device being used by the user. The execution unit 133 derives an estimated detection result, which is estimated as the sensor detection result at the time the context was estimated by the estimation unit 132, and performs calibration using the detection results based on the derived estimated detection result and the sensor detection result acquired by the acquisition unit 131.

[0099] Furthermore, the estimation unit 132 estimates the user's context at the time the sensor detection result was acquired by the acquisition unit 131, based on the user's service usage history.

[0100] Furthermore, the estimation unit 132 takes into account the detection results detected by the sensor mounted on the second device to estimate the user's context at the time the sensor detection results were acquired by the acquisition unit 131.

[0101] For this reason, the information processing device 100 according to the embodiment can, by processing performed by each of the above-described parts, or by any combination of processing performed by each of the parts, estimate the specific situation of user U from the difference between the actual detection result detected by the sensor 51 mounted on the wearable device 50 worn by user U and the estimated detection result of the sensor 51 corresponding to the estimated content of user U based on the usage status of the terminal device 10, and control the service being used by user U in accordance with the estimated specific situation of user U. As a result, the information processing device 100 can improve the usability for users of various online services.

[0102] [7. Hardware Configuration] Furthermore, the information processing devices according to the embodiments and their respective modifications described above are implemented by a computer 1000 having a configuration such as that shown in Figure 8. Figure 8 is a hardware configuration diagram showing an example of a computer that implements the functions of the information processing devices according to the embodiments and their respective modifications.

[0103] Computer 1000 is connected to an output device 1010 and an input device 1020, and has a configuration in which an arithmetic unit 1030, a primary storage device 1040, a secondary storage device 1050, an output interface 1060, an input interface 1070, and a network interface 1080 are connected by a bus 1090.

[0104] The arithmetic unit 1030 operates based on programs stored in the primary storage device 1040 and the secondary storage device 1050, as well as programs read from the input device 1020, and executes various processes. The primary storage device 1040 is a memory device, such as RAM, that temporarily stores data used by the arithmetic unit 1030 for various calculations. The secondary storage device 1050 is a storage device where data used by the arithmetic unit 1030 for various calculations and various databases are registered, and is implemented using ROM (Read Only Memory), HDD, flash memory, etc.

[0105] The output IF1060 is an interface for transmitting information to be output to output devices 1010, such as monitors and printers, and is implemented using connectors of standards such as USB (Universal Serial Bus), DVI (Digital Visual Interface), and HDMI (High Definition Multimedia Interface). The input IF1070 is an interface for receiving information from various input devices 1020, such as mice, keyboards, and scanners, and is implemented using, for example, USB.

[0106] The input device 1020 may also be a device that reads information from, for example, an optical recording medium such as a CD (Compact Disc), DVD (Digital Versatile Disc), or PD (Phase Change Rewritable Disk), a magneto-optical recording medium such as an MO (Magneto-Optical disk), tape media, magnetic recording media, or semiconductor memory. Furthermore, the input device 1020 may be an external storage medium such as a USB memory stick.

[0107] Network IF1080 receives data from other devices via network N and sends it to the arithmetic unit 1030, and also transmits data generated by the arithmetic unit 1030 to other devices via network N.

[0108] The arithmetic unit 1030 controls the output device 1010 and the input device 1020 via the output IF 1060 and the input IF 1070. For example, the arithmetic unit 1030 loads a program from the input device 1020 or the secondary storage device 1050 onto the primary storage device 1040 and executes the loaded program.

[0109] For example, when the computer 1000 functions as the information processing device 100 according to the embodiment, the arithmetic unit 1030 of the computer 1000 realizes the same functions as the control unit 130 by executing a program (for example, an information processing program) loaded on the primary storage device 1040. That is, the arithmetic unit 1030 realizes the processing by the information processing device 100 according to the embodiment in cooperation with the program (for example, an information processing program) loaded on the primary storage device 1040.

[0110] [8. Other] Of the processes described in the above embodiments, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically by known methods. In addition, the processing procedures, specific names, and information including various data and parameters shown in the above documents and drawings can be changed at will unless otherwise specified.

[0111] Furthermore, the components of each illustrated device are functionally conceptual and do not necessarily need to be physically configured as shown. In other words, the specific forms of distribution and integration of each device are not limited to those shown, and all or part of them can be functionally or physically distributed and integrated in any unit according to various loads and usage conditions.

[0112] Furthermore, the embodiments described above can be combined as appropriate, provided that the processing content is not contradictory.

[0113] Although embodiments of the present application have been described in detail above with reference to several drawings, these are illustrative examples, and the present invention can be implemented in various other forms with modifications and improvements based on the knowledge of those skilled in the art, starting with the embodiments described in the disclosure section of the invention.

[0114] Furthermore, the terms "section, module, unit" mentioned above can be replaced with "means" or "circuit," etc. For example, a control unit can be replaced with a control means or a control circuit. [Explanation of Symbols]

[0115] N Network SYS Information Processing System 10 Terminal devices 50 Wearing devices 100 Information Processing Devices 110 Communications Department 120 Storage section 121 Usage history storage unit 122 Corresponding Information Storage Unit 130 Control Unit 131 Acquisition Department 132 Estimation Department 133 Execution Department

Claims

1. An acquisition unit that acquires detection results from sensors mounted on the first device worn by the user, An estimation unit estimates the user's context at the time the sensor detection result was acquired by the acquisition unit, based on the usage status of the second device being used by the user. An execution unit derives an estimated detection result estimated as a detection result of the sensor during the estimation of the context by the estimation unit, and performs calibration to control the service being used by the user based on the derived estimated detection result and the sensor detection result acquired by the acquisition unit. It has, The execution unit is, As part of the calibration, the system estimates the user's level of interest in the service being used based on the change over time between the sensor detection result acquired by the acquisition unit and the derived estimated detection result, and then performs information processing to control the service according to the estimated level of interest. An information processing device characterized by the following:

2. The estimation unit, Based on the user's service usage history, the acquisition unit estimates the user's context at the time the sensor's detection result was obtained. The information processing apparatus according to feature 1.

3. The estimation unit, Taking into account the detection results detected by the sensor mounted on the second device, the acquisition unit estimates the user's context at the time the sensor's detection results were acquired. The information processing apparatus according to feature 2.

4. A method of information processing performed by a computer, An acquisition process to acquire detection results from sensors mounted on the first device worn by the user, An estimation step, based on the usage status of the second device being used by the user, estimates the user's context at the time the detection result of the sensor was obtained by the acquisition step, An execution step which derives an estimated detection result that is estimated as a detection result of the sensor during the estimation of the context by the estimation step, and performs a calibration to control the service being used by the user based on the derived estimated detection result and the detection result of the sensor acquired by the acquisition step. Includes, The execution step described above is: As part of the calibration, based on the change over time in the difference between the detection result of the sensor acquired in the acquisition step and the derived estimated detection result, the user's level of interest in the service being used is estimated as a specific situation of the user, and information processing is executed to control the service according to the estimated level of interest. An information processing method characterized by the following:

5. On the computer, A procedure for acquiring detection results from sensors mounted on the first device worn by the user, An estimation procedure for estimating the user's context at the time the detection result of the sensor was obtained by the acquisition procedure, based on the usage status of the second device being used by the user, An execution procedure which derives an estimated detection result estimated as a detection result of the sensor during the estimation of the context by the estimation procedure, and performs calibration to control the service being used by the user based on the derived estimated detection result and the detection result of the sensor acquired by the acquisition procedure. Make it run, The execution procedure described above is: As part of the calibration, the degree of interest the user has in the service being used is estimated as a specific situation of the user, based on the change over time of the difference between the detection result of the sensor obtained by the acquisition procedure and the derived estimated detection result, and information processing is performed to control the service according to the estimated level of interest. An information processing program characterized by the following features.

Images