Companion analysis device, information provision system, analysis method, and analysis program

Abstract

This technology provides an analysis of a user's travel companions without requiring the user to input information about them. [Solution] The analysis device for analyzing a user's companions comprises: a location acquisition unit that acquires location information indicating the location of multiple users for a predetermined period; a head behavior acquisition unit that acquires head behavior information indicating the head behavior of the user at the location indicated by the acquired location information; a determination unit that uses the location information and head behavior information to determine the companions of a specific user among the multiple users; and an output unit that outputs the companions of the specific user.

Description

Technical Field

[0001] The present disclosure relates to a companion analysis device, an information providing system, an analysis method, and an analysis program.

Background Art

[0002] For example, as described in Patent Document 1, a technique for providing information corresponding to the position information of a user is known. Further, Patent Document 1 discloses a technique for aggregating and analyzing street direction information such as image data and sound data associated with the position information.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] There may be a case of providing tourist information corresponding to the position information of a user. In this case, in tourism measures, information indicating the companions of the user has been required without asking the user for an input regarding the companions.

Means for Solving the Problems

[0005] The present disclosure can be realized in the following forms.

[0006] (1) According to the form of this disclosure, an analytical device is provided for analyzing the companions of a user. This analytical device comprises: a location acquisition unit that acquires location information indicating the location of a user for a predetermined period of time for a plurality of users; a head behavior acquisition unit that acquires head behavior information indicating the head behavior of the user at the location indicated by the acquired location information; a determination unit that uses the location information and the head behavior information to determine the companions of a specific user among the plurality of users; and an output unit that outputs the companions of the specific user. This type of analysis device uses location information and head movement information to identify companions. Therefore, it can analyze companions without requiring the user to input information about them. (2) In the analysis apparatus of the above form, the determination unit may determine that any of the other users among the plurality of users that are located at a distance of 1 or less from the specific user and are facing the same direction as the specific user are companions of the specific user. This configuration allows us to identify users who are highly likely to be looking at the same object as a particular user as they are likely to be companions. (3) In the analysis apparatus of the above form, the determination unit may determine that any of the other users among the plurality of users whose distance from the specific user is less than or equal to the second threshold distance and who is facing the specific user is a companion of the specific user. This format allows us to identify users who are highly likely to be conversing with a specific user as companions. (4) In the analysis apparatus of the above form, the determination unit may determine that any of the other users among the plurality of users that are located at a distance of 3 or less from the specific user and that exhibit behavior similar to that of the specific user are companions of the specific user. This format allows us to identify users who are highly likely to have participated in sightseeing at the same time as a specific user as companions. (5) In the analysis apparatus of the above form, the apparatus further includes an operation acquisition unit that acquires operation information indicating the operation content and timing of operation of information devices held by each of the multiple users, and the determination unit may determine that a user who performed the same operation as the specified user at the same time is a companion of the specified user among the users determined to be companions of the specified user. This type of analysis device uses operational information in addition to location information and head movement information to determine the companions of a specific user, thus enabling more accurate identification of companions. (6) In the analysis device of the above form, the output unit may output at least one of the following: whether or not the specific user has companions, the number of companions of the specific user, and information that can identify the user who is a companion of the specific user. This format allows for the output of information such as whether or not there are companions, the number of companions, and other identifiable information. [Brief explanation of the drawing]

[0007] [Figure 1] This is a diagram showing the configuration of the information provision system. [Figure 2] This is a diagram illustrating how to detect the user's head movements. [Figure 3] This is a flowchart illustrating an example of the analysis process. [Figure 4] This is an explanatory diagram for Condition 1. [Figure 5] This is an explanatory diagram for condition 2. [Figure 6] This is an explanatory diagram for condition 3. [Figure 7] This is a diagram showing the configuration of the information provision system in the second embodiment. [Figure 8] This flowchart shows an example of the analysis process in the second embodiment. [Figure 9] This flowchart shows an example of the analytical process in the third embodiment. [Figure 10] This figure shows an example of a list output by the output unit. [Modes for carrying out the invention]

[0008] A. First Embodiment: Figure 1 shows the configuration of the information provision system 10 according to this embodiment. The information provision system 10 provides information for guidance and explanation to three users, UA, UB, and UC. In this embodiment, the information provision system 10 provides information by sound. The information provision system 10 includes an analysis device 100, an information device T, and a sound playback device 200. The following description will use the example of a user carrying the information device T around a tourist destination.

[0009] In this embodiment, the information device T provides information to the user UA. The information device T is, for example, a smartphone. The information device T records sound data, which is information provided to the user. The information device T has a first information device TA, a second information device TB, and a third information device TC. The first information device TA is owned by the user UA. The second information device TB is owned by the user UB. The third information device TC is owned by the user UC. The information device T can provide information to the user at any time. In this embodiment, the information device T provides information to the user when a predetermined operation is performed by the user.

[0010] The sound playback device 200 is a portable device that outputs sound represented by a signal received from the information device T. The sound playback device 200 is a device worn on the user's head, for example, headphones worn on both ears. The sound playback device 200 has a first sound playback device 200A, a second sound playback device 200B, and a third sound playback device 200C. The first sound playback device 200A is worn on the head of user UA. The second sound playback device 200B is worn on the head of user UB. The third sound playback device 200C is worn on the head of user UC. The user wears the sound playback device 200 on their head and moves around the tourist area.

[0011] In this embodiment, the sound playback device 200 has a sensor 210 that detects the movement of the head of the user wearing the sound playback device 200. The sensor 210 detects acceleration, angle, and angular velocity. The acceleration, angle, and angular velocity detected by the sensor 210 are transmitted to the analysis device 100 via the information device T. Note that the information device T and the sound playback device 200 may be an integrated device.

[0012] The analysis device 100 is a device that analyzes the user's companions. In this embodiment, a companion is a member of a group touring a tourist destination, and does not include a person who happened to talk while touring the tourist destination. The analysis device 100 is composed of a computer including a central processing unit (CPU 120), a RAM, and a ROM. The CPU 120 executes a program pre-installed in the storage unit 110 of the analysis device 100, thereby realizing the functions of the position acquisition unit 121, the head movement acquisition unit 122, the determination unit 123, and the output unit 124. The analysis device 100 includes an input / output interface 130 to which a communication device (not shown) for communicating with the outside by wireless communication is connected. However, part or all of the functions of these units may be realized by a hardware circuit. In this embodiment, the analysis device 100 is a server device.

[0013] The position acquisition unit 121 acquires position information indicating each position of the user. In this embodiment, the position acquisition unit 121 acquires position information including the longitude and latitude indicating the positions of each user UA, user UB, and user UC. More specifically, the position acquisition unit 121 acquires position information periodically detected by the information device T using a global navigation satellite system (GNSS) such as GPS (Global Positioning System).

[0014] The head movement acquisition unit 122 acquires head movement information indicating the movement of the user's head at each position of the user. The "movement of the user's head" includes nodding, looking up, suddenly turning the head in a certain direction, and the user facing the head in a certain direction for a predetermined time or more. In the present disclosure, the head movement information includes information indicating the direction of the user's head. The direction of the user's head can be represented by a roll angle, a pitch angle, and a yaw angle. In the present embodiment, the head movement acquisition unit 122 acquires head movement information via the sensor 210 included in the sound playback device 200. More specifically, the head movement acquisition unit 122 detects the roll angle, the pitch angle, and the yaw angle from the measured values of the acceleration and the measured values of the angular velocity measured by the sensor 210, and acquires the movement of the user's head.

[0015] FIG. 2 is a diagram for explaining a method of detecting the movement of the user's head. A rotation axis along the front-rear direction of the user, more specifically, a rotation axis along the direction extending from the ventral surface to the dorsal surface through the user's nose is defined as the roll axis, a rotation axis along the left-right direction of the user is defined as the pitch axis, and a rotation axis along the gravitational direction from directly above the user's head is defined as the yaw axis. The movement of the user tilting the neck can be represented as a rotation around the roll axis. The movement of the user nodding can be represented as a rotation around the pitch axis. The movement of the user turning around can be represented as a rotation around the yaw axis. In the present embodiment, the movement of the user's head is represented by the rotation angles of three axes.

[0016] In the present embodiment, when the range of the roll angle is set to 0 degrees when the user is standing facing forward, it is from +30 degrees to -30 degrees. When the range of the pitch angle is set to 0 degrees when the user is standing facing forward, it is from +50 degrees to -60 degrees. The range of the yaw angle is initially set with true north as 0 degrees and can take all values from 0 degrees to 360 degrees. Also, the angular velocity takes an absolute value regardless of the rotation direction and is represented by a positive value.

[0017] The determination unit 123 (see Figure 1) uses location information and head movement information to determine the presence or absence of companions of a specific user among multiple users. Details of the companion determination will be described later. In this embodiment, the determination unit 123 determines whether or not the user UA has companions.

[0018] The output unit 124 outputs the companions of the specific user determined by the determination unit 123. In this embodiment, the output unit 124 outputs whether or not the user UA has companions to an external device (not shown) via the input / output interface 130.

[0019] Figure 3 is a flowchart illustrating an example of the analysis process. The analysis process involves the analysis device 100 analyzing the user's companions. This process is executed, for example, after all users have finished receiving information from their respective information devices T.

[0020] The position acquisition unit 121 performs a "position acquisition process" in step S100 to acquire position information.

[0021] In step S110, the head movement acquisition unit 122 performs a "head movement acquisition process" to acquire head movement information. Note that steps S100 and S110 are not limited to this order and can be performed in any order, and may be performed in parallel.

[0022] In step S120, the head movement acquisition unit 122 uses the position information acquired in step S100 and the head movement information acquired in step S110 to perform a "determination process" to determine the companions of a specific user, user UA.

[0023] The determination unit 123 determines, for example, that a user who meets the companion conditions is a companion of a specific user. As companion conditions, one or more of the following conditions can be adopted.

[0024] <Condition 1> The distance to the specific user must be below a predetermined first threshold distance, and the user must be facing the same direction as the specific user. <Condition 2> Being located at a predetermined second threshold distance or less from a specific user, and facing that specific user. <Condition 3> The user is located at a predetermined third threshold distance or less from a specific user, and is behaving similarly to that specific user.

[0025] The predetermined first threshold distance in condition 1 above is an arbitrarily determined distance, for example, 10m. The determination unit 123 determines that a user who is estimated to be looking at a predetermined space including the position where a specific user is estimated to be looking is facing the same direction as the specific user. The position where a user is estimated to be looking is calculated using the user's position and the direction of the user's head. A user who satisfies condition 1 above has a high probability of looking at the same object that the specific user is fixated on, and therefore has a high probability of being a companion.

[0026] Figure 4 is an explanatory diagram of condition 1 described above. Below, we will explain using the example of a case where user UA is a specific user and user UB is a companion of user UA. The distance L1 between user UA and user UB is less than or equal to the first threshold distance. User UA and user UB are both facing the same object Tg. Since user UB satisfies condition 1 above, it is determined that user UB is a companion of user UA.

[0027] The predetermined second threshold distance in condition 2 above is an arbitrarily determined distance, for example, 5m. The second threshold distance is preferably a distance at which conversation is possible. The determination unit 123 determines, for example, that a user who is presumed to be looking at a specific user and is also presumed to be looking at a specific user is facing the specific user. Direction of the specific user's head A user who satisfies condition 2 above has a high probability of conversing with the specific user, and therefore has a high probability of being a companion.

[0028] Figure 5 is an explanatory diagram of condition 2 described above. Below, we will explain using the example of a case where user UA is a specific user and user UB is a companion of user UA. The distance L2 between user UA and user UB is less than or equal to the second threshold distance. User UA and user UB are facing each other. Since user UB satisfies condition 2 above, it is determined that user UB is a companion of user UA.

[0029] The predetermined third threshold distance in condition 3 above is an arbitrarily determined distance, for example, 10m. A similar behavior in condition 3 above is, for example, nodding. The speed of head movement and the amount of head movement along the pitch axis do not need to be the same. Users who satisfy condition 3 above are highly likely to have been provided with information at the same time as a specific user, and therefore highly likely to have participated in the tour at the same time as that specific user. For this reason, they are highly likely to be companions.

[0030] Figure 6 is an explanatory diagram for condition 3 described above. Below, we will explain using the example of a case where user UA is a specific user and user UB is a companion of user UA. The distance L3 between user UA and user UB is less than or equal to the third threshold distance. User UA and user UB nod at the same time. Since user UB satisfies condition 3 above, it is determined that user UB is a companion of user UA.

[0031] Furthermore, the conditions 1 to 3 and other conditions described above can be combined as appropriate to create companion conditions. In addition, users who meet the companion conditions may be determined to be companions of a specific user. That is, companions of a specific user can be determined to be companions of that specific user. In this embodiment, condition 1 described above is adopted as the companion condition.

[0032] In this embodiment, the determination unit 123 determines in step S120 whether or not there is a companion of the specific user. More specifically, the determination unit 123 determines whether or not there is a user who meets the companion conditions.

[0033] In step S130, the output unit 124 performs an "output process" to output the companions determined in step S120. In this embodiment, the output unit 124 outputs whether or not a specific user has companions.

[0034] According to the analysis device 100 of this embodiment described above, the presence or absence of a companion is determined using location information and head movement information. Therefore, the presence or absence of a companion can be analyzed without requiring the user to input information about the companion. Furthermore, head movement information is obtained from the acceleration, angle, and angular velocity detected by the sensor 210. Therefore, compared to obtaining head movement information using video footage of the user, head movement information can be obtained without requiring complicated processing.

[0035] B. Second Embodiment: The analysis apparatus 100B of the second embodiment shown in Figure 7 differs from the first embodiment in that it includes an operation acquisition unit 125, but the other configurations are the same. The analysis process in the second embodiment shown in Figure 8 differs from the first embodiment in that in step S115, operation information indicating the operation content and timing of the information device T held by each user is acquired, but the other steps are the same.

[0036] The operation acquisition unit 125 (see Figure 7) acquires operation information. In this embodiment, the operation content indicated by the operation information is an operation related to information provision by the information device T, and includes, for example, an operation to start providing information to the information device T and an operation to stop providing information to the information device T.

[0037] The operation acquisition unit 125 acquires operation information in step S115 (see Figure 8). Steps S100 to S115 are not limited to this order and can be performed in any order, and may also be performed in parallel.

[0038] In step S125, the determination unit 123 uses the position information acquired in step S100, the head movement information acquired in step S110, and the operation information acquired in step S115 to determine the companion of user UA. In addition, the following condition 4 is added as a companion condition. In this embodiment, the operation acquisition unit 125 determines that a user who satisfies the above-mentioned conditions 1 and 4 is a companion of a specific user.

[0039] <Condition 4> At the same time, the same operation that a specific user performed on information device T is being performed on information device T.

[0040] The same timing in condition 4 above does not need to be exactly simultaneous; it includes a time difference that can be treated as simultaneous. Users who satisfy condition 4 above are highly likely to have received the information at the same time as a specific user, and therefore are highly likely to be companions.

[0041] According to the analysis device 100B of this embodiment described above, since the accompanying person of a specific user is determined using operation information, the accompanying person can be determined with greater accuracy.

[0042] C. Third Embodiment: The third embodiment differs from the first embodiment in that, in the analysis process, the determination unit 123 determines not only the companions of a specific user, but also the companions of all users. The configuration of the information provision system 10 in the third embodiment is the same as that of the information provision system 10 in the first embodiment, so a description of the configuration of the information provision system 10 will be omitted.

[0043] Figure 9 is a flowchart showing an example of the analysis process in the third embodiment. In step S117, the analyzer 100 sets the counter variable N to 1. Note that steps S100 to S117 are not limited to this order and can be performed in any order, and may also be performed in parallel.

[0044] In step S127, the determination unit 123 determines the companions of the Nth user (where the counter variable N is a natural number).

[0045] In step S128, the analyzer 100 determines whether the identification of all users' companions has been completed. If the identification is complete, that is, if the counter variable N is equal to the total number of users, the output unit 124 proceeds to step S137 and outputs the identification result. On the other hand, if the identification is not complete, that is, if the counter variable N is less than the total number of users, the analyzer 100 increments the counter variable N by 1 in step S129 and returns to step S127.

[0046] Figure 10 shows an example of a list output by the output unit 124 in step S137. The list has fields for "User ID" and "Presence or Absence of Companions". "A" represents user UA. The "Presence or Absence of Companions" field records either "Yes" or "No". "Yes" indicates that there are companions, and "No" indicates that there are no companions.

[0047] According to the analysis device 100 of the third embodiment described above, it is possible to analyze not only the companions of a specific user among multiple users, but also the companions of all users.

[0048] D. Other embodiments: (D1) In the embodiment described above, the information provided to the user is stored in the information device T. However, the information may also be stored in an external server.

[0049] (D2) In the embodiment described above, the information provision system 10 is equipped with a sound playback device 200, and the information provision system 10 provides information to users UA, UB, and UC via the sound playback device 200. However, the information provision system 10 is not limited to this and does not need to be equipped with a sound playback device 200. In this case, the information provision system 10 may provide information, for example, through an information device T, in the form of images or text.

[0050] (D3) In the embodiment described above, the information provision system 10 provides information to three users. However, it is not limited to this, and the information provision system 10 may provide information to two or four or more users.

[0051] (D4) In the embodiment described above, the information device T provides information to the user when a predetermined operation is performed by the user. However, the information device T may also provide information to the user UA when it receives instructions from other components of the information provision system 10.

[0052] (D5) In the embodiment described above, the information device T may select the information to provide according to the user's location. In this case, the information device T stores range information representing a predetermined area on the map, and provided information which is information provided to the user and associated with the range information.

[0053] (D6) In the embodiment described above, the sound playback device 200 is headphones. However, it is not limited to headphones; the sound playback device 200 may be, for example, earphones.

[0054] (D7) In the embodiment described above, the position acquisition unit 121 acquires the user's location information detected by each information device T using GNSS. However, the position acquisition unit 121 may also acquire the user's location information detected by other components of the information provision system 10. In addition, the location information may be obtained using images captured by the imaging device.

[0055] (D8) In the embodiment described above, the head behavior acquisition unit 122 obtains head behavior information by using the movement and orientation of each user's head detected by the sensors 210 acquired from each information device T. However, the head behavior acquisition unit 122 may also acquire user behavior obtained by other components of the information provision system 10. Furthermore, the head behavior information may be obtained using images captured by the imaging device.

[0056] (D9) In the embodiment described above, the determination unit 123 may determine that the companion condition is met if the time for which the above-described conditions are met is continuously equal to or greater than a predetermined threshold time, and / or if the number of times the above-described conditions are met is equal to or greater than a predetermined threshold number of times. The companion condition may also be further defined as the time for which the distance from a specific user is within or equal to a predetermined fourth threshold distance is equal to or greater than a predetermined threshold time.

[0057] (D10) In the embodiment described above, the threshold distance for the companion condition is a predetermined distance. However, the threshold distance may be determined according to the size of the area to be visited, the speed of movement of the specific user, and the location of the specific user. For example, the analysis device 100 can set the threshold distance when the road width of the road where the specific user is located is the first width to be greater than the threshold distance when the road width of the road where the specific user is located is the second width, which is smaller than the first width. This makes it possible to set a threshold distance that is appropriate for the location of the specific user.

[0058] (D11) In the embodiment described above, the determination unit 123 determines that a user who is looking at a position estimated to be seen by a specific user is facing the same direction as the specific user. However, the determination unit 123 may also determine that a user whose yaw angle indicating the direction of their head is in the range of +20 degrees to -20 degrees from the yaw angle indicating the direction of the specific user's head is facing the same direction as the specific user. Furthermore, the determination unit 123 determines that a user who is estimated to be seen by a specific user and who is also estimated to be looking at a specific user is facing the specific user. However, the determination unit 123 may also determine that a user whose yaw angle indicating the direction of their head is in the range of +160 degrees to +200 degrees from the yaw angle indicating the direction of the specific user's head is facing the specific user.

[0059] (D12) In the embodiment described above, the output unit 124 outputs whether or not a specific user has any companions. However, the output unit 124 may also output the number of companions of the specific user or information that can identify the users who are companions. Preferably, the output unit 124 outputs at least one of the following: whether or not a specific user has any companions, the number of companions of the specific user, and information that can identify the users who are companions of the specific user.

[0060] (D13) In the embodiment described above, the output unit 124 may output companions of a specific user for predetermined periods. More specifically, the output unit 124 may output users UA who meet the companion conditions as companions for predetermined periods. In this case, the determination unit 123 determines the companions for predetermined periods.

[0061] (D14) In the first embodiment described above, the analysis process is performed after all users have finished receiving information from their respective information devices T. However, the analysis process may be performed at any time, for example, while the information provision system 10 is in operation. In this case, the analysis device 100 may periodically repeat steps S100 and S110 and perform step S120 after all users have finished receiving information from their respective information devices T.

[0062] This disclosure is not limited to the embodiments described above, and can be implemented in various configurations without departing from its spirit. For example, the technical features in the embodiments corresponding to the technical features in each form described in the summary of the invention can be replaced or combined as appropriate in order to solve some or all of the above-described problems, or to achieve some or all of the above-described effects. Furthermore, if a technical feature is not described as essential in this specification, it can be deleted as appropriate. [Explanation of Symbols]

[0063] 10...Information provision system, 100, 100B...Analysis device, 110...Storage unit, 120...CPU, 121...Position acquisition unit, 122...Head movement acquisition unit, 123...Determination unit, 124...Output unit, 125...Operation acquisition unit, 130...Input / output interface, 200...Sound playback device, 200A...First sound playback device, 200B...Second sound playback device, 200C...Third sound playback device, 210...Sensor, T...Information device, TA...First information device, TB...Second information device, TC...Third information device

Claims

1. An analytical device that analyzes the companions of a user, A location acquisition unit acquires location information indicating the location of multiple users over a predetermined period, A head behavior acquisition unit acquires head behavior information indicating the behavior of the user's head at the user's location indicated by the acquired location information, A determination unit that uses the location information and the head movement information to determine the companion of a specific user among the multiple users, An analysis device comprising an output unit that outputs the names of the companions of the specified user.

2. The analytical apparatus according to claim 1, The determination unit is an analysis device that determines, among all other users of the plurality of users, a user whose distance from the specific user is less than or equal to a first threshold distance and who is facing the same direction as the specific user is a companion of the specific user.

3. An analytical apparatus according to claim 1 or claim 2, The determination unit is an analysis device that determines, among all other users of the plurality of users, a user whose distance from the specific user is less than or equal to a second threshold distance and who is facing the specific user is a companion of the specific user.

4. An analytical apparatus according to claim 1 or claim 2, The determination unit is an analysis device that determines, among all other users of the plurality of users, a user whose distance from the specific user is less than or equal to a third threshold distance and whose behavior is similar to that of the specific user is a companion of the specific user.

5. The analytical apparatus according to claim 1 or claim 2, further, The system includes an operation acquisition unit that acquires operation information indicating the operation content and timing of the information device held by each of the aforementioned multiple users. The determination unit is an analysis device that determines, among users determined to be companions of the specific user, to be companions of the specific user if they performed the same operation as the specific user at the same time.

6. An analytical apparatus according to claim 1 or claim 2, The output unit is an analysis device that outputs at least one of the following: whether or not the specific user has companions, the number of companions of the specific user, and information that can identify the users who are companions of the specific user.

7. It is an information provision system, An information device that is attached to the head of each of multiple users and provides predetermined information to the multiple users, A location acquisition unit acquires location information indicating the location of the multiple users for a predetermined period, A head behavior acquisition unit acquires head behavior information, which indicates the movement of the user's head at the user's location indicated by the acquired location information, via sensors in the information device. A determination unit that uses the location information and the head movement information to determine the companion of a specific user among the multiple users, An information provision system including an output unit that outputs the names of companions of the specified user.

8. This is an analytical method for analyzing the companions of a user. A location acquisition process to acquire location information indicating the location of multiple users over a predetermined period, A head behavior acquisition step involves acquiring head behavior information that indicates the behavior of the user's head at the user's location indicated by the acquired location information, A determination step of determining the companion of a specific user among the multiple users using the location information and the head movement information, An analysis method comprising an output step of outputting whether or not the aforementioned specific user has any companions.

9. This is an analysis program that analyzes the companions of the user, A location acquisition function that acquires location information indicating the location of multiple users over a predetermined period, A head behavior acquisition function that acquires head behavior information indicating the behavior of the user's head at the user's location indicated by the acquired location information, A determination function that uses the location information and the head movement information to determine the companion of a specific user among the multiple users, An output function that outputs the names of the companions of the aforementioned specific user, and an analysis program that enables a computer to perform this function.

Images