Information processor, method for processing information, and information processing program

The system addresses the challenge of recommending stores based on user reactions and location by analyzing biometric data to suggest suitable stores post-content viewing, enhancing user convenience with tailored recommendations.

JP2024162452APending Publication Date: 2024-11-21TOYOTA BOSHOKU KK

Patent Information

Application Number
JP2023077962
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-10
Publication Date
2024-11-21

AI Technical Summary

Technical Problem

Existing systems fail to recommend stores that satisfy user desires during or after viewing content, particularly when the store is located far from the user's current location.

Method used

An information processing system that acquires biometric information, analyzes user reactions to content scenes, estimates desired services, and recommends stores based on location information using a controller, server, and communication devices.

Benefits of technology

Enables the recommendation of stores that meet user desires after content viewing, improving convenience by considering congestion and offering coupons, thus enhancing user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024162452000001_ABST
    Figure 2024162452000001_ABST
Patent Text Reader

Abstract

To recommend a shop which satisfies a user when the user is viewing a content or after the user is viewing a content.SOLUTION: A server (10) includes: a reaction analysis unit (114) for analyzing a reaction of a user to each scene of a content on the basis of biological information of a user; a desire estimation unit (115) for estimating a service that the user desires; and a shop search unit (116) for searching for a shop which provides a service on the basis of positional information of the user.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to an information processing device, an information processing method, and an information processing program. [Background technology]

[0002] Conventionally, there is known an invention that collects information reflecting a user's potential interests from the user's natural behavior or reactions when viewing content, and recommends products and the like that the user might be interested in (for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2018-32252 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, the invention described in Patent Document 1 does not use the user's location information when recommending products that the user is interested in, and therefore may recommend stores located far away from the user's current location. As such, it is difficult for the invention described in Patent Document 1 to recommend stores that satisfy the user's desires during or after viewing content.

[0005] One aspect of the present disclosure aims to recommend stores that satisfy a user's desires during or after viewing of content. [Means for solving the problem]

[0006] In order to solve the above problems, an information processing device according to one embodiment of the present disclosure is an information processing device including a controller, which acquires biometric information of a user watching content, analyzes the user's reaction to each scene constituting the content based on the biometric information, estimates a service desired by the user based on the results of the analysis, searches for a store that provides the service based on the service and location information of the user, and recommends the searched store to the user.

[0007] In order to solve the above problems, an information processing method according to one aspect of the present disclosure includes the steps of acquiring biometric information of a user watching content, analyzing the user's reaction to each scene that constitutes the content based on the biometric information, estimating a service desired by the user based on the results of the analysis, searching for a store that provides the service based on the service and location information of the user, and recommending the searched store to the user.

[0008] In order to solve the above problems, an information processing program according to one embodiment of the present disclosure causes a computer to execute the following processes: acquiring biometric information of a user watching content; analyzing the user's reaction to each scene that constitutes the content based on the biometric information; estimating a service desired by the user based on the results of the analysis; searching for a store that provides the service based on the service and location information of the user; and recommending the searched store to the user.

[0009] The information processing device according to each aspect of the present disclosure may be realized by a computer. In this case, a control program for realizing the information processing device on a computer by causing the computer to operate as each unit (software element) of the information processing device, and a computer-readable recording medium on which the control program is recorded, also fall within the scope of the present disclosure. Effect of the Invention

[0010] According to one aspect of the present disclosure, it is possible to recommend a store that satisfies a user's desires during or after viewing of content. [Brief description of the drawings]

[0011] [Figure 1] 1 is a schematic configuration diagram illustrating an example of an information processing system according to a first embodiment of the present disclosure. [Diagram 2] 1 is a block diagram illustrating configurations of a server, a communication device, and a sheet according to a first embodiment of the present disclosure. [Diagram 3] 4 is a sequence chart showing an operation example of the information processing system according to the first embodiment of the present disclosure. [Figure 4] 4 is a sequence chart showing an operation example of the information processing system according to the first embodiment of the present disclosure. [Diagram 5] 1 is a graph showing the relationship between movie screening time and heart rate. [Figure 6] 11 is a table illustrating the store's congestion status and available coupons. [Figure 7] 13 is an example of store-related information displayed on a display of a communication device. [Figure 8] FIG. 11 is a schematic configuration diagram illustrating an example of an information processing system according to a second embodiment of the present disclosure. [Figure 9] 13 is an example of store-related information displayed on a display mounted in a vehicle. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] [Embodiment 1] Hereinafter, the information processing system 100 according to the first embodiment of the present disclosure will be described in detail with reference to the drawings. In the description of the drawings, the same parts are given the same reference numerals and the description will be omitted.

[0013] [Configuration of information processing system 100] FIG. 1 is a schematic diagram showing an example of an information processing system 100. As shown in FIG. 1, the information processing system 100 includes a server 10, a communication network 50, seats 20 installed in a movie theater, and a communication device 40 carried by a user 30. A sensor 22 is provided on each of the seats 20. In FIG. 1, there are two seats 20 on which the sensor 22 is provided, but this is not limited thereto, and there may be one seat 20 on which the sensor 22 is provided, or three or more seats 20 on which the sensor 22 is provided. In FIG. 1, there is one user, but this is not limited thereto, and there may be many users. As the number of users increases, the number of communication devices carried by the user also increases. In addition, there may be multiple movie theaters used in the information processing system 100.

[0014] The server 10 communicates with the seat 20 and the communication device 40 via a communication network 50. The server 10 is a general-purpose computer including a CPU (Central Processing Unit) 11, a memory 12, a communication I / F 13, and a storage device 14, and these components are electrically connected via a bus (not shown). The server 10 is used for a service that provides predetermined information to a user 30. Specifically, the service that provides predetermined information is a service that recommends stores that satisfy the user's desires. The location where the server 10 is installed is not particularly limited, but the server 10 is installed, for example, in a management center of a business that operates an information providing service.

[0015] The CPU 11 is a controller that loads various programs stored in the storage device 14 into the memory 12 and executes various commands included in the programs. The memory 12 is a storage medium such as a Read Only Memory (ROM) or a Random Access Memory (RAM). The storage device 14 is a storage medium such as a Solid State Drive (SSD) or a Hard Disk Drive (HDD).

[0016] The communication I / F 13 is implemented as hardware such as a network adapter, various communication software, or a combination thereof, and is configured to realize wired or wireless communication via the communication network 50. In this embodiment, the communication network 50 is described as the Internet, but is not limited to this and other wireless communication methods may be adopted.

[0017] The sensor 22 provided in the seat 20 detects biometric information of the user 30 seated in the seat 20. In this embodiment, the heart rate is taken as an example of the biometric information. That is, the sensor 22 functions as a heart rate sensor for detecting the heart rate of the user 30 seated in the seat 20. The heart rate data of the user 30 detected by the sensor 22 is transmitted to the server 10 via the communication network 50. In the example shown in FIG. 1, the sensor 22 is provided in the seat cushion, but the location of the sensor 22 is not limited to the seat cushion. For example, the sensor 22 may be provided in the seat back. In addition, the type of the sensor 22 is not particularly limited, and a well-known optical sensor or electric sensor may be used.

[0018] In the following, when explaining the heart rate, it will be simply referred to as the "heart rate", and when treating the heart rate as data, it will be referred to as the "heart rate data".

[0019] A user 30 receives a service provided by the server 10 using a communication device 40. An application for receiving the service is installed in the communication device 40. Hereinafter, the application for receiving the service will be simply referred to as an "app."

[0020] Next, the detailed configurations of the server 10, the sheet 20, and the communication device 40 will be described with reference to FIG.

[0021] [Configuration of communication device 40] As shown in Fig. 2, the communication device 40 includes a communication I / F 41, an application 42, a GPS receiver 43, and a display 44. The communication device 40 is, for example, a portable device such as a smartphone or a tablet terminal. However, the communication device 40 is not limited thereto and may be a wearable device. The communication I / F 41 has the same function as the communication I / F 13, and communicates with the server 10 via a communication network 50. Although not shown in the figure, the communication device 40 also includes a CPU, a memory, and a storage device, similar to the server 10. In this embodiment, the communication device 40 will be described as a smartphone.

[0022] The application 42 is used to recommend a store that provides a service that satisfies the user's desire. The application 42 is realized by a CPU provided in the communication device 40 reading and executing a dedicated application program from a storage device provided in the communication device 40. When using the application 42, the user 30 inputs his / her own information into the application 42 and registers it in advance. Such pre-registration is a well-known technology and is adopted in many applications. By performing pre-registration, unique identification information (e.g., a user ID) is given to the user 30, and the user 30 becomes able to use the application 42. The information input in advance is not particularly limited, and may be, for example, the name, nickname, sex, address, telephone number, and email address of the user 30. However, the method of realizing the application 42 is not limited to this. For example, the communication device 40 may access the server 10 that provides the function of the application 42 to receive the function, and display the execution result of the function transmitted from the server 10 on the browser.

[0023] The GPS receiver 43 receives radio waves from artificial satellites to obtain terrestrial position information of the communication device 40. The position information of the communication device 40 obtained by the GPS receiver 43 is transmitted to the server 10 via the communication I / F 41 at any timing. Note that since the user 30 carries the communication device 40, the position information of the communication device 40 is synonymous with the position information of the user 30.

[0024] [Sheet 20 Configuration] The seat 20 includes a communication I / F 21 and a sensor 22. The communication I / F 21 has the same function as the communication I / F 13, and communicates with the server 10 via the communication network 50. The sensor 22 has been described above, so a description thereof will be omitted. In this embodiment, the communication I / F 21 and the sensor 22 are provided on each of the seats 20, and each of the seats 20 communicates with the server 10 independently, but the present invention is not limited to this. For example, a computer that aggregates data detected by the sensor 22 provided on each of the seats 20 may be installed in a movie theater, and the computer may transmit the data detected by the sensor 22 to the server 10 in a lump. With this configuration, it is not necessary to provide a communication I / F 21 on each seat, and it is sufficient to provide the communication I / F 21 only on the computer.

[0025] [Server 10 configuration] The CPU 11 of the server 10 includes, as examples of multiple functions, a schedule information acquisition unit 111, a location information acquisition unit 112, a biometric information acquisition unit 113, a response analysis unit 114, a desire estimation unit 115, a store search unit 116, a store selection unit 117, and an output unit 118.

[0026] The schedule information acquisition unit 111 acquires schedule information indicating the schedule of the user 30. As a method of acquiring the schedule information, for example, the schedule information acquisition unit 111 can access a calendar application installed in the communication device 40 to acquire the schedule information.

[0027] The location information acquisition unit 112 acquires location information of the user 30 from the communication device 40 .

[0028] The biometric information acquiring unit 113 identifies the seat 20 in which the user 30 is seated based on the schedule information acquired by the schedule information acquiring unit 111, and acquires biometric information from the identified seat 20 when the user 30 is watching a movie. The biometric information acquiring unit 113 outputs the acquired biometric information to the reaction analyzing unit 114.

[0029] The reaction analysis unit 114 analyzes the reaction of the user 30 to a scene in the movie while the user 30 is watching the movie, based on the biometric information acquired from the biometric information acquisition unit 113. The analysis result is stored and accumulated in the analysis log database 142. The reaction analysis unit 114 outputs information indicating the analysis result to the desire estimation unit 115.

[0030] The desire estimation unit 115 compares the scene to which the user 30 reacted with information on the scene to which the user reacted, based on the analysis result acquired from the reaction analysis unit 114, and estimates the desire of the user 30. The desire estimation unit 115 outputs information indicating the estimation result to the store search unit 116.

[0031] The store search unit 116 searches for stores that provide services that satisfy the desires of the user 30 within a predetermined range from the current location of the user 30, based on the location information acquired by the location information acquisition unit 112 and the information acquired from the desire estimation unit 115. The store search unit 116 outputs information indicating the search results to the store selection unit 117.

[0032] The store selection unit 117 selects a store that satisfies a predetermined condition from among the multiple stores searched for by the store search unit 116. The store selection unit 117 outputs information about the selected store to the output unit 118.

[0033] The output unit 118 transmits information about the store selected by the store selection unit 117 to the communication device 40.

[0034] The storage device 14 of the server 10 stores a content database 141, an analysis log database 142, a map database 143, and a store database 144.

[0035] Content database 141 stores information about various types of content. The content includes video content such as movies, television programs, and video on demand videos, as well as audio-only content such as radio programs and music. Specific examples of information about content will be described later. It should be noted that the information is not the content itself, but merely information about the content.

[0036] The analysis log database 142 stores and accumulates the analysis results from the reaction analysis unit 114 .

[0037] The map database 143 stores map information necessary for route guidance, such as road information and facility information.

[0038] The store database 144 stores information such as the store name, store address, store telephone number, store congestion status, and coupons that can be used at the store.

[0039] The content database 141, the map database 143, and the store database 144 may be stored in a storage device of another server, not in the storage device 14 of the server 10. When the content database 141, the map database 143, and the store database 144 are stored in a storage device of another server, the server 10 can acquire various pieces of information stored in the content database 141, the map database 143, and the store database 144 by referring to the storage device of the other server.

[0040] [Example of operation of information processing system 100] Next, with reference to sequence charts in FIGS. 3 and 4, an example of the operation of the information processing system 100 when the user 30 watches a movie at a movie theater will be described.

[0041] In step S101, the communication device 40 accepts a touch operation on the display 44 by the user 30, and starts the application 42. After starting the application 42, the communication device 40 accepts input of a user ID and a password, which are authentication information.

[0042] The authentication information input to the communication device 40 is transmitted to the server 10. The server 10 accesses the storage device 14 and determines whether the authentication information is correct or not (step S102). The authentication information is stored in the storage device 14. If the authentication information input to the communication device 40 matches the content stored in the storage device 14, the server 10 permits login to the application 42.

[0043] The process proceeds to step S103, where the server 10 acquires schedule information indicating the schedule of the user 30. For example, the server 10 acquires the schedule information by accessing a calendar application installed in the communication device 40. In this way, the server 10 can acquire schedule information of the user 30, such as "Watch BB (movie title) at AA movie theater on XX date at XX time, reserved seat number: CC."

[0044] In step S104, the communication device 40 transmits the location information of the user 30 to the server 10. The process of step S104 is performed at any timing after the user 30 logs in to the application 42. As an example of the arbitrary timing, the communication device 40 may transmit the location information of the user 30 to the server 10 at regular time intervals.

[0045] The server 10 acquires the location information of the user 30 from the communication device 40 (step S105).

[0046] The process of step S103 enables the server 10 to grasp the schedule of the user 30. Furthermore, the process of step S105 enables the server 10 to grasp the location of the user 30. Specifically, the server 10 can grasp from the location information of the user 30 that the user 30 is in the AA movie theater, and can grasp from the schedule information of the user 30 that the user 30 will soon watch a movie called BB and that the seat number in which the user 30 will be sitting is CC.

[0047] The process proceeds to step S106, where the server 10 acquires information about the movie that the user 30 is about to watch from the content database 141. The information about the movie stored in the content database 141 includes information such as the title, genre, director's name, actor's name, scene ID given to each scene to identify the scene, text associated with the scene ID and explaining the content of the scene, the screening start time, and the screening end time.

[0048] In step S107, the seat 20 transmits the heart rate data of the user 30 detected by the sensor 22 to the server 10 via the communication I / F 21 while the movie is being shown.

[0049] The server 10 acquires the heart rate data of the user 30 from the seat 20 (step S108). As described above, the server 10 knows the number of the seat 20 in which the user 30 is seated, and therefore, it is sufficient to acquire the heart rate data of the user 30 from the seat 20 with the corresponding number.

[0050] In step S109, the server 10 analyzes the reaction of the user 30 to the scene of the movie. In this analysis, the heart rate of the user 30 is used as the biological information of the user 30. When the user 30 reacts to the scene of the movie, the internal state of the user 30 becomes excited. The heart rate is related to the excited state of a human. In general, when the excited state increases, the autonomic nerves become sympathetic dominant, and adrenaline and the like secreted from the sympathetic nerves increases, and the heart rate rises.

[0051] [Method for Analyzing User 30's Reaction] An example of a method for analyzing User 30's reaction to a movie scene will be described with reference to FIG. 5. The horizontal axis in FIG. 5 indicates the time when the movie is being screened. More specifically, the times T1, T2... on the horizontal axis indicate the one-minute time intervals when the movie is being screened. For example, if the screening time of the movie is from 10:00 to 12:00, time T1 indicates the one minute from 10:00 to 10:01, and time T2 indicates the one minute from 10:01 to 10:02.

[0052] The vertical axis in FIG. 5 indicates the heart rate of User 30. The heart rate is generally expressed as the number of heartbeats per minute, and the unit is BPM (Beats Per Minute). The heart rate in this embodiment is also treated as the number of heartbeats per minute. That is, FIG. 5 is a graph plotting the heart rate data of User 30 every minute during movie viewing. Note that the heart rate data used may be data per second instead of per minute.

[0053] The magnitude relationship of the heart rates is HR1 < HR2 < HR3 < HR4 < HR5. HR1 indicates the normal heart rate of User 30. This means that User 30 is not reacting to the scenes such as T1, T2, etc., that is, not excited.

[0054] HR2 is a threshold value for analyzing whether User 30 is reacting to the movie scene, and is a value appropriately set through experiments, simulations, etc. When the heart rate is greater than HR2, it is analyzed that User 30 is reacting to the movie scene. In the example shown in FIG. 5, HR2 is set to a value greater than the normal heart rate, but it is not limited to this, and HR2 may be set to a value similar to the normal heart rate. That is, HR1 = HR2 may also be possible.

[0055] In FIG. 5, the scenes in which heart rates exceeding HR2 were detected are the three scenes at times T5, T10, and T15. The heart rate detected in the scene at time T5 is HR3, the heart rate detected in the scene at time T10 is HR5, and the heart rate detected in the scene at time T15 is HR4. The server 10 analyzes that the user 30 reacted to the scenes at times T5, T10, and T15, i.e., was excited. It is considered that the higher the heart rate, the greater the degree of excitement of the user 30. For this reason, it is analyzed that, among the three scenes at times T5, T10, and T15, the user 30 was most excited by the scene at time T10.

[0056] 5, assume that no heart rate exceeding HR2 was detected in scenes from time T18 onward. In other words, assume that throughout the entire movie, the only scenes in which a heart rate exceeding HR2 was detected were the three scenes at times T5, T10, and T15.

[0057] In step S110, the server 10 compares the scene to which the user 30 responded with information about the scene, and estimates the desire of the user 30.

[0058] [Desire estimation method] An example of a method for estimating the desire of the user 30 will be described with reference to Fig. 5. The server 10 estimates the desire of the user 30 by analyzing what object the user 30 reacted to in the scene to which the user 30 reacted. Since the scenes to which the user 30 reacted are identified as the scenes at times T5, T10, and T15 in Fig. 5, these three scenes are the objects of analysis.

[0059] First, the server 10 acquires the scene IDs of the three scenes to which the user 30 responded. The scene ID is a number given to each scene in order to identify the scene.

[0060] The scene ID is linked to information indicating the contents of the scene. Therefore, the server 10, which has acquired the scene ID, can grasp the contents of the scene. Here, it is assumed that the information linked to the scene ID of the scene at time T5 is text information saying "the actor is eating grilled meat." In this case, the server 10 can extract the feature "grilled meat" from the text information. Based on the extracted feature "grilled meat" and the analysis result that the user 30 responded to the scene at time T5, the server 10 can estimate that the user 30 wants grilled meat.

[0061] Also assume that the information linked to the scene ID of the scene at time T10 is text information saying "an actor is eating a hamburger." In this case, the server 10 can extract the feature "hamburger" from the text information. Based on the extracted feature "hamburger" and the analysis result that the user 30 responded to the scene at time T10, the server 10 can infer that the user 30 wants a hamburger.

[0062] Also assume that the information linked to the scene ID of the scene at time T15 is text information saying "an actor is eating ramen." In this case, the server 10 can extract the feature "ramen" from the text information. Based on the extracted feature "ramen" and the analysis result that the user 30 responded to the scene at time T15, the server 10 can infer that the user 30 wants ramen.

[0063] Although it has been explained that the scene ID is linked to text information indicating the contents of the scene, such linking is not essential. For example, the server 10 may analyze the video associated with the scene ID using a well-known video analysis method such as pattern matching, and extract the characteristics of the scene from the video. For example, if the scene shows an actor eating a hamburger, the server 10 can extract the characteristic "hamburger" by using a well-known video analysis method. The server 10 can estimate that the user 30 wants a hamburger based on the extracted characteristics and the analysis result that the user 30 responded.

[0064] In step S111, the server 10 searches for a store that provides a service that satisfies the desire of the user 30 within a predetermined range from the current location of the user 30 based on the desire and location information of the user 30. The "predetermined range from the current location of the user 30" is, for example, within a shopping mall where an AA movie theater is a tenant. By the process of step S110, it is estimated that the user 30 wants a hamburger, ramen, or grilled meat. Therefore, the "store that provides a service that satisfies the desire of the user 30" is a store that provides a hamburger, a store that provides ramen, and a store that provides grilled meat. The server 10 refers to the map database 143 to search for a store that provides a hamburger, a store that provides ramen, and a store that provides grilled meat within the shopping mall.

[0065] The server 10 may notify the user 30 of all the searched stores. In this embodiment, in order to improve the convenience of the user 30 compared to a case in which all the searched stores are simply notified to the user 30, the server 10 selects a store to recommend to the user 30 from among the searched stores. The server 10 notifies the user 30 of the selected store.

[0066] [How to select a store] An example of a method for selecting a store to be recommended to user 30 will be described with reference to FIG. 6. Here, a method for selecting a store using congestion status and coupons will be described. FIG. 6 shows the congestion status and coupon information of the store searched for in the process of step S111. As shown in FIG. 6, in the process of step S111, it is assumed that six stores, hamburger store A, hamburger store B, ramen store C, ramen store D, yakiniku restaurant E, and yakiniku restaurant F, are searched for in the shopping mall where AA movie theater is a tenant.

[0067] The server 10 refers to the store database 144 and acquires information indicating the congestion status of the six found stores (step S112). The information indicating the congestion status is periodically transmitted from each store to the server 10 and stored in the store database 144. By referring to the store database 144, the server 10 can grasp that the congestion status of each store is as follows: That is, at hamburger store A, 80% or more of the seats are vacant. Hamburger store B is crowded, with less than 20% of the seats available. Ramen store C is relatively empty, with more than 50% of the seats available. Ramen store D has more than 80% of the seats available. Yakiniku store E is relatively empty, with more than 50% of the seats available. Yakiniku store F is crowded, with less than 20% of the seats available.

[0068] The server 10 can select a store to recommend to the user 30 according to the congestion status of the store. For example, the server 10 may select a store if 50% or more of the seats are available. If 50% or more of the seats are available, the user 30 is likely to be able to receive service without waiting, so recommending a store with 50% or more of the seats available contributes to improving the convenience of the user 30. In FIG. 6, the stores with 50% or more of the seats available are the hamburger store A, the ramen store C, the ramen store D, and the yakiniku store E, so the server 10 may select these stores. Selecting a store with 50% or more of the seats available means, in other words, not selecting a store with less than 50% of the seats available. In other words, selecting a store according to the congestion status of the store leads to avoiding the store being crowded or deserted, and is also beneficial for the store operator. Note that the value of 50% is just an example and can be changed as appropriate.

[0069] Next, a method of selecting a store using a coupon will be described. The server 10 refers to the store database 144 and acquires coupon information for the six stores found (step S113). The coupon information, like the information indicating the congestion state, is transmitted from each store to the server 10 and stored in the store database 144. By referring to the store database 144, the server 10 can ascertain that each store offers the following coupons. That is, hamburger store A and hamburger store B offer a coupon for a 10% discount on food and drink. Ramen store C offers a coupon for a 15% discount on food and drink. Ramen store D and yakiniku store F do not offer any coupons. Yakiniku store E offers a coupon for one free drink.

[0070] The server 10 can select a store to recommend to the user 30 based on a coupon offered by the store. For example, the server 10 may select a store that offers a coupon if the store offers the coupon. By using a coupon, the user 30 can enjoy financial benefits, so recommending a store that offers a coupon contributes to improving the convenience of the user 30. In FIG. 6, the stores that offer coupons are hamburger store A, hamburger store B, ramen store C, and yakiniku restaurant E, so the server 10 may select these stores. Note that selecting a store that offers a coupon means, in other words, not selecting a store that does not offer a coupon.

[0071] Although the method of selecting a store using only the information indicating the crowded state or only the coupon information has been described, the present invention is not limited thereto, and the server 10 may select a store to recommend to the user 30 using both the information indicating the crowded state and the coupon information. For example, the server 10 may select a store where 50% or more of the seats are available and the store offers coupons. If the store has 50% or more of the seats available and offers coupons, the user 30 is more likely to be able to receive services without waiting, and can further enjoy financial benefits from the coupons. In FIG. 6, the stores where 50% or more of the seats are available and the store offers coupons are the hamburger store A, the ramen store C, and the yakiniku restaurant E, so the server 10 may select these stores.

[0072] As described above, the server 10 selects a store that satisfies a predetermined condition from the stores found in the process of step S111 (step S114).

[0073] In step S115, the server 10 transmits information about the store selected in the process of step S114 to the communication device 40. The timing of transmitting the information about the selected store to the communication device 40 is not particularly limited, but for example, the server 10 can transmit the information about the selected store to the communication device 40 when the movie screening ends. This allows the user 30 to head to the store that provides the desired service after watching the movie. If a store is recommended based on congestion information, the store is vacant, so the time it takes to receive the desired service is shortened.

[0074] In step S116, information about the store selected in the process of step S114 is displayed on the display 44 of the communication device 40. Here, with reference to FIG. 7, an example of information about the store displayed on the display 44 of the communication device 40 will be described. As shown in FIG. 7, four notifications 60 to 63 are displayed on the display 44 of the communication device 40. The notification 60 indicates the store selected by the server 10 in the process of step S114, i.e., the category and number of stores recommended to the user 30. In the notification 60, the store category is restaurants, and the number of stores is three. In the example shown in FIG. 7, information about the store selected using both information indicating the congestion status and coupon information is displayed. That is, information about the hamburger store A, the ramen store C, and the yakiniku restaurant E described in FIG. 6 is displayed on the display 44 of the communication device 40.

[0075] The information about the store includes, for example, the name of the store, the location of the store, how busy the store is, and coupons that can be used at the store. Therefore, as shown in notification 61, the name of burger store A, the location of burger store A, how busy the store is, and coupons that can be used at burger store A are displayed as information about burger store A.

[0076] As shown in notification 62, information about ramen shop C includes the name of ramen shop C, the location of ramen shop C, how busy ramen shop C is, and coupons that can be used at ramen shop C.

[0077] As shown in notification 63, information about yakiniku restaurant E includes the name of yakiniku restaurant E, the location of yakiniku restaurant E, how busy yakiniku restaurant E is, and coupons that can be used at yakiniku restaurant E.

[0078] In the example shown in Fig. 7, of the three restaurants, hamburger restaurant A is displayed at the top. This is because, as explained in Fig. 5, the scene in the movie that was analyzed as being the most exciting for the user 30 was the scene in which "an actor is eating a hamburger." In other words, the server 10 can notify the user 30 that the store offering the service related to the feature of the scene that excited the user 30 will be displayed at the top.

[0079] [Effects] As described above, according to the information processing system 100 according to the first embodiment, the following advantageous effects can be obtained.

[0080] A server 10 in an information processing system 100 acquires biometric information of a user 30 viewing content, and analyzes the user's 30 reaction to each scene constituting the content based on the biometric information. The server 10 estimates a service desired by the user 30 based on the analysis result, and searches for a store that provides the service desired by the user 30 based on the service desired by the user 30 and the location information of the user 30. The server 10 recommends the searched store to the user 30 when viewing of the content ends.

[0081] According to the above configuration, by using the location information of the user 30, it is possible to recommend a store that provides a service that satisfies the desire of the user 30 after viewing the content.

[0082] In addition, the server 10 may select a store that satisfies a predetermined condition from among the searched stores based on at least one of information indicating the congestion status of the searched store and coupon information that can be used at the searched store, and recommend the selected store to the user 30.

[0083] According to the above configuration, convenience for the user 30 can be improved by using at least one of the information indicating the congestion state and the coupon information.

[0084] Additionally, the server 10 may select from the searched stores a store that has a predetermined number of available seats or more, or may select from the searched stores a store that has available coupons.

[0085] According to the above configuration, the user 30 is more likely to be able to receive services without waiting. In addition, it helps to prevent the store from being crowded or deserted, which is also beneficial for the store manager. Furthermore, the user 30 can enjoy financial benefits by using the coupon.

[0086] Furthermore, the server 10 may change the benefit that the user 30 obtains from the coupon depending on the level of the user 30's reaction to the movie scene. For example, at the hamburger restaurant A shown in FIG. 6, the coupon is for a 10% discount on the food and drink bill. If the user 30 has a high reaction to the movie scene, for example, if the detected heart rate is HR5 shown in FIG. 5, it is considered that the user 30 will enter the hamburger restaurant A even if the benefit obtained from the coupon is small. Therefore, the server 10 may change the discount rate of the coupon presented to the user 30 from 10% off to 5% off.

[0087] On the other hand, if the user 30 does not respond well, for example if the detected heart rate is higher than but very close to HR2 shown in Fig. 5, it is considered that the user 30 will not enter the hamburger restaurant A unless the profit obtained by the coupon is high. Therefore, the server 10 may change the discount rate of the coupon presented to the user 30 from 10% off to 15% off.

[0088] In this way, when the user 30 has a strong reaction to a scene of the content, the server 10 may reduce the benefit that the user 30 obtains from the coupon usable at the selected store, compared to when the user 30 has a weak reaction. This can realize the provision of coupons that are useful to both the user 30 and the store operator.

[0089] Also, although it has been described that a store with less than a predetermined number of vacant seats (e.g., 50%) is not selected, this is not limiting. For example, if the user 30 has a strong reaction to a scene in a movie, it is considered that the user 30 has a strong desire. It is considered that such a user 30 wants to eat food related to the characteristics of the scene he or she reacted to, even if there is a waiting time.

[0090] If the user 30 responds strongly to a scene in the movie, for example if the detected heart rate is HR5 shown in Fig. 5, the server 10 may select a store that provides a service that satisfies the desires of the user 30 regardless of the congestion situation and recommend it to the user 30. In light of Fig. 6, the server 10 may select hamburger restaurant B and recommend it to the user 30. In this way, it is possible to recommend a store that provides a service that satisfies the desires of the user 30.

[0091] "When the user 30 has a high reaction to a scene in the movie, a store that provides a service that satisfies the desire of the user 30 is selected regardless of the congestion situation" may be rephrased as "When the user 30's reaction is greater than a threshold, a store that provides a service that satisfies the desire of the user 30 is selected even if the number of available seats is less than a predetermined value." The "threshold" here is, for example, a threshold set between HR4 and HR5 shown in FIG. 5.

[0092] Also, although it has been described that a store with a predetermined number (e.g., 50%) or more of seats available is selected, this is not limiting. When the heart rate is higher than HR2 shown in FIG. 5, it is analyzed that the user 30 reacted to a scene in the movie, and when the heart rate is higher than HR2 but very close to HR2, it is considered that the user 30 desires food related to the characteristics of the scene to which he reacted, but the desire is not strong. Therefore, the closer the heart rate is to HR2, the larger the predetermined value may be. For example, when the heart rate is close to HR2, the server 10 may select only stores with 80% or more of the seats available.

[0093] In addition, although an example of searching for a store that provides a service that satisfies the desire of the user 30 in a shopping mall has been described, the search range is not limited to this. For example, if the user 30 comes to the shopping mall by vehicle, the user 30 may want to enjoy a meal on the way back from the shopping mall. In this case, the server 10 may change the search range according to the transportation means of the user 30. For example, the search range may be widened when the transportation means is a vehicle, and narrowed when the transportation means is walking. This allows the server 10 to recommend stores within a range that the user 30 can travel. As for a method of identifying the transportation means of the user 30, the transportation means may be identified from the transition of the position information of the user 30, or the user 30 may be asked to input the transportation means into the app 42. Regardless of the type of transportation means, the search range is based on the current location of the user 30.

[0094] Also, although the sensor 22 provided in the seat 20 detects the heart rate, the method of detecting the heart rate is not limited to this. For example, if the communication device 40 is a wearable device and is provided with a sensor capable of detecting the heart rate, the sensor may detect the heart rate. When detecting the heart rate in this manner, there is no need to provide the sensor 22 in the seat 20.

[0095] Also, the category of the store is not limited to restaurants. Some users 30 may react to music played in a movie. In this case, the server 10 may recommend a music shop that sells the music to which the user 30 reacted. Some users 30 may react to a character that appeared in the movie. In this case, the server 10 may recommend a character shop that sells goods of the character to which the user 30 reacted.

[0096] [Embodiment 2] Next, a second embodiment of the present disclosure will be described below. For ease of explanation, the same reference numerals will be given to members having the same functions as those described in the first embodiment, and the description thereof will not be repeated.

[0097] 8 is a schematic configuration diagram showing an example of an information processing system 200 according to embodiment 2. As shown in FIG.

[0098] The vehicle 70 is a vehicle with an automatic driving function, and a user 31 and a user 32 are aboard the vehicle 70. It is assumed that the automatic driving function installed in the vehicle 70 does not require monitoring by an occupant. In other words, it is assumed that the level of automatic driving is so-called level 3 or higher.

[0099] Vehicle 70 is equipped with a front seat 71 in the front row, a rear seat 72 in the second row, a GPS receiver 74 that acquires position information of vehicle 70, a display 75 capable of displaying various information, and a communication I / F 76.

[0100] The communication I / F 76 has the same functions as the communication I / F 13 , and communicates with the server 10 via the communication network 50 .

[0101] The GPS receiver 74 receives radio waves from artificial satellites to obtain ground position information of the vehicle 70. The position information of the vehicle 70 obtained by the GPS receiver 74 is transmitted to the server 10 via the communication I / F 76 at any timing.

[0102] The front seat 71 on which the user 31 is seated is a rotatable seat. In Fig. 8, the front seat 71 faces rearward. Therefore, the user 31 seated on the front seat 71 and the user 32 seated on the second row rear seat 72 face each other. The front seat 71 and the rear seat 72 are provided with sensors 73 for detecting the heart rates of the seated users 31 and 32.

[0103] The heart rate data of the user 31 and the user 32 detected by the sensor 73 is transmitted to the server 10 via the communication I / F 76 .

[0104] It is assumed that user 31 and user 32 are watching a movie shown on display 75. If this movie is distributed from server 10, server 10 can identify the movie that user 31 and user 32 are watching, and can obtain information about the movie from content database 141.

[0105] The server 10 acquires heart rate data of the user 31 and the user 32 while they are watching a movie from the sensor 73. Next, the server 10 analyzes the reactions of the user 31 and the user 32 to the scenes of the movie. The analysis method is the same as that in the first embodiment, so the explanation is omitted.

[0106] Here, it is assumed that the analysis shows that the user 31 responded to the scene "where an actor is eating a hamburger." In this case, since it is estimated that the user 31 wants a hamburger, the server 10 searches for restaurants that provide hamburgers and are located in the traveling direction of the vehicle 70 based on the position information and route information of the vehicle 70. The search range is not particularly limited, but is, for example, within a radius of 10 km from the position of the vehicle 70. The reason for searching for restaurants that are located in the traveling direction of the vehicle 70 is that they are easy to stop by.

[0107] The server 10 selects a store that satisfies a predetermined condition from among the searched stores. The predetermined conditions are congestion status and coupons as described in the first embodiment. The selection method is the same as in the first embodiment, so the description will be omitted.

[0108] The server 10 determines whether the vehicle 70 has approached the selected store based on the position information of the vehicle 70. As a method of determining the approach, for example, when the distance between the vehicle 70 and the selected store becomes shorter than a predetermined distance, it may be determined that the vehicle 70 has approached the selected store. The server 10 transmits information about the selected store to the vehicle 70 at the time when the vehicle 70 approaches the selected store. The information about the store transmitted from the server 10 is displayed on the display 75. Now, with reference to FIG. 9, an example of the information about the store displayed on the display 75 will be described.

[0109] As shown in Fig. 9, map information and five notifications 751 to 755 are displayed on display 75. On the map, the location of hamburger restaurant G, which is the selected store, and the name of hamburger restaurant G are displayed. Notification 751 indicates that vehicle 70 is approaching a store recommended to user 31.

[0110] In the notification 752, the name of the hamburger restaurant G, the congestion status of the hamburger restaurant G, coupons that can be used at the hamburger restaurant G, and the distance to the hamburger restaurant G are displayed.

[0111] The notification 753 indicates a suggestion to the user 31. The user 31 performs a touch operation on the notification 754 or the notification 755 to decide whether or not to change the destination.

[0112] In this way, the server 10 related to the information processing system 200 determines whether or not the vehicle 70 in which the user 31 is riding has approached the selected store based on the location information of the vehicle 70, and recommends the selected store to the user 31 at the time when the vehicle 70 approaches the selected store.

[0113] According to the above configuration, a store that provides a service that satisfies the desires of the user 31 can be recommended in real time while the user 31 is viewing the content. This allows the user 31 to head to the store that provides the desired service while viewing the content. If a store is recommended based on congestion information, the store is not crowded, so the time it takes to receive the desired service is reduced.

[0114] In addition, there may be cases where two users (user 31 and user 32) are riding in the vehicle 70, and user 31 and user 32 react to different scenes. In this case, the server 10 may recommend a store that provides a service that satisfies the desire of the user who reacts more strongly to the scene, i.e., the user who has a higher detected heart rate.

[0115] Furthermore, when three or more users are in the vehicle 70, the server 10 may determine the store to recommend by majority vote. For example, assume that three users are in the vehicle 70, and two of these users are estimated to want hamburgers, and the remaining user is estimated to want ramen. In this case, since the number of users wanting hamburgers is greater than the number of users wanting ramen, the server 10 may recommend a store that provides hamburgers. Furthermore, the server 10 may add up the heart rates of users who desire the same service, set priorities in the order of the total heart rates, and recommend stores that provide the service according to the set priorities.

[0116] In addition, when three or more users are riding in the vehicle 70, each user may react to a different scene. In this case, the server 10 may recommend a store that provides a service that satisfies the desire of the user who has the greatest reaction to the scene, i.e., the user with the highest detected heart rate.

[0117] [Software implementation example] The function as the information processing device (server 10) is a program for causing a computer to function as the information processing device, and can be realized by a program for causing a computer to function as each control block of the information processing device.

[0118] In this case, the information processing device includes a computer having at least one device (e.g., a processor) and at least one storage device (e.g., a memory) as hardware for executing the program. The computer executes the program to realize each function described in each embodiment.

[0119] The program may be recorded in one or more computer-readable recording media, not temporarily. The recording media may or may not be included in the information processing device. In the latter case, the program may be supplied to the information processing device via any wired or wireless transmission medium.

[0120] In addition, some or all of the functions of each control block can be realized by a logic circuit. For example, an integrated circuit in which a logic circuit that functions as each control block is formed is also included in the scope of the present disclosure. In addition, the functions of each control block can be realized by, for example, a quantum computer.

[0121] Furthermore, each process described in each embodiment may be executed by AI (Artificial Intelligence). In this case, the AI ​​may be operated on an information processing device or on another device (e.g., an edge computer or a cloud server).

[0122] The present disclosure is not limited to the above-described embodiments, and various modifications are possible within the scope of the claims. Embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of the present disclosure.

[0123] For example, the biometric information of the user 30 used for analyzing the reaction of the user 30 to a scene of the content is not limited to the heart rate. The biometric information may be the voice of the user 30. The server 10 may analyze the user 30's voice saying "This hamburger looks delicious" while watching the content, and analyze that the user 30 has reacted to the scene of the content.

[0124] The server 10 may also analyze the user 30's reaction to the content scene by taking into account the user 30's heart rate, heartbeat interval, facial expression, blood pressure, or body temperature. The server 10 may also analyze the user 30's reaction to the content scene by using the user 30's heart rate, heartbeat interval, facial expression, blood pressure, or body temperature. The heartbeat interval, facial expression, blood pressure, or body temperature may be used alone or in any combination. When the excitement level increases, blood pressure or body temperature may increase. Therefore, by taking into account blood pressure, body temperature, etc., it is possible to accurately analyze the user 30's reaction to the content scene. The heartbeat interval here means the time interval between the peak of the so-called R wave and the peak of the next R wave. [Explanation of symbols]

[0125] 100, 200 Information Processing System 10 Server 20 sheets 30 users 40 Communication Equipment 70 vehicles

Claims

1. An information processing device including a controller, The controller: Acquire biometric information of a user viewing the content, Analyzing a user's reaction to each scene constituting the content based on the biometric information; estimating a service desired by the user based on a result of the analysis; Searching for a store that provides the service based on the service and location information of the user; Recommending the searched store to the user; Information processing device.

2. The controller: selecting a store that satisfies a predetermined condition from among the searched stores based on at least one of information indicating the congestion status of the searched stores and coupon information that can be used at the searched stores; Recommending the selected store to the user; The information processing device according to claim 1 .

3. The controller selects a store having a predetermined number of vacant seats or more from among the searched stores, or selects a store having an available coupon from among the searched stores. The information processing device according to claim 2 .

4. The controller reduces a benefit obtained by the user from a coupon available at the selected store when the user's response is large, compared to when the user's response is small. The information processing device according to claim 2 .

5. the controller selects a store that provides the service even if the number of available seats is less than a predetermined number when the reaction of the user is greater than a threshold value; The information processing device according to claim 2 .

6. the controller recommends the selected store to the user when viewing of the content is completed; The information processing device according to claim 2 .

7. The controller: determining whether the vehicle in which the user is riding has approached the selected store based on location information of the vehicle; recommending the selected store to the user when the vehicle approaches the selected store; The information processing device according to claim 2 .

8. acquiring biometric information of a user viewing the content; analyzing a user's reaction to each scene constituting the content based on the biometric information; estimating services desired by the user based on a result of the analysis; A step of searching for a store that provides the service based on the service and location information of the user; and recommending the searched store to the user. Information processing methods.

9. A process of acquiring biometric information of a user viewing content; A process of analyzing a user's reaction to each scene constituting the content based on the biometric information; A process of estimating a service desired by the user based on a result of the analysis; A process of searching for a store that provides the service based on the service and location information of the user; A process of recommending the searched store to the user; An information processing program that causes a computer to execute the above.

Citation Information

Patent Citations

  • Viewing user log accumulation system, viewing user log accumulation server, and viewing user log accumulation method

    JP2018032252A

Cited By

  • Program and prediction system

    JP2026178961A