Information processing device, information processing system, information processing method, and program

Abstract

To enable setting of appropriate travel routes.SOLUTION: An information processing device is provided, comprising a video image acquisition unit for acquiring a video image of the outside of a traveling vehicle, a location information acquisition unit for acquiring location information of the vehicle, a person detection unit for detecting a person on the basis of a face image included in the video image acquired by the video image acquisition unit, a line-of-sight information acquisition unit for acquiring information on a line-of-sight of the person detected by the person detection unit, and a route setting unit for associating the location information with the information on the line-of-sight to set a route to be followed.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present disclosure relates to an information processing device, an information processing system, and an information processing method. [Background technology]

[0002] There are advertising vehicles that run while displaying advertisements for products, etc. By driving while doing so, they advertise products to pedestrians and others.

[0003] For example, Patent Document 1 discloses a method for increasing the ripple effect of advertisements displayed on a display device mounted on a vehicle. The present invention discloses a technology that can appropriately evaluate the effectiveness of advertising while also providing a high level of accuracy. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2013-20432 Summary of the Invention [Problem to be solved by the invention]

[0005] Depending on the content of the advertisement on the advertising vehicle, the attributes of the person who pays attention to the advertisement (e.g., age and gender) The advertising vehicle's route, day of the week, time, and weather conditions also change. The number and attributes of pedestrians on the road change depending on the type of advertisement. Even if you drive a car with advertisements displayed on it, depending on the content of the advertisements and the route you are driving, There is a possibility that the effect will not be achieved. and setting an appropriate driving route based on information about the attributes of people who pay attention to the advertisement. is desired.

[0006] The present disclosure provides an information processing device and an information processing system that can set an appropriate driving route, and an information processing method. [Means for solving the problem]

[0007] An information processing device according to an aspect of the present disclosure is configured to: an image acquisition unit that acquires an image of the outside; a position information acquisition unit that acquires position information of the vehicle; a person detection unit that detects a person based on a face image included in the video acquired by the video acquisition unit; a gaze direction determining unit that determines the gaze direction of the person detected by the person detection unit; The attention determination unit determines the degree of attention to the vehicle based on the direction of the line of sight determined by the attention determination unit. and a vehicle attention level determination unit that associates the position information with the vehicle attention level and sets a route to be traveled. and a path setting unit.

[0008] An information processing system according to an aspect of the present disclosure includes: an information processing device according to an aspect of the present disclosure; and a server device that acquires vehicle information from the information processing device.

[0009] An information processing method according to an aspect of the present disclosure includes: a step of acquiring an outside image, a step of acquiring position information of the vehicle, and detecting a person based on a face image included in the image; and and determining a vehicle attention level for the vehicle based on the determined line of sight direction. determining a route to be traveled by associating the position information with the vehicle attention level; and setting the [Effects of the Invention]

[0010] According to the present disclosure, an appropriate driving route can be set. [Brief explanation of the drawings]

[0011] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of an information processing system according to the first embodiment. [Figure 2] FIG. 2 is a block diagram showing an example of the configuration of the information processing device according to the first embodiment. [Figure 3] FIG. 3 is a diagram for explaining a method for determining the attention level. [Figure 4] FIG. 4 is a diagram for explaining a method for determining the degree of attention by performing weighting. [Figure 5] FIG. 5 is a diagram for explaining a method for determining the ratio of people who paid attention to an advertisement. [Figure 6] FIG. 6 is a diagram for explaining the attention level information. [Figure 7] FIG. 7 is a block diagram showing an example of the configuration of the server device according to the first embodiment. [Figure 8A] FIG. 8A is a flowchart showing an example of the flow of attention level determination processing by the information processing device according to the first embodiment. [Figure 8B] FIG. 8B is a flowchart showing an example of the flow of a display process for a recommended travel route performed by the information processing device according to the first embodiment. [Figure 9] FIG. 9 is a flowchart showing an example of the flow of processing by the information processing device according to the first embodiment. [Figure 10] FIG. 10 is a block diagram showing an example of the configuration of an information processing device according to the second embodiment. [Figure 11] FIG. 11 is a flowchart showing an example of the flow of processing by the information processing device according to the second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0012] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. The present disclosure is not limited to the embodiment, and when there are multiple embodiments, each embodiment The embodiments may be configured by combining them. The same reference numerals are used to denote the same components, and redundant explanations will be omitted. [First embodiment] The configuration of the information processing system according to the first embodiment will be described with reference to FIG. 1 is a diagram illustrating an example of the configuration of an information processing system according to a first embodiment.

[0013] As shown in FIG. 1, the information processing system 1 includes an advertising vehicle 101, an advertising vehicle 102, and ,...,Advertising display car 10 N (N is an integer of 3 or more) and a server device 20. An advertising display vehicle 101, an advertising display vehicle 102, and an advertising display vehicle 10 N and respectively, information processing device 1001, information processing device 1002, and information processing device 100 N and Information processing device 1001 to information processing device 100 N are the wireless network The network NW is communicably connected to the server device 20 via the It is the Internet network.

[0014] Advertising display car 101 ~ Advertising display car 10 N are the numbers within a predetermined area. Travel along the route. Advertising display car 101 ~ Advertising display car 10 N are displayed, respectively. The vehicle displays advertisements to pedestrians on the sidewalks while traveling along the route. Car 101 ~ Advertising Car 10 N These are sometimes collectively referred to as advertising display vehicles 10.

[0015] Information processing device 1001 to information processing device 100 N are advertising display vehicles 101 to advertising display cars 10 N The advertising display vehicles 101 to 10 N of The information processing device 1001 detects the location of the vehicle from the images captured by the vehicle-mounted cameras. Processing device 100 N are the advertisement display vehicles 101 to 103, respectively, among the extracted persons. 10 N The information processing device 1001 to the information processing device 100 extract a person who is paying attention to the information processing device 100. N teeth , and determine the attributes of the extracted person. 00 N are the advertisement display vehicles 101 to 10 N Note to Calculate the target value. N were calculated, respectively. The information processing device 1001 determines a route to be taken based on the attention level. Place 100 N and each provide the determined driving route to the user. ~Information processing device 100 N These may be collectively referred to as an information processing device 100.

[0016] The configuration of the information processing device according to the first embodiment will be described with reference to FIG. 1 is a block diagram showing an example of the configuration of an information processing device according to an embodiment.

[0017] As shown in FIG. 2, the information processing device 100 includes a communication unit 110 and a GPS (Global Positioning System). a receiving unit 120, a storage unit 130, an operation unit 140, and a display unit 150; and a control unit 160.

[0018] The communication unit 110 is, for example, a network interface card (NIC) or a communication circuit. The communication unit 110 is wirelessly connected to the network NW. The communication unit 110 transmits and receives information to and from other devices via the network NW. For example, the device transmits and receives information to and from the server device 20 via the network NW.

[0019] The GPS receiving unit 120 is composed of a GPS receiving circuit, a GPS receiving antenna, etc. The GPS receiver 120 receives the GPS signal and outputs it to the location information acquirer 124. Output to 162.

[0020] The storage unit 130 may be a DRAM (Dynamic Random Access Memory), an SRAM (Static RAM), Random Access Memory, flash memory, hard disk, etc. The storage unit 130 stores various information related to the information processing device 100. The storage unit 130 stores, for example, the information on the advertisement display vehicle on which the information processing device 100 is mounted. The storage unit 130 stores information about the attention level of a person, a person's face, etc. It stores dictionary data used for recognition.

[0021] The operation unit 140 receives various operations from the user. The operation unit 140 outputs an electrical signal corresponding to the input to the control unit 160. The operation unit 140 may be, for example, a physical switch. This is realized by devices such as switches and touch panels.

[0022] The display unit 150 displays various images. The display unit 150 displays the recommended route that an advertising display vehicle equipped with the advertising display vehicle should take. For example, liquid crystal displays (LCDs) or organic electroluminescence (EL) displays The display includes a display such as a NIC Electro-Luminescence display. When the display unit 150 is a touch panel, the operation unit 140 and the display unit 150 are integrally provided. do.

[0023] The control unit 160 includes a video acquisition unit 161, a position information acquisition unit 162, and a person detection unit 163. , a gaze direction determination unit 164, an attribute determination unit 165, an attention level determination unit 166, and a memory control unit 1 67, a route setting unit 168, an output control unit 169, an other attention level information acquisition unit 170, and an environment The information acquisition unit 171 is also provided.

[0024] The control unit 160 is a controller that controls each unit of the information processing device 100. The control unit 160 includes, for example, a CPU (Central Processing Unit), an MPU (Microprocessor Unit), For example, the control unit 160 is implemented by a processor such as an internal The processor reads the various programs stored in the memory device in RAM (Random Access Memory). The control unit 160 executes the program by using the A SIC (Application Specific Integrated Circuit) or FPGA (Field Programmable Gate Array) The control unit 160 may be realized by an integrated circuit such as a memory gate array. It may be realized by a combination of software and hardware.

[0025] The image acquisition unit 161 acquires various types of image data. The image data captured by the camera 30 mounted on the advertisement display vehicle on which the device 100 is mounted is acquired. The image acquisition unit 161 is, for example, an image acquisition unit mounted on an advertisement display vehicle on which the information processing device 100 is mounted. The camera 30 installed in the vehicle captures images of people on the road while the advertising display vehicle is running. In this embodiment, the camera 30 captures an image of the area around the advertising vehicle. The camera 30 is, for example, a spherical camera that captures images of the area around the advertising vehicle. For example, a front camera that takes pictures of the front of the advertising vehicle, side cameras that take pictures of both sides, and The camera 30 may be a front camera, a rear camera that takes pictures of the front and rear. It may also be a combination of a front camera and a rear camera.

[0026] The location information acquisition unit 162 acquires the current location information of the advertisement display vehicle on which the information processing device 100 is mounted. The location information acquisition unit 162 acquires, for example, the GPS information received by the GPS receiving unit 120. Based on the signal, the location information of the advertising display vehicle is obtained.

[0027] The person detection unit 163 detects whether the video data acquired by the video acquisition unit 161 includes a person. The person detection unit 163 detects whether or not a person is present based on a face image from video data, for example. The person detection unit 163 extracts a face image from the video data and detects whether or not it is included. If the person is detected as a person, the person detection unit 163 determines that the video data contains a person. Based on the dictionary data stored in the storage unit 130, people and their faces are detected. The detection unit 163 may calculate the number of people included in the video data. The person detection unit 163 may calculate the number of people included in the image capturing range of the camera 30. Calculate the number of people in a predetermined area (for example, 1 square meter) within the imaging range of the camera 30. You may do so.

[0028] The gaze direction determination unit 164 determines the gaze direction of the person determined by the person detection unit 163. The gaze direction determination unit 164 determines the direction of the face from, for example, a face image of a person, and The gaze direction determining unit 164 determines the gaze direction of the person based on the gaze of the person. The outline of the eyes and the position of the pupils are determined from the image, and based on the outline of the eyes and the position of the pupils, The gaze direction determining unit 164 determines the gaze direction of the person based on the information. It is determined whether or not the advertisement on the advertisement display vehicle on which the processing device 100 is mounted has been viewed.

[0029] The attribute determination unit 165 determines the attribute of the person determined by the person detection unit 163. The gender determination unit 165 determines the attributes of a person based on, for example, a face image of the person. The attributes determined by the attribute determination unit 165 include information about the person's age, gender, etc. The attributes determined by 5 may also include other information.

[0030] The attention level determination unit 166 determines whether or not the person is displaying an advertisement based on the determination result of the line of sight direction determination unit 164. The attention level determination unit 166 determines the attention level to the car advertisement. The attention level determination unit 166 determines the degree of attention to the car advertisement. If the person is not paying attention to the advertisement on the advertisement display vehicle, the attention level determination unit 166 determines that the person is paying attention to the advertisement on the advertisement display vehicle. The longer the gaze is fixed on the advertisement, the higher the attention to the advertisement is judged to be. The determining unit 166 determines whether the person has a high level of interest in the advertisement as the number of times the person has directed their gaze at the advertisement increases within a predetermined time period. It is determined that the item is attracting a lot of attention.

[0031] A method for determining the level of attention will be described with reference to FIG. 3. FIG. 3 illustrates a method for determining the level of attention. This is a diagram for clarification.

[0032] Figure 3 shows the attention level for each person in a table. The first person is 1 The second person is in their 20s, their gender is female, and their attention level is P1. , gender is "male" and attention level is "P2". The third person is "in their 30s" and gender is The fourth person is "male" and the attention level is "P3". The fourth person is "in their 40s" and the gender is "female". As shown in FIG. 3, the attention level determination unit 166 determines whether each person is The degree of attention is determined by associating attributes such as age and gender with the attention level.

[0033] In Figure 3, the attention levels are conceptually shown as P1 to P4, but in reality, they are not specific numbers. For example, the attention level determination unit 166 determines the attention level when the advertisement is viewed even once. If the advertisement is not viewed, the attention level determination unit 1 may determine the attention level as "1" and if the advertisement is not viewed, the attention level determination unit 1 may determine the attention level as "0". 66, for example, depending on the time when the advertisement was viewed and the number of times the advertisement was viewed within a predetermined time, The attention level is determined in stages such as "1", "2", "3", "4", and "5". In this case, for example, a larger number means a higher level of attention. The determining unit 166 may calculate the average value of the attention level for each attribute.

[0034] The attention level determination unit 166 may determine the attention level by weighting the advertisement depending on its content.

[0035] A method for determining the degree of attention by weighting will be described with reference to FIG. 4. 10 is a diagram for explaining a method for determining the attention level by performing the above.

[0036] Figure 4 shows the weighted attention levels for each person in the table in Figure 3. The first person has a weight of "W1" and an attention level of "P1 × W1". The second person has , the weight is "W2" and the attention level is "P2 × W2". The third person, Person 3, has a weight of "W3". The fourth person has a weight of "W4" and an attention level of "P4 x W3". W4".

[0037] In Figure 4, weights are conceptually shown as W1 to W4, but in reality they are not expressed as specific numerical values. The weight value is determined by the relationship between the person's attributes and the target demographic of the advertisement. For example, If the target audience for the advertisement is teenage girls, the value of "W1" will be large and "W3" will be small. The weighting value may be set arbitrarily by the user. The specific value of the value may be arbitrarily set by the user depending on the content of the advertisement.

[0038] The attention level determination unit 166 determines the ratio of people who pay attention to the advertisement among people included in the video. You may do so.

[0039] A method for determining the ratio of people who paid attention to an advertisement will be explained using Figure 5. 10A and 10B are diagrams for explaining a method for determining the ratio of a person in the image.

[0040] Figure 5 shows the ratio of attention paid to "Ad C1" for each attribute. The percentage of "male teenagers" who paid attention to "Advertisement C1" was "R1 Among "teenage" "females," the percentage who paid attention to "Advertisement C1" was "R2." Among "men" in their 20s, the percentage who paid attention to "Advertisement C1" was "R3." Among "women" in their 20s, the percentage who paid attention to "Advertisement C1" was "R4". The determining unit 166 may calculate the proportion of each attribute to all people who paid attention to "Advertisement C1." In other words, the attention level determination unit 166 calculates the number of people who paid attention to the advertisement C1 among the attribute A / the ... You can calculate the ratio by dividing the total number of people in attribute A who paid attention to ad C1 by the number of people in attribute A who paid attention to ad C1. The ratio can also be calculated using C1 (total number of people who paid attention to it).

[0041] In Figure 5, the ratios are shown conceptually as R1 to R4, but in reality they are not specific numerical values. is shown.

[0042] The storage control unit 167 stores various types of information in the storage unit 130. 3. The tables shown in FIGS. 4 and 5 are stored in the storage unit 130. The storage control unit 167 The position information acquired by the position information acquisition unit 162 and the attention level determined by the attention level determination unit 166 are used. The associated attention level information is stored in the storage unit 130. The storage control unit 167 stores the associated attention level information in the storage unit 130. The direction in which the camera took the image and the environmental information acquired by the environmental information acquisition unit 171 (described later) are associated with each other. The storage control unit 167 may store the attention level information in the server device 20 via the communication unit 110. By storing the attention level information in the server device 20, the information installed in other advertisement display vehicles can be The attention level information can be shared between the information processing devices.

[0043] The attention level information will be described with reference to Fig. 6. Fig. 6 is a diagram for explaining the attention level information. is.

[0044] Figure 6 shows the average attention score for each attribute at "Point A" for "Ad C1". In the example shown in Figure 6, for example, for a "male" in his teens, "Advertisement C" The average attention score for "1" is "P11". For "teenage" "female", " The average value of the attention level for the advertisement C1 is "P12." The attention level for the advertisement C1 in the advertisement list is stored in the storage unit 130.

[0045] In Figure 6, the average attention levels are conceptually shown as P11 to P16. is shown as a specific numerical value.

[0046] Referring again to FIG. 2, the route setting unit 168 sets a recommended route along which the advertisement display vehicle should travel. The route setting unit 168 sets the route based on the target route stored in the storage unit 130, the server device 20, etc. The route setting unit 168 sets a recommended driving route based on the attention level information. In other words, the route is set to include points that attract a lot of attention to advertisements. The route setting unit 168 sets a route with a high advertising effect as a recommended travel route. The unit 168 increases the amount of attention level information stored in the server device 20. This makes it possible to set routes that will have a high advertising effect.

[0047] The output control unit 169 controls the route setting unit 168 to set the route to be traveled. The information is output to the display unit 150. The display unit 150 displays the route to be traveled.

[0048] The other attention level information acquisition unit 170 receives other advertisement listings from the server device 20 via the communication unit 110. Other attention level information stored by other information processing devices mounted on the vehicle is acquired. The target information includes specific location information calculated by an information processing device installed in the advertising display vehicle. This includes information about the attention given to the advertisement.

[0049] The environmental information acquisition unit 171 acquires various types of environmental information via the communication unit 110. The information includes information such as date, time, weather, etc. The environmental information may include other information.

[0050] The configuration of the server device according to the first embodiment will be described with reference to FIG. 7. FIG. 2 is a block diagram illustrating an example of a configuration of a server device according to the embodiment.

[0051] As shown in FIG. 7, the server device 20 includes a communication unit 21, a storage unit 22, and a control unit 23. Prepare.

[0052] The communication unit 21 is realized by, for example, a NIC or a communication circuit. The communication unit 21 is connected to the network NW by wireless. The communication unit 21 transmits and receives information to and from the device, etc. via the network NW, for example. Information processing device 1001 to information processing device 100 N Sends and receives information between the

[0053] The storage unit 22 is a data read / write device such as a DRAM, an SRAM, a flash memory, or a hard disk. The storage unit 22 stores various information related to the server device 20. The storage unit 22 stores, for example, the information processing devices 1001 to 100 N Noso The attention level information acquired from each of them is stored.

[0054] The control unit 23 includes an attention level information acquisition unit 231 and a memory control unit 232 .

[0055] The control unit 23 is a controller that controls each unit of the server device 20. The control unit 23 is realized by a processor such as a CPU or an MPU. The unit 160 is a device that allows a processor to execute various programs stored in an internal storage device, such as a RAM. The control unit 23 is implemented by executing the above as a work area. The control unit 23 may be realized by an integrated circuit such as a FPGA. This may be realized in combination with the hardware.

[0056] The attention level information acquisition unit 231 is N Each of The attention level information acquisition unit 231 acquires attention level information from the information processing device 1001. equipment 100 N By acquiring attention level information from each of the information processing devices 1001 to Information processing device 100 N Each of these will be able to share attention information.

[0057] The storage control unit 232 stores the attention level information acquired by the attention level information acquisition unit 231 in the storage unit. Store it in 22.

[0058] The flow of processing by the information processing device according to the first embodiment will be described with reference to FIGS. 8A and 8B. FIG. 8A shows the flow of attention level determination processing by the information processing device according to the first embodiment. 8B is a flowchart showing an example of the estimation performed by the information processing device according to the first embodiment. 10 is a flowchart showing an example of the flow of a recommended travel route display process.

[0059] The attention level determination process performed by the information processing device 100 will be described with reference to FIG. The image acquisition unit 160 acquires an image of the outside of the vehicle (step S10). acquires an image of the outside of the vehicle from the camera 30 of the advertisement display vehicle on which the information processing device 100 is mounted. Then, the process proceeds to step S11.

[0060] The control unit 160 acquires location information (step S11). The image acquisition unit 162 acquires the position information of the position where the image acquisition unit 161 acquires the image from the camera 30. Then, the process proceeds to step S12.

[0061] The control unit 160 detects whether or not a person is included in the video acquired in step S10. Specifically, the person detection unit 163 detects a face image or the like included in the video. Based on this, it is detected whether a person is included. If the result is "Yes" at step S12, the process proceeds to step S13. If so (step S12; No), the control unit 160 returns to step S10 and Repeat the logic.

[0062] If the determination in step S12 is Yes, the control unit 160 determines that the direction of the person's line of sight is the direction of the advertisement. Specifically, the gaze direction determining unit 164 determines whether the user is facing the direction of the gaze (step S13). The system determines the direction of the face and the position of the eyes based on the face image of the person. The direction determination unit 164 determines whether the gaze is directed toward the advertisement based on the direction of the face, the position of the eyes, etc. If it is determined that the gaze is directed at the advertisement (step S13; Yes), On the other hand, if it is determined that the line of sight is not directed at the advertisement (step S14), S13: No), the control unit 160 returns to step S10 and repeats the process.

[0063] If the determination in step S13 is Yes, the control unit 160 determines the attributes of the person ( Step S14). Specifically, the attribute determination unit 165 determines the gender, age, etc. of the person. Then, the process proceeds to step S15.

[0064] The control unit 160 determines the degree of attention to the advertisement (step S15). The attention determination unit 166 determines the attention level to the advertisement based on information and attributes related to the line of sight of the person. Then, the process proceeds to step S16.

[0065] The control unit 160 stores the attention level information (step S16). 167 associates the attention level with the position information and the like, and stores the information in the storage unit 130 and the server device 20, etc. Then, the process proceeds to step S17.

[0066] The control unit 160 determines whether or not the attention level determination process has been completed (step S17). Specifically, the control unit 160 notifies the camera 30 that the image capturing has been completed, and the engine of the image capturing vehicle has stopped. The attention level determination process is then checked to see if it has been completed or not, based on the condition that the power is turned off. If it is determined that the determination process has been completed (step S17; Yes), the process of FIG. 8A is completed. On the other hand, if it is determined that the attention level determination process has not been completed (step S17; N o), the control unit 160 returns to step S10 and repeats the process. While the attention level determination process continues, the processes of steps S10 to S160 are performed. Execute repeatedly.

[0067] The display process of the recommended driving route by the information processing device 100 will be described with reference to FIG. 8B. The control unit 160 sets a recommended travel route to be traveled (step S20). The route setting unit 168 determines the route to be traveled based on the attention level information stored in the storage unit 130. The recommended route is set, and the process proceeds to step S21.

[0068] The control unit 160 displays the recommended driving route (step S21). The display unit 169 displays the recommended driving route together with map information on the display unit 150. End processing of B.

[0069] As shown in FIG. 8A and FIG. 8B, the information processing device 100 stores the Based on the attention level information, a recommended driving route is set and displayed, but the present disclosure is not limited to this. For example, the information processing device 100 receives the attention level from the server device 20 when the advertisement display vehicle is running. Information may be acquired and a recommended driving route may be set.

[0070] 9, attention level information is acquired from the server device of the information processing device according to the first embodiment. 9 is a flow of processing when the server of the information processing device according to the first embodiment is 10 is a flowchart showing an example of a processing flow when attention level information is acquired from a server device.

[0071] The control unit 160 acquires current environmental information (step S30). The information acquisition unit 171 receives information such as the current date, time, and weather from an external device via the communication unit 110. Then, the process proceeds to step S31.

[0072] The control unit 160 acquires attention level information corresponding to the current environmental information from the server device (step Specifically, the other attention level information acquisition unit 170 receives the current environment information from the server device 20. The attention level information of the condition similar to the boundary information is acquired, and the process proceeds to step S32.

[0073] The control unit 160 sets a recommended travel route to be traveled (step S32). The route setting unit 168 determines the route to be traveled based on the attention level information acquired from the server device 20. The recommended route is set, and the process proceeds to step S33.

[0074] The control unit 160 displays the recommended driving route (step S33). The display unit 169 displays the recommended driving route together with map information on the display unit 150. The process ends.

[0075] As described above, in the first embodiment, the information processing device 100 detects pedestrians' reactions to advertisements. The first embodiment calculates the degree of attention to the pedestrian. Set the recommended driving route to include points with many pedestrians who pay attention to advertisements. The display can be provided to the driver of the vehicle. As a result, in the first embodiment, the advertising effect It can travel on routes with high

[0076] In the first embodiment, the road on which the advertisement display vehicle 10 runs is determined based on the line of sight of pedestrians. Since the visibility of the road is to be determined, it is preferable that the road be one where it is easy to capture the image of the pedestrian's face. The road on which the display vehicle 10 runs is a road with good visibility such as a suburban road or a one-way road where pedestrians can be easily seen. It is preferable that the vehicle be a road with one lane on each side and a road in a residential area. It is preferable that the roads traveled by the vehicle are not main roads.

[0077] In the first embodiment, the information processing device 100 detects advertisements on the route of the advertising display vehicle 10. The attention level of an advertisement can be determined based on attributes such as age and gender. Even if the advertising display vehicle 10 is running while displaying an advertisement targeted at women, Therefore, the first embodiment can detect many men on the route. The route including the displayed point is determined as the route to be taken while displaying advertisements for men. can be done.

[0078] In the first embodiment, as the amount of attention level information stored in the server device 20 increases, Therefore, the server device It is preferable to update the attention level information stored in the advertisement display vehicle 20 as needed. For example, the area in which the advertising display vehicle 10 can run is determined in advance. The extent to which the driver of the advertising vehicle 10 can deviate from the area where the vehicle can be driven is also determined in advance. For example, by changing conditions such as the day of the week, time, weather, and route, It is preferable that the advertising vehicle travels within a predetermined area to acquire attention level information. When drivers in 10 find a place with many pedestrians while obtaining attention information, It is preferable to drive through the point within a range where the vehicle can deviate from the point and acquire attention level information. Even when the driver of the display vehicle 10 is traveling along the recommended route, for example, If there are many pedestrians on an off-road route, drive on that route as far as possible. Attention level information may also be acquired.

[0079] In the first embodiment, the advertisement display vehicles 101 to 10 N Multiple advertising displays in cars attract attention In this case, the advertisement display vehicles 101 to 10 N Each of them The travel routes may be the same or different. [Second embodiment] Next, a second embodiment will be described.

[0080] An information processing apparatus according to the second embodiment will be described with reference to FIG. 10. FIG. 1 is a block diagram illustrating an example of a configuration of an information processing apparatus according to an embodiment.

[0081] As shown in FIG. 10, the information processing device 100A includes a control unit 160A and a sales determination unit 172. 2 in that it includes a sales information acquisition unit 173 and an inventory information acquisition unit 174. This differs from the management device 100.

[0082] In the first embodiment, the information processing device 100 is mounted on an advertisement display vehicle that displays advertisements and travels. The information processing device 100A is installed in a mobile sales vehicle that sells products while moving. That's fine.

[0083] The sales determination unit 172 determines the sales of the product. Based on the information, it is determined whether the sales of the product have reached a predetermined amount. The determining unit 172 determines whether the sales of the product within a predetermined period of time have reached a predetermined amount. The set price of the product can be arbitrarily set by the user via the operation unit 140, for example. It is possible.

[0084] The sales information acquisition unit 173 receives sales information from the server device 20 via the communication unit 110. The sales information acquisition unit 173 acquires sales information relating to the sales amount of the product in other Sales information on the total sales amount of the products in the mobile sales vehicle may be acquired. The sales information acquisition unit 173 may acquire sales information relating to the sales amount for each product. It is also possible to acquire only sales information for products that have reached a certain sales amount.

[0085] The inventory information acquisition unit 174 receives information about other mobile sales vehicles from the server device 20 via the communication unit 110. The inventory information includes, for example, the quantity of inventory and the price of inventory. The inventory information acquisition unit 174 includes information about the total amount of merchandise in other mobile sales vehicles. You can get inventory information about the inventory of a product, or you can get inventory information about the inventory of each product. The inventory information acquisition unit 174 may acquire inventory information only for products whose inventory amount is less than a predetermined amount. That's fine.

[0086] Mobile food trucks should be well-marked to show the products they sell so that pedestrians can understand what is being sold. The information processing device 100 detects that the more attention a sign receives, the more likely pedestrians are likely to notice it. The information processing device 100 determines that the user desires to purchase the product. The information processing device 100 sets a route with many pedestrians as a recommended sales route. A location where there are many pedestrians and where the location is attracting a lot of attention is set as a recommended sales location. 100 will recommend a new sales amount if the sales within a certain time period do not reach the preset amount. Establish sales channels or recommended points of sale.

[0087] The mobile sales vehicle can be either a manually operated vehicle or an autonomous vehicle. The level of autonomous driving is In the second embodiment, when the mobile sales vehicle is a mobile sales vehicle, In this case, the level of autonomous driving is, for example, a high level (e.g., level 4 or 5). If the mobile sales vehicle is a manually operated vehicle, the driver The vehicle will travel along the recommended sales routes and sell the products.

[0088] If the mobile sales vehicle is an autonomous vehicle, the mobile sales vehicle will autonomously drive the recommended sales route. If the mobile sales vehicle is an autonomous vehicle, the mobile sales vehicle will Drive to the recommended sales point and sell the product. If the sales within a certain time period reach a preset amount, If the recommended route is not reached, the mobile sales vehicle will travel along the newly set recommended route or The vehicle travels to a destination and sells the goods.

[0089] An example of the processing flow of the information processing device according to the second embodiment will be described with reference to FIG. FIG. 11 is a flowchart showing an example of the processing flow of the information processing device according to the second embodiment. It is.

[0090] The processing in steps S40 and S41 is the same as that in steps S30 and S31 shown in FIG. Since this is the same as the processing in step S31, the explanation will be omitted.

[0091] The control unit 160A sets the recommended sales route to be traveled or the recommended sales point to be visited ( Step S42). Specifically, the route setting unit 168 sets the target route obtained from the server device 20. Based on the information, a recommended sales route or a recommended sales point is set. Then, in step S4 Go to 3.

[0092] The control unit 160A displays the recommended sales route or the recommended sales point (step S43). Specifically, the output control unit 169 displays the recommended sales route or the recommended sales point on the display unit 150. If the mobile sales vehicle is an autonomous vehicle, step S43 If the mobile sales vehicle is a manually operated vehicle, the driver may operate the display unit 150 Operate the mobile sales vehicle in accordance with the recommended sales routes or recommended sales points displayed on the website.

[0093] The control unit 160A determines whether the sales amount of the product is equal to or greater than a predetermined amount (step Specifically, the sales determination unit 172 determines whether the sales of the product within a predetermined time period are greater than or equal to a predetermined number of units. If it is determined that the sales amount is equal to or greater than the predetermined amount, If so (step S44; Yes), the process of FIG. 11 is terminated. If it is determined that the capacity is full (step S44; No), the process proceeds to step S45.

[0094] If the determination in step S44 is No, the control unit 160A receives operation information or a new instruction. Specifically, the route setting unit 168 acquires the target information from the operation unit 14. 0 to obtain operation information about the driving route and sales point setting operation entered by the user Alternatively, the other attention level information acquisition unit 170 may acquire other attention level information different from the attention level information acquired in step S41. Then, the process proceeds to step S46.

[0095] The control unit 160A resets the recommended sales route or the recommended sales point (step S46). Specifically, the route setting unit 168 uses the operation information or attention level information acquired in step S45. Based on the information, the recommended sales route or the recommended sales point is reset, and then, step S43 Proceed to.

[0096] In the second embodiment, in step S41, the sales information acquisition unit 173 acquires information on other mobile sales In step S41, the sales information of the car may be acquired. The unit 174 may acquire inventory information of other mobile sales vehicles. The setting unit 168 sets recommended sales based on sales information and inventory information of other mobile sales vehicles. Routes or recommended points of sale may be set.

[0097] As described above, in the second embodiment, the information processing device 100A is configured to A recommended sales route or a recommended sales point can be set. , products can be sold through recommended sales channels or recommended sales points with high sales effectiveness. As a result, product sales can be increased.

[0098] In the second embodiment, when the mobile sales vehicle is an autonomous vehicle, the information processing device 1 00A has the function to identify suspicious vehicles and suspicious people based on the images from the in-vehicle camera. For example, the information processing device 100A may receive a predetermined amount of merchandise from a mobile sales vehicle without purchasing the merchandise. The information processing device 100A determines a person who does not leave the vehicle for more than 10 minutes as a suspicious person. When a suspicious vehicle or a suspicious person is detected, information such as images of the suspicious vehicle and the suspicious person is sent to the server device. 20. This allows information about suspicious vehicles and suspicious people to be stored in multiple transfers. The information processing device 100A can detect suspicious vehicles and suspicious persons. If the second The embodiment can improve the safety of mobile sales vehicles.

[0099] In the second embodiment, the information processing device 100A determines the situation of other vehicles and Depending on the situation, recommended sales routes and recommended sales points may be determined and set. For example, the information processing device 100A may detect points and routes where customers are congregating in real time. The recommended sales point and the recommended sales point may be set respectively. 100A uses attention information of a time close to the current time with priority to recommend a sales route and a recommendation As an example of the situation of other vehicles, the information processing device 100A may determine a recommended sales point. If the level of attention to both is higher than a certain value, it is considered that customers are concentrated there. The location and route may be determined as a recommended sales location and a recommended sales route. As another example of the situation, the information processing device 100A may If the sales amount within a certain period is higher than a certain value, it is considered that customers are concentrated. The location and route may be determined as a recommended sales location and a recommended sales route. As another example, the information processing device 100A may determine whether the inventory is sufficient based on inventory information of other vehicles. If the number of customers is less than the number of customers in the area, it is considered that customers are concentrated. The information processing device 100A may determine the recommended sales points and the recommended sales routes. The situation of other vehicles may be determined based on images from the onboard camera. By dispatching multiple mobile sales vehicles to locations where customers are concentrated, the mobile sales vehicles can mutually promote sales. This can improve the flow rate and alleviate congestion. [Third embodiment] Next, a third embodiment will be described.

[0100] In the first and second embodiments, the information processing device 100 and the information processing device 100 A is mounted on a vehicle traveling on a road. For example, the information processing device 100A may be installed in a vehicle that runs on a road. It is installed in a merchandise sales robot that autonomously drives around designated areas such as a merchandise park to sell merchandise. This may be done.

[0101] In the third embodiment, the information processing device 100A may be configured to, for example, Map information of the area and notes for each attribute of people for products at each point included in the map information The information processing device 100A stores map information of the site and attention level information relating to the site. Based on the attention level information, a recommended sales point where the product should be sold is set. The robot travels around the premises to sell products based on map information and attention level information. The sales robot sells the product at the recommended sales point set by the information processing device 100A. The information processing device 100A calculates the sales of the product at the recommended sales point within a predetermined time period. If the amount does not reach the target amount, the recommended sales point will be reset. The vehicle then drives to the re-established recommended sales point and sells the product.

[0102] As described above, in the third embodiment, the information processing device 100A is configured to The company may set up recommended sales points within its premises where products should be sold. If the sales of the product at the recommended sales point does not reach the specified amount, This allows you to reset the recommended sales points, which can improve product sales. This can be done.

[0103] In the third embodiment, similarly to the second embodiment, the information processing device 100A includes a rear The locations and routes where customers are concentrated in real time are recommended sales points and recommended sales routes, respectively. Specifically, in the third embodiment, the information processing device 100A may set the other commercial When the attention level of the robot is higher than a predetermined value, it is considered that customers are concentrated there. Therefore, the location may be determined as a recommended sales location. As an example of the situation, the information processing device 100A may detect a situation where the sales amount within a predetermined time is higher than a predetermined value. In this case, it is considered that customers are concentrated there, so even if the location is judged as a recommended sales location, As an example of another state of the product sales robot, the information processing device 100A may If the number of customers is less than the recommended number, it is considered that customers are concentrated in that area. In this way, the third embodiment can be implemented by determining multiple locations at points where customers are concentrated. By placing a large number of product sales robots, the mutual sales of the product sales robots can be improved. , and congestion can be alleviated.

[0104] Although the embodiments of the present disclosure have been described above, the present disclosure is not limited to the contents of these embodiments. In addition, the above-mentioned components include those that can be easily imagined by a person skilled in the art and those that are substantially Furthermore, the above-mentioned components are appropriately Furthermore, the present invention can be configured in a manner that does not deviate from the spirit of the above-described embodiments. Various omissions, substitutions or modifications of components may be made. [Explanation of symbols]

[0105] 1. Information Processing Systems 10 Advertising vehicles 20 Server device 100 Information processing device 110 Communications Department 120 GPS receiver 130 Storage section 140 Operation section 150 Display section 160 control section 161 Video Acquisition Unit 162 Location information acquisition unit 163 Person detection unit 164 Gaze direction determination unit 165 Attribute determination section 166 Attention Degree Judgment Unit 167 Memory control unit 168 Route setting section 169 Output control section 170 Other attention information acquisition unit 171 Environmental Information Acquisition Department 172 Sales Determination Department 173 Sales Information Acquisition Department 174 Inventory Information Acquisition Department

Claims

1. an image acquisition unit that acquires an image of the outside of a traveling vehicle; a person detection unit that detects a person based on a face image included in the video acquired by the video acquisition unit; a gaze information acquisition unit that acquires information about the gaze of the person detected by the person detection unit; Equipped with The vehicle is a mobile sales vehicle that moves around and sells products, Identifying suspicious individuals based on the product purchase status in the mobile sales vehicle and the information on the line of sight. Information processing device.

2. a location information acquisition unit that acquires location information of the vehicle; a route setting unit that sets a route along which the vehicle should travel by associating the position information with information relating to the line of sight; Equipped with The information processing device according to claim 1 .

3. If a suspicious person is detected, image information of the suspicious person is transmitted to a server device via a network and stored therein.

3. The information processing device according to claim 1 or 2.

4. acquiring an image of the exterior of a traveling vehicle; Detecting a person based on a face image included in the acquired video; acquiring information about the line of sight of the detected person; Including, The vehicle is a mobile sales vehicle that moves around and sells products, determining a suspicious person based on the product purchase status in the mobile sales van and the information about the line of sight; The information processing method further includes:

Images