Product purchasing system, server, first communication terminal and second communication terminal

Abstract

To assist a vehicle occupant in purchasing a commodity that he / she sees outside the vehicle during driving.SOLUTION: A commodity purchase system comprises a first communication terminal carried by an advertisement user, a second communication terminal movably provided with a vehicle, and server. The first communication terminal transmits advertisement commodity information showing a commodity that the advertisement user puts on to the server. The second communication terminal transmits a commodity retrieval request including second positional information and second time information at the time of detecting a specific action of an occupant of the vehicle to the server during movement of the vehicle. On the basis of the second positional information and the second time information, the server extracts candidate commodity information from among pieces of the advertisement commodity information and then transmits the extracted candidate commodity information to the second communication terminal.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a product purchasing system, a server, a first communication terminal, and a second communication terminal. [Background technology]

[0002] A technology is known in which an identification symbol is captured by an external camera mounted on a vehicle, and the vehicle acquires content associated with the identification symbol. By associating the identification symbol with content including product details, a vehicle occupant can acquire the content including the product details.

[0003] For example, Patent Document 1 describes an information processing system that displays an identification symbol associated with content including product details on a liquid crystal monitor installed at any position in a store or commercial facility. According to the information processing system of Patent Document 1, when a vehicle arrives at a store or commercial facility, an exterior camera of the vehicle captures an image of the identification symbol displayed on the liquid crystal monitor, thereby providing various contents to the passengers of the vehicle. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2020-135760 A Summary of the Invention [Problem to be solved by the invention]

[0005] Incidentally, a vehicle occupant may see a person around the vehicle while driving and want to buy a product that the person is wearing. However, even if the occupant tries to buy the product that he or she wanted to buy while driving after the drive is over, he or she needs to go back through his or her memory and may not be able to find the product. In addition, the driver of the vehicle cannot pay attention to the products that the person around the vehicle is wearing while driving, and it is difficult for the driver to accurately remember the product that he or she wants. In addition, if a camera is used from inside the vehicle to capture an image of a product that a person outside the vehicle is wearing, the act of capturing an image of the person may itself be considered a nuisance.

[0006] Therefore, an object of the present invention is to assist a vehicle occupant in purchasing an item that he or she sees wearing while driving. [Means for solving the problem]

[0007] In order to solve the above problem, a product purchasing system according to one embodiment of the present invention comprises: A product purchasing system in which a first communication terminal carried by an advertising user who functions as a personal advertising tower for a product, a second communication terminal movably installed together with a vehicle, and a server are communicatively connected via a network, The first communication terminal, Transmitting to the server first location information representing a location of the advertising user during the movement of the advertising user, first time information representing a time when the advertising user is at the location, and advertising product information representing a product worn by the advertising user; The server, receiving the first location information, the first time information, and the advertised product information from the first communication terminal; storing the first location information, the first time information, and the advertised product information received from the first communication terminal in a database in association with each other; The second communication terminal, Detecting a specific action by a passenger of the vehicle, which indicates an intention to purchase a product worn by the advertising user who is present in the vicinity of the vehicle, while the vehicle is moving; recording specific action information, which associates second position information indicating a position of the vehicle when the specific action is detected with second time information indicating a time when the specific action is detected, for each specific action; When at least one specific action information is selected by the passenger from the one or more recorded specific action information, a product search request including the second location information and the second time information corresponding to the selected specific action information is transmitted to the server; The server, receiving the product search request from the second communication terminal; searching the advertised product information stored in the database based on the second location information and the second time information included in the product search request, and extracting candidate product information representing one or more candidate products corresponding to the second location information and the second time information from the advertised product information; Transmitting the extracted candidate product information to the second communication terminal; The second communication terminal, receiving the candidate product information from the server; The candidate product information is displayed on a display unit.

[0008] In order to solve the above problem, a server according to an embodiment of the present invention comprises: A server communicatively connected via a network to a first communication terminal carried by an advertising user who functions as a personal advertising tower for a product and a second communication terminal movably provided together with a vehicle, one or more processors; one or more memories coupled to said processor; Equipped with The processor, receiving, from the first communication terminal, first location information representing a location of the advertising user during the movement of the advertising user, first time information representing a time when the advertising user is at the location, and advertising product information representing a product worn by the advertising user; storing the first location information, the first time information, and the advertised product information received from the first communication terminal in a database in association with each other; receiving from the second communication terminal a product search request including second location information representing a location of the vehicle when a specific action by an occupant of the vehicle, which indicates an intention to purchase a product worn by the advertising user present in the vicinity of the vehicle, is detected while the vehicle is moving, and second time information representing a time when the specific action is detected; searching the advertised product information stored in the database based on the second location information and the second time information included in the product search request, and extracting candidate product information representing one or more candidate products corresponding to the second location information and the second time information from the advertised product information; Transmitting the extracted candidate product information to the second communication terminal; Perform the process including:

[0009] In order to solve the above problem, a second communication terminal according to an embodiment of the present invention comprises: A second communication terminal is communicatively connected via a network to a server capable of communicating with a first communication terminal carried by an advertising user who functions as a personal advertising tower for a product, and is provided so as to be movable together with the vehicle, one or more processors; one or more memories coupled to said processor; Equipped with The processor, Detecting a specific action by a passenger of the vehicle, which indicates an intention to purchase a product worn by the advertising user who is present in the vicinity of the vehicle, while the vehicle is moving; recording specific action information, which associates second position information indicating a position of the vehicle when the specific action is detected with second time information indicating a time when the specific action is detected, for each specific action; When at least one specific action information is selected by the passenger from the one or more recorded specific action information, transmitting a product search request including the second location information and the second time information corresponding to the selected specific action information to the server; receiving, from the server, candidate product information representing one or more candidate products corresponding to the second location information and the second time information included in the product search request; Displaying the candidate product information on a display unit; Perform the process including: Effect of the Invention

[0011] According to the present invention, it is possible to assist a vehicle occupant in purchasing an item that he or she sees wearing while driving. [Brief description of the drawings]

[0012] [Figure 1] FIG. 1 is a schematic diagram showing a product purchasing system according to the present embodiment. [Diagram 2] FIG. 2 is a schematic diagram showing an example of a hardware configuration of the vehicle according to the embodiment. [Diagram 3] FIG. 3 is a block diagram showing an example of a hardware configuration of the server according to the embodiment. [Figure 4] FIG. 4 is a block diagram showing an example of a hardware configuration of the first communication terminal according to the embodiment. [Diagram 5] FIG. 5 is a block diagram showing an example of a functional configuration of the first communication terminal according to the embodiment. [Figure 6] FIG. 6 is a schematic diagram showing a state in which the advertised product registration unit according to the embodiment is registering advertised product information. [Figure 7] FIG. 7 is a schematic diagram showing an example of a functional configuration of the vehicle and the second communication terminal according to the embodiment. [Figure 8] FIG. 8 is a schematic diagram illustrating a state in which the specific action selection unit according to the embodiment is selecting specific action information. [Figure 9] FIG. 9 is a schematic diagram illustrating a state in which the candidate commodity selection unit according to the embodiment is selecting candidate commodity information. [Figure 10] FIG. 10 is a schematic diagram illustrating a state in which the designated position detection unit according to the embodiment detects the display position of the product desired to be purchased. [Figure 11] FIG. 11 is a schematic diagram showing an example of a functional configuration of a vehicle and a second communication terminal according to a modified example. [Figure 12] FIG. 12 is a block diagram showing an example of a functional configuration of the server according to the embodiment. [Figure 13] FIG. 13 is a first sequence diagram showing the processing executed by the product purchasing system according to the embodiment. [Figure 14] FIG. 14 is a second sequence diagram showing the processing executed by the product purchasing system according to the embodiment. [Figure 15] FIG. 15 is a third sequence diagram showing the processing executed by the product purchasing system according to the embodiment. [Figure 16] FIG. 16 is a fourth sequence diagram showing the processing executed by the product purchasing system according to the embodiment. [Figure 17] FIG. 17 is a fifth sequence diagram showing the processing executed by the product purchasing system according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] Hereinafter, an embodiment of the present invention will be described in detail with reference to the accompanying drawings. The specific dimensions, materials, numerical values, etc. shown in the embodiment are merely examples for facilitating understanding of the invention, and do not limit the present invention unless otherwise specified. In this specification and drawings, elements having substantially the same functions and configurations are given the same reference numerals to avoid repeated explanations, and elements not directly related to the present invention are not shown.

[0014] [1. Overall configuration of product purchasing system] First, the overall configuration of a product purchasing system 1000 according to a first embodiment of the present invention will be described with reference to Fig. 1. Fig. 1 is a schematic diagram showing a product purchasing system 1000 according to this embodiment.

[0015] As shown in Fig. 1, the product purchasing system 1000 according to this embodiment includes a plurality of first communication terminals 1A-1C, a plurality of second communication terminals 2A-2B, at least one server 3, and a seller server 4. Hereinafter, the plurality of first communication terminals 1A-1C may be collectively referred to as the "first communication terminal 1." Also, the plurality of second communication terminals 2A-2B may be collectively referred to as the "second communication terminal 2." The first communication terminal 1, the second communication terminal 2, the server 3, and the seller server 4 are connected to each other via a network 5 so as to be able to communicate with each other.

[0016] The first communication terminal 1 is a mobile communication terminal carried by the advertising users 6A to 6C. The advertising users 6A to 6C are individual users who function as personal billboards for products, and a personal billboard refers to a person wearing an advertisement. Hereinafter, the advertising users 6A to 6C may be collectively referred to as "advertising users 6". In this embodiment, the first communication terminal 1A is carried by the advertising user 6A, the first communication terminal 1B is carried by the advertising user 6B, and the first communication terminal 1C is carried by the advertising user 6C. The first communication terminal 1 broadly includes electronic devices capable of wireless or wired communication connection with the server 3. Examples of the first communication terminal 1 include a smartphone, a mobile phone, a tablet device, a personal computer (PC), a tablet PC, a game device, a smart watch, and a wearable device. In this embodiment, a case where a smartphone owned by the advertising user 6 is used as the first communication terminal 1 will be described.

[0017] The second communication terminal 2 is a mobile communication terminal that is movably provided together with the vehicles 7A to 7B. Hereinafter, the vehicles 7A to 7B may be collectively referred to as "vehicles 7". In this embodiment, the second communication terminal 2A is movably provided together with the vehicle 7A, and the second communication terminal 2B is movably provided together with the vehicle 7B. The second communication terminal 2 broadly includes electronic devices that can be connected to the server 3 for wireless or wired communication. Examples of the second communication terminal 2 include a smartphone, a mobile phone, a tablet device, a personal computer (PC), a tablet PC, a game device, a smart watch, and a wearable device. In this embodiment, a case will be described in which a smartphone owned by a passenger 74 is used as the second communication terminal 2. However, the present invention is not limited to this, and the second communication terminal 2 may be a terminal device that is fixedly installed in the vehicle 7 and has a communication function. For example, the second communication terminal 2 may be a navigation device, an audio device, or the like installed in the vehicle 7.

[0018] The vehicle 7 is an automobile capable of traveling on a road. The vehicle 7 is, for example, an engine vehicle provided with an engine as a driving source for traveling. The vehicle 7 may be a hybrid vehicle provided with an engine and a motor as a driving source for traveling, or an electric vehicle provided with a motor as a driving source for traveling. In addition, in this embodiment, an example in which the vehicle 7 is a four-wheeled private automobile will be mainly described. However, the vehicle 7 is not limited to such an example, and may be various automobiles such as commercial vehicles such as buses, trucks, or taxis, or special vehicles such as police cars, fire engines, ambulances, tow trucks, snowplows, or construction vehicles, or motorcycles.

[0019] The server 3 is a digital computer with a built-in program and has server functions. The server 3 is composed of various computer devices such as a server computer, a personal computer, a workstation, a large computer, a microcomputer, etc. The seller server 4 has a similar configuration to the server 3, so a description thereof will be omitted.

[0020] The network 5 is a wireless or wired communication line network for communicatively connecting the first communication terminal 1, the second communication terminal 2, the server 3, and the seller server 4. The network 5 is composed of various networks, such as a satellite communication network for a global positioning system (GPS), a mobile phone network, the Internet, a local area network (LAN), a wide area network (WAN), and other dedicated line networks. At least a part of the network 5 includes a wireless network. However, the network 5 may include a wired network in part.

[0021] The first communication terminal 1 and the second communication terminal 2 communicate with the server 3 via the network 5. Similarly, the server 3 communicates with the first communication terminal 1 and the second communication terminal 2 via the network 5. For this purpose, the server 3 includes a communication device capable of wirelessly or wired communication with an external device via the network 5. The first communication terminal 1 and the second communication terminal 2 and the server 3 communicate with each other via the network 5, so that various information can be shared between the first communication terminal 1 and the second communication terminal 2 and the server 3. In addition, the server 3 can provide various functions and services to all or a part of the first communication terminal 1. In addition, the server 3 can provide various functions and services to all or a part of the second communication terminal 2. The vehicle 7 may include a communication device capable of wirelessly or wired communication with an external device via the network 5.

[0022] In this embodiment, the server 3 collects, stores, and processes information transmitted from a plurality of first communication terminals 1A-1C. The second communication terminal 2 and the server 3 form a so-called client-server system. For example, the second communication terminal 2 (client), which can move together with a vehicle 7 that a user boards and operates, transmits various types of information to the server 3, such as information input by the user, information related to the vehicle 7, and information related to the surrounding environment of the vehicle 7. The server 3 distributes various functions and information to the second communication terminal 2 (client) based on the information collected, stored, and processed from the first communication terminals 1A-1C.

[0023] [2. Vehicle configuration] Here, a hardware configuration of the vehicle 7 according to this embodiment will be described with reference to FIG. 2. FIG. 2 is a schematic diagram showing an example of a hardware configuration of the vehicle 7 according to this embodiment. As shown in FIG. 2, the vehicle 7 includes a plurality of vehicle exterior imaging devices 71A-71D, an in-vehicle imaging device 72, and a plurality of in-vehicle microphones 73A-73D. Hereinafter, the vehicle exterior imaging devices 71A-71D may be collectively referred to as "vehicle exterior imaging device 71." Furthermore, the plurality of in-vehicle microphones 73A-73D may be collectively referred to as "in-vehicle microphone 73." Note that a plurality of in-vehicle imaging devices 72 may be provided in the vehicle 7, similar to the plurality of vehicle exterior imaging devices 71A-71D.

[0024] A plurality of passengers 74A to 74D are on board the vehicle 7. Hereinafter, passengers 74A to 74D may be collectively referred to as "passengers 74." Passenger 74A is, for example, a driver who drives the vehicle 7, and sits in a driver's seat 76A in front of a steering wheel 75 of the vehicle 7. Passenger 74B sits in a passenger seat 76B adjacent to the driver's seat 76A. Passenger 74C is located behind passenger 74A, who is the driver, and sits in a rear seat 76C. Passenger 74D is located behind passenger 74B and sits in a rear seat 76C.

[0025] The vehicle exterior imaging device 71 captures an image of the surrounding environment outside the vehicle 7. The vehicle exterior imaging device 71 is provided in a vehicle cabin in which a passenger 74 rides, and captures an image of the surrounding environment outside the vehicle 7 while the vehicle 7 is traveling or stopped. The vehicle exterior imaging device 71 may be used as a camera used in a drive recorder, a driving assistance system, or the like, or may be a dedicated camera for the product purchasing system 1000 according to this embodiment. The vehicle exterior imaging device 71 may capture either moving images or still images, but is preferably capable of capturing moving images. Image data captured by the vehicle exterior imaging device 71 is output to, for example, an ECU (Electronic Control Unit) 702 (see FIG. 7), and recorded on a recording medium as necessary.

[0026] The exterior imaging device 71A images the side of the vehicle 7 in the traveling direction TD of the vehicle 7 out of the surrounding environment outside the vehicle 7. The exterior imaging device 71B images the left side of the vehicle 7 in the traveling direction TD of the surrounding environment outside the vehicle 7. The exterior imaging device 71C images the right side of the vehicle 7 in the traveling direction TD of the surrounding environment outside the vehicle 7. The exterior imaging device 71D images the opposite side of the vehicle 7 from the traveling direction TD of the surrounding environment outside the vehicle 7.

[0027] The in-vehicle imaging device 72 captures an image of the inside of the vehicle 7. Specifically, the in-vehicle imaging device 72 captures an image of the passenger 74 who is in the vehicle 7. The ECU 702 of the vehicle 7 can detect a gesture of the passenger 74 by using a known image recognition technology. For example, the ECU 702 can acquire gesture information representing the movement of the hand and fingers of the passenger 74 by the image recognition technology. The gesture information can specify, for example, the direction in which the passenger 74 is pointing. The in-vehicle imaging device 72 also captures an image of the face of the passenger 74 who is in the vehicle 7. The ECU 702 of the vehicle 7 acquires facial information of the passenger 74 from an image acquired by capturing an image of the face of the passenger 74. A method for recognizing the facial information is not particularly limited, but for example, the facial information can be acquired by using a known technology for acquiring a person's face. Then, the ECU 702 detects the line of sight of the passenger 74 from the acquired facial information. Specifically, the ECU 702 detects the gaze of the occupant 74 by analyzing the facial information, calculates the angle and direction of the gaze of the occupant 74 relative to the direction of travel TD of the vehicle 7, and identifies the gaze direction of the occupant 74.

[0028] The in-vehicle microphone 73 picks up sounds inside the vehicle 7. The ECU 702 of the vehicle 7 can detect specific utterances of the passenger 74 using known voice recognition technology. The ECU 702 can also identify the position and face direction of the speaking passenger 74 based on the volume and time difference of the voice data acquired from the multiple in-vehicle microphones 73. The in-vehicle microphone 73A picks up sounds on the traveling direction TD side inside the vehicle. The in-vehicle microphone 73B picks up sounds on the left side inside the vehicle in the traveling direction TD. The in-vehicle microphone 73C picks up sounds on the right side inside the vehicle in the traveling direction TD. The in-vehicle microphone 73D picks up sounds on the opposite side of the traveling direction TD inside the vehicle.

[0029] In the present embodiment, an example has been described in which the vehicle 7 is provided with both the in-vehicle imaging device 72 and the in-vehicle microphone 73. However, the present invention is not limited to this, and the vehicle 7 may be provided with only one of the in-vehicle imaging device 72 and the in-vehicle microphone 73. In addition, the vehicle 7 does not necessarily have to be provided with both the in-vehicle imaging device 72 and the in-vehicle microphone 73.

[0030] [3. Server hardware configuration] Next, a hardware configuration of the server 3 according to this embodiment will be described with reference to Fig. 3. Fig. 3 is a block diagram showing an example of a hardware configuration of the server 3 according to this embodiment.

[0031] As shown in FIG. 3, the server 3 includes a processor 31, a memory 32, a storage 33, a communication device 34, an input device 35, an output device 36, and a bus 37.

[0032] The processor 31 is an arithmetic processing device mounted on a computer. The processor 31 is, for example, configured with a CPU (Central Processing Unit), but may be configured with other microprocessors. The processor 31 may also be configured with one or more processors. The processor 31 executes programs stored in the memory 32 or other storage media, thereby performing various processes in the server 3.

[0033] The program is a computer program including instructions executed by a computer. The program may be provided to the server 3, for example, by distribution from an external device through a communication network. The program may also be provided to the server 3 via a non-transitive computer readable medium. By installing the program on the server 3, the server 3 can realize various functions defined by the program.

[0034] The memory 32 is a storage medium that stores programs and various other data. The memory 32 has, for example, a RAM (Random Access Memory) and a ROM (Read Only Memory). The ROM is a non-volatile memory that stores programs used by the processor 31 and data for operating the programs. The RAM is a volatile memory that temporarily stores data such as variables, calculation parameters, and calculation results used in the processing executed by the processor 31. The programs stored in the ROM are read into the RAM and executed by the processor 31 such as a CPU.

[0035] The storage 33 is a storage device for storing various information and data. The storage 33 has a recording medium such as a semiconductor memory, a hard disk, or an optical disk, and a drive for reading data from the recording medium or writing data to the recording medium. The storage 33 can store a larger amount of data than the memory 32. The storage 33 may be an internal storage built into the server 3, or an external storage connected via an external input / output terminal of the server 3. The storage 33 may also be an online storage connected via a communication network.

[0036] The communication device 34 is a device for communicating with an external device connected to the server 3 by wire or wirelessly. The communication device 34 establishes a communication connection with the external device in accordance with a predetermined protocol, and transmits and receives various information and data between the external device and the communication device.

[0037] The input device 35 is a device used by a user to input information to the server 3. The input device 35 includes, for example, a touch sensor, a keyboard, a keypad, a mouse, a remote controller, a button, a switch, or a dial. The input device 35 may include an input device for voice input, such as a microphone or a voice recognition module. The input device 35 may also include a remote control module that receives a user input for remotely operating the server 3 from a remote device. When the input device 35 accepts an input operation by a user, it transmits an input signal corresponding to the input operation to the processor 31.

[0038] The output device 36 is a device for outputting information and data to the outside of the server 3. The output device 36 includes a display device that displays information such as text, figures, and images, and an audio output device that outputs audio. The display device includes a display having a display screen, and an image display module. The display may be, for example, a liquid crystal display (LCD), a plasma display (PDP), an organic light emitting display (OLED), or a cathode ray tube (CRT). The display device may also be a touch panel having a touch sensor provided on the display screen. The audio output device includes a speaker and an audio output module.

[0039] The bus 37 interconnects the processor 31, memory 32, storage 33, communication device 34, input device 35, and output device 36. This allows various types of information and data to be transmitted and received between these devices.

[0040] [4. Hardware configuration of the first communication terminal and the second communication terminal] Next, a hardware configuration of the first communication terminal 1 according to the present embodiment will be described with reference to Fig. 4. Fig. 4 is a block diagram showing an example of a hardware configuration of the first communication terminal 1 according to the present embodiment. Note that the hardware configuration of the second communication terminal 2 is similar to that of the first communication terminal 1, and therefore a description of the hardware configuration of the second communication terminal 2 will be omitted.

[0041] As shown in FIG. 4, the first communication terminal 1 includes a processor 11, a memory 12, a storage 13, a communication device 14, an input device 15, an output device 16, and a bus 17.

[0042] Here, the processor 11, memory 12, storage 13, communication device 14, input device 15, output device 16 and bus 17 of the first communication terminal 1 have substantially the same configurations and functions as the processor 31, memory 32, storage 33, communication device 34, input device 35, output device 36 and bus 37 of the above-mentioned server 3 (see FIG. 3). Therefore, a detailed description of each device in the hardware configuration of the first communication terminal 1 will be omitted.

[0043] Furthermore, the ECU 702 (see FIG. 7) mounted on the vehicle 7 described above may have a hardware configuration similar to that of the server 3 (see FIG. 3) described above. Therefore, detailed description and illustration of each device in the hardware configuration of the ECU 702 will be omitted.

[0044] [5. Functional configuration of the first communication terminal] Next, a functional configuration of the first communication terminal 1 according to this embodiment will be described with reference to Fig. 5. Fig. 5 is a block diagram showing an example of a functional configuration of the first communication terminal 1 according to this embodiment.

[0045] 5, the first communication terminal 1 transmits advertisement product information representing a product worn by the advertising user 6 to the server 3. The first communication terminal 1 includes a clock unit 102, a GPS (Global Positioning System) module 104, an advertisement product registration unit 106, a storage unit 108, a transmission unit 110, a reception unit 112, and an update unit 114.

[0046] The timekeeping unit 102 has a clock function for measuring the date and time, and measures the current time. Time information indicating the current time measured by the timekeeping unit 102 is output to the transmission unit 110 and is recorded in the storage unit 108 as necessary.

[0047] The GPS module 104 is an example of a position detection device that detects the position of the first communication terminal 1. The GPS module 104 detects the position of the first communication terminal 1, thereby making it possible to detect the position of the advertising user 6. Position information indicating the position of the advertising user 6 detected by the GPS module 104 is output to the transmission unit 110 and recorded in the storage unit 108 as necessary. The position information includes, for example, latitude and longitude information. For example, the GPS module 104 constantly measures the position of the first communication terminal 1, i.e., the advertising user 6, when the power of the GPS module 104 is ON and the advertising user 6 is moving around the city.

[0048] The advertisement product registration unit 106 registers advertisement product information representing products worn by the advertisement user 6 in, for example, an application installed in the first communication terminal 1.

[0049] 6 is a schematic diagram showing a state in which the advertised product registration unit 106 according to the present embodiment is registering advertised product information. As shown in FIG. 6, the advertised product registration unit 106 registers information representing a bicycle 120 owned and worn by the advertising user 6A in the app as advertised product information. In addition, the advertised product registration unit 106 registers information representing cycling gloves 130 owned and worn by the advertising user 6A in the app as advertised product information. The advertised product information registered in the app is recorded in the storage unit 108 of the first communication terminal 1, for example.

[0050] The storage unit 108 records the time information, the position information, and the advertised product information. At this time, the storage unit 108 may store the time information, the position information, and the advertised product information in association with each other.

[0051] The transmitting unit 110 acquires time information and location information in real time from the clock unit 102 and the GPS module 104. The transmitting unit 110 associates the acquired time information and location information and records them in the storage unit 108. The transmitting unit 110 transmits the time information and location information acquired from the clock unit 102 and the GPS module 104 to the server 3 at predetermined intervals.

[0052] Furthermore, the transmission unit 110 transmits the advertised product information registered by the advertised product registration unit 106 to the server 3. Here, the transmission unit 110 transmits the advertised product information to the server 3 when the advertised product information is registered. However, this is not limited thereto, and the transmission unit 110 may transmit the advertised product information to the server 3 at a predetermined interval after the advertisement product information is registered. Furthermore, the transmission unit 110 may transmit the advertised product information, the time information, and the location information to the server 3 in association with each other. Furthermore, the transmission unit 110 may record the advertised product information, the time information, and the location information in association with each other in the storage unit 108. Furthermore, the transmission unit 110 may transmit the advertised product information, the time information, and the location information recorded in the storage unit 108 to the server 3.

[0053] In this way, the transmitting unit 110 transmits to the server 3 location information (first location information) indicating the location of the advertising user 6 during movement, time information (first time information) indicating the time when the advertising user 6 is at that location, and advertising product information.

[0054] The receiving unit 112 receives reward information as advertising revenue from the server 3 when a product is purchased based on the advertised product information registered by the advertising user 6. The reward information is, for example, point information indicating points that can be used within the app. Note that the reward is not limited to points and may be, for example, cash.

[0055] When the update unit 114 receives the reward information, it updates the user information associated with the advertising user 6. For example, the update unit 114 performs an update process of point information available in the app among the user information associated with the advertising user 6. Specifically, when the receiving unit 112 receives the reward information, the update unit 114 performs a process of adding the points granted by the server 3 to the points held by the advertising user 6. In addition, when the advertising user 6 consumes points in the app, it performs a process of subtracting the consumed points from the points held by the advertising user 6. The update unit 114 records the updated point information in the storage unit 108. Note that, when the reward is cash, the update unit 114 updates the cash information held by the advertising user 6 and records it in the storage unit 108.

[0056] [6. Functional configuration of the vehicle and the second communication terminal] Next, functional configurations of the vehicle 7 and the second communication terminal 2 according to this embodiment will be described with reference to Fig. 7. Fig. 7 is a schematic diagram showing an example of functional configurations of the vehicle 7 and the second communication terminal 2 according to this embodiment.

[0057] 7, the vehicle 7 includes an ECU (Electronic Control Unit) 702. The ECU 702 and the exterior image capture device 71 are connected to each other, for example, by wire or wirelessly, so as to be able to communicate with each other.

[0058] The ECU 702 is an example of a control device that controls various devices mounted on the vehicle 7. The ECU 702 is configured with a microcontroller that electronically controls the various devices mounted on the vehicle 7.

[0059] The ECU 702 has a function of communicating with each device provided in the vehicle 7, such as a control device, an in-vehicle electronic device, etc. The ECU 702 transmits and receives various information to and from each of the devices. For example, CAN (Controller Area Network) communication may be used as a communication method between the ECU 702 and each device. The ECU 702 also functions as a communication device that communicates with an external device such as the second communication terminal 2. The ECU 702 is provided with a wireless communication device, and transmits or receives various information to and from the external device such as the second communication terminal 2. For example, the ECU 702 transmits image information captured by the exterior image capture device 71 and passenger information collected inside the vehicle to the second communication terminal 2.

[0060] The second communication terminal 2 includes a built-in microphone 202, a clock unit 204, a GPS module 206, a specific action detection unit 208, a memory unit 210, a specific action display unit 212, a specific action selection unit 214, a product search request generation unit 216, and a transmission unit 218. The second communication terminal 2 also includes a reception unit 220, a candidate product display unit 222, a candidate product selection unit 224, a surrounding image display unit 226, a specified position detection unit 228, a similar product search request generation unit 230, a similar product display unit 232, a purchase product selection unit 234, and a purchase processing unit 236.

[0061] When the second communication terminal 2 is inside the vehicle 7, the built-in microphone 202 picks up sound from inside the vehicle 7. Audio data representing the sound picked up by the built-in microphone 202 is output to the specific action detection unit 208 and recorded in the storage unit 210 as necessary.

[0062] The clock unit 204 has a clock function for measuring the date and time, and measures the current time. Time information indicating the current time measured by the clock unit 204 is output to the specific action detection unit 208 and is recorded in the storage unit 210 as necessary.

[0063] The GPS module 206 is an example of a position detection device that detects the position of the second communication terminal 2. When the second communication terminal 2 is inside the vehicle 7, the position of the vehicle 7 can be detected by detecting the position of the second communication terminal 2 using the GPS module 206. Position information indicating the position of the vehicle 7 detected by the GPS module 206 is output to the specific action detection unit 208 and recorded in the storage unit 210 as necessary. The position information includes, for example, latitude and longitude information.

[0064] The specific action detection unit 208 acquires time information and location information in real time from the clock unit 204 and the GPS module 206. In addition, the specific action detection unit 208 detects specific actions by the passengers 74 of the vehicle 7 while the vehicle 7 is moving, the specific actions indicating an intention to purchase a product worn by the advertising user 6 present in the vicinity of the vehicle 7.

[0065] For example, the specific action detection unit 208 detects a specific action based on voice data collected by the built-in microphone 202. The specific action detection unit 208 can detect a specific statement by the passenger 74 using a known voice recognition technology. Specifically, the specific action detection unit 208 detects a specific statement by the passenger 74, which indicates a desire to purchase a product worn by the advertising user 6 present in the vicinity of the vehicle 7, as a specific action. The specific statement is, for example, a specific keyword such as "I want that." Note that, although an example in which the specific action detection unit 208 detects a specific action by a specific statement by the passenger 74 has been shown here, this is not limiting. For example, the second communication terminal 2 may be provided with a specific button or switch, and the specific action detection unit 208 may detect a specific action by pressing the button or switch.

[0066] The specific action detection unit 208 records specific action information, which associates position information (second position information) indicating the position of the vehicle 7 when the specific action was detected with time information (second time information) indicating the time when the specific action was detected, in the storage unit 210. The specific action detection unit 208 records the specific action information, which associates the position information with the time information, in the storage unit 210 every time a specific action is detected.

[0067] Here, the specific action detection unit 208 and the ECU 702 are connected to each other so as to be able to communicate with each other, for example, by wire or wirelessly. Therefore, the specific action detection unit 208 can receive image data of the vehicle surroundings image captured by the vehicle exterior imaging device 71. The specific action detection unit 208 acquires image data of the vehicle surroundings image captured by the vehicle exterior imaging device 71 when the specific action is detected. In this embodiment, the specific action detection unit 208 associates the image data captured by the vehicle exterior imaging device 71 when the specific action is detected with the position information and time information, and records the image data as specific action information in the storage unit 210. Note that the specific action detection unit 208 may automatically apply mosaic or blur to the face of a person included in the image when acquiring the vehicle surroundings image.

[0068] The specific action display unit 212 displays the specific action information recorded in the storage unit 210 on a display (display unit) of the second communication terminal 2.

[0069] The specific action selection unit 214 selects at least one specific action information by the passenger 74 selecting at least one specific action information from one or more specific action information displayed on the display. In other words, the specific action selection unit 214 selects at least one specific action information by the passenger 74 selecting at least one specific action information from one or more specific action information recorded in the storage unit 210. Specifically, when the passenger 74 taps on specific action information displayed on the display, the specific action selection unit 214 selects the tapped specific action information.

[0070] FIG. 8 is a schematic diagram showing a state in which the specific action selection unit 214 according to the present embodiment is selecting specific action information. As shown in FIG. 8, a plurality of pieces of specific action information are displayed on the display of the second communication terminal 2. Here, time information (e.g., "10:20") and location information (e.g., "Location: XXX") are associated with each other and displayed on the display as specific action information. The specific action information is also displayed on the display in chronological order. In FIG. 8, the passenger 74 taps on specific action information associated with the time information "11:30" and location information "Location: XXX" displayed on the display. At this time, the specific action selection unit 214 selects the tapped specific action information.

[0071] When one or more pieces of specific action information are selected by the specific action selection unit 214, the product search request generation unit 216 generates a product search request including the position information and time information corresponding to the selected specific action information.

[0072] When one or more pieces of specific action information are selected by the specific action selection unit 214, the transmission unit 218 transmits the product search request generated by the product search request generation unit 216 to the server 3.

[0073] The receiving unit 220 receives one or more pieces of candidate product information transmitted from the server 3 in response to a product search request. The candidate product information is advertised product information extracted by the server 3 based on specific action information, which will be described in detail later.

[0074] The candidate commodity display unit 222 displays one or more pieces of candidate commodity information received by the receiving unit 220 on the display of the second communication terminal 2 .

[0075] The candidate product selection unit 224 selects at least one piece of candidate product information by the passenger 74 selecting at least one piece of candidate product information from one or more pieces of candidate product information displayed on the display. Specifically, when the passenger 74 taps on the candidate product information displayed on the display, the candidate product selection unit 224 selects the tapped candidate product information. In addition, the candidate product selection unit 224 determines whether or not the candidate product information has been selected by the passenger 74. For example, when an instruction button indicating that the passenger 74 does not have a product desired to be purchased among the candidate product information is displayed on the display and the instruction button is input, the candidate product selection unit 224 determines that no candidate product information has been selected. Note that the candidate product selection unit 224 may determine that an instruction indicating that the passenger 74 does not have a product desired to be purchased among the candidate product information has been made if the passenger 74 has not selected any candidate product information for a certain period of time or more.

[0076] FIG. 9 is a schematic diagram showing a state in which the candidate product selection unit 224 according to the present embodiment is selecting candidate product information. As shown in FIG. 9, a plurality of pieces of candidate product information are displayed on the display of the second communication terminal 2. Here, product information representing the advertised products "bicycle", "cycling gloves", and "one piece" are displayed on the display as a plurality of pieces of candidate product information. In FIG. 9, the passenger 74 taps on the candidate product information representing "bicycle" displayed on the display. At this time, the candidate product selection unit 224 selects the tapped candidate product information. In this way, the candidate product selection unit 224 selects the candidate product information as the purchase desired product selected by the passenger 74 from the candidate product information displayed on the display.

[0077] The surrounding image display unit 226 acquires image data of the vehicle surrounding image recorded in the storage unit 210. When an instruction is input indicating that the product desired to be purchased by the passenger 74 is not included in the candidate product information displayed on the display, the surrounding image display unit 226 displays the vehicle surrounding image corresponding to the specific action information selected by the passenger 74 on the display.

[0078] The designated position detection unit 228 detects the display position of the product desired to be purchased designated by the passenger 74 in the vehicle surroundings image displayed on the display. Specifically, the designated position detection unit 228 detects the position tapped by the passenger 74 in the vehicle surroundings image displayed on the display as the display position of the product desired to be purchased. However, without being limited to this, the designated position detection unit 228 may detect the coordinate position designated by the passenger 74 in the vehicle surroundings image displayed on the display as the display position of the product desired to be purchased. In addition, the designated position detection unit 228 determines whether or not a position has been designated by the passenger 74 in the vehicle surroundings image.

[0079] Fig. 10 is a schematic diagram showing a state in which the designated position detection unit 228 according to this embodiment detects the display position of the product desired to be purchased. As shown in Fig. 10, a vehicle surroundings image 140 is displayed on the display of the second communication terminal 2. A "skateboard" which is a product desired to be purchased by a passenger 74 is displayed on the vehicle surroundings image 140. In Fig. 10, the passenger 74 taps on the "skateboard" displayed on the display. At this time, the designated position detection unit 228 detects the tapped position as the display position of the product desired to be purchased 150.

[0080] When the designated position detection unit 228 detects the display position of the desired product 150, the similar product search request generation unit 230 generates a similar product search request including designated position information representing the detected display position and at least a portion of the vehicle surroundings image 140.

[0081] When the designated position detection unit 228 detects the display position of the purchase-requested product 150 , the transmission unit 218 transmits the similar products search request generated by the similar products search request generation unit 230 to the server 3 .

[0082] The receiving unit 220 receives one or more pieces of similar product information transmitted from the server 3 in response to the similar product search request. The similar product information, which will be described in detail later, is product information that represents one or more similar products that are identical to or similar to the purchase-requested product 150 extracted by the server 3 based on the designated position information and the vehicle surroundings image 140.

[0083] The similar product display unit 232 displays one or more pieces of similar product information received by the receiving unit 220 on the display of the second communication terminal 2.

[0084] The purchase product selection unit 234 selects at least one similar product information from one or more similar product information displayed on the display when the passenger 74 selects at least one similar product information. Specifically, when the passenger 74 taps on similar product information displayed on the display, the purchase product selection unit 234 selects the tapped similar product information.

[0085] The purchase processing unit 236 performs purchase processing of a product corresponding to the candidate product information selected by the candidate product selection unit 224 or the similar product information selected by the purchase product selection unit 234. Specifically, the purchase processing unit 236 generates a purchase request including the selected candidate product information or similar product information, and transmits the purchase request to the server 3. The purchase processing includes a settlement process for purchasing the product.

[0086] Next, the functional configuration of the vehicle 7 and the second communication terminal 2 according to the modified example will be described with reference to Fig. 11. Fig. 11 is a schematic diagram showing an example of the functional configuration of the vehicle 7 and the second communication terminal 2 according to the modified example. Components that are substantially the same as those of the vehicle 7 and the second communication terminal 2 according to the above embodiment are given the same reference numerals and will not be described.

[0087] The ECU 702, the exterior imaging device 71, the interior imaging device 72, and the interior microphone 73 are connected to each other, for example, by wire or wirelessly, so as to be able to communicate with each other. The ECU 702 is an example of a state detection device that detects passenger information indicating the state of a passenger 74 riding in the vehicle 7. The ECU 702 collects passenger information based on information detected by various detection devices (for example, the interior imaging device 72 and the interior microphone 73 described above) mounted on the vehicle 7.

[0088] Here, the specific action detection unit 208 and the ECU 702 are connected to each other so as to be able to communicate with each other, for example, by wire or wirelessly. Therefore, the specific action detection unit 208 can receive image data captured by the in-vehicle imaging device 72 and audio data collected by the in-vehicle microphone 73. Therefore, the specific action detection unit 208 can detect the specific action based on the audio data collected by the in-vehicle microphone 73.

[0089] Furthermore, the specific action detection unit 208 can detect a specific action based on image data of the passenger 74 captured by the in-vehicle imaging device 72. Specifically, the specific action detection unit 208 detects, as the specific action, a specific motion or eye movement of the passenger 74 indicating a desire to purchase a product worn by the advertising user 6 present in the vicinity of the vehicle 7. The specific motion is, for example, a motion of the passenger 74 pointing a finger at the advertising user 6. The eye movement is, for example, a motion of the passenger 74 gazing intently at the advertising user 6.

[0090] In the present embodiment, an example in which the specific action detection unit 208 is provided in the second communication terminal 2 has been described. However, the present invention is not limited to this, and the ECU 702 may be provided with a functional unit that functions as the specific action detection unit 208. In this case, the ECU 702 may detect a specific action by the passenger 74 of the vehicle 7, which indicates an intention to purchase a product worn by the advertising user 6 present in the vicinity of the vehicle 7, while the vehicle 7 is moving. Furthermore, the specific action detection unit 208 and the ECU 702 may cooperate to detect a specific action by the passenger 74 of the vehicle 7, which indicates an intention to purchase a product worn by the advertising user 6 present in the vicinity of the vehicle 7, while the vehicle 7 is moving. In this way, the ECU 702 and the specific action detection unit 208 may cooperate to function as a part of the second communication terminal 2.

[0091] The ECU 702 identifies the direction in which the passenger 74 who performed the specific action is looking, based on at least one of the voice data collected by the in-vehicle microphone 73 and the image data of the passenger 74 captured by the in-vehicle image capture device 72. Then, the ECU 702 transmits direction information indicating the identified direction to the specific action detection unit 208.

[0092] The specific action detection unit 208 associates the direction information received from the ECU 702 with the position information received from the GPS module 206 and the time information received from the clock unit 204, and records the resulting information in the storage unit 210 as specific action information. Then, when one or more pieces of specific action information are selected by the specific action selection unit 214, the product search request generation unit 216 generates a product search request including the direction information, position information, and time information corresponding to the selected specific action information.

[0093] When one or more pieces of specific action information are selected by the specific action selection unit 214, the transmission unit 218 transmits the product search request generated by the product search request generation unit 216 to the server 3.

[0094] [7. Server Functionality Configuration] Next, the functional configuration of the server 3 according to this embodiment will be described with reference to Fig. 12. Fig. 12 is a block diagram showing an example of the functional configuration of the server 3 according to this embodiment.

[0095] 12, the server 3 includes a receiving unit 302, a candidate product database 304, a candidate product search unit 306, a candidate product extraction unit 308, and a transmitting unit 310. The server 3 also includes a similar product search unit 312, a similar product database 314, a similar product extraction unit 316, a purchase processing unit 318, and a reward granting unit 320.

[0096] The receiving unit 302 receives, from the first communication terminal 1, advertised product information indicating products worn by the advertising user 6. The receiving unit 302 also receives, from the first communication terminal 1, location information (first location information) indicating a location where the advertising user 6 is moving, and time information (first time information) indicating the time when the advertising user 6 is at that location. The receiving unit 302 associates the location information, time information, and advertised product information received from the first communication terminal 1 and stores them in the candidate product database 304.

[0097] The candidate product database 304 records and accumulates the location information, time information, and advertised product information received from the first communication terminal 1.

[0098] In addition, the receiving unit 302 receives a product search request from the second communication terminal 2, the product search request including location information (second location information) indicating the location of the vehicle 7 when the specific action was detected and time information (second time information) indicating the time when the specific action was detected.

[0099] When the candidate product search unit 306 receives a product search request, it searches for advertised product information stored in the candidate product database 304 based on the location information and time information included in the product search request.

[0100] The candidate product extraction unit 308 extracts, from the advertised product information stored in the candidate product database 304, candidate product information that indicates one or more candidate products that correspond to the location information and time information included in the product search request.

[0101] Specifically, the candidate product search unit 306 compares the first location information and the first time information of a large number of pieces of advertised product information stored in the candidate product database 304 with the second location information and the second time information received from the second communication terminal 2. Then, the candidate product search unit 306 searches for the first location information and the first time information that are close to the second location information and the second time information.

[0102] Specifically, the candidate product search unit 306 searches for first location information corresponding to a location within a predetermined distance from a location corresponding to the second location information, and first time information corresponding to a time within a predetermined time from a time corresponding to the second time information. Then, the candidate product extraction unit 308 extracts advertised product information associated with the first location information and the first time information close to the second location information and the second time information received from the second communication terminal 2.

[0103] This makes it possible to extract, as candidate products, the advertising user 6 who was present near the vehicle 7 at the time (second time information) when a specific action was detected in the vehicle 7 and the advertised product information of the product worn by the advertising user 6.

[0104] When the candidate product extraction unit 308 receives from the second communication terminal 2 a product search request including direction information indicating the direction in which the passenger 74 who performed the specific action is looking, the candidate product extraction unit 308 extracts advertised product information based on the second time information, the second location information, and the direction information. Specifically, the candidate product extraction unit 308 extracts first location information corresponding to a location within a predetermined distance from the location corresponding to the second location information, and first time information corresponding to a time within a predetermined time from the time corresponding to the second time information. Furthermore, the candidate product extraction unit 308 extracts first location information corresponding to a location according to the direction of the direction information with respect to the location corresponding to the second location information.

[0105] In addition, the receiving unit 302 receives from the second communication terminal 2 specified position information indicating the display position of the product desired to be purchased specified by the occupant 74 in the vehicle surroundings image 140, and a similar product search request including at least a portion of the vehicle surroundings image 140.

[0106] When the similar product search unit 312 receives the similar product search request, it searches the similar product database 314 based on at least a part of the vehicle surroundings image 140 and the specified position information included in the similar product search request. The similar product database 314 stores various product information related to products provided by service providers who operate, for example, stores and commercial facilities.

[0107] Specifically, the similar product search unit 312 specifies the display position of the desired product in the vehicle surroundings image 140 based on the specified position information. Then, the similar product search unit 312 extracts a partial image within a predetermined range from the display position from the vehicle surroundings image 140. The similar product search unit 312 compares the partial image with product images of a large number of product information items stored in the similar product database 314. Then, the similar product search unit 312 searches for products that are the same as or similar to the product image.

[0108] The similar product extraction unit 316 extracts similar product information representing one or more similar products that are the same as or similar to the product desired to be purchased and designated by the passenger 74 from among multiple pieces of product information stored in the similar product database 314.

[0109] The transmission unit 310 transmits the candidate product information extracted by the candidate product extraction unit 308 to the second communication terminal 2. In addition, the transmission unit 310 transmits the similar product information extracted by the similar product extraction unit 316 to the second communication terminal 2.

[0110] When the purchase processing unit 318 receives a purchase request including candidate product information or similar product information selected by the passenger 74 from the second communication terminal 2, it performs an order process for the product corresponding to the candidate product information or similar product information with the seller server 4.

[0111] When the reward granting unit 320 receives a purchase request including the candidate product information from the second communication terminal 2, the reward granting unit 320 grants a reward to the advertising user 6 who has registered the advertising product information corresponding to the candidate product information. Specifically, the reward granting unit 320 grants points that can be used in an app as a reward to the advertising user 6. Note that the reward is not limited to points and may be, for example, cash. The reward granting unit 320 transmits reward information indicating the reward to be granted to the advertising user 6 to the first communication terminal 1.

[0112] [8. Product Purchasing System Processing Flow] Next, with reference to Figs. 13 to 17, the processing executed by product purchase system 1000 according to the present embodiment will be described. Fig. 13 is a first sequence diagram showing the processing executed by product purchase system 1000 according to the present embodiment. Fig. 14 is a second sequence diagram showing the processing executed by product purchase system 1000 according to the present embodiment. Fig. 15 is a third sequence diagram showing the processing executed by product purchase system 1000 according to the present embodiment. Fig. 16 is a fourth sequence diagram showing the processing executed by product purchase system 1000 according to the present embodiment. Fig. 17 is a fifth sequence diagram showing the processing executed by product purchase system 1000 according to the present embodiment.

[0113] 13, the first communication terminal 1 registers, in an installed application, advertised product information representing a product worn by the advertising user 6, and transmits the registered advertised product information to the server 3 (S100). The first communication terminal 1 transmits time information and location information acquired from the clock unit 102 and the GPS module 104 to the server 3 at predetermined intervals (S102).

[0114] The server 3 receives, from the first communication terminal 1, advertising product information representing products worn by the advertising user 6 (S200). The server 3 also receives, from the first communication terminal 1, location information (first location information) representing a location where the advertising user 6 is moving and time information (first time information) representing the time when the advertising user 6 is at that location at any time (S202). The server 3 then records and accumulates the location information, time information, and advertising product information received from the first communication terminal 1 (S204).

[0115] While the vehicle 7 is moving, the second communication terminal 2 detects a specific action by the passenger 74 of the vehicle 7, which indicates an intention to purchase a product worn by the advertising user 6 present in the vicinity of the vehicle 7 (S300). The second communication terminal 2 records in the storage unit 210 specific action information that associates location information (second location information) indicating the location of the vehicle 7 when the specific action was detected with time information (second time information) indicating the time when the specific action was detected (S302).

[0116] The second communication terminal 2 displays the specific action information recorded in the storage unit 210 on a display (display unit) of the second communication terminal 2. In addition, the second communication terminal 2 selects at least one specific action information by the passenger 74 selecting at least one specific action information from the one or more pieces of specific action information displayed on the display (S304).

[0117] When one or more pieces of specific action information are selected by the specific action selection unit 214, the second communication terminal 2 generates a product search request including location information and time information corresponding to the selected specific action information. In addition, the second communication terminal 2 transmits the generated product search request to the server 3 (S306).

[0118] The server 3 receives a product search request including location information (second location information) indicating the location of the vehicle 7 when the specific action was detected and time information (second time information) indicating the time when the specific action was detected from the second communication terminal 2 (S206). Then, as shown in Fig. 14, the server 3 searches for advertised product information stored in the candidate product database 304 based on the location information and time information included in the product search request (S208).

[0119] The server 3 extracts candidate product information representing one or more candidate products corresponding to the location information and time information included in the product search request from the advertisement product information stored in the candidate product database 304 (S210). The server 3 transmits the extracted candidate product information to the second communication terminal 2 (S212).

[0120] The second communication terminal 2 receives one or more pieces of candidate product information transmitted from the server 3 in response to the product search request (S308). Then, the second communication terminal 2 displays the received one or more pieces of candidate product information on the display of the second communication terminal 2 (S310). In addition, the second communication terminal 2 determines whether or not the passenger 74 has selected a product that he or she wishes to purchase (S312).

[0121] As shown in FIG. 15, when the passenger 74 selects a product he or she wishes to purchase (YES in S312), the second communication terminal 2 generates a purchase request including candidate product information corresponding to the selected product he or she wishes to purchase, and transmits the purchase request to the server 3 (S314).

[0122] The server 3 receives a purchase request including the candidate product information selected by the passenger 74 from the second communication terminal 2 (S214). Then, when the server 3 receives the purchase request, it performs an order process for the product corresponding to the candidate product information to the seller server 4 (S216). In addition, when the server 3 receives a purchase request including the candidate product information from the second communication terminal 2, it grants a reward to the advertising user 6 who registered the advertising product information corresponding to the candidate product information (S218).

[0123] When a product is purchased based on the advertised product information registered in the app, the first communication terminal 1 receives reward information as advertising revenue from the server 3 (S104). When the first communication terminal 1 receives the reward information, it updates the user information associated with the advertising user 6 (S106).

[0124] 16, when the passenger 74 has not selected a product desired to be purchased (NO in S312), the second communication terminal 2 displays a vehicle surroundings image on the display (S316). Specifically, when an instruction is input indicating that the passenger 74 does not have a product desired to be purchased among the candidate product information displayed on the display, the second communication terminal 2 displays a vehicle surroundings image corresponding to the specific action information selected by the passenger 74 on the display. Then, the second communication terminal 2 determines whether or not a position has been specified by the passenger 74 in the vehicle surroundings image (S318).

[0125] When a position is specified, the second communication terminal 2 detects the position specified by the passenger 74 in the vehicle surroundings image displayed on the display as the display position of the desired product (S320). Then, the second communication terminal 2 generates a similar product search request including specified position information indicating the detected display position and at least a part of the vehicle surroundings image 140. In addition, the second communication terminal 2 transmits the generated similar product search request to the server 3 (S320).

[0126] The server 3 receives from the second communication terminal 2 designated position information indicating the display position of the desired product designated by the passenger 74 in the vehicle surroundings image 140, and a similar product search request including at least a part of the vehicle surroundings image 140 (S220). Here, the server 3 identifies the display position of the desired product in the vehicle surroundings image 140 based on the designated position information. Then, the server 3 extracts a partial image within a predetermined range from the display position from the vehicle surroundings image 140 (S222).

[0127] The server 3 compares the partial image with the product images of a large number of product information stored in the similar product database 314, and searches for similar products that are identical or similar to the product image (S224). Then, the server 3 extracts similar product information representing one or more similar products that are identical or similar to the product desired to be purchased and designated by the passenger 74 from the multiple product information stored in the similar product database 314 (S226). The server 3 transmits the extracted similar product information to the second communication terminal 2 (S228).

[0128] The second communication terminal 2 receives one or more pieces of similar product information transmitted from the server 3 in response to the similar product search request (S324). Then, the second communication terminal 2 displays the received one or more pieces of similar product information on the display of the second communication terminal 2 (S236). The second communication terminal 2 selects at least one piece of similar product information by the passenger 74 selecting at least one piece of similar product information from the one or more pieces of similar product information displayed on the display (S328). The selected similar product information is information representing the product desired to be purchased by the passenger 74.

[0129] 17, when a product desired to be purchased is selected (S328), the second communication terminal 2 generates a purchase request including similar product information indicating products similar to the selected product desired to be purchased, and transmits the purchase request to the server 3 (S330). The subsequent processes are the same as those of S214, S216, S218, S104, and S106 described in FIG.

[0130] 13 to 16, the processes executed by the first communication terminal 1, server 3, and second communication terminal 2 of product purchasing system 1000 according to this embodiment have been described above. Each process is realized, for example, by installing a program for executing each process in the first communication terminal 1, server 3, and second communication terminal 2.

[0131] [9. Summary] As described above, according to this embodiment, A product purchasing system in which a first communication terminal carried by an advertising user who functions as a personal advertising tower for a product, a second communication terminal movably installed together with a vehicle, and a server are communicatively connected via a network, The first communication terminal, Transmitting to the server first location information representing a location of the advertising user during the movement of the advertising user, first time information representing a time when the advertising user is at the location, and advertising product information representing a product worn by the advertising user; The server, receiving the first location information, the first time information, and the advertised product information from the first communication terminal; storing the first location information, the first time information, and the advertised product information received from the first communication terminal in a database in association with each other; The second communication terminal, Detecting a specific action by a passenger of the vehicle, which indicates an intention to purchase a product worn by the advertising user who is present in the vicinity of the vehicle, while the vehicle is moving; recording specific action information, which associates second position information indicating a position of the vehicle when the specific action is detected with second time information indicating a time when the specific action is detected, for each specific action; When at least one specific action information is selected by the passenger from the one or more recorded specific action information, a product search request including the second location information and the second time information corresponding to the selected specific action information is transmitted to the server; The server, receiving the product search request from the second communication terminal; searching the advertised product information stored in the database based on the second location information and the second time information included in the product search request, and extracting candidate product information representing one or more candidate products corresponding to the second location information and the second time information from the advertised product information; Transmitting the extracted candidate product information to the second communication terminal; The second communication terminal, receiving the candidate product information from the server; displaying the candidate product information on a display unit; A product purchasing system is provided.

[0132] According to this embodiment, A product purchasing system in which a first communication terminal carried by an advertising user who functions as a personal advertising tower for a product, a second communication terminal movably installed together with a vehicle, and a server are communicatively connected via a network, The first communication terminal, one or more first processors; one or more first memories coupled to the first processor; Equipped with The first processor of the first communication terminal, Transmitting to the server first location information representing a location of the advertising user during the movement of the advertising user, first time information representing a time when the advertising user is at the location, and advertising product information representing a product worn by the advertising user; Perform a process including The server, one or more second processors; one or more second memories coupled to the second processor; Equipped with The second processor of the server receiving the first location information, the first time information, and the advertised product information from the first communication terminal; storing the first location information, the first time information, and the advertised product information received from the first communication terminal in a database in association with each other; Perform a process including The second communication terminal, one or more third processors; one or more third memories coupled to the third processor; Equipped with The third processor of the second communication terminal, Detecting a specific action by a passenger of the vehicle, which indicates an intention to purchase a product worn by the advertising user who is present in the vicinity of the vehicle, while the vehicle is moving; recording specific action information, which associates second position information indicating a position of the vehicle when the specific action is detected with second time information indicating a time when the specific action is detected, for each specific action; When at least one specific action information is selected by the passenger from the one or more recorded specific action information, transmitting a product search request including the second location information and the second time information corresponding to the selected specific action information to the server; Perform a process including The second processor of the server receiving the product search request from the second communication terminal; searching the advertised product information stored in the database based on the second location information and the second time information included in the product search request, and extracting candidate product information representing one or more candidate products corresponding to the second location information and the second time information from the advertised product information; Transmitting the extracted candidate product information to the second communication terminal; Perform a process including The third processor of the second communication terminal, receiving the candidate product information from the server; Displaying the candidate product information on a display unit; A product purchasing system is provided that performs a process including the steps of:

[0133] This allows the time and location at which the passenger 74 finds the product to be purchased to be recorded. In addition, based on the recorded time and location, the product desired by the passenger 74 can be matched with the advertised product registered by the advertising user 6. In addition, if the product desired by the passenger 74 matches the advertised product registered by the advertising user 6, the product to be purchased can be provided to the passenger 74. In this way, it is possible to assist in the purchase of a product seen outside the vehicle while driving. Therefore, the passenger 74 can obtain the product to be purchased without relying on the passenger 74's own memory. By recording only the time information and location information required to identify the product to be purchased, the storage capacity of the memory unit 210 can be saved. In addition, since only the minimum necessary information is stored, the effort required for searching for the information can be saved.

[0134] The vehicle is provided with an exterior imaging device that captures an image of an external surrounding environment of the vehicle, The second communication terminal, When the specific action is detected while the vehicle is moving, the specific action information may be recorded, which associates the vehicle surroundings image captured by the exterior imaging device, the second position information, and the second time information.

[0135] As a result, when the passenger 74 finds a product he or she wishes to purchase, the passenger 74 can obtain an image of the vehicle's surroundings without holding a camera. Furthermore, if the passenger 74 is a driver, he or she can concentrate on driving the vehicle 7 and drive safely because there is no need to hold a camera. Furthermore, if the passenger 74 is automatically blurred or blurred on the faces of people included in the image when the vehicle's surroundings image is obtained, capturing the vehicle's surroundings image with the exterior imaging device 71 is less likely to be considered a nuisance.

[0136] When the passenger selects a product he or she wishes to purchase from the candidate product information displayed on the display unit, the second communication terminal executes a purchase process for the product desired to be purchased; When an instruction is input indicating that the passenger's desired product is not included in the candidate product information displayed on the display unit, The second communication terminal, displaying, on the display unit, the vehicle surroundings image corresponding to the specific action information selected by the passenger; Transmitting to the server, designated position information indicating a display position of the desired product designated by the passenger in the displayed vehicle surroundings image, and a similar product search request including at least a part of the vehicle surroundings image; The server, searching the database based on at least a portion of the vehicle surroundings image and the specified position information included in the similar product search request received from the second communication terminal, extracting similar product information representing one or more similar products that are identical or similar to the desired product specified by the passenger, and transmitting the extracted similar product information to the second communication terminal; The second communication terminal, The similar product information received from the server may be displayed on a display unit.

[0137] This allows passenger 74 to be provided with a product that is the same as or similar to the product desired by passenger 74 even if the product desired by passenger 74 does not match the advertised product registered by advertising user 6.

[0138] At least one of the vehicle and the second communication terminal is provided with a microphone that picks up sounds inside the vehicle; The second communication terminal may detect, based on the voice data picked up by the microphone, a specific statement by the passenger indicating a desire to purchase a product worn by the advertising user who is present in the vicinity of the vehicle, as the specific action.

[0139] This makes it possible to detect the timing of a request for a product desired to be purchased based on, for example, a specific keyword of the passenger 74. Therefore, it is possible to improve the accuracy of the request timing for the product desired to be purchased.

[0140] the vehicle is provided with an in-vehicle imaging device that images an interior of the vehicle; The second communication terminal may detect, based on image data of the occupant captured by the in-vehicle imaging device, a specific gesture or eye movement of the occupant indicating a desire to purchase a product worn by the advertising user who is present in the vicinity of the vehicle, as the specific action.

[0141] This makes it possible to detect the timing of the request for the desired product based on a specific action or line of sight movement of the passenger 74. Therefore, it is possible to detect the timing at which the passenger 74 is paying attention to the desired product, thereby improving the accuracy of the request timing for the desired product.

[0142] the vehicle is provided with at least one of a plurality of microphones that pick up sounds inside the vehicle and an in-vehicle imaging device that images the inside of the vehicle; the second communication terminal identifies a direction in which the occupant who performed the specific action is looking, based on at least one of the voice data collected by the microphone or the image data of the occupant captured by the in-vehicle image capture device, and transmits the product search request to the server, the product search request including directional information indicating the identified direction, the second location information, and the second time information; The server may extract the candidate product information based on the first location information, the second location information, and the direction information.

[0143] This makes it possible to identify the direction in which the passenger 74 is looking around the vehicle 7, and enables accurate matching of the products desired to be purchased by the passenger 74 with the advertised products registered by the advertising user 6.

[0144] Although the embodiment of the present invention has been described above with reference to the attached drawings, it goes without saying that the present invention is not limited to such an embodiment. It is clear that a person skilled in the art can think of various modified or altered examples within the scope of the claims, and it is understood that such examples also naturally belong to the technical scope of the present invention.

[0145] The series of processes performed by each device (e.g., the first communication terminal 1, the second communication terminal 2, and the server 3) according to the present embodiment described above may be realized using any of software, hardware, or a combination of software and hardware. The programs constituting the software are stored in advance, for example, in a non-transitory storage medium provided inside or outside each device. Then, the programs are read, for example, from the non-transitory storage medium (e.g., ROM) to a transitory storage medium (e.g., RAM) and executed by a processor such as a CPU.

[0146] A program for implementing each function of each of the above devices can be created and installed in the computer of each of the above devices. The processor executes the program stored in the memory to perform the processing of each of the above functions. At this time, the program may be shared and executed by multiple processors, or the program may be executed by a single processor. Also, the functions of each of the above devices may be implemented by cloud computing using multiple computers interconnected by a communication network.

[0147] The program may be provided to the computer of each device by distribution from an external device through a communication network and installed therein. Alternatively, the program may be stored in a non-transitory computer readable medium and provided to the computer of each device via the recording medium and installed therein.

[0148] According to the present embodiment, a program for executing the processing of each function of each of the above devices can be provided. Furthermore, a non-transitory recording medium in which the program is stored and readable by a computer can be provided. The non-transitory recording medium may be, for example, a disk-type recording medium such as an optical disk, a magnetic disk, or a magneto-optical disk, or may be a semiconductor memory such as a flash memory or a USB memory. [Explanation of symbols]

[0149] TD direction of travel 1. First communication terminal 2. Second communication terminal 3 Server 4. Seller server 5. Network 6 Advertising Users 7. Vehicles 71 Vehicle exterior imaging device 72 In-vehicle imaging device 73 Car Microphone 74 Passengers 102 Timing section 104 GPS Module 106 Advertising Product Registration Department 108 Storage section 110 Transmitter 112 Receiving unit 114 Update Department 202 Built-in microphone 204 Timing section 206 GPS Module 208 Specific Action Detection Unit 210 Storage section 212 Specific action display section 214 Specific Action Selection Section 216 Product search request generation unit 218 Transmitter 220 Receiving unit 222 Candidate product display section 224 Candidate Product Selection Section 226 Peripheral image display section 228 Designated position detection unit 230 Similar product search request generation unit 232 Similar product display section 234 Purchase Product Selection Section 236 Purchase Processing Unit 302 Receiving unit 304 Candidate Product Database 306 Candidate Product Search Department 308 Candidate product extraction section 310 Transmitter 312 Similar Product Search Department 314 Similar Products Database 316 Similar product extraction section 318 Purchase Processing Department 320 Reward Department 702 ECU 1000 Product Purchasing System

Claims

1. A product purchasing system in which a first communication terminal carried by an advertising user who functions as a personal advertising tower for a product, a second communication terminal provided so as to be movable together with a vehicle, and a server are communicatively connected via a network, The first communication terminal, Transmitting to the server first location information representing a location of the advertising user during the movement of the advertising user, first time information representing a time when the advertising user is at the location, and advertising product information representing a product worn by the advertising user; The server, receiving the first location information, the first time information, and the advertised product information from the first communication terminal; storing the first location information, the first time information, and the advertisement product information received from the first communication terminal in a database in association with each other; The second communication terminal, Detecting a specific action by a passenger of the vehicle, which indicates an intention to purchase a product worn by the advertising user who is present in the vicinity of the vehicle, while the vehicle is moving; recording specific action information, which associates second position information indicating a position of the vehicle when the specific action is detected with second time information indicating a time when the specific action is detected, for each specific action; When at least one specific action information is selected by the passenger from the one or more recorded specific action information, a product search request including the second location information and the second time information corresponding to the selected specific action information is transmitted to the server; The server, receiving the product search request from the second communication terminal; searching the advertised product information stored in the database based on the second location information and the second time information included in the product search request, and extracting candidate product information representing one or more candidate products corresponding to the second location information and the second time information from the advertised product information; Transmitting the extracted candidate product information to the second communication terminal; The second communication terminal, receiving the candidate product information from the server; displaying the candidate product information on a display unit; Product purchasing system.

2. The vehicle is provided with an exterior imaging device that captures an image of an external surrounding environment of the vehicle, The second communication terminal, The product purchasing system described in claim 1, wherein when the specific action is detected while the vehicle is moving, the specific action information is recorded in association with the vehicle surroundings image captured by the exterior imaging device, the second location information, and the second time information.

3. When the passenger selects a product he or she wishes to purchase from the candidate product information displayed on the display unit, The second communication terminal executes a purchase process for the product desired to be purchased, When an instruction is input indicating that the passenger's desired product is not included in the candidate product information displayed on the display unit, The second communication terminal, displaying, on the display unit, the vehicle surroundings image corresponding to the specific action information selected by the passenger; Transmitting to the server, designated position information indicating a display position of the desired product designated by the passenger in the displayed vehicle surroundings image, and a similar product search request including at least a part of the vehicle surroundings image; The server, searching the database based on at least a portion of the vehicle surroundings image and the specified position information included in the similar product search request received from the second communication terminal, extracting similar product information representing one or more similar products that are identical or similar to the desired product specified by the passenger, and transmitting the extracted similar product information to the second communication terminal; The second communication terminal, The product purchasing system according to claim 2 , wherein the similar product information received from the server is displayed on a display unit.

4. At least one of the vehicle and the second communication terminal is provided with a microphone that picks up sounds inside the vehicle; The product purchasing system according to any one of claims 1 to 3, wherein the second communication terminal detects, as the specific action, a specific statement by the passenger indicating a desire to purchase a product worn by the advertising user present in the vicinity of the vehicle, based on the voice data picked up by the microphone.

5. the vehicle is provided with an in-vehicle imaging device that images an interior of the vehicle; The product purchasing system according to any one of claims 1 to 4, wherein the second communication terminal detects, as the specific action, a specific movement or eye movement of the occupant indicating a desire to purchase a product worn by the advertising user present in the vicinity of the vehicle, based on image data of the occupant captured by the in-vehicle imaging device.

6. the vehicle is provided with at least one of a plurality of microphones that pick up sounds inside the vehicle and an in-vehicle imaging device that images the inside of the vehicle; the second communication terminal identifies a direction in which the occupant who performed the specific action is looking, based on at least one of the voice data collected by the microphone or the image data of the occupant captured by the in-vehicle image capturing device, and transmits the product search request to the server, the product search request including directional information indicating the identified direction, the second location information, and the second time information; 6. The product purchasing system according to claim 1, wherein the server extracts the candidate product information based on the first location information, the second location information, and the direction information.

7. A server communicatively connected via a network to a first communication terminal carried by an advertising user who functions as a personal advertising tower for a product and a second communication terminal movably provided together with a vehicle, one or more processors; one or more memories coupled to the processor; Equipped with The processor, receiving, from the first communication terminal, first location information representing a location of the advertising user during the movement of the advertising user, first time information representing a time when the advertising user is at the location, and advertising product information representing a product worn by the advertising user; storing the first location information, the first time information, and the advertisement product information received from the first communication terminal in a database in association with each other; receiving from the second communication terminal a product search request including second location information representing a location of the vehicle when a specific action by an occupant of the vehicle, which indicates an intention to purchase a product worn by the advertising user present in the vicinity of the vehicle, is detected while the vehicle is moving, and second time information representing a time when the specific action is detected; searching the advertised product information stored in the database based on the second location information and the second time information included in the product search request, and extracting candidate product information representing one or more candidate products corresponding to the second location information and the second time information from the advertised product information; Transmitting the extracted candidate product information to the second communication terminal; A server that performs processing, including

8. A second communication terminal is communicatively connected via a network to a server capable of communicating with a first communication terminal carried by an advertising user who functions as a personal advertising tower for a product, and is provided so as to be movable together with the vehicle, one or more processors; one or more memories coupled to the processor; Equipped with The processor, Detecting a specific action by a passenger of the vehicle, which indicates an intention to purchase a product worn by the advertising user who is present in the vicinity of the vehicle, while the vehicle is moving; recording specific action information, which associates second position information indicating a position of the vehicle when the specific action is detected with second time information indicating a time when the specific action is detected, for each specific action; When at least one specific action information is selected by the passenger from the one or more recorded specific action information, transmitting a product search request including the second location information and the second time information corresponding to the selected specific action information to the server; receiving, from the server, candidate product information representing one or more candidate products corresponding to the second location information and the second time information included in the product search request; Displaying the candidate product information on a display unit; A second communication terminal that executes a process including the steps of:

Images