Information providing device and information providing system for vehicle-related persons

Abstract

To provide a system and method for providing information for sales promotion, etc. mainly at vehicle energy supply facilities such as gas stations, without recognizing a vehicle number from images captured by an imaging unit.SOLUTION: An information providing device comprises: vehicle identification means for identifying a vehicle or vehicle occupant without recognizing a vehicle number in response to a trigger event occurring at a predetermined location including a specific energy supply facility; and information providing means for providing information related to an owner or an occupant of the vehicle on the basis of the identified vehicle or vehicle occupant.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an information providing device and an information providing system capable of providing information related to vehicle-related persons, such as vehicle occupants or vehicle owners, visiting an energy supply facility such as a gas station. [Background technology]

[0002] In the management of gas stations, it is important to carry out various sales activities when customers come to the store. Examples of sales activities include encouraging customers to have their cars inspected, recommending tire changes, recommending car washes, providing information on car replacements, and selling car-related goods.

[0003] For example, Patent Document 1 discloses a technical idea of ​​storing customer information in association with a vehicle number, storing action setting information that sets actions to be taken by users (facility employees) in association with the customer information, detecting and photographing an visiting vehicle, recognizing the vehicle license plate from the image using image processing to obtain the vehicle number, obtaining customer information corresponding to the vehicle number, obtaining and outputting the action setting information corresponding to the customer information, and controlling the user to input action result information that shows the result of the action, which is then stored in association with the vehicle number.

[0004] However, according to the technical concept of this patent document, it is essential to photograph the vehicle and recognize the vehicle number from the photograph, which necessitates the introduction of a relatively expensive vehicle number recognition mechanism, creating a high barrier to implementation. Thus, there is a demand for technology that can identify a vehicle or its occupants, including the driver, without recognizing the vehicle number.

[0005] Patent Document 2 also discloses the technical concept of a service provision system that includes an imaging unit, a computer, a service information database, and an output unit, in which the imaging unit images a target including at least a person to obtain image data, the computer processes the image data to calculate feature information reflecting the target's features, the service information database stores multiple pieces of service information, and the output unit obtains and outputs service information corresponding to the feature information from the service information database.

[0006] In a first embodiment, this patent document describes a device equipped with a camera and a display, which is installed at a gas station or the like, that photographs people such as drivers, their possessions, vehicles, etc., and a detection unit detects the objects individually from the image data, and a recognition unit recognizes their characteristics and recognizes them individually by comparing them with stored characteristic information.

[0007] However, the technical concept of this patent document requires that images captured by an imaging unit (camera) installed in the facility be used to recognize vehicle numbers and extract characteristics of occupants and vehicles, and does not take into consideration configurations that do not use such fixed imaging units or recognition and feature extraction functions. [Prior art documents] [Patent documents]

[0008] [Patent Document 1] Patent No. 5798222 [Patent Document 2] JP 2014-160394 A Summary of the Invention [Problem to be solved by the invention]

[0009] As described above, the technical ideas disclosed in Patent Documents 1 and 2 have the function of photographing a vehicle or vehicle occupants using an imaging unit installed in a facility, and recognizing vehicle numbers and extracting characteristics of the occupants and vehicle, but there is a problem in that using such equipment and functions can be difficult for economic or facility structural reasons.

[0010] In order to solve the above problems, the present invention has an objective of providing a system and method for providing information for sales promotion, etc., without recognizing the vehicle number from an image captured by an imaging unit, primarily at vehicle energy supply facilities such as gas stations (hereinafter also referred to as "SS"). [Means for solving the problem]

[0011] The information providing device for vehicle personnel according to the first aspect of the present invention comprises: - A vehicle identification means for identifying a vehicle or a vehicle occupant without recognizing a vehicle number when a kick event occurs at a specific location including a specific energy supply facility; - information providing means for providing information related to the owner of the vehicle or the occupant of the vehicle based on the identified vehicle or the occupant of the vehicle; The present invention is characterized by having the following.

[0012] Here, "energy supply facilities" include facilities where vehicles can be supplied with energy, including gas stations (SS), charging spots, hydrogen stations, etc.

[0013] A "vehicle number" is a symbol number displayed on a license plate, also known as a vehicle registration number or car number.

[0014] "Specified location" includes facilities, stores and their headquarters organizations where certain registrations are made.

[0015] "Vehicle-related persons" includes persons related to the vehicle, such as those riding in the vehicle (passengers including the driver) and the owner of the vehicle.

[0016] "Triggered by a kick event" includes detection of a vehicle entering an energy supply facility or the like, access to a biometric authentication device installed at a specific location in an energy supply facility or the like, and the like.

[0017] In this way, it is possible to identify the vehicle occupant, vehicle owner, or the vehicle itself without recognizing the vehicle number, and appropriate or useful information can be provided accordingly, thereby improving the satisfaction of the vehicle occupant and vehicle owner and greatly contributing to the business activities of the energy refueling facility.

[0018] Next, as a second aspect of the present invention, in the information providing device for vehicle personnel according to the first aspect, a vehicle occupant has a portable terminal having a function of reading a machine-readable code, and the vehicle identification means a. a linking means for identifying the linked vehicle number by reading the machine-readable code provided near the vehicle stop position, the mobile terminal being linked in advance to the vehicle number of the vehicle, and reading the machine-readable code with the mobile terminal; b. A vehicle number declaration receiving means for receiving a declaration of a vehicle number inputted via the mobile terminal; c. A vehicle number image receiving and recognizing means for receiving a vehicle number screen photographed by a camera function of the mobile terminal and recognizing the vehicle number; The present invention may be characterized by comprising one or more of the above.

[0019] Here, the term "portable terminal" includes, but is not limited to, a smartphone, a tablet, a (small) PC, etc., and may be any terminal that is portable.

[0020] The "vehicle stopping position" is preferably an energy refueling location such as a fuel tanker within an energy refueling facility, but may also be the entrance to an energy refueling facility, and also includes a certain position where the vehicle does not stop completely but moves slowly.

[0021] The "machine-readable code" is preferably a two-dimensional code including a barcode or a QR code (registered trademark), but may also be an RFID or a three-dimensional code.

[0022] The "linking means" has a database in which the terminal number of the occupant's portable terminal is linked in advance with the vehicle number, and a URL for accessing such a database is embedded in a machine-readable code.When the portable terminal reads the machine-readable code and accesses the URL, vehicle number information is sent from the database to the information providing means, and appropriate or useful information corresponding to that vehicle number can be displayed.

[0023] Here, in order to motivate holders of portable terminals to access the database, it is preferable that they register as members when they register with the database and are then given points each time they access the database. However, this is not limited to this, and any other incentive, such as being able to receive discounts or other services by accessing the database, will suffice.

[0024] In this embodiment, it is also possible to use an on-board camera for a drive recorder installed in a vehicle instead of the camera on the portable terminal, and a machine-readable code can be placed at the entrance to the energy refueling facility, and the on-board camera can read the code while entering (while the vehicle is moving or stopped), and access the database using the URL read using the communication function built into the on-board camera.

[0025] In addition, the vehicle number declaration receiving means may be provided for accepting declarations of vehicle numbers entered on portable terminals held by vehicle-related personnel, and information related to the entered vehicle numbers can be collected.

[0026] Also, the vehicle may have a vehicle number image receiving and recognizing means for receiving a vehicle number screen photographed by a camera function of a mobile terminal held by a person related to the vehicle and recognizing the vehicle number. In this case, even if each energy supply facility does not have a vehicle number recognition device, it is sufficient to have one vehicle number recognition device for multiple energy supply facilities located in remote locations, and overall cost reduction can be expected.

[0027] In this way, even if each energy supply facility does not have a vehicle number recognition function, vehicle number information can be obtained using a portable terminal held by a person involved with the vehicle, making it possible to provide appropriate information based on information related to the vehicle number.

[0028] Next, as a third aspect of the present invention, in the information providing device for vehicle related persons according to the first aspect, the information providing means is - displaying an image on a display device; -Printing output on media including paper; - transmission to a mobile terminal of an occupant of said vehicle; -Instructing a person or robot to respond to the vehicle or the vehicle occupant The present invention may be characterized in that it includes any one or more of the above.

[0029] Here, "displaying an image on a display device" is preferably so-called digital signage (also called "electronic billboard") that displays moving and still images on a display or projector, but is not limited to this and can take any form that can be visually confirmed by those involved with the vehicle, and can also be used in combination with the display unit installed in a refueling machine that displays refueling information.

[0030] Additionally, the term "person in charge of reception" primarily refers to staff at an energy supply facility, but may refer to any person who can provide service to vehicle personnel.

[0031] "Instructions to responders" include, but are not limited to, the following examples: a. Outputting instructions in the form of text, still images, video, audio, etc. to a tablet device held by the attendant. b. Outputting instructions in the form of text, still images, video, audio, etc. to the watch held by the attendant. c. Outputting instructions in the form of text, still images, videos, audio, etc. to glasses, earphones, etc. worn by the attendant.

[0032] Furthermore, the person who answers the phone may not be a person, but may be an artificial object (such as a robot) that can replace a human being. Such an artificial object may receive instructions to answer the phone and perform actions or talk to the user according to the instructions.

[0033] Next, as a fourth aspect of the present invention, in the information providing device for vehicle personnel relating to the first aspect, the means for identifying vehicle occupants among the vehicle etc. identification means may be biometric authentication.

[0034] Here, biometric authentication includes face authentication, fingerprint authentication, vein authentication, iris authentication as physical characteristics, voiceprint authentication and signature as behavioral characteristics, and information related to habits in walking, smartphone operation, and certain promised behavior as behavioral biometric authentication. An individual can be identified by using any one or more of such characteristic information.

[0035] In addition, with the user's consent, a body temperature measuring device installed to prevent infectious diseases may be used as the imaging unit for face authentication.

[0036] In this way, the vehicle occupant can be identified reliably, and appropriate and useful information can be provided accordingly.

[0037] Next, as a fifth aspect of the present invention, in the information providing device for vehicle related persons according to the second aspect, information related to the owner of the vehicle or the occupants of the vehicle is a. Information regarding the vehicle inspection date for said vehicle number; b. Promotional information for vehicle sales based on vehicle information relating to said vehicle number; c. Information on service recommendations, including car washes; The present invention may be characterized in that it includes any one or more of the above.

[0038] In this way, information related to the linked vehicle number can be provided, such as vehicle inspection dates, promotional information leading to a trade-in, and information about services such as car washes available at energy refueling facilities, which is extremely beneficial for vehicle owners.

[0039] Next, as a sixth aspect of the present invention, in the information providing device for vehicle-related persons relating to the fifth aspect, the information providing means may be characterized in that it provides information related to the owner of the vehicle or the occupants of the vehicle according to attributes of the vehicle or the vehicle-related persons.

[0040] Here, the "vehicle attributes" include the vehicle model, the vehicle year, and the like, and the "occupant attributes" include the occupant's gender, the occupant's age, and the like.

[0041] In this way, more appropriate information corresponding to the attributes of the vehicle or vehicle occupant can be provided, which is extremely beneficial for both the vehicle owner or occupant and the energy refueling facility.

[0042] In addition, if the vehicle is a rental car, a car-sharing vehicle, a business vehicle registered in a corporate name, etc., information corresponding to that may be provided.

[0043] Furthermore, there may be other means for identifying a vehicle or a vehicle occupant besides the means described above. For example, the use of a beacon is one example. A beacon transmitter is embedded near a fuel tanker at an energy supply facility, and when a vehicle carrying an occupant who has a smartphone that has been set up to receive radio waves from the beacon approaches, the occupant is asked to take action, and as a result, the occupant can be identified.

[0044] Next, as a seventh aspect of the present invention, the information provision device for vehicle-related persons relating to the first aspect may be characterized in that it enables appropriate energy refueling at the energy refueling facility based on the vehicle or vehicle occupant identified by the vehicle etc. identification means.

[0045] Here, "appropriate energy refueling at an energy refueling facility" is typically refueling at a gas station, but is not limited to this.

[0046] Here, the configuration of a gas station will be described as an example. A plurality of fuel tanks for diesel, regular gasoline, and high-octane gasoline are buried underground at the gas station, one end of a fuel pipe is inserted into the fuel tank, and an electromagnetic valve as an opening and closing valve is provided at the other aboveground end of the fuel pipe, and a fuel pump is connected to the output side of the electromagnetic valve. Note that the order of the opening and closing valve and the fuel pump may be reversed.

[0047] A fuel nozzle is hooked onto one side of the fuel tanker, and a fuel hose extending from a fuel pump or an opening and closing valve is connected to the handle of the fuel nozzle, and a nozzle switch is provided to detect whether the fuel nozzle has been removed from the fuel tanker.

[0048] "Appropriate energy supply" here means, in the case of refueling, making it possible to supply the type of fuel (high-octane gasoline, regular gasoline, diesel, etc.) specified for the specific vehicle model, and includes the following examples: - Any or all of the fuel pumps, valves, and nozzle switches installed at gas stations and fuel dispensers shall be operated (enabled) only for fuel type information obtained from information on a specified vehicle. When the type of fuel input by the user (vehicle occupant) into the operation panel or the like matches the fuel type information obtained from the identified vehicle information, the fuel pump, on-off valve, and / or nozzle switch will be operated (enabled) only for the specified type of fuel.

[0049] In this way, the vehicle can be identified without using vehicle number recognition, the type of fuel to be refueled can be selected, and appropriate fuel can be refueled, enabling safe operation at self-service gas stations or unmanned gas stations, the number of which is expected to increase in the future.

[0050] Next, as an eighth aspect of the present invention, in the information providing device for vehicle personnel according to the seventh aspect, proper energy refueling at the energy refueling facility may be carried out by a robot.

[0051] In other words, a robot (automated equipment) is made to perform all or part of a series of tasks related to refueling, such as opening the fuel filler cap of a vehicle, moving and inserting the fuel nozzle into the fuel filler cap, gripping (squeezing) the lever of the fuel filler nozzle to fill with fuel, removing the fuel filler nozzle after refueling is complete and returning it to the fuel pump, and closing the fuel filler cap.

[0052] This will further reduce the need for human intervention, making it possible to realize unmanned gas stations that can accommodate unmanned vehicles, etc.

[0053] Next, as a ninth aspect of the present invention, there is provided an information providing system, -An information providing device according to any one of the first to eighth aspects; a distribution server connected to a communication interface unit of the information providing device and providing information to the information providing device; The present invention may be characterized in that:

[0054] It is preferable to provide one distribution server for a plurality of information providing devices, but a plurality of distribution servers may be linked together.

[0055] In this way, by providing a distribution server, it is possible to efficiently provide a wide variety of information to a large number of information providing devices, and it is also possible to earn revenue by distributing information, making it possible to widely utilize the system.

[0056] Next, as a tenth aspect of the present invention, in the information display system of the ninth aspect, the distribution server - a distribution server communication interface unit that enables transmission and reception of information with the outside; a distribution server storage unit capable of storing information to be distributed; a distribution server control unit that controls information acquired from the outside via the distribution server communication interface unit to be stored in the distribution server storage unit as is, selected, or edited, and to be distributed via the distribution server communication interface unit upon request; The present invention may be characterized in that:

[0057] With this configuration, it becomes possible to externally acquire and store the information to be displayed, and in particular, the distribution server control unit can distribute the acquired information to the information providing device as is, or by processing the information by selecting, editing, etc. Effect of the Invention

[0058] According to the present invention, it is possible to provide an apparatus and system that provide sales promotion information without recognizing the vehicle number from an image captured by an imaging unit, mainly at a vehicle energy supply facility such as a gas station. [Brief description of the drawings]

[0059] [Figure 1] 1 is a configuration diagram of an information providing device according to an embodiment of the present invention; [Diagram 2] 1 is a perspective view showing a display unit of an information providing device according to an embodiment of the present invention; [Diagram 3] 1 is a configuration diagram of an information providing system according to an embodiment of the present invention. [Figure 4] 4 is a flowchart illustrating an operation of an information providing device according to an embodiment of the present invention. [Diagram 5] 4 is a flowchart illustrating an operation of an information providing device according to an embodiment of the present invention. [Figure 6] 2 is a flowchart showing the operation of the information providing system according to one embodiment of the present invention. [Figure 7] 1 is a diagram showing an example of information displayed on an information providing device according to an embodiment of the present invention; [Figure 8] 1 is a diagram showing an example of information displayed on an information providing device according to an embodiment of the present invention; [Figure 9] 1 is a diagram showing an example of information displayed on an information providing device according to an embodiment of the present invention; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0060] Hereinafter, an information providing device for vehicle personnel according to one embodiment of the present invention will be described with reference to the drawings. Note that the following will show a schematic view of the scope necessary for the explanation of achieving the object of the present invention, and will mainly explain the scope necessary for the explanation of the relevant parts of the present invention, and the parts that are omitted will be based on known technology.

[0061] <Configuration of the information providing device> FIG. 1 is a configuration diagram of an information providing device according to an embodiment of the present invention, and FIG. 2 is a perspective view showing a display unit of the information providing device according to an embodiment of the present invention.

[0062] First, the configuration of the information providing device will be described. The information providing device 1 installed at a certain facility (for example, a specific gas station SS) has an information providing device storage unit 30 that stores information about vehicle numbers and information about customers who use this facility, an information providing device display unit 40 that provides various appropriate and useful information to customers, a communication interface unit 50 that interfaces with the outside for communication, and an information providing device control unit 60 that connects the above units and controls the entire device.

[0063] Here, the information providing device control unit 60 is provided in one unit in a facility (e.g., a gas station SS), and as hardware, it is preferable that the information providing device control unit 60 is configured by a personal computer or server with a built-in CPU, and may also include input units, output units, display units, etc., which are not shown.

[0064] Although one information providing device control unit 60 is provided in the facility, a local control unit may be provided in each information providing device display unit 40 to distribute the functions.

[0065] The information providing device storage unit 30 may be included as a part of the information providing device control unit 60, but when storing a large amount of data, it is preferable to provide dedicated hardware.

[0066] The information providing device memory unit 30 stores information about customers, such as sales information for gasoline and other items collected from the facility's POS system, fuel cards, point cards, credit cards, etc., and additional information entered by employees, but is not limited to this.A wide range of information is stored so that it can be retrieved when the customer visits again.

[0067] The information entered by the employee includes information related to when the vehicle visits the store for the first time or when a vehicle inspection is performed at the store. By having the employee enter this information into the information providing device control unit 60 from an input unit (not shown), the information providing device control unit 60 can compile and provide appropriate information the next time the employee visits the store.

[0068] Furthermore, if the information providing device 1 is connected to an external server as described below, information entered by employees is transmitted to the server side, and customer information and vehicle number information stored in the control unit on the server side are used to edit the information to be provided, for example, to create information such as "Thank you for using our vehicle inspection service" for a customer who has recently had their vehicle inspected, and this information is then transmitted to the information providing device 1 and provided by the information providing device 1.

[0069] In this way, when a control unit such as an external server is used, the control unit may be regarded as a part of the information providing device control unit 60 of the information providing device 1 .

[0070] As shown in FIG. 2, when the facility is a gas station, the information providing device display unit 40 is preferably installed above each refueling machine RD, and as hardware, an LCD (liquid crystal) display is preferable, and its width (on the front side of the refueling machine) is preferably slightly smaller than the width of the front of the refueling machine, but the dimensions are not limited.

[0071] If it is possible to embed it inside the refueling aircraft RD, it may be so configured, or it may be made to share the display unit used for the refueling operation.

[0072] Furthermore, a peripheral photographing unit 41 is provided inside or near the information display unit 40 and is connected to the information providing device control unit 60. The peripheral photographing unit 41 may be an external digital camera, but if a small lens is embedded inside the information display unit 40 as shown in Figure 2, it becomes possible to photograph the surroundings unobtrusively.

[0073] Furthermore, a gaze detection unit 80 may be provided to detect the gaze direction of a person from the face image of the person photographed by the peripheral photographing unit 41.

[0074] Gaze detection (or gaze estimation) is a method of detecting (estimating) eye movement to determine where the user is looking. The eye movement is detected based on the position of the moving point relative to the reference point after finding the "stationary part (reference point)" and "moving part (moving point)" of the eye. In this case, a combination of infrared light and camera is often used.

[0075] Alternatively, technology has been developed that detects or estimates the direction of gaze from images taken with a normal camera by using facial feature point detection technology, which is the core of face recognition technology.

[0076] Such gaze detection techniques that have already been developed or will be developed in the future will be incorporated into the information providing device 1 as software.

[0077] Furthermore, it is desirable that the gaze detection unit 80 has a displayed information interest level grasping unit (displayed information interest level grasping function) that grasps the degree of interest in the displayed information based on the detection results, such as which part of the displayed information the gaze is focused on and the length of time the gaze is focused on.

[0078] Also, a speaker 42 may be provided in or near the information providing device display unit 30 and connected to the information providing device control unit 60. This makes it possible to provide audio information corresponding to the displayed information.

[0079] Furthermore, a microphone 43 may be provided in or near the information providing device display unit 30 and connected to the information providing device control unit 60. This allows for voice responses to the displayed information and conversations with employees, etc. The speaker 42 and microphone 43 may be shared.

[0080] Furthermore, the input means 44 may be provided on or near the surface of the display unit of the information providing device. As the input means, a touch panel placed on the surface of the display unit 50 of the information providing device or the display unit of the fuel tanker is preferable, but the input means is not limited thereto and any means capable of inputting information, such as a switch button, a keyboard, a mouse, etc., may be used.

[0081] When providing the speaker 42, microphone 43, and input means 44, products available on the market may be selected in consideration of performance, dimensions, price, and the like according to the purpose.

[0082] It may also be connected to a mobile terminal 91 of an employee, such as a smartphone carried by the employee. This terminal can display the same content as that provided to the information providing device display unit 40, and can also add other information exclusive to the employee.

[0083] Furthermore, a machine-readable code (MRC) 45 is attached to the surface of the housing of each tanker RD. Here, the machine-readable code 45 is exemplified as a QR code (registered trademark), but may be another code.

[0084] This machine-readable code 45 is designed to be read by a portable terminal, such as a smartphone, held by a vehicle occupant or owner (collectively referred to as vehicle-related persons), which is not included in the information providing device 1.

[0085] <Information provision system configuration> Next, the configuration of the information providing system 100, particularly the distribution server 110 therein, will be described.

[0086] FIG. 3 is a configuration diagram of an information providing system according to an embodiment of the present invention.

[0087] The information providing system 100 includes an information providing device 1, which is installed in one or more sets in a single facility or in multiple facilities, and a distribution server 110 that is connected to the communication interface unit 50 of the information providing device 1 and provides information to the information providing device 1.

[0088] It is preferable to provide one distribution server 110 for a plurality of information providing devices 1, but it may also be provided so that a plurality of distribution servers 101 cooperate with each other.

[0089] The distribution server 110 has a distribution server communication interface unit 111 that enables sending and receiving information with the outside, a distribution server memory unit 112 that can store information to be distributed, a distribution server input unit 113 that executes input to the distribution server, a distribution server output unit 114 that executes output from the distribution server 110, a distribution server display unit 115 that displays information on the distribution server 110, and a distribution server control unit 116 that connects the above units and controls the entire distribution server 110.

[0090] These hardware configurations can be made using general server computer equipment, but dedicated equipment can also be used for parts that require particularly high performance. Furthermore, these devices can be installed in one location, or they can be distributed as part of cloud computing.

[0091] The distribution server communication interface unit 111 is connected to the communication interface unit 50 of the information providing device 1 of each facility, and transmits and receives information.

[0092] Furthermore, outside the distribution server 110, there are various databases connected to the distribution server communication interface unit 111.

[0093] Representative examples include the automobile registration number database DB1 held by the Automobile Inspection and Registration Information Association, the light motor vehicle registration number database DB2 held by the Light Motor Vehicle Inspection Association, and the vehicle catalog database DB3 which consolidates the vehicle catalogs of various companies. There are also other databases of information related to vehicles, and it is possible to connect to these as well.

[0094] In particular, from the automobile registration number database DB1 and the light vehicle registration number database DB2, information such as the vehicle name, model, registration date, engine displacement, and vehicle inspection certificate issue date can be obtained by the automobile registration number.

[0095] In addition, the vehicle catalog database DB3 provides information about registered vehicles, such as grade, specifications, tire size, and compatible model numbers of replacement parts and components.

[0096] The information obtained from these databases is stored in the distribution server memory unit 112, and can also be transferred via the distribution server communication interface unit 111 to the information providing device memory unit 30 of the information providing device 1 of the facility that requires the information, for storage therein.

[0097] In addition, it is preferable that the distribution server memory unit 112 is divided into an information area 112a for each customer, an area information area 112b, and an area 112c for loan to information providers as areas for storing information to be distributed, and the corresponding information is stored in each area.

[0098] The area may be divided not only into areas of a physical storage device, but also into areas with identification codes, headers, etc., attached thereto for classification.

[0099] In addition, a provided information analysis unit 120 is provided in the distribution server 110. The purpose of this is to manage and analyze a large amount of data, so-called big data, collected from multiple information providing devices 1 and various databases in order to provide the data to the information providing device 1.

[0100] This provided information analysis unit 120 is software that combines conventional statistical analysis technology and recent AI technology, and is preferably incorporated into the distribution server control unit 116, but may also be provided separately outside the distribution server 110.

[0101] Although the provided information analysis unit 120 is provided in the distribution server 110, it may be provided in each information providing device 1 in a distributed manner if it is small in scale.

[0102] Furthermore, with regard to the information providing device memory unit 30, which has been described above as being provided in each information providing device 1, all or part of its functions and control may be provided on or belong to the distribution server 110 side, and each information providing device 1 may use those functions via a communication interface.

[0103] In this way, the configuration of each information providing device 1 can be simplified, and operation can be performed at low cost.

[0104] It is desirable that this information be stored in association with information regarding the vehicle number. The association can be done automatically by linking the POS information at the time of the visit with the vehicle information, or by having an employee input the information.

[0105] It is also possible to obtain information related to the vehicle number from an external database, as described later, and it is preferable to store this information in the information providing device storage unit 30 as well.

[0106] Note that the machine readable code (MRC) 45 provided on the surface of the housing of each fuel tanker RD may be read by a portable terminal 90 such as a smartphone held by a vehicle occupant or owner (collectively referred to as a vehicle-related person) that is not included in the information provision system 100. As described later, this makes it possible to link the vehicle-related person with the vehicle number.

[0107] <Operation of information provision devices and systems> Next, there will be described an operation of the information providing device 1. Fig. 4 is a flowchart for explaining the operation of the information providing device according to one embodiment of the present invention.

[0108] The facility is assumed to be a gas station SS, with multiple refueling machines RD installed. A customer arrives at the SS in a vehicle and stops at one of the refueling machines RD (step S11).

[0109] Then, a vehicle occupant (eg, the driver, the owner of the vehicle) gets out of the vehicle to refuel.

[0110] Then, a QR code attached by affixing or painting on the surface of the housing of the fuel tanker RD is read by a portable terminal carried by a person related to the vehicle (S12).

[0111] It is assumed that this QR code is stored, for example, in the distribution server memory unit 112 as a database in which the terminal number (such as a smartphone phone number) of the mobile terminal 90 of the vehicle-related person is pre-linked to the vehicle number of the vehicle owned or driven by the vehicle-related person after the person has registered as a member of the SS (such as registering as a friend via SNS).

[0112] Here, the distribution server 110 receives the terminal number of the mobile terminal of the vehicle-related person by connecting to the URL of the distribution server 110 included in the QR code (S13).

[0113] Next, the vehicle number linked to the terminal number is searched for and extracted (S14).

[0114] The series of steps up to this point constitutes a kick event in the vicinity of the tanker RD, which realizes a vehicle identification means for identifying a vehicle or vehicle occupant without recognizing the vehicle number.

[0115] In particular, in this embodiment, a person related to the vehicle has a portable terminal 90 with the function of reading QR codes, and the vehicle etc. identification means has a linking means in which the portable terminal 90 and the vehicle number are linked in advance, and the linked vehicle number is identified by reading the QR code using the portable terminal 90, and this forms the vehicle etc. identification means.

[0116] In addition to the above, the vehicle identification means may include a vehicle number declaration receiving means for accepting the declaration of the vehicle number entered by a person related to the vehicle on the mobile terminal 90, or a vehicle number image receiving / recognizing means for receiving a vehicle number screen captured by the camera function of the mobile terminal 90 and recognizing the vehicle number.

[0117] In either case, there is no advanced means for capturing an image of the vehicle number and automatically recognizing it.

[0118] Next, the distribution server 110 edits the information related to the vehicle number, and transmits the edited information to the information providing device 1 in the vicinity of the refueling machine RD where the vehicle is parked (S15).

[0119] The information providing device 1 displays the transmitted information on the information providing device display unit 40. In addition to the transmitted information, information held within the information providing device 1 may also be displayed (S16).

[0120] The information displayed here may be, as mentioned above, information related to the vehicle number, such as a notice that the vehicle inspection is approaching, a recommendation to replace the vehicle (including recommended models), a recommendation for an oil change, tire change, or car wash, and a promotion on car accessories. However, without being limited to these, a variety of information may be displayed, such as local event information, weather information, or advertising information provided by external sponsors, which is stored in the information providing device 1 or distributed from outside.

[0121] It is preferable that the appropriate or useful information to be provided be differentiated according to the attributes of the vehicle owner or those involved with the vehicle, i.e., vehicle attributes such as the vehicle model and year of manufacture, and occupant attributes such as the occupant's gender and age.

[0122] In addition, methods of providing information may include displaying an image on a display device, printing out the information on a medium including paper, transmitting the information to a portable terminal of a person related to the vehicle, or issuing instructions to a person or robot handling the vehicle or person related to the vehicle.

[0123] It should be noted that the database linking the terminal numbers (such as smartphone phone numbers) of the mobile terminals of the vehicle-related persons with the vehicle numbers of the vehicles owned or driven by the vehicle-related persons is stored in the distribution server, but it may also be arranged so that only the information for that SS is stored in the information providing device memory unit 30 of the information providing device 1 of each SS in a distributed manner.

[0124] In that case, the portable terminal may be connected to the communication interface unit 50 of each information providing device 1. In this way, when it is desired to provide information independently on a SS basis, it becomes possible to provide the information quickly.

[0125] Next, a description will be given of an additional operation of the information providing device 1. Fig. 5 is a flowchart illustrating the operation of the information providing device according to an embodiment of the present invention.

[0126] The surroundings photographing unit 41 built into the information providing device 1 (preferably the information providing device display unit 40) photographs the surroundings of the fuel tanker RD. In the case of self-service fueling, an image of the entire body and face of the vehicle occupant (driver, etc.) performing the fueling operation is photographed (step S21).

[0127] In particular, the face recognition unit 70 detects a face image from among the captured images (S22).

[0128] Next, the face authentication unit 70 searches the information providing device storage unit 30 for the detected face image (S23).

[0129] If the face image is stored in the information providing device storage unit 30, the information providing device control unit 60 identifies the individual from the retrieved face image, and since the customer has visited the store before, related information is stored, and the information is extracted from the information providing device storage unit 30 (S24).

[0130] On the other hand, if the face image is not stored in the information providing device storage unit 30, the information providing device control unit 60 queries the external device for the detected face image via the communication interface unit 50, identifies the individual, and acquires related information (S26).

[0131] Next, the information providing device control unit 60 displays the extracted or acquired information related to the specific individual on the information providing device display unit 40 (S27).

[0132] As described above, there are various methods for providing information other than displaying it.

[0133] In this way, information related to an individual identified by facial recognition can be displayed without the need for vehicle number recognition, enabling more effective sales and the provision of information that is useful to customers.

[0134] As a personal authentication method, various biometric authentication techniques may be used in addition to face authentication.

[0135] Furthermore, a gaze detection unit 80 may be provided to detect the gaze direction of a person from the face image of the person photographed by the peripheral photographing unit 41.

[0136] Gaze detection (or gaze estimation) is a method of detecting (estimating) eye movement to determine where the user is looking. The eye movement is detected based on the position of the moving point relative to the reference point after finding the "stationary part (reference point)" and "moving part (moving point)" of the eye. In this case, a combination of infrared light and camera is often used.

[0137] Alternatively, technology has been developed that detects or estimates the direction of gaze from images taken with a normal camera by using facial feature point detection technology, which is the core of face recognition technology.

[0138] Such gaze detection techniques that have already been developed or will be developed in the future will be incorporated into the information providing device 1 as software.

[0139] Furthermore, it is desirable that the gaze detection unit 80 has a provided information interest level grasping unit (provided information interest level grasping function) that grasps the degree of interest in the provided information based on the detection results, such as which part of the provided information the gaze is focused on and the length of time the gaze is focused on.

[0140] The information providing device control unit 60 can grasp the usefulness of the displayed information by tallying up what information the person was interested in along with the person's attributes (gender, age, etc.) from the results.

[0141] At this time, if the information is provided by an external information source, data regarding the usefulness of the information can be fed back to the information source, and a fee can be charged.

[0142] <Operation of the information display system> Next, a description will be given of the operation of the information providing system 100 including the information providing device 1 and the distribution server 110. Fig. 6 is a flowchart illustrating the operation of the information providing system according to one embodiment of the present invention.

[0143] First, the distribution server 110 receives a notification of the terminal number from the mobile terminal of the vehicle-related person who read the QR code of the information providing device 1 (step S51).

[0144] The distribution server control unit 116 extracts information about the vehicle number linked to the terminal number of the mobile terminal from the distribution server storage unit 112 (S52).

[0145] Furthermore, the distribution server control unit 116 queries an external database to acquire information related to the vehicle number (S53).

[0146] As the database, the automobile registration number database DB1 or the light vehicle registration number database DB2 is suitable, and these are searched to collect the required information.

[0147] The information that can be collected includes the vehicle name, model, registration date, engine displacement, and vehicle inspection certificate issue date, using the vehicle number as a key.

[0148] Furthermore, if the vehicle name, model, etc. are known, various information relating to the vehicle can be collected from a wide range of vehicle catalog information database DB3.

[0149] The distribution server control unit 116 distributes the information thus obtained in relation to the vehicle number to the information providing device 1 as is, or after selecting and editing it (S54).

[0150] The distribution server control unit 116 stores the acquired information related to the vehicle number in the information area 112a for each customer in the distribution server storage unit 112, and this information will be useful for future inquiries.

[0151] In addition, local information collected or created by the information providing device 1 or the distribution server input unit 113, for example, information on local events such as festivals, information from public institutions and stores located in the area, and road and railroad traffic information, is stored in the local information area 112b of the distribution server memory unit 112 and made available for distribution.

[0152] Furthermore, information provided by external information providers, such as gasoline wholesalers, car dealerships, car accessory stores, general retail stores, and restaurants, based on a distribution contract (distribution date and time, distribution time, number of distributions, fee, etc.) is stored in the area 112c of the distribution server memory unit 112 loaned to the information providers, and is made available for distribution.

[0153] For this regional information and information from information providers, the time period (morning, evening, etc.), day of the week (Sundays only, etc.), and period (October 1st to October 15th, etc.) for which information is displayed may be limited to provide efficient information and to charge the information providers based on the results.

[0154] The information to be displayed as described above may be text information, a still image, or a video. The information may be stored in a different area from that described above.

[0155] Figures 7 to 9 are diagrams showing examples of information displayed on an information providing device of one embodiment of the present invention. Figure 7 shows information for each customer that is distributed from distribution server 110 or stored in information providing device 1, and is used as is or edited to notify the customer of the timing of their vehicle inspection and encourage them to make a reservation.

[0156] FIG. 8 shows a display of recent plans for events in the neighborhood, which is delivered as local information from the delivery server 110 or information stored in the information providing device 1, either as is or after editing.

[0157] 9 shows information from an information provider, which is stored in the area 112c lent to the information provider in the distribution server storage unit 112 of the distribution server 110 and is distributed as is in principle. Note that editing may be added.

[0158] Although the above information has been described as being displayed on separate screens for each piece of information belonging to each area, the same screen may be divided and displayed, or multiple pieces of information for the same area may be displayed on the same screen.

[0159] In addition to the image, voice or music may be played from speaker 42 as part of the information, answers to questions or queries about the information may be provided from microphone 43, and responses required by customers or employees may be input from input means 44.

[0160] Also, the same information as that displayed on the information providing device display unit 40, or information arranged based on that information, may be transferred to and displayed on the portable terminal 90 of the vehicle-related person. Furthermore, the same information may be displayed on the portable terminal 91 of the employee, and may be used for sales promotion and advertising.

[0161] Next, we will explain how this system can be used for refueling. Based on the vehicle or vehicle occupant identified by a vehicle identification means such as QR code reading, declaration by a mobile device, a vehicle number image taken by a mobile device, or biometric authentication of the vehicle occupant, the appropriate refueling can be performed at the gas station SS.

[0162] Although not shown in the figure, multiple fuel tanks for diesel, regular gasoline, and premium gasoline are buried underground at a gas station SS, one end of a fuel pipe is inserted into the fuel tank, and a solenoid valve is provided at the other aboveground end of the fuel pipe as an opening and closing valve, and a fuel pump is connected to the output side of the solenoid valve. Note that the order of the solenoid valve, fuel pump, and opening and closing valve may be reversed.

[0163] A fuel nozzle is hooked onto one side of the fuel tanker, and a fuel hose extending from a fuel pump or an opening and closing valve is connected to the handle of the fuel nozzle, and a nozzle switch is provided to detect whether the fuel nozzle has been removed from the fuel tanker.

[0164] Here, it is possible to refuel with the type of fuel (high octane gasoline, regular gasoline, diesel, etc.) specified by the type of vehicle identified. Examples include the following: - Any or all of the fuel pumps, valves, and nozzle switches installed at gas stations and fuel dispensers shall be operated (enabled) only for fuel type information obtained from information on a specified vehicle. When the type of fuel input by the user (vehicle occupant) into the operation panel or the like matches the fuel type information obtained from the identified vehicle information, the fuel pump, on-off valve, and / or nozzle switch will be operated (enabled) only for the specified type of fuel.

[0165] In addition, when the means for identifying the vehicle occupant among the means for identifying the vehicle, etc., is biometric authentication, the vehicle number linked to the vehicle occupant and the fuel type information obtained from the vehicle number may not always be correct. For example, this may be the case when the same vehicle occupant owns two or more vehicles, when the vehicle has been replaced, when the vehicle is a rental car or borrowed from another person, etc.

[0166] In this case, a step can be added in which the fuel type information obtained from the linked vehicle number is displayed and then the vehicle occupant is asked to confirm it.

[0167] In addition, all or part of the series of tasks related to refueling, i.e., opening the vehicle's fuel filler opening, moving and inserting the fuel filler nozzle into the fuel filler opening, gripping the lever for refueling, removing and returning the fuel filler nozzle after refueling is complete, and closing the fuel filler opening, may be performed by a robot (automated equipment).

[0168] It is desirable for the robot to have six-axis control, a camera, and the ability to sense the position of the fuel filler cap, etc.

[0169] As an additional operation of the distribution server 110, a large amount of data collected by the distribution server 110 may be analyzed by the display information analysis unit 120.

[0170] Here, the provided information analysis unit 120 integrates and manages large amounts of data, so-called big data, from individual information providing devices and information providing systems, and utilizes conventional statistical analysis techniques and AI techniques to grasp the tendencies of the facility's customers.

[0171] For example, it may be possible to calculate the relationship between the type of car owned by a customer and the items that customers of that type of car like to purchase, or the effect of advertising from a sponsor (such as determining the contribution to an increase in sales volume based on the location and time of the customer's gaze on the information display unit, the customer's age group and sex, and the area where the advertising was carried out, etc.).

[0172] The results of these analyses can be provided (charged) to facility operators, wholesalers, car dealerships, car accessory stores, and the like, for a fee depending on the usefulness of the information, thereby generating revenue.

[0173] In the explanation so far, the information providing device has been limited to that described in the first aspect, but the information providing device may be unrestricted and a distribution server having technical characteristics may be one of the aspects of the present invention.

[0174] That is, distribution server 110 has a distribution server communication interface unit 111 that enables sending and receiving information with the outside, a distribution server memory unit 112 that can store information to be distributed, a distribution server input unit 113 that executes input to the distribution server, a distribution server output unit 114 that executes output from distribution server 110, a distribution server display unit 115 that displays information on distribution server 110, and a distribution server control unit 116 that connects the above units and controls the entire distribution server 110.

[0175] Here, the distribution server 110 stores the information acquired from outside via the distribution server communication interface unit 111 in the distribution server storage unit 112 either as is, or after selection, or as edited distribution information, and the distribution server control unit 116 controls the information to be distributed via the distribution server communication interface unit 111 to a device capable of displaying the information upon request.

[0176] Here, the device capable of providing information is not limited to that described in the first embodiment, but may be an existing device that is necessary for refueling and is provided in an existing refueling machine, and the display unit of the existing device may be shared, or it may be any device that is provided for other purposes and is capable of displaying information. [Industrial Applicability]

[0177] The present invention has great industrial applicability because it is extremely important for energy refueling businesses to provide information such as sales promotions at vehicle energy refueling facilities such as gas stations, and the present invention can provide promotional information without recognizing the vehicle number from an image captured by an imaging unit. [Explanation of symbols]

[0178] 1 Information provision device 30 Information providing device storage unit 40 Information providing device display section 45 Machine Readable Code (MRC) 50 Communication interface section 60 Information providing device control section 100 Information provision system 110 Distribution Server 111 Distribution server communication interface unit 112 Distribution server memory unit 113 Distribution server input section 114 Distribution Server Output Section 115 Distribution Server Display Section 116 Distribution server control section RD Refueling Machine

Claims

1. A vehicle identification means for identifying a vehicle or a vehicle occupant without recognizing the vehicle number when a kick event occurs at a predetermined location including a specific energy supply facility; - information providing means for providing information related to the owner of the vehicle or the occupant of the vehicle based on the identified vehicle or the occupant of the vehicle; An information providing device for vehicle personnel having the device.

2. The vehicle occupant has a portable terminal having a function of reading a machine-readable code, and the vehicle identification means a. A linking means for identifying the linked vehicle number by reading the machine-readable code provided near the vehicle stop position, the portable terminal and the vehicle number of the vehicle being linked in advance, and reading the machine-readable code with the portable terminal; b. A vehicle number declaration receiving means for receiving a declaration of a vehicle number inputted by the portable terminal; c) A vehicle number image receiving and recognizing means for receiving a vehicle number screen photographed by a camera function of the mobile terminal and recognizing the vehicle number; 2. The information providing device for vehicle personnel according to claim 1, further comprising at least one of the following:

3. The information providing means, - displaying an image on a display device; - Printing output on media including paper, - transmission to a mobile terminal of an occupant of said vehicle, - Giving instructions to a person or robot that responds to the vehicle or the vehicle occupant 2. The information providing device for vehicle personnel according to claim 1, further comprising at least one of the following:

4. 2. The information providing device for vehicle personnel according to claim 1, wherein the means for identifying a vehicle occupant among the means for identifying the vehicle, etc. is biometric authentication.

5. The information relating to the owner of the vehicle or the occupants of the vehicle is: a. Information regarding the vehicle inspection date for said vehicle number; b. Promotional information for vehicle sales based on vehicle information relating to said vehicle number; c. Information about suggested services, including car washes; 3. The information providing device for vehicle personnel according to claim 2, further comprising at least one of the following:

6. 6. The information providing device for vehicle personnel according to claim 5, wherein the information providing means provides information relating to the owner of the vehicle or the occupants of the vehicle in accordance with attributes of the vehicle or the vehicle personnel.

7. 2. The information providing device for vehicle personnel according to claim 1, further comprising means for enabling appropriate energy refueling at the energy refueling facility based on the vehicle or vehicle occupant identified by the vehicle identification means.

8. 8. The information providing device for vehicle personnel according to claim 7, wherein appropriate energy refueling at the energy refueling facility is carried out by a robot.

9. - an information providing device according to any one of claims 1 to 8; a distribution server connected to a communication interface unit of the information providing device and providing information to the information providing device; An information provision system for vehicle personnel.

10. The distribution server includes: - a distribution server communication interface unit that enables transmission and reception of information with the outside; a distribution server storage unit capable of storing the information to be distributed; a distribution server control unit that controls information acquired from the outside via the distribution server communication interface unit to be stored in the distribution server storage unit as is, selected, or edited, and to be distributed via the distribution server communication interface unit upon request; 10. The information providing system for vehicle personnel according to claim 9, further comprising:

Images