Methods, non-transitory computer-readable media, and information processing apparatuses

Abstract

A method executed by an information processing apparatus (20) includes displaying an image of an engine compartment of a vehicle (10) upon detecting occurrence of a predetermined trigger related to the vehicle (10), determining a consumable to be replenished for the vehicle (10), and displaying assistance information including a position of a replenishing port in the engine compartment corresponding to the determined consumable.

Description

Cross-references to related applications

[0001] This application claims priority to Japanese Patent Application No. 2023-223334, filed on December 28, 2023, the entire disclosure of which is incorporated herein by reference. Technical Field

[0002] This disclosure relates to a method, a non-transitory computer-readable medium, and an information processing apparatus. Background Technology

[0003] Traditionally, in vehicles such as automobiles, consumables such as windshield washer fluid are replenished through a filler port located in the engine compartment. For example, Patent Document 1 discloses an information notification system that displays the amount of windshield washer fluid used and when it needs to be replaced.

[0004] Prior art literature Patent documents Patent Document 1: Japanese Patent Application Publication No. 2016-002929 Summary of the Invention The problem that the invention aims to solve Generally, the engine compartment of a vehicle has dedicated fill ports for not only windshield washer fluid, but also for other consumables such as brake fluid or battery fluid. Therefore, if a user unfamiliar with vehicle maintenance tops up consumables through the wrong fill port, there is a possibility of vehicle malfunction.

[0005] The purpose of this disclosure, which was made in view of the above, is to reduce the possibility of vehicle malfunction when replenishing consumables for the vehicle.

[0006] Methods for solving problems One embodiment of this disclosure relates to a method executed by an information processing apparatus, wherein... The method includes: When a predetermined trigger related to the vehicle is detected, an image of the vehicle's engine compartment is displayed; The consumables to be replenished for the vehicle are determined; and The auxiliary information is displayed, which includes the location of the replenishment port in the engine compartment corresponding to the determined consumable.

[0007] One embodiment of this disclosure involves a non-transitory computer-readable medium storing a program that causes a computer to perform the following actions, wherein... The actions include: When a predetermined trigger related to the vehicle is detected, an image of the vehicle's engine compartment is displayed; The consumables to be replenished for the vehicle are determined; and The auxiliary information is displayed, which includes the location of the replenishment port in the engine compartment corresponding to the determined consumable.

[0008] One embodiment of this disclosure relates to an information processing apparatus equipped with a control unit, wherein... The control unit implements the following control: When a predetermined trigger related to the vehicle is detected, an image of the vehicle's engine compartment is displayed on the monitor. The consumables required to replenish the vehicle are determined, and, The auxiliary information is displayed on the display, including the location of the replenishment port in the engine compartment corresponding to the determined consumable.

[0009] Invention Effects According to one embodiment of this disclosure, the possibility of vehicle malfunction is reduced when replenishing consumables for the vehicle. Attached Figure Description

[0010] Figure 1 This is a block diagram illustrating the general structure of a system according to one embodiment of the present disclosure.

[0011] Figure 2 A block diagram representing the general structure of a vehicle.

[0012] Figure 3 A block diagram illustrating the general structure of an information processing device.

[0013] Figure 4 A block diagram illustrating the general structure of the server.

[0014] Figure 5 A flowchart illustrating the operation of an information processing device. Detailed Implementation

[0015] The embodiments of this disclosure will now be described.

[0016] (Summary of the implementation method) Reference Figure 1 The outline of System 1, which relates to the embodiments of this disclosure, will be described below. System 1 includes a vehicle 10, an information processing device 20, and a server 30. The server 30 is able to communicate with each of the vehicle 10 and the information processing device 20, for example, via a network 40 such as the Internet.

[0017] Vehicle 10 is, for example, a gasoline-powered vehicle, but is not limited to this; it can also be any vehicle that people can ride in, such as a battery electric vehicle (BEV), a hybrid electric vehicle (HEV), a plug-in hybrid electric vehicle (PHEV), or a fuel cell electric vehicle (FCEV). In this embodiment, a dedicated replenishment port corresponding to each of several consumables, such as brake fluid or battery fluid, is provided in the engine compartment of vehicle 10.

[0018] The information processing device 20 is, for example, a computer such as a mobile phone or smartphone. In this embodiment, the information processing device 20 is used by the user of the vehicle 10.

[0019] Server 30 includes one or more computers capable of communicating with each other. In this embodiment, vehicle 10 and information processing device 20 can communicate with each other via server 30. However, vehicle 10 and information processing device 20 can also communicate directly without going through server 30.

[0020] Here, a general overview of this embodiment will be described, and detailed information will be provided later. In this embodiment, the information processing device 20 displays an image of the engine compartment of the vehicle 10 when a predetermined trigger related to the vehicle 10 is detected. The information processing device 20 determines consumables to be replenished for the vehicle 10. Then, the information processing device 20 displays auxiliary information, including the location of replenishment ports in the engine compartment corresponding to the determined consumables.

[0021] In this manner, according to this embodiment, based on the occurrence of a predetermined trigger related to the vehicle 10, an image of the engine compartment of the vehicle 10 and auxiliary information, including, for example, the location of the replenishment port corresponding to consumables replenished for the vehicle 10, are displayed. Therefore, even if a user who wants to replenish the windshield washer fluid in the vehicle 10 is unfamiliar with the maintenance of the vehicle 10, the possibility of replenishing the windshield washer fluid from the wrong replenishment port can be reduced by performing the replenishment operation while referring to the image of the engine compartment displayed on the information processing device 20 and the auxiliary information. Therefore, the possibility of the vehicle 10 malfunctioning when replenishing consumables for the vehicle 10 can be reduced.

[0022] Next, the various structures of System 1 will be explained in detail.

[0023] (Vehicle structure) Reference Figure 2 The various structural elements of the vehicle 10 will be described below. The vehicle 10 includes a communication unit 11, a sensor unit 12, a storage unit 13, and a control unit 14.

[0024] The communication unit 11 includes one or more communication interfaces for connecting to the network 40. Although the communication interface corresponds to mobile communication standards such as 4G (4th Generation) and 5G (5th Generation), it is not limited to these and can correspond to any communication standard.

[0025] The sensor unit 12 includes one or more sensors for detecting the state of the vehicle 10. In this embodiment, the sensor unit 12 includes an opening / closing sensor for detecting the opening and closing of the engine hood.

[0026] Storage unit 13 includes one or more memories. These memories may be, for example, semiconductor memories, magnetic memories, or optical memories, but are not limited to these. Each memory included in storage unit 13 may function as a main storage device, an auxiliary storage device, or a high-speed cache memory. Storage unit 13 stores any information used during the operation of vehicle 10. For example, storage unit 13 may also store system programs, application programs, embedded software, and map information.

[0027] The controller 14 includes one or more processors, one or more programmable circuits, one or more dedicated circuits, or combinations thereof. The processor may be a general-purpose processor such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit), or a dedicated processor specifically designed for particular processing, but is not limited thereto. The programmable circuit may be, for example, a FPGA (Field-Programmable Gate Array), but is not limited thereto. The dedicated circuit may be, for example, an ASIC (Application Specific Integrated Circuit), but is not limited thereto. The control unit 14 controls the overall movement of the vehicle 10.

[0028] (Structure of an information processing device) like Figure 3 As shown, the information processing device 20 includes a communication unit 21, an output unit 22, an input unit 23, a storage unit 24, and a control unit 25.

[0029] The communication unit 21 includes one or more communication interfaces for connecting to the network 40. These communication interfaces may correspond to, for example, mobile communication standards, wired LAN (Local Area Network) standards, or wireless LAN standards, but are not limited to these and may correspond to any communication standard.

[0030] The output unit 22 includes one or more output devices for outputting information. These output devices may be, for example, a display that outputs information in the form of images, or a speaker that outputs information in the form of sound, but are not limited to these. Alternatively, the output unit 22 may also include an interface for connecting an external output device.

[0031] The input unit 23 includes one or more input devices that detect input operations performed by the user. These input devices may be, for example, physical buttons, electrostatic capacitive buttons, a mouse, a touch panel, a touchscreen integrated with the display of the output unit 22, a camera, or a microphone, but are not limited to these. Alternatively, the input unit 23 may also include an interface for connecting external input devices.

[0032] Storage unit 24 includes one or more memory units. Each memory unit included in storage unit 24 may function as a main storage device, an auxiliary storage device, or a high-speed cache memory. Storage unit 24 stores any information used in the operation of information processing device 20. For example, storage unit 24 may also store system programs, application programs, and vehicle information. Vehicle information includes, for example, an image of the engine compartment of vehicle 10 and the location of replenishment ports for various consumables in the engine compartment, but is not limited to this; it may also include any information related to vehicle 10.

[0033] The control unit 25 includes one or more processors, one or more programmable circuits, one or more dedicated circuits, or combinations thereof. The control unit 25 controls the overall operation of the information processing device 20.

[0034] (Server structure) Reference Figure 4 The structural elements of server 30 will be described below. Server 30 includes a communication unit 31, a storage unit 32, and a control unit 33.

[0035] The communication unit 31 includes one or more communication interfaces for connecting to the network 40. These communication interfaces may correspond to wired or wireless LAN standards, but are not limited to these; they may correspond to any communication standard.

[0036] Storage unit 32 includes one or more memories. Each memory included in storage unit 32 may function as a main storage device, an auxiliary storage device, or a cache memory. Storage unit 32 stores any information used in the operation of server 30. For example, storage unit 32 may also store system programs, application programs, embedded software, and databases.

[0037] The controller 33 includes one or more processors, one or more programmable circuits, one or more dedicated circuits, or combinations thereof. The control unit 33 controls the overall operation of the server 30.

[0038] (The operation of the information processing device) Reference Figure 5 The operation of the information processing device 20 will be explained.

[0039] S100: The control unit 25 of the information processing device 20 determines whether a predetermined trigger related to the vehicle 10 has been detected. If it is determined that a trigger has been detected (yes in S100), the process proceeds to S101. On the other hand, if it is determined that no trigger has been detected (no in S100), the process repeats S100.

[0040] In this embodiment, the "predetermined trigger" is the situation where the hood of vehicle 10 is opened. Specifically, when a user opens the hood to refill consumables such as windshield washer fluid, the control unit 14 of vehicle 10 detects that the hood is open via the opening / closing sensor of sensor unit 12. The control unit 14 sends a notification indicating the occurrence of the predetermined trigger (i.e., a notification indicating that the hood is open) to information processing device 20 via communication unit 11 and server 30. Then, when the control unit 25 of information processing device 20 receives the notification via communication unit 21, it determines that the predetermined trigger has been detected.

[0041] S101: If it is determined in S100 that a trigger has been detected (yes in S100), the control unit 25 displays an image of the engine compartment of the vehicle 10 on the display of the output unit 22.

[0042] Specifically, the control unit 25 retrieves an image of the engine compartment from the vehicle information stored in the storage unit 24 and displays it on the display of the output unit 22. The image of the engine compartment can be, for example, an image taken of the engine compartment or a schematic diagram of the engine compartment.

[0043] S102: The control unit 25 determines the consumables to be replenished for the vehicle 10.

[0044] In this embodiment, the control unit 25 determines the consumable to be replenished for the vehicle 10 from five types of consumables: windshield washer fluid, brake fluid, battery fluid, coolant, and engine oil. However, it is not limited to these five types, and the consumable to be replenished for the vehicle 10 may be determined from any six or more types of consumables.

[0045] When determining the consumables to be replenished for vehicle 10, any method can be used. For example, the control unit 25 can also accept user input for selecting or specifying consumables to be replenished for vehicle 10 via the input unit 23.

[0046] Furthermore, for example, the control unit 25 can also acquire an image of consumables replenished for the vehicle 10 based on user operation, and identify the consumable from the image through image recognition. Specifically, when the user uses the camera of the input unit 23 of the information processing device 20 to take a picture of consumables replenished for the vehicle 10, the control unit 25 identifies the consumable from the captured image through image recognition.

[0047] S103: The control unit 25 displays auxiliary information, including the location of the replenishment port in the engine compartment corresponding to the consumables determined in S102, on the display of the output unit 22.

[0048] Furthermore, "auxiliary information" is not limited to the location of the replenishment port corresponding to the identified consumable, and may further include any information related to the consumable. For example, "auxiliary information" may also include the replenishment order of the identified consumable.

[0049] As described above, the information processing device 20 of this embodiment displays an image of the engine compartment of the vehicle 10 when it detects the occurrence of a predetermined trigger related to the vehicle 10. The information processing device 20 determines the consumables to be replenished for the vehicle 10. Then, the information processing device 20 displays auxiliary information including the location of the replenishment port in the engine compartment corresponding to the determined consumables.

[0050] According to this structure, based on the occurrence of a predetermined trigger related to the vehicle 10, an image of the engine compartment of the vehicle 10 and auxiliary information, including, for example, the location of the replenishment port corresponding to consumables replenished for the vehicle 10, will be displayed. Therefore, even if a user wanting to replenish the windshield washer fluid for the vehicle 10 is unfamiliar with the maintenance of the vehicle 10, the possibility of replenishing the fluid from the wrong port can be reduced by performing the replenishment operation while referring to the image of the engine compartment and the auxiliary information displayed on the information processing device 20. Thus, the possibility of the vehicle 10 malfunctioning when replenishing consumables for the vehicle 10 is reduced.

[0051] While this disclosure has been described with reference to the accompanying drawings and embodiments, it should be noted that various modifications and alterations can be made based on this disclosure if one is skilled in the art. Therefore, it is important to note that such modifications and alterations are all included within the scope of this disclosure. For example, the functions included in various structural parts or steps can be reconfigured in a theoretically consistent manner, and multiple structural parts or steps can be combined into one or divided.

[0052] For example, an alternative implementation could be adopted in which the structure and operation of the information processing device 20 are distributed among multiple computers capable of communicating with each other. Alternatively, an implementation could be adopted in which an in-vehicle device (e.g., a navigation device) mounted on the vehicle 10 is used as the aforementioned information processing device 20.

[0053] Furthermore, for example, it can be configured such that a general-purpose computer functions as the information processing apparatus 20 according to the above-described embodiments. Specifically, a program describing the processing content for implementing the various functions of the information processing apparatus 20 according to the above-described embodiments is stored in the memory of a general-purpose computer, and the program is read and executed by a processor. Therefore, this disclosure can also be implemented as a processor-executable program or a non-transitory computer-readable medium storing the program.

[0054] Furthermore, in the above-described embodiment, the sensor unit 12 of the vehicle 10 may also include a sensor for detecting the remaining amount of consumables such as windshield washer fluid in the vehicle 10. In this case, when the control unit 14 of the vehicle 10 detects that the remaining amount of the consumable is less than a predetermined threshold, it may send a notification indicating the consumable to the information processing device 20 via the communication unit 11 and the server 30. When the control unit 25 of the information processing device 20 receives the notification from the vehicle 10, it may also display a webpage (e.g., an EC website webpage) on the display of the output unit 22 where the consumable can be purchased.

[0055] Furthermore, in the above-described embodiment, the "predetermined trigger" is the case where the engine hood of vehicle 10 is opened. However, the "predetermined trigger" is not limited to this example.

[0056] For example, a "predetermined trigger" could also be a user input indicating the start of a replenishment operation for consumables on vehicle 10. This user input can be performed on vehicle 10 or on information processing device 20. Furthermore, this user input can also be detected via input devices such as physical buttons, capacitive buttons, touch panels, touchscreens, or microphones.

[0057] Alternatively, a "pre-arranged trigger" could also refer to the activation of an application related to the vehicle 10 installed on the information processing device 20. This application related to the vehicle 10 could be, for example, an application that performs a pre-arranged operation on the vehicle 10, such as remote operation or settings changes, but is not limited to this.

[0058] Alternatively, the "pre-arranged trigger" could be, for example, the purchase of consumables such as windshield washer fluid from an EC website, or the completion of delivery of such consumables. Specifically, the control unit 25 of the information processing device 20 could also display the webpage on the display of the output unit 22, and determine that a "pre-arranged trigger" has been detected when the user purchases a consumable. Alternatively, the control unit 25 could also determine that a "pre-arranged trigger" has been detected when it receives a notification indicating that the delivery of a consumable purchased by the user has been completed (e.g., a delivery completion email from a logistics operator).

[0059] Furthermore, in the above-described embodiment, the control unit 25 of the information processing device 20 displays an image of the engine compartment on the display of the output unit 22. Here, the control unit 25 may also display information related to the specified part on the display of the output unit 22 when it detects a user operation on the image of a part within the engine compartment via the input unit 23. For example, if the windshield washer fluid refill port is specified by the user operation, general instructions for windshield washer fluid, refill order, precautions, or a link to a webpage where windshield washer fluid can be displayed.

[0060] In the following description, some embodiments of the present disclosure are illustrated. However, it should be noted that the embodiments of the present disclosure are not limited thereto.

[0061] [Postscript 1] A method, which is performed by an information processing device, wherein, The method includes: When a predetermined trigger related to the vehicle is detected, an image of the vehicle's engine compartment is displayed; The consumables to be replenished for the vehicle are determined; and The auxiliary information is displayed, which includes the location of the replenishment port in the engine compartment corresponding to the determined consumable.

[0062] [Postscript 2] As described in Appendix 1, wherein, The trigger includes the situation where the vehicle's hood is open.

[0063] [Postscript 3] As described in Appendix 1 or 2, wherein, The auxiliary information also includes the determined replenishment order of the consumables.

[0064] [Postscript 4] The method described in any of Notes 1 to 3, wherein, It also includes: when a user operation is detected on the image targeting a specific part of the engine compartment, displaying information related to the specified part.

[0065] [Postscript 5] The method described in any of Notes 1 to 4, wherein, The information processing device determines whether windshield washer fluid, brake fluid, battery fluid, coolant, or engine oil is a consumable.

[0066] [Postscript 6] The method described in any of Notes 1 to 5, wherein, It also includes: obtaining images of the consumables based on user actions. The information processing device identifies the consumable from the image.

[0067] [Postscript 7] The method described in any of Notes 1 to 6, wherein, It also includes: when a consumable item with a remaining quantity less than a threshold is detected in the vehicle, displaying a webpage where the consumable item can be purchased.

[0068] [Postscript 8] A program product comprising a program that causes a computer to perform the following actions, wherein, The actions include: When a predetermined trigger related to the vehicle is detected, an image of the vehicle's engine compartment is displayed; The consumables to be replenished for the vehicle are determined; and The auxiliary information is displayed, which includes the location of the replenishment port in the engine compartment corresponding to the determined consumable.

[0069] [Postscript 9] The program product as described in Appendix 8, wherein... The trigger includes the situation where the vehicle's hood is open.

[0070] [Postscript 10] The program product as described in Appendix 8 or 9, wherein... The auxiliary information also includes the determined replenishment order of the consumables.

[0071] [Postscript 11] The procedure product as described in any of Appendix 8 to 10, wherein, The action also includes: When a user operation is detected on the image targeting a specific area within the engine compartment, information related to that specific area is displayed.

[0072] [Postscript 12] The procedure product as described in any of Notes 8 to 11, wherein, The computer determines whether windshield washer fluid, brake fluid, battery fluid, coolant, or engine oil is a consumable.

[0073] [Postscript 13] The procedure product as described in any of Appendix 8 to 12, wherein, The action also includes: The image of the consumable is obtained based on the user's operation.

[0074] [Postscript 14] The program product as described in any of Notes 8 to 13, wherein... The action also includes: When a consumable item with a remaining quantity below a threshold is detected in the vehicle, a webpage showing how to purchase the consumable item is displayed.

[0075] [Postscript 15] An information processing device includes a control unit, wherein... The control unit implements the following control: When a predetermined trigger related to the vehicle is detected, an image of the vehicle's engine compartment is displayed on the monitor. The consumables required to replenish the vehicle are determined, and The auxiliary information is displayed on the display, including the location of the replenishment port in the engine compartment corresponding to the determined consumable.

[0076] [Postscript 16] The information processing apparatus as described in Appendix 15, wherein... The trigger includes the situation where the vehicle's hood is open.

[0077] [Postscript 17] The information processing apparatus as described in Appendix 15 or 16, wherein... The auxiliary information also includes the determined replenishment order of the consumables.

[0078] [Postscript 18] The information processing apparatus as described in any one of Appendices 15 to 17, wherein... When the control unit detects that a user has performed a specified operation on a part of the engine compartment in the image, it displays information related to the specified part on the display.

[0079] [Postscript 19] The information processing apparatus as described in any one of Appendices 15 to 18, wherein... The control unit determines whether windshield washer fluid, brake fluid, battery fluid, coolant, or engine oil is a consumable.

[0080] [Postscript 20] The information processing apparatus as described in any one of Appendices 15 to 19, wherein... The control unit implements the following control: The image of the consumable is obtained based on user input. The consumables are identified from the image.

[0081] Symbol Explanation 1…system; 10… vehicles; 11…Ministry of Communications; 12… Sensor section; 13… Storage Department; 14…Control Department; 20…information processing device; 21…Ministry of Communications; 22… Output section; 23… Input Section; 24… Storage Department; 25…Control Department; 30… servers; 31…Ministry of Communications; 32… Storage section; 33…Control Department; 40…Network.

Claims

1. A method performed by an information processing apparatus, comprising: When a predetermined trigger related to the vehicle is detected, an image of the vehicle's engine compartment is displayed; The consumables to be replenished for the vehicle are determined; and The auxiliary information is displayed, which includes the location of the replenishment port in the engine compartment corresponding to the determined consumable.

2. The method as described in claim 1, wherein, The trigger includes the situation where the vehicle's hood is open.

3. The method as described in claim 1, wherein, The auxiliary information also includes the determined replenishment order of the consumables.

4. The method of claim 1, wherein, It also includes: when a user operation is detected on the image to specify a part of the engine compartment, displaying information related to the specified part.

5. The method of claim 1, wherein, The information processing device determines whether windshield washer fluid, brake fluid, battery fluid, coolant, or engine oil is a consumable.

6. The method of claim 1, wherein, It also includes: obtaining images of the consumables based on user actions. The information processing device identifies the consumable from the image.

7. The method of claim 1, wherein, It also includes: when a consumable item with a remaining quantity less than a threshold is detected in the vehicle, displaying a webpage where the consumable item can be purchased.

8. A non-transitory computer-readable medium storing a program that causes a computer to perform the following actions, wherein... The actions include: When a predetermined trigger related to the vehicle is detected, an image of the vehicle's engine compartment is displayed; The consumables to be replenished for the vehicle are determined; and The auxiliary information is displayed, which includes the location of the replenishment port in the engine compartment corresponding to the determined consumable.

9. The non-transitory computer-readable medium as described in claim 8, wherein, The trigger includes the situation where the vehicle's hood is open.

10. The non-transitory computer-readable medium of claim 8, wherein, The auxiliary information also includes the determined replenishment order of the consumables.

11. The non-transitory computer-readable medium of claim 8, wherein, The action also includes: When a user operation is detected on the image targeting a specific area within the engine compartment, information related to that specific area is displayed.

12. The non-transitory computer-readable medium of claim 8, wherein, The computer determines whether windshield washer fluid, brake fluid, battery fluid, coolant, or engine oil is a consumable.

13. The non-transitory computer-readable medium of claim 8, wherein, The action also includes: The image of the consumable is obtained based on the user's operation.

14. The non-transitory computer-readable medium of claim 8, wherein... The action also includes: When a consumable item with a remaining quantity below a threshold is detected in the vehicle, a webpage showing how to purchase the consumable item is displayed.

15. An information processing apparatus comprising a control unit, wherein, The control unit implements the following control: When a predetermined trigger related to the vehicle is detected, an image of the vehicle's engine compartment is displayed on the monitor. The consumables required to replenish the vehicle are determined, and The auxiliary information is displayed on the display, including the location of the replenishment port in the engine compartment corresponding to the determined consumable.

16. The information processing apparatus as claimed in claim 15, wherein, The trigger includes the situation where the vehicle's hood is open.

17. The information processing apparatus of claim 15, wherein, The auxiliary information also includes the determined replenishment order of the consumables.

18. The information processing apparatus as claimed in claim 15, wherein, When the control unit detects that a user has performed a specified operation on a part of the engine compartment on the image, it displays information related to the specified part on the display.

19. The information processing apparatus as claimed in claim 15, wherein, The control unit determines whether windshield washer fluid, brake fluid, battery fluid, coolant, or engine oil is a consumable.

20. The information processing apparatus of claim 15, wherein, The control unit implements the following control: The image of the consumable is obtained based on the user's operation, and The consumables are identified from the image.

Images