In-vehicle device and program

Abstract

To provide a technique for improving the readability of a two-dimension code.SOLUTION: An in-vehicle device according to an aspect of the present invention acquires a captured image from an imaging device disposed toward the inside of a vehicle, analyzes the acquired captured image to identify a current situation of a user present in the vehicle, determines a display format of a two-dimension code according to the identified current situation, and displays the two-dimension code on a display according to the determined display format.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to an in-vehicle device and a program. [Background technology]

[0002] Patent Document 1 proposes an electronic device that displays information about a spot to which information is to be provided using a two-dimensional code. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2011-039073 Summary of the Invention [Problem to be solved by the invention]

[0004] One of the purposes of the present disclosure is to provide a technique for improving the readability of two-dimensional codes. [Means for solving the problem]

[0005] An in-vehicle device according to a first aspect of the present disclosure includes a control unit configured to acquire an image from an imaging device disposed facing the interior of the vehicle, identify a current situation of a user present in the vehicle by analyzing the acquired image, determine a display format of a two-dimensional code according to the identified current situation, and display the two-dimensional code on a display according to the determined display format.

[0006] A program according to a second aspect of the present disclosure is a program for causing an in-vehicle device to execute an information processing method, the information processing method including: acquiring an image from an imaging device disposed facing the interior of the vehicle; identifying a current situation of a user present in the vehicle by analyzing the acquired image; determining a display format of a two-dimensional code according to the identified current situation; and displaying the two-dimensional code on a display according to the determined display format. [Effects of the Invention]

[0007] According to the present disclosure, it is possible to improve the readability of two-dimensional codes. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 schematically illustrates an example of a situation to which the present disclosure is applied. [Figure 2] FIG. 2 is a diagram showing an example of a situation in which the display format of a two-dimensional code is controlled. [Figure 3] FIG. 3 is a diagram showing an example of a situation in which the display format of a two-dimensional code is controlled. [Figure 4] FIG. 4 shows an example of a scene in which the display format of a two-dimensional code is controlled. [Figure 5] FIG. 5 is a diagram illustrating an example of a hardware configuration of an in-vehicle device according to the present disclosure. [Figure 6] FIG. 6 is a flowchart showing an example of a processing procedure for displaying a two-dimensional code by the in-vehicle device of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0009] In conventional methods, two-dimensional codes are displayed in a fixed area. However, in a vehicle, a two-dimensional code displayed in a fixed area is not necessarily easy to read. For example, the position where the two-dimensional code is easy to read differs depending on whether the passenger sitting in the passenger seat reads the code or the driver sitting in the driver's seat. Therefore, in conventional methods, In this case, the displayed two-dimensional code may be difficult for the user to read.

[0010] In contrast, an in-vehicle device according to a first aspect of the present disclosure includes a control unit configured to acquire an image from an imaging device disposed facing the interior of the vehicle, identify a current situation of a user in the vehicle by analyzing the acquired image, determine a display format of a two-dimensional code according to the identified current situation, and display the two-dimensional code on a display according to the determined display format.

[0011] In a first aspect of the present disclosure, the current situation inside the vehicle is identified from an image captured by an imaging device, and the display format of the two-dimensional code is determined according to the identified current situation. This makes it possible to control the display format of the two-dimensional code according to the current situation inside the vehicle. By controlling the display format of the two-dimensional code, it is possible to display the two-dimensional code in a manner appropriate to the situation inside the vehicle, such as displaying the two-dimensional code in a position close to the user. Therefore, according to the first aspect of the present disclosure, it is possible to improve the readability of the two-dimensional code.

[0012] As another form of the in-vehicle device according to the above aspect, one aspect of the present disclosure may be an information processing method or a program that realizes all or part of the above components, or may be a storage medium that stores such a program and is readable by a machine such as a computer. Here, the machine-readable storage medium is a medium that stores information such as a program by electrical, magnetic, optical, mechanical, or chemical action.

[0013] For example, a program according to a second aspect of the present disclosure includes a series of instructions for causing an in-vehicle device to execute an information processing method, the information processing method including acquiring an image from an imaging device disposed facing the interior of the vehicle, identifying a current situation of a user present in the vehicle by analyzing the acquired image, determining a display format of a two-dimensional code according to the identified current situation, and displaying the two-dimensional code on a display according to the determined display format.

[0014] [1 Application example] 1 is a schematic diagram illustrating an example of a situation in which the present disclosure is applied. The in-vehicle device 1 according to this embodiment is one or more computers configured to execute a process of displaying a two-dimensional code 35 on a display 141.

[0015] The in-vehicle device 1 according to this embodiment acquires a captured image 20 from an imaging device CA arranged facing the interior of the vehicle. The in-vehicle device 1 identifies a current situation 25 of a user U present in the vehicle by analyzing the acquired captured image 20. The in-vehicle device 1 determines a display format 30 of a two-dimensional code 35 according to the identified current situation 25. The in-vehicle device 1 then displays the two-dimensional code 35 on the display 141 according to the determined display format 30.

[0016] In this embodiment, a current situation 25 inside the vehicle is identified through an image 20 captured by an imaging device CA arranged facing the vehicle interior. The display format 30 of the two-dimensional code 35 is controlled according to the identified current situation 25. This allows the two-dimensional code 35 to be displayed in a manner suited to the situation inside the vehicle. Therefore, according to this embodiment, the readability of the two-dimensional code 35 can be improved.

[0017] (In-vehicle devices / imaging devices / displays) The in-vehicle device 1 may be an in-vehicle device that is permanently installed in the vehicle T, or may be a user terminal that is installed in the vehicle T at least temporarily.

[0018] The imaging device CA may be provided in the vehicle-mounted device 1 or may be provided separately from the vehicle-mounted device 1. The imaging device CA may be permanently installed in the vehicle T or may be temporarily installed. As long as the imaging device CA can capture images of the interior of the vehicle T, the location of the imaging device CA is not particularly limited and may be determined appropriately depending on the embodiment. The imaging device CA may be fixed or movable. The type of the imaging device CA may be selected arbitrarily. The imaging device CA may include any sensor that acquires data in the form of an image or an image representation, such as an RGB camera, a depth sensor, an infrared sensor, or a radar.

[0019] The display 141 may be provided in the in-vehicle device 1 or may be provided separately from the in-vehicle device 1. The display 141 may be permanently installed in the vehicle T or may be temporarily installed. As long as it is available to the user in the vehicle T, the location of the display 141 is not particularly limited and may be determined appropriately depending on the embodiment. The display 141 may be fixed or movable. The type of the display 141 may be selected arbitrarily. The display 141 may be a general display or a touch panel display.

[0020] (analysis) The analysis content of the captured image 20 may be determined appropriately depending on the embodiment. In one example, analyzing the captured image 20 may include detecting an object appearing in the captured image 20, estimating the position of the object, estimating the distance to the object, identifying the type of the object, etc. The object may be, for example, a user, a two-dimensional code reader, etc. The user may be a vehicle occupant such as a driver or a passenger.

[0021] Furthermore, an analysis method for the captured image 20 may be selected arbitrarily. In one example, the captured image 20 may be analyzed using a common image analysis method such as edge detection or pattern matching. In another example, the captured image 20 may be analyzed using a trained machine learning model that has acquired the ability to analyze images. The machine learning model is configured to have one or more calculation parameters that can be adjusted by machine learning. The one or more calculation parameters are used to calculate the desired inference (in this embodiment, image analysis). The machine learning model may be configured using, for example, a neural network, a support vector machine, or other functional formulas (calculation models). The machine learning method may be appropriately selected depending on the machine learning model employed (e.g., backpropagation). Training the machine learning model means adjusting (optimizing) the values ​​of the calculation parameters using training samples. The machine learning model may be appropriately trained so that, when given training sample images, it derives the true value of the corresponding analysis result. A large-scale model such as a large-scale visual language model (VLM) may be used as the trained machine learning model.

[0022] (Current status / display format) As long as the display format 30 can be controlled, the identification content of the current situation 25 is not particularly limited and may be determined appropriately depending on the embodiment. For example, the current situation 25 of the user U may include the relative position of the user U with respect to the display 141, whether the user U is pointing the reading device toward the display 141, etc. The current situation 25 of the user U may be identified directly from the user U detected in the captured image 20, or may be identified indirectly from an object other than the user U, such as a reading device carried by the user U.

[0023] As long as the display format 30 can be controlled, the granularity of identifying the current situation 25 is not particularly limited and may be determined appropriately depending on the embodiment. In one example, the current situation 25 of the user U may be simply identified by, for example, indicating that an object that may correspond to the user U is present on the right or left side of the display 141. In another example, the current situation 25 of the user U may be specifically identified by, for example, identifying the user U or estimating the distance to the user U.

[0024] The display format 30 of the two-dimensional code 35 displays the two-dimensional code 35 on the display 141. The display format 30 to be controlled may be selected appropriately depending on the embodiment. In one example, the display format 30 to be controlled may include settings that may affect reading of the display position, display size, resolution, brightness, etc. on the display 141.

[0025] The correspondence between the current situation 25 and the display format 30 may be determined as appropriate so that the user U of the identified current situation 25 can read the two-dimensional code 35. For example, the in-vehicle device 1 may determine the display format 30 so that the two-dimensional code 35 is displayed in an area on the display 141 on the side where the user U is present. For example, the in-vehicle device 1 may determine the display format 30 so that the closer the user U is to the display 141, the larger the two-dimensional code 35 is displayed, and the farther the user U is from the display 141, the smaller or normal-sized the two-dimensional code 35 is displayed. For example, the in-vehicle device 1 may determine the display format 30 so that the larger the two-dimensional code 35 is displayed when the user U is holding a reading device, and the smaller or normal-sized the two-dimensional code 35 is displayed when the user U is not holding a reading device. In one example, the in-vehicle device 1 may determine the display format 30 of the two-dimensional code 35 according to the identified current situation 25 by at least one of the following first to third control methods.

[0026] (1) First control method FIG. 2 schematically illustrates an example of a situation in which the display format 30 of the two-dimensional code 35 is controlled. In one example, the current situation 25 may include the relative position of the user U with respect to the display 141. The display format 30 may include setting a display position on the display 141. Determining the display format 30 may include determining the display position of the two-dimensional code 35 within an area on the user U's side according to the relative position. The area on the user U's side may be closer to the user U on the display 141. In one example, the area on the user U's side may be set in stages, such as to the right, center, or left, or may be set continuously according to the detected direction of the user U. In the example of FIG. 2, analysis of the captured image 20 may identify that the user U is on the right side of the display 141. In response to this, the display position of the two-dimensional code 35 may be set within the right area of ​​the display 141.

[0027] For example, when the display 141 is disposed between the driver's seat and the passenger seat and the user U is sitting in the driver's seat (i.e., the user U is the driver), the display position of the two-dimensional code 35 may be set within the driver's seat side area of ​​the display 141. As a result, the two-dimensional code 35 may be displayed on the driver's seat side of the display 141. Furthermore, when the user U is sitting in the passenger seat, the display position of the two-dimensional code 35 may be set within the passenger seat side area of ​​the display 141. As a result, the two-dimensional code 35 may be displayed on the passenger seat side of the display 141. According to one example of the present embodiment, the two-dimensional code 35 can be displayed at a position close to the user U. As a result, the amount of movement of the user U when reading the two-dimensional code 35 can be reduced.

[0028] In one example, the positional relationship between the imaging device CA and the display 141 may be specified in advance, such as by installing the imaging device CA and the display 141 at predetermined positions. In this case, the in-vehicle device 1 may identify the relative position of the user U with respect to the display 141 by detecting the user U in the captured image 20. In another example, when the installation position of the imaging device CA with respect to the display 141 is unknown, the in-vehicle device 1 may identify the relative position of the user U with respect to the display 141 by detecting the display 141 and the user U in the captured image 20.

[0029] The granularity of identifying the relative position may be determined appropriately depending on the embodiment. In one example, the relative position may be simply identified, such as the user U being detected on the right side, the center, or the left side in the captured image 20. In other words, identifying the relative position is achieved by identifying the direction in which the user U is present relative to the display 141. In another example, identifying the relative position may include estimating the distance from the display 141 to the user U. The distance to the user U may be identified by a specific scale number such as cm or m, or may be identified by a gradation level such as far or close.

[0030] When estimating the distance to the user U, the in-vehicle device 1 may determine the display format 30 of the two-dimensional code 35 by further using the estimated distance, or may determine the display format 30 regardless of the estimated distance. As an example of the former, the in-vehicle device 1 may determine the display position of the two-dimensional code 35 on the display 141 depending on the direction in which the user U is present relative to the display 141, and may determine the size of the two-dimensional code 35 depending on the estimated distance. For example, if the identification result of the distance to the user U indicates that the user U is closer to the display 141 than a threshold, the in-vehicle device 1 may determine the display format 30 to enlarge the size of the two-dimensional code 35. In other cases, the in-vehicle device 1 may determine the display format 30 to display the two-dimensional code 35 at a normal size. The normal and enlarged sizes may be determined as appropriate. The display size may be controlled in two stages, normal and enlarged, or in three or more stages.

[0031] Furthermore, when multiple users U are detected, the display position of the two-dimensional code 35 may be determined by any method. In one example, the display position of the two-dimensional code 35 may be set between the multiple users U. One user U may be selected as a priority from the multiple users U, and the display position of the two-dimensional code 35 may be set on the side of the selected user U. The method for selecting the user U may be determined as appropriate depending on the embodiment. In one example, the priority user U may be determined in advance, such as by giving priority to the user in the passenger seat when there are users in both the passenger seat and the driver's seat. In another example, the priority user U may be selected by a second control method described later.

[0032] (2) Second control method FIG. 3 schematically illustrates an example of a situation in which the display format 30 of the two-dimensional code 35 is controlled. In one example, when multiple users U are present in a vehicle, identifying the current status 25 of each user U may involve identifying the current status 25 of the user U who, among the multiple users U, holds a reading device RD for the two-dimensional code 35. That is, when multiple users U are present, the user U holding the reading device RD may be selected as the prioritized user U, and the display position of the two-dimensional code 35 may be set to the side of the user U holding the reading device RD. In the example of FIG. 3 , of two users (U1, U2), user U2, who is located on the left, holds the reading device RD. Accordingly, the display position of the two-dimensional code 35 may be set within the left area of ​​the display 141. According to this example, it is possible to select from the multiple users U a user U who is likely to read the two-dimensional code 35, using the possession of a reading device RD as an indicator. This reduces the amount of work required for the selected user U to read the two-dimensional code 35.

[0033] In one example, the in-vehicle device 1 may detect each user U in the captured image 20 and then detect the reading device RD, thereby identifying the user U holding the reading device RD. In another example, the in-vehicle device 1 may indirectly identify the user U holding the reading device RD by detecting the reading device RD without detecting each user U. When multiple reading devices RD are detected, the display position of the two-dimensional code 35 may be determined by any method. In one example, the display position of the two-dimensional code 35 may be set between the multiple reading devices RD. A prioritized reading device RD may be selected from the multiple reading devices RD, and the display position of the two-dimensional code 35 may be set on the side of the selected reading device RD. The in-vehicle device 1 may select from the multiple reading devices RD a reading device RD that satisfies conditions such as being facing toward the display 141 or being closest to the display 141, and determine the display position of the two-dimensional code 35 on the side of the selected reading device RD. The reading device RD may be, for example, a terminal equipped with an imaging device, a dedicated device, etc. The terminal may be, for example, a mobile terminal (including a smartphone), a tablet terminal, a notebook PC (Personal Computer), or the like.

[0034] (3) Third control method FIG. 4 schematically illustrates an example of a situation in which the display format 30 of the two-dimensional code 35 is controlled. In one example, the current situation 25 may include whether the user U is pointing the reading device RD toward the display 141. The display format 30 may include setting the size of the two-dimensional code 35. Determining the display format 30 may include determining to enlarge the size of the two-dimensional code 35 when the user U is pointing the reading device RD toward the display 141. In the example of FIG. 4, of two users (U1, U2), the user U2 on the left is pointing the reading device RD toward the display 141. In response to this, the display position of the two-dimensional code 35 may be set within the left region of the display 141, and the size of the two-dimensional code 35 may be enlarged.

[0035] According to one example of this embodiment, by pointing the reading device RD toward the display 141, it is possible to detect a situation in which the two-dimensional code 35 is likely to be read. Then, in the detected situation, the size of the two-dimensional code 35 can be enlarged. As a result, in a situation in which the two-dimensional code 35 is unlikely to be read, priority is given to displaying other information (saving the display area of ​​the display 141), and by enlarging the two-dimensional code 35 when reading, it is possible to improve readability.

[0036] The criteria for determining whether the reading device RD is pointed toward the display 141 may be defined as appropriate depending on the embodiment. In one example, simply detecting the reading device RD in the captured image 20 may be considered to indicate that the reading device RD is pointed toward the display 141. That is, the in-vehicle device 1 may determine that the reading device RD is pointed toward the display 141 in response to the reading device RD being detected. The in-vehicle device 1 may determine that the reading device RD is not pointed toward the display 141 in response to the reading device RD not being detected. Detection of even a part of the reading device RD may be considered to indicate that the reading device RD is detected. Detection of the entire reading device RD may be considered to indicate that the reading device RD is detected.

[0037] In another example, the orientation of the reading device RD may be estimated in the analysis of the captured image 20. The in-vehicle device 1 may determine whether the reading device RD is facing the display 141 according to the estimated orientation. The in-vehicle device 1 may detect a sensor (such as an imaging device) of the reading device RD in the analysis of the captured image 20. The in-vehicle device 1 may determine whether the reading device RD is facing the display 141 according to the position of the detected sensor and the orientation of the reading device RD.

[0038] In yet another example, the distance from the display 141 to the reading device RD may be estimated in the analysis of the captured image 20. The distance to the reading device RD may be estimated using a specific scale value or may be estimated using a step-by-step level. The in-vehicle device 1 may determine that the reading device RD is pointed toward the display 141 if the estimated distance is less than a threshold value. The in-vehicle device 1 may determine that the reading device RD is not pointed toward the display 141 if the estimated distance exceeds a threshold value. If the estimated distance is equal to the threshold value, the in-vehicle device 1 may make either determination.

[0039] The display size of the two-dimensional code 35 when enlarged may be determined as appropriate depending on the embodiment. For example, the in-car device 1 may refer to size information 125 indicating the size of the display 141. The in-car device 1 determines the display size of the two-dimensional code 35 when enlarged so that the display size is equal to or larger than a predetermined size within the display 141 having the size indicated in the size information 125. In another example, the in-vehicle device 1 may enlarge the two-dimensional code 35 at a predetermined magnification without referring to the size information 125. The magnification for enlargement may be specified arbitrarily. The normal display size of the two-dimensional code 35 may also be determined appropriately depending on the embodiment. The display size may be controlled in two stages, normal and enlarged, or may be controlled in three or more stages. When the display size of the two-dimensional code 35 is controlled in three or more stages, the display size in each stage may be determined appropriately depending on the embodiment.

[0040] (2D code) The information stored in the two-dimensional code 35 is not particularly limited and may be selected appropriately depending on the embodiment. In one example, the information stored in the two-dimensional code 35 may include navigation information such as facility information about facilities present in the vicinity of the vehicle T. The facilities may be, for example, stores, rest facilities, etc. The information stored in the two-dimensional code 35 may include any information acquired via a network. The information stored in the two-dimensional code 35 may also include vehicle information about the vehicle T. The vehicle information may include, for example, the location information of the vehicle T, the remaining amount of fuel, the number of vacant seats, the temperature inside the vehicle, captured images of the interior of the vehicle, etc. The remaining amount of fuel may be, for example, the amount of gasoline, the remaining amount of battery (State Of Charge), etc. Display The two-dimensional code 35 may be switched as desired. The two-dimensional code 35 may also be displayed in response to an event such as an operator's operation or the vehicle T approaching a target facility. The two-dimensional code 35 is configured to have information in both horizontal and vertical directions. The type of the two-dimensional code 35 may be selected as desired from a matrix type, a stack type, etc.

[0041] [2 Configuration Examples] 5 is a schematic diagram showing an example of the hardware configuration of the in-vehicle device 1 according to this embodiment. The in-vehicle device 1 according to this embodiment is a computer to which a control unit 11, a storage unit 12, an input device 13, an output device 14, a drive 15, and an external interface 16 are electrically connected.

[0042] The control unit 11 includes a CPU (Central Processing Unit), a RAM (Random Access Memory The control unit 11 includes a memory 81, a ROM (Read Only Memory), etc., and is configured to execute any information processing based on a program and various data. The control unit 11 (CPU) is an example of a processor resource. The storage unit 12 may be configured with any storage device, such as a hard disk drive, a solid state drive, or a semiconductor memory. The storage unit 12 (as well as RAM and ROM) are examples of memory resources. In this embodiment, the storage unit 12 stores various information such as a program 81 and size information 125. The program 81 is a program for causing the in-vehicle device 1 to execute information processing (see FIG. 6 described below) related to the display of the two-dimensional code 35. The program 81 includes a series of instructions for the information processing.

[0043] The input device 13 is a device for inputting information, such as an operation button or a microphone. The output device 14 is a device for outputting information, such as a speaker. In this embodiment, the output device 14 includes a display 141. An operator such as a user U can operate the in-vehicle device 1 by using the input device 13 and the output device 14. The input device 13 and the output device 14 (display 141) may be integrally configured, for example, by a touch panel display or the like. At least one of the input device 13 and the output device 14 may be connected via an external interface 16.

[0044] The drive 15 is a device for reading various information such as programs stored in a storage medium 91. At least one of the above-mentioned programs 81 and size information 125 may be stored in the storage medium 91 instead of or together with the storage unit 12. The storage medium 91 is configured to store various information (stored programs, etc.) by electrical, magnetic, optical, mechanical or chemical action so that a machine such as a computer can read the information. The in-vehicle device 1 stores at least one of the above-mentioned programs 81 and size information 125. The drive 15 may acquire the data from the storage medium 91. The storage medium 91 may be a disk-type storage medium such as a CD or a DVD, or may be a non-disk-type storage medium such as a semiconductor memory (for example, a flash memory). The type of the drive 15 may be selected appropriately depending on the type of the storage medium 91.

[0045] The external interface 16 is configured to connect to an external device via a wired or wireless connection. The external interface 16 may be configured, for example, by a USB (Universal Serial Bus) port, a dedicated port, a communication port, or the like. If the external interface 16 includes a communication port, the communication standard of the communication port may be selected arbitrarily. In this embodiment, the in-vehicle device 1 may be connected to the imaging device CA via the external interface 16. Note that the connection method of the imaging device CA is not limited to this example and may be changed as appropriate depending on the embodiment. In another example, the in-vehicle device 1 may include the imaging device CA as one of its components. The in-vehicle device 1 may be connected to the imaging device CA via another computer.

[0046] Regarding the specific hardware configuration of the in-vehicle device 1, components can be omitted, replaced, or added as appropriate depending on the embodiment. For example, the control unit 11 may include multiple hardware processors. The hardware processors may be a microprocessor, a field-programmable gate array (FPGA), a digital signal processor (DSP), an ECU, etc. The in-vehicle device 1 may be configured by an Electronic Control Unit (ECM), a Graphics Processing Unit (GPU), an ASIC (application specific integrated circuit), etc. The drive 15 may be omitted. The in-vehicle device 1 may be a specially designed computer, a mobile terminal (including a smartphone), a tablet terminal, a general-purpose PC, etc.

[0047] [3 Example of operation] FIG. 6 is a flowchart showing an example of a processing procedure for displaying a two-dimensional code 35 by the in-vehicle device 1 according to this embodiment. The control unit 11 of the in-vehicle device 1 executes instructions included in the program 81 using the CPU. As a result, the in-vehicle device 1 operates as a computer capable of executing the information processing shown in FIG. 6 below. The following processing procedure is an example of an information processing method executed by a computer (in-vehicle device). However, the following processing procedure is merely an example, and each step may be modified as much as possible. Furthermore, steps may be omitted, replaced, or added to the following processing procedure as appropriate depending on the embodiment.

[0048] In step S101, the control unit 11 acquires the captured image 20 from the imaging device CA. After acquiring the captured image 20, the control unit 11 advances the process to the next step S102.

[0049] In step S102, the control unit 11 identifies the current situation 25 of the user U present in the vehicle T by analyzing the acquired captured image 20.

[0050] In one example, the control unit 11 may obtain an analysis result of the current situation 25 of the user U by analyzing the captured image 20 using a general image analysis method. In another example, the control unit 11 may input the acquired captured image 20 to a trained machine learning model and execute arithmetic processing of the trained machine learning model. In this way, the control unit 11 may obtain an output corresponding to the analysis result of the current situation 25 from the trained machine learning model.

[0051] In one example, in analyzing the captured image 20, the control unit 11 may identify the relative position of the user U with respect to the display 141 as at least a part of the current situation 25. In one example, when there are multiple users U in the vehicle T, the control unit 11 may identify the current situation 25 of one of the multiple users U who is holding a reader RD for the two-dimensional code 35. In another example, in analyzing the captured image 20, the control unit 11 may identify whether the reader RD is pointed at the display 141 as at least a part of the current situation 25. When the current situation 25 is identified, the control unit 11 advances the process to the next step S103.

[0052] In step S103, the control unit 11 determines the display format 30 of the two-dimensional code 35 according to the identified current situation 25.

[0053] In one example, the display format 30 may include setting a display position on the display 141. The control unit 11 may determine the display position of the two-dimensional code 35 in an area on the user U's side on the display 141 according to the identified relative position. In one example, when there are multiple users U, the control unit 11 may determine the display position of the two-dimensional code 35 in an area on the user U's side holding the reading device RD. In another example, the display format 30 may include setting a size of the two-dimensional code 35. When the reading device RD is pointed at the display 141, the control unit 11 may determine to enlarge the size of the two-dimensional code 35. After determining the display format 30, the control unit 11 proceeds to the next step S104.

[0054] In step S104, the control unit 11 displays the two-dimensional code 35 on the display 141 in accordance with the determined display format 30.

[0055] In one example, the control unit 11 may display the two-dimensional code 35 closer to the user U. In one example, when there are multiple users U, the control unit 11 may display the two-dimensional code 35 closer to the user U holding the reading device RD. In another example, when the reading device RD is pointed at the display 141, the control unit 11 may enlarge the two-dimensional code 35 and then display it on the display 141. When the display of the two-dimensional code 35 is complete, the control unit 11 ends the processing procedure related to this operation example.

[0056] The control unit 11 may acquire information about the two-dimensional code 35 to be displayed in response to an arbitrary event such as an operator's operation or the fulfillment of a condition (approaching a target facility, etc.). The control unit 11 may execute a series of processes from step S101 to step S104 in response to receiving the two-dimensional code 35 to be displayed. The control unit 11 may execute a series of processes from step S101 to step S104 in real time.

[0057] Furthermore, the control unit 11 may periodically or irregularly repeat the series of processes from step S101 to step S104 while displaying the same two-dimensional code 35. In this way, the control unit 11 may track the current situation 25 of the user U, and may update the display format 30 of the two-dimensional code 35 in real time according to the tracked current situation 25.

[0058] [Features] In this embodiment, the current situation 25 of the user U in the vehicle is identified by the processing of steps S101 to S103, and the display format 30 of the two-dimensional code 35 is controlled in accordance with the identified current situation 25. This makes it possible to display the two-dimensional code 35 in a manner suited to the situation inside the vehicle. Therefore, according to this embodiment, it is possible to improve the readability of the two-dimensional code 35.

[0059] [4 Variations] Although the embodiments of the present disclosure have been described in detail above, the above description is merely an example of the present disclosure in every respect. The processes and means described in the present disclosure can be freely combined and implemented as long as no technical contradiction occurs. Various improvements or modifications may be made to the above embodiments as appropriate. [Explanation of symbols]

[0060] 1...In-vehicle device, 11...control unit, 12...storage unit, 141...display, 20...Captured image, 25...Current situation, 30...Display format, 35...Two-dimensional code, T...vehicle, U...user, CA...imaging device, RD...reading device

Claims

1. Acquiring a captured image from an imaging device disposed facing the interior of the vehicle; Identifying a current situation of a user in a vehicle by analyzing the acquired captured image; determining a display format of the two-dimensional code according to the identified current situation; and and displaying the two-dimensional code on a display in accordance with the determined display format. In-vehicle device.

2. the current situation includes the user's relative position with respect to the display; the display format includes a setting of a display position on the display; determining the display format includes determining a display position of the two-dimensional code within the user-side area in accordance with the relative position; The in-vehicle device according to claim 1 .

3. When there are multiple users in the vehicle, identifying the current status of the user includes identifying the current status of a user who holds a reader for the two-dimensional code among the multiple users. The in-vehicle device according to claim 2 .

4. the current situation includes whether the user is pointing the reading device at the display; the display format includes setting a size of the two-dimensional code; determining the display format includes determining to enlarge the size of the two-dimensional code when the user points the reading device toward the display; The in-vehicle device according to claim 3 .

5. A program for causing an in-vehicle device to execute an information processing method, The information processing method includes: Acquiring a captured image from an imaging device disposed facing the interior of the vehicle; Identifying a current situation of a user in a vehicle by analyzing the acquired captured image; determining a display format of the two-dimensional code according to the identified current situation; and displaying the two-dimensional code on a display in accordance with the determined display format; Including, program.

Images