Information processing device and vehicle

Abstract

To improve travel safety of a vehicle.SOLUTION: An information processing device detects checking operation, operation of visually checking a side portion of a first vehicle, being performed by a driver of the first vehicle and provides control to set transmittance of a window lying in a corresponding direction at a predetermined value if the checking operation is detected. The process improves safety when the vehicle travels.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to a driving assistance function of a vehicle. [Background technology]

[0002] Technologies for electronically controlling the transmittance of automobile windows have been proposed. For example, Patent Document 1 discloses a vehicle system that applies a voltage to an element built into the window glass to change the transmittance according to the situation. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2008-189202 A Summary of the Invention [Problem to be solved by the invention]

[0004] The present disclosure aims to improve the driving safety of vehicles. [Means for solving the problem]

[0005] One aspect of an embodiment of the present disclosure is an information processing device having a control unit that detects when a confirmation action, which is an action of visually checking the side of the first vehicle, is performed by a driver of a first vehicle, and when the confirmation action is detected, performs control to set the transmittance of a window in the corresponding direction to a predetermined value.

[0006] One aspect of an embodiment of the present disclosure is a vehicle having a display device that outputs an image using a window as a medium, and a control device, wherein the display device includes a first unit that outputs the image and a second unit that changes the transmittance of the window, and the control device has a control unit that detects when a driver has performed a confirmation action, which is an action of visually checking the side of the vehicle, and when the confirmation action is detected, controls to set the transmittance of the window in the corresponding direction to a predetermined value.

[0007] Further, other aspects include a method executed by the above-mentioned device, a program for causing a computer to execute the method, or a computer-readable storage medium non-transitoryly storing the program. Effect of the Invention

[0008] According to the present disclosure, the traveling safety of a vehicle can be improved. [Brief description of the drawings]

[0009] [Figure 1] 1 is a schematic diagram of a vehicle system according to a first embodiment. [Diagram 2] FIG. 2 is a diagram for explaining the arrangement position of a display device 110. [Diagram 3] FIG. 3 is a cross-sectional view of glass included in the display device 110. [Figure 4] 1 is a diagram illustrating components of a vehicle 10. FIG. [Diagram 5] FIG. 4 is a top view for explaining visual confirmation by a driver. [Figure 6] FIG. 2 is a diagram for explaining components of a server device 200. [Figure 7] 1 is an example of data stored in an advertisement information database. [Figure 8] 4 is an example of data stored in a vehicle information database. [Figure 9] 1 is an example of data stored in a driving history database. [Figure 10]FIG. 4 is a sequence diagram of a process in which the in-vehicle device transmits information to the server device. [Figure 11] 6 is a flowchart of a process in which the server device distributes an advertisement to the vehicle-mounted device. [Figure 12] 5 is a flowchart of a process in which the in-vehicle device outputs an advertisement. [Figure 13] 11 is a flowchart of a process for temporarily suspending advertisement output based on the driver's face direction. [Figure 14] 11 is a flowchart of a process for temporarily suspending advertisement output based on the operating status of a turn signal. [Figure 15] An example of data defining the relationship between the vehicle state and the windows to be controlled. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] There is glass that can adaptively change its transmittance. For example, there is known a sheet of glass that can dynamically change its darkness by applying a voltage to a built-in element. By applying this to car windows, it will be possible to appropriately block direct sunlight depending on the situation.

[0011] Such glass can be used for more than just sun protection. For example, there is a technology that incorporates a display panel that acts as a display in the window glass and outputs images. By sandwiching the display panel between two pieces of glass with variable transmittance, it is possible to switch between a mode in which images are projected toward the outside of the vehicle and a mode in which images are projected toward the outside of the vehicle. This makes it possible to display advertisements while driving, and to provide information and entertainment to passengers inside the vehicle. The window glass with variable transmittance can be mainly installed in the rear seats.

[0012] However, if the transmittance of the window glass is reduced, it becomes difficult to see outside the vehicle from inside the vehicle, which may hinder the driver from visually checking when changing lanes or turning right or left.

[0013] In order to solve this problem, it is preferable to appropriately control the transmittance of the window glass depending on the driving conditions of the vehicle. The information processing device according to the present disclosure solves such a problem.

[0014] An information processing device according to one aspect of the present disclosure is characterized in that it has a control unit that detects that a confirmation action has been performed by a driver of a first vehicle, which is an action of visually checking the side of the first vehicle, and when the confirmation action is detected, performs control to set the transmittance of a window in the corresponding direction to a predetermined value.

[0015] The checking action is an action of directly checking the side of the vehicle by visual inspection. The checking action is performed, for example, by a passenger (driver) seated in the driver's seat. The side of the vehicle includes not only the area directly to the side of the vehicle, but also the area diagonally rearward of the vehicle. When the driver performs a checking operation, it is necessary for the driver to see outside the vehicle through the window glass from inside the vehicle. Therefore, when the control unit detects the checking operation, it performs control to set the transmittance of the window in the corresponding direction (i.e., the direction in which the driver is trying to look) to a predetermined value. The predetermined value is preferably a value that does not impede the driver's view of the outside of the vehicle. For example, if the transmittance of the target window is set low for the purpose of blocking the sun, this can be temporarily cancelled to allow the outside of the vehicle to be seen from inside the vehicle, thereby ensuring safety.

[0016] The windows of the first vehicle may be capable of outputting video images. Also, the windows may be of a type that reduces transmittance when video images are output. If the target window is the type that projects images by reducing transmittance, the transmittance can be increased by stopping the output of the image.

[0017] The control unit may detect the checking action by a camera that captures the face of the driver. For example, the control unit can detect that the driver is about to perform the checking action by an in-car camera for preventing drowsy driving.

[0018] Furthermore, the control unit may detect a sign of a checking operation based on data acquired from the vehicle platform, and in response thereto, preliminarily change the transmittance of the window glass. The sign of a checking operation may be determined based on the operating state of a turn signal, for example. For example, when the right (left) turn signal is operated, the transmittance of the right (left) window may be set to a predetermined value. According to this embodiment, it is possible to quickly create a transparent state of the window glass without waiting for detection of a checking operation.

[0019] Furthermore, the vehicle state may be associated with the windows for which control to change the transmittance is performed, and this may be used to determine the windows for which the transmittance is to be changed. For example, when the vehicle is parked, the output of the image should not be stopped even if the driver turns around. In this way, the window whose transmittance should be changed can be determined based on the state of the vehicle.

[0020] Specific embodiments of the present disclosure will be described below with reference to the drawings. Unless otherwise specified, the hardware configuration, module configuration, functional configuration, and the like described in each embodiment are not intended to limit the technical scope of the disclosure to only those.

[0021] First Embodiment An overview of a vehicle system according to a first embodiment will be described with reference to Fig. 1. The vehicle system according to this embodiment includes a vehicle 10 equipped with an in-vehicle device 100 and a display device 110, and a server device 200.

[0022] The vehicle 10 is an automobile equipped with a plurality of display devices 110, and can display advertisements via the display devices 110 based on advertisement content received from the server device 200. In this embodiment, displaying an advertisement means outputting image data or the like to the display devices 110 and displaying a still image or a moving image. The vehicle 10 can receive advertising content data (advertising data) distributed from the server device 200, and output the advertising content, such as still images, slide shows, and moving images, to the outside of the vehicle 10 via the multiple display devices 110.

[0023] The display device 110 is a display device built into a window glass. Fig. 2 is a diagram for explaining the installation position of the display device 110. Note that, in this example, the display device 110 is illustrated as being installed on the left side of the rear of the vehicle, but the display device 110 may be installed on the right side of the rear of the vehicle. Also, the display device 110 may be installed at the rear of the vehicle.

[0024] The display device 110 can be configured using a liquid crystal display such as an LCD (Liquid Crystal Display), an organic EL (Electro-Luminescence) display, an LED matrix (Light Emitting Diode), a projector, or the like.

[0025] In this embodiment, the display device 110 includes a transmissive display panel and a light control glass capable of changing the transmittance. Fig. 3 is a diagram showing a cross section of a window glass. As shown in the figure, the window glass of the vehicle 10 is configured by sandwiching a transmissive display panel 3 (first unit) between two sheets of light control glass 3A and 3B (second units). For example, when it is desired to project an image toward the outside of the vehicle, the transmittance of the light-control glass 3A is maximized and the transmittance of the light-control glass 3B is minimized. The transmittance of the light control glass 3A is set to a minimum, and the transmittance of the light control glass 3B is set to a maximum. In this embodiment, when the transmittance is set to a maximum, the glass becomes the most transparent, and when the transmittance is set to a minimum, the glass becomes the most opaque. This allows images to be projected in any direction. In either case, while an image is being output, the visibility from inside the vehicle to the outside of the vehicle decreases compared to when no image is being output.

[0026] The in-vehicle device 100 receives advertisement data from the server device 200 and controls the display device 110 to output the advertisement. Furthermore, the in-vehicle device 100 detects that the driver is about to visually check the side of the vehicle, and temporarily halts the output of advertisements by the display device 110 built into the window glass in the corresponding direction. This increases the transmittance of the window glass, thereby ensuring the driver's visibility. In the following description, the action of the driver visually checking the side of the vehicle will be referred to as a checking action.

[0027] Each element that makes up the system will be explained. The vehicle 10 is a connected car having a communication function with an external network. The vehicle 10 includes an in-vehicle device 100 and a plurality of display devices 110. Although a single in-vehicle device is illustrated in FIG. 1, the vehicle 10 may include a plurality of in-vehicle devices or ECUs.

[0028] 4 is a diagram illustrating components of the vehicle 10 according to this embodiment. The vehicle 10 according to this embodiment includes an in-vehicle device 100, a display device 110, and a sensor group 120.

[0029] First, the display device 110 will be described. In this embodiment, the vehicle 10 is configured to have a plurality of display devices 110 arranged facing the outside of the vehicle, as shown in Fig. 2. In this embodiment, the display devices 110 are arranged on the left and right windows of the rear seats. In the description of the embodiment, the display device arranged on the left side in the traveling direction is referred to as display device 110L, and the display device arranged on the right side in the traveling direction is referred to as display device 110R. The display device 110 is typically a liquid crystal display, but can also be configured using an organic EL display, an LED matrix, a projector, or the like. Although FIG. 3 shows only the display panel and the light control glass, the display device 110 may include a unit that controls the output of an image, the transmittance of the light control glass, and the like.

[0030] The number of display devices 110 may differ depending on the type or model of the vehicle 10. The display devices 110 may be arranged in a plurality of positions, for example, on the left side, right side, rear of the vehicle, and the like. As described above, the display device 110 reduces the transmittance of the window glass while an image is being output. In other words, while an image is being output, the visibility from inside the vehicle to outside the vehicle decreases.

[0031] Next, the in-vehicle device 100 will be described. The vehicle-mounted device 100 is a device that controls the output of advertisements using the display device 110. The vehicle-mounted device 100 receives advertisement data from the server device 200, and controls the output of advertisements based on the received advertisement data. Furthermore, the in-vehicle device 100 detects, based on the result of sensing the driver, that the driver is about to visually check outside the vehicle. In order to improve visibility from inside the vehicle to the outside, control is performed to temporarily stop the output of advertisements.

[0032] The in-vehicle device 100 may be a device (for example, a car navigation device) that provides information to a vehicle occupant. The in-vehicle device 100 is also called a car navigation device, an infotainment device, or a head unit. The in-vehicle device 100 can provide navigation and entertainment to the vehicle occupant. The in-vehicle device 100 has a function of performing wireless communication with an external network. The in-vehicle device 100 may have a function of downloading traffic information, road map data, music, videos, and the like by communicating with an external network of the vehicle 10. The in-vehicle device 100 may also be a device that can be linked with a smartphone or the like.

[0033] The in-vehicle device 100 can be configured as a computer having a processor such as a CPU or GPU, a main memory such as a RAM or ROM, and an auxiliary memory such as an EPROM, a hard disk drive, or a removable medium. The auxiliary memory stores an operating system (OS), various programs, various tables, etc., and by executing the programs stored therein, various functions that match a predetermined purpose, as described below, can be realized. However, some or all of the functions may be realized by hardware circuits such as ASIC or FPGA.

[0034] The in-vehicle device 100 includes a control unit 101, a storage unit 102, a communication unit 103, an input / output unit 104, a wireless communication unit 105, and a position information acquisition unit 106.

[0035] The control unit 101 is a calculation unit that executes a predetermined program to realize various functions of the in-vehicle device 100. The control unit 101 may be realized by, for example, a CPU. The control unit 101 is configured to have two functional modules: an advertisement output unit 1011 and a determination unit 1012. Each functional module may be realized by executing a stored program by a CPU.

[0036] The advertisement output unit 1011 acquires data (advertisement data) relating to the advertisement content to be output to the display device 110 from the server device 200, and controls the output. The advertisement data is preferably acquired immediately before the vehicle 10 starts traveling or while the vehicle 10 is traveling, but is not limited to this. For example, the advertisement data can be acquired when the ignition is turned on, when the destination is set, or when the vehicle starts traveling. The advertisement output unit 1011 may transmit information about the vehicle to the server device 200 in order to obtain appropriate advertisement data.

[0037] Furthermore, advertisement output unit 1011 outputs images and the like included in the advertisement data to display device 110. Note that, when conditions for outputting advertisement content are set, advertisements may be output only when the conditions are met.

[0038] The determination unit 1012 detects a confirmation action by the driver of the vehicle 10. FIG. 5 is a top view of a traveling vehicle 10. As shown in the figure, the driver of the vehicle 10 may turn his head to directly visually check the side of the vehicle. However, if a display device (display device 110L in this example) is outputting an advertisement, the visibility from inside the vehicle to the outside may be obstructed. The determination unit 1012 determines that the driver is looking at the side of the vehicle based on the direction of the driver's face, and in such a case, performs control to temporarily stop the output of the advertisement. In the example shown in FIG. 5, since the driver is facing rear to the left, the output of the advertisement output on display device 110L located at the rear left is temporarily stopped. As a result, the corresponding position It is possible to improve the transmittance of the window glass in the vicinity of the glass substrate, thereby improving visibility.

[0039] The storage unit 102 includes a main storage device and an auxiliary storage device. The main storage device is a memory in which the programs executed by the control unit 101 and data used by the control programs are expanded. The auxiliary storage device is a device in which the programs executed by the control unit 101 and data used by the control programs are stored. The auxiliary storage device may store an operating system for executing the programs. The programs stored in the auxiliary storage device are loaded into the main storage device and executed by the control unit 101, thereby realizing the above-mentioned functions. The storage unit 102 also stores data of advertisement content received from the server device 200 (advertisement data 102A).

[0040] The communication unit 103 is a communication interface that connects the in-vehicle device 100 to a bus of an in-vehicle network.

[0041] The input / output unit 104 is a means for accepting an input operation performed by a user and presenting information to the user. Specifically, it is composed of a touch panel and its control means, and a liquid crystal display and its control means. In this embodiment, the touch panel and the liquid crystal display are composed of one touch panel display. The input / output unit 104 may include a unit for outputting sound (an amplifier and a speaker), a unit for inputting sound (a microphone), etc.

[0042] The wireless communication unit 105 includes an antenna and a communication module for wireless communication. The antenna is an antenna element for inputting and outputting wireless signals. In this embodiment, the antenna is suitable for mobile communication (e.g., mobile communication such as 3G, LTE, and 5G). The antenna may be configured to include multiple physical antennas. For example, when performing mobile communication using radio waves in a high frequency band such as microwaves and millimeter waves, multiple antennas may be distributed and arranged to stabilize communication. The communication module is a module for performing mobile communication.

[0043] The location information acquisition unit 106 includes a GPS antenna and a positioning module for measuring location information. The GPS antenna is an antenna that receives a positioning signal transmitted from a positioning satellite (also called a GNSS satellite). The positioning module is a module that calculates location information based on the signal received by the GPS antenna.

[0044] The display device 110 is a display device built into the window glass of the vehicle 10. As described with reference to FIG. 3, the display device 110 is composed of a transmissive display 3 and two light control glasses 3A and 3B. For example, by minimizing the transmittance of the light control glass 3A and maximizing the transmittance of the light control glass 3B, the image displayed on the transmissive display can be provided to the outside of the vehicle. Also, by maximizing the transmittance of the light control glass 3A and minimizing the transmittance of the light control glass 3B, the image displayed on the transmissive display can be provided to the inside of the vehicle. In this embodiment, the display device 110 is composed of a display device 110L installed on the rear glass on the left side in the traveling direction and a display device 110R installed on the rear glass on the right side in the traveling direction.

[0045] In this embodiment, a transmissive display is used as an example of a means for displaying an image, but an image may be projected by a projector or the like installed in the vehicle. In this case, the light control glass functions as a screen.

[0046] The sensor group 120 includes a plurality of sensors that the vehicle platform has. In this embodiment, the sensor group 120 includes a sensor that detects the direction of the driver's face (hereinafter, a face direction sensor) and a sensor that detects the operation state of a turn signal (hereinafter, a turn signal sensor). . The face direction sensor may include, for example, a camera installed facing the driver's seat, and may include a unit that performs image processing on an image captured by the camera and calculates the angle of the driver's face. The turn signal sensor is a device that senses the operating state of the turn signals of the vehicle 10 (for example, whether the left turn signal or the right turn signal is on).

[0047] The network bus is a communication bus that constitutes an in-vehicle network. Although one bus is illustrated in this example, the vehicle 10 may have two or more communication buses. The multiple communication buses may be connected to each other by a gateway that manages the multiple communication buses.

[0048] Next, the server device 200 will be described. The server device 200 is a device that distributes advertisement data to the vehicle 10 (the in-vehicle device 100).

[0049] FIG. 6 is a diagram showing in detail components of the server device 200 included in the vehicle system according to this embodiment.

[0050] The server device 200 can be configured as a computer having a processor such as a CPU or GPU, a main storage device such as a RAM or ROM, and an auxiliary storage device such as an EPROM, a hard disk drive, or a removable medium. The auxiliary storage device stores an operating system (OS), various programs, various tables, and the like, and the programs stored therein are loaded into a working area of ​​the main storage device and executed. Each component is controlled through the execution of the programs, thereby realizing each function that matches a predetermined purpose, as described below. However, some or all of the functions may be realized by a hardware circuit such as an ASIC or an FPGA.

[0051] The server device 200 includes a control unit 201 , a storage unit 202 , and a communication unit 203 . The control unit 201 is a calculation device that manages the control performed by the server device 200. The control unit 201 can be realized by a calculation processing device such as a CPU. The control unit 201 is configured to have two functional modules: an advertisement distribution unit 2011 and a vehicle management unit 2012. Each functional module may be realized by causing a CPU to execute a program stored in an auxiliary storage unit.

[0052] The advertisement distribution unit 2011 determines advertisements to be displayed in one or more vehicles 10 under the management of the system, and transmits corresponding advertisement data to the vehicles 10. The vehicles to which the advertisements are to be distributed are determined based on information collected by a vehicle management unit 2012, which will be described later. The vehicle management unit 2012 periodically communicates with a plurality of vehicles 10 to collect information on each vehicle. The information on the vehicles 10 includes, for example, information on the vehicles themselves (hereinafter, vehicle information) and information on the running of each vehicle (hereinafter, running history information).

[0053] The storage unit 202 includes a main storage device and an auxiliary storage device. The main storage device is a memory in which the programs executed by the control unit 201 and data used by the control programs are expanded. The auxiliary storage device is a device in which the programs executed by the control unit 201 and data used by the control programs are stored. The main storage device and the auxiliary storage device are similar to those of the storage unit 102, and therefore detailed description thereof will be omitted.

[0054] Furthermore, the storage unit 202 stores an advertisement information database 202A, a vehicle information database 20 2B, and a driving history database 202C. The advertisement information database 202A is a database that stores data (advertising data) related to advertisements to be distributed to the vehicle 10. These data are generated by advertisers. The vehicle information database 202B is a database that stores data related to the attributes and characteristics of the vehicle 10. This data is generated when the vehicle 10 is registered in the system. The driving history database 202C is a database that stores the driving history of the vehicle 10. The driving history includes, for example, the routes and locations traveled by the vehicle 10, the display status of advertisements, and identifiers of advertisements currently being displayed. These data are updated as needed based on information received from the vehicle 10.

[0055] These databases are constructed by a database management system (DBMS) program executed by a processor that manages data stored in a storage device. The database used in this embodiment is, for example, a relational database.

[0056] Here, the data stored in the advertisement information database 202A will be described with reference to Fig. 7. Fig. 7 is an example of the data stored in the advertisement information database 202A. As shown in the figure, the advertisement information database 202A stores an advertisement identifier (advertising ID), information related to the genre and attributes of the advertisement, information related to the conditions for displaying the advertisement, information specifying the requirements of the vehicle on which the advertisement is to be displayed, content data, etc. The content data is, for example, still image data, continuous image data, or moving image data. Each record stored in the advertisement information database 202A is referred to as advertisement data.

[0057] Next, data stored in the vehicle information database 202B will be described with reference to Fig. 8. Fig. 8 is an example of data stored in the vehicle information database 202B. The vehicle information database 202B stores information about the vehicle type and display devices. The information about the display devices includes, for example, the number of display devices, installation positions, display areas, and the like, but may also include other information.

[0058] Next, data stored in the driving history database 202C will be described with reference to Fig. 9. Fig. 9 is an example of data stored in the driving history database 202C. The driving history database 202C stores a vehicle identifier (vehicle ID), date and time, location information of the vehicle 10 (e.g., latitude and longitude), traveling direction, speed, advertisement output state, advertisement identifier (advertisement ID), etc. The advertisement output status is information that indicates the display status of the advertisement, such as, for example, "outputting", "not outputting", etc. If the advertisement is not displayed for some reason, such as the vehicle 10 being driven outside the area designated by the advertiser, or being driven outside the designated time period, the reason may be included in the field. The use of the data stored in the database will be described later.

[0059] The communication unit 203 is a communication interface for connecting the server device 200 to a network. The communication unit 203 includes, for example, a network interface board and a wireless communication interface for wireless communication.

[0060] 4 and 6 are merely examples, and all or part of the functions shown in the figures may be executed using specially designed circuits. Furthermore, programs may be stored or executed using a combination of a main memory device and an auxiliary memory device other than those shown in the figures.

[0061] Next, a process in which the server device 200 distributes an advertisement to the vehicle 10 will be described.

[0062] First, in step S11, the in-vehicle device 100 (advertisement output unit 1011) acquires the position information of the vehicle via the position information acquisition unit .

[0063] In step S12, the in-vehicle device 100 (advertisement output unit 1011) transmits the advertisement display status and the vehicle's position information to the server device. The advertisement display status includes information indicating whether the vehicle 10 is outputting an advertisement. For example, if the vehicle 10 is outputting an advertisement, an identifier of the advertisement, an output status, etc. are transmitted to the server device. Note that in this step, the in-vehicle device 100 may obtain information related to driving (e.g., speed, direction of travel, etc.) and transmit it to the server device 200 at the same time. In step S13, the server device 200 (vehicle management unit 2012) stores the received information in the driving history database 202C.

[0064] 11 is a flowchart of a process in which the server device 200 distributes an advertisement to the vehicle 10. The illustrated process is executed periodically. First, in step S21, the advertisement distribution unit 2011 acquires advertisement data recorded in the advertisement information database 202A. Next, in step S22, it is determined whether or not there is an advertisement that matches the conditions among the acquired advertisement data. For example, if there is an advertisement whose designated display time period matches the current date and time, the determination in step S22 is positive. If there is a matching advertisement, the corresponding record is temporarily stored in a predetermined area of ​​the storage unit 202.

[0065] Next, in step S23, the advertisement distribution unit 2011 refers to the vehicle information database 202B and extracts vehicles that match the extracted advertisement. In this step, vehicles that match the requirements specified in the advertisement data (e.g., vehicle type, display device position, display device area, driving area, etc.) are extracted. Next, in step S24, the advertisement distribution unit 2011 transmits advertisement data to the extracted vehicles.

[0066] FIG. 12 is a flowchart of the process executed by the vehicle-mounted device 100 (advertisement output unit 1011) that receives the advertisement data. First, in step S31, the current situation is compared with the conditions set in the received advertisement data to determine whether or not to display an advertisement. For example, if the advertisement data specifies that the advertisement is to be displayed only in a specific area, the advertisement display unit 106 compares the conditions for that area with the location information acquired via the location information acquisition unit 106 to determine whether or not to display the advertisement. If the advertisement data specifies that the advertisement is to be displayed only during a specific time period, the advertisement display unit 106 compares the conditions for that time period with the current date and time to determine whether or not to display the advertisement. Here, the area and time period are exemplified as conditions for determining whether or not to display the advertisement, but other conditions may be used as long as they can be determined in the vehicle 10.

[0067] As a result of the determination made in step S31, if the condition is met (step S32-Yes), the process proceeds to step S33, and advertisement output is started (or continued if the advertisement is already being output). Note that, if the vehicle 10 stores multiple advertisement data, the advertisement to be output may be selected according to a predetermined condition. If the condition is not met (step S32-No), the process proceeds to step S34, where the advertisement output is terminated. Through the above-described processing, advertisements are posted by the vehicle 10.

[0068] The advertisement is displayed by outputting an image to the transmissive display 3 of the display device 110. At this time, the in-vehicle device 100 executes a process to reduce the transmittance of the light control glass 3A. This makes the image visible from outside the vehicle 10.

[0069] On the other hand, as described above, when the transmittance of the light control glass decreases, it becomes difficult to see the outside of the vehicle from inside the vehicle, which may affect safety confirmation. Therefore, the in-vehicle device 100 executes a process to temporarily stop outputting advertisements and ensure visibility based on the direction of the driver's face (hereinafter, face direction). FIG. 13 is a flowchart of this process. This process is periodically executed by the determination unit 1012 while the vehicle 10 is traveling.

[0070] First, in step S41, the face direction of the driver is determined using a face direction sensor included in the sensor group. In step S42, it is determined whether the driver is performing a confirmation action. If the driver's face is facing diagonally backward from the vehicle, it can be determined that the driver is performing a confirmation action. In this case, the process proceeds to step S43.

[0071] In step S43, the advertisement output unit 1011 judges whether or not an advertisement is being output. If the judgment in this step is positive, the process proceeds to step S44, and advertisement output using the window glass in the corresponding direction is temporarily stopped. For example, when the driver is checking the right side in the traveling direction, advertisement output to the display device 110R is stopped. Also, when the driver is checking the left side in the traveling direction, advertisement output to the display device 110L is stopped. At this time, the judgment unit 1012 controls the light control glass 3A to improve the transmittance. The control to change the transmittance may be executed by the in-vehicle device 100 as described in this example, or may be executed by a control unit built into the display device 110. Here, improving the transmittance means setting the transmittance within a predetermined range that does not impede safety confirmation.

[0072] If the determination in step S42 is negative, that is, if the driver has not visually checked the sides of the vehicle, the process proceeds to step S45. In step S45, it is determined whether or not the output of the advertisement is paused. If the output of the advertisement is paused by executing step S44, the determination in this step is affirmative, and the process proceeds to step S46. In step S46, the output of the advertisement that was paused is resumed. If the determination in step S45 is negative, the process ends.

[0073] As described above, when the driver is visually checking the sides of the vehicle and an advertisement is being output using the window glass, the in-vehicle device 100 according to the first embodiment temporarily stops output of the advertisement and increases the transmittance of the window glass. With this configuration, it is possible to ensure safety while the vehicle is traveling.

[0074] Second Embodiment In the first embodiment, it is determined that the driver is performing a confirmation action based on the driver's facial direction. However, since there is a time lag between when the driver's facial direction is sensed and when the transmittance of the window glass changes, in this embodiment, there is a risk that a period of time will occur during which the driver's visual confirmation is hindered. To address this, in the second embodiment, it is predicted that the driver of the vehicle will perform a confirmation action based on data (first data) acquired from the vehicle platform, and the output of the advertisement is stopped in advance.

[0075] In the second embodiment, the determination unit 1012 obtains data from a turn signal sensor included in the sensor group 120, and predicts that a confirmation action for changing lanes or turning right or left will occur when the turn signal of the vehicle is activated. The activation of the turn signal of the vehicle can be regarded as a sign of the confirmation action. 14 is a flowchart of the process executed by the in-vehicle device 100 in the second embodiment. The process is periodically executed by the determination unit 1012 while the vehicle 10 is traveling. Processes similar to those in the first embodiment are indicated by dotted lines, and detailed explanations are omitted. Note that the process is executed in parallel with the process shown in FIG.

[0076] First, in step S51, the operation state of the turn signal is determined based on data acquired from the turn signal sensor. The state can be, for example, one of three states: "right turn signal in operation," "left turn signal in operation," and "not in operation."

[0077] Next, in step S52, it is determined whether or not a confirmation operation is predicted. This determination may be made by using other sensor data acquired from the vehicle platform or an in-vehicle device (such as a navigation device). For example, if the left turn signal is on before an intersection, a confirmation operation to prevent being hit is predicted. On the other hand, if the right turn signal is on near the center of the intersection, it is highly likely that a confirmation operation will not be performed (in both cases, when driving on the left side). In addition, whether or not a confirmation operation is performed may vary depending on the speed of the vehicle 10. In this step, the determination may be made using data that correlates the state of the vehicle 10 determined based on sensor data acquired from the vehicle platform and the predicted result of the checking operation. Such data may be a table, a machine learning model, or the like.

[0078] If the determination in step S52 is positive, the process proceeds to step S43, and control is performed to temporarily suspend the output of the advertisement in the same manner as in the first embodiment. If the determination in step S52 is negative, the process proceeds to step S45, where control is performed to resume advertisement output in the same manner as in the first embodiment.

[0079] According to the second embodiment, the control for temporarily suspending the output of the advertisement is performed based on the state of the turn signal of the vehicle 10 in addition to the direction of the driver's face. With this configuration, it becomes possible to reduce the transmittance of the window glass prior to the confirmation operation, thereby reducing the sense of discomfort felt by the driver.

[0080] If the driver's facial direction does not change (no confirmation action is detected) even after a predetermined time has elapsed since the output of the advertisement was stopped, a negative determination may be made in step S52 and the output of the advertisement may be resumed. In this embodiment, the advertisement output is stopped as in the first embodiment, but if a preparatory operation for improving the visibility from inside the vehicle to the outside can be performed, it is not necessary to completely stop the advertisement output. For example, the transmittance of the window glass may be slightly reduced while the advertisement is still output.

[0081] 13 and 14 are executed in parallel (in other words, the advertisement output is stopped when either condition is satisfied), but the advertisement output may be stopped when both conditions are satisfied. That is, the advertisement output may be stopped when both of the following conditions are satisfied: (1) the turn signal is on and (2) the driver's face is facing diagonally backward.

[0082] Third embodiment In the first and second embodiments, when the driver's face is facing diagonally backward, the advertisement output is unconditionally stopped. On the other hand, in a situation where visual confirmation is not required, there are cases where the advertisement output should not be stopped even if the driver is facing to the side or rear. For example, when the shift position is in park, etc., when it is expected that the vehicle 10 will not depart immediately, the advertisement output should not be stopped even if the driver's face is facing to the side or rear.

[0083] In the third embodiment, in order to deal with this, it is determined whether or not to stop outputting the advertisement based on the state of the vehicle 10. In the third embodiment, the storage unit 102 stores data associating the state of the vehicle 10 with the window to be controlled. In this embodiment, a display device is also built into the window glass at the rear of the vehicle 10. FIG. 15 is an example of such data (second data). In this example, for example, if the vehicle's shift position is "parking", control is not performed to stop advertisements on all windows. Also, if the vehicle's shift position is "drive", control is performed to stop advertisements on windows other than the rear window. If the vehicle's shift position is "reverse", control is performed to stop advertisements on all windows. Note that in this example, only the shift position is exemplified as the state of the vehicle 10, but other information such as the vehicle speed and the state of the parking brake may also be used in combination.

[0084] The determination regarding the state of the vehicle 10 can be performed by the determination unit 1012, for example, before executing the process of step S41 (or S51). If there is a window that is not a control target, the process of step S44 is skipped for that window.

[0085] In this way, according to the third embodiment, it is possible to provide exceptions to the control for stopping the output of advertisements, and to prevent the stopping of useless advertisements.

[0086] (Modification) The above-described embodiment is merely an example, and the present disclosure can be modified and implemented as appropriate without departing from the spirit and scope of the present disclosure. For example, the processes and means described in this disclosure can be freely combined and implemented as long as no technical contradiction occurs.

[0087] In addition, in the description of the embodiment, an example was given of changing the transmittance of the window glass installed in the rear seat of the vehicle, but the transmittance of other window glass may also be changed if permitted by the legal system. Furthermore, the change in transmittance does not have to be made to the entire surface of the window glass, but may be made to only a part of it.

[0088] In addition, in the description of the embodiment, a vehicle that outputs advertisements using the display device 110 has been exemplified, but the present invention can be applied to other vehicles as long as the vehicle is capable of dynamically changing the transmittance of the window glass. For example, an example of such a vehicle is a vehicle in which the transmittance of the window glass can be changed for the purpose of providing shade.

[0089] In addition, in the description of the embodiment, a vehicle in which an image is projected to the outside of the vehicle by reducing the transmittance of the light control glass 3A has been exemplified, but it is also possible to project an image (for entertainment, for example) to the inside of the vehicle by reducing the transmittance of the light control glass 3B. In such a vehicle, the same effect can be obtained by controlling the transmittance of the light control glass.

[0090] In addition, the processing described as being performed by one device may be shared and executed by multiple devices. Alternatively, the processes described as being performed by different devices may be executed by a single device. In a computer system, the hardware configuration (server configuration) by which each function is realized can be flexibly changed.

[0091] The present disclosure can also be realized by supplying a computer program implementing the functions described in the above embodiments to a computer, and having one or more processors of the computer read and execute the program. Such a computer program may be provided to the computer by a non-transitory computer-readable storage medium connectable to the system bus of the computer, or may be provided to the computer via a network. Non-transitory computer-readable storage media include, for example, any type of disk, such as a magnetic disk (floppy disk, hard disk drive (HDD), etc.), an optical disk (CD-ROM, DVD disk, Blu-ray disk, etc.), a read-only memory (ROM), a random access memory (RAM), an EPROM, an EEPROM, a magnetic card, a flash memory, an optical card, and any type of medium suitable for storing electronic instructions. [Explanation of symbols]

[0092] 10. Vehicle 100...In-vehicle equipment 110...Display device 120 Sensor group 200 Server device 101, 201...Control unit 102,202...Storage section 103,203···Communications Department 104...Input / output section 105 Wireless communication unit 106...Location information acquisition unit

Claims

1. Detecting that a driver of a first vehicle has performed a confirmation action, which is an action of visually checking a side of the first vehicle; When the checking action is detected, a control is performed to set the transmittance of a window in a corresponding direction to a predetermined value. A control unit that executes the first vehicle has a plurality of windows capable of outputting an image and changing the transmittance; When the control unit detects the checking action while the image is being outputted through one or more windows of the first vehicle, the control unit stops outputting the image through the window in the corresponding direction. Information processing device.

2. when the control unit detects the checking action while the image is being outputted through one or more windows of the first vehicle, the control unit stops outputting the image through the window in the corresponding direction and sets the transmittance of the window in the corresponding direction to the predetermined value. The information processing device according to claim 1 .

3. The control unit detects the confirmation action by a camera that is provided in the first vehicle and captures a face of the driver.

3. The information processing device according to claim 1 or 2.

4. The control unit detects a sign of the confirmation operation based on first data acquired from one or more sensors included in the first vehicle.

3. The information processing device according to claim 1 or 2.

5. When the control unit detects a sign of the checking operation, the control unit sets the transmittance of a window in a direction corresponding to the expected checking operation to the predetermined value. The information processing device according to claim 4.

6. The control unit, when a turn signal provided in the first vehicle is operated, setting the transmittance of the window on the side corresponding to said predetermined value; The information processing device according to claim 5 .

7. The vehicle control system further includes a storage unit configured to store second data associating the window to be controlled with the first vehicle state.

3. The information processing device according to claim 1 or 2.

8. The control unit determines a window to be controlled based on the first vehicle state and the second data. The information processing device according to claim 7.

9. A vehicle having a plurality of windows capable of changing the image output and transmittance, a display device that outputs images using the windows as a medium, and a control device, The display device includes: a first unit for outputting the image and a second unit for changing the transmittance of the window; The control device includes: Detecting that a driver has performed a confirmation action, which is an action of visually checking a side of the vehicle; When the checking action is detected, a control is performed to set the transmittance of the window in the corresponding direction to a predetermined value. A control unit that executes When the control unit detects the checking action while the image is being output through one or more of the windows, the control unit stops output of the image through the window in the corresponding direction. vehicle.

10. when the control device detects the checking action while the image is being output through one or more of the windows, the control device stops output of the image through the window in the corresponding direction and sets the transmittance of the window in the corresponding direction to the predetermined value.

10. The vehicle of claim 9.

11. Further comprising a camera for capturing the face of the driver, The control device detects the confirmation action by the camera. A vehicle according to claim 9 or 10.

12. The control device detects a sign of the confirmation operation based on data acquired from one or more sensors included in the vehicle. A vehicle according to claim 9 or 10.

13. When the control device detects the sign of the checking operation, the control device sets the transmittance of a window in a direction corresponding to the expected checking operation to the predetermined value.

13. A vehicle as claimed in claim 12.

14. When a turn signal provided in the vehicle is activated, the control device sets the transmittance of a window on a side corresponding to the turn signal to the predetermined value.

14. A vehicle as claimed in claim 13.

15. When the control device detects the checking operation while a turn signal of the vehicle is in operation, the control device sets the transmittance of the window in the corresponding direction to the predetermined value. A vehicle according to claim 9 or 10.

16. The vehicle control system further includes a storage unit configured to store second data associating the window to be controlled with a state of the vehicle. A vehicle according to claim 9 or 10.

17. The control device determines a window to be controlled based on the state of the vehicle and the second data.

17. A vehicle as claimed in claim 16.

Images