Information processing apparatus, information processing method, and information processing system

Abstract

The present technology relates to an information processing device, an information processing method, and an information processing system for providing a safe viewing space in a vehicle interior while taking into account vehicle exterior safety. The condition determination unit determines the external condition of the host vehicle on the basis of external information relating to the outside of the host vehicle. A risk level determination unit determines a level of risk at which the video is erroneously recognized from the outside of the host vehicle, on the basis of the determined external condition of the host vehicle and brightness information on the video displayed on a display unit disposed inside the host vehicle. The display control section applies a display limit to the video in accordance with the degree of risk of misrecognition. The present technology is applicable, for example, to a system that provides a video content viewing space to an occupant in a vehicle.

Description

Technical Field

[0001] The present technology relates to an information processing device, an information processing method and an information processing system, and more specifically, to an information processing device, an information processing method and an information processing system for providing a safe viewing space inside a vehicle while taking into account the safety of the vehicle's exterior. Background Art

[0002] In recent years, drivers and passengers can collect various information and watch various videos through in-vehicle display devices installed in cars.

[0003] For example, PTL 1 discloses a technology that detects the direction of a driver's line of sight and controls the brightness of an in-vehicle display device when a state in which the driver is not looking at the in-vehicle display device changes to a state in which the driver is looking at the in-vehicle display device.

[0004] [Citation list]

[0005] [Patent Document]

[0006] [PTL 1] Japanese Patent Publication No. 2012-162126 Summary of the invention

[0007] [Technical issues]

[0008] On the other hand, when the video displayed on the in-vehicle display device is visible from outside the vehicle, drivers of surrounding vehicles traveling behind or to the side of the vehicle may mistakenly recognize the video as a lighting device.

[0009] The present technology has been proposed in view of the above circumstances, and can provide a safe viewing space in the interior of a vehicle while taking the exterior safety of the vehicle into consideration.

[0010] [Solution to the problem]

[0011] According to the present technology, the information processing device includes a condition determination unit, a risk level determination unit and a display control unit. The condition determination unit determines the external condition of the vehicle based on the off-vehicle information about the outside of the vehicle. The risk level determination unit determines the risk level of misidentification of the video from outside the vehicle based on the determined external condition of the vehicle and the brightness information about the video displayed on the display unit arranged inside the vehicle. The display control unit imposes display restrictions on the video according to the risk level of misidentification.

[0012] The information processing method according to the present technology includes determining the external condition of the vehicle based on the off-vehicle information about the outside of the vehicle through an information processing device, determining the degree of risk of misidentification of the video from outside the vehicle based on the determined external condition of the vehicle and the brightness information about the video displayed on a display unit arranged inside the vehicle, and imposing display restrictions on the video according to the degree of risk of misidentification.

[0013] According to the present technology, the information processing system includes a display unit arranged inside the vehicle, a condition determination unit that determines the external condition of the vehicle based on off-vehicle information about the outside of the vehicle, a risk level determination unit that determines the risk level of misidentification of the video from outside the vehicle based on the determined external condition of the vehicle and brightness information about the video displayed on the display unit, and a display control unit that imposes display restrictions on the video according to the risk level of misidentification.

[0014] According to the present technology, the external condition of the vehicle is determined based on the outside information about the outside of the vehicle, the risk level of misidentifying the video from outside the vehicle is determined based on the determined outside condition and the brightness information about the video displayed on the display unit arranged inside the vehicle, and further, display restrictions are imposed on the video based on the risk level of misidentification. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 : is a block diagram depicting a configuration example of an information display / determination system according to the present technology.

[0016] Figure 2 is a flowchart indicating the operation of the information display / determination system.

[0017] Figure 3 This is a block diagram illustrating an example of the configuration of a vehicle exterior condition recognition system.

[0018] Figure 4 This is a block diagram depicting an example configuration of a brightness detection system.

[0019] Figure 5 This is a block diagram depicting an example configuration of a display system.

[0020] Figure 6 is a diagram depicting examples of objects that may be misrecognized.

[0021] Figure 7 is a diagram showing an example of changing the display content.

[0022] Figure 8 is a flowchart indicating the operation of the vehicle exterior condition recognition system.

[0023] Fig. 9 is a flow chart indicating the operation of the brightness detection system.

[0024] Fig.10 is a flowchart indicating the operation of the display system.

[0025] Fig.11 2 is a diagram depicting a first positioning example of the brightness detection section.

[0026] Fig.12 2 is a diagram depicting a second positioning example of the brightness detection section.

[0027] Fig.13 This is a block diagram depicting still another configuration example of the brightness detection system.

[0028] Fig.14 2 is a diagram depicting a third positioning example of the brightness detection section.

[0029] Fig.15 This is a block diagram depicting another configuration example of the brightness detection system.

[0030] Fig.16 This is a block diagram depicting an example of the configuration of a computer. DETAILED DESCRIPTION

[0031] Hereinafter, an embodiment for implementing the present technology (hereinafter, referred to as “embodiment”) will be described. It should be noted that the description will be made in the following order.

[0032] 1. Overall structure and operation of the information display / judgment system

[0033] 2. Details of each system that constitutes the information display / judgment system

[0034] 3. Operation of each system constituting the information display / judgment system

[0035] 4. Example of positioning of the brightness detection unit

[0036] 5. Modifications

[0037] 6. Examples of computer configuration

[0038] <1. Overall structure and operation of information display / judgment system>

[0039] (Configuration of information display / judgment system)

[0040] Figure 1 This is a block diagram illustrating a configuration example of an information display / determination system 1 as an example of an information processing system (information processing apparatus) to which the present technology is applied.

[0041] The information display / determination system 1 can be installed in a vehicle (car) as a mobile body. Inside the vehicle in which the information display / determination system 1 is installed, a display section (display) on which, for example, passengers sitting in a back seat can watch a video is installed. That is, the information display / determination system 1 can provide a video content viewing space for passengers in the vehicle.

[0042] like Figure 1 As shown in , the information display / determination system 1 includes a vehicle exterior condition recognition system 10 , a brightness detection system 20 , a display system 30 , and a content holding unit 40 .

[0043] The vehicle exterior condition recognition system 10 has a function of a condition determination section that determines the exterior condition of the vehicle (host vehicle) in which the information display / determination system 1 is installed. The vehicle exterior condition recognition system 10 determines the exterior condition of the vehicle by using sensors arranged at various parts of the host vehicle or using communication with the outside of the host vehicle, and outputs information indicating the exterior condition of the host vehicle to the brightness detection system 20.

[0044] The brightness detection system 20 has a function of a risk level determination unit that determines the risk level of misidentifying the video from outside the vehicle based on the information obtained from the vehicle exterior condition recognition system 10 (the vehicle exterior condition) and the brightness information about the video displayed on the display unit arranged inside the vehicle (hereinafter, also referred to as the in-vehicle video). The brightness information about the video is obtained by directly measuring the brightness of the display unit, or is obtained from the content of the video provided as the content holding unit 40. Information indicating the risk level of misidentification determined by the brightness detection system 20 is output to the display system 30.

[0045] The display system 30 has a function of a display control unit that controls the display of the in-vehicle video. Specifically, the display system 30 imposes display restrictions on the content (video) provided from the content storage unit 40 based on the information (error recognition risk level) obtained from the brightness detection system 20. The display restrictions imposed on the video include changes in display items in the video, switching of the video, and power control of the light source of the display unit.

[0046] The content holding section 40 is formed as a recording device in which content to be used as the in-vehicle video is held (recorded) If necessary, the content held in the content holding section 40 is read out by the brightness detection system 20 and the display system 30 .

[0047] (Information display / judgment system operation)

[0048] Next, we will refer to Figure 2 The flowchart in illustrates the operation of the information display / determination system 1.

[0049] In step S1 , the vehicle exterior condition recognition system 10 determines the exterior condition of the host vehicle by executing a condition determination process based on vehicle exterior information about the exterior of the host vehicle.

[0050] In step S2 , the brightness detection system 20 determines the risk level of misrecognizing the in-vehicle video from outside the vehicle by performing risk level determination processing based on the vehicle exterior conditions determined by the vehicle exterior condition recognition system 10 and brightness information about the in-vehicle video.

[0051] In step S3 , the display system 30 imposes display restrictions on the in-vehicle video by executing a display control process according to the misrecognition risk level of the in-vehicle video determined by the brightness detection system 20 .

[0052] According to the above processing, even if the video displayed on the display unit inside the vehicle is visible from outside the vehicle, it is possible to prevent the driver of the surrounding vehicle traveling behind or to the side of the vehicle from mistakenly recognizing the video as a lighting device. Thus, while considering the safety of the vehicle's exterior, a safe viewing space inside the vehicle can be provided.

[0053] <2. Details of each system constituting the information display / determination system>

[0054] Next, a detailed configuration example of each system constituting the information display / determination system 1 will be described.

[0055] (Configuration of the vehicle exterior condition recognition system)

[0056] Figure 3 2 is a block diagram showing a configuration example of the vehicle exterior situation recognition system 10 .

[0057] The vehicle exterior condition recognition system 10 includes a sensing unit 110 and a data processing unit 120 .

[0058] The sensing unit 110 acquires vehicle exterior information about the exterior of the vehicle, and provides the vehicle exterior information to the data processing unit 120 as unprocessed primary data.

[0059] The sensing unit 110 includes at least any one of a camera 111, a radar 112, a ToF (time of flight) sensor 113, a LiDAR (light detection and ranging) 114, and an ultrasonic sensor 115 to sense the exterior of the host vehicle. Specifically, the sensing unit 110 provides sensing information obtained by sensing the rear area of ​​the host vehicle as vehicle exterior information to the data processing unit 120.

[0060] The data processing section 120 functions as a situation determination section that determines the external situation of the host vehicle based on secondary data generated by performing predetermined data processing on the primary data (vehicle exterior information) obtained from the sensing section 110 .

[0061] The data processing unit 120 is realized by, for example, a CPU (Central Processing Unit), a microcomputer, or a SoC (System on Chip) on which a memory, etc. is mounted. The data processing unit 120 includes a storage unit 121 , a processing unit 122 , and an analyzing / determining unit 123 .

[0062] In the storage unit 121, the vehicle exterior information obtained from the sensing unit 110 is accumulated. The vehicle exterior information stored in the storage unit 121 is sequentially read out by the processing unit 122.

[0063] The processing unit 122 sequentially reads out the vehicle exterior information stored in the storage unit 121, and performs processing to convert the read data into secondary data that can be processed by the analysis / determination unit 123. Specifically, the processing unit 122 creates information indicating an image of the exterior of the host vehicle, the distance from the host vehicle to the surrounding objects, the absolute speed of the host vehicle and the surrounding objects, or the relative speed between the host vehicle and the surrounding objects based on the vehicle exterior information, and provides the created data to the analysis / determination unit 123 as secondary data.

[0064] It should be noted that the vehicle exterior information is not limited to the sensing information acquired by the sensing unit 110. The processing unit 122 may acquire, as the vehicle exterior information, traffic information about the surroundings of the vehicle acquired through ITS (Information Transmission System) communication or V2X (Vehicle to Everything) communication, and / or vehicle information about other vehicles traveling around the vehicle (e.g., surrounding vehicles traveling behind or to the side of the vehicle) acquired through V2V (Vehicle to Vehicle) communication.

[0065] The analyzing / determining unit 123 determines the conditions outside the vehicle based on the secondary data (image, distance, speed) obtained from the processing unit 122 .

[0066] Specifically, the analysis / determination unit 123 identifies a person who is outside the vehicle and is not a target viewer of the in-vehicle video (hereinafter, referred to as a non-target viewer) based on the image obtained from the processing unit 122. Examples of non-target viewers include pedestrians walking around the vehicle and drivers of surrounding vehicles traveling behind or to the side of the vehicle.

[0067] Furthermore, the analysis / determination section 123 measures the distance to the non-target viewer based on the distance obtained from the processing section 122. Furthermore, the analysis / determination section 123 calculates the relative speed with respect to the non-target viewer based on the speed obtained from the processing section 122. Then, the analysis / determination section 123 determines whether the non-target viewer visually recognizes the in-vehicle video as a condition of the non-target viewer based on the recognition result of the non-target viewer, the distance, and the relative speed.

[0068] The determination result indicating the condition of the non-target viewer (whether the non-target viewer visually recognizes the in-vehicle video) is output to the brightness detection system 20 .

[0069] (Configuration of brightness detection system)

[0070] Figure 4 2 is a block diagram illustrating a configuration example of the brightness detection system 20 .

[0071] The brightness detection system 20 includes a brightness detection unit 210 and a data processing unit 220 .

[0072] The brightness detection unit 210 acquires measurement information by measuring the brightness of the in-vehicle video, and provides the measurement information to the data processing unit 220 as unprocessed primary data.

[0073] The brightness detection unit 210 includes at least one of a camera 211 and a measuring device 212 to measure the brightness of the in-vehicle video. The measuring device 212 is formed by a device capable of measuring brightness, such as a brightness meter, an illuminance meter, a photometer, a power meter, or a calorimeter. For example, the brightness detection unit 210 is arranged on the outside (rear outside) of the vehicle, and provides the measurement information obtained by measuring the brightness of the in-vehicle video through the rear glass of the vehicle as brightness information to the data processing unit 220.

[0074] The data processing unit 220 functions as a risk level determination unit that determines the risk level of misidentifying the in-vehicle video from outside the vehicle based on secondary data generated as a result of prescribed data processing of the primary data (measurement information) provided from the brightness detection unit 210 .

[0075] and the data processing unit 120 ( Figure 3 ), the data processing unit 220 is also implemented by, for example, a CPU, a microcomputer, or a SoC equipped with a memory, etc. The data processing unit 220 further includes a storage unit 221, a processing unit 222, and an analysis / determination unit 223.

[0076] The storage unit 221 stores the measurement information supplied from the brightness detection unit 210. The measurement information stored in the storage unit 221 is sequentially read out by the processing unit 222.

[0077] The processing unit 222 sequentially reads out the measurement information stored in the storage unit 221, and performs processing to convert the measurement information into secondary data that can be processed by the analysis / determination unit 223. Specifically, the processing unit 222 creates information indicating the brightness of the in-vehicle video based on the measurement information, and provides the created information to the analysis / determination unit 223 as secondary data.

[0078] The analysis / determination unit 223 determines the risk level of misidentifying the in-vehicle video from outside the vehicle based on the secondary data (brightness) provided by the processing unit 222.

[0079] Specifically, the analysis / determination unit 223 determines the risk level of misidentifying the in-vehicle video by a non-target viewer based on the determination result (status of non-target viewers) obtained from the out-of-vehicle condition recognition system 10 and the brightness obtained from the processing unit 222.

[0080] More specifically, the analysis / determination unit 223 determines the possibility that the in-vehicle video will be misidentified as a lighting device (e.g., a flash, a side marker light, a tail light, a reverse light, or a brake light) of the vehicle as the misidentification risk level.

[0081] For example, the analysis / determination unit 223 determines whether the color value R (red) (0 ≤ R ≤ 255) and the brightness value Hist (0 ≤ Hist ≤ 255) of each pixel of the in-vehicle video respectively satisfy the criteria of R < x and Hist < y. The values of x and y are determined, for example, according to the lighting regulations specified in the announcement of the details of the Road Vehicle Safety Regulations under the Road Transport Vehicle Law in Japan (e.g., in terms of luminous intensity, 300 cd or less). The values of x and y are variably determined according to the values specified by the regulations of local laws in each region or country.

[0082] In this case, by determining the values of x and y according to the position information indicating the country or region where the vehicle is traveling, the analysis / determination unit 223 determines the possibility that the in-vehicle video will be misidentified as a lighting device of the vehicle. The position information can be obtained by GPS (Global Positioning System) or VPS (Visual Positioning System / Service) based on image measurement of the position, or can be, for example, identification information or position information predefined for roadside equipment for ETC (Electronic Toll Collection System). Alternatively, the position information can be rough position information indicating the country or region based on information pre-registered in a vehicle system including the ECU (Electronic Control Unit) of the vehicle.

[0083] It should be noted that when the values specified in each country or region are updated due to amendments to the law, the values of x and y are also updated to meet the criteria corresponding to the updated values. The update of the values of x and y can be achieved, for example, by directly or via the cloud updating the software running on the device mounted on the vehicle.

[0084] In addition, the analysis / determination unit 223 can determine the possibility that the in-vehicle video will be misidentified as a road sign or a traffic signal as the misidentification risk level. In this case, the analysis / determination unit 223 determines whether the in-vehicle video includes a road sign / traffic signal or an object similar thereto by performing object recognition via machine learning.

[0085] Then, based on the determined risk level of misrecognition, the analyzing / determining section 223 determines a restriction level indicating a display restriction range of the in-vehicle video being displayed by the display system 30. The determination result indicating the restriction level is output to the display system 30.

[0086] (Display system configuration)

[0087] Figure 5 2 is a block diagram depicting a configuration example of the display system 30 .

[0088] The display system 30 includes a data processing unit 310 and a display unit 320 .

[0089] The data processing unit 310 functions as a display control unit, which controls the display of the in-vehicle video based on the content (video signal) provided from the content retention unit 40, and imposes display restrictions on the video based on the restriction level corresponding to the degree of misrecognition risk determined by the brightness detection system 20.

[0090] The data processing unit 310 is realized by, for example, a CPU, a microcomputer, or a SoC equipped with a memory, etc. The data processing unit 310 includes a storage unit 311 , a processing unit 312 , a display event control unit 313 , and a brightness control unit 314 .

[0091] In the storage section 311, the video signal supplied from the content holding section 40 is stored. The video signal accumulated in the storage section 311 is sequentially read out by the processing section 312.

[0092] Here, the content holding section 40 may include not only an in-vehicle multimedia device, a smartphone owned by a passenger, and a storage device in the cloud that can communicate with the vehicle, but also a reproduction device that can reproduce video content and the like.

[0093] The processing section 312 sequentially reads out the video signals stored in the storage section 311, and performs processing to convert the signals into secondary data that can be processed by the display event control section 313 and the brightness control section 314. The processed video signals are provided to the display event control section 313 and the brightness control section 314 as secondary data.

[0094] The display item control unit 313 processes the secondary data (video signal) supplied from the processing unit 312 for changing the display items in the vehicle video according to the restriction level obtained from the brightness detection system 20. The term "display item" covers the brightness, color, shape, etc. of an object contained in the in-vehicle video. That is, the brightness control unit 314 determines the area in the in-vehicle video where the brightness, color, shape, etc. are to be changed, and supplies the video signal obtained by changing the brightness, color, shape, etc. in the determined area to the display unit 320.

[0095] In addition, the display event control unit 313 can switch on / off the display of the in-vehicle video on the display unit 320 by controlling the supply of secondary data (video signal) provided from the processing unit 312 to the display unit 320 according to the restriction level obtained from the brightness detection system 20.

[0096] The brightness control section 314 generates a control signal for controlling the power of the light source of the display section 320 according to the restriction level provided from the brightness detection system 20 and the brightness or color of the object included in the in-vehicle video displayed on the display section 320, and outputs the control signal to the display section 320. Specifically, the brightness control section 314 determines the pixel position (address) to be brightness-controlled in the in-vehicle video, and then generates a control signal for controlling the power of the light source corresponding to the determined pixel position. Alternatively, the brightness control section 314 may generate a control signal for controlling the power of a light source section (generally referred to as a light source of a backlight, a projector, etc.), which controls the brightness of all pixels in the entire screen as a whole.

[0097] It should be noted that any display can be used as the display unit 320 as long as video and information can be indicated on the display, such as a direct-view display, a projector, or a spatial display capable of providing stereoscopic vision or three-dimensional representation. The direct-view display is, for example, a liquid crystal display, an OLED (organic light-emitting diode) display, or an LED display.

[0098] In addition, when the brightness, color, tone or shape of an object contained in the in-car video displayed on the display unit 320 is changed, or when the display of the in-car video on the display unit 320 is turned off, a notification using a message, sound or icon can be issued in advance to the passengers watching the in-car video.

[0099] Here, the object whose display item is changed by the display item control unit 313 or whose brightness is controlled by the brightness control unit 314 is an object that is highly likely to be erroneously recognized by non-target viewers.

[0100] Figure 6 Describe examples of objects that are most likely to be misidentified.

[0101] As an object that is very likely to be misidentified, Figure 6 A in OBJ1L indicates a pair of objects OBJ1L and OBJ1R, which are the taillights of the vehicle itself or similar thereto. As objects that are highly likely to be misidentified, Figure 6 B in the figure indicates an object OBJ2, which is a road sign indicating "No Entry" itself or a similar object. As an object that is highly likely to be misidentified, Figure 6C in OBJ3 indicates an object OBJ3 that is a road sign indicating "drive only in the direction of the arrow" or something similar. As an object that is highly likely to be misidentified, Figure 6 D in the figure indicates an object OBJ4 which is a traffic light itself or is similar thereto.

[0102] It should be noted that objects that are likely to be misidentified are not limited to Figure 6 Such objects may be any other road sign, any other type of traffic light, objects similar thereto, or objects such as text, logos, advertisements, etc.

[0103] When the in-vehicle video displayed on the display unit 320 includes the objects OBJ1L and OBJ1R, the brightness control unit 314 controls the brightness of the regions of the objects OBJ1L and OBJ1R. Thus, it is possible to prevent the objects OBJ1L and OBJ1R from being mistakenly recognized as vehicle taillights.

[0104] In the case where the in-vehicle video displayed on the display unit 320 includes the object OBJ2, as in Figure 7 As shown in A in FIG. 1 , the display event control unit 313 changes the color of the object OBJ2 (object OBJ2-1). Similarly, the hue of the object OBJ2 can be changed (object OBJ2-2), and the shape of the object OBJ2 can be changed (object OBJ2-3). Thus, it is possible to prevent the object OBJ2 from being mistakenly recognized as a road sign indicating "No Entry".

[0105] It should be noted that the color or hue of the area other than the object OBJ2 in the in-vehicle video displayed on the display unit 320 may be changed instead of the color or hue of the object itself, such as the object OBJ2-1 and the object OBJ2-2.

[0106] In the case where the in-vehicle video displayed on the display unit 320 includes the object OBJ3, as in Figure 7 As shown in B in FIG. 1 , the display event control unit 313 changes the shape (design) of the arrow included in the object OBJ3 (object OBJ3-1). The shape (design) may be changed so as not to change the meaning of the object. Thus, it is possible to prevent the object OBJ3 from being mistakenly recognized as a road sign indicating "drive only in the direction of the arrow"

[0107] In the case where the in-vehicle video displayed on the display unit 320 includes the object OBJ4, as in Figure 7 As shown in C in FIG. 8 , the display matter control unit 313 horizontally inverts the object OBJ4 to change the design of the object OBJ4 (object OBJ4 - 1 ).

[0108] In the case where the driving condition of the surrounding vehicles is an autonomous driving condition, the objects described above may be erroneously recognized by front cameras or side cameras provided on the surrounding vehicles, or monitoring cameras present on a traffic system capable of ITS or V2X.

[0109] Then, for example, based on the position information indicating a country or region, the display of the object OBJ4 is changed to the object OBJ4-1 which does not exist in the country or region the host vehicle is traveling in. Thus, erroneous recognition at the camera related to autonomous driving can be prevented.

[0110] In the above manner, the data processing unit 310 changes the display items in the in-vehicle video being displayed on the display unit 320, or controls the power of the light source of the display unit 320, so as to reduce the possibility of the in-vehicle video being mistakenly identified as vehicle lighting equipment, road signs or traffic lights.

[0111] <3. Operation of each system constituting the information display / determination system>

[0112] Next, the operations of the respective systems constituting the above-described information display / determination system 1 will be described.

[0113] (Operation of the vehicle exterior condition recognition system)

[0114] First, refer to Figure 8 Flowchart description in Figure 3 Operation of the vehicle exterior condition recognition system 10.

[0115] In step S11 , the data processing unit 120 acquires vehicle exterior information from the sensing unit 110 .

[0116] In step S12 , the data processing unit 120 identifies non-target viewers of the in-vehicle video according to the information outside the vehicle.

[0117] In step S13 , the data processing unit 120 measures the distance to the non-target viewer based on the non-target viewer identification result and the vehicle exterior information.

[0118] In step S14 , the data processing unit 120 calculates the relative speed of the non-target viewer based on the non-target viewer identification result and the vehicle exterior information.

[0119] In step S15, the data processing unit 120 determines the status of the non-target viewer based on the non-target viewer identification result, the distance to the non-target viewer, and the relative speed of the non-target viewer, that is, determines whether the non-target viewer is visually recognizing the in-vehicle video. The obtained determination result (status of the non-target viewer) is output to the brightness detection system 20.

[0120] (Operation of brightness detection system)

[0121] Next, we will refer to Fig. 9 Flowchart description in Figure 4 Operation of the brightness detection system 20 in FIG.

[0122] In step S21 , the data processing unit 220 acquires brightness information from the brightness detection unit 210 .

[0123] In step S22 , the data processing unit 220 acquires position information indicating the country or region in which the host vehicle is traveling.

[0124] In step S23 , the data processing unit 220 determines the risk level of misrecognition of the in-vehicle video based on the determination result (the condition of the non-target viewer) obtained from the vehicle exterior condition recognition system 10 , the brightness information, and the position information.

[0125] In step S24 , the data processing unit 220 determines a restriction level according to the risk level of misidentification. The obtained restriction level is output to the display system 30 .

[0126] (Show system operation)

[0127] In addition, reference will be made to Fig.10 Flowchart description in Figure 5 The operation of the display system 30 is shown in FIG.

[0128] In step S31 , the data processing unit 310 changes the display items in the in-vehicle video according to the restriction level provided from the brightness detection system 20 .

[0129] In step S32 , the data processing unit 310 determines the power amount of the light source of the display unit 320 according to the limit level provided from the brightness detection system 20 .

[0130] In step S33 , the data processing unit 310 controls the display unit 320 to display the in-vehicle video based on the determined event and the determined power amount of the light source.

[0131] As a result of the above steps, for example, it is possible to prevent drivers of surrounding vehicles traveling behind or to the side of the vehicle from mistakenly identifying the video displayed on the display unit 320 inside the vehicle as a light device, etc. Thus, a safe viewing space inside the vehicle can be provided while taking the safety of the vehicle's exterior into consideration.

[0132] <4. Example of positioning of brightness detection unit>

[0133] Next, a description will be given of an example of positioning of the brightness detection section 210 that acquires brightness information.

[0134] (First positioning example)

[0135] In the above description, the brightness detection section 210 is arranged outside (outside rear portion) of the host vehicle, and acquires measurement information indicating the brightness of the in-vehicle video measured via the rear glass of the host vehicle as brightness information.

[0136] Specifically, Fig.11 As shown in FIG. 1 , the camera CAM 11 serving as the brightness detection unit 210 is arranged on the rear outer side of the host vehicle VC, and the camera CAM 11 photographs the display unit 320 arranged inside the host vehicle VC via the rear glass RG of the vehicle VC. Thus, the camera CAM 11 can measure the brightness of the in-vehicle video displayed on the display unit 320 in consideration of the transmittance of the rear glass RG.

[0137] It should be noted that the camera CAM 11 is not limited to an external camera arranged on the outside of the vehicle VC, and the camera CAM11 may include a front camera or a side camera set on a surrounding vehicle of the vehicle VC, or a monitoring camera existing on a traffic system capable of ITS or V2X.

[0138] Assume that the transmittance of the rear glass RG changes due to electric sunshades, blinds, etc. In this regard, Fig.11 In the example of , the camera CAM 11 serving as the brightness detection unit 210 can measure the brightness of the in-vehicle video in consideration of the transmittance of the rear glass RG. Thus, the brightness of the in-vehicle video visually recognized by the non-target viewer NA located behind the vehicle VC can be appropriately obtained. As a result, the brightness of the in-vehicle video displayed on the display unit 320 can be controlled so that, for example, the in-vehicle video including red and being visually recognized by the non-target viewer NA can be prevented from being mistakenly recognized as a taillight device on the vehicle.

[0139] (Second positioning example)

[0140] The brightness detection section 210 may be disposed inside the vehicle, and may acquire measurement information indicating the brightness of the in-vehicle video directly measured by the brightness detection section 210 and the transmittance of the rear glass of the host vehicle prepared in advance as the brightness information.

[0141] Specifically, Fig.12 As shown in FIG. 1 , the camera CAM 21 serving as the brightness detection section 210 is arranged at the rear of the interior of the host vehicle VC, and the camera CAM 21 captures the display section 320 arranged inside the host vehicle VC. Thus, the camera CAM 21 can directly measure the brightness of the in-vehicle video displayed on the display section 320.

[0142] It should be noted that the camera CAM 21 may include a vehicle-mounted camera having a system function for sensing a person or animal inside a vehicle such as a DMS (Driver Monitoring System) or a PMS (Passenger Monitoring System) in order to sense the condition of a passenger in the host vehicle VC.

[0143] Assume that the transmittance of the rear glass RG changes due to the electric sunshade or blinds. Fig.12 In the example of FIG. 2 , the camera CAM 21 serving as the brightness detection section 210 cannot measure the changed transmittance of the rear glass RG. Therefore, the transmittance of the prepared rear glass RG is obtained.

[0144] For example, Fig.13 As shown in , in the brightness detection system 20, the data processing section 220 acquires not only the measurement information provided from the brightness detection section 210, but also the specification information prepared as the vehicle window transmittance data WT as primary data. The vehicle window transmittance data WT may include the transmittance of the rear glass RG as the specification information about the rear glass RG, or may include information about the material or thickness of the rear glass RG from which the transmittance can be calculated. Alternatively, the vehicle window transmittance data WT may include information indicating the relationship of the transmittance with respect to an electrical variation parameter such as current, voltage, driving frequency, or duty cycle.

[0145] That is, in addition to the brightness of the in-vehicle video directly measured, the transmittance acquired as the specification information about the rear glass RG is also taken into account, so that the brightness of the in-vehicle video visually recognized by the non-target viewer NA located behind the host vehicle VC can be appropriately obtained. As a result, the brightness of the in-vehicle video displayed on the display section 320 can be controlled, so that, for example, the in-vehicle video including red and being visually recognized by the non-target viewer NA can be prevented from being mistakenly recognized as a taillight device on the vehicle.

[0146] (Third Positioning Example)

[0147] The brightness detection section 210 may be disposed inside the host vehicle, and may acquire measurement information indicating brightness of the in-vehicle video directly measured by the brightness detection section 210 and transmittance of the rear glass of the host vehicle directly measured by the brightness detection section 210 as brightness information.

[0148] Specifically, Fig.14As shown in , the camera CAM 31 serving as the brightness detection unit 210 is arranged at the rear interior of the vehicle VC, and the camera CAM 31 photographs the display unit 320 arranged at the interior of the vehicle VC. Thus, the camera CAM 31 can directly measure the brightness of the in-vehicle video displayed on the display unit 320. In addition, the camera CAM 32 serving as the brightness detection unit 210 is arranged at the rear interior of the vehicle VC, and the camera CAM 32 photographs the rear glass RG of the vehicle VC. Thus, the camera CAM 32 can directly measure the transmittance of the rear glass RG. For example, the camera CAM 32 can measure the transmittance of the rear glass RG based on a reference such as a sticker on the outside of the rear glass RG, so that the absolute value of the transmittance or the rate of change of the transmittance can be obtained.

[0149] It should be noted that the cameras CAM 31 and CAM 32 may include vehicle-mounted cameras having a recognition system function such as a DMS or a PMS in order to sense the conditions of passengers in the host vehicle VC.

[0150] Assume that the transmittance of the rear glass RG changes due to the electric sunshade or blinds. Fig.14 In the example of , the camera CAM 31 acting as the brightness detection unit 210 can directly measure the brightness of the in-vehicle video, and further, the camera CAM 32 acting as the brightness detection unit 210 can directly measure the transmittance of the rear glass RG. Thus, the brightness of the in-vehicle video visually recognized by the non-target viewer NA located behind the host vehicle VC can be appropriately obtained. As a result, the brightness of the in-vehicle video displayed on the display unit 320 can be controlled so as to prevent, for example, the in-vehicle video including red and being visually recognized by the non-target viewer NA from being mistakenly recognized as a taillight device on the vehicle.

[0151] <5. Modifications>

[0152] Modifications of the above-described embodiment will be described below.

[0153] (Get brightness information based on content)

[0154] In the brightness detection system 20, the data processing section 220 (risk degree determination section) can acquire brightness information based on the content (video signal) provided from the content holding section 40. Needless to say, mixed brightness information which is a combination of this brightness information and brightness information obtained by, for example, the brightness detection section 210 which is a camera may be used.

[0155] For example, Fig.15As shown in , the data processing unit 220 is configured to estimate the brightness of the in-vehicle video based on the brightness signal information contained in the content (video signal) provided from the content holding unit 40. In this case, the data processing unit 220 can obtain the brightness of the in-vehicle video that is being visually recognized by the non-target viewer based on the estimated brightness of the in-vehicle video and the transmittance obtained as the rear glass specification information contained in the vehicle window transmittance data WT. Alternatively, the data processing unit 220 can obtain the brightness of the in-vehicle video that is being visually recognized by the non-target viewer based on the estimated brightness of the in-vehicle video and the transmittance of the rear glass directly measured by the vehicle-mounted camera.

[0156] (Based on the display limitation of vehicle information about surrounding vehicles)

[0157] In the display system 30 , the data processing section 310 (display control portion) may impose display restrictions on the in-vehicle video according to the driving conditions of the surrounding vehicles determined based on the vehicle information about the surrounding vehicles.

[0158] Specifically, when the driving condition of the surrounding vehicles is determined to be a manual driving condition based on the vehicle information obtained through V2V communication, a setting is made to impose display restrictions on the in-car video. On the contrary, when the driving condition of the surrounding vehicles is determined to be an automatic driving condition, a setting is made not to impose display restrictions on the in-car video.

[0159] It should be noted that when autonomous driving of surrounding vehicles can be performed safely, display restrictions do not necessarily apply to the in-vehicle video, but when the safety of autonomous driving of surrounding vehicles cannot be guaranteed according to the autonomous driving mode, display restrictions may be imposed on the in-vehicle video.

[0160] <6. Example of Computer Configuration>

[0161] The series of processes described above can also be performed by hardware, or can also be performed by software. In the case of performing the series of processes by software, the program constituting the software is installed from a program recording medium into a computer incorporated in dedicated hardware, or installed into a general-purpose personal computer.

[0162] Fig.16 This is a block diagram depicting an example of the hardware configuration of a computer that executes the above-described series of processes in accordance with a program.

[0163] The information display / determination system 1 described above is composed of Fig.16 The configuration described in the embodiment is implemented by a computer 500.

[0164] The CPU 501 , the ROM 502 , and the RAM 503 are connected to each other via a bus 504 .

[0165] Furthermore, an input / output interface 505 is connected to the bus 504. An input section 506 including, for example, a keyboard or a mouse and an output section 507 including, for example, a display or a speaker are connected to the input / output interface 505. In addition, for example, a storage section 508 including a hard disk or a nonvolatile memory, a communication section 509 including a network interface, and a drive 510 that drives a removable medium 511 are connected to the input / output interface 505.

[0166] In the computer 500 having the above-described configuration, the CPU 501 loads the program stored in the storage section 508 into the RAM 503 via the input / output interface 505 and the bus 504, for example, and executes the program. Thus, the series of processing described above is executed.

[0167] The program to be executed by the CPU 501 is recorded in the removable medium 511 or provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital satellite broadcasting, and then installed in the storage section 508 .

[0168] It should be noted that the program to be executed by CPU 501 may be a program for executing processing in the time series order described in this document, a program for executing processing in parallel, or a program for executing processing at a necessary timing (such as the timing of calling).

[0169] In this specification, the term "system" means a group of multiple components (devices, modules (components), etc.), and it is not important whether all the components are contained in the same housing. Thus, a group of multiple devices contained in different housings and connected through a network is a system, and further, a single device having multiple modules contained in a single housing is also a system.

[0170] The embodiments of the present technology are not limited to the above-described embodiments, and various changes can be made within the scope of the gist of the present technology.

[0171] In addition, the effects described in this specification are merely examples, and therefore are not limited to specific effects. Therefore, any other effects may be provided.

[0172] Furthermore, the present technology may also adopt the following configurations.

[0173] (1) An information processing device comprising:

[0174] a condition determination unit configured to determine an external condition of the vehicle based on external information about the exterior of the vehicle;

[0175] a risk level determination unit that determines a risk level of misrecognition of the video from outside the vehicle based on the determined external condition of the vehicle and brightness information about the video displayed on a display unit arranged inside the vehicle; and

[0176] A display control unit is configured to impose display restrictions on the video according to a risk level of misrecognition.

[0177] (2) The information processing device according to (1), wherein

[0178] The situation determination unit determines a situation of a non-target viewer of the video outside the host vehicle, and

[0179] The risk level determination section determines a risk level of misidentification of the non-target viewer.

[0180] (3) The information processing device according to (2), wherein

[0181] The status determination section determines whether the non-target viewer is visually recognizing the video as the status of the non-target viewer.

[0182] (4) The information processing device according to (3), wherein

[0183] The non-target viewers include pedestrians and drivers of surrounding vehicles traveling behind or to the side of the vehicle.

[0184] (5) The information processing device according to (4), wherein

[0185] The vehicle exterior information includes sensing information obtained by sensing a rear area of ​​the host vehicle.

[0186] (6) The information processing device according to (4), wherein

[0187] The vehicle exterior information includes at least any one of traffic information about the periphery of the own vehicle obtained through ITS communication or V2V communication, and vehicle information about surrounding vehicles obtained through V2V communication.

[0188] (7) The information processing device according to (6), wherein

[0189] The display control unit avoids imposing display restrictions on the video when the surrounding vehicle is determined to be autonomously driven based on the vehicle information.

[0190] (8) The information processing device according to any one of (1) to (7), wherein

[0191] The risk level determination unit determines, as the misidentification risk level, a possibility that the video will be misidentified as a lighting device of a host vehicle.

[0192] (9) The information processing device according to any one of (1) to (7), wherein

[0193] The risk level determination section determines, as a misrecognition risk level, a possibility that the video will be misrecognized as a road sign or a traffic light.

[0194] (10) The information processing device according to any one of (1) to (9), wherein

[0195] The display control unit changes display items in the video according to a restriction level corresponding to the misrecognition risk level.

[0196] (11) The information processing device according to (10), wherein

[0197] The display matters include at least any one of brightness, color, hue, and shape of an object included in the video.

[0198] (12) The information processing device according to (11), wherein

[0199] When the video includes the object which is a road sign or a traffic light itself or which is similar to a road sign or a traffic light, the display control unit changes the display item.

[0200] (13) The information processing device according to any one of (1) to (9), wherein

[0201] The display control unit switches on / off the video on the display unit according to the restriction level corresponding to the misrecognition risk level.

[0202] (14) The information processing device according to any one of (1) to (13),

[0203] The display control unit controls the power of the light source of the display unit according to the restriction level corresponding to the misrecognition risk degree.

[0204] (15) The information processing device according to any one of (1) to (14), wherein

[0205] The brightness information is acquired as measurement information obtained by measuring the brightness of the video through a rear glass of the host vehicle by a brightness detection section disposed outside the host vehicle.

[0206] (16) The information processing device according to any one of (1) to (14), wherein

[0207] The brightness information is acquired as measurement information obtained by measuring the brightness of the video by a brightness detection section disposed inside the host vehicle, and as transmittance of a rear glass of the host vehicle prepared in advance.

[0208] (17) The information processing device according to any one of (1) to (14), wherein

[0209] The brightness information is acquired as first measurement information obtained by measuring the brightness of the video by a first brightness detection unit arranged inside the vehicle and second measurement information obtained by measuring the rear glass of the vehicle by a second brightness detection unit arranged inside the vehicle.

[0210] (18) The information processing device according to any one of (1) to (14), wherein

[0211] The brightness information is acquired as a brightness signal included in a video signal supplied to the display section.

[0212] (19) An information processing method comprising:

[0213] Through information processing devices,

[0214] Determining the external condition of the vehicle based on the external information about the exterior of the vehicle;

[0215] determining a risk level of misrecognition of the video from outside the vehicle based on the determined external condition of the vehicle and brightness information about the video displayed on a display unit arranged inside the vehicle; and

[0216] Display restrictions are imposed on the video according to the degree of risk of misidentification.

[0217] (20) An information processing system comprising:

[0218] A display unit arranged inside the vehicle;

[0219] a condition determination unit that determines an external condition of the vehicle based on external vehicle information about the exterior of the vehicle;

[0220] a risk level determination unit that determines a risk level of misrecognition of the video from outside the vehicle based on the determined external condition of the vehicle and brightness information about the video displayed on the display unit; and

[0221] The display control unit imposes display restrictions on the video according to the risk level of misrecognition.

[0222] (21) A program for causing a computer to implement the following processing:

[0223] Determining the external condition of the vehicle based on the external information about the exterior of the vehicle;

[0224] determining a risk level of misrecognition of the video from outside the vehicle based on the determined external condition of the vehicle and brightness information about the video displayed on a display unit arranged inside the vehicle; and

[0225] Display restrictions are imposed on the video according to the degree of risk of misidentification.

[0226] [reference numerals list]

[0227] 1: Information display / judgment system

[0228] 10: External vehicle status recognition system

[0229] 20: Brightness detection system

[0230] 30: Display System

[0231] 40: Content retention unit

[0232] 110: Sensor

[0233] 120: Data Processing Department

[0234] 210: Brightness detection unit

[0235] 220: Data Processing Department

[0236] 310: Data Processing Department

[0237] 320: Display unit

Claims

1. An information processing device, comprising: a condition determination unit configured to determine an external condition of the vehicle based on external information about the exterior of the vehicle; a risk level determination unit that determines a risk level of misrecognition of the video from outside the vehicle based on the determined external condition of the vehicle and brightness information about the video displayed on a display unit arranged inside the vehicle; and A display control unit is configured to impose display restrictions on the video according to a risk level of misrecognition.

2. The information processing device according to claim 1, wherein The situation determination unit determines a situation of a non-target viewer of the video outside the host vehicle, and The risk level determination section determines a risk level of misidentification of the non-target viewer.

3. The information processing device according to claim 2, wherein The status determination section determines whether the non-target viewer is visually recognizing the video as the status of the non-target viewer.

4. The information processing device according to claim 3, wherein The non-target viewers include pedestrians and drivers of surrounding vehicles traveling behind or to the side of the vehicle.

5. The information processing device according to claim 4, wherein The vehicle exterior information includes sensing information obtained by sensing a rear area of ​​the host vehicle.

6. The information processing device according to claim 4, wherein The vehicle exterior information includes at least any one of traffic information about the periphery of the own vehicle obtained through ITS communication or V2V communication, and vehicle information about surrounding vehicles obtained through V2V communication.

7. The information processing device according to claim 6, wherein The display control unit avoids imposing display restrictions on the video when the surrounding vehicle is determined to be automatically driven based on the vehicle information.

8. The information processing device according to claim 1, wherein The risk level determination unit determines, as the misidentification risk level, a possibility that the video will be misidentified as a lighting device of a host vehicle.

9. The information processing device according to claim 1, wherein The risk level determination section determines, as a misrecognition risk level, a possibility that the video will be misrecognized as a road sign or a traffic light.

10. The information processing device according to claim 1, wherein The display control unit changes display items in the video according to a restriction level corresponding to the misrecognition risk level.

11. The information processing device according to claim 10, wherein The display matters include at least any one of brightness, color, hue, and shape of an object included in the video.

12. The information processing device according to claim 11, wherein When the video includes the object which is a road sign or a traffic light itself or which is similar to a road sign or a traffic light, the display control unit changes the display item.

13. The information processing device according to claim 1, wherein The display control unit switches on / off the video on the display unit according to the restriction level corresponding to the misrecognition risk level.

14. The information processing device according to claim 1, wherein The display control unit controls the power of the light source of the display unit according to the restriction level corresponding to the misrecognition risk degree.

15. The information processing apparatus according to claim 1, wherein The brightness information is acquired as measurement information obtained by measuring the brightness of the video via a rear glass of the host vehicle by a brightness detection section arranged outside the host vehicle.

16. The information processing device according to claim 1, wherein The brightness information is acquired as measurement information obtained by measuring the brightness of the video by a brightness detection section arranged inside the host vehicle and as a previously prepared transmittance of a rear glass of the host vehicle.

17. The information processing apparatus according to claim 1, wherein The brightness information is acquired as first measurement information obtained by measuring the brightness of the video through a first brightness detection unit arranged inside the vehicle, and second measurement information obtained by measuring the rear glass of the vehicle through a second brightness detection unit arranged inside the vehicle.

18. The information processing apparatus according to claim 1, wherein The brightness information is acquired as a brightness signal included in a video signal supplied to the display section.

19. An information processing method, comprising: Through information processing devices, Determining the external condition of the vehicle based on the external information about the exterior of the vehicle; determining a risk level of misrecognition of the video from outside the vehicle based on the determined external condition of the vehicle and brightness information about the video displayed on a display unit arranged inside the vehicle; as well as Display restrictions are imposed on the video according to the degree of risk of misidentification.

20. An information processing system comprising: A display unit arranged inside the vehicle; a condition determination unit that determines an external condition of the vehicle based on external vehicle information about the exterior of the vehicle; a risk level determination unit that determines a risk level of misrecognition of the video from outside the vehicle based on the determined external condition of the vehicle and brightness information about the video displayed on the display unit; and The display control unit imposes display restrictions on the video according to the risk level of misrecognition.

Images