Display control device, display control system, program, and display control method

Abstract

To provide a display control device, a display control system, a program, and a display control method with which it is possible to improve the comfort in a vehicle interior space.SOLUTION: The display control device of an embodiment includes an estimation unit and a display control unit. The estimation unit estimates the magnitude of a sense of limitation that a person in the vehicle interior feels. The display control unit performs: either controlling a display device so that a moving-image is displayed in the vehicle interior, or suggesting to the person that the moving-image be displayed in the vehicle interior when the magnitude of the sense of limitation is greater than or equal to a prescribed level.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present invention relates to a display control device, a display control system, a program, and a display control method.

Background Art

[0002] Patent Document 1 discloses projecting an outside-vehicle image acquired by a camera installed outside a vehicle onto a ceiling by a projector installed inside the vehicle.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] A person inside a vehicle may feel a sense of stuffiness, for example, in case of bad weather, traffic jams, and when driving on a narrow road. In a situation where a person feels a sense of stuffiness, displaying an outside-vehicle image in real time as in the prior art cannot eliminate the sense of stuffiness.

[0005] The problem to be solved by the embodiments of the present invention is to provide a display control device, a display control system, a program, and a display control method capable of improving the comfort of the interior space of a vehicle.

Means for Solving the Problems

[0006] The display control device according to the embodiment includes an estimation unit and a display control unit. The estimation unit estimates the level of stuffiness felt by a person inside the vehicle. The display control unit, when the level of stuffiness is equal to or higher than a predetermined value, controls a display device to display a moving image inside the vehicle, and / or proposes to the person to display the moving image inside the vehicle.

Effects of the Invention

[0007] The present invention can improve the comfort of the in-vehicle space.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Modes for Carrying Out the Invention

[0009] Hereinafter, a projection system according to an embodiment will be described with reference to the drawings. Note that the scales of the respective parts in the following drawings may be appropriately changed. Also, the respective drawings used in the following description of the embodiment may show the configuration with some omissions for the sake of explanation. Further, in each drawing and this specification, the same reference numerals indicate the same elements. FIG. 1 is a block diagram showing an example of the main configuration of a display control system 1 according to an embodiment and components included in the display control system 1. Note that each component of the device may be built-in or externally attached. The display control system 1 is a system that determines whether to display an image outside the vehicle according to the situation outside the vehicle. The display control system 1 includes, as an example, a vehicle 100 and a server device 200. Note that the display control system 1 is an example of a display control system.

[0010] The vehicle 100 and the server device 200 are connected to the network NW. The network NW is typically a communication network including the Internet. The network NW is typically a communication network including a WAN (wide area network). The network NW may be a communication network including a private network such as an intranet.

[0011] The vehicle 100 is, for example, an automobile. The type of the automobile is not limited. The vehicle 100 includes, as an example, a control device 110, a display device 120, an external vehicle sensor 130, and a camera 140. However, the control device 110 may not be provided in the vehicle 100. Also, the display device 120 may not be provided in the vehicle 100.

[0012] The control device 110 is a device capable of controlling the display device 130. The control device 110 is, for example, an in-vehicle device of the vehicle 100. The in-vehicle device is, for example, an ECU (electronic control unit), a car navigation system, or an ETC (electronic toll collection) in-vehicle unit, etc. Also, the control device 110 may be a smartphone, a tablet terminal, or a PC (personal computer), etc. Alternatively, the display device 120 may include the control device 110. The control device 110 includes, as an example, a processor 111, a ROM (read-only memory) 112, a RAM (random-access memory) 113, an auxiliary storage device 114, a communication interface 115, a display device 116, an input device 117, and a positioning device 118. And a bus 119, etc., connects these parts. Note that the control device 110 is an example of a display control device.

[0013] Processor 111 is the central part of a computer that performs processes such as operations and controls necessary for the operation of control device 110, and performs various operations and processes. Processor 111 is, for example, a CPU (central processing unit), MPU (micro processing unit), SoC (system on a chip), DSP (digital signal processor), GPU (graphics processing unit), ASIC (application specific integrated circuit), PLD (programmable logic device), or FPGA (field-programmable gate array), etc. Alternatively, processor 111 is a combination of a plurality of these. Also, processor 111 may be a combination of these with a hardware accelerator or the like. Processor 111 controls each part in order to realize various functions of control device 110 based on programs such as firmware, system software, and application software stored in ROM 112 or auxiliary storage device 114, etc. Also, processor 111 executes the processes described later based on the program. Note that part or all of the program may be incorporated in the circuit of processor 111.

[0014] ROM 112 and RAM 113 are the main storage devices of a computer centered around processor 111. ROM 112 is a non-volatile memory used exclusively for reading data. ROM 112 stores, for example, firmware among the above programs. Also, ROM 112 stores data etc. used by processor 111 when performing various processes.

[0015] RAM 113 is a memory used for reading and writing data. RAM 113 is utilized as a work area etc. that stores data temporarily used by processor 111 when performing various processes. RAM 113 is typically a volatile memory.

[0016] The auxiliary storage device 114 is an auxiliary storage device of a computer centered on the processor 111. The auxiliary storage device 114 is, for example, an EEPROM (electric erasable programmable read-only memory), an HDD (hard disk drive), or a flash memory. The auxiliary storage device 114 stores, among the above programs, for example, system software and application software. The auxiliary storage device 114 also stores data used by the processor 111 to perform various processes, data generated by the processes in the processor 111, and various setting values.

[0017] The communication interface 115 is an interface for the control device 110 to communicate with other devices. This communication may be wireless communication or wired communication. This communication may also be a mixture of wireless communication and wired communication. The control device 110 communicates with the display device 120 and the camera 140 via the communication interface 115. The control device 110 controls the display device 120 and the camera 140 using this communication. The communication interface 115 is also connected to the network NW. The control device 110 communicates with the server device 200 via the network NW.

[0018] The display device 116 displays a screen for notifying various information to the operator of the vehicle 100 or the control device 110. The display device 116 is, for example, a display such as a liquid crystal display or an organic EL (electro-luminescence) display.

[0019] The input device 117 receives operations by the operator of the vehicle 100 or the control device 110. The input device 117 is, for example, a keyboard, a keypad, a touch pad, or a controller. Also, the input device 117 may be a device for voice input. Further, a touch panel can also be used as the display device 116 and the input device 117. In this case, the display panel included in the touch panel functions as the display device 116. And the pointing device by touch input included in the touch panel functions as the input device 117.

[0020] The positioning device 118 is an IC (integrated circuit) chip, module, or circuit that positions and outputs the position of the control device 110 using a GNSS (global navigation satellite system) such as GPS (Global Positioning System). The position of the control device 110 is also the position of the vehicle 100. The positioning device 118 includes, for example, an antenna that receives GNSS signals from GNSS satellites. Also, the positioning device 118 includes an arithmetic unit that performs arithmetic operations for positioning. The positioning device 118 outputs the positioning result. Note that the control device 110 may be configured such that the processor 111 performs arithmetic operations for positioning. In this case, the positioning device 118 may not include an arithmetic unit. Also, the positioning device 118 may position the position of the control device 110 by a method other than GNSS. Further, the control device 110 may use GNSS and a method other than GNSS in combination to position the position of the control device 110.

[0021] The bus 119 includes a control bus, an address bus, a data bus, etc., and transmits signals exchanged between each part of the control device 110.

[0022] The display device 120 is a device that displays an image in the passenger compartment of the vehicle 100. The display device 120 is, for example, a display such as a liquid crystal display or an organic EL display, or a projector. The display may be a head-mounted display or a head-up display. The head-mounted display may be a VR (virtual reality) goggle or an AR (augmented reality) goggle, etc. A projector is a device that projects an image onto a projection target by projecting light. The projection target is somewhere in the passenger compartment of the vehicle 100. Examples of the projection destination of the image include the ceiling, wall, door, and floor in the passenger compartment of the vehicle 100, the back side of the seat backrest, the window glass, and the dashboard. The place where the head-mounted display displays the image is, for example, inside the goggles. If the head-mounted display is in the passenger compartment of the vehicle 100, the image displayed inside the goggles is also an image displayed in the passenger compartment of the vehicle 100. Note that a moving image is a type of image. Also, the image may be a 3D (three-dimensional) image.

[0023] The external sensor 130 is a sensor for the outside of the vehicle 100. The external sensor 130 detects, for example, the situation outside the vehicle. The external sensor 130 is, for example, a camera, a microphone, an optical sensor, an infrared sensor, a radar, LIDAR (light detection and ranging), a vibration sensor, and a brightness sensor, etc. The external sensor 130 outputs information indicating the sensing result. The information output by the external sensor 130 is hereinafter referred to as "external information". The vehicle 100 may be provided with a plurality of types of external sensors 130. The vehicle 100 may be provided with a plurality of external sensors 130.

[0024] Camera 140 captures images. In addition, camera 140 outputs the captured image data. Camera 140 may also be used as an external sensor 130 of the vehicle. Camera 140 captures the outside of the vehicle 100. The imaging direction of camera 140 is preferably the outside direction of vehicle 100. Camera 140 may be a hemispherical camera or an omnidirectional camera in order to be able to capture the outside of vehicle 100 in all directions.

[0025] The server device 200 is a device that stores moving images to be displayed in the vehicle interior (hereinafter referred to as "inside the vehicle") of the vehicle 100. In addition, the server device 200 is a device that transmits the moving images to the control device 110. The server device 200 includes, as an example, a processor 201, a ROM 202, a RAM 203, an auxiliary storage device 204, and a communication interface 205. And a bus 206 or the like connects these respective parts.

[0026] The processor 201 is the central part of a computer that performs processes such as operations and controls necessary for the operation of the server device 200, and performs various operations and processes. The processor 201 is, for example, a CPU, an MPU, an SoC, a DSP, a GPU, an ASIC, a PLD, or an FPGA, or the like. Alternatively, the processor 201 is a combination of a plurality of these. In addition, the processor 201 may be a combination of these with a hardware accelerator or the like. The processor 201 controls each part in order to realize various functions of the server device 200 based on programs such as firmware, system software, and application software stored in the ROM 202 or the auxiliary storage device 204. In addition, the processor 201 executes the processes described later based on the program. Note that part or all of the program may be incorporated in the circuit of the processor 201.

[0027] ROM 202 and RAM 203 are the main memory devices of a computer centered around the processor 201. ROM 202 is a non-volatile memory used exclusively for reading data. ROM 202 stores, for example, firmware among the above programs. Also, ROM 202 stores data used by the processor 201 for performing various processes.

[0028] RAM 203 is a memory used for reading and writing data. RAM 203 is utilized as a work area for storing data temporarily used by the processor 201 for performing various processes. RAM 203 is typically a volatile memory.

[0029] The auxiliary storage device 204 is an auxiliary storage device of a computer centered around the processor 201. The auxiliary storage device 204 is, for example, an EEPROM, HDD, or flash memory. The auxiliary storage device 204 stores, for example, system software and application software among the above programs. Also, the auxiliary storage device 204 stores data used by the processor 201 for performing various processes, data generated by the processing in the processor 201, and various setting values. The data stored in the auxiliary storage device 204 includes a moving image DB and moving images that can be relaxing.

[0030] The moving image DB is a database for storing and managing moving images. The moving image DB stores, for each moving image, the video ID, moving image data, shooting position information, and situation information in association with each other.

[0031] Details of moving images that can be relaxing will be described later. The video ID is unique identification information for each moving image. The shooting position information is information indicating the position where the moving image was shot. The shooting position information may be information indicating the shooting position at each playback time within the moving image. The situation information is information indicating the situation where the moving image was shot. The situation information may be information indicating the situation at each playback time within the moving image.

[0032] The communication interface 205 is an interface for the server device 200 to communicate via a network NW or the like.

[0033] The bus 206 includes a control bus, an address bus, a data bus, etc., and transmits signals exchanged among the respective parts of the server device 200.

[0034] Hereinafter, the operation of the display control system 1 according to the embodiment will be described based on FIGS. 2 to 5 and the like. Note that the content of the processing in the following operation description is an example, and various processes capable of obtaining the same result can be appropriately used. FIGS. 2 to 4 are flowcharts showing an example of the processing by the processor 111 of the control device 110. The processor 111 executes the processing of FIGS. 2 to 4 based on a program stored in, for example, the ROM 112 or the auxiliary storage device 114. FIG. 5 is a flowchart showing an example of the processing by the processor 201 of the server device 200. The processor 201 executes the processing of FIG. 5 based on a program stored in, for example, the ROM 202 or the auxiliary storage device 204. In the following description, a specific single vehicle 100 will be focused on for explanation. In the following description, vehicles other than the specific single vehicle 100 are not labeled.

[0035] In step ST11 of FIG. 2, the processor 111 of the control device 110 acquires information (hereinafter referred to as "calculation information") used to estimate the height of the sense of congestion felt by a person inside the vehicle. The processor 111 acquires, for example, at least any one of vehicle exterior information, congestion information, weather information, and road information as the calculation information. The processor 111 acquires the vehicle exterior information from the vehicle exterior sensor 130. The congestion information is information indicating at least any one of the congestion situation and traffic jam situation of the road on which the vehicle 100 is traveling. The processor 111 may acquire the congestion information from a service that provides map information such as Google Maps (registered trademark). The weather information is information indicating the weather at the current position of the vehicle 100. The road information is information indicating the state of the road on which the vehicle 100 is traveling. Note that when the processor 111 needs to know the current position of the vehicle 100 in order to acquire the calculation information, the positioning device 118 is used to acquire position information indicating the current position of the vehicle 100. By acquiring the position information, the processor 111 functions as an example of a position acquisition unit that acquires position information indicating the current position of the vehicle.

[0036] In step ST12, the processor 111 estimates the height of the sense of congestion felt by a person inside the vehicle using the calculation information acquired in step ST11. The processor 111 estimates the height of the sense of congestion, for example, by calculating a congestion index. The congestion index indicates the height of the sense of congestion. For example, the larger the value of the congestion index, the higher the sense of congestion. The congestion index has, for example, at least any one of the following characteristics (A1) to (A11).

[0037] (A1) The congestion index increases as the ratio of the sky visible from the vehicle 100 (sky rate) decreases. (A2) The congestion index increases as the number of vehicles within a predetermined range from the vehicle 100 increases. (A3) The congestion index increases as the distance from the vehicle 100 to the surrounding objects of the vehicle 100 decreases. The surrounding objects are, for example, buildings and vehicles. (A4) The congestion index increases as the number of vehicles traveling around the vehicle 100 increases. (A5) The sense of confinement index increases as the brightness around vehicle 100 decreases. (A6) The sense of confinement index increases as the traffic congestion on the road on which vehicle 100 is traveling increases. (A7) The sense of confinement index increases as the degree of traffic jam on the road on which vehicle 100 is traveling worsens. (A8) The sense of confinement index increases as the road surface condition of the road on which vehicle 100 is traveling deteriorates. (A9) The sense of confinement index increases as the width of the road on which vehicle 100 is traveling decreases. (A10) The sense of confinement index increases as the weather worsens. For example, snow represents worse weather than rain. Rain represents worse weather than cloudy. Cloudy represents worse weather than sunny. Sunny represents worse weather than clear sky. (A11) The sense of confinement index increases as the cloud amount at the current position of vehicle 100 increases.

[0038] From the above, the processor 111 functions as an example of an estimation unit that estimates the level of the sense of confinement felt by a person inside the vehicle cabin by performing the process of step ST12.

[0039] In step ST13 of FIG. 2, the processor 111 of the control device 110 determines whether to display a moving image inside the vehicle. When the sense of confinement inside the vehicle is high above a predetermined level, the processor 111 determines to display a moving image inside the vehicle. For example, when the sense of confinement index is equal to or higher than a predetermined threshold value TH1, the processor 111 considers that the sense of confinement inside the vehicle is high above a predetermined level in step ST13. If the processor 111 determines to display a moving image inside the vehicle, it determines Yes in step ST13 and proceeds to step ST14.

[0040] In step ST14, the processor 111 proposes to the person in the vehicle to display a moving image that can reduce the sense of congestion. For this purpose, the processor 111 displays, for example, a proposal screen on the display device 116 or the display apparatus 120. The proposal screen includes, as an example, a proposal image, an OK button, and an NG button. The proposal image is an image that proposes to display a moving image that can reduce the sense of congestion. Note that characters are a type of image. The OK button is a button for the operator of the control device 110 to operate when instructing the control device 110 to display the moving image. The NG button is a button for the operator of the control device 110 to operate when instructing the control device 110 not to display the moving image.

[0041] From the above, the processor 111 functions as an example of a display control unit that proposes to the person to display a moving image in the passenger compartment when the height of the sense of congestion is equal to or more than a predetermined value by performing the processes of step ST13 and step ST14.

[0042] In step ST15, the processor 111 determines whether to display a moving image inside the vehicle. For example, the processor 111 determines to display a moving image when the OK button is operated. And, for example, the processor 111 determines not to display a moving image when the NG button is operated. The processor 111 may also determine not to display a moving image when a timeout occurs without either the OK button or the NG button being operated. If the processor 111 determines not to display a moving image inside the vehicle, it determines No in step ST15 and returns to step ST11. Note that when the processor 111 determines No in step ST15, it may perform a process (hereinafter referred to as "prevention process") to avoid repeatedly proposing the proposal in step ST14. As the prevention process, for example, when the processor 111 determines Yes in the process of step ST13 until a predetermined condition is satisfied, it performs a process of returning to step ST11. The predetermined condition is, for example, that a predetermined time has elapsed or the vehicle 100 has moved a predetermined distance. As the prevention process, the processor 111 may perform a process of increasing the value of the threshold TH1. Note that the processor 111 does not have to perform the prevention process when the NG button is operated, and does not have to perform the prevention process when a timeout occurs.

[0043] On the other hand, if the processor 111 determines to display a moving image inside the vehicle, it determines Yes in step ST15 and proceeds to step ST16.

[0044] In step ST16, the processor 111 executes a moving image acquisition process. The moving image acquisition process is a process of acquiring a moving image to be displayed inside the vehicle. In the moving image acquisition process, the processor 111 acquires, for example, a moving image that allows relaxation. Examples of moving images that allow relaxation are shown below as (B1) to (B10).

[0045] (B1) A moving image without dialogue. (B2) A moving image with a dialogue amount of a predetermined value or less. (B3) A moving image in which no person is shown. (B4) A moving image in which the degree of the person being shown is below a predetermined level. (B5) A moving image showing a landscape. (B6) A moving image in which the degree of the landscape being shown is above a predetermined level. (B7) A moving image in which a predetermined thing is shown or the degree of the thing being shown is above a predetermined level. The predetermined thing is, for example, an animal, a starry sky or nature. (B8) A moving image in which a predetermined thing is not shown or the degree of the thing being shown is below a predetermined level. The predetermined thing is, for example, a violent expression or the like. (B9) A moving image including a predetermined sound or including the sound above a predetermined level. The predetermined sound is, for example, a natural sound or the chirping sound of an insect or an animal. (B10) A moving image not including a predetermined sound or including the sound below a predetermined level. The predetermined sound is, for example, a shouting voice or a sound above a predetermined volume.

[0046] Note that the processor 111 acquires a relaxing moving image from, for example, the auxiliary storage device 114 or the server device 200. When the processor 111 acquires the moving image from the server device 200, it executes a moving image acquisition process as shown in FIG. 3.

[0047] In step ST31 of FIG. 3, the processor 111 instructs the communication interface 115 to transmit a first transmission request to the server device 200. The first transmission request is information for requesting the server device 200 to transmit a relaxing moving image. In response to this transmission instruction, the communication interface 115 transmits the first transmission request to the server device 200. The transmitted first transmission request is received by the communication interface 205 of the server device 200.

[0048] In step ST51 of FIG. 5, the processor 201 of the server device 200 determines whether a first transmission request has been received by the communication interface 205. If the first transmission request is not received, the processor 201 determines No in step ST51 and proceeds to step ST52.

[0049] In step ST52, the processor 201 determines whether a second transmission request has been received by the communication interface 205. If the second transmission request is not received, the processor 201 determines No in step ST52 and proceeds to step ST53.

[0050] In step ST53, the processor 201 determines whether moving image information has been received by the communication interface 205. If the moving image information is not received, the processor 201 determines No in step ST53 and returns to step ST51. Thus, the processor 201 enters a waiting state in which steps ST51 to ST53 are repeated until the first transmission request, the second transmission request, or the moving image information is received.

[0051] If the first transmission request is received while the processor 201 is in the waiting state of repeating steps ST51 to ST53, the processor 201 determines Yes in step ST51 and proceeds to step ST54.

[0052] In step ST54, the processor 201 instructs the communication interface 205 to transmit a relaxing moving image to the control device 110. For example, the processor 201 acquires and transmits the moving image from the auxiliary storage device 204. In response to this transmission instruction, the communication interface 205 transmits the moving image to the control device 110. The transmitted moving image is received by the communication interface 115 of the control device 110. After the processing of step ST54, the processor 201 returns to step ST51.

[0053] On the other hand, in step ST32 of FIG. 3, the processor 111 of the control device 110 waits for a moving image to be received by the communication interface 115. If the moving image is received, the processor 111 determines Yes in step ST32 and ends the video acquisition process shown in FIG. 3.

[0054] Further, in the moving image acquisition process, the processor 111 may acquire a moving image captured at or near the current position of the vehicle 100 (hereinafter referred to as "the same-position video"). The same-position video acquired here is typically a moving image captured by another vehicle. Also, the same-position video acquired here is a moving image captured in a situation where the sense of congestion felt by a person inside the vehicle is lower than a predetermined level. The situation where the sense of congestion felt by a person inside the vehicle is lower than a predetermined level is, for example, a situation where the congestion index is equal to or less than a predetermined threshold TH2. The value of the threshold TH2 is smaller than the value of the threshold TH1. When acquiring the same-position video, the processor 111 executes a moving image acquisition process as shown in FIG. 4.

[0055] In step ST41 of FIG. 4, the processor 111 uses the positioning device 118 to acquire position information indicating the current position of the vehicle 100.

[0056] In step ST42, the processor 111 generates a second transmission request. The second transmission request is information for requesting the server device 200 to transmit the same-position video. The second transmission request includes, as an example, the position information acquired in step ST41. After generating the second transmission request, the processor 111 instructs the communication interface 115 to transmit the second transmission request to the server device 200. In response to this transmission instruction, the communication interface 115 transmits the second transmission request to the server device 200. The transmitted second transmission request is received by the communication interface 205 of the server device 200.

[0057] On the other hand, when a second transmission request is received while the processor 201 of the server device 200 is in a waiting state repeating steps ST51 to ST53 in FIG. 5, it determines Yes in step ST52 and proceeds to step ST55.

[0058] In step ST55, the processor 201 refers to the moving image DB and acquires the moving image requested by the second transmission request received in step ST52. The position indicated by the shooting position information associated with the moving image includes the position indicated by the position information included in the second transmission request.

[0059] In step ST56, the processor 201 instructs the communication interface 205 to transmit the moving image and the shooting position information acquired in step ST55 to the control device 110. In response to this transmission instruction, the communication interface 205 transmits the moving image and the shooting position information to the control device 110. The transmitted moving image and the shooting position information are received by the communication interface 115 of the control device 110. After the process of step ST56, the processor 201 returns to step ST51.

[0060] On the other hand, in step ST43 of FIG. 4, the processor 111 of the control device 110 is waiting for the moving image and the shooting position information to be received by the communication interface 115. If the moving image and the shooting position information are received, the processor 111 determines Yes in step ST43 and ends the moving image acquisition process shown in FIG. 4.

[0061] After the process of step ST16 in FIG. 2, the processor 111 proceeds to the process of step ST17.

[0062] In step ST17, the processor 111 controls the display device 120 to start displaying the moving image acquired in step ST16. When the processor 111 displays the moving image acquired from the server device 200, either a streaming type or a download type playback method may be used.

[0063] When the processor 111 displays the co-location video, it may change the playback speed of the co-location video according to the speed of the vehicle 100. By changing the playback speed of the co-location video according to the speed of the vehicle 100, the processor 111 may make the speed at which the actual scenery outside the vehicle flows due to the running of the vehicle 100 the same as the speed at which the scenery of the co-location video flows. Also, the processor 111 may use the shooting position information acquired in step ST43 to play the co-location video so that the shooting position at the current playback time of the co-location video is the same as the current position of the vehicle 100.

[0064] As described above, by performing the processes of step ST13 and step ST17, the processor 111 functions as an example of a display control unit that controls the display device to display a moving image in the vehicle interior when the height of the sense of stuffiness is equal to or greater than a predetermined value.

[0065] In step ST18, the processor 111 determines whether to end the display of the moving image started in step ST17. For example, the processor 111 determines to end the display of the moving image in response to an operation instructing to end the display of the moving image being performed on the input device 117. Also, the processor 111 determines to end the display of the moving image when the sense of stuffiness felt by a person in the vehicle is eliminated. For this purpose, the processor 111 estimates the height of the sense of stuffiness felt by a person in the vehicle in the same manner as in steps ST11 and ST12. For example, the processor 111 considers that the sense of stuffiness felt by a person in the vehicle is eliminated when the calculated sense of stuffiness index is less than a predetermined threshold value TH3. The value of the threshold HT3 is less than or equal to the value of the threshold TH1. The value of the threshold TH3 may be equal to the value of the threshold TH1. If the processor 111 does not end the display of the moving image, it determines No in step ST18 and repeats the process of step ST18. On the other hand, if the processor 111 ends the display of the moving image, it determines Yes in step ST18 and proceeds to step ST19.

[0066] In step ST19, the processor 111 controls the display device 120 to end the display of the moving image that started to be displayed in step ST17. After the processing of step ST19, the processor 111 returns to step ST11.

[0067] If the processor 111 does not determine to display a moving image inside the vehicle in step ST13, it determines No in step ST13 and proceeds to step ST20.

[0068] In step ST20, the processor 111 determines whether to photograph the outside of the vehicle 100. For example, the processor 111 determines to photograph the outside when the sense of stuffiness felt by a person inside the vehicle is lower than a predetermined level. For example, when the stuffiness index calculated in step ST12 is less than a predetermined threshold value TH2, the processor 111 regards the sense of stuffiness as lower than the predetermined level in step ST20. The value of the threshold TH2 is less than or equal to the value of the threshold TH1. When the values of the threshold TH2 and the threshold TH1 are equal, if it is determined No in step ST13, it will always be determined Yes in step ST20. Therefore, when the values of the threshold TH2 and the threshold TH1 are equal, if the processor 111 determines No in step ST13, it may proceed to step ST21. If the processor 111 does not determine to photograph the outside, it determines No in step ST20 and returns to step ST11. On the other hand, if the processor 111 determines to photograph the outside, it determines Yes in step ST20 and proceeds to step ST21.

[0069] In step ST21, the processor 111 controls the camera 140 to start photographing outside the vehicle 100. Also, the processor 111 starts recording the photographing position. Note that the processor 111 acquires position information using the positioning device 118 for recording the photographing position. The processor 111 records, for example, the position information of the vehicle 100 for each date and time. Thereby, the processor 111 can know the photographing position at any reproduction time of the moving image. Also, the processor 111 starts recording the congestion feeling index at the time of photographing. The processor 111 calculates the congestion feeling index repeatedly during the photographing of the moving image and records the congestion feeling index for each date and time, for example. Thereby, the processor 111 can know the congestion feeling index at any reproduction time of the moving image.

[0070] From the above, the processor 111 functions as an example of a photographing unit that photographs outside the vehicle when the height of the congestion feeling is lower than a predetermined value by performing the processes of step ST20 and step ST21. Alternatively, the processor 111 functions as an example of a photographing unit by performing the processes of step ST20 and step ST21 in cooperation with the camera 140. Also, the processor 111 functions as an example of a position recording unit that records the position where photographing by the photographing unit was performed by performing the process of step ST21.

[0071] In step ST22, the processor 111 determines whether to end the shooting that started in step ST21. For example, when an operation to instruct the input device 117 to end the shooting is performed, the processor 111 determines to end the shooting. Also, when the sense of stuffiness felt by a person in the vehicle becomes higher than a predetermined level, the processor 111 determines to end the shooting. For this purpose, the processor 111 estimates the level of the sense of stuffiness felt by a person in the vehicle in the same manner as in steps ST11 and ST12. For example, when the calculated stuffiness index is equal to or greater than a predetermined threshold value TH4, it is considered that the sense of stuffiness felt by a person in the vehicle has become higher than the predetermined level. The value of the threshold TH4 is equal to or greater than the value of the threshold TH2. The value of the threshold TH4 may be equal to the value of the threshold TH1. The value of the threshold TH4 may be equal to the values of the threshold TH1 and the threshold TH2. If the processor 111 does not determine to end the shooting that started in step ST21, it determines No in step ST22 and repeats the process of step ST22. On the other hand, if the processor 111 determines to end the shooting that started in step ST21, it determines Yes in step ST22 and proceeds to step ST23.

[0072] In step ST23, the processor 111 controls the camera 140 to end the shooting that started in step ST21. Also, the processor 111 ends the recording of the shooting position that started in step ST21.

[0073] In step ST24, the processor 111 uploads the captured video to the server device 200. For this purpose, the processor 111 instructs the communication interface 115, for example, to transmit the moving image information to the server device 200. The moving image information includes the moving images captured in steps ST21 to ST23, the shooting positions recorded in steps ST21 to ST23, the occlusion feeling index recorded in steps ST21 to ST23, and the shooting date and time. In response to this transmission instruction, the communication interface 115 transmits the moving image information to the server device 200. The transmitted moving image information is received by the communication interface 205 of the server device 200. After the process of step ST24, the processor 111 returns to step ST11.

[0074] As described above, by performing the process of step ST24, the processor 111 functions as an example of a transmission unit that transmits the moving image captured by the imaging unit to the server device. Alternatively, the processor 111 functions as an example of a transmission unit by performing the process of step ST24 in cooperation with the communication interface 115.

[0075] On the other hand, when the moving image information is received while the processor 201 of the server device 200 is in a waiting state repeating steps ST51 to ST53 in FIG. 5, the processor 201 determines Yes in step ST53 and proceeds to step ST57.

[0076] In step ST57, the processor 201 newly issues a moving image ID. Then, the processor 201 associates the moving image ID, the moving image data, the shooting position information, and the situation information and stores them in the moving image DB. The moving image data is the data of the moving image included in the moving image information received in step ST53. The shooting position information is based on the shooting position included in the moving image information. The situation information includes the occlusion feeling index and the shooting date and time included in the moving image information. After the process of step ST57, the processor 201 returns to step ST51.

[0077] As described above, the processor 201 functions as an example of a storage unit that stores the moving image transmitted by the transmission unit by performing the process of step ST57. Alternatively, the processor 201 functions as an example of a storage unit by performing the process of step ST57 in cooperation with the auxiliary storage device 204. Alternatively, the auxiliary storage device 204 functions as an example of a storage unit.

[0078] The display control system 1 according to the embodiment proposes to display a moving image in the vehicle interior when the sense of stuffiness felt by a person in the vehicle is higher than a predetermined level. Further, the display control system 1 according to the embodiment displays a moving image in the vehicle interior when the sense of stuffiness felt by a person in the vehicle is higher than a predetermined level. Thereby, the display control system 1 according to the embodiment can reduce the sense of stuffiness felt by a person in the vehicle. Therefore, the display control system 1 according to the embodiment can improve the comfort of the vehicle interior space.

[0079] Further, the display control system 1 according to the embodiment displays a relaxing moving image in the vehicle interior. By displaying such a moving image, the display control system 1 according to the embodiment can reduce the sense of stuffiness felt by a person in the vehicle.

[0080] A relaxing moving image is, for example, a moving image depicting nature, a moving image without dialogue, or a moving image in which no person is shown. By displaying such a moving image, the display control system 1 according to the embodiment can reduce the sense of stuffiness felt by a person in the vehicle.

[0081] Further, the display control system 1 according to the embodiment estimates the degree of stuffiness to be higher as the weather at the current position of the vehicle 100 is worse, as the traffic congestion on the road on which the vehicle 100 is traveling is higher, as the degree of traffic jam on the road on which the vehicle 100 is traveling is worse, as the road surface condition of the road on which the vehicle 100 is traveling is worse, as the ratio of the sky visible from the vehicle 100 is smaller, as the brightness around the vehicle 100 is darker, or as the distance to the objects around the vehicle 100 is shorter. By doing so, the display control system 1 according to the embodiment can estimate the stuffiness felt by the person inside the vehicle.

[0082] Further, the display control system 1 according to the embodiment displays a moving image previously captured at the current position of the vehicle 100 in a situation where the stuffiness felt by the person inside the vehicle is lower than a predetermined level. Thereby, the person inside the vehicle can view the scenery outside the vehicle captured in a situation where the stuffiness is low even in a situation where the stuffiness is high. Therefore, the display control system 1 according to the embodiment can reduce the stuffiness felt by the person inside the vehicle.

[0083] Further, when the stuffiness felt by the person inside the vehicle is lower than a predetermined level, the display control system 1 according to the embodiment captures the outside of the vehicle 100. Further, the display control system 1 according to the embodiment uploads the captured moving image to the server device 200. Thereby, vehicles other than the vehicle 100 can acquire and display the moving image from the server device 200.

[0084] Further, when capturing the outside of the vehicle 100, the display control system 1 according to the embodiment records so that the captured position can be known. Further, the display control system 1 according to the embodiment uploads the record to the server device 200. Thereby, when a vehicle other than the vehicle 100 travels to the same position where the vehicle 100 captured the moving image, the vehicle can acquire and display the moving image from the server device 200.

[0085] The above embodiments can be modified as follows.

[0086] In the above-described embodiment, the processor 111 of the control device 110 acquires a moving image captured at the same position as the current position of the vehicle 100. However, the processor 111 may acquire a moving image captured under a situation where conditions other than the position match. For example, the processor 111 may acquire a moving image that satisfies at least any one of the following conditions (C1) to (C5).

[0087] (C1) It was captured at or near the current position of the vehicle 100. (C2) It was captured under the same or similar weather as the weather at the current position of the vehicle 100. (C3) It was captured in the same season as the current date and time. (C4) It was captured at the same time period as the current date and time. (C5) It was captured in the same time zone as the current date and time.

[0088] The processor 111 of the control device 110 may record the weather at the time of capturing the moving image. In this case, the moving image information includes the weather. Further, the situation information includes the weather.

[0089] In the above-described embodiment, when the processor 111 of the control device 110 determines Yes in step ST13, it proceeds to step ST14. However, when the processor 111 determines Yes in step ST13, it may proceed to step ST16.

[0090] In the display control system 1 in the above-described embodiment, the moving image to be displayed is automatically determined. However, in the display control system 1 of the embodiment, the operator of the control device 110 may be able to select the moving image to be displayed from among a plurality of moving images.

[0091] A part of the processing executed by the control device 110 in the above-described embodiment may be executed by the server device 200. Therefore, the server device 200 is an example of a display control device. A part of the processing executed by the server device 110 in the above-described embodiment may be executed by the control device 200.

[0092] Each device of the embodiment may be composed of a plurality of devices.

[0093] Processor 111 and processor 201 may implement part or all of the processing realized by the program in the above embodiment by the hardware configuration of the circuit.

[0094] The program for realizing the processing of the embodiment is transferred, for example, in a state stored in a non-temporary computer-readable storage medium in the device. However, the device may be transferred without the program being stored. And the program may be transferred separately and written into the device. The transfer of the program at this time can be realized, for example, by recording it on a removable non-temporary computer-readable storage medium or by downloading via a network such as the Internet or a LAN.

[0095] As described above, the embodiments of the present invention have been described, but they are shown as examples and do not limit the scope of the present invention. The embodiments of the present invention can be implemented in various modes without departing from the gist of the present invention.

Explanation of Signs

[0096] 1 Display control system 100 Vehicle 110 Control device 111, 201 Processor 112, 202 ROM 113, 203 RAM 114, 204 Auxiliary storage device 115, 205 Communication interface 116 Display device 117 Input device 118 Positioning device 119, 206 Bus 120 Display 130 External vehicle sensor 140 Camera 200 Server device

Claims

1. An estimation unit that estimates the height of the sense of confinement felt by a person in the vehicle cabin, A display control device comprising: a display control unit that, when the height of the sense of confinement is equal to or greater than a predetermined value, controls a display device to display a moving image in the vehicle cabin and / or proposes to the person to display the moving image in the vehicle cabin.

2. The display control device according to claim 1, wherein the moving image is a moving image depicting nature, a moving image without dialogue, or a moving image in which no person is shown.

3. The display control device according to claim 1, wherein the estimation unit estimates the height of the sense of confinement on the assumption that the sense of confinement increases as the weather at the current position of the vehicle worsens, as the traffic congestion on the road on which the vehicle is traveling increases, as the degree of traffic jam on the road on which the vehicle is traveling worsens, as the road surface condition on the road on which the vehicle is traveling deteriorates, as the proportion of the sky visible from the vehicle decreases, as the brightness around the vehicle darkens, or as the distance to the objects around the vehicle decreases.

4. The display control device according to claim 1, further comprising a position acquisition unit that acquires position information indicating the current position of the vehicle, wherein the moving image is a moving image previously captured at the current position in a situation where the sense of confinement is lower than a predetermined value.

5. The display control device according to claim 1, further comprising: a photographing unit that photographs the outside of the vehicle when the height of the sense of confinement is lower than a predetermined value; a transmission unit that transmits a moving image photographed by the photographing unit to a server device.

6. The display control device according to claim 5, further comprising a position recording unit that records the position where the photographing by the photographing unit was performed, wherein the transmission unit transmits the position recorded by the position recording unit to the server device.

7. Including a display control device and a server device, wherein the display control device comprises: an estimation unit that estimates the height of the sense of confinement felt by a person in the vehicle cabin; a display control unit that, when the height of the sense of confinement is equal to or greater than a predetermined value, controls a display device to display a moving image in the vehicle cabin and / or proposes to the person to display the moving image in the vehicle cabin; a photographing unit that photographs the outside of the vehicle when the height of the sense of confinement is lower than a predetermined value; a transmission unit that transmits a moving image photographed by the photographing unit to the server device. A display control system, wherein the server device includes a storage unit that stores the moving image transmitted by the transmission unit. **Claim 8** A program that causes a processor included in a display control device to function as: an estimation unit that estimates the height of the sense of stuffiness felt by a person in the vehicle interior; and a display control unit that, when the height of the sense of stuffiness is equal to or greater than a predetermined value, controls a display device to display a moving image in the vehicle interior and / or proposes to the person to display the moving image in the vehicle interior. **Claim 9** A display control method for estimating the height of the sense of stuffiness felt by a person in the vehicle interior and, when the height of the sense of stuffiness is equal to or greater than a predetermined value, controlling a display device to display a moving image in the vehicle interior and / or proposing to the person to display the moving image in the vehicle interior. ​

Images