Cabin environment control device and cabin environment control method

Abstract

To provide a cabin environment control device and a cabin environment control method which can appropriately perform cabin environment control for a user when contents are given in the cabin.SOLUTION: A cabin environment control device comprises: a specification part which specifies scenes contained in contents which are given to a user using a vehicle; and an environment control part which performs environment control in a cabin. The environment control part controls, when image information is not provided to the user in the cabin, environment in the cabin based on a first environment setting information set in advance by the user, and controls, when contents is provided to the user, environment in the cabin based on a second environment setting information where the first environment setting information is varied at a degree of change according to the scene.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an interior environment control device and an interior environment control method. [Background technology]

[0002] Conventionally, a technique has been disclosed for controlling seats and air conditioning in a vehicle cabin in accordance with a video scene displayed on an in-vehicle display device (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2020-188390 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, in conventional technology, fixed changes in the in-car environment corresponding to the video scene are made without taking into account the in-car environment, such as air conditioning, that the user has set in advance, so the magnitude of the change in the environment can make the user feel uncomfortable and can reduce the sense of immersion in the content, such as the video.

[0005] The present invention has been made taking such circumstances into consideration, and one of its objectives is to provide an in-vehicle environment control device and an in-vehicle environment control method that can provide more appropriate in-vehicle environment control to a user when providing content in a vehicle. [Means for solving the problem]

[0006] The vehicle interior environment control device and vehicle interior environment control method according to the present invention employ the following configuration. (1): An in-vehicle environment control device according to one embodiment of the present invention includes an identification unit that identifies a scene included in content provided to a user using a vehicle, and an environment control unit that controls the environment within the vehicle cabin, wherein the environment control unit controls the environment within the vehicle cabin based on first environment setting information previously set by the user when no video information is provided to the user within the vehicle cabin, and controls the environment within the vehicle cabin based on second environment setting information that is changed based on the first environment setting information with a degree of change corresponding to the scene when content is provided to the user.

[0007] (2): In the above aspect (1), the environmental control includes air conditioning control, and the first environmental setting information and the second environmental setting information include at least one of temperature information, air volume information, and position information of an air outlet provided in the vehicle cabin.

[0008] (3): In the above aspect (1), the environmental control unit sets the second environmental setting information for each scene included in the content, and controls the environment inside the vehicle cabin based on the second environmental setting information corresponding to the scene.

[0009] (4): In the above aspect (1), the environmental control unit controls the environment within the vehicle cabin based on the second environmental setting information for a predetermined period of time including the point at which the scene included in the content changes.

[0010] (5): In the above aspect (1), the vehicle further includes a user state detection unit that detects the state of the user in the vehicle cabin, and the identification unit identifies the scene of the content being provided to the user in accordance with the facial expression of the user detected by the user state detection unit.

[0011] (6): In the above aspect (1), the environmental control unit controls the second environmental setting information, which is changed based on the first environmental setting information at a degree of change according to the scene, so that it does not exceed a preset settable range.

[0012] (7): In the above aspect (1), when providing content to the user, the environmental control unit performs at least one of a shading control for shading light from entering the vehicle interior and a noise suppression control for suppressing noise from outside the vehicle.

[0013] (8) In the above aspect (1), the environmental control unit controls the vehicle so that it cannot travel while the content is being provided to the user.

[0014] (9): A vehicle environment control method according to one embodiment of the present invention is a vehicle environment control method in which a computer identifies a scene included in content provided to a user using a vehicle, controls the environment in the vehicle cabin, and, when no video information is provided to the user in the vehicle cabin, controls the environment in the vehicle cabin based on first environment setting information set in advance by the user, and, when content is provided to the user, controls the environment in the vehicle cabin based on second environment setting information that is changed based on the first environment setting information with a degree of change corresponding to the scene. Effect of the Invention

[0015] According to the above aspects (1) to (9), when content is provided in a vehicle, more appropriate vehicle environment control can be performed for the user. [Brief description of the drawings]

[0016] [Figure 1] 1 is a diagram showing an example of a configuration of a vehicle system 1 including an interior environment control device according to an embodiment. [Diagram 2] 13 is a diagram for explaining the contents of first environmental setting information 152. FIG. [Diagram 3] FIG. 11 is a diagram for explaining scene-specific adjustment data 154. [Figure 4] 13 is a diagram for explaining a setting example when the second environmental setting information exceeds a settable range. FIG. [Diagram 5]FIG. 2 is a diagram for explaining a first environmental control in the embodiment. [Figure 6] FIG. 11 is a diagram for explaining a second environmental control in the embodiment. [Figure 7] 4 is a flowchart illustrating an example of a process executed by the vehicle interior environment control device according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0017] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, an embodiment of an in-vehicle environment control device and an in-vehicle environment control method of the present invention will be described with reference to the drawings.

[0018] FIG. 1 is a diagram showing an example of the configuration of a vehicle system 1 including an in-vehicle environment control device according to an embodiment. The vehicle on which the vehicle system 1 is mounted is, for example, a two-wheeled, three-wheeled, or four-wheeled vehicle, and the driving source is an internal combustion engine such as a diesel engine or a gasoline engine, an electric motor, or a combination of these. The electric motor operates using power generated by a generator connected to the internal combustion engine, or discharged power from a secondary battery or a fuel cell. The vehicle system 1 includes, for example, a communication device 10, an HMI 20, a vehicle sensor 30, an air conditioner 40, a lighting device 50, a shading device 60, a noise canceller 70, an in-vehicle camera 80, and a vehicle control device 100. These devices and equipment are connected to each other by a multiplex communication line such as a CAN (Controller Area Network) communication line, a serial communication line, a wireless communication network, or the like. Note that the configuration shown in FIG. 1 is merely an example, and part of the configuration may be omitted, or another configuration may be added. For example, the vehicle system 1 is provided with a driving operator for driving the vehicle, a driving force output device and a brake device for controlling the speed of the vehicle, a steering device for controlling the steering of the vehicle, etc. The in-vehicle camera 80 is an example of a "user state detection unit" that detects the state of a user U in the vehicle.

[0019] The communication device 10 includes, for example, a TCU (Telematics Control Unit). The communication device 10 communicates with a content server 200 and a terminal device 300 used by a user U who uses a vehicle, using a network such as a cellular network, a Wi-Fi network, Bluetooth (registered trademark), DSRC (Dedicated Short Range Communication), the Internet, a Wide Area Network (WAN), a Local Area Network (LAN), a public line, a provider device, a dedicated line, a wireless base station, or the like. The communication device 10 may perform wireless communication with the terminal device 300 through a short-distance communication network such as a Wi-Fi network or Bluetooth, or may perform wired communication with the terminal device 300 by being connected with a communication cable. The content server 200 may be, for example, a DB (Database) server, or may be a cloud server configured by cloud computing including one or more information processing devices. The content server 200 provides various contents (for example, video (video) content, image content, and audio (music) content) to a vehicle equipped with the vehicle system 1. The video content may include, for example, video provided by game content (applications) and the like. The terminal device 300 is, for example, a smartphone or a tablet terminal. The terminal device 300 includes at least a communication unit capable of communicating with the communication device 10 and the content server 200, a display unit for displaying various contents provided from the vehicle system 1 or the content server 200, a speaker for outputting sound, and the like.

[0020] The HMI 20 presents various information to a user U who is in the vehicle and accepts input operations by the user U. The HMI 20 includes, for example, a display unit 22 and a speaker 24. The display unit 22 is, for example, a liquid crystal display (LCD) or an organic EL (Electro Luminescence) display. The display unit 22 is, for example, a display device provided in the center of an instrument panel of the vehicle or in front of the driver's seat, which displays various information about the vehicle, such as a speedometer indicating the traveling speed of the vehicle or a tachometer indicating the number of revolutions (rotation speed) of an internal combustion engine provided in the vehicle, and is a so-called multi-information display. The display unit 22 may be a projection device that projects an image on a side surface or a predetermined area in the vehicle cabin, or may be a head up display (HUD) or the like. One or more speakers 24 are attached to any position in the vehicle cabin and output various sounds. The HMI 20 may also include a switch, a buzzer, a touch panel, a microphone, a key, and the like. The HMI 20 receives, for example, input of various information (for example, first environmental setting information described below and content to be viewed) from a user U. The HMI 20 outputs video and audio corresponding to the content.

[0021] The vehicle sensor 30 includes a vehicle speed sensor that detects the speed of the vehicle, an acceleration sensor that detects the acceleration, a yaw rate sensor that detects the angular velocity around a vertical axis, a steering angle sensor that detects the steering angle, and the like. The vehicle sensor 30 may also include a position sensor that acquires the position of the vehicle. The position sensor is, for example, a sensor that acquires position information (longitude and latitude information) from a GNSS (Global Navigation Satellite System) receiver (not shown) or the like provided in the vehicle system 1. The vehicle sensor 30 may also include a temperature sensor that detects the temperature in the vehicle cabin, an illuminance sensor that detects the illuminance, a noise sensor that detects the amount of noise (crowded noise and noise) outside the vehicle, and the like. The vehicle sensor 30 may also include an air volume sensor that detects the air volume by the air conditioning device 40. Information detected by the vehicle sensor 30 is output to the vehicle control device 100.

[0022] The air conditioner 40 is, for example, an air conditioner. The air conditioner 40 is provided, for example, in an engine room of a vehicle, and supplies conditioned air from a plurality of air outlets provided at any position, such as an instrument panel, a footwell, or a ceiling, to control the air conditioning in the vehicle cabin. Specifically, the air conditioner 40 supplies hot air or cold air into the vehicle cabin, for example, under the control of an air conditioning control unit described later, so that the temperature in the vehicle cabin (the temperature detected by a temperature sensor) becomes a temperature included in the environmental setting information (first environmental setting information) set by the user U. The first environmental setting information includes, for example, at least one of temperature information, air volume level (an example of air volume information), and position information of the air outlet that supplies the conditioned air (which may include the wind direction). When the first environmental setting information includes an air volume level, the air conditioner 40 supplies conditioned air at a volume corresponding to the air volume level, and when the first environmental setting information includes the position information of the air outlet, the air conditioner supplies the conditioned air from that position. In addition to the above contents, the first environmental setting information may include setting information of the user U regarding the brightness (illuminance level) in the vehicle cabin and the like.

[0023] The lighting device 50 controls the lighting in the vehicle cabin. For example, the lighting device 50 includes a light source unit that emits light in a predetermined color on the upper part (ceiling), side parts, lower part (foot space), etc. of the vehicle cabin. For example, the lighting device 50 turns on (or off) the light source unit under the control of a lighting control unit described later so that the illuminance in the vehicle cabin (illuminance detected by an illuminance sensor) becomes the illuminance level included in the first environmental setting information.

[0024] The shading device 60 is, for example, a sunshade, and is provided on the inside of the window glass (windshield) in front of, on the side of, or behind the driver's seat. For example, the shading member is opened and closed by operating a switch provided on the HMI 20. When the shading device 60 performs control to close the shading member, the shading member covers the inside of the window glass to block or suppress sunlight entering the vehicle, and when the shading device 60 performs control to open the shading member, the shading member allows light to enter through the window glass of the vehicle. The shading device 60 may be a device that controls the light transmittance of the window glass. When the shading member is closed or the transmittance is controlled to be lowered, it becomes difficult to see inside the vehicle cabin from the outside. In addition, in the embodiment, it may be difficult to see outside the vehicle from inside the vehicle cabin when the vehicle is not running.

[0025] The noise canceller 70 performs control to suppress noise outside the vehicle (such as crowd noise and other noise) in the vehicle cabin, for example. For example, the noise canceller 70 analyzes sounds collected from a microphone inside the vehicle to estimate noise outside the vehicle, and generates another sound in the opposite phase to the estimated noise and outputs it from the speaker 24 to suppress the noise outside the vehicle. The noise canceller 70 may also suppress the noise outside the vehicle by, for example, adjusting the volume of the video content (by increasing the volume or adjusting the directionality of the sound).

[0026] The interior camera 80 is, for example, a digital camera using a solid-state imaging element such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor). The interior camera 80 is a camera for capturing images of objects placed inside the vehicle cabin. The interior camera 80 is attached, for example, to any location capable of capturing an image of the interior of the vehicle cabin. The interior camera 80 captures an image of the interior of the vehicle cabin at a predetermined timing or periodically and repeatedly. The interior camera 80 may be a stereo camera.

[0027] The vehicle control device 100 includes, for example, an acquisition unit 110, a provision unit 120, a specification unit 130, an environment control unit 140, and a storage unit 150. Some or all of the acquisition unit 110, the specification unit 130, the provision unit 120, and the environment control unit 140 are realized by, for example, a hardware processor such as a CPU (Central Processing Unit) executing a program (software). Some or all of these components may be realized by hardware (including circuitry) such as an LSI (Large Scale Integration), an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), or a GPU (Graphics Processing Unit), or may be realized by cooperation between software and hardware. The program may be stored in advance in a storage device (a storage device having a non-transient storage medium) such as an HDD or a flash memory of the vehicle control device 100, or may be stored in a removable storage medium such as a DVD or a CD-ROM, and may be installed in the HDD (Hard Disk Drive) or the flash memory of the vehicle control device 100 by mounting the storage medium (non-transient storage medium) in a drive device. For example, the HMI 20, the vehicle sensor 30, the air conditioning device 40, the lighting device 50, the shading device 60, the noise canceller 70, the in-vehicle camera 80, the acquisition unit 110, the identification unit 130, the environment control unit 140, and the storage unit 150 are examples of an "in-vehicle environment control device."

[0028] The storage unit 150 is realized by, for example, a HDD, a flash memory, an EEPROM (Electrically Erasable Programmable Read Only Memory), a ROM (Read Only Memory), a RAM (Random Access Memory), etc. The storage unit 150 stores, for example, first environmental setting information 152, scene-specific adjustment data 154, content data 156, programs, and various other information.

[0029] FIG. 2 is a diagram for explaining the contents of the first environment setting information 152. The first environment setting information 152 shown in FIG. 2 includes, for example, temperature information, an air volume level, and air outlet position information, and may include at least one of these. The temperature information is the temperature in the vehicle interior desired by the user U. The air volume level is an index value indicating the magnitude of the air volume of the conditioned air supplied to the vehicle interior. In the embodiment, the larger the value of the air volume level, the larger the air volume. The air outlet position information is information regarding the position, number, and wind direction of the air outlet that actually blows out the conditioned air among a plurality of air outlets that are installed in advance in the vehicle interior and that can blow out the conditioned air. In addition to the above information, the first environment setting information 152 may include, for example, information regarding the illuminance level in the vehicle interior, information indicating whether or not to perform shading control, and information indicating whether or not to perform noise suppression control. These pieces of information are set by the user U via the HMI 20. In addition, the first environment setting information 152 may be notified to the user U from the providing unit 120 so that the setting is completed before the content is provided to the user U.

[0030] FIG. 3 is a diagram for explaining the scene-specific adjustment data 154. In the scene-specific adjustment data 154, for example, environmental change degree information is associated with a scene type. The environmental change degree information includes, for example, a temperature change degree [°C], an airflow level change degree, and an air outlet change degree. The temperature change degree is a temperature change amount (increase or decrease value) based on the temperature information of the first environmental setting information 152. For example, "±0" shown in FIG. 3 indicates that there is no temperature change. The airflow level change degree is an airflow change amount (increase or decrease value) based on the airflow level of the first environmental setting information 152. The air outlet position change degree indicates, for example, the change in the position, number, and wind direction of the air outlet. For example, the change in the air outlet position is information indicating how much the position is increased or decreased on either side of the position or number stored in the air outlet position information of the first environmental setting information 152. For example, "+1" shown in FIG. 3 indicates that any position is acceptable, and that the number of air outlets is increased by one from the current number. Also, when "right air outlet" is set, it indicates that an air outlet on the right side of the cabin is added based on the position of the riding user U (facing forward when seated in the seat). Also, "Air direction: left" indicates that conditioned air is supplied from the air outlet to the left.

[0031] The environmental change degree information may include information indicating that the air conditioning is to be turned off. The environmental change degree information may also include change degree information related to lighting (increase or decrease value based on the illuminance level of the first environmental setting information). The environmental change degree information may be set in advance to a degree of change that is assumed not to cause discomfort to humans, or may be set by the user U. By the user U setting the degree of change, it is possible to predict the degree of environmental change in advance, so that even if the environment actually changes, it is possible to prevent the sense of immersion in the content from being lost. When the user U sets the degree of change, it may be limited so as not to exceed a predetermined changeable range.

[0032] The content data 156 is various content provided by the content server 200 or content previously stored in the vehicle. The content data 156 may be appropriately updated by communication between the communication device 10 and the content server 200.

[0033] The acquisition unit 110 acquires first environmental setting information 152 received by the HMI 20 or the terminal device 300 connected to the vehicle. The acquired first environmental setting information 152 is stored in the storage unit 150. The acquisition unit 110 also acquires various contents from the content server 200, and stores the acquired contents in the storage unit 150 as content data 156.

[0034] The providing unit 120 provides content to a user U who is in a vehicle. For example, the providing unit 120 acquires content designated by the user U from the content server 200 or the content data 156 using the HMI 20 or the terminal device 300 connected to the vehicle system 1, and outputs the acquired content from the HMI 20 or the terminal device 300.

[0035] The identification unit 130 identifies a scene included in the content (e.g., video content, image content, audio content) provided to the user U who uses the vehicle. For example, when the content is a video, the identification unit 130 performs existing image analysis processing on each image frame (or image frames at a predetermined interval) included in the video information to extract feature information of the image, and identifies the scene of the video based on the extracted feature information. For example, the identification unit 130 may identify a scene related to a location such as a desert, snowfall, sea, mountain, cave, etc. from the feature information, identify a scene related to a movement such as rightward movement or leftward movement from the feature information of the time-series image frames, or identify a scene related to a genre such as horror, sports, adventure, suspense, etc. Furthermore, the identification unit 130 may analyze the image of the image content to identify the scene of the image.

[0036] Furthermore, instead of (or in addition to) analyzing the video, the identification unit 130 may perform existing audio analysis processing on the audio output in accordance with the video to extract feature information of the audio, and identify the scene of the video based on the extracted feature information. For example, if the video contains audio such as a scream, the identification unit 130 identifies it as a horror scene, and if it contains a loud wind noise, the identification unit 130 identifies it as a storm scene. In the case of audio content, the identification unit 130 identifies the scene of the audio being played by the above-mentioned audio analysis, etc.

[0037] The identification unit 130 also analyzes the camera image captured by the in-vehicle camera 80 using existing image analysis processing, and estimates the facial expression of the user U while in the vehicle based on the analysis results. Furthermore, the identification unit 130 may characterize the scene of the video being viewed from the estimated facial expression. For example, if the user U has a scary face, the identification unit 130 identifies the video being viewed as a horror scene.

[0038] Furthermore, when tag information (meta information) indicating a scene type is previously assigned to the content, the identification unit 130 may identify the scene of the content from the assigned information. Note that the tag information is assigned together with, for example, playback time (timestamp) information of the video content, so that multiple scenes included in the video content can be identified.

[0039] The environment control unit 140 controls the environment in the vehicle cabin. The environment control unit 140 includes, for example, an air conditioning control unit 142, a lighting control unit 144, and a noise control unit 146. The air conditioning control unit 142 controls the air conditioning in the vehicle cabin by controlling the air conditioner 40. For example, when content is not provided to the user U, the air conditioning control unit 142 controls the air conditioning in the vehicle cabin based on the first environment setting information 152 set in advance by the user U. When content is provided to the user U, the air conditioning control unit 142 sets second environment setting information changed based on the first environment setting information 152 at a change degree according to the scene, and controls the air conditioning in the vehicle cabin based on the set second environment setting information. In this case, the air conditioning control unit 142 refers to the scene-specific adjustment data 154 based on the result of identifying the scene identified by the identification unit 130, and acquires change degree information corresponding to the identified scene. The air conditioning control unit 142 then controls the air conditioning in the vehicle cabin based on the second environmental setting information that is changed by the acquired degree of change, using the current environmental setting (first environmental setting information 152) as a reference.

[0040] The lighting control unit 144 controls the illumination in the vehicle cabin by controlling the lighting device 50. For example, when no content is provided to the user U, the lighting control unit 144 controls the illumination in the vehicle cabin based on the first environment setting information 152. When content is provided, the lighting control unit 144 sets second environment setting information that is changed by a degree of change according to the scene based on the first environment setting information 152 based on change degree information related to the illumination included in the scene-specific adjustment data 154, and controls the illumination in the vehicle cabin based on the set second environment setting information.

[0041] Furthermore, when content is being provided to the user U, the lighting control unit 144 may control the shading device 60 to make it difficult to see inside the vehicle cabin from the outside and / or to make it difficult to see outside the vehicle from inside the vehicle cabin when the vehicle is not moving. This allows the user U to concentrate on the content without being distracted by the outside of the vehicle, thereby further improving the sense of immersion in the content. Note that the above-mentioned shading control by the shading device 60 may be performed when the user U gets into the vehicle, or may be performed according to the scene of the content.

[0042] The noise control unit 146 controls the noise canceller 70 to suppress noise outside the vehicle in the vehicle cabin. For example, when content is provided to the user U, the noise control unit 146 operates the noise canceller 70 when the amount of noise from outside the vehicle is equal to or greater than a threshold value according to the detection result of the noise sensor, thereby suppressing noise outside the vehicle. This allows the user U to concentrate on the content without being bothered by the outside of the vehicle, thereby further improving the sense of immersion in the content. Note that the above-mentioned noise suppression control may be performed when the user U gets into the vehicle, or may be performed according to the scene of the content.

[0043] [Setting the second environment setting information] Next, a method of setting the second environment setting information based on the first environment setting information 152 will be described. For example, when the content is provided by the providing unit 120 to the user U who is in the vehicle, the environment control unit 140 acquires the environment change degree information by referring to the scene-specific adjustment data 154 based on the scene of the content identified by the identifying unit 130. Then, the environment control unit 140 sets the second environment setting information changed by the change degree of the environment change degree information based on the value set in the first environment setting information 152. This makes it possible to prevent the user U from feeling uncomfortable due to a sudden change in the environment, which may cause the user U to lose his / her immersion in the content. In addition, since a more appropriate in-vehicle environment can be provided to the user U according to the content being viewed, the immersion in the content can be further improved.

[0044] Note that when the first environmental setting information 152 is set, it is set within a preset settable range. Therefore, if the user U sets a value close to the upper or lower limit, there is a possibility that the settable range changed according to the change degree of the environmental change degree information will be exceeded. Therefore, the environmental control unit 140 controls the second environmental setting information changed according to the change degree of the environmental change degree information so that it does not exceed the settable range.

[0045] FIG. 4 is a diagram for explaining a setting example in which the second environmental setting information exceeds the settable range. In FIG. 4, the settable range (upper limit, lower limit) of the environmental setting information (for example, temperature) is shown. The first environmental setting information is set by the user U within a predetermined settable range (for example, 18 to 32 [°C]). For example, when the temperature of the first environmental setting information is 30 [°C] and the change degree of the environmental change degree information according to the scene of the content is +3 [°C], the upper limit value (18 to 32 [°C]) is exceeded. Therefore, the environmental control unit 140 (in the above example, the air conditioning control unit 142) sets a temperature with a change degree that does not exceed the upper limit value (for example, +2 [°C]) as the second environmental setting information, and performs air conditioning control to set the temperature to that temperature. This makes it possible to prevent environmental control from being performed beyond the settable range, and provide a more comfortable indoor environment.

[0046] In addition, the environment control unit 140 may set the second environment setting information by making the change amount smaller than the change degree indicated in the scene-specific adjustment data 154 when passengers other than the user U in the vehicle cabin include a child or an elderly person, or when the user U in the vehicle cabin is a child or an elderly person. The determination of whether the user is a child or an elderly person may be determined, for example, based on characteristic information (for example, body contour shape, posture, hair color, facial expression) obtained from the analysis result of the camera image of the vehicle interior camera 80, or the user U may apply for such a determination in advance. For example, in the case where an adult and a child are riding in the vehicle, the environment control unit 140 may change the degree of change of the surrounding environment between the seat position where the child rides (for example, the back seat) and the seat position where the adult rides (for example, the driver's seat). This makes it possible to provide a more appropriate environment for each user riding in the vehicle.

[0047] [Per-scene environmental control] Next, a specific example of environmental control for each scene included in the content will be described. In the following, it is assumed that the user U has already boarded the vehicle and the first environmental setting information has already been set. In the following, it is assumed that the content is video content and the environmental control is air conditioning control. FIG. 5 is a diagram for explaining the first environmental control in the embodiment. In the example of FIG. 5, switching of each scene (scenes 1, 2, 3) included in the video content over time is shown. T0, T1, T2, and T3 in FIG. 5 indicate time, with time T0 being the earliest, followed by times T1, T2, and T3 in that order. In the example of FIG. 5, times T0 to T1 are a period during which the video content is not provided, times T1 to T2 are a period during which scene 1 of the video content is provided (viewed by user U), times T2 to T3 are a period during which scene 2 of the video content is provided, and time T3 and after are a period during which scene 3 of the video content is provided. The same applies to the example of FIG. 6 described later.

[0048] During the period from time T0 to T1, the air conditioning control unit 142 performs air conditioning control in the vehicle cabin based on the first environment setting information. During the period from time T1 to T2, the air conditioning control unit 142 acquires environment change degree information corresponding to the scene 1 identified by the identification unit 130, sets second environment setting information changed by a change degree corresponding to the environment change degree information based on the value of the first environment setting information as a reference, and performs air conditioning control in the vehicle cabin based on the set information. Similarly, during the period from time T2 to T3, the air conditioning control unit 142 performs air conditioning control with the second environment setting information changed by a change degree based on the environment change degree information corresponding to the scene 2, and during the period from time T3 onwards when the scene 3 is being provided, performs air conditioning control with the second environment setting information changed by a change degree based on the environment change degree information corresponding to the scene 3. That is, in the first environment control, while the scene is being provided (viewed, played), the environment control corresponding to that scene is executed. The first environment control allows the user U to experience the environment change for each scene. This can further improve the user U's sense of immersion in the video content.

[0049] Fig. 6 is a diagram for explaining the second environmental control in the embodiment. In the second environmental control, environmental control (air conditioning control) based on the second environmental setting information is performed only during a predetermined time including a switching point. In the example of Fig. 6, the switching points are time T1, which is the start time of the video content, and times T2 and T3, which are the times when the scene switches.

[0050] During the period from time T0 to T1 (just before time T1), the air conditioning control unit 142 controls the air conditioning in the vehicle cabin based on the first environment setting information. During the period from time T1 (including time T1) until the first predetermined time has elapsed, the air conditioning control unit 142 acquires environment change degree information corresponding to scene 1 identified by the identification unit 130, sets second environment setting information changed by a change degree corresponding to the environment change degree information based on the value of the first environment setting information, and controls the air conditioning in the vehicle cabin based on the set information. The first predetermined time may be a fixed time or a variable time according to the playback time of the scene (for example, 20% of the scene playback time of 10 minutes (2 minutes)).

[0051] Thereafter, the air conditioning control unit 142 returns to the first environmental setting information and performs air conditioning control in the vehicle cabin for a period up to a second predetermined time before time T2 when the scene is switched to scene 2. The second predetermined time may be a fixed time (e.g., 5 seconds), or may be a variable time according to the type of scene after the switch or a combination of scenes before and after the switch. For example, when the second predetermined time is set to be variable, the larger the temperature change caused by the scene switch, the longer the second predetermined time is set. This makes it possible to make the temperature change immediately felt after the scene switch.

[0052] Furthermore, the air conditioning control unit 142 performs air conditioning control using the second environmental setting information changed by the degree of change based on the environmental change degree information corresponding to scene 2 during the period from the second predetermined time before time T2 until the first predetermined time has elapsed. Thereafter, the air conditioning control unit 142 performs air conditioning control in the vehicle cabin by returning to the first environmental setting information during the period from the second predetermined time before time T3 at which scene 3 is switched to until the first predetermined time has elapsed. Thereafter, similarly, the air conditioning control unit 142 performs air conditioning control in the vehicle cabin by returning to the first environmental setting information changed by the degree of change based on the environmental change degree information corresponding to scene 3 during the period from the second predetermined time before time T3 until the first predetermined time has elapsed. Furthermore, after the first predetermined time has elapsed, the air conditioning control unit 142 performs air conditioning control in the vehicle cabin by returning to the first environmental setting information.

[0053] In the case of the second environment control, it is necessary to identify the next scene (or video content) before the scene is provided. In this case, the identification unit 130 may identify the scene in advance, for example, by tag information added to the content together with a timestamp, or may pre-read the content before it is provided and identify the next scene.

[0054] According to the second environmental control described above, the control period based on the second environmental setting information is shorter than that of the first environmental control. Therefore, it is possible to suppress discomfort caused by a long period of time in which the environment is changed. In addition, since the user U is highly conscious of grasping the situation of the scene when the scene is changed, by temporarily changing the environment according to the scene for a predetermined period of time including the scene change point, it is possible to make it easier to recognize what kind of scene it is, and to further improve the sense of immersion in the video. Note that the first and second environmental controls described above may be switched according to the settings of the user U, and may be selected according to the content (for example, the genre of the entire content or the number of scenes included in the content).

[0055] [Processing flow] Next, a process executed by the vehicle interior environment control device in the embodiment will be described. In the following description, it is assumed that the user U is already in the vehicle and the first environment information has also been set (registered). FIG. 7 is a flowchart showing an example of a process executed by the vehicle interior environment control device in the embodiment. In the example of FIG. 7, the acquisition unit 110 acquires the first environment setting information (step S100). Next, the environment control unit 140 determines whether or not content has been provided to the user U by the provision unit 120 (step S110). If it is determined that content has not been provided, the environment control unit 140 executes environment control based on the first environment setting information (step S120).

[0056] If it is determined in the process of step S110 that the content is provided, the identification unit 130 identifies the scene of the content (step S130). Next, the environment control unit 140 sets the second environment setting information that is changed by a degree of change corresponding to the identified scene based on the value set in the first environment setting information (step S140), and executes environment control based on the set second environment setting information (step S150). This ends the process of this flowchart.

[0057] [Variations] In the above-described embodiment, whether the content is provided to the HMI 20 or the terminal device 300 may be set in advance by the user U, and may be selected according to the riding position of the user U riding in the vehicle, the number of passengers, and the like. For example, when the user U sits in the back seat, the providing unit 120 provides the content to the terminal device 300 because the display unit 22 in front may be difficult to see. In addition, when two users U watch in the driver's seat and the passenger seat, the providing unit 120 displays the content on the HMI 20 so that they can be viewed simultaneously. In addition, when the user U rides in the front seat and the rear seat, respectively, the providing unit 120 may provide the content to both the HMI 20 and the terminal device 300. The riding position of the user U can be confirmed, for example, by the analysis result of the camera image of the interior camera 80.

[0058] In the embodiment, the acquisition unit 110 may acquire an instruction operation by a gesture of a user in the vehicle, instead of from the HMI 20 or the terminal device 300. The gesture can be recognized, for example, from an analysis result of a camera image of the interior camera 80.

[0059] Furthermore, the environment control unit 140 may perform seat control in addition to (or instead of) the above-mentioned air conditioning control, lighting control, shading control, and noise suppression control. In this case, information on the seat position and the angle of the backrest is set in the first environment setting information, and information on the degree of change of the seat for each scene is set in the scene-specific adjustment data 154.

[0060] The service in the embodiment (environment control service tailored to content) can be provided to a user U who does not drive (or cannot drive) a vehicle. For example, a user U who does not own a vehicle can access an external server that provides car sharing or rental cars via the terminal device 300 to reserve a vehicle, get in the vehicle at the reserved place at the reserved time, set the first environment information, and select content, thereby receiving the in-vehicle environment control service tailored to the above-mentioned content.

[0061] In addition, when a user U who does not drive (or cannot drive) gets in the vehicle, in order to prevent the vehicle from moving by mistake, the environment control unit 140 may control the vehicle to be unable to move by disabling the operation of the driving operation elements (steering wheel, accelerator pedal) or by not operating the driving force output device or steering device when content is being provided. This allows the user U (especially a user who cannot drive) to use the vehicle as a private space with peace of mind.

[0062] The vehicle interior environment control device in the embodiment may be mounted on an autonomous vehicle. Autonomous driving refers to, for example, automatically controlling one or both of the steering and acceleration / deceleration of the vehicle to execute driving control. Autonomous driving allows the user U to move to a specified destination or the like without performing driving operations, and allows the user U to view content and receive a vehicle interior environment control service according to the content until the user U arrives at the destination.

[0063] According to the embodiment described above, the vehicle interior environment control device includes an identification unit 130 that identifies a scene included in the content provided to the user U using the vehicle, and an environment control unit 140 that controls the environment in the vehicle interior. When the content is not provided to the user U in the vehicle interior, the environment control unit 140 controls the environment in the vehicle interior based on the first environment setting information previously set by the user U, and when the content is provided to the user U, the environment control unit 140 controls the environment in the vehicle interior based on the second environment setting information that is changed based on the first environment setting information by a degree of change according to the scene, thereby performing more appropriate environment control for the user when the content is provided. Therefore, the user's immersion in the content can be further improved.

[0064] Specifically, in the embodiment, the video content provided to the vehicle is analyzed to determine a value to be increased or decreased from the first environment setting information, and the environment control for each scene is performed based on the second environment setting information changed by the determined value. As a result, for example, when the scene switches to a snowy mountain, it is possible to control so that cold air flows into the vehicle, so that a natural change in the environment that matches the content can be given to the user U. Therefore, the user U can feel more immersed in the content. Since the comfort caused by this change in environment is different from the comfort when driving, a service with higher added value can be provided using the vehicle system.

[0065] According to the embodiment, a private content viewing space using a vehicle can be provided to the user U, so that the user can effectively use a few hours of free time without moving to a special place. Furthermore, according to the embodiment, a shading control and a noise suppression control are performed on the vehicle, so that an environment that makes it easy to concentrate on the content can be created. According to the embodiment, the user U who cannot drive a vehicle can also use the vehicle, so that the vehicle can be used more effectively.

[0066] The above-described embodiment can be expressed as follows. a storage medium for storing computer-readable instructions; a processor coupled to the storage medium; The processor executes the computer-readable instructions to: Identifying a scene included in content provided to a user who uses a vehicle; Control the vehicle interior environment, When video information is not provided to the user in the vehicle cabin, the vehicle cabin environment is controlled based on first environment setting information preset by the user; When content is provided to the user, the vehicle interior environment is controlled based on second environment setting information that is changed based on the first environment setting information by a degree of change corresponding to the scene. Vehicle climate control system.

[0067] The above describes the form for carrying out the present invention using an embodiment, but the present invention is not limited to such an embodiment, and various modifications and substitutions can be made within the scope that does not deviate from the gist of the present invention. [Explanation of symbols]

[0068] 1...vehicle system, 10...communication device, 20...HMI, 30...vehicle sensor, 40...air conditioning device, 50...lighting device, 60...shading device, 70...noise canceller, 80...in-vehicle camera, 100...vehicle control device, 110...acquisition unit, 120...provision unit, 130...identification unit, 140...environment control unit, 142...air conditioning control unit, 144...lighting control unit, 146...noise control unit

Claims

1. an identification unit that identifies a scene included in content provided to a user who uses a vehicle; An environmental control unit that controls an environment in a vehicle cabin, The environmental control unit includes: When video information is not provided to a user in the vehicle cabin, the vehicle cabin environment is controlled based on first environment setting information preset by the user; When content is provided to the user, the vehicle interior environment is controlled based on second environmental setting information that is changed based on the first environmental setting information by a degree of change corresponding to the scene. Vehicle climate control system.

2. the environmental control includes air conditioning control; The first environmental setting information and the second environmental setting information include at least one of temperature information, air volume information, and position information of an air outlet provided in the vehicle compartment. The vehicle interior climate control system according to claim 1 .

3. the environment control unit sets the second environment setting information for each scene included in the content, and controls an environment in the vehicle cabin based on the second environment setting information corresponding to the scene. The vehicle climate control system according to claim 1 .

4. the environmental control unit controls the environment in the vehicle cabin based on the second environmental setting information for a predetermined time period including a point at which a scene included in the content is changed. The vehicle interior climate control system according to claim 1 .

5. A user state detection unit that detects a state of a user in the vehicle cabin is further provided, The identification unit identifies a scene of the content being provided to the user in accordance with a facial expression of the user detected by the user state detection unit. The vehicle climate control system according to claim 1 .

6. the environment control unit controls the second environment setting information, which is changed based on the first environment setting information at a degree of change corresponding to the scene, so as not to exceed a preset settable range. The vehicle climate control system according to claim 1 .

7. The environment control unit performs at least one of a light blocking control for blocking light from entering the vehicle interior and a noise suppression control for suppressing noise from outside the vehicle when providing content to the user. The vehicle climate control system according to claim 1 .

8. the environmental control unit controls the vehicle so as not to be able to run while the content is being provided to the user; The vehicle climate control system according to claim 1 .

9. The computer Identifying a scene included in content provided to a user who uses a vehicle; Control the vehicle interior environment, When video information is not provided to a user in the vehicle cabin, the vehicle cabin environment is controlled based on first environment setting information preset by the user; When content is provided to the user, the vehicle interior environment is controlled based on second environmental setting information that is changed based on the first environmental setting information by a degree of change corresponding to the scene. A method for controlling the interior environment of a vehicle.

Images