Mood roof for an enhanced media experience inside the vehicle cabin

Abstract

To provide a moodroof for an augmented media experience in a vehicle cabin.SOLUTION: In various embodiments, a moodroof media application provides media content into a vehicle cabin. In operation, the moodroof media application determines at least one state associated with the vehicle cabin on the basis of sensor data from at least one sensor. The moodroof media application then receives media content associated with the at least one state. The moodroof media application further causes visual content associated with the media content to be displayed on at least one display surface positioned on a ceiling of the vehicle cabin.SELECTED DRAWING: Figure 5A

Description

Technical Field

[0001] Cross - Reference to Related Applications This application claims priority to U.S. Provisional Patent Application No. 62 / 613,709, filed on January 4, 2018, entitled "Configurable Moodroof for Augmented Spatial Audio / Video Experience". The subject matter of this related application is hereby incorporated by reference in its entirety.

[0002] Field of Various Embodiments Various embodiments generally relate to media systems, and more specifically to moodroofs for an enhanced media experience within a vehicle cabin.

Background Art

[0003] Description of Related Technologies Vehicles typically include a media system that provides audio and / or video information and entertainment to the vehicle's occupants. For example, an audio system generally enables an occupant to receive audio content from the radio, participate in a cellular phone conversation, receive navigation instructions from a navigation subsystem, receive safety warnings from an Advanced Driver Assistance System (ADAS), etc. Similarly, a visual system generally enables an occupant to view information related to audio content, view a map from a navigation subsystem, receive safety - related warnings from an ADAS, etc.

[0004] Typically, an in-vehicle visual system can include a display on the dashboard above the center console and can further include one or more additional displays on the rear surface of the seat headrest. The dashboard display, which can be a component of an in-vehicle entertainment information system, is typically connected to the head unit via a wired interface. The dashboard display displays content received from the head unit, which includes, but is not limited to, vehicle information, one or more user interfaces for controlling specific vehicle functions, audio content information, and entertainment content. The headrest display may be connected to the head unit via a wired or wireless interface, or may operate independently of the head unit. The headrest display can display content received from the head unit (such as entertainment content) or content received from another device connected to the headrest display (such as an optical disc player).

[0005] One drawback of such media systems is that, often, the displays cannot provide an immersive media experience. For example, the dashboard and headrest displays are relatively small and / or are implemented to display vehicle information to the driver, so the screens typically do not provide an immersive visual experience to the vehicle occupants. As a result, vehicle occupants often have to rely on the visual experience provided by the external environment of the vehicle, such as looking through the vehicle's windows. However, in many situations, the external environment can provide unpleasant visual and / or auditory experiences for vehicle occupants. For example, when the vehicle is caught in traffic congestion and / or when the external weather is bad, the visual and / or auditory experiences provided by the environment can have an adverse effect on the emotional state of the occupants. As a result, riding in the vehicle can be a less enjoyable experience for the occupants.

[0006] As described above, to provide a positive media experience for the occupants within the vehicle cabin Effective technologies are needed.

SUMMARY OF THE INVENTION

MEANS FOR SOLVING THE PROBLEM

[0007] One embodiment describes a method for displaying media content within a vehicle cabin. The method includes determining at least one state related to the vehicle cabin based on sensor data from at least one sensor, receiving media content related to the at least one state, and displaying visual content related to the media content on at least one display surface disposed on the ceiling within the vehicle cabin.

[0008] A further embodiment provides, among other things, a system configured to implement the above-described method and one or more computer-readable storage media.

[0009] At least one of the advantages and technological improvements of the disclosed technology is that the ceiling within the vehicle cabin can be opened to allow natural light and air to flow into the vehicle cabin, while at the same time the ceiling can be used as a display space for displaying media content to the occupants within the vehicle cabin.

[0010] A more detailed description of the concepts of the present invention, briefly summarized above, so that the above features of the various embodiments can be understood in detail, is obtained by referring to the various embodiments, some of which are illustrated in the accompanying drawings. However, the accompanying drawings merely illustrate typical embodiments of the concepts of the present invention and should therefore in no way be considered as limiting the scope, and it should be noted that there are other equally effective embodiments. The present invention provides, for example, the following. (Item 1) Determining at least one state related to the vehicle cabin based on sensor data from at least one sensor; Receiving media content related to the at least one state; Causing visual content related to the media content to be displayed on at least one display surface disposed on the ceiling within the vehicle cabin; A method executed by a computer for presenting media content within the vehicle cabin, including the above. (Item 2) The method according to the above item, wherein the at least one display surface is disposed vertically below a sunroof of the vehicle cabin. (Item 3) The method according to any one of the above items, wherein the at least one sensor includes at least one of a vehicle sensor, an environmental sensor, and a biosensor. (Item 4) The method according to any one of the above items, wherein the at least one state includes at least one of a vehicle state, an environmental state, and an emotional state of an occupant of the vehicle cabin. (Item 5) The method according to any one of the above items, wherein the at least one display surface includes a first display device and a second display device, the first display device is adjacent to the second display surface, and both the first display surface and the second display device display the visual content toward the interior of the vehicle cabin. (Item 6) The method according to any one of the above items, wherein the visual content includes visual content received from a device related to an occupant of the vehicle cabin, and the device is communicably coupled to an entertainment information system of the vehicle cabin. (Item 7) The method according to any one of the above items, wherein the at least one display surface extends parallel to the ceiling of the vehicle cabin. (Item 8) A first display surface disposed on the ceiling of the vehicle cabin; A second display surface disposed on the ceiling of the vehicle cabin, wherein the first display surface is movable relative to the second display surface. A memory for storing media applications, A processor coupled to the memory, the processor for displaying media content on the first display surface and the second display surface within the vehicle cabin when the media application is executed, A system within a vehicle cabin for displaying media content, comprising: (Item 9) Displaying media content on the first display surface and the second display surface includes transmitting the media content to one or more projectors, and the one or more projectors project the media content onto the first display surface and the second display surface. The system according to any one of the above items. (Item 10) The system according to any one of the above items, wherein the first display surface is at least partially transparent. (Item 11) The system according to any one of the above items, wherein when the first display surface is in the closed position, the first display surface is horizontally adjacent to the second display surface. (Item 12) The system according to any one of the above items, wherein when the first display surface is in the open position, the first display surface is disposed vertically above the second display surface. (Item 13) When executed by the processor, the media application further causes the processor to stop displaying media content on the first display surface when the first display surface is in the open position. The system according to any one of the above items. (Item 14) The system according to any one of the above items, wherein the first display surface is disposed vertically below a sunroof panel, and when both the first display surface and the sunroof panel are in the open position, the sunroof of the vehicle cabin is open to the external environment. (Item 15) Determining a first emotional state related to at least one occupant within a vehicle cabin; Receiving media content related to the first emotional state; Causing visual content related to the media content to be displayed on at least one display surface disposed on a ceiling within the vehicle cabin; One or more non-transitory computer-readable storage media that, when executed by a processor, cause the processor to perform steps including causing the presentation of media content. (Item 16) One or more computer-readable storage media according to any of the above items, wherein the visual content includes at least one still image and video related to the first emotional state. (Item 17) Receiving the media content related to the first emotional state comprises: Determining a goal emotional state based on the first emotional state; Obtaining the media content based on the goal emotional state; One or more computer-readable storage media according to any of the above items. (Item 18) Receiving the media content related to the first emotional state comprises: Receiving user input related to a goal emotional state; Selecting the media content based on the goal emotional state; One or more computer-readable storage media according to any of the above items. (Item 19) One or more computer-readable storage media according to any of the above items, wherein the at least one display surface includes a first display surface and a second display surface, and the first display surface is movable relative to the second display surface disposed on the ceiling of the vehicle cabin. (Item 20) Further including determining at least one of a vehicle state and an environmental state, receiving the media content related to the first emotional state includes obtaining the media content based further on the at least one of the vehicle state and the environmental state, one or more computer-readable storage media according to any of the above items. (Abstract) In various embodiments, a mood roof media application provides media content into a vehicle cabin. During operation, the mood roof media application determines at least one state related to the vehicle cabin based on sensor data from at least one sensor. The mood roof media application then receives media content related to the at least one state. The mood roof media application further causes visual content related to the media content to be displayed on at least one display surface disposed on a ceiling of the vehicle cabin.

Brief Description of the Drawings

[0011]

Figure 1A

Figure 1B

Figure 2

Figure 3

Figure 4

Figure 5A

Figure 5B

Figure 5C

Figure 5D

Figure 5E

Figure 6A

Figure 6B

Figure 6C

Figure 7A

Figure 7B

Figure 7C

Figure 7D

Figure 7E

Figure 8

Figure 9

Figure 10

Figure 11

Mode for Carrying Out the Invention

[0012] In the following description, numerous specific details are set forth in order to provide a more thorough understanding of the various embodiments. However, it will be apparent to those skilled in the art that the inventive concept may be practiced without one or more of these specific details.

[0013] FIGS. 1A - 1B are conceptual diagrams showing a mood roof display system within a vehicle 100, according to one or more aspects of various embodiments. FIG. 1A shows a side view of the upper portion of the vehicle 100, and FIG. 1B shows an exposed top view of the vehicle 100.

[0014] The vehicle 100 includes a roof 102 that covers the vehicle cabin 103 and components within the vehicle cabin 103 (e.g., seats, controllers, steering wheel, etc.). In some embodiments, the roof 102 includes a sunroof (not shown). The sunroof can include one or more glass panels that can be moved to form an opening in the roof 102 to expose the vehicle cabin 103 to the external environment of the vehicle 100.

[0015] Vehicle 100 further includes one or more mood roof displays 110 installed on roof 102. The mood roof display 110 can be installed on roof 102 instead of or in addition to the sunroof. In various embodiments, the mood roof display 110 extends parallel to roof 102 and displays visual content towards the interior of the vehicle cabin. Each of the mood roof displays 110 can display media content to the occupants within vehicle cabin 103 under the instruction and / or coordination of head unit 120. For example, the media content may be output from head unit 120 to mood roof display 110 for display to the occupants within vehicle cabin 103. In various embodiments, the display device (e.g., liquid crystal display (LCD) screen, light emitting diode (LED) display screen, organic light emitting diode (OLED) display screen, etc.) configured to output mood roof displays 110-1 and 110-2. In various other embodiments, the projection surface functions as a mood roof display instead of (or in addition to) one or more mood roof displays 110. One or more projectors can then be mounted on roof 102 or any other installable location within the vehicle. The projector(s) receive media content from head unit 120 and project that media content onto the projection surface.

[0016] As shown, vehicle 100 includes two mood roof displays 110-1 and 110-2 disposed on roof 102 for viewing by occupants within vehicle cabin 103. For example, as shown in FIG. 1B, mood roof display 110-1 is disposed above the front seats and mood roof display 110-2 is disposed above the rear seats. However, it should be understood that the positioning of mood roof display 110 shown in FIG. 1B is an example, and other positions on roof 102 are possible. Further, two mood roof displays having a specific size and aspect ratio are shown by way of example only, and it should be understood that the mood roof display can include one, two, three, or more displays of any size, aspect ratio, and shape.

[0017] In various embodiments, at least one mood roof display 110 can be opened and closed (e.g., moved between an open position and a closed position). For example, at least one mood roof display 110 can be attached to a track and motor system. At least one mood roof display 110 can then be moved from a closed position to an open position and vice versa via the track and motor system. In some embodiments, the mood roof display may not display media content while in the open position. When a projection surface is used as the mood roof display, the projection surface may be opened and closed by being retracted and extended, respectively, including partial opening and closing. While the projection surface is fully and / or partially open, the projector cannot project media content onto the projection surface. In various embodiments, when a plurality of mood roof displays are installed on roof 102, at least one of the plurality of mood roof displays 110 is fixed.

[0018] Vehicle 100 includes a head unit 120. The head unit 120 includes, among other things, a mood roof media application 230 that controls media output to the mood roof display 110. The head unit 120 may also include control (not shown) for opening and closing the mood roof display 110. The control may be an operation by an occupant of the vehicle 100 to open and close one or more mood roof displays 110 within the vehicle 100. In some embodiments, the control for opening and closing the mood roof can be arranged at other locations within the vehicle 100 (e.g., on a portion of the roof 102 that is accessible to the driver). The mood roof opening and closing control can be implemented in any technically feasible manner (e.g., buttons, switches, user interfaces displayed on a touch screen, etc.). The mood roof media application 230 can implement any number of techniques for delivering visual media content to the mood roof display 110, including wired or wireless transmission. In some embodiments, the media content output to the mood roof display 110 can be obtained from a storage device located within the vehicle (e.g., in the head unit 120), a device communicatively connected to the vehicle 100 (e.g., a mobile device communicatively connected to the head unit 120), and / or a cloud service communicatively connected to the vehicle 100.

[0019] Figure 2 is a more detailed view of the head unit 120 of FIG. 1 according to one or more aspects of various embodiments. As shown, the head unit 120 includes, without limitation, a processor 202 and a system memory 204. The processor 202 and the system memory 204 can be implemented in any technically feasible manner. For example, without limitation in various embodiments, any combination of the processor 202 and the system memory 204 can be implemented as a stand-alone chip or as part of a more comprehensive solution implemented as an application-specific integrated circuit (ASIC) or a system-on-chip (SoC).

[0020] Processor 202 generally includes a programmable processor that executes program instructions for manipulating input data. Processor 202 may include any number of processing cores, memories, and other modules to facilitate program execution. Processor 202 can receive inputs via any number of user input devices 208 and can generate pixels for display on display device 206. User input devices 208 can include various types of input devices such as buttons, microphones, cameras, a touch input device integrated with display device 206 (i.e., a touch screen), and other input devices for providing input data to head unit 120. Processor 202 can also generate pixels for display on other display devices within vehicle 100, such as mood roof display 110.

[0021] Head unit 120 can support any number of input and output data types and formats. For example, without limitation, in some embodiments, head unit 120 can include built-in Bluetooth® for hands-free calling and audio streaming, a Universal Serial Bus (USB) connection, voice recognition, camera inputs for any number of fields of view (e.g., rear field of view, front field of view, cabin interior field of view, roof exterior field of view, etc.), video output for any number and type of displays (e.g., headrest-mounted displays, mood roof display 110), and any number of audio outputs. Generally, any number of sensors, displays, receivers, transmitters, etc. can be integrated with head unit 120 or implemented external to head unit 120. External devices can communicate with head unit 120 in technically feasible ways. In alternative embodiments, vehicle 100 can include any number of stand-alone units that implement any amount of the functionality described herein with respect to head unit 120. Stand-alone head unit 120 is not integrated with head unit 120 and in some embodiments can replace head unit 120.

[0022] The head unit can output audio content to one or more audio output devices 212 (e.g., via an audio output). Examples of audio output devices include, but are not limited to, one or more speakers within the vehicle 100.

[0023] The system memory 204 generally includes storage chips such as random access memory (RAM) chips that store application programs and data for processing by the processor 202. In various embodiments, the system memory 204 includes non-volatile memory such as an optical drive, a magnetic drive, a flash drive, or other storage devices. In some embodiments, the storage device 210 can supplement the system memory 204. The storage device 210 can include any number and type of external memory accessible to the processor 202. For example, but not limited to, the storage device 210 can include a secure digital card, an external flash memory, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0024] In addition to, or instead of, the mood roof media application 230, the system memory 204 can include any number and type of other applications. For example, in some embodiments, the system memory 204 includes, by way of example, the - It can include an entertainment subsystem, a navigation subsystem, and an advanced driver assistance subsystem (ADAS). The entertainment subsystem can include software for controlling any number and type of entertainment components, such as AM / FM radio, satellite radio, audio and video computer file players (e.g., MP3 audio file players), optical media players (e.g., compact discs (CDs)), etc. The navigation subsystem can include any number and type of applications that enable the driver to efficiently navigate the vehicle. For example, the navigation subsystem can include maps, route search software, etc. ADAS can include functions designed for purposes such as enhancing driver safety and automating driving operations. In some embodiments, the functions of the mood roof media application 230 may be integrated into or distributed across any number of other applications (e.g., entertainment information systems, entertainment subsystems).

[0025] The head unit 120 may further be communicatively coupled to a mobile device 218. Examples of the mobile device 218 include, but are not limited to, smartphones, tablets, portable media players, portable game devices, and laptop computers. The head unit 120 can communicate with the mobile device 218 in any technically feasible way (e.g., Bluetooth®, Wi-Fi, USB, etc.). The head unit 120 can access the content stored in the mobile device 218. Further, the head unit 120 can receive user input and / or commands from the mobile device 218 (e.g., from an application on the mobile device 218 configured to control various functions of the head unit 120).

[0026] The head unit 120 can further communicate with a mood roof actuation system 216 and optionally a sunroof actuation system 214. The mood roof actuation system 216 includes motors, tracks, etc. for effecting movement of the mood roof display 110. When the vehicle 100 is equipped with a sunroof, the sunroof actuation system 214 includes motors, tracks, etc. for effecting movement of the sunroof. The head unit 120 can generate a control signal for controlling the mood roof actuation system 216, for example, to open and close one or more mood roof displays 110, in response to a user input via mood roof open / close control (e.g., implemented via the user input device 208) and / or an instruction signal from the mood roof media application 230. Similarly, the head unit 120 can generate a control signal for controlling the sunroof actuation system 214, for example, to open and close the sunroof, in response to a user input via sunroof open / close control (e.g., implemented via the user input device 208) and / or an instruction signal from the mood roof media application 230. The mood roof open / close control (e.g., the user input device 208 configured to control the mood roof display 110) can be disposed on the head unit 120 or at other locations within the vehicle 100 (e.g., a part of the roof 102 accessible to the driver).

[0027] Generally, the entertainment information system of a conventional vehicle provides visual media content to one or more conventional display devices 206 that can be disposed near the dashboard and / or attached to the headrest. Depending on the situation, the conventional display devices 206 may not be able to provide an immersive visual experience to the occupants within the vehicle 100. As a result, the vehicle occupants rely on the visual experience provided by the external environment of the vehicle 100 (e.g., as seen through the vehicle's windows). However, in many cases, the external environment provides visual and / or auditory experiences that are not pleasant for the vehicle occupants. These unpleasant visual and / or auditory experiences can potentially have an adverse effect on the emotional state of the occupants and the experience of riding in the vehicle This can result in an unpleasant experience for the passengers.

[0028] Display of media content on the mood roof display To improve the media experience of the occupants of vehicle 100, the mood roof media application 230 can receive visual media content 244 from the head unit 120 and output the visual media content to the mood roof display 110. Optionally, the mood roof media application 230 can also receive audio media content 242 from the head unit 120 and output the audio media content to the audio output device 212. In various embodiments, the mood roof media application 230 can obtain and / or generate visual and / or audio media content based on sensor data received from one or more sensors 220 and / or one or more user inputs (e.g., inputs received via the user input device 208 and / or the mobile device 218). In some embodiments, the mood roof media application 230 can determine one or more states related to the vehicle cabin 103 based on the sensor data and determine the media content to obtain and / or generate based on the one or more states. One or more states related to the vehicle cabin can include, but are not limited to, the weather outside the vehicle 100, the speed of the vehicle 100, the environment in which the vehicle 100 is moving, the occupancy state of the vehicle cabin 103, and / or the emotional state(s) of one or more occupants of the vehicle 100. The mood roof media application 230 can obtain media content for output from one or more media sources 250 that can include the system memory 204, the storage device 210, the sensors 220, the visual sensors 304 and 306, and / or the mobile device 218. In various embodiments, the mood roof media application 230 can expand the obtained media content (e.g., generate an augmented reality overlay on a camera image) and output the expanded media content. In this manner, the mood roof media application 230 distributes media content to the mood roof display 110 to enhance the media experience of the occupants of vehicle 100.

[0029] Figure 3 is a more detailed view of the sensor 220 of FIG. 2 according to one or more aspects of various embodiments. As shown, the sensor 220 can include an internal vision sensor 304, an external vision sensor 306, a biometric sensor 312, an auditory sensor 314, a motion sensor 316, a vehicle sensor 318, an internal environment sensor 320, and an external environment sensor 322. The head unit 120 receives sensor data 330 from one or more sensors 220 and transfers the sensor data 330 to applications, subsystems, etc. within the head unit 120, such as the mood roof media application 230.

[0030] The internal vision sensor 304 can acquire an image of the vehicle cabin 103 and / or an occupant within the vehicle cabin 103. The image data can include the facial expression, body posture, body position, etc. of the occupant that can indicate the emotional state(s) and / or mood(s) of one or more occupants of the vehicle 100. The image data can further include the field of view of the vehicle cabin 103 indicating where the occupant is located and what posture the occupant is taking within the vehicle cabin 103. In some embodiments, the internal vision sensor 304 includes, but is not limited to, any number and combination of infrared cameras, RGB cameras, a camera array providing multiple viewpoints on the occupant's body and / or head and / or multiple viewpoints on the vehicle cabin 103, and a depth camera for sensing body position and orientation.

[0031] The external vision sensor 306 can acquire an external image of the vehicle 100 including an upper external field of view (e.g., a view from above the vehicle 100) and an optional horizontal outer field of view from the vehicle 100 (e.g., side, front, and rear views from the vehicle 100). In some embodiments, the external vision sensor 306 includes, but is not limited to, any number and combination of infrared cameras, RGB cameras, a camera array providing multiple viewpoints on the external field of view of the vehicle 100, and a depth camera for sensing objects external to the vehicle 100.

[0032] The biological sensor 312 generates biological data that can correlate with the emotional state(s) and / or mood(s) of one or more occupants of the vehicle 100. In some embodiments, the biological sensor 312 includes, but is not limited to, a galvanic skin response sensor that measures any number and combination of emotional arousal, an image sensor that detects blood oxygen levels, a thermal sensor that detects blood flow, an optical sensor that detects blood flow, an electroencephalogram sensor that detects the surface potential of the brain, a magnetoencephalogram sensor that detects neural activity, and the like.

[0033] The auditory sensor 314 generates audio data that can indicate the emotional state(s) and / or mood(s) of one or more occupants of the vehicle 100. More precisely, the words spoken by an individual and the way an individual speaks a given phrase often indicate emotion and mood. In some embodiments, the auditory sensor 314 includes, but is not limited to, any number and combination of microphones, microphone arrays, and the like.

[0034] The motion sensor 316 can generate tactile data, electronic activity data, and the like that provide insights into the activities of individuals around the vehicle 100 and the occupants within the vehicle 100. The detected activities can indicate the emotional state(s) and / or mood(s) of one or more occupants of the vehicle 100. For example, in some embodiments, the motion sensor 316 includes, but is not limited to, any number of mobile usage sensors that detect the use of mobile devices. Generally, the pattern of applications used by an occupant can correlate with mood. For example, if an application is classified as a fun social application, the use of the application can correlate with a fun, social mood.

[0035] In the same or other embodiments, the motion sensor 316 includes, without limitation, a pressure sensor, a touch sensor, an acoustic sensor, and a button press sensor that indicates how the occupant places their hand. Tactile data can indicate the mood of the occupant. For example, tactile data indicating that the occupant is pressing a key with unnecessary force may indicate an excited mood.

[0036] The vehicle sensor(s) 318 generate data indicating one or more states and / or characteristics of the vehicle 100, which include, without limitation, the linear velocity of the vehicle 100, the turning speed and radius of the vehicle 100, the most recent driving distance of the vehicle 100, the most recent driving time of the vehicle 100, and the moving direction by the vehicle 100. In some embodiments, the vehicle sensor 318 includes, without limitation, a speedometer, an accelerometer, a compass, a timer, an odometer, etc.

[0037] The internal environment sensor 320 generates data indicating one or more states of the interior environment of the vehicle 100 (e.g., one or more states of the vehicle cabin 103), which include, without limitation, the temperature inside the vehicle cabin 103, the humidity inside the vehicle cabin 103, the air pressure level inside the vehicle cabin 103, the light intensity inside the vehicle cabin 103, the air quality grade inside the vehicle cabin 103, etc. In some embodiments, the internal environment sensor 320 includes, without limitation, a thermometer, a hygrometer, a barometer, a lux meter, an air quality meter, etc.

[0038] The external environment sensor 322 generates data indicating one or more states of the external environment of the vehicle 100 (e.g., one or more states related to the outside of the vehicle 100 such as road conditions), which include without limitation, the external temperature of the vehicle 100, the external humidity of the vehicle 100, the external air pressure level of the vehicle 100, the external light intensity of the vehicle 100, the external air quality grade of the vehicle 100, the external weather conditions of the vehicle 100, etc. In some embodiments, the external environment sensor 322 includes, without limitation, a thermometer, a hygrometer, a barometer, a lux meter, an air quality meter, etc.

[0039] Figure 4 is a diagram showing in more detail the mood roof media application 230 of FIG. 2 according to one or more aspects of various embodiments. The mood roof media application 230 can include a state determination engine 400, a gating engine 420, a media acquisition and media generation engine 450, and optionally a goal engine 410.

[0040] After the mood roof media application 230 receives the sensor data 330 from the head unit 120, the state determination engine 400 processes the sensor data 330 to determine one or more vehicle states 402 (e.g., speed, turning speed, etc.), one or more environmental states 404 (e.g., the external temperature of the vehicle 100, the temperature inside the vehicle cabin 103, the external visibility of the vehicle 100, etc.), and / or one or more emotional states 406 of one or more occupants inside the vehicle cabin 103.

[0041] More generally, each of the vehicle state 402, the environmental state 404, and the one or more emotional states 406 is associated with the vehicle cabin 103 in some way. For example, the speed of the vehicle 100 is the speed of the vehicle cabin 103. As another example, the external temperature of the vehicle 100 is the temperature to which the vehicle cabin 103 can be exposed when the windows and / or sunroof are open. As a further example, the emotional state of the occupants inside the vehicle cabin 103 represents the mood inside the vehicle cabin 103.

[0042] As part of data processing, the state determination engine 400 can execute any number of algorithms. For example, to determine the emotional state 406 of an occupant within the vehicle 100, the state determination engine 400 can execute algorithms suitable for determining emotional states and / or moods, such as natural language processing algorithms, sentiment analysis, and voice analysis. With respect to the vehicle state 402 and the environmental state 404, the state determination engine 400 can execute any number of suitable algorithms for determining these states. Further, the state determination engine 400 can perform disambiguation operations based on combinations of data received from different sensor types. Subsequently, for each type of determined state, the state determination engine 400 determines the state associated with the user based on the processed data. The state determination engine 400 can determine the vehicle state 402, the environmental state 404, and the emotional state 406 in any technically feasible way. For example, the state determination engine 400 can implement any number and types of discovery techniques, rules, and / or machine learning algorithms in any combination to determine the vehicle state 402, the environmental state 404, and the emotional state 406. In some embodiments, the state determination engine 400 can include any number of sub-engines configured to determine each state, specific to each type of the vehicle state 402, the environmental state 404, and / or the emotional state 406.

[0043] For example, in some embodiments, the state determination engine 400 (or the emotional state sub-engine) includes a support vector machine, a Bayesian classifier, or a Markov chain. In other embodiments, the state determination engine 400 includes an emotion classification model that maps face images, biological data, and application usage data to the emotional state 406. In some embodiments, the state determination engine 400 correlates the processed data with previously observed data associated with known emotions. In the same or other embodiments, the state determination engine 400 executes a statistical algorithm to determine the emotional state 406. Further, in some embodiments In this state, the state determination engine 400 can determine the emotional states of the passengers as a set. Alternatively, the state determination engine can determine the emotional state of each passenger and then aggregate the emotional states (e.g., average emotional state, median emotional state, weighted aggregation).

[0044] As shown by the dashed box, the goal engine 410 can be implemented in some embodiments but omitted in other embodiments. Embodiments in which the goal engine 410 is implemented operate in "goal mode", and embodiments in which the goal engine 410 is omitted operate in "non-goal mode". In some embodiments, the goal engine 410 can be configured to selectively operate in goal mode based on any technically feasible criterion (e.g., a configurable setting).

[0045] As illustrated, the goal engine 410 includes, but is not limited to, a goal state 412, an initial state 414, and a goal status 416. First, the goal engine 410 determines the goal state 412 based on one or more states determined by the state determination engine 400, such as the emotional state 406. The goal engine 410 can determine the goal state 412 in any technically feasible way. For example, the goal engine 410 can implement any number and type of discovery techniques, rules, and / or machine learning algorithms in any combination to generate the goal state 412 based on the emotional state 406. The goal engine 410 can determine an aggregate goal state 412 for the passengers in any technically feasible way based on any number of emotional states 406. For example, the goal engine 410 can generate the aggregate goal state 412 as a weighted set of the emotional states 406, where the emotional states 406 related to a particular mood are weighted more heavily than other emotional states 406.

[0046] After the goal engine 410 determines the goal state 412, the goal engine 410 sets the initial state 414 to reflect the emotional state 406, and sets the goal status 416 such that the goal state 412 indicates a new goal state 412. Subsequently, when the mood roof media application 230 and the mood roof display 110 operate, the goal engine 410 receives the updated emotional state 406. The goal engine 410 then updates the goal status 416 to reflect whether the mood roof media application 230 has successfully transitioned the emotional state 406 related to the target occupant from the initial state 414 to the goal state 412.

[0047] The goal engine 410 can also regenerate the goal state 412, the initial state 414, and the goal status 416 based on any regeneration criteria (e.g., when reaching the goal state 412). In some alternative embodiments, the goal engine 410 does not include either the initial state 414 or the goal status 416. In such embodiments, upon receiving the new emotional state 406, the goal engine 410 regenerates the goal state 412 based on the new emotional state 406. In particular, since emotions are often transient, the goal engine 410 may not be able to reach the goal state 412 before generating a new goal state 412 based on the new emotional state 406.

[0048] In some embodiments, the goal engine 410 can operate in conjunction with user input 470 to the head unit 120. For example, an occupant may be presented with a user interface option (e.g., a touch screen button via the user input device 208) to set the goal state to a particular state (e.g., "make us happy"). In response to the user input 470 corresponding to the activation of the user interface option, the goal engine 410 sets the goal state 412 to a state related to the user interface option (e.g., "happy") and sets the initial state 414 to reflect the emotional state 406. Set and further set the goal status 416 such that a specific goal state 412 indicates that it is the new goal state 412. Subsequently, when the mood roof media application 230 and the mood roof display 110 operate, the goal engine 410 receives the updated emotional state 406. The goal engine 410 then updates the goal status 416 to reflect whether the mood roof media application 230 has successfully transitioned the emotional state 406 related to the target occupant from the initial state 414 to the specific goal state 412.

[0049] The gating engine 420 determines whether the mood roof media application 230 provides visual and / or audio media content to the occupant based on the states 402, 404, 406 and / or based on user input. The gating engine 420 can determine, in any technically feasible way, whether the mood roof display 110 provides visual media content to the occupant. For example, if any of the occupants makes a user input 470 to the head unit 120 to play specific media content on the mood roof display 110, the gating engine 420 can subsequently determine that the specific media content is played via the mood roof display 110 and the states 402, 404, 406 can be ignored. In other words, the user input that selects the specific content to play can replace the playback of media content obtained and / or generated based on the states 402, 404, 406. If no specific media content has been selected by the occupant, the gating engine 420 can determine, based on the states 402, 404, 406 and optionally further based on techniques that take into account the goal state 412, the initial state 414, and / or the goal status 416, that visual media content can be provided to the occupant.

[0050] If the gating engine 420 determines that the mood roof display 110 does not provide visual media content to the occupant, the gating engine 420 configures the mood roof display 110 to stop providing visual media content to the occupant (e.g., disables the mood roof display 110 from the displayed content). The gating engine 420 can also ensure that the mood roof media application 230 does not acquire or generate visual media content 244 until the gating engine 420 determines that the mood roof display 110 should provide visual media content to the occupant. The gating engine 420 can configure the mood roof display 110 to stop providing audio content to the occupant in any technically feasible way. For example, if the mood roof display 110 is moved to or is in the open position, the gating engine 420 can determine that the mood roof display 110 does not provide visual media content to the occupant. The gating engine 420 then configures the mood roof display 110 to stop providing audio content to the occupant (e.g., by fading out the provided content). The gating engine 420 can determine the position of the mood roof display 110 through communication with the mood roof actuation system 216 and / or the sunroof actuation system 214 (e.g., the mood roof actuation system 216 can inform the mood roof media application 230 of the position of the display).

[0051] However, when the mood roof display 110 provides visual media content to the occupant as determined by the gating engine 420, the media acquisition and media generation engine 450 obtains and / or generates visual media content 244 based on states 402, 404, 406 and / or user input 470, and optionally source visual media content received from any number of media sources 250. For example, the media acquisition and media generation engine 450 can obtain visual media content from the system memory 204, the storage device 210, the internal vision sen sor 304, the external vision sensor 306, and / or the mobile device 218 associated with the occupant. The media acquisition and media generation engine 450 can generate visual media content, including combining different portions of the visual media content, in any technically feasible way.

[0052] In some embodiments, when the mood roof display 110 provides visual media content to the occupant, the gating engine 420 can automatically signal the mood roof operating system 216 to close the mood roof display 110. Similarly, when the sunroof is in the open position and the mood roof display 110 provides visual media content to the occupant, the gating engine 420 can automatically signal the sunroof operating system 214 to close the sunroof. Further, when the mood roof display is integrated with the sunroof, the gating engine 420 can automatically signal the sunroof operating system 214 to close the sunroof, and correspondingly close the integrated mood roof display.

[0053] As described above, the media acquisition and media generation engine 450 can obtain source visual media content received from any number of media sources 250 in any technically feasible way, including combining different portions of the visual media content, and can generate visual media content. For example, when the time is night and the outside sky is cloudy, the media acquisition and media generation engine 450 can obtain and / or generate an image (e.g., an image of a clear night sky, a starry night sky, or an aurora) to have a positive impact on the emotional state of the occupant. As another example, when the time is night and the outside sky is clear, the media acquisition and media generation engine 450 can obtain a camera image of the sky from the external visual sensor 306 and generate an augmented reality overlay (e.g., information regarding visible celestial objects) that can be superimposed on the camera image to entertain the occupant and / or have a positive impact on the emotional state of the occupant. The mood roof media application 230 transmits the acquired and / or generated visual media content 244 to the mood roof display 110 via the head unit 120.

[0054] Additional, non-limiting examples of media content that can be obtained and / or generated are as follows. When the vehicle is moving through a dry environment, the media acquisition and generation engine 450 can obtain and / or generate an image of a forest, a leaping marine creature, or an underwater environment with a water current. When the time is daytime and the outside sky is cloudy, the media acquisition and media generation engine 450 can obtain and / or generate an image of a clear sky. These and other examples of media content can be obtained and / or generated to have a positive impact on the emotional state of the occupant and / or to improve the enjoyment of the occupant while in the vehicle 100.

[0055] In various embodiments, the moonroof media application 230 can also obtain and / or generate audio media content 242 in a manner similar to the visual media content 244. The audio media content 242 can be obtained and / or generated in conjunction with the visual media content 244. The moonroof media application 230 transmits the obtained and / or generated audio media content 242 to the audio output device 212 via the head unit 120. The moonroof media application 230 can provide the audio media content 242 to the audio output device 212 even while the moonroof display 110 is not displaying content (e.g., because the moonroof display 110 is configured to be in an open position and thus stop displaying content). In some embodiments, the visual media content 244 further includes the ambient light within the vehicle cabin. For example, the moonroof media application 230 can control the ambient lighting within the vehicle cabin 103 based on the same techniques as described above for obtaining and generating visual media content. Including. For example, the moonroof media application 230 can control the ambient lighting within the vehicle cabin 103 based on the same techniques as described above for obtaining and generating visual media content.

[0056] Opening and closing of the moonroof display Figures 5A-5E are diagrams showing the operation of an exemplary mood roof display 502 according to one or more aspects of various embodiments. As shown, Figure 5A shows the mood roof display 502, the sunroof glass panel 504, and the vehicle headliner 500 (e.g., the ceiling of the vehicle cabin 103) of the vehicle 100. The mood roof display 502 is separated from the sunroof glass panel 504. In various embodiments, the mood roof display 502 is disposed under the sunroof panel 504. In Figures 5A-5E, the mood roof display 502-2 and the sunroof panel 504-2 are fixed, and the mood roof display 502-1 and the sunroof panel 504-1 are movable. Thus, Figures 5A-5E show an exemplary implementation of the mood roof display 110, which is a display surface that is separated from the sunroof panel and can be moved independently of the sunroof panel.

[0057] As shown in Figure 5A, the mood roof display 502-1 and the sunroof panel 504-1 are each in a closed position. The mood roof display 502-1 is horizontally adjacent to the mood roof display 502-2, and the sunroof panel 504-1 is horizontally adjacent to the sunroof panel 504-2. While the mood roof display 502-1 is in the closed position, the mood roof display 502-1 is configured to display content. In various embodiments, the mood roof display 502 is opaque and prevents light from passing through the mood roof display 502 regardless of whether the mood roof display 502 is displaying content or whether the mood roof display 502 is in the open position.

[0058] Figure 5B shows the mood roof display 502-1 starting to move towards the open position. For example, an occupant can activate a mood roof opening option via the user input device 208 and / or other mood roof opening / closing controls. As another example, the mood roof media application 230 can automatically activate the movement of the mood roof display 502-1 to the open position. In response, the head unit 102 sends a signal to the mood roof actuation system 216 to move the mood roof display 502-1 towards the open position. The mood roof actuation system 216 tilts the mood roof display 502-1 at an angle directed towards the space between the sunroof panel 504-2 and the mood roof display 502-2.

[0059] While the mood roof display 502-1 is tilting and / or moving towards the open position, the mood roof display 502-1 may be configured to stop displaying content. For example, the gating engine 420 can determine that the mood roof display 502-1 is being opened in response to the tilt and / or movement of the mood roof display 502-1, and in response, can stop displaying content to the mood roof display 502-1. For example, the mood roof display 502-1 can be powered off, and / or the gating engine 420 can fade out the content being displayed on the mood roof display 502-1 as the mood roof display 502-1 moves towards the open position.

[0060] The mood roof actuation system 216 then, as shown in Figure 5C, moves the mood roof display 502-1 (e.g., along the track of the mood roof actuation system 216) towards the sun Move it to the space between the roof panel 504-2 and the mood roof display 502-2. When moving to this space, the mood roof display 502-1 will be in the open position. When in the open position, the mood roof display 502-1 can be configured not to display content, and the mood roof media application 230 may not output the visual content 244 to the mood roof display 502-1. However, the mood roof display 502-2 can still be configured to display content while the mood roof display 502-1 is in the open position.

[0061] As shown in FIG. 5C, the sunroof panel 504-1 is still in the closed position. While the sunroof panel 504-1 is in the closed position, light from outside the vehicle can pass through the sunroof panel 504-1, but the air from outside the vehicle is restricted from entering the vehicle interior from the ceiling of the vehicle cabin. The vehicle occupant can activate a sunroof opening option to open the sunroof panel 504-1 (e.g., via the user input device 208 and / or other sunroof opening / closing controls). In response, the head unit 102 sends a signal to the sunroof actuation system 214 to move the sunroof panel 504-1 to the open position. The sunroof actuation system 214 starts the movement of the sunroof panel 504-1 by tilting the sunroof panel 504-1 at an angle towards the space above the sunroof panel 504-1, and moves the sunroof panel 504 towards the open position within that space, as shown in FIG. 5D.

[0062] As shown in FIG. 5E, the sunroof panel 504-1 has completed its movement to the open position above the sunroof panel 504-2. With both the mood roof display 502-1 and the sunroof panel 504-1 in their respective open positions, an opening 506 is formed through the roof of the vehicle. Air can flow through the vehicle cabin via the opening 506, and light can also pass through the opening 506.

[0063] To close the sunroof panel 504-1 and / or the mood roof display 502-1, the steps shown in FIGS. 5A-5E can be reversed. For example, the sunroof panel 504-1 can return to the closed position shown in FIGS. 5A-5C in response to user input and / or an instruction from the mood roof media application 230. The mood roof display 502-1 returns to its closed position as shown in FIG. 5A.

[0064] It should be understood that the mood roof display 502 and the sunroof panel 504 can be arranged in any technically feasible way. For example, the mood roof display 502 can be manufactured to have a thickness that fits into the space between the mood roof display 502-2 and the sunroof panel 504-2, while at the same time, the upper part of the sunroof panel 504 can be made to be on the same plane as the upper part of the sunroof panel 504 when it is still in the closed position. Further, the mood roof operating system 216 and the sunroof operating system 214 can be implemented in any technically feasible way. For example, the mood roof operating system 216 can have a track and a motor configured to move the mood roof display 502-1 as shown in FIGS. 5A-5C. Further, while FIGS. 5A-5E show the fixed mood roof display 502-2 and the fixed sunroof 504-2, the mood roof display 502-2 and / or the sunroof panel 504-2 can be configured to be movable in any technically feasible way between their respective open and closed positions.

[0065] FIGS. 6A-6C are diagrams showing examples of the operation of a further mood roof display 602 according to one or more aspects of various embodiments. As shown, FIG. 6A shows the mood roof display 602, the sunroof glass panel 604, and the vehicle headliner 600 (e.g., the ceiling of the vehicle cabin 103). The mood roof display 602 is the sunroof - It is integrated with the glass panel 604. For example, the mood roof display 602-1 is integrated with the sunroof panel 604-1, and the mood roof display 602-2 is integrated with the sunroof panel 604-2. In some embodiments, the integrated mood roof display 602-1 is fixed to the sunroof panel 604-1 and can bend together with the sunroof panel 604-1. Similarly, the integrated mood roof display 602-2 is fixed to the sunroof panel 604-2 and can bend together with the sunroof panel 604-2. In FIGS. 6A-6C, the sunroof panel 604-2 is fixed. The sunroof panel 604-1 is movable, and the mood roof display 602-1 moves with the sunroof panel 604-1. Therefore, FIGS. 6A-6C show an exemplary implementation of the mood roof display 110 in the vehicle 100, which is a display surface where the mood roof display is integrated with the sunroof panel.

[0066] In some embodiments, the mood roof display 602 is a thin LED display fixed to the sunroof panel 604. Further, in some embodiments, the mood roof display 602 is translucent and thus can act as a shading that allows some external light to pass through even when the sunroof panel 604 is in the closed position.

[0067] As shown in FIG. 6A, the sunroof panel 604-1 and the mood roof display 602-1 are in the closed position. The sunroof panel 604-1 is horizontally adjacent to the sunroof panel 604-2. While the sunroof panel 604-1 is in the closed position, the mood roof display 602-1 can be configured to display content.

[0068] Figure 6B shows the sunroof panel 604-1 starting to move towards the open position. For example, the occupant can activate the open / close option of the mood roof (or sunroof) via the user input device 208 and / or the open / close control of another mood roof (or sunroof). As another example, the mood roof media application 230 can automatically activate the movement of the sunroof 604-1 to the open position. In response, the head unit 102 sends a signal to the sunroof actuation system 214 to move the sunroof display 602-1 to the open position. The sunroof actuation system 214 tilts the sunroof panel 604-1 at an angle towards the space above the sunroof panel 604-2.

[0069] While the sunroof panel 604-1 is tilting and / or moving towards the open position, the mood roof display 602-1 can be configured to stop displaying content. For example, the gating engine 420 can determine that the sunroof panel 604-1 is being opened in response to the tilt and / or movement of the sunroof panel 604-1, and in response, can stop displaying content on the mood roof display 602-1. For example, the gating engine 420 can power down the mood roof display 602-1 and / or fade out the content displayed on the mood roof display 602-1 when the sunroof panel 604-1 is moving towards the open position.

[0070] The sunroof operating system 214 then moves the sunroof 604-1, as shown in FIG. 6C, into the space above the sunroof panel 604-2 (e.g., along the orbit of the sunroof operating system 214). When moved into this space, the sunroof panel 604-1 is in the open position. When the sunroof panel 604-1 is in the open position, the mood roof display 602-1 can be configured not to display content, and the mood roof media application 230 may not output the visual content 244 to the mood roof display 602-1. However, the mood roof display 602-2 can still be configured to display content while the sunroof panel 604-1 is in the open position. The sunroof panel 604-1 can be closed by reversing the steps shown in FIGS. 6A - 6C. For example, the sunroof panel 604-1 can return to the closed position shown in FIG. 6A in response to user input and / or an instruction from the mood roof media application 230.

[0071] With the sunroof panel 604-1 in the open position, an opening 606 is formed through the roof of the vehicle. Air can flow through the opening 606 into the vehicle cabin, and light can also pass through the opening 606.

[0072] To close the sunroof panel 604-1, the steps shown in FIGS. 6A - 6C can be reversed. For example, the sunroof panel 604-1 can return to the closed position shown in FIG. 6A in response to user input and / or an instruction from the mood roof media application 230.

[0073] It should be understood that the sunroof panel 604 can be arranged in any technically feasible manner, and the mood roof display 602 can be integrated with the sunroof panel 604 in any technically feasible manner. For example, the mood roof display 602 can be manufactured to have a thickness that avoids contact between the sunroof glass 604-2 and the headliner 600 when in the open or closed position. Further, the sunroof operating system 214 can be implemented in any technically feasible manner. For example, the sunroof operating system 214 can have a track and a motor configured to move the sunroof panel 604-1 as shown in FIGS. 6A-6C. Further, while FIGS. 6A-6C show a fixed sunroof 604-2, the sunroof 604-2 may be configured to be movable in any technically feasible manner to move between an open position and a closed position.

[0074] Figures 7A-7E are diagrams showing the operation of one exemplary mood roof projection surface 702 according to one or more aspects of various embodiments. As shown, FIG. 7A shows the mood roof projection surface 702, the sunroof glass panel 704, the headliner 700 of the vehicle 100 (e.g., the ceiling of the vehicle cabin 103), and one or more projectors 706 attached to the headliner 700. The projection surface 702 can be separated from the sunroof panel 704 and can be extended and retracted under the sunroof panel 704. For example, the projection surface 702 can be a flexible surface that can be rolled (retracted) and unrolled (extended) in the horizontal direction in a manner similar to how a roll-up projector screen can be extended and retracted in the vertical direction. Additionally or alternatively, the lower surface of the sunroof panel 704 facing the interior of the vehicle cabin can be implemented as the projection surface 702. In FIGS. 7A-7E, the roll bases of the projector surface 702 and the projection surface 702 can extend from a fixed roll base. Further, the sunroof panel 704-2 may be fixed and the sunroof panel 704-1 may be movable. Accordingly, FIGS. 7A-7E show an exemplary implementation of the mood roof display 110, where the mood roof display 110 is implemented as a projection surface on which visual content 244 can be projected.

[0075] As shown in FIG. 7A, the projection surface 702 and the sunroof panel 704-1 are in their respective closed positions. The projection surface 702 is extended and covers the sunroof 704. The sunroof panel 704-1 is horizontally adjacent to the sunroof panel 704-2. While the projection surface 702 is in the closed position, the projector 706 is configured to project content (e.g., visual content 244) onto the projection surface 702. For example, the projector 706-1 projects a projection 708-1 of the content onto a first portion of the projection surface 702, and the projector 706-2 projects a projection 708-2 of the content onto a second portion of the projection surface 702. In various embodiments, the projection surface 702 is opaque and prevents light from passing through the projection surface 702. In various other embodiments, the projection surface 702 is semi-transmissive or semi-transparent.

[0076] FIG. 7B shows the projection surface 702 in a partially open position, exposing the sunroof panel 704-1 but still covering the sunroof panel 704-2. For example, an occupant can activate a mood roof opening option via the user input device 208 and / or other mood roof opening and closing controls. In response, the head unit 102 sends a signal to the mood roof actuation system 216 to retract the projection surface 702 towards at least a partially open position. The mood roof actuation system 216 winds up the projection surface 702 on a fixed roll base to retract the projection surface 702.

[0077] While the projection surface 702 is being retracted towards a partially open position, the projector 706-1 may be configured to stop projecting content onto the projection surface 702. For example, the gating engine 420 can determine that the projection surface 702 is being retracted in response to the retraction of the projection surface 702, and in response, the projector 706-1 can stop projecting content. In such an embodiment, the gating engine 420 can power off the projector 706-1 and / or fade out the projection 708-1.

[0078] As shown in FIG. 7B, the sunroof panel 704-1 is still in the closed position. While the sunroof panel 704-1 is in the closed position, light from outside the vehicle can pass through the sunroof panel 704-1, but the entry of air from outside the vehicle into the vehicle interior through the ceiling of the vehicle cabin is restricted. A vehicle occupant can activate a sunroof release option (e.g., via the user input device 208 and / or other sunroof opening and closing controls) to open the sunroof panel 704-1. In response, the head unit 102 sends a signal to the sunroof actuation system 214 to move the sunroof panel 704-1 to the open position. The sunroof actuation system 214 starts the movement of the sunroof panel 704-1 by tilting it at an angle towards the space above the sunroof panel 704-2, as shown in FIG. 7C, and moves the sunroof panel 704-1 towards the open position within that space.

[0079] As shown in FIG. 7D, the sunroof panel 704-1 has completed its movement to the open position above the sunroof panel 704-2. When the projection surface 702 is in the partially open position and the sunroof panel 704-1 is in the open position, an opening 710 is formed through the vehicle roof. Air can flow through the vehicle cabin via the opening 710, and light can similarly pass completely through the opening 710.

[0080] The projection surface 702 can further be fully retracted from a closed position or a partially open position to a fully open position. For example, FIG. 7E shows the projection surface 702 retracted to the fully open position. The mood roof actuation system 216 can fully retract the projection surface 702 in response to a signal from the head unit 102 and then transmit a signal in response to user input and / or instructions from the mood roof media application 230. The projection surface 702 can be fully retracted while the sunroof panel 704-1 is in the open or closed position. When the projection surface 702 is fully retracted, the sunroof panel 704-2 is exposed within the vehicle cabin and light can pass through the sunroof panel 704-2 and enter the vehicle cabin. Further, when the projection surface 702 is fully retracted, both projectors 706-1 and 706-2 are configured to stop projecting content.

[0081] To close the sunroof panel 704-1 and / or the projection surface 702, the steps shown in FIGS. 7A-7E can be reversed. For example, the sunroof panel 704-1 can return to its closed position shown in FIGS. 7A-7B in response to user input and / or instructions from the mood roof media application 230. The projection surface 702 can be extended from a fully or partially open position to a closed position as shown in FIG. 7A in response to user input and / or instructions from the mood roof media application 230.

[0082] It should be understood that the projection surface 702 and the sunroof panel 704 can be arranged in any technically feasible way. For example, the projection surface 702 may be manufactured to have a thickness that fits into the space between the sunroof panel 704 and the headliner 700. As another example, the projection surface 702 may be implemented as one or more panels that can move between an open position and a closed position, instead of a retractable flexible surface. As a further example, the projection surface 702 may be implemented as two or more retractable flexible surfaces. Further, the mood roof operating system 216 and the sunroof operating system 214 can be implemented in any technically feasible way. For example, the mood roof operating system 216 can have a motor configured to retract and extend the projection surface 702, and a track configured to guide the retraction and extension of the projection surface 702. Further, although FIGS. 7A-7E show the fixed sunroof 704-2, the sunroof 704-2 may be configured to be movable in any technically feasible way to move between an open position and a closed position.

[0083] FIG. 8 illustrates a flowchart of steps of a method for displaying media content on a mood roof display system according to one or more aspects of various embodiments. Although the steps of the method are described in relation to the system of FIGS. 1A-7E, those skilled in the art will understand that any system configured to execute the steps of the method in any order is within the scope of the various embodiments.

[0084] As shown in FIG. 8, method 800 begins at step 802, where the mood roof media application 230 determines one or more states based on sensor data. For example, the mood roof media application 230 can determine one or more of the vehicle state 402, the environmental state 404, and the occupant's emotional state 406 based on the sensor data 330 from the sensor 220.

[0085] In step 804, if the mood roof media application 230 is not operating in the goal mode (804 - No), the method proceeds to step 808. If the mood roof media application is operating in the goal mode (804 - Yes), the method 800 proceeds to step 806.

[0086] In step 806, the mood roof media application 230 updates the initial state, goal state, and / or goal status based on one or more states. For example, the goal engine 410 can determine the initial state 414, goal state 412, and / or goal status 416 based on one or more vehicle states 402, environmental states 404, and occupant emotional states 406. By way of a specific example, the goal status 416 can be determined such that the initial state 414 is a dark mood, the goal state 412 is a happy mood, and the current status 416 is determined to be moving towards the goal state 412.

[0087] In step 808, if no one or more user inputs indicating specific content of the mood roof display system have been received (808 - No), the method 800 proceeds to step 810. If one or more user inputs (e.g., user input 470) indicating specific content of the mood roof display system have been received (808 - Yes), the method 800 proceeds to step 812.

[0088] In step 810, the mood roof media application 230 obtains and / or generates visual media content and / or audio media content based on at least one or more states, media sources, and optionally the goal state. For example, the media acquisition and media generation engine 450 obtains visual Visual content 244 and optionally audio content 242 can be obtained. The media acquisition and media generation engine 450 can also generate visual content 244 and optionally audio content 242. The media acquisition and media generation engine 450 can further combine the acquired visual content and the generated visual content (for example, acquire a camera image of the external environment and generate an augmented reality overlay of the camera image). The acquired and / or generated visual content 244 can be selected and determined based on one or more of the vehicle state 402, the environmental state 404, and the occupant emotional state 406, and optionally the goal state 412, the initial state 414, and the goal status 416.

[0089] In step 812, Mood Roof Media Application 230 acquires and / or generates visual media content and / or audio media content based at least on user input and media sources. For example, Media Acquisition and Media Generation Engine 450 can select content and acquire visual content 244 and optionally audio content 242 from media source 250 according to user input 470 that specifies a media source. Media Acquisition and Media Generation Engine 450 can also generate visual content 244 and optionally audio content 242 according to user input 470. In some embodiments, the acquired and / or generated visual content is associated with audio content (e.g., visualization graphics generated for a piece of music, an image of a marine landscape accompanying an ocean sound track, etc.). Media Acquisition and Media Generation Engine 450 can further combine the acquired visual content and the generated visual content (e.g., acquire a camera image of the external environment and generate an augmented reality overlay for the camera image). In various embodiments, the acquisition and / or generation may be based on one or more states as well as user input 470. In some embodiments, user input 470 specifies a goal state 412 instead of selecting a particular piece of content. In these embodiments, Goal Engine 410 sets the goal state to the specified goal state 412, and Media Acquisition and Media Generation Engine 450 acquires and / or generates content 244 and 242 to advance towards goal state 412.

[0090] In step 814, the mood roof media application 230 outputs visual content 244 to one or more mood roof displays 110 and outputs audio content 242 to the audio output device 212. The mood roof media application 230 transmits the visual content 244 for display or projection to the mood roof display 110 (e.g., display 502 or 602) or the projector 708 via the head unit 120. The mood roof media application 230 transmits the audio content 242 for output to the audio output device 212 (e.g., speaker) via the head unit 120.

[0091] In step 818, if the mood roof media application 230 determines to stop the execution of the mood roof media application 230 (818 - Yes), the method 800 ends. If the mood roof media application 230 determines that the mood roof media application 230 continues to execute (818 - No), the method 800 returns to step 802, where the mood roof media application 230 can determine the updated state.

[0092] FIG. 9 shows an exploded view of an embodiment 900 of the exemplary mood roof display of FIGS. 5A - 5E according to one or more aspects of various embodiments. FIG. 9 shows the components within the embodiment 900 of the mood roof display 502 and the sun roof panel 504. FIG. 9 shows an exploded view of the embodiment 900 from an oblique perspective looking down.

[0093] Embodiment 900 includes a roof sheet metal 902 and a headliner 910. The roof sheet metal 902 forms the upper surface of the vehicle roof 102, and the headliner 910 forms the inner surface of the vehicle roof 102. The roof sheet metal 902 includes an opening 914, and the headliner 910 includes an opening 912. The track and motor system 908 (e.g., the mood roof actuation system 216) can be mounted on the headliner 902 along the side of the opening 912 in the headliner 902. The front moving display 906 (e.g., the mood roof display 502-1) may be disposed above the opening 912 in the headliner 910 and may be mounted on the track of the track and motor system 908. The rear fixed display 907 (e.g., the mood roof display 502-2) may also be disposed above the opening 912 of the headliner 910 and may be fixedly mounted on the track of the track and motor system 908. The glass sunroof assembly 904 (e.g., the sunroof panel 504 and the sunroof actuation system 214) is disposed below the opening 914 in the roof sheet metal 902 and is attached to the roof sheet metal 902.

[0094] FIG. 10 shows an exploded view of an implementation 1000 of a further exemplary mood roof display according to one or more aspects of various embodiments. FIG. 10 shows the components within the implementation 1000 of the mood roof display 602 and the sunroof panel 604. FIG. 10 shows an exploded view of the implementation 1000 from a diagonal perspective looking down.

[0095] Embodiment 1000 includes a roof sheet metal 1002 and a headliner 1010. The roof sheet metal 1002 forms the upper surface of the vehicle roof 102, and the headliner 1010 forms the inner surface of the vehicle roof 102. The roof sheet metal 1002 includes an opening 1014, and the headliner 1010 includes an opening 1012. The front and rear displays 1006 (e.g., mood roof display 602) are fixed to the sunroof glass panel (e.g., sunroof panel 604) of the glass sunroof assembly 1004. In some embodiments, the display 1006 is a transparent OLED display. The glass sunroof assembly 1004 (e.g., sunroof panel 604 and sunroof operating system 214) is disposed below the opening 1014 of the roof sheet metal 1002 and above the opening 1012 within the headliner 1010. The glass sunroof assembly 1004 can be attached to the headliner 1010 and / or the roof sheet metal 1002.

[0096] FIG. 11 shows an exploded view of an embodiment 1100 of the exemplary mood roof projection surface of FIGS. 7A - 7E according to one or more aspects of various embodiments. FIG. 11 shows the components within the embodiment 1100 of the projection surface 702 and the sunroof panel 704. FIG. 11 shows an exploded view of an embodiment 1200 from an oblique perspective looking up from below.

[0097] Embodiment 1100 includes a roof sheet metal 1102 and a headliner 1110. The roof sheet metal 1102 forms the upper surface of the vehicle roof 102, and the headliner 1110 forms the inner surface of the vehicle roof 102. The roof sheet metal 1102 includes an opening 1114, and the headliner 1110 includes an opening 1112. Projectors 1116-1 and 1116-2 can be mounted on the headliner 1110 along the side surfaces of the opening 1112. The glass sunroof assembly 1104 (e.g., sunroof panel 604, sunroof operating system 214) is disposed below the opening 1114 in the roof sheet metal 1102 and above the opening 1112 in the headliner 1110. The glass sunroof assembly 1104 can be attached to the headliner 1110 and / or the roof sheet metal 1102. The glass sunroof assembly 1104 includes a retractable projection surface (e.g., projection surface 702), and associated tracks and motors (e.g., mood roof operating system 216) for retracting and extending the projection surface 702.

[0098] In short, the vehicle includes a mood roof display system disposed on the upper part (e.g., ceiling or roof) of the vehicle cabin instead of or in addition to a sunroof (also called a "moonroof"). The mood roof media application can obtain sensor data from one or more sensors that may include vehicle sensors, image sensors, environmental sensors, and biometric sensors. The mood roof media application then obtains media content (e.g., images, videos) based on the sensor data. For example, the vehicle can determine one or more states and / or characteristics based on the sensor data and obtain media content based on the one or more states and / or characteristics. Examples of states and / or characteristics that can be determined from the sensor data include the state of the vehicle, the characteristics inside the vehicle cabin, the state of the external environment of the vehicle, and the characteristics of the occupant(s). When the media content includes visual content, the mood roof media application causes visual content related to the media content, which can be at least a component of the media content itself, to be displayed on the mood roof display system on the upper part of the vehicle cabin. In some embodiments, the mood roof display system includes at least two displays, and at least one display is retractable to expose the vehicle cabin to the external environment of the vehicle. Additionally or alternatively, the mood roof display system can include a projection system having a retractable projection surface.

[0099] At least one of the advantages and technical improvements of the disclosed technology is to enable the ceiling inside the vehicle cabin to be opened so that natural light and air can flow into the vehicle cabin, and at the same time, the ceiling can be used as a display space for displaying media content to the passengers inside the vehicle cabin. Other advantages and technical improvements are that the disclosed technology enables an immersive media experience that further enhances the experience of the vehicle occupants. Further advantages and technical improvements are that since the media content can be obtained based on the emotional state(s) of the occupant(s), the overall experience of the occupant(s) can be improved.

[0100] 1. In some embodiments, a method executed by a computer for presenting media content inside a vehicle cabin includes determining at least one state associated with the vehicle cabin based on sensor data from at least one sensor data, receiving media content associated with the at least one state, and causing visual content associated with the media content to be displayed on at least one display surface disposed on the ceiling of the vehicle cabin.

[0101] 2. The method according to clause 1 or 2, wherein the at least one display surface is disposed vertically below the sunroof of the vehicle cabin.

[0102] 3. The method according to clause 1, wherein the at least one sensor includes at least one of a vehicle sensor, an environmental sensor, and a biometric sensor.

[0103] 4. The method according to any one of clauses 1 to 3, wherein the at least one state includes at least one of a vehicle state, an environmental state, and an emotional state of an occupant of the vehicle cabin.

[0104] 5. The method according to any one of clauses 1 to 4, wherein the at least one display surface includes a first display device and a second display device, the first display device is adjacent to the second display surface, and both the first display surface and the second display device display the visual content towards the interior of the vehicle cabin.

[0105] 6. The method according to any one of clauses 1 to 5, wherein the visual content includes visual content received from a device related to an occupant of the vehicle cabin, and the device is communicatively coupled to an entertainment information system of the vehicle cabin.

[0106] 7. The method according to any one of clauses 1 to 6, wherein the at least one display surface extends parallel to the ceiling of the vehicle cabin.

[0107] 8. In some embodiments, a system in a vehicle cabin for displaying media content includes a first display surface disposed on the ceiling of the vehicle cabin, a second display surface disposed on the ceiling of the vehicle cabin, the first display surface being movable relative to the second display surface, a memory storing a media application, and a processor coupled to the memory, the processor causing the media content to be displayed on the first display surface and the second display surface within the vehicle cabin when the media application is executed.

[0108] 9. The system according to clause 8, wherein causing the media content to be displayed on the first display surface and the second display surface includes transmitting the media content to one or more projectors, the one or more projectors projecting the media content onto the first display surface and the second display surface.

[0109] 10. The system according to any one of clauses 8 or 9, wherein the first display surface is at least partially transparent.

[0110] 11. The system according to any one of clauses 8 to 10, wherein when the first display surface is in the closed position, the first display surface is horizontally adjacent to the second display surface.

[0111] 12. The system according to any one of clauses 8 to 11, wherein when the first display surface is in the open position, the first display surface is disposed vertically above the second display surface.

[0112] 13. The system according to any one of clauses 8 to 12, wherein when executed by the processor, the media application further causes the processor to stop displaying media content on the first display surface when the first display surface is in the open position.

[0113] 14. The system according to any one of clauses 8 to 13, wherein the first display surface is disposed vertically below the sunroof panel, and when both the first display surface and the sunroof panel are in the open position, the sunroof of the vehicle cabin is open to the external environment.

[0114] 15. In some embodiments, one or more non-transitory computer-readable storage media determine a first emotional state associated with at least one occupant in a vehicle cabin, receive media content associated with the emotional state, and display visual content associated with the media content on at least one display surface disposed on the ceiling in the vehicle cabin, and when executed by a processor, include an instruction to cause the processor to present the media content.

[0115] 16. The one or more computer-readable storage media according to clause 15, wherein the visual content includes at least one still image and video related to the first emotional state.

[0116] 17. Receiving the media content related to the first emotional state includes determining a goal emotional state based on the first emotional state, and obtaining the media content based on the goal emotional state, in the one or more computer-readable storage media according to any of clauses 15 or 16.

[0117] 18. Receiving the media content related to the first emotional state includes receiving user input related to the goal emotional state, and selecting the media content based on the goal emotional state, in the one or more computer-readable storage media according to any of clauses 15 to 17.

[0118] 19. The one or more computer-readable storage media according to any of clauses 15 to 18, wherein the at least one display surface includes a first display surface and a second display surface, and the first display surface is movable relative to the second display surface disposed on the ceiling of the vehicle cabin.

[0119] 20. Further including determining at least one of a vehicle state and an environmental state, and receiving the media content related to the first emotional state includes obtaining the media content further based on the at least one of the vehicle state and the environmental state, in the one or more computer-readable storage media according to any of clauses 15 to 19.

[0120] Any and all combinations of any of the elements of any of the claims described in any claim, and / or any of the elements described in this application, are included within the scope intended to be protected in any manner.

[0121] The descriptions of the various embodiments are presented for purposes of illustration but are not intended to be exhaustive or limited to the disclosed embodiments. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments.

[0122] Aspects of the present embodiment can be embodied as a system, method, or computer program product. Accordingly, aspects of the present disclosure can take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, microcode, etc.), or an embodiment combining software and hardware aspects, all of which may generally be referred to herein as a "module" or "system." Furthermore, aspects of the present disclosure can take the form of a computer program product embodied in one or more computer-readable media having computer-readable program code embodied thereon.

[0123] Any combination of one or more computer-readable media can be utilized. The computer-readable media can be a computer-readable signal medium or a computer-readable storage medium. A computer-readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer-readable storage medium include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access Memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disc read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above. In the context of this specification, a computer-readable storage medium can be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.

[0124] Aspects of the present disclosure have been described above with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the disclosure. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, enable the execution of the functions / acts specified in the block or blocks of the flowchart and / or block diagram. Such a processor can be, by way of non-limiting example, a general purpose processor, a special purpose processor, an application specific processor, or a field programmable gate array.

[0125] The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible embodiments of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram can represent a module, segment, or portion of code, and each block includes one or more executable instructions for performing a particular logical function(s). It should also be noted that in some alternative embodiments, the functions noted in the blocks may occur in a different order than shown in the figures. For example, two blocks shown in succession may, in fact, be executed substantially simultaneously, or may sometimes be executed in the reverse order, depending on the functionality involved. It should also be noted that each block of the block diagrams and / or flowchart diagrams, and combinations of blocks in the block diagrams and / or flowchart diagrams, can be implemented by a dedicated hardware-based system for performing a particular function or operation, or by a combination of dedicated hardware and computer instructions.

[0126] While the foregoing is directed to embodiments of the present disclosure, further embodiments of the present disclosure can be devised without departing from the basic scope thereof, which is determined by the following claims.

Claims

1. A system for displaying media content within a vehicle cabin, the system comprising: a second display surface disposed on the ceiling of the vehicle cabin; a first display surface disposed on the ceiling of the vehicle cabin, the first display surface being between a closed position between a first glass panel within the ceiling of the vehicle cabin and the interior of the vehicle cabin and an open position between a second glass panel within the ceiling of the vehicle cabin and the second display surface and being movable relative to the second display surface; a memory storing a media application; a processor coupled to the memory; and wherein when the processor executes the media application, the processor performs the steps of deploying the first display surface from the open position to the closed position and displaying media content within the vehicle cabin using the first display surface and the second display surface. A system.

2. The system further comprising one or more projectors, wherein the step of displaying the media content using the first display surface and the second display surface comprises projecting the media content onto the first display surface and the second display surface using the one or more projectors. The system of claim 1.

3. The system of claim 1, wherein the first display surface is at least partially transparent.

4. The system of claim 1, wherein when the first display surface is in the closed position, the first display surface is horizontally adjacent to the second display surface.

5. The system according to any one of claims 1 to 4, wherein the step further comprises stopping the display of the media content on the first display surface when the first display surface is in the open position.

6. The step further comprises determining a state of an occupant of the vehicle cabin based on sensor data from at least one sensor and selecting the media content based on the state of the occupant. The system according to any one of claims 1 to 4.

7. The system according to claim 6, wherein the step of selecting the media content includes selecting the media content further based on the goal state of the occupant.

8. The state of the occupant is the initial emotional state of the occupant, The system according to claim 7, wherein the goal state of the occupant is the goal emotional state of the occupant.

9. The system according to claim 8, wherein the goal emotional state is selected by the occupant.

10. A method executed by a computer for presenting media content in a vehicle cabin, the method comprising: deploying a first display surface from an open position to a closed position; displaying media content on the first display surface and a second display surface including, The first display surface is the closed position between a first glass panel in the ceiling of the vehicle cabin and the interior of the vehicle cabin, the open position between a second glass panel in the ceiling and the second display surface is movable relative to the second display surface between, In the closed position, the first display surface and the second display surface are disposed on the ceiling.

11. The method according to claim 10, wherein displaying the media content on the first display surface and the second display surface includes projecting the media content onto the first display surface and the second display surface using one or more projectors.

12. The method according to claim 10, wherein the first display surface is at least partially transparent.

13. The method according to claim 10, wherein when the first display surface is in the closed position, the first display surface is horizontally adjacent to the second display surface.

14. The method according to claim 10, further comprising stopping displaying the media content on the first display surface when the first display surface is in the open position.

15. determining the state of an occupant of the vehicle cabin based on sensor data from at least one sensor; selecting the media content based on the state of the occupant further comprising the method according to claim 10.

16. The method according to claim 15, wherein selecting the media content includes selecting the media content further based on the goal state of the occupant.

17. The state of the occupant is the initial emotional state of the occupant, The method according to claim 16, wherein the goal state of the occupant is the goal emotional state of the occupant.

18. One or more non-transitory computer-readable storage media storing instructions which, when executed by a processor, cause the processor to perform the method according to any one of claims 10 to 17.

Images