Method, apparatus, device and medium for controlling content presentation

By controlling the presentation of multimedia content based on the vehicle driving conditions, the safety hazards of drivers browsing visual content are solved, and the complete experience of multimedia content is achieved while ensuring safety.

CN114257851BActive Publication Date: 2025-08-08MOBILITY ASIA SMART TECH CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202010996676.6
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-09-21
Publication Date
2025-08-08
Estimated Expiration
2040-09-21

AI Technical Summary

Technical Problem

There are safety risks for drivers to use smartphones to browse visual content during driving. The prior art can still not guarantee driving safety by directly projecting visual content to the vehicle's central console, which also leads to incomplete multimedia content experience.

Method used

The presentation of different types of content elements in the multimedia content is controlled according to the driving conditions of the vehicle, ensuring that only low attention needs are presented when the attention needs are high, and the full content is presented when the attention needs are reduced.

Benefits of technology

While ensuring driving safety, maintain a complete experience of multimedia content and avoid distraction from drivers.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114257851B_ABST
    Figure CN114257851B_ABST
Patent Text Reader

Abstract

Embodiments of the present disclosure relate to methods, devices, equipment, and computer-readable storage media for controlling content presentation. A method for controlling content presentation is provided, comprising: obtaining multimedia content to be presented in a vehicle, the multimedia content including multiple types of content elements; detecting the driving condition of the vehicle; if it is detected that the vehicle is in a first driving condition, causing a first content portion of the multimedia content to be presented in the vehicle, the first content portion including at least a portion of the first type of content elements among multiple types; and if it is detected that the vehicle changes from the first driving condition to a second driving condition, causing a second content portion of the multimedia content to be presented in the vehicle, the second content portion including at least a portion of the presented first content portion and at least a portion of the second type of content elements among multiple types. Through the embodiments of the present disclosure, it is possible to maintain a complete user experience of the multimedia content while ensuring driving safety.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] Embodiments of the present disclosure relate generally to multimedia technology, and more particularly to methods, apparatuses, devices, and computer-readable storage media for controlling content presentation. Background Art

[0002] Visual content, such as images and videos, can provide drivers with a rich and engaging experience. However, to ensure driving safety, only audio content is typically played in vehicles. Sometimes, drivers use their smartphones to browse visual content while driving. This behavior is not only dangerous but also prohibited by law.

[0003] Currently, to prevent drivers from using their smartphones to browse visual content while driving, mirroring technology is often used to project smartphone content directly onto the vehicle's center console display. This allows drivers to view all content on their smartphones on the center console display. However, this approach still poses safety risks. Summary of the Invention

[0004] According to an exemplary embodiment of the present disclosure, a solution for controlling content presentation is provided. This solution controls the presentation of different types of content elements in multimedia content based on the vehicle's driving conditions, thereby ensuring driving safety while maintaining a complete user experience of the multimedia content.

[0005] In a first aspect of the present disclosure, a method for controlling content presentation is provided. The method includes: acquiring multimedia content to be presented in a vehicle, the multimedia content including multiple types of content elements; detecting a driving condition of the vehicle; if the vehicle is detected to be in a first driving condition, causing a first content portion of the multimedia content to be presented in the vehicle, the first content portion including at least a portion of content elements of the first type from the multiple types; and if the vehicle is detected to have changed from the first driving condition to a second driving condition, causing a second content portion of the multimedia content to be presented in the vehicle, the second content portion including at least a portion of the presented first content portion and at least a portion of content elements of the second type from the multiple types.

[0006] In some embodiments, the first driving condition requires a higher level of user attention than the second driving condition, and the first type of content element requires a lower level of user attention than the second type of content element.

[0007] In some embodiments, causing the second content portion to be presented further includes: selecting at least a portion from the presented first content portion as a first target content portion; selecting a second target content portion from the multimedia content, the second target content portion including a portion of a second type of content element associated with the first target content portion; and combining the first target content portion and the second target content portion into a second content portion for presentation.

[0008] In some embodiments, selecting a second target content portion from the multimedia content includes: selecting a second type of content element from the multimedia content as the second target content portion that satisfies at least one of the following: comes from the same content source as the first target content portion, is presented simultaneously with the first target content portion, and describes more details about the first target content portion.

[0009] In some embodiments, the method further includes: obtaining content presentation criteria, the content presentation criteria indicating a correlation between the driving condition of the vehicle and the type of content elements that can be presented.

[0010] In some embodiments, causing the first content portion to be presented also includes: if it is detected that the vehicle is in a first driving condition, based on content presentation criteria, determining that the type of content elements that can be allowed to be presented under the first driving condition is a first type; and extracting at least a portion of the content elements of the first type from the multimedia content as the first content portion for presentation.

[0011] In some embodiments, causing the second content portion to be presented further includes: if it is detected that the vehicle changes from a first driving condition to a second driving condition, based on content presentation criteria, determining that the types of content elements that can be allowed to be presented under the second driving condition are a first type and a second type; and selecting at least a portion of the first content portion and at least a portion of the second type of content elements from the multimedia content as the second content portion for presentation.

[0012] In some embodiments, detecting the driving condition of the vehicle includes: detecting at least one of the following: the operating condition of the vehicle and the surrounding traffic condition of the vehicle; and determining the driving condition of the vehicle based on at least one of the detected operating condition and the surrounding traffic condition.

[0013] In some embodiments, the operating condition of the vehicle includes at least one of the following: the speed of the vehicle, the gear of the vehicle, the braking status of the vehicle, and the engine status of the vehicle, and the traffic condition around the vehicle includes at least one of the following: the condition of the traffic lights around the vehicle, the condition of other vehicles around the vehicle, and the condition of pedestrians around the vehicle.

[0014] In some embodiments, obtaining the multimedia content includes obtaining aggregated content of at least one of: audio, images, text, video, and content requiring user interaction.

[0015] In a second aspect of the present disclosure, a device for controlling content presentation is provided. The device includes: a content acquisition module configured to acquire multimedia content to be presented in a vehicle, the multimedia content including multiple types of content elements; a driving condition detection module configured to detect a driving condition of the vehicle; a first content presentation control module configured to, upon detecting that the vehicle is in a first driving condition, cause a first content portion of the multimedia content to be presented in the vehicle, the first content portion including at least a portion of content elements of a first type from multiple types; and a second content presentation control module configured to, upon detecting that the vehicle changes from the first driving condition to a second driving condition, cause a second content portion of the multimedia content to be presented in the vehicle, the second content portion including at least a portion of the presented first content portion and at least a portion of content elements of a second type from multiple types.

[0016] In some embodiments, the first driving condition requires a higher level of user attention than the second driving condition, and the first type of content element requires a lower level of user attention than the second type of content element.

[0017] In some embodiments, the second content presentation control module also includes: a first target content part selection module, configured to select at least a part from the presented first content part as a first target content part; a second target content part selection module, configured to select a second target content part from the multimedia content, the second target content part including a part of the second type of content element associated with the first target content part; and a target content part combination module, configured to combine the first target content part and the second target content part into a second content part for presentation.

[0018] In some embodiments, the second target content part selection module includes: a second type content element selection module, configured to select a second type of content element from the multimedia content as the second target content part that satisfies at least one of the following: comes from the same content source as the first target content part, is presented simultaneously with the first target content part, and describes more details about the first target content part.

[0019] In some embodiments, the apparatus further includes: a content presentation criterion acquisition module configured to acquire a content presentation criterion, the content presentation criterion indicating a correlation between a driving condition of the vehicle and a type of content element that is allowable for presentation.

[0020] In some embodiments, the first content presentation control module also includes: a first content element type determination module, configured to determine that the type of content elements allowable for presentation under the first driving condition is a first type based on content presentation criteria if the vehicle is detected to be in a first driving condition; and a first content part determination module, configured to extract at least a part of the first type of content element from the multimedia content as a first content part for presentation.

[0021] In some embodiments, the second content presentation control module also includes: a second content element type determination module, configured to determine, if it is detected that the vehicle changes from a first driving condition to a second driving condition, based on content presentation criteria, the types of content elements that can be allowed to be presented under the second driving condition as a first type and a second type; and a second content part determination module, configured to select at least a part of the first content part and at least a part of the second type of content elements from the multimedia content as a second content part for presentation.

[0022] In some embodiments, the driving condition detection module includes: an operating and traffic condition detection module, configured to detect at least one of the following: the operating condition of the vehicle and the traffic condition around the vehicle; and a driving condition determination module, configured to determine the driving condition of the vehicle based on at least one of the detected operating condition and surrounding traffic condition.

[0023] In some embodiments, the operating condition of the vehicle includes at least one of the following: the speed of the vehicle, the gear of the vehicle, the braking status of the vehicle, and the engine status of the vehicle, and the traffic condition around the vehicle includes at least one of the following: the condition of the traffic lights around the vehicle, the condition of other vehicles around the vehicle, and the condition of pedestrians around the vehicle.

[0024] In a third aspect of the present disclosure, a device for controlling content presentation is provided. The device includes: at least one processing unit; and at least one memory, the at least one memory being coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, wherein the instructions, when executed by the at least one processing unit, cause the device to perform the method according to the first aspect of the present disclosure.

[0025] In a fourth aspect of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a device, the device executes the method according to the first aspect of the present disclosure.

[0026] It can be seen from the above description that by presenting different types of content elements in multimedia content according to different driving conditions of the vehicle, it is possible to maintain a complete user experience of the multimedia content while ensuring driving safety.

[0027] It should be understood that the contents described in the Summary of the Invention section are not intended to limit the key or important features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become readily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:

[0029] Figure 1 A schematic diagram illustrating an example environment according to an embodiment of the present disclosure is shown;

[0030] Figure 2 A flowchart illustrating an example method for controlling content presentation according to an embodiment of the present disclosure is shown;

[0031] Figure 3 a flowchart illustrating an example method for causing a second content portion to be presented according to an embodiment of the present disclosure;

[0032] Figure 4 A block diagram illustrating an example apparatus for controlling content presentation according to an embodiment of the present disclosure; and

[0033] Figure 5 A block diagram of a computing device is shown in which embodiments of the present disclosure may be implemented. DETAILED DESCRIPTION

[0034] The following describes embodiments of the present disclosure in more detail with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments described herein. Instead, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of protection of the present disclosure.

[0035] In the description of the embodiments of the present disclosure, the term "including" and similar terms should be understood as open inclusion, that is, "including but not limited to." The term "based on" should be understood as "based at least in part on." The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment." The terms "first," "second," etc. may refer to different or the same objects. Other explicit and implicit definitions may also be included below.

[0036] As mentioned above, currently, in order to prevent drivers from using smartphones to browse visual content while driving, mirroring technology is usually used to project the content in the smartphone directly onto the presentation screen of the vehicle's center console. In this way, the driver can browse all the content in his smartphone on the presentation screen of the center console. However, visual content may distract the driver's attention. Therefore, directly projecting the visual content in the smartphone onto the presentation screen of the center console still poses a major safety hazard, especially when, for example, the vehicle is moving at a high speed or the surrounding traffic conditions are complex. In some cases, in order to ensure driving safety, when the vehicle is moving at a high speed or the surrounding traffic conditions are complex, all visual content is controlled not to be presented. In such a solution, the visual content that is not presented is missing for the driver, making it impossible for the driver to obtain a complete experience of the multimedia content.

[0037] According to an embodiment of the present disclosure, a solution for controlling content presentation is proposed. This solution controls the presentation of different types of content elements within multimedia content based on the vehicle's driving conditions. When a vehicle detects a change from a first driving condition requiring a higher level of user attention to a second driving condition requiring a lower level of user attention, the portion of the multimedia content that was not presented during the first driving condition is controlled and presented in the vehicle. This content presentation solution ensures driving safety while maintaining a complete user experience of the multimedia content.

[0038] Figure 1 1 shows a schematic diagram of an example environment 100 according to an embodiment of the present disclosure. Figure 1 As shown, example environment 100 includes a presentation control device 110, a multimedia presentation system 120 in a vehicle 160, a driving condition 130, a content library 140, and a criteria library 150. In some embodiments, presentation control device 100 can retrieve multimedia content 145 from content library 140 and, based on driving condition 130 detected by vehicle sensors, cause a certain portion of multimedia content 145 to be presented in the vehicle, for example, by multimedia presentation system 120 in the vehicle. Additionally, in some embodiments, presentation control device 100 can also retrieve information such as content presentation criteria 155 from criteria library 150 and, based on information such as the detected driving condition 130 and content presentation criteria 155, cause a certain portion of multimedia content 145 to be presented in the vehicle.

[0039] The multimedia presentation system 120 can present a certain portion of the multimedia content 145 based on the control command received from the presentation control device 110. In some embodiments, the multimedia presentation system 120 includes a visual content presentation device, such as a display screen, for presenting the visual content of the multimedia content. Alternatively, in other embodiments, the multimedia presentation system 120 may also include an audio playback device (not shown) to play the audio content (if any) of the multimedia content. The presentation control device 110 and the multimedia presentation system 120 can communicate with each other via a bus in the vehicle.

[0040] Regarding the driving situation 130, the multimedia content 145 in the content library 140, and the content presentation criteria 155 in the criteria library 150, the following will be described. Figure 2 Detailed description.

[0041] It should be understood that the example environment 100 is described for illustrative purposes only and does not imply any limitation on the scope of the present disclosure. For example, embodiments of the present disclosure may also be applied to environments different from the example environment 100. For example, the presentation control device of an embodiment of the present disclosure may also be in a vehicle. It should be understood that the specific number of the above-mentioned devices is given for illustrative purposes only and does not imply any limitation on the scope of the present disclosure. Embodiments of the present disclosure may also obtain other information in addition to driving conditions and content presentation criteria. Embodiments of the present disclosure may also be applied to more multimedia presentation systems.

[0042] Figure 2 A flowchart of an example method 200 for controlling content presentation according to an embodiment of the present disclosure is shown. In some embodiments, the method 200 may be performed by Figure 1 The presenting control device 110 shown is implemented. For ease of understanding, the specific data mentioned in the following description are exemplary and are not intended to limit the scope of protection of the present disclosure.

[0043] At 210, the presentation control device 110 obtains multimedia content 145 to be presented in the vehicle 160, and the multimedia content 145 includes multiple types of content elements. In some embodiments, the presentation control device 110 can obtain aggregated content of different combinations of content elements such as audio, images, text, and video. For example, the presentation control device 110 can obtain audio and video containing audio, text, and video. Additionally or alternatively, the presentation control device 110 can obtain articles containing images and text. Additionally, the multimedia content 145 can also include content that requires user interaction, such as content that is enlarged or reduced by a user click, content that presents details by a user click, content that is selected by a user click, etc.

[0044] In some embodiments, the presentation control device 110 can obtain multimedia content 145 by accessing a pre-configured content library 140. The multimedia content 145 in the content library 140 can have a label to indicate the type of content elements included in the multimedia content 145. For example, an audio and video containing audio, text, and video can have a label of "audio+video+text", and the audio, text, and video parts can further have their own sub-labels; an article containing images and text can have a label of "image+text", and the images and text can further have their own sub-labels. Additionally or alternatively, in other embodiments, the presentation control device 110 can obtain multimedia content outside the content library 140, for example, through a connected user's smartphone.

[0045] At 220, the presentation control device 110 detects the vehicle's driving condition 130. In some embodiments, the vehicle's driving condition 130 may be associated with the vehicle's own operating condition. In some embodiments, the presentation control device 110 may acquire signals from vehicle sensors to detect the vehicle's operating condition. The vehicle's operating condition may include, for example, the vehicle's speed, gear position, braking status, and engine status. For example, the vehicle's speed value, whether the vehicle's gear position is P or D, whether the vehicle is braked, whether the vehicle's engine is on or off, etc.

[0046] Additionally or alternatively, in other embodiments, the vehicle's driving condition 130 may be associated with the vehicle's surrounding traffic conditions. The presentation control device 110 may also acquire signals from vehicle sensors to detect the vehicle's surrounding traffic conditions. The surrounding traffic conditions may include, for example, the conditions of traffic lights surrounding the vehicle, the conditions of other vehicles surrounding the vehicle, and the conditions of pedestrians surrounding the vehicle, such as whether the traffic light is red or green, the number of other vehicles surrounding the vehicle and their respective speeds, whether there are pedestrians around the vehicle, and the number of pedestrians surrounding the vehicle.

[0047] The presentation control device 110 can determine the vehicle's driving condition 130 based on the detected operating conditions and / or surrounding traffic conditions. In some embodiments, the vehicle's driving condition 130 can include multiple predefined driving conditions, each of which is associated with a corresponding operating condition and / or surrounding traffic condition. For example, the vehicle's driving condition 130 can include: a very fast driving condition, a fast driving condition, a medium speed driving condition, a slow driving condition with complex surrounding traffic, a vehicle parked with the engine on, a vehicle parked with the engine off, and the like.

[0048] At 230 , presentation control device 110 detects whether vehicle 160 is in a first driving condition. If so, at 240 , presentation control device 110 causes a first content portion of multimedia content 145 to be presented in the vehicle, the first content portion including at least a portion of content elements of a first type among the plurality of types.

[0049] It is easy to understand that different driving conditions require different levels of user attention. For example, when the vehicle is moving at a faster speed or the traffic conditions around the vehicle are more complex, the driver needs to maintain a higher level of attention to ensure driving safety. At the same time, different types of content elements to be presented also require different levels of user attention. For example, in order of the required level of user attention, they are audio, images, text, video, and content requiring user interaction. In order to ensure driving safety, when the vehicle is moving at a faster speed or the surrounding traffic conditions are more complex, content elements that require a higher level of user attention should not be presented to prevent the driver's attention from being distracted, thereby causing safety problems.

[0050] Therefore, when presentation control device 110 detects that vehicle 160 is in a first driving condition requiring a high level of user attention, content elements in multimedia content 145 requiring a low level of user attention are presented. In other words, a missing version of the complete multimedia content is presented. For example, in some examples, when vehicle 160 is detected to be in a first driving condition requiring a high level of user attention, presentation control device 110 may cause the audio content portion of a complete movie to be presented, while the video portion is not presented. In some examples, when vehicle 160 is detected to be in a first driving condition requiring a high level of user attention, presentation control device 110 may cause the image portion of a complete article to be presented, while the text portion is not presented.

[0051] In some embodiments, upon detecting that the vehicle 160 is in a first driving condition, the presentation control device 110 may determine, based on the level of user attention required by the first driving condition, which content elements of the first type to present in the multimedia content 145. For example, in some examples, if the first driving condition is detected as a medium-speed driving condition, e.g., greater than 10 km / h but less than 40 km / h, the presentation control device 110 may cause at least a portion of the audio, images, and text in the multimedia content 145 to be presented, but may not cause the video and content requiring user interaction in the multimedia content 145 to be presented. In some examples, if the first driving condition is detected as a fast-speed driving condition, e.g., greater than 40 km / h, the presentation control device 110 may cause at least a portion of the audio and images in the multimedia content 145 to be presented, but may not cause other content elements in the multimedia content 145 to be presented, and so on.

[0052] In some embodiments, the presentation control device 110 can obtain content presentation criteria 155, which indicates the correlation between the driving condition of the vehicle and the type of content elements that can be presented. When it is detected that the vehicle 160 is in a first driving condition, the presentation control device 110 can determine that the type of content elements that can be presented is the first type based on the content presentation criteria 150, and then extract at least a portion of the first type of content elements from the multimedia content 145 as the first content portion for presentation. As explained above, the user attention required for the first driving condition is higher, so it is more appropriate to present the first content portion that requires lower user attention. In some examples, the first driving condition can be a medium-speed driving condition, and the first type of content elements can be audio, images, and text. In some examples, the first driving condition can be a fast driving condition, and the first type of content elements can be audio and images, etc.

[0053] In some embodiments, the content presentation criteria 155 may define that when the vehicle is in an ultra-fast state exceeding 80 km / h, all content elements in the multimedia content 145 are prohibited from being presented. In some embodiments, the content presentation criteria 155 may define that when the vehicle is parked and the engine is off, all content elements in the multimedia content 145 are permitted to be presented. In some embodiments, the content presentation criteria 155 may define that when the vehicle is parked but the engine is on, audio, image, text, and video content elements in the multimedia content 145 are permitted to be presented, but content elements requiring user interaction are not permitted to be presented. In some embodiments, the content presentation criteria 155 may define that when the vehicle is in a state where the surrounding traffic light is red and the vehicle is braking, audio, image, text, and video content elements in the multimedia content 145 are permitted to be presented, but content elements requiring user interaction are not permitted to be presented, and so on.

[0054] In some embodiments, content presentation criteria 155 may be preconfigured by the vehicle manufacturer. In some embodiments, the driver may adjust the preconfigured content presentation criteria 155 as needed to obtain customized content presentation criteria. For example, the vehicle manufacturer may preconfigure content presentation criteria 155 to prohibit presentation of all content elements in multimedia content 145 when the vehicle is traveling at a speed exceeding 80 km / h. An experienced driver may adjust content presentation criteria 155 to prohibit presentation of all content elements in multimedia content 145 when the vehicle is traveling at a speed exceeding 90 km / h.

[0055] It should be understood that the various content presentation criteria and the driver's adjustments to the content presentation criteria are shown for exemplary purposes only and do not imply any limitation on the scope of the present disclosure. For example, other content presentation criteria may be pre-configured, and the driver may also make other adjustments to the content presentation criteria. The present disclosure is not limited in this respect.

[0056] By determining the first content part based on the content presentation criteria and the driving condition of the vehicle, content elements suitable for different driving conditions and different drivers can be flexibly determined for presentation, making it possible to customize the content usage experience suitable for different driving conditions and different drivers.

[0057] At 250 , presentation control device 110 detects whether vehicle 160 has changed from a first driving condition to a second driving condition. If so, at 260 , presentation control device 110 causes a second content portion of multimedia content 145 to be presented in vehicle 160 , the second content portion including at least a portion of the already presented first content portion and at least a portion of content elements of a second type among a plurality of types. That is, when the vehicle is in the second driving condition, presentation control device 110 controls the presentation of more types of content elements in the multimedia content to the user, particularly including portions of content that had been previously presented. In other words, at this point, presentation control device 110 can cause a complete version (i.e., the second content portion) corresponding to the previously presented missing version of multimedia content 145 (i.e., the first content portion) to be presented.

[0058] In some embodiments, upon detecting that vehicle 160 has changed from a first driving condition requiring a higher level of user attention to a second driving condition requiring a lower level of user attention, such as a change to a lower vehicle speed or a lighter traffic situation, presentation control device 110 may cause a second content portion to be presented in vehicle 160. The second content portion includes at least a portion of the presented first content portion and at least a portion of a second type of content element requiring a higher level of user attention. In this manner, presentation control device 110 may present less distracting content elements of the multimedia content during periods when the driver's attention should be focused on driving, thereby ensuring driving safety while enabling the driver to understand the theme and / or outline of the multimedia content. Furthermore, presentation control device 110 may present other content or details during periods when the driver's attention is less required, allowing the driver to fully understand the multimedia content.

[0059] In some embodiments, when it is detected that the vehicle 160 changes from a first driving condition to a second driving condition, the presentation control device 110 can determine the types of content elements that can be presented as a first type and a second type according to the content presentation criteria 150, and then select at least a portion of the first content portion and at least a portion of the second type of content elements from the multimedia content as the second content portion for presentation.

[0060] For example, in an embodiment where the acquired multimedia content is an article including images and text, when it is detected that the vehicle is in a fast-moving condition, such as above 40 km / h, the presentation control device 110 causes some images in the article to be presented, but the text describing these images is not presented; when it is detected that the driving condition of the vehicle changes to a low-speed driving condition, such as below 10 km / h or even parked (for example, when waiting for a red light), the presentation control device 110 can cause these images and the text describing these images to be presented together.

[0061] In an embodiment where the acquired multimedia content is audio and video including audio, text, and video, when it is detected that the vehicle is in a fast-moving condition, for example, above 40 km / h, the presentation control device 110 causes the audio in the audio and video and a certain frame of image in the video to be presented, but the text and video are not presented; when it is detected that the driving condition of the vehicle has changed to a condition where the traffic light is red and the vehicle is braking, the presentation control device 110 causes the text and video that have not been previously presented to be presented together with the audio that has been presented.

[0062] In this way, when the vehicle is in a first driving condition that requires a higher level of user attention, the driver can understand the subject and / or summary of the multimedia content by listening to audio or viewing images; when the vehicle changes from the first driving condition to a second driving condition that requires a lower level of user attention, the presentation control device 110 can present the unpresented content in the multimedia content that is associated with the presented content, so that the driver can obtain the complete multimedia content in the second driving condition without affecting driving safety. How to make the second content part be presented will be described below. Figure 3 To describe in detail.

[0063] It should be understood that the first driving condition, the second driving condition, the first type of content element, and the second type of content element are shown for exemplary purposes only and do not imply any limitation on the scope of the present disclosure. For example, the first driving condition and the second driving condition may also be other driving conditions, and the first type and the second type of content elements may also be other types. The present disclosure is not limited in this respect.

[0064] In the above exemplary embodiments, by presenting different types of content elements in the multimedia content according to different driving conditions of the vehicle, it is possible to ensure driving safety while maintaining a complete user experience of the multimedia content.

[0065] Figure 3 1 is a flowchart illustrating an example method 300 for causing a second content portion to be presented according to an embodiment of the present disclosure. In some embodiments, the method 300 may be performed at Figure 1 The presenting control device 110 is shown as being implemented. For ease of understanding, the specific data mentioned in the following description are exemplary and are not intended to limit the scope of protection of the present disclosure.

[0066] At 310 , the presentation control device 110 may select at least one portion from the presented first content portion as a first target content portion. As explained above, the first content portion includes, for example, content elements requiring less user attention.

[0067] In some embodiments, presentation control device 110 may select the last presented portion from the presented first content portions as the first target content portion. Alternatively, in other embodiments, presentation control device 110 may select the entire presented first content portion as the first target content portion. For example, in an embodiment where the acquired multimedia content is an article including images and text, and the presented first content portion consists of three images, presentation control device 110 may select the last presented image from these three images as the first target content portion, or may select all three images as the first target content portion.

[0068] At 320 , the presentation control device 110 may select a second target content portion from the multimedia content, the second target content portion including a portion of the second type of content element associated with the first target content portion.

[0069] Taking the example of an embodiment where the first content portion presented is an image, if the first target content portion is the last image presented, presentation control device 110 may select a second-type content element associated with this image from the multimedia content. For example, presentation control device 110 may select text describing the image in more detail from the multimedia content, or select a video presented simultaneously with the image from the multimedia content, or select content requiring user interaction from the same content source as the image from the multimedia content. If the first target content portion is all images presented, presentation control device 110 may select all second-type content elements associated with these three images from the multimedia content.

[0070] At 330, presentation control device 110 combines the first target content portion and the second target content portion into a second content portion for presentation. The combined second content portion may require a higher level of user attention, but this content presentation is appropriate when the vehicle is in a second driving condition that does not require as much user attention. In this way, the driver can fully browse the multimedia content while the vehicle is in the second driving condition.

[0071] In the above exemplary embodiment, by combining at least a portion of the presented first content portion and a second type of content element associated with the portion, the driver is enabled to browse the multimedia content portion that was not presented during the previous driving process, so that the driver maintains a complete experience of the multimedia content.

[0072] Figure 4 FIG. 4 is a block diagram showing an example apparatus 400 for controlling content presentation according to an embodiment of the present disclosure. The apparatus 400 may be used to implement, for example, Figure 1 The presentation control device 110 is shown. Figure 4 As shown, the device 400 may include a content acquisition module 410, configured to acquire multimedia content to be presented in a vehicle, the multimedia content including multiple types of content elements; a driving condition detection module 420, configured to detect the driving condition of the vehicle; a first content presentation control module 430, configured to cause a first content portion in the multimedia content to be presented in the vehicle if it is detected that the vehicle is in a first driving condition, the first content portion including at least a portion of content elements of a first type among multiple types; and a second content portion presentation module 440, configured to cause a second content portion in the multimedia content to be presented in the vehicle if it is detected that the vehicle changes from the first driving condition to the second driving condition, the second content portion including at least a portion of the presented first content portion and at least a portion of content elements of a second type among multiple types.

[0073] In some embodiments, the first driving condition requires a higher level of user attention than the second driving condition, and the first type of content element requires a lower level of user attention than the second type of content element.

[0074] In some embodiments, the second content part presentation module 440 also includes: a first target content part selection module, configured to select at least a portion from the presented first content part as a first target content part; a second target content part selection module, configured to select a second target content part from the multimedia content, the second target content part including a portion of the second type of content element associated with the first target content part; and a target content part combination module, configured to combine the first target content part and the second target content part into a second content part for presentation.

[0075] In some embodiments, the second target content part selection module includes: a second type content element selection module, configured to select a second type of content element from the multimedia content as the second target content part that satisfies at least one of the following: comes from the same content source as the first target content part, is presented simultaneously with the first target content part, and describes more details about the first target content part.

[0076] In some embodiments, the apparatus 400 further includes: a content presentation criterion acquisition module configured to acquire a content presentation criterion, where the content presentation criterion indicates a correlation between the driving condition of the vehicle and the type of content elements that can be presented.

[0077] In some embodiments, the first content presentation control module 430 also includes: a first content element type determination module, configured to determine, if it is detected that the vehicle is in a first driving condition, based on content presentation criteria, that the type of content elements that can be allowed to be presented under the first driving condition is a first type; and a first content part determination module, configured to extract at least a part of the first type of content element from the multimedia content as a first content part for presentation.

[0078] In some embodiments, the second content presentation control module 440 also includes: a second content element type determination module, configured to determine, based on content presentation criteria, if it is detected that the vehicle changes from a first driving condition to a second driving condition, the types of content elements that can be allowed to be presented under the second driving condition as a first type and a second type; and a second content part determination module, configured to select at least a part of the first content part and at least a part of the second type of content elements from the multimedia content as a second content part for presentation.

[0079] In some embodiments, the driving condition detection module 420 includes: an operating and traffic condition detection module, configured to detect at least one of the following: the operating condition of the vehicle and the traffic condition around the vehicle; and a driving condition determination module, configured to determine the driving condition of the vehicle based on at least one of the detected operating condition and surrounding traffic condition.

[0080] In some embodiments, the operating condition of the vehicle includes at least one of the following: the speed of the vehicle, the gear of the vehicle, the braking status of the vehicle, and the engine status of the vehicle, and the traffic condition around the vehicle includes at least one of the following: the condition of the traffic lights around the vehicle, the condition of other vehicles around the vehicle, and the condition of pedestrians around the vehicle.

[0081] The modules and / or units included in the device 400 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some embodiments, one or more units can be implemented using software and / or firmware, such as machine executable instructions stored on a storage medium. In addition to or as an alternative to machine executable instructions, some or all of the units in the device 400 can be implemented at least in part by one or more hardware logic components. By way of example and not limitation, exemplary types of hardware logic components that can be used include field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.

[0082] Figure 4 The modules and / or units shown in the can be partially or completely implemented as hardware modules, software modules, firmware modules, or any combination thereof. In particular, in some embodiments, the processes, methods, or procedures described above can be implemented by hardware in the storage system, a host corresponding to the storage system, or other computing devices independent of the storage system.

[0083] Figure 5 1 is a schematic block diagram of an example device 500 that can be used to implement an embodiment of the present disclosure. The device 500 can be used to implement the following Figure 1 The presentation control device 110 is shown. Figure 5 As shown, the device 500 includes a central processing unit (CPU) 501, which can perform various appropriate actions and processes according to computer program instructions stored in a read-only memory (ROM) 502 or computer program instructions loaded from a storage unit 508 into a random access memory (RAM) 503. Various programs and data required for the operation of the device 500 can also be stored in the RAM 503. The CPU 501, ROM 502, and RAM 503 are connected to each other via a bus 504. An input / output (I / O) interface 505 is also connected to the bus 504.

[0084] Various components in the device 500 are connected to the I / O interface 505, including: an input unit 506, such as a keyboard, a mouse, etc.; an output unit 507, such as various types of renderers, speakers, etc.; a storage unit 508, such as a magnetic disk, an optical disk, etc.; and a communication unit 509, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 509 allows the device 500 to exchange information / data with other devices via a computer network such as the Internet and / or various telecommunication networks.

[0085] The processing unit 501 performs the various methods and processes described above, such as methods 200 and 300. For example, in some embodiments, methods 200 and 300 may be implemented as a computer software program that is tangibly contained in a machine-readable medium, such as storage unit 508. In some embodiments, part or all of the computer program may be loaded and / or installed onto the device 500 via ROM 502 and / or communication unit 509. When the computer program is loaded into RAM 503 and executed by CPU 501, one or more steps of methods 200 and 300 described above may be performed. Alternatively, in other embodiments, CPU 501 may be configured to perform methods 200 and 300 in any other suitable manner (e.g., via firmware).

[0086] The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, and without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), and the like.

[0087] In the context of the present disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in conjunction with an instruction execution system, device or equipment. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0088] In addition, although adopting specific order to describe each operation, this should be understood as requiring such operation to be carried out in the specific order shown or in sequential order, or requiring that all illustrated operations should be carried out to obtain desired results. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although comprising some specific implementation details in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of separate embodiment can also be implemented in a single implementation in combination. On the contrary, the various features described in the context of a single implementation also can be implemented in a plurality of implementations individually or in the mode of any suitable subcombination.

Claims

1. A method for controlling content presentation, comprising: Acquire multimedia content to be presented in a vehicle, the multimedia content including a plurality of types of content elements; detecting a driving condition of the vehicle, wherein detecting the driving condition of the vehicle comprises: detecting both an operating condition of the vehicle and a surrounding traffic condition of the vehicle based on signals from vehicle sensors, and determining the driving condition of the vehicle based on both the detected operating condition and the detected surrounding traffic condition, wherein the operating condition of the vehicle comprises at least one of the following: a gear position of the vehicle and an engine status of the vehicle; If it is detected that the vehicle is in a first driving condition, causing a first content portion of the multimedia content to be presented in the vehicle, the first content portion including at least a portion of content elements of a first type among the plurality of types; and If it is detected that the vehicle changes from the first driving condition to the second driving condition, a second content portion in the multimedia content is presented in the vehicle, the second content portion including at least a portion of the presented first content portion and at least a portion of content elements of a second type among the multiple types.

2. The method of claim 1 , wherein the first driving condition requires a higher level of user attention than the second driving condition, and the first type of content element requires a lower level of user attention than the second type of content element.

3. The method of claim 1 , wherein causing the second content portion to be presented further comprises: selecting at least one portion from the presented first content portion as a first target content portion; selecting a second target content portion from the multimedia content, the second target content portion comprising a portion of the second type of content element associated with the first target content portion; as well as The first targeted content portion and the second targeted content portion are combined into the second content portion for presentation.

4. The method of claim 3, wherein selecting the second target content portion from the multimedia content comprises: A second type of content element that satisfies at least one of the following conditions is selected from the multimedia content as the second target content part: The first target content portion comes from the same content source, and the first target content portion is presented simultaneously, and Describe more details about the first target content portion.

5. The method according to claim 1, further comprising: A content presentation criterion is obtained, wherein the content presentation criterion indicates a correlation between a driving condition of the vehicle and a type of content element that is allowable for presentation.

6. The method of claim 5, wherein causing the first content portion to be presented further comprises: If it is detected that the vehicle is in the first driving condition, determining, based on the content presentation criteria, that the type of content elements that can be presented in the first driving condition is the first type; as well as At least a portion of the content elements of the first type are extracted from the multimedia content as the first content portion for presentation.

7. The method of claim 5, wherein causing the second content portion to be presented further comprises: If it is detected that the vehicle changes from the first driving condition to the second driving condition, determining, based on the content presentation criteria, that the types of content elements that can be presented in the second driving condition are the first type and the second type; as well as At least a portion of the first content portion and at least a portion of the content elements of the second type are selected from the multimedia content as the second content portion for presentation.

8. The method according to claim 1, wherein the operating condition of the vehicle further comprises at least one of the following: the speed of the vehicle and the braking state of the vehicle, and The surrounding traffic condition of the vehicle includes at least one of the following: a condition of traffic lights around the vehicle, a condition of other vehicles around the vehicle, and a condition of pedestrians around the vehicle.

9. The method of claim 1 , wherein obtaining the multimedia content comprises: Aggregated content of at least one of the following is obtained: audio, image, text, video, and content requiring user interaction.

10. A device for controlling content presentation, comprising: a content acquisition module configured to acquire multimedia content to be presented in the vehicle, the multimedia content including a plurality of types of content elements; A driving condition detection module is configured to detect the driving condition of the vehicle, wherein the driving condition detection module includes: an operating and traffic condition detection module configured to detect both an operating condition of the vehicle and a traffic condition surrounding the vehicle, wherein detecting both the operating condition of the vehicle and the traffic condition surrounding the vehicle is based on signals from vehicle sensors, wherein the operating condition of the vehicle includes at least one of the following: a gear position of the vehicle and an engine status of the vehicle, and a driving condition determination module configured to determine a driving condition of the vehicle based on both the detected operating condition and the surrounding traffic condition; a first content presentation control module configured to cause a first content portion of the multimedia content to be presented in the vehicle if it is detected that the vehicle is in a first driving condition, the first content portion including at least a portion of content elements of a first type among the plurality of types; and A second content presentation control module is configured to, if it is detected that the vehicle changes from the first driving condition to a second driving condition, cause a second content portion of the multimedia content to be presented in the vehicle, the second content portion including at least a portion of the presented first content portion and at least a portion of content elements of a second type among the multiple types.

11. The apparatus of claim 10, wherein the first driving condition requires a higher level of user attention than the second driving condition, and the first type of content element requires a lower level of user attention than the second type of content element.

12. The apparatus according to claim 10, wherein the second content presentation control module further comprises: A first target content part selection module is configured to select at least one part from the presented first content part as a first target content part; a second target content portion selection module configured to select a second target content portion from the multimedia content, wherein the second target content portion includes a portion of the second type of content element associated with the first target content portion; as well as The target content portion combining module is configured to combine the first target content portion and the second target content portion into the second content portion for presentation.

13. The apparatus according to claim 12, wherein the second target content portion selection module comprises: The second-type content element selection module is configured to select a second-type content element that satisfies at least one of the following conditions from the multimedia content as the second target content portion: The first target content portion comes from the same content source, and the first target content portion is presented simultaneously, and Describe more details about the first target content portion.

14. The apparatus according to claim 10, further comprising: The content presentation criterion acquisition module is configured to acquire a content presentation criterion indicating a correlation between a driving condition of the vehicle and a type of content element that can be presented.

15. The apparatus according to claim 14, wherein the first content presentation control module further comprises: a first content element type determination module configured to, if it is detected that the vehicle is in the first driving condition, determine, based on the content presentation criteria, that the type of content elements that can be allowed to be presented in the first driving condition is the first type; as well as The first content portion determination module is configured to extract at least a portion of the first type of content elements from the multimedia content as the first content portion for presentation.

16. The apparatus according to claim 14, wherein the second content presentation control module further comprises: a second content element type determination module configured to, if it is detected that the vehicle changes from the first driving condition to the second driving condition, determine, based on the content presentation criteria, that the types of content elements that can be allowed to be presented in the second driving condition are the first type and the second type; as well as The second content portion determination module is configured to select at least a portion of the first content portion and at least a portion of the second type of content elements from the multimedia content as the second content portion for presentation.

17. The apparatus according to claim 10, wherein the operating condition of the vehicle further comprises at least one of the following: the speed of the vehicle and the braking state of the vehicle, and The surrounding traffic condition of the vehicle includes at least one of the following: a condition of traffic lights around the vehicle, a condition of other vehicles around the vehicle, and a condition of pedestrians around the vehicle.

18. The apparatus according to claim 10, wherein the content acquisition module comprises: The aggregate content acquisition module is configured to acquire aggregate content of at least one of the following: audio, image, text, video, and content requiring user interaction.

19. A device for controlling content presentation, comprising: at least one processing unit; as well as At least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions, when executed by the at least one processing unit, causing the apparatus to perform the method according to any one of claims 1 to 9.

20. A computer-readable storage medium having a computer program stored thereon, which, when executed by a device, causes the device to perform the method according to any one of claims 1 to 9.

Citation Information

Patent Citations

  • Method for processing multimedia broadcasting data in wireless terminal in a driving vehicle

    CN1956366A