Audiovisual parameter determination method and apparatus, electronic device, storage medium, and product

Abstract

The present disclosure relates to an audio-visual parameter determination method and device, electronic equipment, storage medium and product. The audio-visual parameter determination method comprises: in response to playing of a media file, obtaining current environment information, wherein the current environment information comprises one or more of ambient light intensity and ambient noise; determining a current audio-visual parameter based on the current environment information, wherein a visual parameter is determined based on the ambient light intensity, and an auditory parameter is determined based on the ambient noise. Through the present disclosure, the audio-visual parameter of the played media file can be adaptively adjusted, and the user experience is improved.

Description

Technical Field

[0001] This disclosure relates to the field of media file adjustment, and in particular to methods, apparatus, electronic devices, storage media, and products for determining audiovisual parameters. Background Technology

[0002] Currently, when users watch media files, such as videos, through streaming media platforms, they adjust the audio-visual parameters of the media file, such as volume and screen brightness. Related technologies typically use solid-state buttons to adjust the volume, but repeatedly pressing these buttons can negatively impact the user experience. Furthermore, this adjustment method is not intelligent enough, and solid-state buttons are prone to damage, ultimately preventing users from effectively adjusting the audio-visual parameters. Summary of the Invention

[0003] To overcome the problems existing in related technologies, this disclosure provides a method, apparatus, electronic device, storage medium, and product for determining audiovisual parameters.

[0004] According to some embodiments of this disclosure, a method for determining audiovisual parameters is provided, comprising: in response to the playback of a media file, acquiring current environmental information; wherein the current environmental information includes one or more of ambient light intensity and ambient noise; determining current audiovisual parameters based on the current environmental information; wherein visual parameters are determined based on the ambient light intensity and auditory parameters are determined based on the ambient noise; and continuing to play the media file based on the current audiovisual parameters.

[0005] In some embodiments, after continuing to play the media file based on the current audiovisual parameters, the method further includes:

[0006] Receive audiovisual parameter adjustment instructions, adjust the current audiovisual parameters based on the audiovisual parameter adjustment instructions to obtain target audiovisual parameters, and play the media file according to the target audiovisual parameters.

[0007] In some embodiments, obtaining the audiovisual parameter adjustment instruction includes: in response to receiving a touch operation in a preset area within the media file playback window, determining that the audiovisual parameter adjustment instruction has been obtained.

[0008] In some embodiments, adjusting the current audiovisual parameters based on the audiovisual parameter adjustment command to obtain target audiovisual parameters includes: sampling and recording the touch point position within a preset time period according to a preset sampling period, and determining the sliding acceleration and touch pressure value when touching the touch point position to determine the effective sliding trajectory; accumulating the audiovisual parameter adjustment amount corresponding to each effective sliding trajectory to obtain an adjustment value; and obtaining the target audiovisual parameters based on the adjustment value and the current audiovisual parameters.

[0009] In some embodiments, before determining the current audiovisual parameters based on the current environmental information, the method further includes: determining that the difference between the current environmental information and historical environmental information is greater than a difference threshold, wherein the historical environmental information is environmental information acquired and stored by the electronic device before acquiring the current environmental information.

[0010] In some embodiments, the method further includes: acquiring environmental information again at a set time interval; in response to a change in the acquired environmental information compared to the acquired environment, re-determining audiovisual parameters corresponding to the changed environmental information; and updating the target audiovisual parameters to the re-determined audiovisual parameters.

[0011] According to some embodiments of this disclosure, an audiovisual parameter determination device is provided, comprising: an acquisition unit, configured to acquire current environmental information in response to the playback of a media file, wherein the current environmental information includes one or more of ambient light intensity and ambient noise; a determination unit, configured to determine current audiovisual parameters based on the current environmental information, wherein visual parameters are determined based on the ambient light intensity and auditory parameters are determined based on the ambient noise; and a processing unit, configured to continue playing the media file based on the current audiovisual parameters.

[0012] In some embodiments, the processing unit further determines the media file based on the current audiovisual parameters by: receiving an audiovisual parameter adjustment instruction, adjusting the current audiovisual parameters based on the audiovisual parameter adjustment instruction, and obtaining target audiovisual parameters to play the media file according to the target audiovisual parameters.

[0013] In some embodiments, the processing unit obtains the audiovisual parameter adjustment instruction in the following manner: in response to receiving a touch operation in a preset area within the media file playback window, it determines that the audiovisual parameter adjustment instruction has been obtained.

[0014] In some embodiments, the processing unit adjusts the current audiovisual parameters based on the audiovisual parameter adjustment instruction in the following manner to obtain target audiovisual parameters: sampling and recording the touch point position within a preset time period according to a preset sampling period, and determining the sliding acceleration and touch pressure value when touching the touch point position to determine the effective sliding trajectory; accumulating the audiovisual parameter adjustment amount corresponding to each effective sliding trajectory to obtain an adjustment value; and obtaining the target audiovisual parameters based on the adjustment value and the current audiovisual parameters.

[0015] In some embodiments, the determining unit is further configured to determine, before determining the current audiovisual parameters based on the current environmental information, that the difference between the current environmental information and the historical environmental information is greater than a difference threshold, wherein the historical environmental information is environmental information acquired and stored by the electronic device before acquiring the current environmental information.

[0016] In some embodiments, the acquisition unit is further configured to reacquire environmental information at a set time interval; the determination unit is further configured to re-determine audiovisual parameters corresponding to the changed environmental information in response to a change in the reacquired environmental information compared to the previously acquired environment; and the processing unit is further configured to update the target audiovisual parameters to the re-determined audiovisual parameters.

[0017] According to some embodiments of this disclosure, an electronic device is provided, including: a processor; a memory for storing a computer program or instructions executable by the processor; wherein the processor is configured to execute the computer program or instructions to implement the audiovisual parameter determination method described in any of the above embodiments.

[0018] According to some embodiments of this disclosure, a storage medium is provided that stores a computer program or instructions, which, when executed by a processor of an electronic device, enable the electronic device to perform the audiovisual parameter determination method described in any of the above embodiments.

[0019] According to some embodiments of this disclosure, a computer program product is provided, including a computer program that, when executed by a processor, implements the audiovisual parameter determination method described in any of the above embodiments.

[0020] The technical solutions provided by the embodiments of this disclosure can include the following beneficial effects: by acquiring current environmental information and determining the current audiovisual parameters corresponding to the current environmental information, adaptive adjustment of the audiovisual parameters of the played media file is achieved based on the environmental information, so that the appropriate audiovisual parameters are obtained when the user opens the media file, without the need for direct manual adjustment, thus improving the user experience. It should be understood that the above general description and the following detailed description are merely exemplary and explanatory, and do not limit this disclosure. Attached Figure Description

[0021] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure.

[0022] Figure 1 This is a flowchart illustrating a local refresh method based on frame difference, according to relevant technologies.

[0023] Figure 2 This is a flowchart illustrating a method for determining audiovisual parameters according to some embodiments of the present disclosure.

[0024] Figure 3 This is a schematic diagram illustrating a method for determining audiovisual parameters according to some embodiments of the present disclosure.

[0025] Figure 4 This is a flowchart illustrating a method for adjusting current audiovisual parameters according to some embodiments of the present disclosure.

[0026] Figure 5 This is a schematic diagram illustrating the use of a sliding trajectory to adjust audiovisual parameters according to some embodiments of the present disclosure.

[0027] Figure 6 This is a schematic diagram of an accelerometer coordinate system shown according to some embodiments of the present disclosure.

[0028] Figure 7 This is a schematic diagram showing the rotation of a touch event collection area according to some embodiments of the present disclosure.

[0029] Figure 8 This is a schematic diagram of a prediction model illustrating the mapping relationship between environmental information and audiovisual parameters according to some embodiments of this disclosure.

[0030] Figure 9 This is a block diagram illustrating an audiovisual parameter determination device according to some embodiments of the present disclosure.

[0031] Figure 10 This is a block diagram illustrating an apparatus for determining video parameters according to some embodiments of the present disclosure.

[0032] Figure 11 This is a block diagram illustrating an apparatus for determining audiovisual parameters according to some embodiments of the present disclosure. Detailed Implementation

[0033] Some embodiments of this disclosure will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings denote the same or similar elements. Various changes, modifications, and equivalents of the methods, apparatus, and / or systems described herein will become apparent upon understanding this disclosure. For example, the order of operations described herein is merely illustrative and is not limited to those orders set forth herein, but can be changed as will become apparent upon understanding this disclosure, except for operations that must be performed in a particular order. Furthermore, for clarity and brevity, descriptions of features known in the art may be omitted.

[0034] The embodiments described in the following examples of this disclosure are not representative of all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims.

[0035] The audiovisual parameter determination method provided in some embodiments of this disclosure is applied to the audiovisual parameter adjustment of a streaming media playback platform. The playback medium can be a smartphone, tablet, touch screen TV, vehicle electronic terminal, or laptop computer with a touchpad, etc., and the media file to be played can be a video (including short videos), electronic photo album, pictures, etc.

[0036] In related technologies, most mainstream short video streaming platforms currently support adjusting the audio-visual parameters of the streaming media via solid-state buttons or third-party control applications. For solid-state button adjustments: Almost all electronic devices are equipped with physical buttons (solid-state buttons), usually located on the side of the device. When the screen is unlocked, a short press of the volume button increases or decreases the media volume, allowing for quick adjustments when needed. A long press of the volume button immediately turns the volume to maximum or mutes it. However, repeatedly pressing the solid-state button can negatively impact the user experience. For third-party control application adjustments: The operating system of an electronic device may not have precise audio-visual parameter control settings, or user needs may be more complex. In such cases, a third-party audio-visual parameter control application needs to be downloaded as an embedded audio-visual control. These controls typically allow users to create audio-visual parameter profiles that can automatically adjust the phone's audio-visual parameters based on time or location. However, the parameters configured in these controls are historical fixed values. Short video platforms adjust the audio-visual parameters of streaming media according to these historical fixed values, making it impossible to flexibly adjust the parameters to improve the audio-visual experience.

[0037] Currently, when playing short videos, touch swiping within the video playback window is typically used to switch between videos, such as to the next video or back. Touch swiping cannot adjust the audiovisual parameters of the short video. Therefore, adjusting the audiovisual parameters of short videos is usually done using the aforementioned solid-state buttons or third-party control applications.

[0038] The related technology employs a local refresh scheme based on frame difference. Figure 1 This is a flowchart illustrating a local refresh method based on frame difference, according to relevant technologies. Figure 1 As shown, preset video frame images are input into a pre-defined lightweight classification model to perform video category classification, resulting in video classification results. Based on the video classification results, the corresponding playback audiovisual parameters are searched in a preset parameter matching table. The preset parameter matching table is a list of associations between video categories and playback audiovisual parameters, including display brightness, contrast, color saturation, and sound parameters. The playback audiovisual parameters are then input into the playback controller for video playback.

[0039] This solution has some shortcomings. Each time a video is switched, the system needs to frequently cache and read video frames to calculate image differences, which easily leads to busy I / O and prolonged high CPU load, resulting in high memory consumption. This is unfriendly to high-resolution videos / images and scenarios where video content changes are not significant, both in terms of memory usage and memory read / write efficiency. Although this solution provides a set of audiovisual parameter values ​​in software, it still lacks universality and generalization. Different users may still need to repeatedly adjust the solid-state buttons on their electronic devices to achieve satisfactory audiovisual effects, thus affecting the user's audiovisual experience.

[0040] The audiovisual parameters involved in this disclosure include visual parameters and auditory parameters. The visual parameter is the screen brightness of the electronic device when playing video, and the auditory parameter is the volume of the video during playback. The short videos involved in this disclosure refer to videos with a length ranging from a few seconds to over ten minutes, tailored to users' fast browsing and fragmented consumption habits. They are characterized by fragmented dissemination, instant interaction, and high-frequency content updates, attracting user participation through algorithmic recommendations, social sharing, and creative tools, and have become a mainstream method of entertainment, information acquisition, and social interaction.

[0041] In view of this, some embodiments of this disclosure provide a method for determining audiovisual parameters. By sensing current environmental information and utilizing the current audiovisual parameters corresponding to the current environmental information, the method determines the audiovisual parameters of the media file played on the platform. This enables adaptive adjustment of the audiovisual parameters of the media file, thereby improving the user's audiovisual experience. This disclosure uses video as an example for further explanation.

[0042] Figure 2 This is a flowchart illustrating an audiovisual parameter adjustment method according to some embodiments of the present disclosure, such as... Figure 2 As shown, the method includes steps S11 to S13.

[0043] In step S11, in response to the electronic device playing a media file, current environmental information is obtained, wherein the current environmental information includes one or more of ambient light intensity and ambient noise.

[0044] In this embodiment of the disclosure, before a user watches a media file played by a streaming media platform, the electronic device loads and plays the media file, which is output audiovisual information, such as a short video. Before playing the video, the electronic device obtains current environmental information through its onboard environmental sensors. The current environmental information may include one or more of the ambient light intensity (Lux) and ambient noise (Db). For example, the electronic device will obtain different environmental information depending on whether it is in a quiet indoor environment, a noisy outdoor environment, or a dark room. The environmental sensors may include an under-display light sensor, an earpiece, a microphone, etc.

[0045] In step S12, the current audiovisual parameters are determined based on the current environmental information, the visual parameters are determined based on the ambient light intensity, and the auditory parameters are determined based on the ambient noise.

[0046] In this embodiment of the disclosure, the audiovisual parameters include one or more of visual and auditory parameters. Visual parameters can be understood as the screen brightness when a user watches a video; different screen brightness levels result in different sensory experiences. Auditory parameters can be understood as the sound during video playback. Because the ambient light intensity in the environment where the electronic device is located affects the brightness of the played video, i.e., it affects the visual parameters, a certain light intensity will match a corresponding visual parameter. For example, if the ambient light intensity is high, the video brightness will also increase accordingly to clearly display the video image. Similarly, ambient noise in the environmental information will also affect the volume during video playback, i.e., it affects the auditory parameters, a certain ambient noise level will match a corresponding auditory parameter. For example, if the ambient noise level is high, the volume will increase to hear the video playback sound clearly. When the environmental information includes light intensity, the visual parameters can be determined by the light intensity; when the environmental information includes ambient noise, the auditory parameters can be determined by the ambient noise. Therefore, there is a mapping relationship between environmental information and audiovisual parameters. Through this mapping relationship, the current audiovisual parameters corresponding to the current environmental information are determined based on the acquired current environmental information.

[0047] In step S13, the media file continues to play based on the current audiovisual parameters.

[0048] In this embodiment of the disclosure, when the electronic device plays a video, it continues to play the media file based on the current audiovisual parameters determined above. That is, the brightness of the video display is determined based on the visual parameters in the current audiovisual parameters, and the volume of the video is determined based on the auditory parameters in the current audiovisual parameters.

[0049] In this embodiment of the disclosure, the current environmental information is obtained through an electronic device, and the current audiovisual parameters that match the current environmental information are used to adaptively adjust the audiovisual parameters of the video being played, thereby meeting the user's needs for screen brightness and volume and improving the user experience.

[0050] In this embodiment, the current audiovisual parameters corresponding to the current environmental information can be used as the audiovisual parameters for video playback. That is, when the video plays, the visual parameters in the current audiovisual parameters are directly used as the screen brightness, and the auditory parameters are directly used as the video sound. Therefore, the matching audiovisual parameters of the video can be directly determined based on the current environmental information, avoiding the need for the user to adjust the video brightness and volume using solid-state buttons or embedded controls. In this embodiment, after obtaining the current audiovisual parameters, further adjustments can be made to them. Figure 3This is a schematic diagram illustrating a method for determining audiovisual parameters according to some embodiments of the present disclosure, such as... Figure 3 As shown, the system acquires current environmental information and determines the current audiovisual parameters corresponding to the current environment based on the mapping relationship between environmental information and audiovisual parameters. The acquired audiovisual parameter adjustment instructions are then used to adjust the current audiovisual parameters, which are then adopted as the target audiovisual parameters for the video. Specifically, during video playback, the visual parameters from the adjusted target audiovisual parameters are used as the screen brightness, and the auditory parameters are used as the video sound. After further fine-tuning of the current audiovisual parameters, the screen brightness and video sound better meet user needs, further enhancing the user experience.

[0051] In this embodiment, the electronic device has a video playback window when playing video. A preset area is set within the video playback window. Performing a touch operation within the preset area allows for the acquisition of audiovisual parameter adjustment commands. If a touch operation is performed outside the preset area, it is an invalid touch operation, and no audiovisual operation adjustment commands can be acquired. Audiovisual operation adjustment commands can be understood as touch operations within the preset area of ​​the video playback window.

[0052] Figure 4 This is a flowchart illustrating a method for adjusting current audiovisual parameters according to some embodiments of the present disclosure, such as... Figure 4 As shown, it includes steps S21 to S23.

[0053] In step S21, the touch point position is sampled and recorded within a preset time period according to the preset sampling period, and the sliding acceleration and touch pressure value when touching the touch point position are determined to determine the effective sliding trajectory.

[0054] In this embodiment, the user performs a touch operation within a preset area of ​​the video playback window. The under-display capacitive sensor tracks the touch point trajectory based on the finger's touch position. When the under-display capacitive sensor detects a touch event, it samples within a preset time period (e.g., time period t1 to tn) according to the preset sampling period T of the under-display capacitive sensor and records the touch point position. For example, the touch point position is m1 at time t1+T, m2 at time t1+2T, m3 at time t1+3T, and m4 at time t1+4T. The pressure value (F) at the touch point position is then obtained through the under-display capacitive sensor. down The accelerometer of the electronic device is used to obtain the finger sliding acceleration at the touch point. This disclosure is not limited to user finger touch operation; a stylus or other touch-enabled device can also be used to perform touch operations.

[0055] In this embodiment, when the sliding acceleration and pressure values ​​at the touch point position reach a set threshold, the sliding trajectory is determined to be valid; otherwise, the sliding trajectory is invalid. For example, at touch point position m2, if the sliding acceleration or pressure value does not reach the set threshold, then touch point position m2 is an invalid touch point position, and all sliding trajectories before time t1+2T are invalid. The sliding trajectory is then reacquired and its validity is determined. At touch point positions m3 and m4, if both the sliding acceleration and pressure values ​​reach the set threshold, then touch point positions m3 and m4 are both valid touch point positions. The sliding trajectory during the time period t1+2T to t1+3T is a valid sliding trajectory, and the sliding trajectory during the time period t1+3T to t1+4T is also a valid sliding trajectory. That is, the sliding trajectory during the time period t1+2T to t1+4T is valid. If all touch trajectories during the time period t1 to tn are valid, the valid touch trajectory ζ during the time period t1 to tn is calculated by integrating the sliding acceleration and duration of each valid touch trajectory. touch ={ζ t1 ,ζ t2 ,...ζ tn}, where ζ ti ={x start ,y start ,x end ,y end ,a t1+iT}, ζ ti Let be the i-th valid touch trajectory, where 1 ≤ i ≤ n, and i is an integer. t1+iT x represents the sliding acceleration value at the sampling point of the under-display capacitive sensor. start ,y start ,x end ,y end The initial and final coordinates of the touch point for the current sliding trajectory, such as x during the time interval from t1+3T to t1+4T. start ,y start Let x be the coordinates of the touch point position m3. end ,y end Here are the coordinates of the touch point position m4.

[0056] In step S22, the audiovisual parameter adjustment amounts corresponding to each recorded valid sliding trajectory are accumulated to obtain the adjustment value.

[0057] In this embodiment, each effective touch point position corresponds to an effective sliding trajectory. The length of each effective touch trajectory can be determined using the aforementioned touch trajectory formula. Multiplying the length of each effective touch trajectory by a preset step size yields the audiovisual parameter adjustment amount corresponding to each effective touch trajectory, thus determining the audiovisual parameter adjustment amount corresponding to each effective touch point position. The preset step size represents the change in audiovisual parameters per unit length within a preset area of ​​the video playback window; for example, a 1mm sliding length corresponds to a brightness change of 5 nits. The audiovisual parameter adjustment amounts corresponding to each effective sliding trajectory within the time period t1 to tn are accumulated sequentially to obtain the adjusted audiovisual parameter value. Figure 5 This is a schematic diagram illustrating the use of a sliding trajectory to adjust audiovisual parameters according to some embodiments of this disclosure, such as... Figure 5 As shown, within the preset area of ​​the video playback window (the APP window area in the figure), specifically the areas for visual parameters and auditory parameters, the sliding trajectory is obtained through finger touch, and the visual and auditory parameters are adjusted respectively.

[0058] In step S23, the target audiovisual parameters are obtained based on the adjustment value and the current audiovisual parameters.

[0059] In this embodiment, the corresponding current audiovisual parameters are determined based on the current environmental information. The current audiovisual parameters are then adjusted using the adjustment values ​​obtained based on the touch trajectory to obtain the adjusted audiovisual parameters. These adjusted audiovisual parameters are then used as the target audiovisual parameters for the video played by the electronic device.

[0060] In this embodiment of the disclosure, the current audiovisual parameters determined by the current environmental information are further refined by using touch trajectory, which can make the screen brightness and volume of the video played by the electronic device more in line with the user's needs, thereby further improving the user experience.

[0061] In this embodiment, the preset area of ​​the video playback window is used to adjust audiovisual parameters. Since these parameters are adjusted via touch trajectories within the preset area, it can be understood as a touch event collection area. When playing a short video, the user needs to determine the window state, such as its position or size. The electronic device's video playback window will then preset a touch event collection area. Because users may use landscape or portrait mode when watching videos and may rotate the electronic device as needed, it is necessary to determine the position and size of the touch event collection area after screen rotation. Figure 6 This is a schematic diagram of an accelerometer coordinate system shown according to some embodiments of the present disclosure, such as... Figure 6As shown, an accelerometer coordinate system is established with the electronic device as the center. The screen of the electronic device can be considered as a plane defined by the x-axis and y-axis, and the direction perpendicular to the screen is the z-axis. When the electronic device is rotated, the acceleration values ​​A in the x, y, and z directions can be obtained through the accelerometer. x A y A z , when 4(A x *A x +A y *A y )≥A z *A z Calculate the rotation angle θ of the electronic device on the plane defined by the x-axis and y-axis, and calculate the horizontal and vertical screen states of the electronic device based on the rotation angle θ, according to the following formula.

[0062]

[0063] Determine the new mapping coordinates of the preset touch event collection area, where x and y are the coordinates of any point in the original touch event collection area, x' and y' are the new coordinates of the point after mapping, and s is the scaling factor, which is the width of the video playback window divided by its height in portrait mode. Figure 7 This is a schematic diagram showing the rotation of the touch event collection area according to some embodiments of the present disclosure, such as... Figure 7 As shown, when an electronic device rotates from portrait to landscape mode, the new range of the touch event collection area (including the volume adjustment area and the brightness adjustment area) will be determined based on the mapped coordinate values ​​x' and y'.

[0064] In this embodiment, the mapping relationship between environmental information and audiovisual parameters is represented by a prediction model. The input to the prediction model is multiple different environmental information items, and the output of the prediction model is multiple different audiovisual parameters corresponding to the multiple different environmental information items. To determine the current audiovisual parameters corresponding to the current environmental information, it is necessary to pre-construct the mapping relationship between environmental information and audiovisual parameters. The environmental information includes light intensity (Lux) and ambient noise in decibels (Db), and the audiovisual parameters include the brightness (Bri) and volume (Vol) of the electronic device. A certain range of light intensity is preset, for example, from 0-3000 Lux, divided into multiple intervals (e.g., 100, 200, 300, ..., 3000). A certain range of ambient noise is preset, for example, from 30-100 dB, divided into multiple intervals (e.g., 30, 40, 50, ..., 100). The laboratory environment was controlled, and the combinations of Lux and Db were adjusted, such as (100,30) and (200,40). By setting different combinations of environmental information, the Bri and Vol values ​​selected by each user under each Lux / Db group were recorded. A neural network was used to train the user data. Different environmental information was input, and the corresponding audiovisual parameters were output. A fitted prediction model was obtained through training, establishing a mapping relationship between environmental information and audiovisual parameters. Therefore, the mapping relationship between environmental information and audiovisual parameters can be represented by the prediction model. Cross-validation was used to validate the prediction model to ensure the accuracy and generalization ability of the mapping relationship. Figure 8 This is a schematic diagram of a prediction model illustrating the mapping relationship between environmental information and audiovisual parameters according to some embodiments of this disclosure, such as... Figure 8 As shown, based on a certain set of environmental information (Lux / Db), the corresponding audiovisual parameters (Bri / Vol) can be determined.

[0065] In this embodiment of the disclosure, to avoid repeatedly searching for the audiovisual parameters corresponding to the mapping relationship when the environmental information does not change significantly, before acquiring the current environmental information and determining the corresponding current audiovisual parameters, the current environmental information is compared with historical environmental information, where the historical environmental information is the environmental information acquired and stored by the electronic device before acquiring the current environmental information. When the difference between the two exceeds a set difference threshold δ, i.e., |Lux cur -Lux his |Exceeding δ, or|Db cur -Db his If | exceeds δ, then a new set of audiovisual parameters needs to be preloaded. Based on the pre-created mapping relationship between environmental information and audiovisual parameters, a new set of current audiovisual parameters corresponding to the current environmental information is determined. If |Lux cur -Lux his |and|Db cur -Db hisIf neither of the above exceeds the difference threshold δ, then the audiovisual parameters corresponding to the historical environmental information are used as the current audiovisual parameters corresponding to the current environmental information. In this embodiment, both light intensity and environmental noise have a difference threshold δ. The light intensity threshold can be set with reference to Weber's Law, where the minimum brightness change perceptible to the human eye is approximately 7% (therefore, an audiovisual parameter update can be triggered when ΔLux ≥ 10%). The environmental noise threshold can be set with reference to the ITU-R BS.1770 standard, where a sound pressure level change of 3dB is a perceptible difference to the human ear. When the environmental noise change exceeds 3dB, an audiovisual parameter update can be triggered.

[0066] In this embodiment, when a user watches a short video, the surrounding environment may change, or the user may move to a different environment to watch the video, causing changes in the environmental information of the electronic device. Therefore, a time interval can be set, and at each set interval, the current environmental information of the electronic device can be re-acquired. If the re-acquired environmental information changes compared to the previously acquired environmental information, the audiovisual parameters corresponding to the changed environmental information are redefined, and the target audiovisual parameters of the played video are updated to the redefined audiovisual parameters. Therefore, by monitoring environmental information, the audiovisual parameters required for the video can be adaptively updated, improving the user's audiovisual experience.

[0067] When this disclosure is used for short video playback, it can obtain appropriate audiovisual parameters based on the current environment information, and the short video will be played using these audiovisual parameters, such as volume and screen brightness. When it is necessary to adjust the audiovisual parameters, the user can perform a touch swipe operation within a preset area of ​​the short video playback window to fine-tune the audiovisual parameters. When the user needs to switch to the next or previous short video, they can swipe in an area outside the preset area of ​​the playback window.

[0068] Figure 9 This is a block diagram illustrating an audiovisual parameter determination device 100 according to some embodiments of the present disclosure. (Refer to...) Figure 9 The device includes an acquisition unit 101, a determination unit 102, and a processing unit 103.

[0069] Acquisition unit 101 is used to acquire current environmental information in response to the playback of media files, wherein the current environmental information includes one or more of ambient light intensity and ambient noise; determination unit 102 is used to determine current audiovisual parameters based on the current environmental information, wherein visual parameters are determined based on ambient light intensity and auditory parameters are determined based on ambient noise; processing unit 103 is used to continue playing media files based on the current audiovisual parameters.

[0070] In one embodiment, the processing unit 103, based on the current audiovisual parameters, further determines the media file by: receiving an audiovisual parameter adjustment instruction, adjusting the current audiovisual parameters based on the audiovisual parameter adjustment instruction, and obtaining target audiovisual parameters to play the media file according to the target audiovisual parameters.

[0071] In one embodiment, the processing unit 103 obtains the audiovisual parameter adjustment instruction in the following manner: in response to receiving a touch operation in a preset area within the media file playback window, it determines that the audiovisual parameter adjustment instruction has been obtained.

[0072] In one embodiment, the processing unit 103 adjusts the current audiovisual parameters based on the audiovisual parameter adjustment command in the following manner to obtain the target audiovisual parameters: sampling and recording the touch point position within a preset time period according to a preset sampling period, and determining the sliding acceleration and touch pressure value when touching the touch point position to determine the effective sliding trajectory; accumulating the audiovisual parameter adjustment amount corresponding to each effective sliding trajectory to obtain the adjustment value; and obtaining the target audiovisual parameters based on the adjustment value and the current audiovisual parameters.

[0073] In one embodiment, the determining unit 102 is further configured to determine, before determining the current audiovisual parameters corresponding to the current environmental information, that the difference between the current environmental information and the historical environmental information is greater than a difference threshold, wherein the historical environmental information is the environmental information acquired and stored by the electronic device before acquiring the current environmental information.

[0074] In one embodiment, the acquisition unit 101 is further configured to reacquire environmental information at a set time interval; the determination unit 102 is further configured to re-determine the audiovisual parameters corresponding to the changed environmental information in response to a change in the reacquired environmental information compared to the previously acquired environment; and the processing unit 103 is further configured to update the target audiovisual parameters to the re-determined audiovisual parameters.

[0075] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.

[0076] Figure 10 This is a block diagram illustrating an apparatus 200 for determining video parameters according to some embodiments of the present disclosure. The apparatus 200 can be provided as a terminal. For example, the apparatus 200 can be a mobile phone, computer, digital broadcasting terminal, messaging device, game console, tablet device, medical device, fitness equipment, personal digital assistant, etc.

[0077] Reference Figure 10The device 200 may include one or more of the following components: processing component 202, memory 204, power component 206, multimedia component 208, audio component 210, input / output (I / O) interface 212, sensor component 214, and communication component 216.

[0078] Processing component 202 typically controls the overall operation of device 200, such as operations associated with display, telephone calls, data communication, camera operation, and recording. Processing component 202 may include one or more processors 220 to execute instructions to perform all or part of the steps of the methods described above. Furthermore, processing component 202 may include one or more modules to facilitate interaction between processing component 202 and other components. For example, processing component 202 may include a multimedia module to facilitate interaction between multimedia component 208 and processing component 202.

[0079] Memory 204 is configured to store various types of data to support the operation of device 200. Examples of such data include instructions for any application or method operating on device 200, contact data, phonebook data, messages, pictures, videos, etc. Memory 204 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.

[0080] The power supply component 206 provides power to the various components of the device 200. The power supply component 206 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power to the device 200.

[0081] Multimedia component 208 includes a screen that provides an output interface between the device 200 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touchscreen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors may sense not only the boundaries of the touch or swipe action but also the duration and pressure associated with the touch or swipe operation. In some embodiments, multimedia component 208 includes a front-facing camera and / or a rear-facing camera. When the device 200 is in an operating mode, such as a shooting mode or a video mode, the front-facing camera and / or the rear-facing camera may receive external multimedia data. Each front-facing camera and rear-facing camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

[0082] Audio component 210 is configured to output and / or input audio signals. For example, audio component 210 includes a microphone (MIC) configured to receive external audio signals when device 200 is in an operating mode, such as call mode, recording mode, and voice recognition mode. The received audio signals may be further stored in memory 204 or transmitted via communication component 216. In some embodiments, audio component 210 also includes a speaker for outputting audio signals.

[0083] I / O interface 212 provides an interface between processing component 202 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to, home buttons, volume buttons, power buttons, and lock buttons.

[0084] Sensor assembly 214 includes one or more sensors for providing status assessments of various aspects of device 200. For example, sensor assembly 214 may detect the on / off state of device 200, the relative positioning of components such as the display and keypad of device 200, changes in the position of device 200 or a component of device 200, the presence or absence of user contact with device 200, the orientation or acceleration / deceleration of device 200, and temperature changes of device 200. Sensor assembly 214 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 214 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, sensor assembly 214 may also include an accelerometer, a gyroscope, a magnetometer, a pressure sensor, or a temperature sensor.

[0085] Communication component 216 is configured to facilitate wired or wireless communication between device 200 and other devices. Device 200 can access wireless networks based on communication standards, such as WiFi, 2G, or 3G, or combinations thereof. In one exemplary embodiment, communication component 216 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, communication component 216 also includes a near-field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0086] In an exemplary embodiment, the apparatus 200 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the methods described above.

[0087] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 204 including instructions, which can be executed by a processor 220 of the device 200 to perform the above-described method. For example, the non-transitory computer-readable storage medium may be a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc.

[0088] Figure 11 This is a block diagram illustrating an apparatus 300 for determining audiovisual parameters according to some embodiments of the present disclosure. For example, apparatus 300 may be provided as a server. See also... Figure 11 The device 300 includes a processing component 322, which further includes one or more processors, and memory resources represented by memory 332 for storing instructions, such as application programs, that can be executed by the processing component 322. The application programs stored in memory 332 may include one or more modules, each corresponding to a set of instructions. Furthermore, the processing component 322 is configured to execute instructions to perform the aforementioned audiovisual parameter determination method.

[0089] Device 300 may also include a power supply component 326 configured to perform power management of device 300, a wired or wireless network interface 350 configured to connect device 300 to a network, and an input / output (I / O) interface 358. Device 300 may operate on an operating system stored in memory 332, such as Windows Server™, MacOSX™, Unix™, Linux™, FreeBSD™, or similar.

[0090] In some embodiments of this disclosure, a storage medium is provided, which may be a non-transitory computer-readable storage medium.

[0091] In some embodiments of this disclosure, when instructions in the storage medium are executed by the processor of an electronic device, the electronic device is able to perform the audiovisual parameter determination method described above.

[0092] This disclosure also provides a computer program product, including a computer program that, when executed by a processor, implements the audiovisual parameter determination method involved in any of the above embodiments.

[0093] Although terms such as “first,” “second,” and “third” may be used herein to describe various components, parts, regions, layers, or sections, these components, parts, regions, layers, or sections are not limited to these terms. Rather, these terms are used only to distinguish one component, part, region, layer, or section from another. Therefore, without departing from the teachings of the examples described herein, a first component, part, region, layer, or section mentioned in the examples may also be referred to as a second component, part, region, layer, or section. Furthermore, the terms “first” and “second” are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Thus, a feature defined as “first” or “second” may explicitly or implicitly include at least one of that feature.

[0094] It is further understood that the terms "first," "second," etc., are used to describe various types of information, but this information should not be limited to these terms. These terms are only used to distinguish information of the same type from one another, and do not indicate a specific order or degree of importance. In fact, the expressions "first," "second," etc., are completely interchangeable. For example, without departing from the scope of this disclosure, first information can also be referred to as second information, and similarly, second information can also be referred to as first information.

[0095] In this description, "multiple" means at least two, referring to two or more, such as two, three, etc., unless otherwise explicitly specified. Other quantifiers are similar. The singular forms "a," "the," and "the" are also intended to include the plural forms unless the context clearly indicates otherwise. Furthermore, unless otherwise specified or clearly indicated from the context, the articles "a" and "an" as used in this application and the appended claims are generally understood to mean "one or more."

[0096] It should be understood that, unless otherwise specifically indicated, features of various embodiments of this disclosure described herein can be combined with each other. As used herein, the term "and / or" includes any one of the related listed items and any combination of two or more; "and / or" describes the association relationship between related objects, indicating that three relationships may exist, for example, A and / or B can represent: A alone, A and B simultaneously, and B alone. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. Similarly, "at least one of..." includes any one of the related listed items and any combination of two or more.

[0097] It is further understood that the terms "first," "second," etc., are used to describe various types of information, but this information should not be limited to these terms. These terms are only used to distinguish information of the same type from one another, and do not indicate a specific order or degree of importance. In fact, the expressions "first," "second," etc., are completely interchangeable. For example, without departing from the scope of this disclosure, first information can also be referred to as second information, and similarly, second information can also be referred to as first information.

[0098] Furthermore, the term "exemplary" is used herein to indicate that it serves as an example, instance, or illustration. Any aspect or design described herein as "exemplary" is not necessarily to be construed as advantageous compared to other aspects or designs. Rather, the use of the term "exemplary" is intended to present concepts in a concrete manner. As used herein, the term "or" is intended to indicate an inclusive "or" rather than an exclusive "or." That is, unless otherwise specified or clear from the context, "X applies A or B" is intended to indicate any of the natural inclusive permutations. That is, if X applies A; X applies B; or X applies both A and B, then applying A or B satisfies the condition under any of the foregoing instances.

[0099] Similarly, although this disclosure has been shown and described with respect to one or more implementations, equivalent variations and modifications will occur to those skilled in the art upon reading and understanding the specification and drawings. This disclosure includes all such modifications and variations and is limited only by the scope of the claims. In particular, with respect to the various functions performed by the components described above (e.g., elements, resources, etc.), unless otherwise indicated, the terminology used to describe such components is intended to correspond to any component (functionally equivalent) that performs the specific function of the described component, even if it is not structurally equivalent to the disclosed structure. Furthermore, although specific features of this disclosure may have been disclosed with respect to only one of several implementations, such features may be combined with one or more other features of other implementations, as may be desired and advantageous to any given or particular application. Moreover, with regard to the terms “comprising,” “owning,” “having,” “having,” or variations thereof as used in this disclosure, such terms are intended to be inclusive in a manner similar to the term “including.”

[0100] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein.

[0101] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.

Claims

1. A method for determining audiovisual parameters, characterized in that, include: In response to the playback of a media file, the system obtains current environmental information; wherein, the current environmental information includes one or more of ambient light intensity and ambient noise. Based on the current environmental information, the current audiovisual parameters are determined; wherein, the visual parameters are determined based on the ambient light intensity, and the auditory parameters are determined based on the ambient noise. Based on the current audiovisual parameters, continue playing the media file.

2. The method according to claim 1, characterized in that, After continuing to play the media file based on the current audiovisual parameters, the method further includes: Receive audiovisual parameter adjustment instructions, adjust the current audiovisual parameters based on the audiovisual parameter adjustment instructions to obtain target audiovisual parameters, and play the media file according to the target audiovisual parameters.

3. The method according to claim 2, characterized in that, The acquisition of audiovisual parameter adjustment instructions includes: In response to a touch operation received in a preset area within the media file playback window, it is determined that an audiovisual parameter adjustment instruction has been obtained.

4. The method according to claim 2, characterized in that, The step of adjusting the current audiovisual parameters based on the audiovisual parameter adjustment command to obtain the target audiovisual parameters includes: According to the preset sampling period, the touch point position is sampled and recorded within a preset time period, and the sliding acceleration and touch pressure value when touching the touch point position are determined to determine the effective sliding trajectory. The adjustment amounts of the audiovisual parameters corresponding to each effective sliding trajectory are accumulated to obtain the adjustment value; Based on the adjustment value and the current audiovisual parameters, the target audiovisual parameters are obtained.

5. The method according to any one of claims 1 to 3, characterized in that, Before determining the current audiovisual parameters based on the current environmental information, the method further includes: The difference between the current environmental information and the historical environmental information is determined to be greater than a difference threshold. The historical environmental information is the environmental information acquired and stored by the electronic device before acquiring the current environmental information.

6. The method according to claim 1, characterized in that, The method further includes: Reacquire environmental information at set time intervals; In response to changes in the acquired environmental information compared to the previously acquired environment, the audiovisual parameters corresponding to the changed environmental information are redefined. Update the target audiovisual parameters to the newly determined audiovisual parameters.

7. An audiovisual parameter determining device, characterized in that, include: The acquisition unit is used to acquire current environmental information in response to the playback of a media file, wherein the current environmental information includes one or more of ambient light intensity and ambient noise. A determining unit is configured to determine current audiovisual parameters based on the current environmental information, wherein the visual parameters are determined based on the ambient light intensity, and the auditory parameters are determined based on the ambient noise. The processing unit is configured to continue playing the media file based on the current audiovisual parameters.

8. The apparatus according to claim 7, characterized in that, Based on the current audiovisual parameters, the processing unit further determines that the media file is also used for: Receive audiovisual parameter adjustment instructions, adjust the current audiovisual parameters based on the audiovisual parameter adjustment instructions to obtain target audiovisual parameters, and play the media file according to the target audiovisual parameters.

9. The apparatus according to claim 8, characterized in that, The processing unit obtains the audiovisual parameter adjustment instructions in the following manner: In response to a touch operation received in a preset area within the media file playback window, it is determined that an audiovisual parameter adjustment instruction has been obtained.

10. The method according to claim 9, characterized in that, The processing unit adjusts the current audiovisual parameters based on the audiovisual parameter adjustment command in the following manner to obtain the target audiovisual parameters: According to the preset sampling period, the touch point position is sampled and recorded within a preset time period, and the sliding acceleration and touch pressure value when touching the touch point position are determined to determine the effective sliding trajectory. The adjustment amounts of the audiovisual parameters corresponding to each effective sliding trajectory are accumulated to obtain the adjustment value; Based on the adjustment value and the current audiovisual parameters, the target audiovisual parameters are obtained.

11. The apparatus according to any one of claims 7 to 9, characterized in that, The determining unit is further configured to determine, before determining the current audiovisual parameters based on the current environmental information, that the difference between the current environmental information and the historical environmental information is greater than a difference threshold, wherein the historical environmental information is the environmental information acquired and stored by the electronic device before acquiring the current environmental information.

12. The apparatus according to claim 7, characterized in that, The acquisition unit is also used to reacquire environmental information at set time intervals; The determining unit is further configured to, in response to a change in the reacquired environmental information compared to the previously acquired environment, redetermine the audiovisual parameters corresponding to the changed environmental information; The processing unit is also used to update the target audiovisual parameters to the newly determined audiovisual parameters.

13. An electronic device, characterized in that, include: processor; Memory used to store computer programs or instructions that can be executed by a processor; The processor is configured to execute the computer program or instructions to implement the audiovisual parameter determination method according to any one of claims 1 to 6.

14. A storage medium, characterized in that, The storage medium stores a computer program or instructions, which, when executed by the processor of an electronic device, enable the electronic device to perform the audiovisual parameter determination method according to any one of claims 1 to 6.

15. A computer program product, characterized in that, It includes a computer program that, when executed by a processor, implements the audiovisual parameter determination method according to any one of claims 1 to 6.

Images