Video playing method and device, equipment and storage medium

Abstract

The invention discloses a video playing method and device, equipment and a storage medium, relates to the technical field of display, and discloses a video playing method which comprises the following steps: dynamically obtaining a current display picture; determining object position information of the target object in the current display picture; controlling a sound production unit corresponding to the object position information to produce sound; and displaying a preset sound production position identifier at a display picture corresponding to the object position information. According to the invention, the perception of the user on the sound and picture accompanying effect is enhanced, and the user experience is improved.

Description

Technical Field

[0001] The present application relates to the field of display technology, and in particular to a video playback method, device, equipment and storage medium. Background Art

[0002] With the rapid development of high-definition display technology, various display devices have reached unprecedented heights in visual presentation, and the importance of sound effects as a key factor in improving the overall viewing experience has become increasingly prominent. The sound technology of "sound and picture accompanying" combines the motion trajectory of sound and image with the motion trajectory of the picture space, realizing an immersive audio-visual experience in which sound follows the picture.

[0003] However, although audio-video technology can theoretically improve the viewing experience, in actual applications, due to the diversity of video content and individual differences among users, the performance of audio-video technology varies significantly in different scenarios (for example, the effect of audio-video technology in scenes with calm plots is weaker than in scenes with intense plots) or among different users, and user perception is low.

[0004] The above contents are only used to assist in understanding the technical solution of the present application and do not constitute an admission that the above contents are prior art. Summary of the invention

[0005] The main purpose of this application is to provide a video playback method, device, equipment and storage medium, aiming to enhance the user's perception of the audio and video accompanying effect and improve the user experience.

[0006] To achieve the above purpose, the present application provides a video playback method, which includes:

[0007] Dynamically obtain the current display screen;

[0008] Determine object position information of a target object in the current display image;

[0009] Controlling a target sound emitting unit corresponding to the object position information to emit sound;

[0010] A preset sound location mark is displayed on the display screen corresponding to the object location information.

[0011] In one embodiment, before the step of determining the object position information of the target object in the current display image, the method further includes:

[0012] Determining a moving object in the current display picture;

[0013] The target object is determined from the moving objects.

[0014] In one embodiment, the step of determining the target object from the moving objects comprises:

[0015] The moving object with the largest display size is determined as the target object.

[0016] In one embodiment, the step of determining the object position information of the target object in the current display image includes:

[0017] Determining normalized position information of the target object in the current display image;

[0018] The normalized position information is converted into pixel position information according to the display parameters of the current display picture to serve as the object position information.

[0019] In one embodiment, the step of controlling the target sound emitting unit corresponding to the object position information to emit sound comprises:

[0020] Determine target audio data matching the target object in the audio source data associated with the currently displayed picture;

[0021] According to the distance between each of the target sound units relative to the object position information, the audio data weight of each of the target sound units playing the target audio data is adjusted, wherein the audio data weight is negatively correlated with the distance between the target sound unit relative to the object position information.

[0022] In one embodiment, the step of determining the target audio data matching the target object in the audio source data associated with the currently displayed picture includes:

[0023] matching candidate audio data from the audio source data according to the object type of the target object;

[0024] The target audio data is matched from the candidate audio data according to the motion state of the target object.

[0025] In one embodiment, the step of displaying a preset sound location marker on a display screen corresponding to the object location information includes:

[0026] A transparent mask including the sound emission position identifier is added to the display screen corresponding to the object position information.

[0027] In addition, to achieve the above-mentioned purpose, the embodiment of the present application further provides a video playback device, which is applied to an electronic device and includes:

[0028] An acquisition module is configured to dynamically acquire the current display screen;

[0029] A determination module, configured to determine object position information of a target object in the current display image;

[0030] A control module, configured to control a sound generating unit corresponding to the object position information to generate a sound;

[0031] The display module is configured to display a preset sound location mark at a display screen corresponding to the object location information.

[0032] In addition, to achieve the above-mentioned purpose, an embodiment of the present application also proposes an electronic device, which includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the video playback method described above.

[0033] In addition, to achieve the above-mentioned purpose, an embodiment of the present application further proposes a storage medium, which is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, the steps of the video playback method described above are implemented.

[0034] In addition, to achieve the above-mentioned purpose, an embodiment of the present application further proposes a computer program product, wherein the computer program product includes a computer program, and when the computer program is executed by a processor, the steps of the video playback method described above are implemented.

[0035] One or more technical solutions proposed in the embodiments of the present application have at least the following technical effects: by dynamically acquiring the current display screen; and then determining the object position information of the target object in the current display screen, and controlling the target sound unit corresponding to the object position information to make a sound, so as to achieve the sound and picture accompanying effect, and at the same time, displaying the preset sound position mark at the display screen corresponding to the object position information. The embodiments of the present application directly display the sound position in the display screen through the sound position mark, so that the user can immediately and intuitively understand the source of the sound, significantly improving the user's perception of the sound and picture accompanying effect. This kind of visual auxiliary information elevates the effect that was originally at the auditory level to the visual level, making the auditory effects that may have been ignored or difficult to perceive become obvious, enhancing the user's viewing experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0037] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the conventional technology, the drawings required for use in the embodiments or the conventional technology descriptions are briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0038] Figure 1 A flowchart of the first embodiment of the video playback method of the present application is provided;

[0039] Figure 2 A schematic diagram of a scene provided for the first embodiment of the video playback method of the present application;

[0040] Figure 3 This is a flow chart of a more complete embodiment of the present application;

[0041] Figure 4 This is a schematic diagram of the framework structure of the video playback device in the embodiment of the present application;

[0042] Figure 5 Schematic diagram of the device structure of the hardware operating environment of the electronic device involved in the video playback method in the embodiment of the present application.

[0043] The purpose, features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0044] It should be understood that the specific embodiments described herein are only used to explain the technical solutions of the present application and are not used to limit the present application.

[0045] In order to better understand the technical solution of the present application, a detailed description will be given below in conjunction with the accompanying drawings and specific implementation methods.

[0046] In conventional technology, although the sound-with-picture technology can theoretically improve the viewing experience, in practical applications, there is a problem of low user perception. The root of this problem lies in the combined influence of many factors. First of all, the diversity of video content leads to significant differences in the performance of the sound-with-picture effect in different scenes, especially in film and television works with smooth plots, the effect is often not as prominent as intense scenes such as fighting and racing. Secondly, the interference of external environmental noise is also a factor that cannot be ignored. Any additional sound may weaken the immersive feeling brought by the sound-with-picture technology. Finally, individual differences make different users have very different sensitivities to sound. Some users may not be able to fully experience the charm of the sound-with-picture technology due to their limited perception of subtle changes in sound. Therefore, how to optimize the sound-with-picture technology so that it can enhance user perception in different scenarios has become a technical problem that needs to be solved urgently.

[0047] The embodiment of the present application provides a solution by dynamically acquiring the current display screen; then determining the object position information of the target object in the current display screen, and controlling the target sound unit corresponding to the object position information to make a sound, so as to achieve the sound and picture accompanying effect. At the same time, a preset sound position mark is displayed at the display screen corresponding to the object position information. The embodiment of the present application directly displays the sound position in the display screen through the sound position mark, so that the user can immediately and intuitively understand the source of the sound, significantly improving the user's perception of the sound and picture accompanying effect. This kind of visual auxiliary information elevates the effect that was originally at the auditory level to the visual level, making the auditory effects that may have been ignored or difficult to perceive become obvious, enhancing the user's viewing experience.

[0048] Reference Figure 1 , Figure 1 This is a flow chart of the first embodiment of the video playback method of the present application.

[0049] It should be noted that the execution subject of the video playback method may be an electronic device, and the electronic device may be a display device, such as a television, a computer, a projector, etc. This embodiment does not limit this. For the sake of convenience, the following description of each embodiment is omitted. The video playback method includes:

[0050] Step S10, dynamically acquiring the current display image;

[0051] Step S20, determining the object position information of the target object in the current display image;

[0052] In a feasible embodiment, the current display image is dynamically acquired, and the target object in the current display image is determined; and then the position information (ie, object position information) of the target object in the current display image is determined.

[0053] It should be understood that the current display screen may contain one or more screen elements, and the target object is a key screen element that brings a 3D-like surround feeling to the user in terms of hearing. For example, in videos such as animations, movies or games, characters or people can be target objects. By identifying the position and movement trajectory of the characters in the picture, the playback position of the corresponding audio data (such as dialogue, footsteps, etc.) can be adjusted, so that the sound seems to be emitted from the position of the character, enhancing the sense of immersion. In addition to the characters, objects or props in the picture may also be target objects. When there is an object that is making a sound (such as an alarm clock, a car, etc.) in the picture, the real source of the sound can be simulated by adjusting the playback position of the audio data. In some cases, the entire scene or environment itself can also be regarded as a target object. For example, in environments such as forests, valleys or cities, the playback position and intensity of environmental sound effects (such as wind, birdsong, traffic, etc.) can be adjusted to create an immersive feeling.

[0054] Exemplarily, the current display image is captured according to a preset frame rate.

[0055] Step S30, controlling the target sound unit corresponding to the object position information to make a sound;

[0056] In a feasible embodiment, according to the object position information, a target sound unit corresponding to the object position information is determined from multiple sound units included in the device, and the target sound unit is controlled to make sound so that the sound position coincides with the position of the target object in the display screen in real time, thereby achieving the effect of audio and video accompanying each other, and enhancing the user's sense of presence and immersion when watching the video.

[0057] The target sound unit may be a sound unit used to play audio data matching the target object. When the display device is small, each sound unit of the display device may be determined as a target sound unit, and the sound and picture accompanying effect may be achieved by adjusting the parameters of each target sound unit. When the display device is large, some sound units in the display device corresponding to the object position information may be determined as target sound units.

[0058] Step S40: displaying a preset sound location mark on a display screen corresponding to the object location information.

[0059] In a feasible embodiment, a sound position mark is pre-set to mark the sound position, and then the sound position mark is displayed at the display screen corresponding to the object position information. By directly displaying the sound position in the display screen, the user can instantly and intuitively understand the source of the sound, which significantly improves the user perception of the sound-with-picture technology. This visual auxiliary information makes the auditory effects that may have been ignored or difficult to detect become obvious, enhancing the user's viewing experience. For complex scenes or multi-sound source environments, the sound position mark can help users better understand the correspondence between sound and picture content, and reduce confusion caused by inaccurate or difficult to capture sound positioning. This can not only enhance the user's immersion when watching the video, but also promote in-depth understanding and memory of the video content. In addition, in interactive videos or games, the sound position mark can be used as an important tool for users to interact with video content. Users can quickly locate the sound source of interest according to the guidance of the sound position mark, so as to participate in the experience of video content more actively and efficiently.

[0060] It should be understood that the sound location marker can continuously and smoothly follow the movement at all times according to the changes in the target object position information in the current display screen that is dynamically acquired.

[0061] Exemplarily, the sound location mark may be various graphics such as a dot or a circle, which are used to indicate the location of the target object in the display screen.

[0062] For example, in the process of selling display devices (e.g., televisions) with the accompanying audio and video function, in order to better demonstrate the accompanying audio and video function to users, the shopping guide needs to use specific film sources (e.g., videos of intense scenes such as battles and racing), which makes the display process of the accompanying audio and video function more cumbersome; and other sound interference in noisy environments such as stores may further weaken the immersive feeling brought by the sound-with-picture technology. The embodiment of the present application uses the sound position identification to directly mark the sound position in the display screen, so that users can instantly and intuitively understand the source of the sound, significantly improving the user's perception of the accompanying audio and video effect. This kind of visual auxiliary information elevates the effect that was originally at the auditory level to the visual level, making the auditory effects that may have been ignored or difficult to perceive become obvious, enhancing the user's viewing experience.

[0063] In this embodiment, the current display screen is dynamically acquired; the object position information of the target object in the current display screen is then determined, and the target sound unit corresponding to the object position information is controlled to make a sound, so as to achieve the sound and picture accompanying effect. At the same time, a preset sound position mark is displayed at the display screen corresponding to the object position information. The embodiment of the present application directly displays the sound position in the display screen through the sound position mark, so that the user can immediately and intuitively understand the source of the sound, significantly improving the user's perception of the sound and picture accompanying effect. This kind of visual auxiliary information elevates the effect that was originally at the auditory level to the visual level, making the auditory effects that may have been ignored or difficult to perceive become obvious, enhancing the user's viewing experience.

[0064] In one feasible implementation, step S40, the step of displaying a preset sound location mark on a display screen corresponding to the object location information includes:

[0065] Step S41, adding a transparent mask including a sound location identifier to the display screen corresponding to the object location information.

[0066] In a feasible embodiment, a transparent mask is added to the display screen corresponding to the object position information, so as to display the sound location mark.

[0067] Exemplarily, the application layer displays the sound location identifier in the form of a transparent mask at the top layer of the display hierarchy (ie, the highest position of the display hierarchy, the layer that the user's line of sight first contacts).

[0068] For example, refer to Figure 2 , the display device is a television, and the current display screen 100 of the display device includes objects: a person, a surfboard and waves, and the waves are further determined to be the target object 101, and then the target sound unit corresponding to the object position information of the target object 101 is controlled to make a sound; and a preset sound position mark 102 (i.e., a gray circle) is displayed at the display screen corresponding to the object position information, so that the user can instantly and intuitively understand the source of the sound, significantly improving the user perception of the accompanying audio and video effect.

[0069] In this embodiment, the transparent mask can be a fully transparent or semi-transparent mask so that the user can still see the lower screen content when seeing the sound location mark on the top of the display screen, avoiding the mark blocking the original display content.

[0070] Based on the above first embodiment, a second embodiment of the video playback method of the present application is proposed. In this embodiment, before step S20, the step of determining the object position information of the target object in the current display screen, it also includes:

[0071] Step S21, determining a moving object in the current display image;

[0072] Step S22, determining a target object from the moving objects.

[0073] In a feasible embodiment, an object in motion (ie, a moving object) is determined from a plurality of objects included in the current display image; and then a target object is further determined from the moving objects.

[0074] Exemplarily, the difference values ​​of the objects included in the current display picture between multiple consecutive frames may be determined, and the objects whose difference values ​​are greater than a preset difference threshold are determined as moving objects.

[0075] Exemplarily, the target object can be determined from the moving objects according to a preset target object determination rule. For example, a person in the moving object is determined as the target object. If the moving object does not contain a person, the moving object with the largest display size is determined as the target object.

[0076] Exemplarily, the target object may be one or more.

[0077] Exemplarily, when the target object is determined and the target object is included in multiple current display images acquired continuously, the target sound unit is controlled to emit sound according to the object position of the target object in each current display image, and a preset sound position mark is displayed. When the target object disappears from the current display image, the steps of determining the moving object in the current display image and determining the target object from the moving object are re-executed.

[0078] In one feasible implementation, step S21, the step of determining the moving object in the current display picture includes:

[0079] Step S221: The moving object with the largest display size is determined as the target object.

[0080] In a feasible embodiment, the display size of each moving object in the current display picture is determined, and the moving object with the largest display size is determined as the target object.

[0081] In this embodiment, by automatically identifying the target object in the currently displayed image, an audio and video accompanying effect for the target object is achieved, thereby enhancing the user's sense of presence and immersion in watching the video.

[0082] In one feasible implementation, step S20, the step of determining the object position information of the target object in the current display image includes:

[0083] Step S23, determining the normalized position information of the target object in the current display image;

[0084] In a feasible embodiment, when the target object is determined, the position of the target object in the current display image is identified, and normalized position information of the target object is obtained.

[0085] The normalized position information may be normalized coordinates, which is a representation method that is independent of the resolution of a specific display device and can locate an object on screens of different resolutions and sizes.

[0086] Step S24 , converting the normalized position information into pixel position information according to the display parameters of the current display image, as the object position information.

[0087] In a feasible embodiment, the normalized position information is converted according to display parameters of the display device to obtain pixel position information, which is determined as the object position information.

[0088] Exemplarily, the display parameter may be the current screen resolution (ie, width and height, in pixels) of the display device; the object position information is determined according to the product of the normalized position and the screen resolution.

[0089] Exemplarily, when the display device starts the audio and video accompanying function, the display device starts the screenshot module and the sound position analysis algorithm module; the screenshot module dynamically captures the current display screen of the display device at a set frame rate and sends it to the sound position analysis algorithm module; the sound position analysis algorithm module determines the target object in the current display screen, and identifies the normalized coordinates of the target object in the display screen (i.e., normalized position information), wherein the normalized coordinates are stored in the form of a floating-point array with a length of 2 and a range of 0 to 1. The application layer of the display device dynamically polls the normalized coordinates obtained by the sound position analysis algorithm module within the configured time frequency, and communicates with the sound position analysis algorithm module in the form of an interface through the link of the middleware interface; the application layer calculates the product of the normalized coordinates and the current resolution of the real device, and determines it as the object position information.

[0090] In this embodiment, the normalized position information does not depend on a specific screen resolution. Therefore, the use of normalized position information can ensure that the target object can obtain accurate position information on screens with different resolutions, and then convert the normalized position information into pixel position information according to the actual resolution of the display device to achieve cross-resolution compatibility.

[0091] Based on the above first and / or second embodiments, a third embodiment of the video playback method of the present application is proposed. In this embodiment, step S30, the step of controlling the target sound unit corresponding to the object position information to sound includes:

[0092] Step S31, determining target audio data matching the target object in the audio source data associated with the current display screen;

[0093] In a feasible embodiment, audio source data associated with the currently displayed picture is acquired, and then audio data associated with the target object (ie, target audio data) in the audio source data is determined.

[0094] In one feasible implementation, step S31, the step of determining the target audio data matching the target object in the audio source data associated with the current display screen, includes:

[0095] Step S311, matching candidate audio data from audio source data according to the object type of the target object;

[0096] In a feasible embodiment, the object type of the target object is identified, for example, a vehicle, a pedestrian, an animal, etc., and then the audio source data is preliminarily screened according to the object type to obtain candidate audio data.

[0097] Exemplarily, when the object type of the target object is a car, engine sound, horn sound, etc. are determined from the audio source data as candidate audio data, and when the object type of the target object is an animal, the matching candidate audio data may be a specific call.

[0098] Step S312: matching target audio data from candidate audio data according to the motion state of the target object.

[0099] In a feasible embodiment, the motion state of the target object is identified, and then secondary screening is performed from the candidate audio data based on the motion state to obtain the target audio data.

[0100] Exemplarily, the target object is a vehicle, and when the moving state of the target object is high-speed driving, the target audio data may include engine sound and wind noise.

[0101] In this embodiment, according to the object type and motion state of the target object, the target audio data matching the target object is screened, thereby specifically conditioning the playback effect of the target audio data and realizing audio and video accompanying.

[0102] Step S32, adjusting the audio data weight of each target sound unit playing the target audio data according to the distance between each target sound unit and the object position information, wherein the audio data weight is negatively correlated with the distance between the target sound unit and the object position information.

[0103] In a feasible embodiment, in order to achieve the sound and picture following effect, the audio data weight of each target sound unit playing the target audio data can be adjusted according to the distance between each target sound unit relative to the object position information, wherein the closer the distance between the target sound unit relative to the object position information, the greater the audio data weight, and the farther the distance between the target sound unit relative to the object position information, the smaller the audio data weight, thereby achieving the sound and picture following effect.

[0104] The audio data weight may correspond to a plurality of sound unit parameters, such as volume distribution, delay of the audio signal, adjustment of the frequency component, channel distribution, etc.

[0105] Volume allocation can adjust the volume of different sound units according to the position of the target object in the display screen, so that the loudness of the sound matches the visual position of the object; wherein, the closer the distance between the target sound unit and the object position information, the higher the volume allocation ratio, that is, the louder the volume; the farther the distance between the target sound unit and the object position information, the lower the volume allocation ratio, that is, the smaller the volume.

[0106] Delaying the audio signal can enhance the three-dimensional effect by introducing a time delay, simulating the actual travel time of sound from the position of an object on the screen to the listener's ears.

[0107] The frequency components can be adjusted according to the characteristics and location of the target object to simulate the characteristics of different sound sources.

[0108] Channel allocation can determine which channels should be activated and the relative strength of each channel in a multi-channel system based on the position of the target object. The closer the distance between the target sound unit and the object position information, the higher the intensity allocation ratio, that is, the greater the intensity; the farther the distance between the target sound unit and the object position information, the lower the intensity allocation ratio, that is, the smaller the intensity.

[0109] In this embodiment, the audio data weight of each target sound unit playing the target audio data is adjusted according to the distance between the target sound unit and the object position information, so as to achieve the effect of matching the sound and the target object position, allowing the user to clearly feel that the sound output actually moves with the movement of the picture, and through the spatial movement of the sound position, an intuitive feeling of sound and picture accompanying the sound is achieved.

[0110] In order to assist in understanding the above technical solution, the following is a more complete embodiment of the video playback method. Figure 3, step A101, dynamically obtain the current display screen of the display screen at a set frame rate. A102, determine the moving object in the current display screen, and determine the moving object with the largest display size as the target object. Step A103, determine the normalized position information of the target object in the current display screen, wherein the normalized position information includes normalized coordinates stored in the form of a floating-point array with a length of 2 and a range of 0 to 1. Step A104, according to the resolution of the current display screen, convert the normalized position information into pixel position information, and use it as the object position information. Step A105, determine the target audio data matching the target object in the audio source data associated with the current display screen, and adjust the audio data weight of each target sound unit playing the target audio data according to the distance between the sound of the target sound unit corresponding to the object position information and the object position information, so as to achieve the effect of accompanying sound and picture. At step A106, at the same time, the sound position mark can be displayed in the form of a transparent mask at the top layer of the display hierarchy in the display screen corresponding to the object position information, thereby improving the user's perception of the accompanying audio and video effect and enhancing the user's viewing experience.

[0111] The present application embodiment provides a video playback device, referring to Figure 4 , the device is applied to electronic equipment, the device comprises:

[0112] An acquisition module 10 is configured to dynamically acquire the current display image;

[0113] A determination module 20 is configured to determine object position information of a target object in a current display image;

[0114] A control module 30, configured to control a sound generating unit corresponding to the object position information to generate a sound;

[0115] The display module 40 is configured to display a preset sound position mark at the display screen corresponding to the object position information. The video playback device provided in the embodiment of the present application adopts the video playback method in the above embodiment, which can enhance the user's perception of the accompanying sound and picture effect and improve the user experience. Compared with conventional technologies, the beneficial effects of the video playback device provided in the embodiment of the present application are the same as the beneficial effects of the video playback method provided in the above embodiment, and other technical features in the video playback device are the same as the features disclosed in the above embodiment method, which will not be repeated here.

[0116] An embodiment of the present application provides an electronic device, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the video playback method in the above-mentioned embodiment 1.

[0117] Reference below Figure 5 , respectively show the structural schematic diagrams of electronic devices suitable for implementing the embodiments of the present application. The electronic devices in the embodiments of the present application may include but are not limited to mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Portable Application Descriptions), PMPs (Portable Media Players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 5 The electronic device shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0118] like Figure 5 As shown, the electronic device may include a processing device 1001 (e.g., a central processing unit, a graphics processor, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM: Read Only Memory) 1002 or a program loaded from a storage device 1003 to a random access memory (RAM: Random Access Memory) 1004. In RAM1004, various programs and data required for the operation of the electronic device are also stored. The processing device 1001, ROM1002, and RAM1004 are connected to each other through a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Generally, the following systems can be connected to the I / O interface 1006: an input device 1007 including, for example, a touch screen, a touch pad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; an output device 1008 including, for example, a liquid crystal display (LCD: Liquid Crystal Display), a speaker, a vibrator, etc.; a storage device 1003 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1009. The communication device 1009 can allow the electronic device to communicate with other devices wirelessly or by wire to exchange data. Although the figure shows an electronic device with various systems, it should be understood that it is not required to implement or have all the systems shown. More or fewer systems can be implemented or have alternatively.

[0119] In particular, according to the embodiments disclosed in the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present application include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device, or installed from a storage device 1003, or installed from a ROM 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the method of the embodiment disclosed in the present application are executed.

[0120] The electronic device provided in the embodiment of the present application adopts the video playback method in the above embodiment, which can enhance the user's perception of the accompanying audio and video effect and improve the user experience. Compared with conventional technologies, the beneficial effects of the electronic device provided in the embodiment of the present application are the same as the beneficial effects of the video playback method provided in the above embodiment, and other technical features in the electronic device are the same as the features disclosed in the method of the previous embodiment, which will not be repeated here.

[0121] It should be understood that the various parts disclosed in this application can be implemented by hardware, software, firmware or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.

[0122] The above are only specific implementations of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

[0123] An embodiment of the present application provides a computer-readable storage medium having computer-readable program instructions (ie, computer programs) stored thereon, and the computer-readable program instructions are used to execute the video playback method in the above-mentioned embodiment.

[0124] The computer-readable storage medium provided in the embodiment of the present application may be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, systems or devices, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM: Random Access Memory), a read-only memory (ROM: Read Only Memory), an erasable programmable read-only memory (EPROM: Erasable Programmable Read Only Memory or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM: CD-Read Only Memory), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this embodiment, the computer-readable storage medium may be any tangible medium that includes or stores a program that can be used by or in combination with an instruction execution system, system or device. The program code included on the computer-readable storage medium may be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (Radio Frequency: Radio Frequency), etc., or any suitable combination of the above.

[0125] The computer-readable storage medium may be included in the electronic device, or may exist independently without being installed in the electronic device.

[0126] The above-mentioned computer-readable storage medium carries one or more programs. When the above-mentioned one or more programs are executed by an electronic device, the electronic device is enabled to: dynamically obtain the current display screen; determine the object position information of the target object in the current display screen; control the sound unit corresponding to the object position information to make a sound; and display a preset sound position identifier at the display screen corresponding to the object position information.

[0127] Computer program code for performing the operations of the present application may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0128] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present application. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code includes one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0129] The modules involved in the embodiments described in this application may be implemented by software or hardware, wherein the name of the module does not constitute a limitation on the unit itself in some cases.

[0130] The readable storage medium provided in the embodiment of the present application is a computer-readable storage medium, which stores computer-readable program instructions (i.e., computer programs) for executing the above-mentioned video playback method, which can enhance the user's perception of the accompanying audio and video effect and improve the user experience. Compared with conventional technologies, the beneficial effects of the computer-readable storage medium provided in the embodiment of the present application are the same as the beneficial effects of the video playback method provided in the above-mentioned embodiment, and will not be repeated here.

[0131] The above are only some embodiments of the present application, and are not intended to limit the patent scope of the present application. All equivalent structural changes made using the contents of the present application specification and drawings under the technical concept of the present application, or direct / indirect application in other related technical fields are included in the patent protection scope of the present application.

Claims

1. A video playback method, characterized in that: The method includes: Dynamically obtain the current display screen; Determine object position information of a target object in the current display image; Controlling a target sound emitting unit corresponding to the object position information to emit sound; A preset sound location mark is displayed on the display screen corresponding to the object location information.

2. The method according to claim 1, characterized in that Before the step of determining the object position information of the target object in the current display picture, the method further includes: Determining a moving object in the current display picture; The target object is determined from the moving objects.

3. The method according to claim 2, characterized in that The step of determining the target object from the moving object comprises: The moving object with the largest display size is determined as the target object.

4. The method according to any one of claims 1 to 3, characterized in that The step of determining the object position information of the target object in the current display image comprises: Determining normalized position information of the target object in the current display image; The normalized position information is converted into pixel position information according to the display parameters of the current display picture to serve as the object position information.

5. The method according to claim 1, characterized in that The step of controlling the target sound emitting unit corresponding to the object position information to emit sound comprises: Determine target audio data matching the target object in the audio source data associated with the currently displayed picture; According to the distance between each of the target sound units relative to the object position information, the audio data weight of each of the target sound units playing the target audio data is adjusted, wherein the audio data weight is negatively correlated with the distance between the target sound unit relative to the object position information.

6. The method according to claim 5, characterized in that The step of determining the target audio data matching the target object in the audio source data associated with the currently displayed picture comprises: matching candidate audio data from the audio source data according to the object type of the target object; The target audio data is matched from the candidate audio data according to the motion state of the target object.

7. The method according to claim 1, characterized in that The step of displaying a preset sound location mark on a display screen corresponding to the object location information comprises: A transparent mask including the sound emission position identifier is added to the display screen corresponding to the object position information.

8. A video playback device, characterized in that: The device comprises: An acquisition module is configured to dynamically acquire the current display screen; A determination module, configured to determine object position information of a target object in the current display image; A control module, configured to control a sound generating unit corresponding to the object position information to generate a sound; The display module is configured to display a preset sound location mark at a display screen corresponding to the object location information.

9. An electronic device, characterized in that: The electronic device comprises: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the video playback method according to any one of claims 1 to 7.

10. A storage medium, characterized in that: The storage medium is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, the steps of the video playback method according to any one of claims 1 to 7 are implemented.

Images