Method, device and electronic device for video audio quality matching

Abstract

The present application relates to the field of video processing technology, and discloses a method for video audio and video quality matching, including: when an audio signal or video signal input is detected, one or more screen images are captured; the screen image is identified to obtain a video tag; the audio and video quality mode corresponding to the video tag is obtained; and the audio and video quality mode is switched to. When an audio signal or video signal input is detected, one or more screen images are captured, and the video tag is obtained by identifying the screen image, and then the audio and video quality mode corresponding to the video tag is obtained and automatically switched. In this way, when watching a video, the user can automatically switch to the audio and video quality mode required by the video, without the need for the user to manually switch, and the operation is more convenient and flexible. The present application also discloses a device and electronic device for video audio and video quality matching.

Description

Technical Field

[0001] The present application relates to the field of video processing technology, for example, to a method and device for video audio and picture quality matching, and an electronic device. Background Art

[0002] Nowadays, the video content on smart devices is very rich and clearly classified, including movies, TV series, entertainment, music, sports, etc. Different video content requires different sound effects and picture quality. Some need to highlight the background music, some need to highlight the human voice, and some need to add surround; some need the picture quality to be more vivid, and some need higher contrast, etc., so that people can have an immersive effect. At present, users can manually select and switch to the sound and picture quality mode required by the video according to the video content.

[0003] In the process of implementing the embodiments of the present disclosure, it is found that there are at least the following problems in the related art: it is inconvenient for a user to manually select the audio and video quality mode required for a video when watching the video. Summary of the invention

[0004] In order to provide a basic understanding of some aspects of the disclosed embodiments, a brief summary is given below. The summary is not an extensive review, nor is it intended to identify key / critical components or delineate the scope of protection of these embodiments, but rather serves as a prelude to the detailed description that follows.

[0005] The embodiments of the present disclosure provide a method and device for video audio and video quality matching, and an electronic device to solve the problem that users currently have to manually select the audio and video quality mode required for a video when watching it, which is inconvenient.

[0006] In some embodiments, the method for video audio quality matching includes:

[0007] When an audio signal or a video signal input is detected, capturing one or more screen images;

[0008] Recognize the screen image to obtain the video tag;

[0009] Get the audio and video quality mode corresponding to the video tag;

[0010] Switch to audio quality mode.

[0011] In some embodiments, the apparatus for video audio and picture quality matching includes a processor and a memory storing program instructions, and the processor is configured to execute the above-mentioned method for video audio and picture quality matching when executing the program instructions.

[0012] In some embodiments, the electronic device includes the above-mentioned device for video and audio quality matching.

[0013] The method, device, and electronic device for video audio quality matching provided by the embodiments of the present disclosure can achieve the following technical effects:

[0014] When an audio signal or video signal input is detected, one or more screen images are captured, and the video tag is obtained by identifying the screen image, and then the audio and video quality mode corresponding to the video tag is obtained and automatically switched. In this way, when the user is watching a video, the audio and video quality mode required by the video can be automatically switched without the user manually switching, which is more convenient and flexible.

[0015] The above general description and the following description are exemplary and explanatory only and are not intended to limit the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] One or more embodiments are exemplarily described by corresponding drawings, which do not limit the embodiments. Elements with the same reference numerals in the drawings are shown as similar elements, and the drawings do not constitute a scale limitation, and wherein:

[0017] Figure 1 is a schematic diagram of a method for video audio and picture quality matching provided by an embodiment of the present disclosure;

[0018] Figure 2 is a schematic diagram of another method for video audio and picture quality matching provided by an embodiment of the present disclosure;

[0019] Figure 3 is a schematic diagram of another method for video audio and picture quality matching provided by an embodiment of the present disclosure;

[0020] Figure 4 It is a schematic diagram of a device for video audio quality matching provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0021] In order to be able to understand the features and technical contents of the embodiments of the present disclosure in more detail, the implementation of the embodiments of the present disclosure is described in detail below in conjunction with the accompanying drawings. The attached drawings are for reference only and are not used to limit the embodiments of the present disclosure. In the following technical description, for the convenience of explanation, a full understanding of the disclosed embodiments is provided through multiple details. However, one or more embodiments can still be implemented without these details. In other cases, to simplify the drawings, well-known structures and devices can be simplified for display.

[0022] The terms "first", "second", etc. in the specification and claims of the embodiments of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the terms used in this way can be interchanged where appropriate, so that the embodiments of the embodiments of the present disclosure described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions.

[0023] Unless otherwise specified, the term "plurality" means two or more. The character " / " indicates that the objects before and after are in an "or" relationship. For example, A / B means: A or B. The term "and / or" is a description of the association relationship between objects, indicating that there can be three relationships. For example, A and / or B means: A or B, or, A and B.

[0024] Combination Figure 1 As shown, the embodiment of the present disclosure provides a method for video audio quality matching, comprising the following steps:

[0025] S101: When an audio signal or a video signal input is detected, one or more screen images are captured.

[0026] An audio signal is a signal that contains only sound. When audio information is received, it can be determined that an audio signal is input; a video signal is a signal that contains only images. When video information is received, it can be determined that a video signal is input. Before the user selects to play the video content, the third-party application (such as a smart TV application) or an external network player (such as Internet TV OTT, interactive network TV IPTV) has no audio signal or video signal output; after the user manipulates the third-party application or external network player to select to play the target video, the third-party application or external network player will switch to the details page of the target video and output audio and video signals at the same time. The details page displays a text description of the video attributes of the target video (for example, "Science Fiction; No. 1 on the Hot Movie List"), captures the screen image of the details page, and obtains the video tag of the target video by identifying the screen image.

[0027] S102: Identify the screen image to obtain a video tag.

[0028] Optionally, the video tag includes a first video tag; and recognizing the screen image to obtain the video tag includes: performing text recognition on the screen image to obtain the first video tag.

[0029] Since the screen image displays the text description of the video attributes of the played video, the corresponding first video tag can be obtained by identifying the text description in the screen image.

[0030] Optionally, performing text recognition on the screen image to obtain the first video tag includes: recognizing text located at a preset position of the screen image to obtain a keyword of the video attribute; and using the video tag corresponding to the keyword as the first video tag.

[0031] Based on the keyword, the video tag corresponding to the keyword is determined by searching the first correspondence table. The first correspondence table is used to indicate the correspondence between the keyword and the video tag. For example, the following Table 1 shows an optional first correspondence table:

[0032] Table 1: First correspondence table

[0033]

[0034] Keywords of video attributes include one or more of video type, video name, video publishing time, video director, and video starring. For example, the text located at the preset position of the screen image is "Science Fiction; No. 1 on the popular movie list", and the keywords of the video attributes obtained through text recognition are "Science Fiction" and "Movie". Then, by searching the first correspondence table, the video tag corresponding to the above keywords can be determined as "Science Fiction; Movie", and the video tag is used as the first video tag. Determining the corresponding video tags based on different types of keywords expands the application scope of determining video tags through keywords, which is conducive to accurately obtaining video tags to achieve matching of video audio and video quality, and enhance the user's viewing experience.

[0035] Here, the text located at a preset position of the screen image is text located within a preset ratio range of the screen image, for example, text located within a range from one quarter to one half of the screen image. Generally speaking, after a third-party application or an external network player switches to the details page of the target video, a portion of the details page (for example, located within a range from the boundary to one quarter of the screen image) plays the target video, and a portion (for example, located within a range from one quarter to one half of the screen image) displays a text description of the video attributes of the target video. Therefore, compared to identifying all text in the screen image, choosing to identify specific text located at a preset position of the screen image can reduce the amount of data processing for text recognition, thereby improving the efficiency of acquiring the first video tag.

[0036] Optionally, using the video tag corresponding to the keyword as the first video tag includes: uploading the keyword to a preset database; and retrieving and matching the video tag corresponding to the keyword in the preset database as the first video tag.

[0037] The preset database is a cloud database independent of third-party applications or external network players. A first correspondence table is pre-stored in the database. After uploading the keyword to the preset database, the video tag corresponding to the keyword is matched by searching the first correspondence table, and the video tag is used as the first video tag. The preset database independent of third-party applications or external network players is uniformly set up, and video tags of different video playback paths including third-party applications and external network players can be retrieved, which expands the application scope of the method for video audio and picture quality matching and improves the retrieval rate.

[0038] Optionally, the update interval of the preset database is determined according to the retrieval frequency. The greater the retrieval frequency, the smaller the update interval. The greater the retrieval frequency, the more frequently the user watches the video, and the higher the requirement for video quality is compared with the general user, so the frequency of updating the database content is appropriately increased. In this way, the storage content of the preset database is updated according to the user's usage habits, which can better meet the user's usage needs.

[0039] S103: Acquire the audio and video quality mode corresponding to the video tag.

[0040] Based on the video tag, the audio and video quality mode corresponding to the video tag is determined by searching the second correspondence table. The second correspondence table is used to indicate the correspondence between the video tag and the audio and video quality mode. For example, the following Table 2 shows an optional second correspondence table:

[0041] Table 2: Second correspondence table

[0042] Video Tags Audio quality mode "Science Fiction; Movies" "Surround sound; low color purity" "Horror; Movie" "Highlight background music; low sharpness" "Tenderness; TV series" "Highlight vocals; natural white balance"

[0043] S104: Switch to audio and video quality mode.

[0044] After obtaining the audio and video quality mode of the played video, the current audio and video quality mode is switched to the obtained audio and video quality mode, thereby improving the user's viewing experience.

[0045] By using the method for video audio and video quality matching provided by the embodiment of the present disclosure, when an audio signal or video signal input is detected, one or more screen images are captured, and the video tag is obtained by identifying the screen image, and then the audio and video quality mode corresponding to the video tag is obtained and automatically switched. In this way, when the user is watching a video, the audio and video quality mode required by the video can be automatically switched without the user manually switching, and the operation is more convenient and flexible.

[0046] In some embodiments, in combination Figure 2 As shown, the method for video audio quality matching includes the following steps:

[0047] S201: When an audio signal or a video signal input is detected, a plurality of screen images are captured.

[0048] Here, a plurality of screen images are captured sequentially in chronological order.

[0049] S202: Obtaining a first image similarity between a screen image and a previous screen image and a second image similarity between a screen image and a subsequent screen image.

[0050] The first image similarity is the similarity between the screen image and the previous screen image; the second image similarity is the similarity between the screen image and the next screen image.

[0051] S203: Selecting a screen image with the smallest image similarity difference between the first image similarity and the second image similarity as a target screen image.

[0052] The smaller the image similarity between the first image similarity and the second image similarity, the higher the similarity between the previous screen image, the screen image and the next screen image. After the user manipulates the third-party application or external network player to select and play the target video, the third-party application or external network player will switch to the details page of the target video. The screen image will switch while the audio signal or video signal is input. When the image similarity difference between the first image similarity and the second image similarity is the smallest, the screen image switching is considered to be completed. At this time, the target screen image is the image showing the details page rather than the image in the switching process.

[0053] S204: Perform text recognition on the target screen image to obtain a first video tag.

[0054] S205: Acquire a first audio and video quality mode corresponding to the first video tag.

[0055] Based on the first video tag, a first audio and video quality mode corresponding to the first video tag is determined by searching a second corresponding relationship table.

[0056] S206: Switch to the first audio and video quality mode.

[0057] After acquiring the first audio and video quality mode for playing the video, the current audio and video quality mode is switched to the first audio and video quality mode, thereby improving the user's viewing experience.

[0058] In the embodiment of the present disclosure, when an audio signal or video signal input is detected, multiple screen images are captured in chronological order, and a target screen image with the smallest image similarity difference between the first image similarity and the second image similarity is selected for text recognition to obtain a first video tag, and the corresponding first audio and video quality mode is switched. Since the target screen image is an image that displays a detail page rather than an image in the switching process, identifying the target screen image to obtain the first video tag can improve the accuracy of obtaining the first video tag, and thus can more accurately switch to the corresponding audio and video quality mode.

[0059] In some embodiments, in combination Figure 3 As shown, the method for video audio quality matching includes the following steps:

[0060] S301: When an audio signal or a video signal input is detected, one or more screen images are captured.

[0061] S302: Determine whether a first video tag is obtained within a preset time period.

[0062] S303: When a first video tag is obtained within a preset time period, a first audio and video quality mode corresponding to the first video tag is obtained and switched to the first audio and video quality mode.

[0063] S304: When the first video tag is not obtained within the preset period of time, image recognition is performed on the screen image to obtain a second video tag.

[0064] Optionally, performing image recognition on the screen image to obtain the second video tag includes: uploading the screen image to a network end for image recognition to obtain a video name; and using the video tag corresponding to the video name as the second video tag. The network end may be a cloud server.

[0065] Based on the video name, the video tag corresponding to the video name is determined by searching the third correspondence table. The third correspondence table is used to indicate the correspondence between the video name and the video tag. For example, the following Table 3 shows an optional third correspondence table:

[0066] Table 3: The third correspondence table

[0067] Video Name Video Tags "A Beautiful Mind" "Drama; Movie" "Extinction" "Science Fiction; Movies" "Crash Landing on You" "Romance; TV series"

[0068] S305: Acquire a second audio and video quality mode corresponding to the second video tag.

[0069] Based on the second video tag, the second audio and video quality mode corresponding to the second video tag is determined by searching the second correspondence table.

[0070] S306: Switch to the second audio and video quality mode.

[0071] After acquiring the second audio and video quality mode for playing the video, the current audio and video quality mode is switched to the second audio and video quality mode, thereby improving the user's viewing experience.

[0072] In the disclosed embodiment, when the first video tag is not obtained within the preset period, the screen image (i.e., the video screen in the video content) is image recognized to obtain the second video tag. In this way, the success rate of obtaining the video tag of the played video can be improved, and the video audio and video quality mode can be adjusted to the audio and video quality mode corresponding to the played video in a timely manner, thereby improving the user's viewing experience.

[0073] In some embodiments, the method for matching video audio and video quality further includes: in the process of switching to the audio and video quality mode, issuing an audio and video quality switching prompt message. This helps the user to clearly understand the current audio and video quality mode, and facilitates adaptive adjustments according to the switched audio and video quality mode (for example, the user manually adjusts the audio and video quality of the played video), which is more user-friendly.

[0074] In some embodiments, the method for video audio and video quality matching further includes: when no audio signal or video signal input is detected, switching to the original audio and video quality mode. When the user triggers the switch to the default standard state, when the user returns to the system to detect no audio signal or video signal input, it is determined that the current video playback is over, and the system switches back to the default standard audio and video quality mode (original audio and video quality mode) to avoid affecting the normal audio and video quality of the system.

[0075] Combination Figure 4 The embodiment of the present disclosure provides a device for video audio and picture quality matching, including a processor 40 and a memory 41, and may also include a communication interface 42 and a bus 43. The processor 40, the communication interface 42, and the memory 41 can communicate with each other through the bus 43. The communication interface 42 can be used for information transmission. The processor 40 can call the logic instructions in the memory 41 to execute the method for video audio and picture quality matching of the above embodiment.

[0076] In addition, the logic instructions in the memory 41 can be implemented in the form of software functional units and can be stored in a computer-readable storage medium when sold or used as an independent product.

[0077] The memory 41 is a computer-readable storage medium that can be used to store software programs and computer executable programs, such as program instructions / modules corresponding to the method in the embodiment of the present disclosure. The processor 40 executes the function application and data processing by running the program instructions / modules stored in the memory 41, that is, the method for video audio quality matching in the above method embodiment is implemented.

[0078] The memory 41 may include a program storage area and a data storage area, wherein the program storage area may store an operating system and an application required for at least one function; the data storage area may store data created according to the use of the terminal device, etc. In addition, the memory 41 may include a high-speed random access memory and may also include a non-volatile memory.

[0079] The embodiments of the present disclosure provide an electronic device (eg, a computer, a mobile phone, etc.), comprising the above-mentioned apparatus for video and audio quality matching.

[0080] An embodiment of the present disclosure provides a computer-readable storage medium storing computer-executable instructions, wherein the computer-executable instructions are configured to execute the above-mentioned method for video audio and picture quality matching.

[0081] An embodiment of the present disclosure provides a computer program product, which includes a computer program stored on a computer-readable storage medium, and the computer program includes program instructions. When the program instructions are executed by a computer, the computer executes the above-mentioned method for video audio and picture quality matching.

[0082] The computer-readable storage medium mentioned above may be a transient computer-readable storage medium or a non-transitory computer-readable storage medium.

[0083] The technical solution of the embodiment of the present disclosure can be embodied in the form of a software product, which is stored in a storage medium and includes one or more instructions for enabling a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in the embodiment of the present disclosure. The aforementioned storage medium may be a non-transient storage medium, including: a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and other media that can store program codes, or a transient storage medium.

[0084] The above description and the accompanying drawings fully illustrate the embodiments of the present disclosure so that those skilled in the art can practice them. Other embodiments may include structural, logical, electrical, process and other changes. The embodiments represent only possible changes. Unless explicitly required, individual components and functions are optional, and the order of operation may vary. The parts and features of some embodiments may be included in or replace the parts and features of other embodiments. The scope of the embodiments of the present disclosure includes the entire scope of the claims, and all available equivalents of the claims. When used in this application, although the terms "first", "second", etc. may be used in this application to describe each element, these elements should not be limited by these terms. These terms are only used to distinguish one element from another element. For example, without changing the meaning of the description, the first element can be called the second element, and similarly, the second element can be called the first element, as long as all occurrences of the "first element" are renamed consistently and all occurrences of the "second element" are renamed consistently. The first element and the second element are both elements, but may not be the same element. Moreover, the words used in this application are only used to describe the embodiments and are not used to limit the claims. As used in the description of the embodiments and claims, unless the context clearly indicates, the singular forms "a", "an" and "the" are intended to include the plural forms as well. Similarly, the term "and / or" as used in this application refers to any and all possible combinations of one or more associated listings. In addition, when used in this application, the term "comprise" and its variants "comprises" and / or comprising refer to the presence of stated features, wholes, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or groups of these. In the absence of further restrictions, the elements defined by the sentence "including one..." do not exclude the presence of other identical elements in the process, method or device including the elements. In this article, each embodiment may focus on the differences from other embodiments, and the same and similar parts between the embodiments may refer to each other. For the methods, products, etc. disclosed in the embodiments, if they correspond to the method part disclosed in the embodiments, then the relevant parts can refer to the description of the method part.

[0085] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software may depend on the specific application and design constraints of the technical solution. The technicians may use different methods for each specific application to implement the described functions, but such implementations should not be considered to exceed the scope of the embodiments of the present disclosure. The technicians may clearly understand that, for the convenience and simplicity of description, the specific working processes of the systems, devices and units described above may refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here.

[0086] In the embodiments disclosed herein, the disclosed methods and products (including but not limited to devices, equipment, etc.) can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units can be only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between each other shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms. The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to implement this embodiment. In addition, each functional unit in the embodiment of the present disclosure may be integrated in a processing unit, or each unit may exist physically alone, or two or more units may be integrated in one unit.

[0087] The flowchart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to the embodiment of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a part of the code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. In some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, which can depend on the functions involved. In the description corresponding to the flowchart and the block diagram in the accompanying drawings, the operations or steps corresponding to different boxes can also occur in a different order from the order disclosed in the description, and sometimes there is no specific order between different operations or steps. For example, two consecutive operations or steps can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, which can depend on the functions involved. Each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented by a dedicated hardware-based system that performs the specified functions or actions, or may be implemented by a combination of dedicated hardware and computer instructions.

Claims

1. A method for video audio quality matching, characterized in that: include: When an audio signal or a video signal input is detected, capturing one or more screen images; Identify the text located at a preset position of the screen image to obtain a keyword of the video attribute; wherein the text located at the preset position of the screen image is the text located within a preset ratio range of the screen image; Uploading the keywords to a preset database; Searching a first correspondence table, retrieving and matching a video tag corresponding to the keyword in the preset database as a first video tag; wherein the first correspondence table is used to indicate a correspondence between a keyword and a video tag; When capturing multiple screen images, obtaining a first image similarity between the screen image and a previous screen image and a second image similarity between the screen image and a subsequent screen image; Selecting a screen image with the smallest image similarity difference between the first image similarity and the second image similarity as a target screen image; Performing text recognition on the target screen image to obtain the first video tag; Searching a second correspondence table to obtain the audio and video quality mode corresponding to the first video tag; wherein the second correspondence table is used to indicate the correspondence between the video tag and the audio and video quality mode; Switch to the above audio and video quality mode.

2. The method according to claim 1, characterized in that Also includes: When the first video tag is not obtained within a preset period of time, image recognition is performed on the screen image to obtain a second video tag.

3. The method according to any one of claims 1 to 2, characterized in that: Also includes: During the process of switching to the audio and video quality mode, a prompt message of audio and video quality switching is issued.

4. The method according to any one of claims 1 to 2, characterized in that: Also includes: When no audio or video signal input is detected, it switches to original sound quality mode.

5. A device for video audio quality matching, comprising a processor and a memory storing program instructions, characterized in that: The processor is configured to perform the method for video audio and picture quality matching as described in any one of claims 1 to 4 when executing the program instructions.

6. An electronic device, characterized in that: It comprises the device for video, audio and picture quality matching as described in claim 5.

Images