Method for pushing information, apparatus, terminal, and storage medium

Abstract

The present application is applicable to the technical field of information processing, and provides a method for pushing information, an apparatus, a terminal, and a storage medium. The method comprises: a first terminal playing back multimedia data, wherein audio data of the multimedia data is generated by superposing an ultrasonic audio signal and an original multimedia audio signal, the ultrasonic audio signal is used for pushing information, and the ultrasonic audio signal is generated by encoding and modulating the information; a second terminal receiving the audio data of the multimedia data; obtaining the ultrasonic audio signal on the basis of the audio data; determining the information on the basis of the ultrasonic audio signal; and displaying a target interface corresponding to the information, wherein the target interface is a webpage, an application page, a QR code, a picture, or an image containing push content. In the technical solution provided by the present application, according to actual conditions, a user can select whether to receive the push information, and a user views the push information on a second device while the user is not affected to normally view the multimedia data on a first device, thereby improving the use experience of the user.

Description

Method, device, terminal and storage medium for pushing information

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office on March 29, 2024, with application number 202410385612.0 and application name “A method, device, terminal and storage medium for pushing information”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application belongs to the field of information processing technology, and in particular relates to a method, device, terminal and storage medium for pushing information. Background Art

[0003] Push notifications, as one of the primary means of information dissemination, are now being used in various fields, such as advertising. How to effectively and accurately push advertising information to target users has become a key focus.

[0004] Existing push information technology can automatically push ads when users launch certain applications or devices, displaying relevant information to users. If users do not want push ads, they can activate a membership service to display any push ads within the application or device. However, the above-mentioned information blocking method indiscriminately rejects all push messages after the user activates the membership. If the user cannot choose to push advertising information after the membership is activated, that is, during the validity period of the membership service, the push settings have low flexibility, which affects the user experience. Summary of the Invention

[0005] The embodiments of the present application provide a method, device, terminal and storage medium for pushing information, which can solve the problem of existing push information technology that users cannot flexibly choose whether to push information according to their needs and the low flexibility of push settings.

[0006] In a first aspect, the present application provides a method for pushing information, applied to a second terminal, the method comprising:

[0007] receiving audio data of multimedia data, where the audio data of the multimedia data is generated by superimposing the ultrasonic audio signal and an original audio signal of the multimedia data;

[0008] obtaining the ultrasonic audio signal according to the audio data;

[0009] determining the information according to the ultrasonic audio signal;

[0010] The target interface corresponding to the information is displayed, where the target interface is a web page, an application page, a QR code, a picture, or an image containing the pushed content.

[0011] The implementation of the embodiment of the present application has the following beneficial effects: multimedia data carrying an ultrasonic audio signal is played through a first terminal, so that a second terminal can obtain information corresponding to the ultrasonic audio signal upon receiving the ultrasonic audio signal, and display the corresponding target interface of the information based on the information, thereby achieving the purpose of pushing information. In this embodiment, the first terminal does not affect the user's normal viewing of the multimedia data during the process of pushing information. Because the information used to push information in the multimedia data is transmitted via the ultrasonic audio signal, and the sound frequency of the ultrasonic audio signal is outside the audible frequency range of the human ear, that is, the process of the ultrasonic audio signal being transmitted to the second terminal does not affect the user's normal viewing of the multimedia data. When the user needs to receive the information, the page corresponding to the information can be displayed through the second terminal; and when the user does not need to receive the information, the ultrasonic audio signal in the multimedia data does not need to be parsed by the second terminal, thereby improving the flexibility of pushing information. The user can choose whether to receive the information according to the actual situation without affecting the user's normal viewing of the multimedia data, thereby improving the user experience.

[0012] In a possible implementation of the first aspect, obtaining the ultrasonic audio signal according to the audio data includes: performing high-pass filtering on the audio data to obtain the ultrasonic audio signal;

[0013] Determining the information based on the ultrasonic audio signal includes: modulating and demodulating the ultrasonic audio signal to obtain binary-coded data; the binary-coded data is generated by encoding the information; and converting the binary-coded data into the information using a preset binary coding decoding rule. In this implementation, the ultrasonic audio signal is extracted through high-pass filtering, and then decoded to restore the information, achieving the purpose of pushing information based on the ultrasonic audio signal and improving the flexibility of information push.

[0014] In one possible implementation of the first aspect, the information is a jump link; and displaying the target interface corresponding to the information includes: displaying the target page in a preset browsing application based on the jump link. In this implementation, the information is a jump link, so the second terminal can display the corresponding page based on the jump link. Compared to graphical data, jump links have a smaller data volume, thereby improving the efficiency of the information push process.

[0015] In one possible implementation of the first aspect, the pushed data is a QR code; and displaying the target interface corresponding to the information includes: displaying the QR code; and, in response to a recognition event of the QR code, displaying a page corresponding to the QR code. In this implementation, since the information is a QR code, the user can determine whether to recognize the QR code based on actual display needs, thereby increasing the flexibility of the push process and enhancing user engagement.

[0016] In one possible implementation of the first aspect, before receiving the multimedia audio data, the method further includes: in response to a first trigger event, enabling a function for pushing information, and enabling a function module for parsing the ultrasonic audio signal, wherein the function module is configured to determine the information based on the ultrasonic audio signal. In this implementation, a user can adjust the activation status of the function for pushing information as needed, thereby increasing the flexibility of information push.

[0017] In a possible implementation of the first aspect, the triggering event includes: an operation event of clicking a push function to start a control, an event of starting the push function through a voice keyword, or an event of starting the push function through a specified gesture.

[0018] In one possible implementation of the first aspect, displaying the target interface corresponding to the information includes displaying the target interface corresponding to the information when the second terminal is in a preset state, where the preset state includes a screen-on state, an unlocked state, a held state, or a state where the user is looking at the screen. In this implementation, the second terminal displays the page corresponding to the information only when the device is in use, thereby improving push notification accuracy and avoiding invalid push notifications.

[0019] In one possible implementation of the first aspect, displaying the target interface corresponding to the information includes: in response to a second triggering event, displaying the target interface based on the information, wherein the target interface includes information associated with the second triggering event. The second triggering event may be an event in which a user initiates a voice instruction or selects information, such as a user speaking a voice instruction for a keyword such as "clothes" or "sunscreen," and the second terminal may display the target interface corresponding to the second triggering event. In this implementation, the second terminal may display the target interface corresponding to the specified information based on the user's operation. This allows the second terminal to display the target interface corresponding to the information of interest to the user when receiving multiple messages, thereby improving the accuracy of the displayed information.

[0020] In a possible implementation of the first aspect, the target interface includes first content and second content, and displaying the target interface corresponding to the information includes: displaying a first page corresponding to the first content in response to a first trigger event of the first content.

[0021] In a possible implementation manner of the first aspect, the information includes first information and second information, the first content indicates content corresponding to the first information, and the second content indicates content corresponding to the second information.

[0022] In one possible implementation of the first aspect, the ultrasonic audio signal includes a first ultrasonic signal and a second ultrasonic signal, the second ultrasonic signal having a frequency higher than the first ultrasonic information frequency. Determining the information based on the ultrasonic audio signal includes: determining the first information based on the first ultrasonic signal; determining the second information based on the second ultrasonic signal; and determining the information based on the first information and the second information. In this implementation, the second terminal can extract the first ultrasonic signal and the second ultrasonic signal from the audio data using high-pass filtering modules in different frequency bands, thereby obtaining information corresponding to the ultrasonic signals in different frequency bands, thereby achieving the purpose of receiving multiple information.

[0023] In one possible implementation of the first aspect, the ultrasonic audio signal includes a delimiter, and determining the information based on the ultrasonic audio signal includes: dividing the ultrasonic audio signal into a first ultrasonic signal and a second ultrasonic signal based on the delimiter; determining the first information based on the first ultrasonic signal; determining the second information based on the second ultrasonic signal; and determining the information based on the first information and the second information. In this implementation, the second terminal can separate the ultrasonic audio signal using the delimiter, thereby obtaining information corresponding to different ultrasonic signals, thereby achieving the purpose of receiving multiple information.

[0024] In a possible implementation of the first aspect, determining the information based on the ultrasonic audio signal includes: determining the first information based on a signal within a first time interval in the ultrasonic audio signal; determining the second information based on a signal within a second time interval in the ultrasonic audio signal, the second time interval being after the first time interval; and determining the information based on the first information and the second information. In this implementation, the second terminal can segment the ultrasonic audio signal by time interval, thereby obtaining information corresponding to different ultrasonic signals, thereby achieving the purpose of receiving multiple information.

[0025] In a second aspect, an embodiment of the present application provides a device for displaying information, including:

[0026] an audio data receiving unit, configured to receive audio data of multimedia data, where the audio data of the multimedia data is generated by superimposing the ultrasonic audio signal and an original audio signal of the multimedia data;

[0027] an audio data parsing unit, configured to obtain the ultrasonic audio signal based on the audio data;

[0028] an ultrasonic audio signal analyzing unit, configured to determine the information based on the ultrasonic audio signal;

[0029] The display unit is used to display the target interface corresponding to the information, where the target interface is a web page, an application page, a QR code, a picture, or an image containing pushed content.

[0030] In a possible implementation of the second aspect, the audio data parsing unit includes:

[0031] a filtering unit, configured to perform high-pass filtering on the audio signal of the multimedia data to obtain the ultrasonic audio signal;

[0032] The ultrasonic audio signal analysis unit includes:

[0033] a demodulation unit, configured to modulate and demodulate the ultrasonic audio signal to obtain binary coded data; the binary coded data is generated by encoding the information;

[0034] The decoding unit is used to convert the binary coded data into the information through a preset binary coded decoding rule.

[0035] In a possible implementation of the second aspect, the information is a jump link;

[0036] The display unit is specifically configured to display the target page in a preset browsing application based on the jump link.

[0037] In a possible implementation of the second aspect, the pushed data is a QR code; and the display unit includes:

[0038] A QR code display unit, configured to display the QR code;

[0039] The QR code recognition unit is used to display a page corresponding to the QR code in response to a recognition event of the QR code.

[0040] In a possible implementation of the second aspect, the apparatus further includes:

[0041] The trigger unit is used to start the function of pushing information in response to the first trigger event and start the functional module of parsing the ultrasonic audio signal, wherein the functional module is used to determine the information according to the ultrasonic audio signal.

[0042] In a possible implementation of the second aspect, the triggering event includes: an operation event of clicking a control to start the push function, an event of starting the push function through a voice keyword, or an event of starting the push function through a specified gesture.

[0043] In a possible implementation of the second aspect, the display unit is specifically used to: when the device status of the second terminal is in a preset state, display the target interface corresponding to the information, and the preset state includes: screen-on state, unlocked state, holding state or user-looking-at-the-screen state.

[0044] In a possible implementation manner of the second aspect, the display unit is specifically configured to: in response to a second triggering event, display the target interface based on the display information, where the target interface includes information associated with the second triggering event.

[0045] In a possible implementation of the second aspect, the target interface includes first content and second content, and the display unit includes:

[0046] The third triggering unit is configured to respond to a third triggering event on the first content.

[0047] The first page display unit is configured to display a first page corresponding to the first content.

[0048] In a possible implementation manner of the second aspect, the information includes first information and second information, the first content indicates content corresponding to the first information, and the second content indicates content corresponding to the second information.

[0049] In a possible implementation of the second aspect, the ultrasonic audio signal includes a first ultrasonic signal and a second ultrasonic signal, the second ultrasonic signal has a frequency higher than the first ultrasonic information frequency, and the ultrasonic audio signal parsing unit includes:

[0050] a first frequency band analysis unit, configured to determine the first information based on the first ultrasonic signal;

[0051] a second frequency band analysis unit, configured to determine the second information based on the second ultrasonic signal;

[0052] A first information merging unit is configured to determine the information based on the first information and the second information.

[0053] In a possible implementation of the second aspect, the ultrasonic audio signal includes a separator, and the ultrasonic audio signal parsing unit includes:

[0054] a delimiter division unit, configured to divide the ultrasonic audio signal into a first ultrasonic signal and a second ultrasonic signal based on the delimiter;

[0055] a first analyzing unit, configured to determine the first information based on the first ultrasonic signal;

[0056] a second analyzing unit, configured to determine the second information based on the second ultrasonic signal;

[0057] The second information merging unit is configured to determine the information based on the first information and the second information.

[0058] In a possible implementation of the second aspect, the ultrasonic audio signal analysis unit includes:

[0059] a first time division unit, configured to determine the first information based on a signal of a first time interval in the ultrasonic audio signal;

[0060] a second time division unit, configured to determine the second information based on a signal of a second time interval in the ultrasonic audio signal, the second time interval being after the first time interval;

[0061] A third information merging unit is configured to determine the information based on the first information and the second information.

[0062] In a third aspect, an embodiment of the present application provides a method for pushing information, which is applied to a first terminal, and the method includes:

[0063] Play multimedia data, where the audio data of the multimedia data is generated by superimposing the ultrasonic audio signal with the original audio signal of the multimedia, and the ultrasonic audio signal is used to push the information, where the information includes: a jump link, a QR code, or a combination of one or more of an image containing the pushed content, and the ultrasonic audio signal is generated by encoding and modulating the information.

[0064] The implementation of the embodiment of the present application has the following beneficial effects: multimedia data carrying an ultrasonic audio signal is played through a first terminal, so that a second terminal can obtain information corresponding to the ultrasonic audio signal upon receiving the ultrasonic audio signal, and display the corresponding target interface of the information based on the information, thereby achieving the purpose of pushing information. In this embodiment, the first terminal does not affect the user's normal viewing of the multimedia data during the process of pushing information. Because the information used to push information in the multimedia data is transmitted via the ultrasonic audio signal, and the sound frequency of the ultrasonic audio signal is outside the audible frequency range of the human ear, that is, the process of the ultrasonic audio signal being transmitted to the second terminal does not affect the user's normal viewing of the multimedia data. When the user needs to receive the information, the page corresponding to the information can be displayed through the second terminal; and when the user does not need to receive the information, the ultrasonic audio signal in the multimedia data does not need to be parsed by the second terminal, thereby improving the flexibility of pushing information. The user can choose whether to receive the information according to the actual situation without affecting the user's normal viewing of the multimedia data, thereby improving the user experience.

[0065] In a possible implementation manner of the third aspect, the multimedia data includes video data and audio data.

[0066] In one possible implementation of the third aspect, the audio data is generated by superimposing the ultrasonic audio signal with the original audio signal based on first-order complementary coefficients. In this implementation, superimposing the signals using first-order complementary coefficients enables the ultrasonic audio signal to be transmitted without affecting the user's ability to normally hear the original audio signal, thereby improving the stealth of ultrasonic audio signal transmission.

[0067] In a possible implementation of the third aspect, the signal modulation includes a combination of one or more of amplitude modulation, frequency shift modulation, or phase shift modulation; the binary encoding includes the American Standard Code for Information Interchange (ASCII), the Unicode Format Conversion (UTF-8), or the Chinese Character Internal Code Extension Specification (GBK).

[0068] In one possible implementation of the third aspect, the multimedia data includes first data and second data, and playing the multimedia data further includes: determining audio data of the second data based on the first data or an instruction voice, the audio data of the second data including an ultrasonic audio signal corresponding to the information; and playing the second data. The second data is played after the first data. In this implementation, during the multimedia data playback process, the ultrasonic audio signal can be determined in real time based on the played content and / or the user's instruction voice, and the ultrasonic audio signal can be superimposed on the multimedia data in real time, thereby increasing the flexibility of push information settings.

[0069] In a possible implementation of the third aspect, playing the second data includes: superimposing the ultrasonic audio signal with the original audio signal of the second data to generate the audio signal of the second data; and playing the second data carrying the ultrasonic audio signal when the playback timing of the second data is met.

[0070] In one possible implementation of the third aspect, determining the audio data of the second data based on the first data or the indicative voice includes: determining a push keyword corresponding to the first data or the indicative voice; and determining information corresponding to the push keyword. In this implementation, the first terminal can determine the push keyword based on the played data segment and then match the corresponding information, thereby improving the match between the information and the content of the multimedia data, thereby improving push accuracy.

[0071] In one possible implementation of the third aspect, the information includes first information and second information, and the ultrasonic audio signal includes a first ultrasonic audio signal for pushing the first information and a second ultrasonic audio signal for pushing the second information. The first ultrasonic audio signal and the second ultrasonic audio signal are fused via a delimiter or time interval to form the ultrasonic audio signal, or the second ultrasonic audio signal has a higher frequency than the first ultrasonic audio signal. In this implementation, the ultrasonic audio signal for pushing multiple pieces of information can be obtained through time-sharing encapsulation, frequency-sharing encapsulation, fusion encapsulation, or delimiter encapsulation, thereby achieving the purpose of pushing multiple pieces of information and improving the flexibility of information pushing.

[0072] In a fourth aspect, an embodiment of the present application provides a device for pushing information, including:

[0073] A multimedia data playback unit is used to play multimedia data, wherein the audio data of the multimedia data is generated by superimposing the ultrasonic audio signal and the original audio signal of the multimedia, and the ultrasonic audio signal is used to push the information, wherein the information includes: a jump link, a QR code, or an image containing the pushed content, or a combination of one or more of the above, and the ultrasonic audio signal is generated by encoding and modulating the information.

[0074] In a possible implementation manner of the fourth aspect, the audio signal of the multimedia data is generated by superimposing the ultrasonic audio signal and the original audio signal based on first-order complementary coefficients.

[0075] In a possible implementation of the fourth aspect, the signal modulation includes a combination of one or more of amplitude modulation, frequency shift modulation, or phase shift modulation; the binary encoding includes the American Standard Code for Information Interchange (ASCII), the Unicode format conversion (UTF-8), or the Chinese Character Internal Code Extension Specification (GBK).

[0076] In a possible implementation of the fourth aspect, the multimedia data includes first data and second data, and the multimedia data playback unit includes:

[0077] an information determining unit, configured to determine audio data of the second data based on the first data or the instruction voice, wherein the audio data of the second data includes an ultrasonic audio signal corresponding to the information;

[0078] The second data playing unit is configured to play the second data.

[0079] In a possible implementation of the fourth aspect, the information includes first information and second information, and the ultrasonic audio signal includes a first ultrasonic audio signal that pushes the first information and a second ultrasonic audio signal that pushes the second information, wherein the first ultrasonic audio signal and the second ultrasonic audio signal are fused through a delimiter or a time interval to form the ultrasonic audio signal, or the second ultrasonic audio signal has a higher frequency than the first ultrasonic audio signal.

[0080] The target interface corresponding to the information is displayed to determine the information according to the ultrasonic audio signal.

[0081] The information is determined based on the ultrasonic audio signal.

[0082] In a fifth aspect, the present application provides a method for pushing information, applied to a system including a first terminal and a second terminal, the method comprising:

[0083] The first terminal plays multimedia data, wherein audio data of the multimedia data is generated by superimposing the ultrasonic audio signal and the original audio signal of the multimedia, and the ultrasonic audio signal is used to push the information; the information includes: a jump link, a QR code, or an image containing the pushed content, or a combination of one or more of the following: the ultrasonic audio signal is generated by encoding and modulating the information;

[0084] The second terminal receives the audio data of the multimedia data;

[0085] The second terminal obtains the ultrasonic audio signal according to the audio data;

[0086] The second terminal determines the information according to the ultrasonic audio signal;

[0087] The second terminal displays a target interface corresponding to the information, where the target interface is a web page, an application page, a QR code, a picture, or an image containing pushed content.

[0088] In a sixth aspect, the present application provides a push system, the push system comprising a first terminal and a second terminal;

[0089] The first terminal is configured to play multimedia data, wherein audio data of the multimedia data is generated by superimposing the ultrasonic audio signal with an original audio signal of the multimedia data, and the ultrasonic audio signal is used to push the information; the information includes: a jump link, a QR code, or a combination of one or more of an image containing pushed content; and the ultrasonic audio signal is generated by encoding and modulating the information;

[0090] The second terminal is configured to receive the audio data of the multimedia data;

[0091] The second terminal is configured to obtain the ultrasonic audio signal based on the audio data;

[0092] The second terminal is configured to determine the information based on the ultrasonic audio signal;

[0093] The second terminal is used to display a target interface corresponding to the information, where the target interface is a web page, an application page, a QR code, a picture, or an image containing pushed content.

[0094] In a seventh aspect, an embodiment of the present application provides a system for information push, the system comprising a first terminal and a second terminal, and the system is used to execute the method described in the sixth aspect.

[0095] In the eighth aspect, an embodiment of the present application provides an electronic device, comprising: a memory, a processor, and a program stored in the memory, wherein when the processor executes the program, it implements the steps of the method for pushing information described in any one of the first aspects above or implements the steps of the method for pushing information described in any one of the third aspects above.

[0096] In the ninth aspect, an embodiment of the present application provides a readable storage medium, which stores a program. When the program is executed by a processor, it implements the steps of the method for pushing information described in any one of the first aspects or the steps of the method for pushing information described in any one of the third aspects.

[0097] In the tenth aspect, an embodiment of the present application provides a program product. When the program product is run on a device, the device executes the steps of the method for pushing information described in any one of the first aspects or implements the steps of the method for pushing information described in any one of the third aspects.

[0098] It can be understood that the beneficial effects of the second to tenth aspects mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0099] FIG1 is a schematic diagram of the push of existing advertising messages;

[0100] FIG2 is a schematic diagram of an information push system provided by an embodiment of the present application;

[0101] FIG3 is a flow chart of a method for pushing information provided by an embodiment of the present application;

[0102] 4 is a flowchart of the interaction between the first terminal and the second terminal of the method for pushing information provided by an embodiment of the present application;

[0103] FIG5 is a schematic diagram of a function of enabling push information through a settings interface provided by an embodiment of the present application;

[0104] FIG6 is a schematic diagram of a function of enabling push information through a specified gesture provided by an embodiment of the present application;

[0105] 7 is a schematic diagram of another embodiment of the present application to enable the function of pushing information through the setting interface;

[0106] FIG8 is a schematic diagram of a first terminal playing multimedia data according to an embodiment of the present application;

[0107] FIG9 is a schematic diagram of information provided by an embodiment of the present application;

[0108] FIG10 is a schematic diagram of a statically packaged ultrasonic audio device according to an embodiment of the present application;

[0109] FIG11 is a flowchart of an implementation of encapsulating an ultrasonic audio signal into multimedia data according to an embodiment of the present application;

[0110] FIG12 is a schematic diagram of a process for dynamically packaging ultrasonic audio according to an embodiment of the present application;

[0111] FIG13 is a schematic diagram of a multi-information push scenario provided by an embodiment of the present application;

[0112] FIG14 is a schematic diagram of pushing multiple information through ultrasonic audio signals according to an embodiment of the present application;

[0113] FIG15 is a schematic diagram of a process for analyzing an ultrasonic audio signal on a second terminal according to an embodiment of the present application;

[0114] FIG16 is a schematic diagram of a process of extracting an ultrasonic audio signal by a second terminal according to an embodiment of the present application;

[0115] FIG17 is a schematic diagram of a target interface displayed based on a QR code image according to an embodiment of the present application;

[0116] FIG18 is a schematic diagram of an interface displaying multiple different information based on a countdown according to an embodiment of the present application;

[0117] FIG19 is a schematic diagram of displaying multiple different information based on a selection interface according to an embodiment of the present application;

[0118] 20 is a flowchart of the interaction between the first terminal and the second terminal according to another embodiment of the present application of a method for pushing information;

[0119] 21 is a flowchart of an implementation method of pushing information provided by an embodiment of the present application on the second terminal side;

[0120] FIG22 is a structural block diagram of a device for displaying information provided in an embodiment of the present application;

[0121] 23 is a flowchart of an implementation method of pushing information provided by an embodiment of the present application on the first terminal side;

[0122] FIG24 is a structural block diagram of an apparatus for pushing information provided in an embodiment of the present application;

[0123] FIG25 is a schematic structural diagram of an electronic device provided in one embodiment of the present application. DETAILED DESCRIPTION

[0124] In the following description, specific details such as specific system structures and techniques are provided for purposes of illustration rather than limitation to facilitate a thorough understanding of the embodiments of the present application. However, it will be apparent to those skilled in the art that the present application may be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to avoid obscuring the description of the present application with unnecessary detail.

[0125] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, integers, steps, operations, elements and / or components, but does not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or collections thereof.

[0126] It will also be understood that the term "and / or" used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.

[0127] As used in this specification and the appended claims, the term "if" can be interpreted as "when" or "upon" or "in response to determining" or "in response to detecting," depending on the context. Similarly, the phrase "if it is determined" or "if [described condition or event] is detected" can be interpreted as meaning "upon determination" or "in response to determining" or "upon detection of [described condition or event]" or "in response to detecting [described condition or event]," depending on the context.

[0128] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0129] References to "one embodiment" or "some embodiments" in this specification mean that a particular feature, structure, or characteristic described in conjunction with that embodiment is included in one or more embodiments of the present application. Thus, phrases such as "in one embodiment," "in some embodiments," "in other embodiments," and "in other embodiments" appearing in various places in this specification do not necessarily refer to the same embodiment, but rather mean "one or more but not all embodiments," unless otherwise specifically emphasized. The terms "including," "comprising," "having," and variations thereof all mean "including but not limited to," unless otherwise specifically emphasized.

[0130] Existing advertising push technology is generally displayed when an application opens a certain page or a terminal displays a certain operation interface. For example, Figure 1 shows a schematic diagram of the push of existing advertising messages. Referring to (a) in Figure 1, the user can turn on the TV 11 by means of a remote control or voice control, and the TV 11 can switch from the sleep state to the start state after receiving the start operation initiated by the user. Before the TV 11 displays the corresponding main operation interface, a specified advertising message can be pushed, as shown in (b) in Figure 1. The content displayed on the TV 11 is message 12, which realizes the push of advertising information. After the advertising message is played, the corresponding main operation interface will be displayed, as shown in (c) in Figure 1.

[0131] In some scenarios, users can block the push of the above-mentioned advertising information by opening a paid membership. For example, the device supplier corresponding to the TV 11 is enterprise A. The user can open a paid membership of enterprise A and log in as a member on the TV 11. At this time, when the TV 11 is started, it can obtain the service rights of the logged-in user. If the service rights include blocking information, the corresponding advertising message will not be displayed before the TV 11 is started and the corresponding main operation interface is displayed, that is, it directly switches from (a) in Figure 1 to (c) in Figure 1, and the message 12 in (b) in Figure 1 will not be displayed.

[0132] The process of pushing advertising information within an app is similar to the process of pushing messages on a terminal. When a user opens a specific interface within an app, for example, a video player, a related advertisement can be inserted before the video content is displayed. This allows for push notifications. Users can also opt out of receiving push notifications by subscribing to a paid membership in the app.

[0133] However, user needs are often fickle. While users may refuse to receive push notifications in some scenarios, they may still be willing to receive them in others. For example, while watching a video, users may be interested in the costumes of the characters in the video and would like to receive push notifications about related clothing. However, the above approach indiscriminately blocks all push notifications during the paid membership period, preventing users from choosing whether to receive push notifications based on their actual preferences. This approach is inflexible and cannot meet users' push needs in certain scenarios.

[0134] It can be seen from this that the existing advertising push technology is unable to push information when the user is willing to push it, and is unable to block advertising push information when the user does not need it. The flexibility of the push setting is low. In other words, the existing technology cannot flexibly push advertising information without affecting the normal use of the user.

[0135] To address the problems in push information technology, an embodiment of the present application provides a method for pushing information, which can be applied to a push information system. The push information system includes at least two terminals, namely a first terminal capable of playing ultrasonic audio and a second terminal capable of receiving ultrasonic audio. The terminals can be any existing terminal device, such as a smart TV, a smart projector, a smart phone, a laptop, a tablet computer, a desktop computer, and a smartwatch.

[0136] For example, FIG2 shows a schematic diagram of a push information system provided by an embodiment of the present application. Referring to FIG2 , the push information system includes a terminal 21 and a terminal 22 .

[0137] The terminal 21 is a smart TV, which includes a display screen 211 and a speaker 212. The display screen 211 can be used to display a related operation interface (such as a setting interface), as well as video images (such as live TV images) or image data (TV screensavers) in the multimedia data that the user needs to play. The speaker 212 is used to play audio data in the multimedia data. The sound frequency band of the speaker includes the sound frequency band that the human body can receive, such as 20 Hz to 20 kilohertz (kHz) or less, and can also play ultrasonic frequency bands, such as 20 kHz to 44 kHz.

[0138] The terminal 22 is a smartphone, or other portable device that the user can carry with them. The choice can be based on the user's needs. The smartphone includes a display 221 and a microphone 222. The display 221 can also be used to display a target page corresponding to information, such as an advertisement. The microphone 222 is specifically used to receive ultrasonic audio signals from the terminal 21 during multimedia data playback.

[0139] It should be noted that the terminal 21 may be the first terminal in subsequent embodiments, and the terminal 22 may be the second terminal in subsequent embodiments. In other implementation scenarios, the terminal 21 may also be the second terminal in subsequent embodiments, and the terminal 22 may also be the first terminal in subsequent embodiments. The selection of the first terminal and the second terminal is limited here.

[0140] Among them, the first terminal in the embodiment of the present application is specifically a terminal for playing multimedia data carrying ultrasonic audio signals, and the second terminal is specifically a terminal for parsing the received ultrasonic audio signals and displaying the corresponding information page.

[0141] In some implementation scenarios, if the scenario includes multiple different other users, and each user holds a corresponding terminal, then in this scenario, the number of the above-mentioned terminals 22 can be multiple.

[0142] Specifically, FIG3 shows a flow chart of a method for pushing information provided in an embodiment of the present application. The method for pushing information provided in an embodiment of the present application specifically includes three stages: a stage 31 for setting the function of pushing information for the first terminal and / or the second terminal, a stage 32 for playing the ultrasonic audio signal by the first terminal, and a stage 33 for parsing the ultrasonic audio signal and displaying the page corresponding to the information by the second terminal. In other words, it is divided into a preparation stage, a push message propagation stage, and a push message display stage.

[0143] To further illustrate the specific operations performed at each stage, FIG4 shows a flowchart of the interaction between the first terminal and the second terminal in the method for pushing information provided by an embodiment of the present application. In combination with the various stages of the push method, the specific implementation process of the method for pushing information provided by the embodiment of the present application is as follows:

[0144] Phase 1: Setting up the function of pushing information to the first terminal and / or the second terminal

[0145] It should be noted that the various steps in Phase 1 are optional. After the above-mentioned function of the first terminal is turned on, the first terminal can subsequently play multimedia data carrying ultrasonic audio signals, that is, push information to other terminals through ultrasonic audio signals. When the above-mentioned function of the second terminal is turned on, the second terminal can receive information and display the target interface corresponding to the information. For example, the function of pushing information in the first terminal and / or the second terminal can be turned on by default. In this case, the user does not need to perform any operation to turn on the above-mentioned function, and information can be pushed based on ultrasonic audio signals.

[0146] In this embodiment, the above-mentioned setting stage can be performed on the second terminal (i.e., the terminal receiving the ultrasonic audio signal) or on the first terminal (i.e., the terminal playing the ultrasonic audio signal). When performing function setting on the second terminal, the corresponding steps are S401 to S402, and when performing function setting on the first terminal, the corresponding steps are S401' to S402'.

[0147] Case 1: Function settings on the second terminal

[0148] In S401, the user initiates a trigger event for the second terminal.

[0149] In S402, the second terminal starts the function of pushing information in response to the trigger operation, and starts the functional module of parsing the ultrasonic audio signal, where the functional module is used to determine information based on the ultrasonic audio signal.

[0150] In this embodiment, the user can control the opening and closing of the push information function according to the actual push demand. If the user needs to open the push information function, that is, is willing to receive relevant advertising messages, the user can initiate the opening operation of the push information function.

[0151] In this embodiment, because existing terminals are often equipped with microphone modules, and the audio sampling frequency of the microphone modules can reach 44.1kHz, such as 44.1kHz, 44.7kHz, and 98kHz, it is possible for the terminal to receive and recognize ultrasonic audio signals. This embodiment can push information via ultrasonic audio signals, thereby not affecting the user's normal playback of multimedia data. If the user indicates that the information is being pushed, the corresponding interface can be displayed to the user, achieving the purpose of displaying information, increasing the flexibility of displaying advertisements, and improving the user experience.

[0152] In this embodiment, the second terminal can obtain the audio signal in the scene through the microphone module. The frequency band of the audio signal includes the frequency band recognizable by the human ear (i.e., audio signals below 20kHz) and the ultrasonic frequency band (i.e., audio signals above 20kHz). In the prior art, the terminal does not perform additional analysis on the signal in the ultrasonic frequency band, that is, it only receives and does not perform additional processing. In this embodiment, when the user turns on the information display function, the second terminal can start the corresponding functional module (such as the high-pass filter module), and then perform special analysis operations on the signal in the ultrasonic frequency band from the audio signal received by the microphone module, so that when the audio signal is superimposed with the ultrasonic audio signal, the target page corresponding to the information can be displayed.

[0153] In some implementations, the methods for enabling the push function on the second terminal include at least the following three:

[0154] Method 1: Enable the function through the settings interface in the second terminal

[0155] For example, FIG5 shows a schematic diagram of a function of enabling push information through a setting interface provided by an embodiment of the present application. Referring to FIG5 (a), the second terminal may be a smart phone, and a corresponding setting icon 51 is provided in the main interface of the smart phone. The user can enter the setting interface of the smart phone by clicking the above-mentioned setting icon 51, as shown in FIG5 (b). FIG5 (b) includes a setting control 52 for other functions, and the user can enter the setting interface of other functions by clicking the above-mentioned setting control 52, as shown in FIG5 (c). In the setting interface of other functions, a switch control 53 for the function of ultrasonic advertising push is included. When the user needs to enable ultrasonic advertising push, he can click the above-mentioned switch control 53 to set the above-mentioned ultrasonic advertising push function to the on state, as shown in FIG5 (d).

[0156] In some implementations, in addition to providing a corresponding ultrasonic advertising push switch control (such as the aforementioned switch control 53) in the operating system of the second terminal, each application can also be provided with an independent push function switch control. The user can click on or off the corresponding push information function through the application settings interface within the application. For example, if a video playback application and an online shopping application are installed in the second terminal, the corresponding push advertising function can be enabled through the application settings interface of the video playback application and the application settings interface of the online shopping application.

[0157] Method 2: Enable the function by issuing a voice command to the second terminal

[0158] The second terminal may be configured with a microphone module. The microphone module on the second terminal may be used to receive voice commands initiated by the user. For example, the user may control the second terminal to open the corresponding operation interface, i.e., the settings interface mentioned in the voice command, by issuing a voice command of "open the settings interface." Correspondingly, the user may control the second terminal to set the state of the above-mentioned advertising push function to the on state by issuing a voice command of "turn on the advertising push function." The content of the specific voice command may be set according to the actual situation, and the content of the voice command is not limited here.

[0159] In some implementations, the user can issue a voice command of "turn on the advertising push function" when the second terminal is in any operation interface to control the second terminal to set the status of the above-mentioned advertising push function to the on state. At this time, a floating box message of "The advertising push function is turned on" can be displayed on the second terminal to prompt the user that the voice operation has been completed.

[0160] Method 3: Enable the function by initiating a specified gesture operation on the second terminal

[0161] Exemplarily, FIG6 shows a schematic diagram of a function of enabling push information through a specified gesture provided by an embodiment of the present application. Referring to FIG6 (a), the second terminal may be a smart phone, which is provided with a touch screen, and the touch screen may receive touch operations initiated by the user. For example, the sliding trajectory corresponding to the above-mentioned function of enabling advertisement push is a circle. If the second terminal detects a sliding trajectory initiated by the user on the touch screen, such as a track 61 that matches the sliding trajectory corresponding to the function of enabling advertisement push, it identifies that the user needs to enable the function of pushing information, and generates a corresponding prompt message 62, namely, "the ultrasonic advertisement push function is enabled", as shown in FIG6 (b), to prompt the user of this gesture operation.

[0162] In some implementations, if a user does not wish to receive any push notifications, while the push function is enabled on the second terminal, the user can initiate a corresponding push notification function deactivation operation to disable the aforementioned push notification function. Specifically, deactivating the aforementioned push notification function is similar to enabling it. For details, please refer to the description of the enabling function process and will not be repeated here.

[0163] Case 2: Function settings on the first terminal

[0164] In S401', the user initiates a push start operation on the first terminal.

[0165] In S402', the first terminal responds to the push start operation initiated by the user and starts the function of pushing information based on the ultrasonic audio signal.

[0166] In this embodiment, the user can also set whether to enable the push information function on the first terminal. Since the multimedia data carrying the ultrasonic audio signal is played through the first terminal, if the first terminal blocks the playback of the ultrasonic audio signal, the purpose of disabling the push information function can be achieved.

[0167] In some implementations, the ultrasonic audio signal may be encapsulated within the multimedia data by the provider of the multimedia data. In this case, if the first terminal has disabled the push function for the advertisement message, the first terminal may filter the audio data within the multimedia data using an ultrasonic audio filter, thereby not playing the ultrasonic audio signal within the multimedia data, thereby disabling the function of pushing information based on the ultrasonic audio signal.

[0168] In some implementations, the ultrasonic audio signal may be encapsulated within multimedia data by the first terminal. In this case, if the first terminal has disabled the push information function, the first terminal may not superimpose the ultrasonic audio signal with the original audio signal of the multimedia data. That is, the multimedia data played will not include the ultrasonic audio signal, thereby disabling the push information function.

[0169] In some implementations, the methods for enabling the push function on the first terminal include at least the following two:

[0170] Method 1: Enable the function through the settings interface in the first terminal

[0171] For example, FIG7 shows a schematic diagram of a function of enabling push information through a setting interface provided by another embodiment of the present application. Referring to FIG7 (a), the second terminal may be a smart TV, which may display a corresponding main operation interface after startup. The main operation interface may display multiple function controls in the smart TV, and the user may select an operation object by controlling a cursor 71 in the main operation interface. A setting control 72 is displayed in the above-mentioned main operation interface, and the user may move the cursor 71 to the position of the above-mentioned control 72 and click the confirmation button in the remote control to enter the setting interface of the smart TV, as shown in FIG7 (b).

[0172] In some implementations, in addition to controlling the cursor movement through a remote control, you can also use voice commands, such as saying "enter the settings interface", to switch to the above-mentioned settings interface.

[0173] In the setting interface of the smart TV, there is a setting control 73 for the push function of advertising messages. The user can move the cursor 71 to the above-mentioned setting control 73 through the remote control to adjust the on / off state of the push function, as shown in (b) in Figure 7. At this time, the push function of advertising messages is in the off state. If the user moves the cursor 71 to the position of the above-mentioned setting control 73 and clicks the confirmation button on the remote control, the push function of advertising messages can be adjusted from the off state to the on state, as shown in (c) in Figure 7.

[0174] Method 2: Enable the function by issuing a voice command to the second terminal

[0175] The first terminal may be configured with a microphone module. The microphone module on the first terminal may be used to receive voice commands initiated by the user. For example, the user may control the first terminal to open the corresponding operation interface, i.e., the settings interface mentioned in the voice command, by issuing a voice command of "open the settings interface." Correspondingly, the user may control the first terminal to set the state of the above-mentioned push information function to be turned on by issuing a voice command of "turn on the advertising push function." The content of the specific voice command may be set according to actual conditions, and the content of the voice command is not limited here.

[0176] In some implementations, the user can issue a voice command of "turn on the advertising push function" when the first terminal is in any interface, and control the second terminal to set the status of the above-mentioned push information function to be on. At this time, a floating box message of "Advertising push function is turned on" can be displayed on the first terminal to prompt the user that the voice operation has been completed.

[0177] In an embodiment of the present application, the user can adjust the on / off status of the push information function according to actual push needs, thereby improving the flexibility of push information and avoiding the situation where the user cannot receive any advertising push messages because the user has activated the relevant paid membership.

[0178] Phase 2: The first terminal plays the ultrasonic audio signal

[0179] In S403, the first terminal responds to the play instruction initiated by the user and obtains multimedia data corresponding to the play instruction and carrying the ultrasonic audio signal; the ultrasonic audio signal is used for information.

[0180] In this embodiment, the user can play specified multimedia data, such as video, music or screen saver, through the first terminal, wherein the multimedia data includes audio data and video data. For example, FIG8 shows a schematic diagram of the first terminal playing multimedia data provided by an embodiment of the present application. Taking the first terminal as a smart TV as an example, the user can play a specified video through the smart TV, or watch live TV. Referring to (a) in FIG8 , at this time, the smart TV can display multiple playable video files, such as video 81. The user can select the video file to be played from the above-mentioned multiple playable video files, that is, initiate a play instruction for the corresponding video file to the first terminal. For example, the user moves the cursor to the position of the above-mentioned video 81 and clicks to confirm, and a play instruction for video 81 will be generated. When the smart TV receives the play instruction for video 81, it can obtain the video data corresponding to video 81 (that is, the above-mentioned multimedia data), and after obtaining the video data, play the corresponding video data, as shown in (b) in FIG8 .

[0181] The multimedia data may be obtained through a server corresponding to a video website, downloaded from the Internet, or obtained through an external memory inserted into the first terminal; the multimedia data may also be multimedia data stored in an internal memory of the first terminal. The method of obtaining the multimedia data is not limited here.

[0182] In this embodiment, multimedia data carries an ultrasonic audio signal. This ultrasonic audio signal can be received by another terminal (such as a second terminal) when the multimedia data is played. Based on the information corresponding to the ultrasonic audio signal, a target interface corresponding to the information is displayed on the second terminal, thereby achieving the purpose of displaying relevant information on the other terminal. The ultrasonic audio signal is generated based on the information. Therefore, after parsing the ultrasonic audio signal, the other terminal (such as the second terminal) can extract the corresponding information and then display the corresponding target interface based on the information.

[0183] In some implementations, the above information may be a jump link, a QR code, or an image containing the push content to be pushed, or a combination of one or more of the above.

[0184] The jump link can be a uniform resource locator (URL) or the network address corresponding to the page. The jump link can also be a link used to activate an application on the second terminal. For example, if the pushed content is a product, the jump link is used to activate an online shopping application on the second terminal and display the purchase page corresponding to the product within the online shopping application. That is, the jump link is the URL corresponding to the purchase page of the product.

[0185] The above-mentioned QR code is used to display a target interface containing the pushed content on a terminal that scans the QR code. Exemplarily, the QR code can be generated based on a URL corresponding to the target interface.

[0186] The above-mentioned image containing push content is specifically an image that allows the user to directly understand the specific push object, such as an image containing a product to be pushed. For example, Figure 9 shows a schematic diagram of information provided by an embodiment of the present application. Referring to Figure 9 (a), the push content is a product, such as clothing, and the information specifically includes an image of the clothing to be pushed.

[0187] In some implementations, the above information may include multiple different types of data. As shown in (b) in Figure 9, the information is a combination of an image containing the pushed content and a QR code. The data type of the information is not limited here. Any data that can achieve the purpose of the information can be applied to the solution of this embodiment.

[0188] In this embodiment, the ultrasonic audio signal is encapsulated in multimedia data in at least two ways:

[0189] Method 1: Static encapsulation of ultrasonic audio signals

[0190] In this embodiment, the ultrasonic audio signal encapsulated in the multimedia data can be generated based on specified information. In this case, the execution subject of the above-mentioned encapsulation of the ultrasonic audio signal in the multimedia data can be the server of the provider of the multimedia data, or it can be the first terminal. When the ultrasonic audio signal is encapsulated in this way, the ultrasonic audio signal has been superimposed on the original audio signal of the multimedia data before the first terminal plays the multimedia data. Since the ultrasonic audio signal and the original audio signal of the multimedia data are in different frequency bands, the original audio signal can be normally received by the user during the process of the first terminal playing the multimedia data, and the ultrasonic audio signal in the multimedia data can also be received by the second terminal, thereby achieving the two purposes of the user playing the multimedia data normally and pushing information.

[0191] For example, FIG10 shows a schematic diagram of statically encapsulated ultrasonic audio provided by an embodiment of the present application. Referring to FIG10 (a), the encapsulation process can be performed by the provider of multimedia data (such as a server of a video playback application), and the server can push information corresponding to the content (such as product 101) as needed, generate a corresponding ultrasonic audio signal 102, and encapsulate the ultrasonic audio signal 102 into one of the video data (such as the video file 103 of the first episode of a TV series). The video file 103 encapsulating the ultrasonic audio signal 102 can be stored in the server. When the user plays the first episode of the TV series on the first terminal, the video file 103 encapsulating the ultrasonic audio signal 102 can be downloaded from the server. Among them, the first terminal can store the above-mentioned video file 103 locally, and when the video file 103 is played again later, the video file 103 can be directly obtained from the local memory without downloading again.

[0192] As shown in FIG10( b ), the encapsulation process can also be performed by the first terminal, which obtains the video file 104, for example, by downloading it from a server, reading it from a local memory, or reading it from an external memory. After obtaining the video file 104, the first terminal can superimpose the ultrasonic audio signal 106 corresponding to the product 105 with the original audio signal of the video file 104, thereby obtaining a video file 107 that encapsulates the ultrasonic audio signal 106. Similarly, after the first terminal generates the video file 107, it can store the video file 107 locally. When the video file 107 is subsequently played again, the video file 107 can be directly obtained from the local memory without the need for resynthesis. The storage method of the multimedia data that encapsulates the ultrasonic audio signal is not limited herein.

[0193] In one possible implementation, FIG11 shows a flowchart for encapsulating an ultrasonic audio signal in multimedia data according to an embodiment of the present application. It should be noted that the execution subject of this embodiment is the device corresponding to the multimedia data provider, such as a server of a video platform, a server of a live broadcast platform, etc., or the first terminal. Referring to FIG11 , the process of generating multimedia data carrying an ultrasonic audio signal may specifically include the following steps:

[0194] In S1101, the information is binary-encoded to obtain coded data corresponding to the information.

[0195] In this embodiment, after determining the information corresponding to the desired push content, such as the jump link corresponding to the desired push product, or a QR code image, the information can be encoded. Since the information is generally based on a combination of characters (such as a URL is a combination of English characters and punctuation marks), or image data, the above-mentioned types of data cannot be directly transmitted via analog signals (i.e., ultrasonic audio signals). The information needs to be binary encoded, that is, represented by 0s and 1s. Therefore, after determining the information, the information can be encoded using a preset binary code to obtain the encoded data corresponding to the information.

[0196] In some implementations, the binary encoding includes: American Standard Code for Information Interchange (ASCII), Unicode-8 (UTF-8), or Chinese Character Internal Code Extensions (GBK).

[0197] In some implementations, after the encoded data is generated, the encoded data based on binary representation can be converted into a corresponding step signal, such as signal 1 in FIG. 11 , so as to subsequently generate a corresponding ultrasonic audio signal.

[0198] In S1102 , the encoded data is modulated to generate an ultrasonic audio signal.

[0199] In this embodiment, the encoded data is converted into an ultrasonic audio signal in the ultrasonic frequency band through a preset signal modulation method, that is, the digital signal is converted into a corresponding analog signal for subsequent signal fusion with the original audio signal of the multimedia data.

[0200] In some implementations, the signal modulation method includes: a combination of one or more of amplitude modulation, frequency shift modulation, or phase shift modulation. For example, in the case of frequency shift modulation, a transmission frequency band corresponding to an ultrasonic audio signal is determined, such as 22kHz to 44kHz, and a carrier signal in the frequency band is generated. The encoded data is transmitted via the carrier signal in the frequency band, i.e., the encoded data is modulated with the carrier signal in the frequency band, such as by using binary frequency modulation (2Frequency Shift Keying, 2FSK), thereby obtaining an ultrasonic audio signal in the ultrasonic frequency band, such as signal 2 in FIG11 .

[0201] In S1103 , the original audio signal of the multimedia data is superimposed on the ultrasonic audio signal to obtain the audio data of the multimedia data.

[0202] In this embodiment, the original audio signal of the multimedia data is used for listening by the user. Therefore, the signal frequency of the original audio signal is within the frequency range audible to the human ear, that is, below 22kHz; and the signal frequency of the ultrasonic audio signal generated based on the encoded data is in the ultrasonic frequency band, that is, above 22kHz. Therefore, the two audio signals in different frequency bands can be superimposed to obtain the audio data of the corresponding multimedia data.

[0203] In some implementations, the original audio signal and the ultrasonic audio signal can be superimposed in a first-order complementary manner. The first-order complementary coefficient is Alpha, and the audio data of the multimedia data can be expressed as: AudioMix = (1-Alpha)*Audio+Alpha*UltraSound

[0204] Among them, the above-mentioned AudioMix is ​​audio data, that is, signal 4 in Figure 11, Audio is the original audio signal, that is, signal 3 in Figure 11, and UltraSound is the ultrasonic audio signal, that is, signal 2 in Figure 11.

[0205] In an embodiment of the present application, the purpose of multimedia data carrying ultrasonic audio signals is achieved by converting information into corresponding ultrasonic audio signals in advance and superimposing the ultrasonic audio signals with the original audio signals of the multimedia data. Since the above operations do not need to be performed before playing the multimedia data, the data processing pressure on the first terminal is reduced, and the encapsulation operation of the ultrasonic audio signal is completed before playback, thereby reducing the playback delay caused by the encapsulation of the ultrasonic audio signal and improving the smoothness of the multimedia data playback.

[0206] Method 2: Dynamically encapsulate ultrasonic audio signals

[0207] In this embodiment, the encapsulation process of the ultrasonic audio signal can be completed during the playback of multimedia data, that is, the ultrasonic audio signal converted from information is superimposed in real time on the original audio signal of the multimedia data being played, so that the audio data of the multimedia data being played carries the ultrasonic audio signal. The above process can be completed by the provider of the multimedia data (such as the server of the multimedia data) or by the first terminal. For example, if the multimedia data is a live video data, in this case, the server of the live broadcast platform can encapsulate the ultrasonic audio signal in the live video data in real time, or the first terminal can encapsulate the ultrasonic audio signal in the live video data after receiving the live video data sent by the server of the live broadcast platform, thereby achieving the purpose of dynamically encapsulating the ultrasonic audio signal.

[0208] For example, FIG12 shows a schematic diagram of a process for dynamically packaging ultrasonic audio signals according to an embodiment of the present application. Referring to FIG12 , the process for dynamically packaging ultrasonic audio signals specifically includes the following steps, which are described in detail as follows:

[0209] In S1201 , a push keyword is determined based on a played data segment in the multimedia data or an instruction voice initiated by the user.

[0210] In this embodiment, the multimedia data is played over a period of time. For example, the multimedia data is a video, which may be one hour long. The video content at each moment generally has contextual relevance. Therefore, based on the previously played data segment (i.e., the previous content) in the multimedia data, content prediction (i.e., the next content) can be performed for the currently played data segment and the subsequently played data segment. The corresponding push keyword is determined based on the predicted next content, so that corresponding information can be pushed in real time when the related content is subsequently played, thereby improving the timeliness and accuracy of the pushed information.

[0211] In some implementations, the first terminal or server may store a learning model, and import the played data segments in the multimedia data into the above learning model, which can be used to predict the currently playing video content, that is, to predict the playback content at subsequent moments, and determine the corresponding push keywords based on the playback content at subsequent moments.

[0212] In some implementations, the first terminal or server can set a corresponding reference duration, such as 1 to 3 minutes, and predict the push keyword corresponding to the current moment based on the played data segment within 1 to 3 minutes before the current moment. For example, if the content contained in the played data segment includes: "Your hair is so beautiful?", it can be predicted that the subsequent video content may be about the shampoo used by "you" in the video or the hair dye used by "you" in the video, and the corresponding push keywords may be "shampoo" and "hair dye"; for another example, if the content contained in the played data segment includes: "Today's sun is so sunny!", it can be predicted that the subsequent video content may be about "you" applying sunscreen, and the corresponding push keyword may be "sunscreen". Similarly, based on the text content of the played data segment, the subsequent content is predicted, and the keywords corresponding to the predicted content are determined, and the keywords of the predicted content are used as the above-mentioned push keywords.

[0213] In some implementations, the first terminal can receive a user's voice prompt, determine a corresponding push keyword from the prompt, and then generate a corresponding ultrasonic audio signal in real time based on the user's prompt. For example, if a user says "what beautiful clothes" while watching a video, the first terminal will extract the push keyword "clothes" and generate an ultrasonic audio signal based on the purchase link for the clothes, thereby pushing the content that the user is interested in.

[0214] In S1202 , based on the push keyword, push content corresponding to the push keyword is determined.

[0215] In this embodiment, the first terminal or server stores an information library containing a plurality of candidate content items that can be pushed. Each candidate content item may correspond to one or more content keywords. Based on the played data segments, subsequent content items are predicted. Once the corresponding push keywords are obtained, the push keywords are matched with the content keywords associated with each candidate content item. The candidate content items that match the push keywords are selected as the pushed content items.

[0216] For example, the information library is a product library that can be pushed, and each candidate content corresponds to a product, such as shampoo, sunscreen, shirts, pants, etc. Each product corresponds to at least one content keyword. For example, the content keywords corresponding to shampoo (i.e., product A) may be "shampoo," "shampoo," "Shampoo," etc.; while the content keywords corresponding to sunscreen (i.e., product B) may be "sunscreen," "sun protection," "SPF (Sun Protection Factor)," etc. If the push keyword is "shampoo," shampoo can be used as the pushed content.

[0217] In S1203, information corresponding to the pushed content is obtained.

[0218] In this embodiment, the information library can also record information corresponding to different candidate contents, such as corresponding URLs. After determining the push content, the first terminal can obtain information corresponding to the push content from the information library, such as the purchase link corresponding to shampoo, a QR code image for jumping to the purchase page of shampoo, and an image displaying shampoo.

[0219] In S1204, the information is binary-encoded to obtain encoded data.

[0220] In S1205 , the encoded data is modulated to generate an ultrasonic audio signal.

[0221] In S1206 , the original audio signal of the multimedia data and the ultrasonic audio signal are superimposed to obtain audio data of the multimedia data.

[0222] In this embodiment, the process of the first terminal generating an ultrasonic audio signal and the process of superimposing the ultrasonic audio signal with the original audio signal of the multimedia data are exactly the same as the process implemented by the server in method 1, that is, the implementation process of S1204 to S1206 is exactly the same as the process of S1101 to S1103. For specific descriptions, please refer to the relevant descriptions in method 1 and will not be repeated here.

[0223] In an embodiment of the present application, the first terminal can determine in real time during the process of playing multimedia data the information corresponding to the currently playing content or the instruction voice initiated by the user, and encapsulate the ultrasonic audio signal generated based on the information in the currently playing multimedia data, thereby enabling flexible push of information, improving the flexibility of pushing information, and not relying on the provider of multimedia data to encapsulate the ultrasonic audio signal. The first terminal can encapsulate the ultrasonic audio signal for all multimedia data played locally, further improving the scope of application of advertising push based on ultrasonic audio signals.

[0224] The above describes the specific implementation process of encapsulating a piece of information in multimedia data. In some implementations, the number of pieces of information can be multiple. For example, FIG13 shows a schematic diagram of a push scenario of multiple information provided by an embodiment of the present application. Referring to FIG13 , the clothing worn by the character in the video includes: a top, a skirt, and a hat. Each piece of clothing corresponds to a product. Therefore, the screen corresponds to multiple products that need to be pushed, and different products correspond to a purchase link. In this case, multimedia data can push multiple pieces of information through ultrasonic audio signals.

[0225] For example, FIG14 shows a schematic diagram of an embodiment of the present application for implementing the push of multiple information through ultrasonic audio signals. Referring to FIG14 , in the push scenario of multiple information, the specific implementation methods may include at least the following three:

[0226] Method A: Time-sharing push

[0227] Different pushed content corresponds to different information, such as different URLs. Different information is binary-encoded and signal-modulated, respectively, to obtain ultrasonic audio signals corresponding to different information, as shown in (a) of FIG14 . When superimposing the ultrasonic audio signal with the original audio signal of the multimedia data, the ultrasonic audio signal can be sequentially superimposed with each signal segment in the original audio signal according to the signal length of each ultrasonic audio signal and a preset time interval. For example, the ultrasonic audio signal corresponding to product 1 (i.e., signal 1) is superimposed with signal segment A in the original audio signal of the multimedia data, while the ultrasonic audio signal corresponding to product 2 (i.e., signal 2) is superimposed with signal segment B in the original audio signal, and the ultrasonic audio signal corresponding to product 3 (i.e., signal 3) is superimposed with the new segment C in the original audio signal. Similarly, different ultrasonic audio signals are superimposed with a certain signal segment in the original audio signal in a time-sharing manner, thereby achieving the purpose of pushing multiple information to the user.

[0228] Method B: Frequency push

[0229] Similar to method A, different information can correspond to different ultrasonic audio signals. Unlike method A, the frequency of the ultrasonic carrier used when modulating the information is different. For example, the frequency of the ultrasonic carrier corresponding to product 1 is 22kHz, the frequency of the ultrasonic carrier corresponding to product 2 is 44kHz, and the frequency of the ultrasonic carrier corresponding to product 3 is 90kHz. Therefore, although the frequencies of the ultrasonic audio signals generated based on the information of each product are all in the ultrasonic audio band, the frequencies of the various ultrasonic audio signals do not overlap, as shown in (b) in Figure 14. In this case, multiple ultrasonic audio signals in different frequency bands can be superimposed on the same signal segment in the original audio signal of the multimedia data, so that when the signal segment corresponding to the multimedia data is played, multiple different information can be pushed at the same time, realizing the simultaneous push of multiple advertising information.

[0230] Method C: Integrated push based on page

[0231] Unlike Methods A and B, when multiple different pushed content corresponds to different information, the multiple pieces of information can be first encapsulated to obtain fused data that incorporates the multiple pieces of information. For example, as shown in (c) of FIG14 , different products correspond to one URL. The URLs of the multiple products can be displayed on the same page, i.e., Page 1. This Page 1 is used as the fused data that incorporates the multiple pieces of information. The fused data is binary-encoded to obtain the encoded data corresponding to the fused data. The encoded data of the fused data is then modulated to obtain the ultrasonic audio signal corresponding to the fused data. The ultrasonic audio signal is then superimposed with the original audio signal. This allows the page containing the multiple product URLs to be displayed on other devices when the multimedia data is subsequently played. Users can click on the corresponding URL to display the product of interest based on actual needs.

[0232] Method D: Fusion push based on separators

[0233] Unlike methods A and B, when multiple different push contents correspond to different information, the multiple information can be fused together using a separator to obtain a fused data containing multiple information. For example, the jump link corresponding to product 1 is URL1, and the jump link corresponding to product 2 is URL2. The two jump links can be fused together using the preset separator ";", thus obtaining the fused data of "URL1; URL2". The encoded data of the fused data is modulated to obtain the ultrasonic audio signal corresponding to the fused data. The ultrasonic audio signal is then superimposed on the original audio signal, so that when the multimedia data is subsequently played, the target interface corresponding to the multiple information can be displayed on other devices.

[0234] In some possible implementations, if the information is a jump link and the domain name of multiple pieces of information is the same, when merging the multiple pieces of information based on the separator, the domain name of some of the information can be omitted, that is, only the area of ​​the interface identifier is retained. For example, the jump link corresponding to product 1 is: www.xxx.com / 1, and the jump link corresponding to product 2 is: www.xxx.com / 2. When merging these two jump links, the domain names can be merged, retaining the interface identifiers " / 1" and " / 2". The corresponding fused data is www.xxx.com / 1; / 2.

[0235] In the embodiment of the present application, when multiple messages need to be pushed, a corresponding method can be selected according to the actual situation to generate a corresponding ultrasonic audio signal, which is then superimposed with the original audio signal of the multimedia data, thereby improving the flexibility of pushing information. It should be noted that the encapsulation of the ultrasonic audio signal of the above-mentioned multiple messages can be performed by the provider of the multimedia data or by the first terminal, and the execution entity of the encapsulation is not limited here.

[0236] In S404, the first terminal plays the multimedia data carrying the ultrasonic audio signal.

[0237] In this embodiment, after the first terminal obtains the multimedia data that the user needs to play, it can play the multimedia data. The multimedia data includes video data and audio data. The video data is played through the display screen of the first terminal, and at the same time, the audio data is played through the speaker of the first terminal. Since the audio data of the multimedia data is generated by superimposing the ultrasonic audio signal and the original audio signal, and the two audio signals are in different frequency bands, when the audio data of the multimedia data is played through the speaker, the original audio signal can be heard normally by the human ear, while the frequency band of the ultrasonic audio signal is outside the hearing range of the human ear. Therefore, the user will not be aware of the existence of the ultrasonic audio signal; the microphone of the other terminal (such as the second terminal) can receive the ultrasonic audio signal, and then the information can be displayed on the other terminal to achieve the purpose of pushing information.

[0238] Phase 3: The second terminal analyzes the ultrasonic audio signal and displays the corresponding interface of the information

[0239] In S405 , the second terminal receives the audio signal of the multimedia data, and acquires information from the ultrasonic audio signal in the audio data of the multimedia data.

[0240] In this embodiment, a microphone module is configured in the second terminal, and the audio signal in the scene can be received through the microphone module. Since the sampling frequency of the microphone module is generally greater than 40kHz, that is, the collected audio signal includes a signal in the frequency band that can be received by the human ear, and a signal in the ultrasonic frequency band. Therefore, when the audio data of the multimedia data played by the first terminal is integrated with the ultrasonic audio signal, the second terminal can receive the audio data of the multimedia data through the microphone module. The audio data is generated based on the superposition of the original audio signal of the multimedia data and the ultrasonic audio signal. Therefore, by performing signal separation on the audio data of the above multimedia data, the ultrasonic audio signal in the ultrasonic frequency band can be extracted.

[0241] In some implementations, when the function of pushing information is turned off, although the audio data received by the microphone module includes signals in the ultrasonic frequency band, it does not perform additional processing on this frequency band, that is, the ultrasonic audio signal is not parsed; on the contrary, when the function of pushing information is turned on, the ultrasonic audio signal can be extracted from the audio data of the multimedia data and the ultrasonic audio signal can be parsed.

[0242] In this embodiment, since the ultrasonic audio signal is generated by modulating and demodulating the binary coded data corresponding to the information, the second terminal can restore the information from the ultrasonic audio signal through corresponding inverse processing, and then can display the target interface corresponding to the information on the second terminal based on the information.

[0243] For example, FIG15 shows a schematic diagram of a process for parsing ultrasonic audio signals on a second terminal according to an embodiment of the present application. Referring to FIG15(a), the second terminal may be a smartphone. After the user turns on the ultrasonic advertising push function in the smartphone, the smartphone enters the ultrasonic advertising receiving interface, as shown in FIG15(b). At this point, the smartphone receives the audio signal in the scene and, if the audio signal contains an ultrasonic audio signal, attempts to parse the corresponding information. If the ultrasonic audio signal contains information, the subsequent steps may be executed.

[0244] In some implementations, FIG16 shows a schematic diagram of a process for extracting an ultrasonic audio signal by a second terminal according to an embodiment of the present application. Referring to FIG16 , the steps of extracting an ultrasonic audio signal in this embodiment include: S1601 to S1603 , and the specific implementation process is as follows:

[0245] In S1601, the second terminal performs high-pass filtering on the audio signal of the multimedia data to obtain an ultrasonic audio signal.

[0246] In this embodiment, the second terminal can be configured with a high-pass filtering module, which is specifically used to filter audio signals below 20kHz and retain signals in the ultrasonic frequency band. That is, the corresponding ultrasonic audio signal can be obtained through high-pass filtering, such as filtering the corresponding signal 162 from the signal 161 in Figure 16.

[0247] In S1602, the second terminal modulates and demodulates the ultrasonic audio signal to obtain binary coded data corresponding to the information.

[0248] In this embodiment, after separating the ultrasonic audio signal in the ultrasonic frequency band from the audio signal of the multimedia data, the second terminal can convert the ultrasonic audio signal into a corresponding binary coded signal using a corresponding modulation and demodulation method. The modulation and demodulation method used can be determined based on the signal modulation method of the ultrasonic audio signal.

[0249] In some implementations, if the ultrasonic audio signal is generated by frequency shift modulation, the second terminal can obtain a binary coded signal by frequency shift demodulation, such as signal 163 in Figure 16; if the ultrasonic audio signal is generated by amplitude modulation, the second terminal can obtain a binary coded signal by amplitude demodulation.

[0250] In this embodiment, after converting the ultrasonic audio signal into a corresponding binary coded signal, the second terminal can use a threshold judgment method, for example, identifying the area with an amplitude greater than 1 as 1 and identifying the area with an amplitude less than 0 as 0, thereby obtaining binary coded data based on a combination of 1 and 0, that is, data 164 in Figure 16.

[0251] In S1603, the second terminal converts the binary coded data into information using a preset binary coding decoding rule.

[0252] In this embodiment, the second terminal can convert the binary encoded data into information using agreed binary decoding rules, such as restoring it to a corresponding jump link (such as a URL), a QR code, or an image containing pushed content. For example, if the information in the ultrasonic audio signal is converted from a URL into binary encoded data using the ASCII encoding rules, the second terminal can restore the binary encoded data to the corresponding URL using the ASCII decoding rules.

[0253] In an embodiment of the present application, the second terminal can extract the ultrasonic audio signal from the audio signal of the multimedia data through the inverse process corresponding to the first terminal, and convert the ultrasonic audio signal into corresponding information, so as to restore the information from the sound signal, making it possible to push advertisements through the ultrasonic audio signal, and improving the flexibility of pushing information.

[0254] In S407, the second terminal displays the target interface corresponding to the information.

[0255] In this embodiment, after receiving the information, the second terminal can locate the interface containing the pushed content based on the information and display the aforementioned target interface on the second terminal to achieve the purpose of pushing the pushed content to the user holding the second terminal. For example, referring to Figure 15 again, after the smartphone receives the ultrasonic audio signal and restores the corresponding information, it can display the interface containing the pushed content based on the information, as shown in Figure 15 (c).

[0256] In some implementations, if the information is a URL, the second terminal can display the corresponding web interface via the URL through a local browser application. Alternatively, the URL may be an interface for navigating to a specific application. In this case, the second terminal can launch the application corresponding to the URL and display the corresponding application interface within the application, such as launching an online shopping application and displaying the corresponding product purchase interface within the online shopping application, allowing the user to purchase the product directly within the product purchase interface.

[0257] In some implementations, if the above information is a QR code, the second terminal can parse the QR code image in the background and directly display the interface corresponding to the QR code through a browser application or other locally installed applications.

[0258] In some implementations, the second terminal may also directly display the QR code and determine whether it is necessary to jump to the interface corresponding to the QR code image based on the user's operation. Figure 17 shows a schematic diagram of a target interface displayed based on a QR code image according to an embodiment of the present application. Referring to (a) in Figure 17, after the second terminal obtains the QR code image through ultrasonic audio signal analysis, it can be displayed on the second terminal. The user can long press the QR code image to call up the corresponding operation menu, as shown in (b) in Figure 17. The operation menu includes: a control for saving the image, a control 171 for scanning the QR code (i.e., initiating an identification operation), and a control for forwarding the image. If the user needs to display the target message, the user can click the above-mentioned control 171 for scanning the QR code, and an interface containing the target message will be displayed, as shown in (c) in Figure 17.

[0259] In some implementations, if the information is an image containing pushed content, the second terminal stores the image containing the pushed content in a local photo album application, and displays the image containing the pushed content through the photo album application.

[0260] In some implementations, before S407, the process further includes:

[0261] In S406, the second terminal obtains the current usage status.

[0262] In this embodiment, the second terminal can determine whether to display the information based on the current terminal usage status. If the second terminal is in use, that is, the current user is operating the second terminal, the second terminal can perform the operation of S407. Correspondingly, S407 can specifically be: when the second terminal is in a preset state, the second terminal displays information corresponding to the information based on the information.

[0263] In this embodiment, the aforementioned preset states include: the display module being in a bright screen state, the device being unlocked, the device being held, and the user being attentive to the device. Specifically, the bright screen state can be determined by the on / off state of the display module on the second terminal; the held state can be determined by the sensing value fed back by the motion sensor of the second terminal; and the user being attentive to the device can be determined by capturing a facial image of the user via the front camera of the second terminal.

[0264] In some implementations, after S406, the second terminal may further include: when the second state is in a standby state, the second terminal does not display the target page corresponding to the information. The standby state includes: the display module is in an off state, the device is in a locked state, the device is in an unheld state, and the user is not looking at the device.

[0265] In an embodiment of the present application, before determining whether the target page needs to be displayed, the current usage status of the second terminal can be obtained. The target page is displayed only when the second terminal is in use, thereby improving the effectiveness of the display and reducing invalid displays.

[0266] In some implementations, the first terminal may push multiple messages. The second terminal may determine different messages based on how the multiple messages are packaged, thereby displaying the target interface corresponding to the multiple messages. Similar to how the first terminal packages multiple messages, the second terminal may obtain multiple messages in the following four ways:

[0267] Method A: Obtain multiple information in a time-sharing manner

[0268] In this embodiment, the second terminal may separate the audio data of the multimedia data according to a preset time interval, thereby obtaining a plurality of different audio segments, and analyze the ultrasonic signals in the different audio segments respectively to obtain a plurality of information.

[0269] Method B: Frequency division to obtain multiple information

[0270] In this embodiment, the second terminal can separate the audio data of the multimedia data through high-pass filters corresponding to different frequency bands, thereby obtaining multiple ultrasonic signals with different signal frequencies, and analyze the ultrasonic signals with different signal frequencies respectively to obtain multiple information.

[0271] Method C: Get multiple information based on delimiters

[0272] In this embodiment, the second terminal may separate the ultrasonic audio signal by using a delimiter, thereby obtaining a plurality of different ultrasonic signals, and analyze ultrasonic signals of different signal frequencies respectively to obtain a plurality of information.

[0273] In the case of obtaining multiple information, the second terminal can sequentially display the interface corresponding to each information, for example, setting a corresponding countdown for the interface of different information. For example, Figure 18 shows a schematic diagram of an interface for displaying multiple different information based on a countdown provided by an embodiment of the present application. Referring to (a) in Figure 18, when the second terminal displays a purchase interface for clothes, the purchase interface includes a countdown 181. When the countdown ends, the interface for the next information can be displayed, that is, the purchase interface for pants, as shown in (b) in Figure 18. The purchase interface for pants also includes a countdown 183. It should be noted that the purchase interface in (a) in Figure 18 also includes a close control 182. The user can directly click on the close control 182 to display the interface for the next information in advance.

[0274] Method D: Display multiple information based on fused data

[0275] In this embodiment, the second terminal may display an interface containing multiple information according to the ultrasonic audio signal, and the user may select an interface corresponding to one of the information to be viewed according to needs.

[0276] For example, FIG19 shows a schematic diagram of displaying multiple different information based on a selection interface provided by an embodiment of the present application. Referring to FIG19 (a), when the second terminal receives information of multiple different information, it can generate a selection interface containing multiple information, such as a purchase link 191 for clothes, a purchase link 192 for pants, etc. The user can select one of the information interfaces to display according to needs. For example, clicking the above-mentioned purchase link 191 will display the purchase interface of clothes, as shown in FIG19 (b). If the user needs to view other interfaces, he can click the back control 193 in the above-mentioned purchase interface to switch to the selection interface, that is, the interface in FIG19 (a).

[0277] In some implementations, the first terminal may push multiple messages, each of which may correspond to at least one push keyword. In this case, the second terminal may receive the user's voice notification of the push instruction, obtain the push keyword contained in the voice notification, match the push keyword with the information keywords of each message, and display the message that matches the push keyword based on the matching results.

[0278] For example, a second terminal receives multiple pieces of information, including clothing, pants, and hats, each corresponding to a keyword. A user can initiate push notifications by voice commands such as "What beautiful clothing!" or "Want to know where to buy clothing?" Upon receiving these push notifications, the second terminal can identify "clothing" as the keyword and, based on the clothing's corresponding information, display the clothing purchase page on the second terminal. Users can also enter the corresponding keyword information by typing.

[0279] As can be seen from the above, in a method for pushing information provided by an embodiment of the present application, multimedia data carrying an ultrasonic audio signal is played through a first terminal, so that a second terminal can obtain information corresponding to the ultrasonic audio signal when receiving the ultrasonic audio signal, and display a target interface based on the information, thereby achieving the purpose of pushing information. In this embodiment, the first terminal does not affect the user's normal viewing of the multimedia data during the process of pushing information. Because the multimedia data used to push information is transmitted through an ultrasonic audio signal, and the sound frequency of the ultrasonic audio signal is outside the audible frequency range of the human ear, that is, the process of the ultrasonic audio signal propagating to the second terminal does not affect the user's normal viewing of the multimedia data. When the user needs to receive information, the target interface can be viewed through the second terminal; and when the user does not need to receive information, the ultrasonic audio signal can be received without the second terminal. This improves the flexibility of pushing information, and the user can choose whether to receive information according to actual conditions without affecting the user's normal viewing of the multimedia data, thereby improving the user experience.

[0280] To further define the necessary steps in implementing information push based on ultrasonic audio signals, FIG20 shows a flowchart of the interaction between a first terminal and a second terminal in a method for pushing information provided by another embodiment of the present application. Referring to FIG20 , the necessary steps in the above-mentioned method for pushing information specifically include:

[0281] In S2001, the first terminal plays multimedia data, and the audio data of the multimedia data is generated by superimposing the ultrasonic audio signal and the original audio signal of the multimedia, and the ultrasonic audio signal is used to push the information; the information includes: a jump link, a QR code, or a combination of one or more of an image containing pushed content; the ultrasonic audio signal is generated by encoding and modulating the information.

[0282] Among them, the above S2001 is implemented in the same way as S403 in the embodiment of Figure 4. For specific descriptions, please refer to the relevant descriptions of S403, which will not be repeated here.

[0283] In S2002, the second terminal receives the audio data of the multimedia data;

[0284] Among them, the above S2002 is implemented in the same way as S405 in the embodiment of Figure 4. For specific descriptions, please refer to the relevant descriptions of S405, which will not be repeated here.

[0285] In S2003, the second terminal obtains the ultrasonic audio signal according to the audio data.

[0286] Among them, the above S2003 is implemented in the same way as S1601 in the embodiment of Figure 16. For specific descriptions, please refer to the relevant descriptions of S1601, which will not be repeated here.

[0287] In S2004, the second terminal determines the information according to the ultrasonic audio signal;

[0288] Among them, the above-mentioned S2004 can be implemented through the methods of S1602 to S1603 in the embodiment of Figure 16. For specific descriptions, please refer to the relevant descriptions of S1602 to S1603, which will not be repeated here.

[0289] In S2005, the second terminal displays the target interface corresponding to the information, and the target interface is a web page, application page, QR code, picture or image containing pushed content. Among them, the above S2005 is implemented in the same way as S407 in the embodiment of Figure 4. For specific descriptions, please refer to the relevant descriptions of S407, which will not be repeated here.

[0290] Figure 21 shows a flowchart of the implementation of the method for pushing information provided by an embodiment of the present application on the second terminal side. Compared with the embodiment shown in Figure 4, the embodiment shown in Figure 4 illustrates the method for pushing information provided by the embodiment of the present application from the perspective of the interaction between the first terminal and the second terminal, while the embodiment shown in Figure 21 illustrates the method for pushing information provided by the embodiment of the present application from the perspective of the second terminal. The specific description is as follows:

[0291] In S2101, audio data of multimedia data is received, where the audio data of the multimedia data is generated by superimposing the ultrasonic audio signal and the original audio signal of the multimedia data;

[0292] In S2102, the ultrasonic audio signal is obtained according to the audio data;

[0293] In S2103, the information is determined according to the ultrasonic audio signal;

[0294] In S2104, a target interface corresponding to the information is displayed, where the target interface is a web page, an application page, a QR code, a picture, or an image containing pushed content.

[0295] Optionally, obtaining the ultrasonic audio signal according to the audio data includes: performing high-pass filtering on the audio data to obtain the ultrasonic audio signal;

[0296] Determining the information based on the ultrasonic audio signal includes: modulating and demodulating the ultrasonic audio signal to obtain binary-coded data; the binary-coded data is generated by encoding the information; and converting the binary-coded data into the information using a preset binary coding decoding rule. In this implementation, the ultrasonic audio signal is extracted through high-pass filtering, and then decoded to restore the information, achieving the purpose of pushing information based on the ultrasonic audio signal and improving the flexibility of information push.

[0297] Optionally, the information is a jump link; and displaying the target interface corresponding to the information includes: displaying the target page in a preset browsing application based on the jump link. In this implementation, the information is a jump link, so the second terminal can display the corresponding page based on the jump link. Compared with graphic data, the data volume of jump links is smaller, thereby improving the efficiency of the information push process.

[0298] Optionally, the pushed data is a QR code; and displaying the target interface corresponding to the information includes: displaying the QR code; and, in response to a recognition event of the QR code, displaying a page corresponding to the QR code. In this implementation, the information is a QR code, and the user can determine whether to recognize the QR code based on actual display needs, thereby increasing the flexibility of the push process and enhancing user engagement.

[0299] Optionally, before receiving multimedia audio data, the method further includes: in response to a first trigger event, starting a function of pushing information, starting a functional module for parsing the ultrasonic audio signal, and the functional module is used to determine the information based on the ultrasonic audio signal.

[0300] Optionally, the triggering event includes: an operation event of clicking a push function activation control, an event of activating the push function through a voice keyword, or an event of activating the push function through a designated gesture.

[0301] Optionally, displaying the target interface corresponding to the information includes: when the device status of the second terminal is in a preset state, displaying the target interface corresponding to the information, and the preset state includes: screen-on state, unlocked state, holding state or user-looking-at-the-screen state.

[0302] Optionally, displaying the target interface corresponding to the information includes: in response to a second trigger event, displaying the target interface based on the information, wherein the target interface includes information associated with the second trigger event.

[0303] Optionally, the target interface includes first content and second content, and displaying the target interface corresponding to the information includes: displaying a first page corresponding to the first content in response to a third trigger event for the first content.

[0304] Optionally, the information includes first information and second information, the first content indicates content corresponding to the first information, and the second content indicates content corresponding to the second information.

[0305] Optionally, the ultrasonic audio signal includes a first ultrasonic signal and a second ultrasonic signal, the frequency of the second ultrasonic signal is higher than the frequency of the first ultrasonic information, and determining the information according to the ultrasonic audio signal includes: determining the first information based on the first ultrasonic signal; determining the second information based on the second ultrasonic signal; and determining the information based on the first information and the second information.

[0306] Optionally, the ultrasonic audio signal includes a delimiter, and determining the information according to the ultrasonic audio signal includes: dividing the ultrasonic audio signal into a first ultrasonic signal and a second ultrasonic signal based on the delimiter; determining the first information based on the first ultrasonic signal; determining the second information based on the second ultrasonic signal; and determining the information based on the first information and the second information.

[0307] Optionally, determining the information according to the ultrasonic audio signal includes: determining the first information based on a signal of a first time interval in the ultrasonic audio signal; determining the second information based on a signal of a second time interval in the ultrasonic audio signal, the second time interval being after the first time interval; and determining the information based on the first information and the second information.

[0308] Corresponding to the method of pushing information in the embodiment shown in Figure 21 above, Figure 22 shows a structural block diagram of a device for displaying information provided by an embodiment of the present application. For the sake of convenience, only the part related to the embodiment of the present application is shown.

[0309] As shown in FIG22 , the information display device includes:

[0310] The audio data receiving unit 221 is configured to receive audio data of multimedia data, where the audio data is generated by superimposing an ultrasonic audio signal and an original audio signal of the multimedia;

[0311] an audio data parsing unit 222, configured to obtain the ultrasonic audio signal according to the audio data;

[0312] an ultrasonic audio signal analyzing unit 223, configured to determine the information based on the ultrasonic audio signal;

[0313] The display unit 224 is configured to display a target interface corresponding to the information, where the target interface is a web page, an application page, a QR code, a picture, or an image containing pushed content.

[0314] Optionally, the audio data parsing unit 222 includes:

[0315] a filtering unit, configured to perform high-pass filtering on the audio signal of the multimedia data to obtain the ultrasonic audio signal;

[0316] The ultrasonic audio signal analysis unit includes:

[0317] a demodulation unit, configured to modulate and demodulate the ultrasonic audio signal to obtain binary coded data; the binary coded data is generated by encoding the information;

[0318] The decoding unit is used to convert the binary coded data into the information through a preset binary coded decoding rule.

[0319] Optionally, the information is a jump link;

[0320] The display unit 224 is specifically configured to display the target page in a preset browsing application based on the jump link.

[0321] Optionally, the pushed data is a QR code; the display unit 224 includes:

[0322] A QR code display unit, configured to display the QR code;

[0323] The QR code recognition unit is used to display a page corresponding to the QR code in response to a recognition event of the QR code.

[0324] Optionally, the device further comprises:

[0325] The trigger unit is used to start the function of pushing information in response to the first trigger event and start the functional module of parsing the ultrasonic audio signal, wherein the functional module is used to determine the information according to the ultrasonic audio signal.

[0326] Optionally, the triggering event includes: an operation event of clicking a push function activation control, an event of activating the push function through a voice keyword, or an event of activating the push function through a designated gesture.

[0327] Optionally, the display unit 224 is specifically used to: display the target interface corresponding to the information when the device status of the second terminal is in a preset state, and the preset state includes: screen-on state, unlocked state, held state or user staring at the screen state.

[0328] Optionally, the display unit 224 is specifically configured to: in response to a second triggering event, display the target interface based on the information, where the target interface includes information associated with the second triggering event.

[0329] Optionally, the target interface includes first content and second content, and the display unit 224 includes:

[0330] The third triggering unit is configured to respond to a third triggering event on the first content.

[0331] The first page display unit is configured to display a first page corresponding to the first content.

[0332] Optionally, the information includes first information and second information, the first content indicates content corresponding to the first information, and the second content indicates content corresponding to the second information.

[0333] Optionally, the ultrasonic audio signal includes a first ultrasonic signal and a second ultrasonic signal, the frequency of the second ultrasonic signal is higher than the frequency of the first ultrasonic information, and the ultrasonic audio signal parsing unit 223 includes:

[0334] a first frequency band analysis unit, configured to determine the first information based on the first ultrasonic signal;

[0335] a second frequency band analysis unit, configured to determine the second information based on the second ultrasonic signal;

[0336] A first information merging unit is configured to determine the information based on the first information and the second information.

[0337] Optionally, the ultrasonic audio signal includes a separator, and the ultrasonic audio signal parsing unit 223 includes:

[0338] a delimiter division unit, configured to divide the ultrasonic audio signal into a first ultrasonic signal and a second ultrasonic signal based on the delimiter;

[0339] a first analyzing unit, configured to determine the first information based on the first ultrasonic signal;

[0340] a second analyzing unit, configured to determine the second information based on the second ultrasonic signal;

[0341] The second information merging unit is configured to determine the information based on the first information and the second information.

[0342] Optionally, the ultrasonic audio signal parsing unit 223 includes:

[0343] a first time division unit, configured to determine the first information based on a signal of a first time interval in the ultrasonic audio signal;

[0344] a second time division unit, configured to determine the second information based on a signal of a second time interval in the ultrasonic audio signal, the second time interval being after the first time interval;

[0345] A third information merging unit is configured to determine the information based on the first information and the second information.

[0346] Figure 23 shows a flowchart of the implementation of the method for pushing information provided by an embodiment of the present application on the first terminal side. Compared with the embodiment shown in Figure 4, the embodiment shown in Figure 4 illustrates the method for pushing information provided by the embodiment of the present application from the perspective of dual-end interaction between the first terminal and the second terminal, while the embodiment shown in Figure 23 illustrates the method for pushing information provided by the embodiment of the present application from the perspective of the first terminal. The specific description is as follows:

[0347] In S2301, the first terminal plays multimedia data, and the audio data of the multimedia data is generated by superimposing the ultrasonic audio signal and the original audio signal of the multimedia. The ultrasonic audio signal is used to push the information, and the information includes: a jump link, a QR code, or an image containing the pushed content, or a combination of one or more of the above. The ultrasonic audio signal is generated by encoding and modulating the information.

[0348] Optionally, the multimedia data includes video data and audio data.

[0349] Optionally, the audio data is generated by superimposing the ultrasonic audio signal and the original audio signal based on first-order complementary coefficients.

[0350] Optionally, the signal modulation includes a combination of one or more of amplitude modulation, frequency shift modulation or phase shift modulation; the binary encoding includes the American Standard Code for Information Interchange ASCII, Unicode UTF-8 or Chinese Character Internal Code Extension Standard GBK.

[0351] Optionally, the multimedia data includes first data and second data, and playing the multimedia data further includes: determining audio data of the second data based on the first data or the instruction voice, the audio data of the second data including an ultrasonic audio signal corresponding to the information; and playing the second data. The second data is played after the first data.

[0352] Optionally, playing the second data includes: superimposing the ultrasonic audio signal with the original audio signal of the second data to generate the audio signal of the second data; and playing the second data carrying the ultrasonic audio signal when a playing timing of the second data is met.

[0353] Optionally, determining the audio data of the second data based on the first data or the indicative voice includes: determining a push keyword corresponding to the first data or the indicative voice; and determining information corresponding to the push keyword.

[0354] Optionally, the information includes first information and second information, and the ultrasonic audio signal includes a first ultrasonic audio signal that pushes the first information and a second ultrasonic audio signal that pushes the second information, wherein the first ultrasonic audio signal and the second ultrasonic audio signal are fused through a delimiter or a time interval to form the ultrasonic audio signal, or the frequency of the second ultrasonic audio signal is higher than that of the first ultrasonic audio signal.

[0355] Corresponding to the method of pushing information in the embodiment shown in Figure 23 above, Figure 24 shows a structural block diagram of an apparatus for pushing information provided in an embodiment of the present application. For ease of explanation, only the parts related to the embodiment of the present application are shown.

[0356] As shown in FIG24 , the above-mentioned device for pushing information includes:

[0357] The multimedia data playback unit 241 is used to play multimedia data. The audio data of the multimedia data is generated by superimposing the ultrasonic audio signal and the original audio signal of the multimedia. The ultrasonic audio signal is used to push the information. The information includes: a jump link, a QR code, or an image containing the pushed content. One or more combinations thereof, the ultrasonic audio signal is generated by encoding and modulating the information.

[0358] Optionally, the audio signal of the multimedia data is generated by superimposing the ultrasonic audio signal and the original audio signal based on first-order complementary coefficients.

[0359] Optionally, the signal modulation includes a combination of one or more of amplitude modulation, frequency shift modulation or phase shift modulation; the binary encoding includes the American Standard Code for Information Interchange ASCII, Unicode UTF-8 or Chinese Character Internal Code Extension Standard GBK.

[0360] Optionally, the multimedia data includes first data and second data, and the multimedia data playing unit includes:

[0361] an information determining unit, configured to determine audio data of the second data based on the first data or the instruction voice, wherein the audio data of the second data includes an ultrasonic audio signal corresponding to the information;

[0362] The second data playing unit is configured to play the second data.

[0363] Optionally, the information includes first information and second information, and the ultrasonic audio signal includes a first ultrasonic audio signal that pushes the first information and a second ultrasonic audio signal that pushes the second information, wherein the first ultrasonic audio signal and the second ultrasonic audio signal are fused through a delimiter or a time interval to form the ultrasonic audio signal, or the frequency of the second ultrasonic audio signal is higher than that of the first ultrasonic audio signal.

[0364] Displaying a target interface corresponding to the information Displaying a target interface corresponding to the information determines the information according to the ultrasonic audio signal.

[0365] The information is determined based on the ultrasonic audio signal.

[0366] Figure 25 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. As shown in Figure 25, the electronic device 25 of this embodiment includes: at least one processor 250 (only one processor is shown in Figure 25, and the number of processors can match the number of chips actually included in the electronic device in the embodiment), a memory 251, and a program 252 stored in the memory 251 and executable on the at least one processor 250. When the processor 250 executes the program 252, the steps of any of the above-mentioned methods for pushing information are implemented.

[0367] The electronic device 25 may be a tablet computer, a smartphone, a laptop computer, etc. The electronic device may include, but is not limited to, a processor 250 and a memory 251. Those skilled in the art will appreciate that FIG25 is merely an example of the electronic device 25 and does not limit the electronic device 25. The electronic device 25 may include more or fewer components than shown, or may combine certain components or different components. For example, the electronic device may also include input and output electronic devices, network access electronic devices, etc.

[0368] The processor 250 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. A general-purpose processor may be a microprocessor or any conventional processor.

[0369] In some embodiments, the memory 251 may be an internal storage unit of the electronic device 25, such as a hard disk or memory of the electronic device 25. In other embodiments, the memory 251 may also be an external storage electronic device of the electronic device 25, such as a plug-in hard disk, a smart memory card (SMC), a secure digital (SD) card, a flash card, etc. equipped on the electronic device 25. Furthermore, the memory 251 may also include both an internal storage unit of the electronic device 25 and an external storage electronic device. The memory 251 is used to store an operating system, an application program, a boot loader (BootLoader), data, and other programs, such as the program code of the program. The memory 251 may also be used to temporarily store data that has been output or is about to be output.

[0370] It should be noted that the information interaction, execution process, etc. between the above-mentioned devices / units are based on the same concept as the method embodiment of this application. Their specific functions and technical effects can be found in the method embodiment section and will not be repeated here.

[0371] Those skilled in the art can clearly understand that, for the convenience and brevity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In actual applications, the above-mentioned functions can be distributed and completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated into one processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0372] An embodiment of the present application also provides an electronic device, which includes: at least one processor, a memory, and a computer program stored in the memory and executable on the at least one processor, wherein the processor implements the steps of any of the above-mentioned method embodiments when executing the computer program.

[0373] An embodiment of the present application further provides a readable storage medium, wherein the readable storage medium stores a program, and when the program is executed by a processor, the steps in the above-mentioned various method embodiments can be implemented.

[0374] An embodiment of the present application provides a program product. When the program product is run on an electronic device, the electronic device can implement the steps in the above-mentioned various method embodiments when executing the program product.

[0375] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the process in the above-mentioned embodiment method by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium. When the computer program is executed by a processor, it can implement the steps of each of the above-mentioned method embodiments. The computer program includes computer program code, which can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium can at least include: any entity or device that can carry the computer program code to the camera / electronic device, recording medium, computer memory, read-only memory (ROM), random access memory (RAM), electric carrier signal, telecommunication signal and software distribution medium. For example, a USB flash drive, a mobile hard disk, a magnetic disk or an optical disk. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electric carrier signals and telecommunication signals.

[0376] In the above embodiments, the description of each embodiment has its own focus. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant description of other embodiments.

[0377] The above-described embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present application, and should all be included in the scope of protection of the present application.

Claims

1. A method for pushing information, characterized in that: Applied to the second terminal, the method for pushing information includes: receiving audio data of multimedia data, where the audio data is generated by superimposing an ultrasonic audio signal and an original audio signal of the multimedia; obtaining the ultrasonic audio signal according to the audio data; determining the information according to the ultrasonic audio signal; The target interface corresponding to the information is displayed, where the target interface is a web page, an application page, a QR code, a picture, or an image containing the pushed content.

2. The method according to claim 1, characterized in that The step of obtaining the ultrasonic audio signal according to the audio data includes: Performing high-pass filtering on the audio data to obtain the ultrasonic audio signal; The determining the information according to the ultrasonic audio signal includes: Modulating and demodulating the ultrasonic audio signal to obtain binary coded data; The binary coded data is converted into the information through a preset binary coded decoding rule.

3. The method according to claim 1 or 2, characterized in that Before receiving the multimedia audio data, the method further includes: In response to the first trigger event, the function of pushing information is started, and the functional module for parsing the ultrasonic audio signal is started, wherein the functional module is used to determine the information according to the ultrasonic audio signal.

4. The method according to any one of claims 1 to 3, characterized in that The target interface corresponding to the information is displayed, including: When the device status of the second terminal is in a preset state, the target interface corresponding to the information is displayed, and the preset state includes: a bright screen state, an unlocked state, a holding state, or a user staring at the screen state.

5. The method according to any one of claims 1 to 4, characterized in that: The target interface corresponding to the information is displayed, including: In response to a second triggering event, the target interface is displayed based on the information, where the target interface includes information associated with the second triggering event.

6. The method according to any one of claims 1 to 5, characterized in that The target interface includes first content and second content, and the target interface corresponding to the information displayed includes: In response to a third triggering event on the first content, a first page corresponding to the first content is displayed.

7. The method according to claim 6, characterized in that The information includes first information and second information, the first content indicates content corresponding to the first information, and the second content indicates content corresponding to the second information.

8. The method according to claim 7, characterized in that The ultrasonic audio signal includes a first ultrasonic signal and a second ultrasonic signal, wherein a frequency of the second ultrasonic signal is higher than a frequency of the first ultrasonic information. Determining the information according to the ultrasonic audio signal includes: determining the first information based on the first ultrasound signal; determining the second information based on the second ultrasound signal; The information is determined based on the first information and the second information.

9. The method according to claim 7, characterized in that The ultrasonic audio signal includes a separator, and determining the information according to the ultrasonic audio signal includes: dividing the ultrasonic audio signal into a first ultrasonic signal and a second ultrasonic signal based on the delimiter; determining the first information based on the first ultrasound signal; determining the second information based on the second ultrasound signal; The information is determined based on the first information and the second information.

10. The method according to claim 7, characterized in that Determining the information according to the ultrasonic audio signal includes: determining the first information based on a signal of a first time interval in the ultrasonic audio signal; determining the second information based on a signal of a second time interval in the ultrasonic audio signal, the second time interval being after the first time interval; The information is determined based on the first information and the second information.

11. A method for pushing information, characterized in that: Applied to the first terminal, the method for pushing information includes: Play multimedia data, where the audio data of the multimedia data is generated by superimposing the ultrasonic audio signal with the original audio signal of the multimedia, and the ultrasonic audio signal is used to push the information, where the information includes: a jump link, a QR code, or a combination of one or more of an image containing the pushed content, and the ultrasonic audio signal is generated by encoding and modulating the information.

12. The method according to claim 11, characterized in that The audio data is generated by superimposing the ultrasonic audio signal and the original audio signal based on a first-order complementary coefficient.

13. The method according to claim 11 or 12, characterized in that The multimedia data includes first data and second data, and the playing of the multimedia data further includes: determining audio data of the second data based on the first data or the instruction voice, where the audio data of the second data includes an ultrasonic audio signal corresponding to the information; The second data is played.

14. The method according to any one of claims 11 to 13, characterized in that: The information includes first information and second information, and the ultrasonic audio signal includes a first ultrasonic audio signal that pushes the first information and a second ultrasonic audio signal that pushes the second information, wherein the first ultrasonic audio signal and the second ultrasonic audio signal are fused through a delimiter or a time interval to form the ultrasonic audio signal, or the second ultrasonic audio signal has a higher frequency than the first ultrasonic audio signal.

15. A method for pushing information, applied to a system including a first terminal and a second terminal, characterized in that The method comprises: The first terminal plays multimedia data, wherein audio data of the multimedia data is generated by superimposing the ultrasonic audio signal and the original audio signal of the multimedia, and the ultrasonic audio signal is used to push the information; the information includes: a jump link, a QR code, or an image containing the pushed content, or a combination of one or more of the following: the ultrasonic audio signal is generated by encoding and modulating the information; The second terminal receives the audio data of the multimedia data; The second terminal obtains the ultrasonic audio signal according to the audio data; The second terminal determines the information according to the ultrasonic audio signal; The second terminal displays a target interface corresponding to the information, where the target interface is a web page, an application page, a QR code, a picture, or an image containing pushed content.

16. A system for pushing information, comprising a first terminal and a second terminal, characterized in that: The first terminal executes the method executed by the first terminal according to any one of claims 11 to 14, and the second terminal executes the method executed by the second terminal according to any one of claims 1 to 10.

17. An electronic device, characterized in that: The electronic device includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the steps of the method according to any one of claims 1 to 10 or the steps of the method according to any one of claims 11 to 14 are implemented.

18. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 10 or the steps of the method according to any one of claims 11 to 14 are implemented.

19. A computer product comprising computer readable instructions which, when executed by one or more processors, implement the method of any one of claims 1 to 10.

Images