Display device and sound information processing method

Abstract

The embodiment of the invention discloses a display device and a sound information processing method. The method comprises the following steps: sending a report function query request; the reporting function query request is used for triggering the main sound equipment to query a field value of a reporting function field; receiving a field value sent by the master sound equipment, and determining whether the master sound equipment supports a reporting function of a wireless connection state of the slave sound equipment based on the field value; if yes, sending a connection state reporting request; the connection state reporting request is used for triggering the master sound equipment to determine the wireless connection state of the slave sound equipment corresponding to the connection state reporting request; and receiving connection state report information generated by the main sound based on the wireless connection state, and generating connection state prompt information based on the connection state report information so as to control the display to display the connection state prompt information. Therefore, a user can know which slave sound equipment is disconnected more conveniently and timely, and the fault repair efficiency of the sound equipment system is improved.

Description

Technical Field

[0001] This application relates to the field of communication technology, and in particular to a display device and a method for processing audio information. Background Technology

[0002] With the development of audio technology, audio systems containing multiple independent channels have emerged, bringing users a richer and more enjoyable listening experience with their excellent sound quality and immersive sound. An audio system consists of a main speaker (such as a soundbar) with system control functions and corresponding slave speakers for each independent channel (such as front left and right speakers, surround speakers, subwoofers, etc.). The main speaker communicates with audio-providing devices such as televisions and mobile phones, and then wirelessly communicates with at least one slave speaker.

[0003] Due to unstable wireless environments and channel congestion, wireless connections to speakers may experience disconnections or dropouts. In such cases, users can only determine whether the connection has been lost by observing indicator lights on the speaker or changes in the sound quality, resulting in poor stability of the speaker system and a negative user experience. Summary of the Invention

[0004] Some embodiments of this application provide a display device and an audio information processing method to help users quickly detect interrupted audio system connections, thereby improving the connection stability of the audio system.

[0005] Some embodiments of this application provide a display device, including:

[0006] monitor;

[0007] A communicator used for data communication with the main speaker;

[0008] A controller connected to the display and the communicator is configured to:

[0009] Send a reporting function query request; the reporting function query request is used to trigger the main speaker to query the field value of the reporting function field;

[0010] Receive the field value sent by the main speaker, and determine whether the main speaker supports the function of reporting the wireless connection status of the speaker based on the field value;

[0011] If so, a connection status reporting request is sent; the connection status reporting request is used to trigger the main speaker to determine the wireless connection status of the slave speaker corresponding to the connection status reporting request.

[0012] The system receives connection status reporting information generated by the main speaker based on the wireless connection status, and generates connection status prompt information based on the connection status reporting information, so as to control the display to display the connection status prompt information.

[0013] Some embodiments of this application also provide an audio information processing method, including:

[0014] Send a reporting function query request; the reporting function query request is used to trigger the main speaker to query the field value of the reporting function field;

[0015] Receive the field value sent by the main speaker, and determine whether the main speaker supports the function of reporting the wireless connection status of the speaker based on the field value;

[0016] If so, a connection status reporting request is sent; the connection status reporting request is used to trigger the main speaker to determine the wireless connection status of the slave speaker corresponding to the connection status reporting request.

[0017] The system receives connection status reporting information generated by the main speaker based on the wireless connection status, and generates connection status prompt information based on the connection status reporting information, so as to control the display to display the connection status prompt information.

[0018] As can be seen from the above technical solutions, the display device and audio information processing method provided in some embodiments of this application can add a reporting function field to the communication protocol between the display device and the main speaker of the audio system. Using the main speaker as an intermediary, a communication channel is established for the display device to obtain the wireless connection status of the wirelessly connected slave speakers in the audio system. This allows the display device to send a reporting function query request containing the reporting function field, which triggers the main speaker to query the field value of the reporting function field. If the display device receives the field value of the reporting function field sent by the main speaker, and determines based on the field value that the main speaker supports the wireless connection status reporting function, then the display device sends... The connection status reporting request triggers the main speaker to determine and report the wireless connection status of the corresponding secondary speaker. The display device then generates a connection status notification based on the main speaker's report and displays this notification on the monitor. This automatically informs the user of the secondary speaker's wireless connection status, eliminating the need for manual judgment of whether a secondary speaker is disconnected. This allows users to more conveniently and promptly identify which secondary speaker is disconnected, improving the efficiency of fault repair and enhancing the connection stability and user experience. Attached Figure Description

[0019] Figure 1This illustration shows a scene diagram of a display device and its control device, and an audio system, according to some embodiments of this application.

[0020] Figure 2 A hardware configuration block diagram of a control device 100 according to some embodiments of this application is shown;

[0021] Figure 3 A hardware configuration block diagram of a display device 200 according to some embodiments of this application is shown;

[0022] Figure 4 This application shows a software configuration diagram of a display device 200 in some embodiments;

[0023] Figure 5 A flowchart of an audio information processing method according to some embodiments of this application is shown;

[0024] Figure 6 It shows Figure 5 A detailed flowchart of S540 in the audio information processing method shown;

[0025] Figure 7 A schematic diagram of the system interface of an audio system according to some embodiments of this application is shown;

[0026] Figure 8 This application shows a schematic diagram illustrating the display of audio information in an audio system according to some embodiments;

[0027] Figure 9 A schematic diagram showing the display of audio information in another audio system according to some embodiments of this application is shown;

[0028] Figure 10 A flowchart of another audio information processing method according to some embodiments of this application is shown. Detailed Implementation

[0029] To make the objectives and implementation methods of this application clearer, the exemplary implementation methods of this application will be clearly and completely described below with reference to the accompanying drawings of the exemplary embodiments of this application. Obviously, the exemplary embodiments described are only some embodiments of this application, and not all embodiments.

[0030] It should be noted that the brief descriptions of terms in this application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise stated, these terms should be understood in their ordinary and common meaning.

[0031] The terms "first," "second," "third," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar or related objects or entities, and do not necessarily imply a specific order or sequence, unless otherwise specified. It should be understood that such terms are interchangeable where appropriate.

[0032] The terms “comprising” and “having”, and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device that includes a range of components is not necessarily limited to all of the components that are clearly listed, but may include other components that are not clearly listed or that are inherent to such product or device.

[0033] In this related technology, the display device communicates with the main speaker of the audio system, and the main speaker also communicates with each of the slave speakers. Thus, the display device only needs to send audio files to the main speaker, without complex audio processing or complex interactions with multiple slave speakers. The main speaker then processes the audio files using relevant audio processing and communication technologies and distributes them to the corresponding slave speakers for playback. Therefore, there is no direct or indirect communication between the display device and the slave speakers, and the communication protocol between the display device and the main speaker does not support the main speaker actively reporting information to the display device. In this way, the main speaker can obtain the connection status (wired or wireless) of the slave speakers, but it cannot send the connection status of the slave speakers to the display device to provide notifications to the user.

[0034] Based on the above, in some embodiments of this application, a reporting function field is defined in the communication protocol between the display device and the main speaker, and the field values ​​corresponding to the supported reporting function (e.g., 1) and the field values ​​corresponding to the unsupported reporting function (e.g., 0) are specified. In this way, without increasing the audio processing procedures of the display device and its interaction with multiple slave speakers, a communication bridge can be established between the display device and the slave speakers through the main speaker, enabling the main speaker to proactively report relevant information about the connection status of the slave speakers to the display device.

[0035] The display device provided in this application can have various implementation forms. For example, the display device can be a smart TV, a laser projection device, a monitor, an electronic bulletin board, an electronic table, a vehicle display, etc. Figure 1 and Figure 2 This is one specific embodiment of the display device of this application.

[0036] Figure 1 This is a schematic diagram illustrating the scene between the display device and its control unit, and the audio system in some embodiments of this application. For example... Figure 1 As shown, the user can operate the display device 200 via the smart device 300 or the control device 100. The display device 200 is wired to the main speaker 510 in the audio system 500 to send relevant audio files to the main speaker 510 for audio playback processing.

[0037] In some embodiments of this application, the audio system 500 is used to receive audio files provided by a display device and play the corresponding audio files according to the corresponding channels. The audio system 500 includes a main speaker 510 with audio control functions and at least one slave speaker 520 corresponding to an independent channel. The main speaker 510 can be wirelessly connected to at least one slave speaker 520, or it can be wired to at least one slave speaker 520. The wireless connection can include infrared protocol communication, Bluetooth protocol communication, or Wireless Fidelity (WiFi) protocol communication, etc. The slave speaker 520 can be a front left channel speaker, a front right channel speaker, a center speaker, a rear left surround speaker, a rear right surround speaker, or a subwoofer, etc.

[0038] In some embodiments of this application, the control device 100 may be a remote control. Communication between the remote control and the display device includes infrared protocol communication, Bluetooth protocol communication, and other short-range communication methods, controlling the display device 200 wirelessly or via wired means. Users can control the display device 200 by inputting user commands through buttons on the remote control, voice input, control panel input, etc.

[0039] In some embodiments of this application, a smart device 300 (such as a mobile terminal, tablet computer, computer, laptop computer, etc.) may also be used to control the display device 200. For example, an application running on the smart device 300 may be used to control the display device 200.

[0040] In some embodiments of this application, the display device 200 may receive instructions without using the aforementioned smart device 300 or control device 100, but instead receive user control through touch or interactive gestures (such as gestures, eye movements, body postures, etc.).

[0041] In some embodiments of this application, the display device 200 can also be controlled in ways other than the control device 100 and the smart device 300. For example, it can be controlled by directly receiving the user's voice commands through a module configured inside the display device 200 for acquiring voice commands, or it can be controlled by receiving the user's voice commands through a voice control device set outside the display device 200.

[0042] In some embodiments of this application, the display device 200 also communicates with the server 400. The display device 200 may be allowed to communicate via a local area network (LAN), wireless local area network (WLAN), and other networks. The server 400 may provide various content and interactive features to the display device 200. The server 400 may be a cluster or multiple clusters, and may include one or more types of servers.

[0043] Figure 2 An exemplary block diagram of the configuration of the control device 100 according to an exemplary embodiment is shown. Figure 2 As shown, the control device 100 includes a controller 110, a communication interface 130, a user input / output interface 140, a memory, and a power supply. The control device 100 can receive user input operation commands and convert the operation commands into commands that the display device 200 can recognize and respond to, thus acting as an intermediary for interaction between the user and the display device 200.

[0044] like Figure 3 The hardware structure of the display device 200 includes at least one of the following: tuner 210, communicator 220, detector 230, external device interface 240, controller 250, display 260, audio output interface 270, memory, power supply, and user interface.

[0045] In some embodiments of this application, the display 260 includes a display screen component for presenting images, a driving component for driving image display, a component for receiving image signals from the controller output, and a user control UI interface for displaying video content, image content, menu control interface, and user control UI interface.

[0046] In some embodiments of this application, the display 260 may be a liquid crystal display, an OLED display, or a projection display, and may also be a projection device and a projection screen.

[0047] In some embodiments of this application, the communicator 220 is a component used to communicate with external devices or servers according to various communication protocols. For example, the communicator may include at least one of a WiFi module, a Bluetooth module, a wired Ethernet module, other network communication protocol chips or near-field communication protocol chips, and an infrared receiver. The display device 200 can establish the transmission and reception of control signals and data signals with the external control device 100 or server 400 through the communicator 220.

[0048] In some embodiments of this application, the user interface can be used to receive control signals from the control device 100 (e.g., an infrared remote control).

[0049] In some embodiments of this application, the detector 230 is used to collect signals from the external environment or to interact with the outside world. For example, the detector 230 includes a light receiver, a sensor for collecting ambient light intensity; or, the detector 230 includes an image acquisition device, such as a camera, which can be used to collect external environmental scenes, user attributes, or user interaction gestures; or, the detector 230 includes a sound acquisition device, such as a microphone, for receiving external sounds.

[0050] In some embodiments of this application, the external device interface 240 may include, but is not limited to, one or more interfaces such as: High Definition Multimedia Interface (HDMI), analog or data high-definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, etc. It may also be a composite input / output interface formed by multiple of the above interfaces.

[0051] In some embodiments of this application, the tuner 210 receives broadcast television signals via wired or wireless means, and demodulates audio and video signals, such as EPG data signals, from multiple wireless or wired broadcast television signals.

[0052] In some embodiments of this application, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0053] In some embodiments of this application, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the display device 200. For example, in response to receiving a user command to select a UI object to display on the display 260, the controller 250 can perform operations related to the object selected by the user command.

[0054] In some embodiments of this application, the controller 250 includes at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), RAM (Random Access Memory), ROM (Read-Only Memory), a first to an nth interface for input / output, a communication bus, etc.

[0055] Users can input commands through a graphical user interface (GUI) displayed on the monitor 260, and the user input interface receives the user input commands through the GUI. Alternatively, users can input commands by entering specific sounds or gestures, and the user input interface receives the user input commands by detecting the sounds or gestures through sensors.

[0056] A "user interface" is the medium through which an application or operating system interacts and exchanges information with the user. It converts information from its internal form to a form that the user can accept. A common form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed graphically. It can be an icon, window, control, or other interface element displayed on the screen of a display device. Controls can include visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets.

[0057] See Figure 4 The software system of a display device can be divided into four layers, from top to bottom: the Applications layer (referred to as the "application layer"), the Application Framework layer (referred to as the "framework layer"), the Android runtime and system library layer (referred to as the "system runtime library layer"), and the kernel layer.

[0058] In some embodiments of this application, at least one application runs in the application layer. These applications may be Windows programs, system settings programs, or clock programs that come with the operating system; they may also be applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the examples above.

[0059] In some embodiments of this application, the framework layer provides an application programming interface (API) and a programming framework for the application. The application framework layer includes predefined functions. It acts as a processing center that determines the actions taken by the application within the application layer. Through the API, the application can access system resources and obtain system services during execution.

[0060] like Figure 4As shown, in some embodiments of this application, the application framework layer includes managers, content providers, etc., wherein the managers include at least one of the following modules: an Activity Manager for interacting with all activities running in the system; a Location Manager for providing system services or applications with access to system location services; a Package Manager for retrieving various information related to application packages currently installed on the device; a Notification Manager for controlling the display and clearing of notification messages; and a Window Manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0061] In some embodiments of this application, the activity manager is used to manage the lifecycle of each application and common navigation and back functions, such as controlling the exit, opening, and back of applications. The window manager is used to manage all window programs, such as obtaining the screen size, determining whether there is a status bar, locking the screen, capturing the screen, and controlling changes to the display window (e.g., shrinking the display window, shaking the display, or distorting the display).

[0062] In some embodiments of this application, the system runtime library layer provides support for the upper layer, namely the framework layer. When the framework layer is used, the Android operating system will run the C / C++ libraries contained in the system runtime library layer to implement the functions to be implemented by the framework layer.

[0063] In some embodiments of this application, the kernel layer is a layer between hardware and software. For example... Figure 4 As shown, the kernel layer includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver.

[0064] In some embodiments of this application, the above-mentioned display device specifically includes:

[0065] monitor;

[0066] A communicator used for data communication with the main speaker;

[0067] A controller connected to a display and a communicator is configured to perform steps A through D as follows:

[0068] Step A: Send a reporting function query request; this reporting function query request is used to trigger the main speaker to query the field value of the reporting function field.

[0069] The reporting function field is a new field added to the communication protocol between the display device and the main speaker in the audio system. It is used to indicate whether the main speaker supports the reporting function of the wireless connection status of the speakers.

[0070] Specifically, after the display device and the main speaker complete authentication and establish a communication connection according to the communication protocol, the display device can generate a reporting function query request containing reporting function fields according to the communication protocol and send it to the main speaker. After receiving the reporting function query request, the main speaker can query the field values ​​of the configured reporting function fields and send the field values ​​as request feedback information to the display device.

[0071] Step B: Receive the field value sent by the main speaker and determine whether the main speaker supports the function of reporting the wireless connection status of the speaker based on the field value.

[0072] Specifically, after the display device receives the field value of the reporting function field from the main speaker, if it determines that the field value is the field value corresponding to the reporting function as agreed in the communication protocol (such as 1), then it determines that the main speaker has the ability to report relevant information about the wireless connection status; otherwise, if it determines that the field value is the field value corresponding to the field value corresponding to the non-supported reporting function as agreed in the communication protocol (such as 0), then it determines that the main speaker does not have the ability to report relevant information about the wireless connection status.

[0073] Step C: If it is determined that the main speaker supports the wireless connection status reporting function, a connection status reporting request is sent; the connection status reporting request is used to trigger the main speaker to determine the wireless connection status of the slave speaker corresponding to the connection status reporting request.

[0074] The connection status reporting request is a request from the main speaker to report the current wireless connection status of the slave speaker. The connection status reporting information is generated by the main speaker and reported to the display device to characterize the wireless connection status of the slave speaker (such as disconnected or connected).

[0075] Specifically, if the display device determines that the main speaker does not support the wireless connection status reporting function, the process ends. If the display device determines that the main speaker supports the wireless connection status reporting function, it means that the display device can continue to communicate with the main speaker to obtain the wireless connection status of the secondary speaker. Therefore, the display device can generate a connection status reporting request and send it to the main speaker.

[0076] In response to a connection status reporting request, the master speaker determines the current wireless connection status of the slave speakers it is wirelessly connected to, and generates connection status reporting information accordingly. The connection status reporting information can be the slave speaker identifier and its connection status identifier carried in the connection status reporting request, or it can be all slave speaker identifiers and their connection status identifiers, or it can be the identifier of a disconnected slave speaker and its connection status identifier, etc.

[0077] In one example, when the main speaker already records the wireless connection status information of each slave speaker, it can use the wireless connection status information of the slave speakers that meet the connection status reporting request to generate connection status reporting information. In another example, when the main speaker does not record the current wireless connection status information of the slave speakers, it can detect whether the slave speakers that meet the connection status reporting request are maintaining a wireless connection, and generate connection status reporting information based on the detection result. Then, the main speaker feeds back the generated connection status reporting information to the display device.

[0078] In some embodiments of this application, the controller is configured to send a connection status reporting request by: sending a system identifier request; determining the slave speaker information based on the speaker system identifier sent by the master speaker; generating a connection status reporting request based on the slave speaker information; and sending the connection status reporting request.

[0079] The system identifier request is used to obtain the system identifier (i.e., the audio system identifier) ​​of the audio system. The audio system identifier is the identifier of the audio system, which can be the name, abbreviation, or model number of the audio system. The slave speaker information is the information of the slave speakers connected to the main audio system and operating on independent channels. This information may include slave speaker identifiers (Chinese / English names, abbreviations, numbers, etc.), slave speaker types, slave speaker connection methods, and the number of slave speakers.

[0080] Specifically, different types of audio systems differ in the type, number, and connection method of the speakers. In some embodiments of this application, a correspondence can be pre-established between the audio system identifier and the slave speaker information of the wirelessly connected slave speakers in the audio system. In this way, the display device can generate more accurate and refined connection status reporting requests based on this correspondence and user requirements, so that the wireless connection status information of the slave speakers corresponding to the user's needs can be obtained in subsequent processes.

[0081] In practice, when the display device determines that the main speaker supports the wireless connection status reporting function based on the obtained field values, it can further send a system identifier request. After receiving the system identifier request, the main speaker can query its speaker system identifier. For example, the main speaker can query its local or external storage space to obtain its speaker system identifier. Then, the main speaker feeds back the speaker system identifier to the display device.

[0082] The display device can query the pre-established correspondence between the obtained audio system identifier and the slave speaker information to obtain the slave speaker information available for query in the audio system. For example, the correspondence is shown in Table 1 below, which records the audio system identifier (audio system name and model) and the slave speaker information corresponding to each audio system identifier. For instance, the audio system identifier received by the display device is audio system model "0x03", and its corresponding audio system name is "4.1.2 Audio Product". The slave speaker information includes the five wirelessly connected slave speakers that the main speaker can report. These slave speaker identifiers are: Subwoofer, Surround Left (SL), Surround Right (SR), Front Left (FL), and Front Right (FR).

[0083] Table 1. Correspondence between audio system identifiers and audio information.

[0084]

[0085] The display device can then generate a connection status reporting request based on the retrieved audio information.

[0086] In one example, the display device can select at least one speaker identifier from the queried speaker information to generate a connection status reporting request according to preset conditions. These preset conditions could be user-input speaker identifiers to be monitored, speaker identifiers with the highest frequency / number of wireless connection drops within a historical time period, or speaker identifiers from the product manufacturer that have been fully authorized by the user. For example, if the user's requirement is to monitor the wireless connection status of a subwoofer, the user-input speaker identifier could be "subwoofer" or "Subwoofer". When the display device determines that the speaker information contains "subwoofer" or "Subwoofer", it generates a connection status reporting request containing "subwoofer" or "Subwoofer" to better meet the user's needs. For example, if the speaker with the highest frequency / number of wireless connection drops within a historical time period (such as 7 days, 1 month, 6 months, etc.) is the left surround speaker, then the speaker can be identified as "left surround speaker" or "SL". When the display device determines that the speaker information contains "left surround speaker" or "SL", it generates a connection status reporting request containing "left surround speaker" or "SL" to provide more timely feedback on speaker conditions that may lead to audio system instability. Similarly, if the speaker authorized by the user to participate in a product improvement program is a subwoofer, then the speaker can be identified as "subwoofer" or "Subwoofer". When the display device determines that the speaker information contains "subwoofer" or "Subwoofer", it generates a connection status reporting request containing "subwoofer" or "Subwoofer".

[0087] In another example, the display device may randomly select at least one slave speaker identifier from the retrieved slave speaker information to generate a connection status reporting request.

[0088] In another example, the display device can generate a connection status reporting request based on a preset identifier. This preset identifier can be an empty character ("") or a character such as "all" indicating all slave speaker identifiers. In this way, the display device requests the master speaker to report the connection status of all wirelessly connected slave speakers.

[0089] Step D: Based on the connection status report information sent by the main speaker, generate connection status prompt information for the speaker system, and provide a prompt based on the connection status prompt information.

[0090] Receive connection status reports from the main speaker based on the wireless connection status, and generate connection status prompts based on the connection status reports to control the display to show the connection status prompts.

[0091] The connection status notification is generated by the display device to inform the user of the wireless connection status from the speaker. The connection status notification can be in at least one of the following formats: text, image, voice, or video.

[0092] Specifically, after receiving connection status reports, the display device can generate connection status prompts based on these reports to improve the timeliness of user notification regarding whether the connection from the speakers has been lost. The display device then controls its monitor to display these prompts.

[0093] In some embodiments of this application, the display device can control its display and / or speaker to present connection status prompts. For example, when the connection status prompt is presented in at least one form of text, image, and video, the display device can control its display to show the connection status prompt; as another example, when the connection status prompt is presented in the form of voice, the display device can control its speaker to play the connection status prompt; and as yet another example, when the connection status prompt is presented in the form of voice and at least one form of text, image, and video, the display device can simultaneously control its display and speaker to display and play the connection status prompt, etc.

[0094] It should be noted that the connection status prompt can be displayed automatically by the display device when certain timing conditions are met (such as immediate effect or timer expiration); the connection status prompt can also be displayed by the display device in response to certain user operations.

[0095] In some embodiments of this application, the controller is configured to control the display to show connection status information in the following manner: in response to an operation to view the connection status of the audio system, the controller controls the display to show connection status information.

[0096] Specifically, the display device can provide a connection status viewing function, such as providing a corresponding information viewing interface. This allows users to check the connection status of the audio system using the display device's introduction / guide. For example, users can use the control device to select the audio system's interface and choose the wireless connection status option; alternatively, when the display device receives user control via touch or interactive gestures (such as gestures, eye movements, body postures, etc.), users can perform relevant touch control operations or interactive gestures; furthermore, the control device can be configured with shortcut keys for viewing the audio system's connection status, allowing users to perform button operations on these shortcut keys. In response to these viewing operations, the display device displays connection status prompts via a floating bar control or display interface. Thus, the display device can present these connection status prompts through interactive operations when needed, making it more convenient and clear for users to understand the overall connection status of the audio system.

[0097] In some embodiments of this application, the controller is configured to generate connection status prompt information based on connection status reporting information in the following manner: matching the audio system identifier with the image identifiers of multiple candidate connection status images, and determining the successfully matched candidate connection status image as the target connection status image; generating connection status prompt information based on the target connection status image and the connection status reporting information.

[0098] The candidate connection status image is a pre-configured image used to represent the speaker layout and connection status of the speaker system. This connection status can be a schematic representation of a communication connection relationship or a schematic representation of an actual connection status. The image identifier is the identifier of the candidate connection status image, and it carries at least the corresponding speaker system identifier. For example, when the speaker system identifier is a speaker system model, the image identifier of its corresponding candidate connection status image also carries that speaker system model. For instance, when the speaker system identifier is "0x02", the image identifier of its corresponding candidate connection status image will at least contain "0x02".

[0099] Specifically, to further enhance the intuitiveness of connection status prompts, the display device can generate more visually appealing images based on the reported connection status information, serving as either the connection status prompts or a portion of that information. Based on this, multiple candidate connection status images and their identifiers can be pre-stored in the display device's internal or external storage space. After obtaining the audio system identifier, the display device uses this identifier as an index to query each image identifier. When the audio system identifier successfully matches an image identifier, the candidate connection status image corresponding to that image identifier is determined as the connection status image adapted to the audio system (i.e., the target connection status image).

[0100] It should be noted that if none of the image identifiers match the audio system identifier, it means that there is no connection status image suitable for the audio system. In this case, the default image can be used as the target connection status image, or the position for the target connection status image can be left empty.

[0101] Then, the display device can combine the target connection status image and the connection status reporting information to generate a connection status prompt message in the form of pictures and text.

[0102] In some embodiments of this application, the controller is configured to match the audio system identifier with the image identifiers of multiple candidate connection status images in the following manner: matching the audio system identifier and connection status reporting information with the image identifiers of multiple candidate connection status images.

[0103] Specifically, the candidate connection status image can be a schematic diagram representing the actual connection status. In this case, the image identifier includes not only the audio system identifier but also the subwoofer identifier and its connection status identifier. For example, the image identifier for a candidate connection status image can include: Image Abbreviation / Number + Audio System Identifier + Subwoofer Identifier 1 + Connection Status Identifier 1 + Audio Identifier 2 + Connection Status Identifier 2 + ... For instance, the image identifier for the candidate connection status image corresponding to the 5.1 audio product with a disconnected subwoofer in the table above could be: Image 1 + 0x02 + Subwoofer + Disconnect + SL + Connect + SR + Connect.

[0104] Based on the above, the display device can use the audio system identifier and connection status reporting information as indexes to search for each image identifier until all matches fail, or until at least one successfully matched candidate connection status image is obtained. Then, a randomly selected candidate connection status image that has successfully matched is used as the target connection status image for the audio system at the current moment. This further increases the information content in the target connection status image, thereby further improving the visualization of the displayed connection status prompts and making it more convenient and faster for users to know the connection status of the audio system.

[0105] It should be noted that if the connection status information is checked again after the connection status of each speaker has changed, the display device can re-find the appropriate target connection status image based on the speaker system identifier and the connection status change information.

[0106] In some embodiments of this application, the controller is also configured to:

[0107] If a connection status change message is received from the main speaker, the time interval between the most recent wireless connection status notifications is determined, and if the time interval exceeds a first preset duration, the display is controlled to show the connection status change message.

[0108] The connection status change information is generated when the main speaker actively reports a change in the wireless connection status of at least one secondary speaker (from connected to disconnected, from disconnected to connected, etc.). For example, the connection status change information may include the secondary speaker identifier, the connection status before the change, and the connection status after the change. The notification interval is the time interval between the most recent notification during actual use of the display device. The first preset duration is the shortest interval between two adjacent notifications, such as 5 minutes or 10 minutes. The first preset duration can be a factory preset for the display device or a user-defined setting based on their acceptable level of disturbance.

[0109] Specifically, after the main speaker of the audio system actively reports the wireless connection status of the slave speakers in response to the connection status reporting request from the display device, it can still obtain the connection status information of each slave speaker in real time. If the main speaker detects that the wireless connection status of at least one slave speaker is inconsistent with the most recently reported wireless connection status, it indicates that the wireless connection status of the corresponding slave speaker has changed. In this case, the main speaker can first calculate the interval between the current time and the time of the most recently reported wireless connection status (i.e., the reporting time interval) and determine whether the reporting time interval exceeds a second preset time. The second preset time is the shortest interval between two adjacent reports, which can be preset at the factory of the audio system or user-defined, such as 5 minutes, 10 minutes, etc. If the reporting time interval does not exceed the second preset time, it indicates that the aforementioned change in the wireless connection status of the slave speaker may be caused by a temporary disconnection or reconnection of the slave speaker. Reporting it may result in too frequent reporting, and may also cause the user to feel that the status has changed again when they check due to communication delays, leading to the user's perception of false information. Therefore, in this case, the main speaker does not report the information. If the reporting interval exceeds the second preset time, it indicates that the wireless connection status change of the speaker is relatively stable, and the main speaker will report the connection status change information to the display device.

[0110] During operation, if the display device receives a connection status change message from the main speaker, it first calculates the interval between the current time and the time of the most recent message notification (i.e., the notification time interval) and determines whether this notification time interval exceeds a first preset duration. If it does not exceed the preset duration, no notification is given; if it does, the display is controlled to show the connection status change message to notify the user. In this way, the user can obtain relatively timely information about the wireless connection status of the speaker without frequent interruptions, further improving the timeliness of speaker system malfunctions or repairs, thereby enhancing the stability of the speaker system and the user experience.

[0111] In some embodiments of this application, the display device can control the display to show connection status change information via a pop-up layer component or a floating frame, or it can broadcast the connection status change information through the display device's speaker or a connected secondary speaker. This achieves the purpose of notifying the secondary speaker of connection status changes without user intervention, improving the speed of connection status change notifications.

[0112] In some embodiments of this application, the controller is further configured to: if it is determined that at least one slave speaker is in a disconnected state, send a reconnection request to the master speaker; the reconnection request is used to control the master speaker to enter a wireless connection pairing state so that the master speaker can reconnect with the slave speakers in the pairing state; receive the reconnection result sent by the master speaker, and control the display to show the reconnection result.

[0113] Specifically, after receiving connection status reporting information or connection status change information from the main speaker, the display device can determine whether at least one slave speaker in the speaker system has disconnected. If not, the connection status monitoring process continues. If any slave speaker is disconnected, a reconnection process is executed for that disconnected slave speaker. Alternatively, when the number of disconnected slave speakers reaches a preset number, a reconnection process is executed for any disconnected slave speaker. This preset number is a pre-configured value that can be set according to the user's acceptable level of audio listening effect. For example, the preset number can be set to 70% to 100% of the total number of slave speakers in the speaker system.

[0114] The display device sends a reconnection request. This reconnection request carries at least the identifier of the slave speaker requesting reconnection and a pairing control command. The pairing control command is used to control the master speaker to enter the wireless pairing state. Thus, upon receiving the reconnection request, the master speaker can control itself to enter the pairing state and pair with the slave speaker identifier in the request, re-establishing the connection. After reconnecting with at least one disconnected slave speaker, the master speaker can send a reconnection result to the display device. The display device then controls the screen to display this reconnection result to inform the user which slave speakers reconnected successfully and which failed.

[0115] It's important to note that the master speaker controls all slave speakers. When the master speaker enters pairing mode, all wirelessly connected slave speakers will disconnect. In this case, the master speaker will reconnect to the slave speaker corresponding to the slave speaker identifier carried in the reconnection request, while other slave speakers will not automatically reconnect unless specifically configured. If the reconnection request carries an identifier pointing to all slave speakers, then the master speaker will reconnect to all wirelessly connected slave speakers.

[0116] It should also be noted that after the main speaker enters pairing mode, the slave speaker to be reconnected also needs to enter pairing mode to complete the reconnection process. At this point, the slave speaker can be manually put into pairing mode, or it can be configured to enter pairing mode under specific conditions.

[0117] In some embodiments of this application, the controller is further configured to: after sending a reconnection request, control the display to show reconnection guidance information; the reconnection guidance information is used to guide the user to perform a reconnection operation on the secondary speaker so that the secondary speaker is in a paired state.

[0118] Among them, reconnection guidance information is information used to guide users to perform certain operations. For example, it may include guiding information such as performing an operation (such as pressing a button or interacting with a gesture), displaying the result of the operation, and continuing to perform the operation.

[0119] Specifically, the process of manually entering pairing mode from a speaker can be as follows: After the display device sends a reconnection request to the main speaker, it can provide operation prompts to the user based on the reconnection guidance information. The user can follow the prompts from the display device step by step to perform the reconnection control operation of the secondary speaker, so that the secondary speaker enters pairing mode.

[0120] In some embodiments of this application, the secondary speaker can be pre-configured so that it automatically enters pairing mode after being disconnected. This further reduces manual operation, simplifies the reconnection process of the secondary speaker, and improves the efficiency of reconnection, thereby further improving the stability of the audio system and the user experience.

[0121] Figure 5 A schematic flowchart of an audio information processing method according to some embodiments of this application is shown. This audio information processing method can be executed by a controller in a display device. Figure 5 As shown, some embodiments of this application provide an audio information processing method that includes the following steps:

[0122] S510, Send a reporting function query request; This reporting function query request is used to trigger the main speaker to query the field value of the reporting function field.

[0123] The reporting function field is a new field added to the communication protocol between the display device and the main speaker in the audio system. It is used to indicate whether the main speaker supports the reporting function of the wireless connection status of the speakers.

[0124] Specifically, after the display device and the main speaker complete authentication and establish a communication connection according to the communication protocol, the display device can generate a reporting function query request containing reporting function fields according to the communication protocol and send it to the main speaker. After receiving the reporting function query request, the main speaker can query the field values ​​of the configured reporting function fields and send the field values ​​as request feedback information to the display device.

[0125] S520 receives the field value sent by the main speaker and determines whether the main speaker supports the function of reporting the wireless connection status of the speaker based on the field value.

[0126] Specifically, after the display device receives the field value of the reporting function field from the main speaker, if it determines that the field value is the field value corresponding to the reporting function as agreed in the communication protocol (such as 1), then it determines that the main speaker has the ability to report relevant information about the wireless connection status; otherwise, if it determines that the field value is the field value corresponding to the field value corresponding to the non-supported reporting function as agreed in the communication protocol (such as 0), then it determines that the main speaker does not have the ability to report relevant information about the wireless connection status.

[0127] S530. If it is determined that the main speaker supports the wireless connection status reporting function, a connection status reporting request is sent. The connection status reporting request is used to trigger the main speaker to determine the wireless connection status of the slave speaker corresponding to the connection status reporting request.

[0128] The connection status reporting request is a request from the main speaker to report the current wireless connection status of the slave speaker. The connection status reporting information is generated by the main speaker and reported to the display device to characterize the wireless connection status of the slave speaker (such as disconnected or connected).

[0129] Specifically, if the display device determines that the main speaker does not support the wireless connection status reporting function, the process ends. If the display device determines that the main speaker supports the wireless connection status reporting function, it means that the display device can continue to communicate with the main speaker to obtain the wireless connection status of the secondary speaker. Therefore, the display device can generate a connection status reporting request and send it to the main speaker.

[0130] In response to a connection status reporting request, the master speaker determines the current wireless connection status of the slave speakers it is wirelessly connected to, and generates connection status reporting information accordingly. The connection status reporting information can be the slave speaker identifier and its connection status identifier carried in the connection status reporting request, or it can be all slave speaker identifiers and their connection status identifiers, or it can be the identifier of a disconnected slave speaker and its connection status identifier, etc.

[0131] In one example, when the main speaker already records the wireless connection status information of each slave speaker, it can use the wireless connection status information of the slave speakers that meet the connection status reporting request to generate connection status reporting information. In another example, when the main speaker does not record the current wireless connection status information of the slave speakers, it can detect whether the slave speakers that meet the connection status reporting request are maintaining a wireless connection, and generate connection status reporting information based on the detection result. Then, the main speaker feeds back the generated connection status reporting information to the display device.

[0132] In some embodiments of this application, sending a connection status reporting request in S530 can be implemented as follows: sending a system identifier request; determining the slave speaker information based on the speaker system identifier sent by the master speaker; generating a connection status reporting request based on the slave speaker information, and sending the connection status reporting request.

[0133] The system identifier request is used to obtain the system identifier (i.e., the audio system identifier) ​​of the audio system. The audio system identifier is the identifier of the audio system, which can be the name, abbreviation, or model number of the audio system. The slave speaker information is the information of the slave speakers connected to the main audio system and operating on independent channels. This information may include slave speaker identifiers (Chinese / English names, abbreviations, numbers, etc.), slave speaker types, slave speaker connection methods, and the number of slave speakers.

[0134] Specifically, different types of audio systems differ in the type, number, and connection method of the speakers. In some embodiments of this application, a correspondence can be pre-established between the audio system identifier and the slave speaker information of the wirelessly connected slave speakers in the audio system. In this way, the display device can generate more accurate and refined connection status reporting requests based on this correspondence and user requirements, so that the wireless connection status information of the slave speakers corresponding to the user's needs can be obtained in subsequent processes.

[0135] In practice, when the display device determines that the main speaker supports the wireless connection status reporting function based on the obtained field values, it can further send a system identifier request. After receiving the system identifier request, the main speaker can query its speaker system identifier. For example, the main speaker can query its local or external storage space to obtain its speaker system identifier. Then, the main speaker feeds back the speaker system identifier to the display device.

[0136] The display device can query the pre-established correspondence between the audio system identifier and the slave speaker information based on the obtained audio system identifier to obtain the slave speaker information available for query in the audio system. For example, the correspondence is shown in Table 1 above, which records the audio system identifier (audio system name and model) and the slave speaker information corresponding to each audio system identifier. For instance, the audio system identifier received by the display device is audio system model "0x03", its corresponding audio system name is "4.1.2 Audio Product", and the slave speaker information includes the five wirelessly connected slave speakers that the main speaker can report. These slave speaker identifiers are subwoofer, left surround speaker (SL), right surround speaker (SR), front left speaker (FL), and front right speaker (FR). Then, the display device can generate a connection status reporting request based on the queried slave speaker information.

[0137] In one example, the display device can select at least one speaker identifier from the queried speaker information to generate a connection status reporting request according to preset conditions. These preset conditions could be user-input speaker identifiers to be monitored, speaker identifiers with the highest frequency / number of wireless connection drops within a historical time period, or speaker identifiers from the product manufacturer that have been fully authorized by the user. For example, if the user's requirement is to monitor the wireless connection status of a subwoofer, the user-input speaker identifier could be "subwoofer" or "Subwoofer". When the display device determines that the speaker information contains "subwoofer" or "Subwoofer", it generates a connection status reporting request containing "subwoofer" or "Subwoofer" to better meet the user's needs. For example, if the speaker with the highest frequency / number of wireless connection drops within a historical time period (such as 7 days, 1 month, 6 months, etc.) is the left surround speaker, then the speaker can be identified as "left surround speaker" or "SL". When the display device determines that the speaker information contains "left surround speaker" or "SL", it generates a connection status reporting request containing "left surround speaker" or "SL" to provide more timely feedback on speaker conditions that may lead to audio system instability. Similarly, if the speaker authorized by the user to participate in a product improvement program is a subwoofer, then the speaker can be identified as "subwoofer" or "Subwoofer". When the display device determines that the speaker information contains "subwoofer" or "Subwoofer", it generates a connection status reporting request containing "subwoofer" or "Subwoofer".

[0138] In another example, the display device may randomly select at least one slave speaker identifier from the retrieved slave speaker information to generate a connection status reporting request.

[0139] In another example, the display device can generate a connection status reporting request based on a preset identifier. This preset identifier can be an empty character ("") or a character such as "all" indicating all slave speaker identifiers. In this way, the display device requests the master speaker to report the connection status of all wirelessly connected slave speakers.

[0140] S540 receives connection status reporting information generated by the main speaker based on the wireless connection status, and generates connection status prompt information based on the connection status reporting information, so as to control the display to show the connection status prompt information.

[0141] The connection status notification is generated by the display device to inform the user of the wireless connection status from the speaker. The connection status notification can be in at least one of the following formats: text, image, voice, or video.

[0142] Specifically, after receiving connection status reports, the display device can generate connection status prompts based on these reports to improve the timeliness of user notification regarding whether the connection from the speakers has been lost. The display device then controls its monitor to display these prompts.

[0143] In some embodiments of this application, the display device can control its display and / or speaker to present connection status prompts. For example, when the connection status prompt is presented in at least one form of text, image, and video, the display device can control its display to show the connection status prompt; as another example, when the connection status prompt is presented in the form of voice, the display device can control its speaker to play the connection status prompt; and as yet another example, when the connection status prompt is presented in the form of voice and at least one form of text, image, and video, the display device can simultaneously control its display and speaker to display and play the connection status prompt, etc.

[0144] It should be noted that the connection status prompt can be displayed automatically by the display device when certain timing conditions are met (such as immediate effect or timer expiration); the connection status prompt can also be displayed by the display device in response to certain user operations.

[0145] In some embodiments of this application, when the display device includes a display that is communicatively connected to the controller, controlling the display to display connection status prompt information in S540 can be implemented as follows: in response to the operation of viewing the connection status of the audio system, controlling the display to display connection status prompt information.

[0146] Specifically, the display device can provide a connection status viewing function, such as providing a corresponding information viewing interface. This allows users to check the connection status of the audio system using the display device's introduction / guide. For example, users can use the control device to select the audio system's interface and choose the wireless connection status option; alternatively, when the display device receives user control via touch or interactive gestures (such as gestures, eye movements, body postures, etc.), users can perform relevant touch control operations or interactive gestures; furthermore, the control device can be configured with shortcut keys for viewing the audio system's connection status, allowing users to perform button operations on these shortcut keys. In response to these viewing operations, the display device displays connection status prompts via a floating bar control or display interface. Thus, the display device can present these connection status prompts through interactive operations when needed, making it more convenient and clear for users to understand the overall connection status of the audio system.

[0147] In some embodiments of this application, after S540, the audio information processing method further includes: if connection status change information sent by the main speaker is received, determining the time interval of the most recent wireless connection status prompt, and controlling the display to display the connection status change information when the prompt time interval is greater than a first preset duration.

[0148] The connection status change information is generated when the main speaker actively reports a change in the wireless connection status of at least one secondary speaker (from connected to disconnected, from disconnected to connected, etc.). For example, the connection status change information may include the secondary speaker identifier, the connection status before the change, and the connection status after the change. The notification interval is the time interval between the most recent notification during actual use of the display device. The first preset duration is the shortest interval between two adjacent notifications, such as 5 minutes or 10 minutes. The first preset duration can be a factory preset for the display device or a user-defined setting based on their acceptable level of disturbance.

[0149] Specifically, after the main speaker of the audio system actively reports the wireless connection status of the slave speakers in response to the connection status reporting request from the display device, it can still obtain the connection status information of each slave speaker in real time. If the main speaker detects that the wireless connection status of at least one slave speaker is inconsistent with the most recently reported wireless connection status, it indicates that the wireless connection status of the corresponding slave speaker has changed. In this case, the main speaker can first calculate the interval between the current time and the time of the most recently reported wireless connection status (i.e., the reporting time interval) and determine whether the reporting time interval exceeds a second preset time. The second preset time is the shortest interval between two adjacent reports, which can be preset at the factory of the audio system or user-defined, such as 5 minutes, 10 minutes, etc. If the reporting time interval does not exceed the second preset time, it indicates that the aforementioned change in the wireless connection status of the slave speaker may be caused by a temporary disconnection or reconnection of the slave speaker. Reporting it may result in too frequent reporting, and may also cause the user to feel that the status has changed again when they check due to communication delays, leading to the user's perception of false information. Therefore, in this case, the main speaker does not report the information. If the reporting interval exceeds the second preset time, it indicates that the wireless connection status change of the speaker is relatively stable, and the main speaker will report the connection status change information to the display device.

[0150] During operation, if the display device receives a connection status change message from the main speaker, it first calculates the interval between the current time and the time of the most recent message notification (i.e., the notification time interval) and determines whether this notification time interval exceeds a first preset duration. If it does not exceed the preset duration, no notification is given; if it does, the display is controlled to show the connection status change message to notify the user. In this way, the user can obtain relatively timely information about the wireless connection status of the speaker without frequent interruptions, further improving the timeliness of speaker system malfunctions or repairs, thereby enhancing the stability of the speaker system and the user experience.

[0151] In some embodiments of this application, the display device can control the display to show connection status change information via a pop-up layer component or a floating frame, or it can broadcast the connection status change information through the display device's speaker or a connected secondary speaker. This achieves the purpose of notifying the secondary speaker of connection status changes without user intervention, improving the speed of connection status change notifications.

[0152] The audio information processing method provided in the above embodiments of this application can add a reporting function field to the communication protocol between the display device and the main speaker of the audio system. Using the main speaker as an intermediary, it establishes a communication channel for the display device to obtain the wireless connection status of the wirelessly connected slave speakers in the audio system. This allows the display device to send a reporting function query request containing the reporting function field, triggering the main speaker to query the field value of the reporting function field. If the display device receives the field value of the reporting function field from the main speaker and determines that the main speaker supports the wireless connection status reporting function based on the field value, it sends a connection status reporting request to trigger the main speaker to determine and report the wireless connection status of the slave speaker corresponding to the connection status reporting request. The display device then generates a connection status prompt message for the audio system based on the connection status reporting information sent by the main speaker and controls the display to show this prompt message, automatically informing the user of the wireless connection status of the slave speakers. This saves the manual process of determining whether a slave speaker is disconnected, allowing users to more conveniently and promptly know whether a slave speaker in the audio system is disconnected and which slave speaker is disconnected. This improves the fault repair efficiency of the audio system, thereby enhancing the connection stability of the audio system and improving the user experience.

[0153] Figure 6 Showing the target Figure 5The diagram illustrates a detailed flow of step S540 in the audio information processing method. In some embodiments of this application, the display device can generate visually displayable connection status prompts by combining candidate connection status images. As an optional embodiment, when the display device includes a display communicatively connected to the controller, the connection status prompts can be displayed on the display. Figure 6 As shown, S540 "generates connection status prompt information based on connection status reporting information to control the display to show the connection status prompt information" includes the following steps:

[0154] S610. Match the audio system identifier with the image identifiers of multiple candidate connection state images, and determine the successfully matched candidate connection state image as the target connection state image.

[0155] The candidate connection status image is a pre-configured image used to represent the speaker layout and connection status of the speaker system. This connection status can be a schematic representation of a communication connection relationship or a schematic representation of an actual connection status. The image identifier is the identifier of the candidate connection status image, and it carries at least the corresponding speaker system identifier. For example, when the speaker system identifier is a speaker system model, the image identifier of its corresponding candidate connection status image also carries that speaker system model. For instance, when the speaker system identifier is "0x02", the image identifier of its corresponding candidate connection status image will at least contain "0x02".

[0156] Specifically, to further enhance the intuitiveness of connection status prompts, the display device can generate more visually appealing images based on the reported connection status information, serving as either the connection status prompts or a portion of that information. Based on this, multiple candidate connection status images and their identifiers can be pre-stored in the display device's internal or external storage space. After obtaining the audio system identifier, the display device uses this identifier as an index to query each image identifier. When the audio system identifier successfully matches an image identifier, the candidate connection status image corresponding to that image identifier is determined as the connection status image adapted to the audio system (i.e., the target connection status image).

[0157] It should be noted that if none of the image identifiers match the audio system identifier, it means that there is no connection status image suitable for the audio system. In this case, the default image can be used as the target connection status image, or the position for the target connection status image can be left empty.

[0158] In some embodiments of this application, matching the audio system identifier with the image identifiers of multiple candidate connection status images includes: matching the audio system identifier and connection status reporting information with the image identifiers of multiple candidate connection status images.

[0159] Specifically, the candidate connection status image can be a schematic diagram representing the actual connection status. In this case, the image identifier includes not only the audio system identifier but also the subwoofer identifier and its connection status identifier. For example, the image identifier for a candidate connection status image can include: Image Abbreviation / Number + Audio System Identifier + Subwoofer Identifier 1 + Connection Status Identifier 1 + Audio Identifier 2 + Connection Status Identifier 2 + ... For instance, the image identifier for the candidate connection status image corresponding to the 5.1 audio product with a disconnected subwoofer in the table above could be: Image 1 + 0x02 + Subwoofer + Disconnect + SL + Connect + SR + Connect.

[0160] Based on the above, the display device can use the audio system identifier and connection status reporting information as indexes to search for each image identifier until all matches fail, or until at least one successfully matched candidate connection status image is obtained. Then, a randomly selected candidate connection status image that has successfully matched is used as the target connection status image for the audio system at the current moment. This further increases the information content in the target connection status image, thereby further improving the visualization of the displayed connection status prompts and making it more convenient and faster for users to know the connection status of the audio system.

[0161] It should be noted that if the connection status information is checked again after the connection status of each speaker has changed, the display device can re-find the appropriate target connection status image based on the speaker system identifier and the connection status change information.

[0162] S620. Generate connection status prompt information based on the target connection status image and connection status reporting information.

[0163] Specifically, the display device can combine the target connection status image and the connection status reporting information to generate a connection status prompt message in the form of graphics and text.

[0164] S630, in response to viewing the wireless connection status, controls the display to show connection status prompts.

[0165] Specifically, see Figure 7Users can access the audio system's system interface 700 via the control device and display device. When the field value obtained in S510 indicates that the main speaker supports wireless connection status reporting, the display device controls the system interface 700 displayed on its monitor to include a "Wireless Connected Slave Speaker" option 710. When the user triggers the "Wireless Connected Slave Speaker" option 710, the display device responds to the viewing operation by displaying the "Wireless Connected Slave Speaker Information" interface. This interface displays connection status information in graphic and textual form; that is, the "Wireless Connected Slave Speaker Information" interface includes a target connection status image, as well as the slave speaker identifier and its connection status text content from the connection status reporting information.

[0166] For example, see Figure 8 When the candidate connection status image can be a schematic diagram representing the actual connection status, and the audio system is identified as "0x03" in the table above, and the subwoofer is disconnected, the left area of ​​the "Wireless Connection Speaker Information" interface 800 can display the target connection status image 810, indicating that there are 5 wirelessly connected speaker speakers, the layout position of each speaker speaker, and one speaker speaker (subwoofer) located in the front center position is disconnected. Furthermore, the right area of ​​the "Wireless Connection Speaker Information" interface 800 can display text-based connection status reporting information 820, which includes the identifiers of the 5 speaker speakers and their connection status, indicating that the subwoofer is disconnected among the 5 wirelessly connected speaker speakers.

[0167] For example, see Figure 9 When the candidate connection status image can be a schematic diagram representing a communication connection relationship, and the audio system is identified as "0x02" in the table above, and the subwoofer is disconnected, the target connection status image 910 can be displayed in the left area of ​​the "Wireless Connection Slave Audio Information" interface 900, indicating that there are 3 wirelessly connected slave audios and the layout position of each slave audio. Furthermore, the right area of ​​the "Wireless Connection Slave Audio Information" interface 900 can display the identifiers of the 3 slave audios in the connection status reporting information and their connection status, indicating that the subwoofer is disconnected among the 3 wirelessly connected slave audios.

[0168] The connection status prompt information generation and prompting method provided in the above embodiments of this application generates and displays connection status prompt information by using candidate connection status images and connection status reporting information. This can further improve the visualization and intuitiveness of the connection status prompt information, thereby increasing the information content in the target connection status image and making it easier and faster for users to know the connection status of the speaker.

[0169] Figure 10A flowchart illustrating another audio information processing method provided in some embodiments of this application is shown. After receiving connection status reporting information or connection status change information sent by the main speaker and providing a notification, this audio information processing method may also add an automatic reconnection process. For example... Figure 10 As shown, the audio information processing method includes the following steps:

[0170] S1010. If it is determined that at least one slave speaker is in a disconnected state, a reconnection request is sent. The reconnection request is used to control the master speaker to enter the wireless connection pairing state so that the master speaker can reconnect with the slave speaker in the pairing state.

[0171] Specifically, after receiving connection status reporting information or connection status change information from the main speaker, the display device can determine whether at least one slave speaker in the speaker system has disconnected. If not, the connection status monitoring process continues. If any slave speaker is disconnected, the reconnection process S1010 to S1020 is executed for that disconnected slave speaker. Alternatively, when the number of disconnected slave speakers reaches a preset number, the reconnection process S1010 to S1020 is executed for any disconnected slave speaker. The preset number is a pre-configured value that can be set according to the user's acceptable level of audio listening effect. For example, the preset number can be set to 70% to 100% of the total number of slave speakers in the speaker system.

[0172] The display device sends a reconnection request to the main speaker. This reconnection request includes at least the slave speaker identifier requesting reconnection and a pairing control command. This pairing control command is used to control the main speaker to enter the wireless pairing state. Thus, upon receiving the reconnection request, the main speaker can control itself to enter pairing state and perform pairing and re-establishment of the connection with the slave speaker identifier in the request.

[0173] It's important to note that the master speaker controls all slave speakers. When the master speaker enters pairing mode, all wirelessly connected slave speakers will disconnect. In this case, the master speaker will reconnect to the slave speaker corresponding to the slave speaker identifier carried in the reconnection request, while other slave speakers will not automatically reconnect unless specifically configured. If the reconnection request carries an identifier pointing to all slave speakers, then the master speaker will reconnect to all wirelessly connected slave speakers.

[0174] It should also be noted that after the main speaker enters pairing mode, the slave speaker to be reconnected also needs to enter pairing mode to complete the reconnection process. At this point, the slave speaker can be manually put into pairing mode, or it can be configured to enter pairing mode under specific conditions.

[0175] In some embodiments of this application, after the reconnection request is sent in S1010, the control display shows reconnection guidance information; the reconnection guidance information is used to guide the user to perform a reconnection operation on the secondary speaker so that the secondary speaker is in a paired state.

[0176] Among them, reconnection guidance information is information used to guide users to perform certain operations. For example, it may include guiding information such as performing an operation (such as pressing a button or interacting with a gesture), displaying the result of the operation, and continuing to perform the operation.

[0177] Specifically, the process of manually entering pairing mode from a speaker can be as follows: After the display device sends a reconnection request to the main speaker, it can provide operation prompts to the user based on the reconnection guidance information. The user can follow the prompts from the display device step by step to perform the reconnection control operation of the secondary speaker, so that the secondary speaker enters pairing mode.

[0178] In some embodiments of this application, the secondary speaker can be pre-configured so that it automatically enters pairing mode after being disconnected. This further reduces manual operation, simplifies the reconnection process of the secondary speaker, and improves the efficiency of reconnection, thereby further improving the stability of the audio system and the user experience.

[0179] S1020: Receive the reconnection result sent by the main speaker and control the display to show the reconnection result.

[0180] Specifically, after the main speaker reconnects to at least one disconnected slave speaker, it can send the reconnection result to the display device. The display device then controls the monitor to show the reconnection result, informing the user which slave speakers reconnected successfully and which failed.

[0181] The audio information processing method provided in the above embodiments of this application controls the main speaker to automatically enter the pairing state after detecting a disconnection of the secondary speaker, so as to complete the automatic reconnection of the secondary speaker. This can further reduce manual operation, simplify the reconnection process of the secondary speaker, improve the efficiency of reconnection of the secondary speaker, and thus further improve the stability of the audio system and the user experience.

[0182] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

[0183] For ease of explanation, the above description has been provided in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Various modifications and variations can be obtained based on the above teachings. The selection and description of the above embodiments are for the purpose of better explaining the principles and practical applications, thereby enabling those skilled in the art to better utilize the described embodiments and various different variations of embodiments suitable for specific use considerations.

Claims

1. A display device, characterized in that, include: monitor; A communicator used for data communication with the main speaker; A controller connected to the display and the communicator is configured to: Send a reporting function query request; the reporting function query request is used to trigger the main speaker to query the field value of the reporting function field; Receive the field value sent by the main speaker, and determine whether the main speaker supports the function of reporting the wireless connection status of the speaker based on the field value; If so, a connection status reporting request is sent; the connection status reporting request is used to trigger the main speaker to determine the wireless connection status of the slave speaker corresponding to the connection status reporting request. The system receives connection status reporting information generated by the main speaker based on the wireless connection status, and generates connection status prompt information based on the connection status reporting information, so as to control the display to display the connection status prompt information.

2. The display device according to claim 1, characterized in that, The controller is configured to send the connection status reporting request in the following manner: Send a system identifier request; the system identifier request is used to trigger the main speaker to determine the speaker system identifier; Based on the audio system identifier sent by the main speaker, determine the secondary speaker information; The connection status reporting request is generated based on the audio information and then sent.

3. The display device according to claim 2, characterized in that, The controller is configured to generate connection status notification information based on the connection status reporting information in the following manner: The audio system identifier is matched with the image identifiers of multiple candidate connection state images, and the candidate connection state image that is successfully matched is determined as the target connection state image; Based on the target connection status image and the connection status reporting information, the connection status prompt information is generated.

4. The display device according to claim 3, characterized in that, The controller is configured to match the audio system identifier with image identifiers of multiple candidate connection status images in the following manner: The audio system identifier and the connection status reporting information are matched with the image identifiers of multiple candidate connection status images.

5. The display device according to any one of claims 1 to 4, characterized in that, The controller is configured to control the display to show the connection status information in the following manner: In response to the operation of viewing the wireless connection status, the display is controlled to show the connection status prompt information.

6. The display device according to claim 1, characterized in that, The controller is also configured to: If the connection status change information sent by the main speaker is received, the time interval between the most recent wireless connection status prompts is determined, and when the time interval is greater than a first preset duration, the display is controlled to show the connection status change information; wherein, the connection status change information is generated and sent by the main speaker when it detects a change in the wireless connection status of at least one of the slave speakers and determines that the time interval between the most recent wireless connection status reports is greater than a second preset duration.

7. The display device according to claim 1 or 6, characterized in that, The controller is also configured to: If it is determined that at least one of the slave speakers is in a disconnected state, a reconnection request is sent; the reconnection request is used to control the master speaker to enter a wireless connection pairing state so that the master speaker can reconnect with the slave speakers that are in the pairing state. Receive the reconnection result sent by the main speaker and control the display to show the reconnection result.

8. The display device according to claim 7, characterized in that, The controller is also configured to: After the reconnection request is sent, the display is controlled to show reconnection guidance information; the reconnection guidance information is used to guide the user to perform a reconnection operation on the secondary speaker so that the secondary speaker is in a paired state.

9. The display device according to claim 7, characterized in that, The speaker is configured to enter pairing mode after being in the disconnected state.

10. A method for processing audio information, characterized in that, include: Send a query request for the reporting function; The reporting function query request is used to trigger the main speaker to query the field value of the reporting function field; Receive the field value sent by the main speaker, and determine whether the main speaker supports the function of reporting the wireless connection status of the speaker based on the field value; If so, a connection status reporting request is sent; the connection status reporting request is used to trigger the main speaker to determine the wireless connection status of the slave speaker corresponding to the connection status reporting request. The system receives connection status reporting information generated by the main speaker based on the wireless connection status, and generates connection status prompt information based on the connection status reporting information, so as to control the display to show the connection status prompt information.

Images