Display device and volume adjusting method

Abstract

The invention provides a display device and a volume adjusting method. The display device and the volume adjusting method are used for simplifying user operation when the volume of a hearing aid is adjusted. The display device comprises a display, a user interface, a communicator, a memory, and at least one processor connected with the display, the user interface, the communicator and the memory, wherein the at least one processor is configured to receive a first volume adjustment instruction; adjusting the volume of the display equipment according to the first volume adjustment instruction, and acquiring a first volume value and a second volume value under the condition that the display equipment establishes a Bluetooth connection with a hearing aid supporting a hearing aid service HAS; under the condition that the condition of adjusting the volume of the hearing aid is satisfied according to the first volume value and the second volume value, acquiring the loudness of the environment sound; generating a second volume adjusting instruction according to the loudness of the environment sound; and sending a second volume adjustment instruction to the hearing aid through the Bluetooth connection so as to adjust the volume of the hearing aid.

Description

Display device and volume adjustment method

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This disclosure claims priority to the Chinese patent applications filed with the China Patent Office on September 27, 2022, with application number 202211184993.3, and the Chinese patent applications filed with the China Patent Office on September 27, 2022, with application number 202211185637.3, the entire contents of which are incorporated by reference into this disclosure. Technical Field

[0003] The present disclosure relates to the field of Bluetooth communication technology, and more specifically, to a display device and a volume adjustment method. Background Art

[0004] A hearing aid is a device that picks up ambient sound through a microphone, amplifies it, reduces noise, and then reproduces it at the wearer's ear to assist hearing. Because the volume of ambient sound changes in real time, it often needs to be adjusted during use.

[0005] Currently, the most common way to adjust the volume of a hearing aid is to adjust the volume of the hearing aid through the volume adjustment button on the hearing aid or through an independent device to realize the hearing aid remote control (HARC) role. However, when adjusting the volume of the hearing aid through the volume adjustment button on the hearing aid, the hearing aid needs to be taken off to accurately operate the volume adjustment button, which is very inconvenient. When adjusting the volume of the hearing aid through the hearing aid remote control, it is necessary to first operate the hearing aid remote control and / or the hearing aid to establish a connection between the hearing aid remote control and the hearing aid, and then further operate the hearing aid remote control to adjust the volume of the hearing aid, which is also very inconvenient.

[0006] Summary of the Invention

[0007] The present disclosure provides a display device, comprising: a display configured to display an image and / or a user interface; a user interface configured to receive instructions from a user; a communicator configured to communicate with an external device according to a predetermined protocol; and a memory configured to store computer instructions and data associated with the display device.

[0008] At least one processor is connected to the display, user interface, communicator and memory, and is configured to execute computer instructions to cause the display device to execute: receiving a first volume adjustment instruction; adjusting the volume of the display device according to the first volume adjustment instruction, and obtaining a first volume value and a second volume value when a Bluetooth connection is established between the display device and a hearing aid that supports hearing assistance service (HAS); the first volume value is the volume value of the display device after the volume of the display device is adjusted according to the first volume adjustment instruction, and the second volume value is the volume value of the hearing aid; when it is determined that the conditions for adjusting the volume of the hearing aid are met according to the first volume value and the second volume value, obtaining the loudness of the ambient sound; generating a second volume adjustment instruction according to the loudness of the ambient sound; and sending the second volume adjustment instruction to the hearing aid via the Bluetooth connection to adjust the volume of the hearing aid.

[0009] An embodiment of the present disclosure provides a volume adjustment method, which is applied to a display device, the method comprising receiving a first volume adjustment instruction; adjusting the volume of the display device according to the first volume adjustment instruction; obtaining a first volume value and a second volume value when a Bluetooth connection is established between the display device and a hearing aid that supports a hearing assistance service (HAS); the first volume value is the volume value of the display device after the volume of the display device is adjusted according to the first volume adjustment instruction, and the second volume value is the volume value of the hearing aid; obtaining the loudness of the ambient sound when it is determined that a condition for adjusting the volume of the hearing aid is met according to the first volume value and the second volume value; generating a second volume adjustment instruction according to the loudness of the ambient sound; and sending the second volume adjustment instruction to the hearing aid via the Bluetooth connection to adjust the volume of the hearing aid. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] FIG1 is a scenario architecture diagram of a volume adjustment method according to some embodiments;

[0011] FIG2 is a block diagram of a hardware configuration of a control device according to some embodiments;

[0012] FIG3 is a block diagram of a hardware configuration of a display device according to some embodiments;

[0013] FIG4 is a block diagram of a hardware configuration of a hearing aid according to some embodiments;

[0014] FIG5 is a diagram illustrating software configuration in a display device according to some embodiments;

[0015] FIG6 is a software configuration diagram of an audio architecture according to some embodiments;

[0016] FIG7 is a flow chart of steps of a volume adjustment method according to some embodiments;

[0017] FIG8 is an interactive flow chart of a volume adjustment method according to some embodiments;

[0018] FIG9 is an interactive flow chart of another volume adjustment method according to some embodiments;

[0019] FIG10 is an interactive flow chart of a volume adjustment method according to some embodiments;

[0020] FIG11 is an interactive flow chart of another volume adjustment method according to some embodiments;

[0021] FIG12 is a flowchart of another volume adjustment method according to some embodiments;

[0022] FIG13 is an interactive flow chart of another volume adjustment method according to some embodiments;

[0023] FIG14 is a scene interface diagram of a volume adjustment method according to some embodiments;

[0024] FIG15 is a scene interface diagram of another volume adjustment method according to some embodiments;

[0025] FIG16 is a scene interface diagram of another volume adjustment method according to some embodiments;

[0026] FIG17 is an interactive flow chart of another volume adjustment method according to some embodiments;

[0027] FIG18 is an interactive flowchart of another volume adjustment method according to some embodiments. DETAILED DESCRIPTION

[0028] Figure 1 is a schematic diagram of a scenario architecture of a volume adjustment method disclosed herein. The scenario architecture shown in Figure 1 includes: a control device 100, a display device 200, a terminal device 300, a server 400, and a hearing aid 500.

[0029] The user can operate the display device 200 via the terminal device 300 or the control apparatus 100. A data transmission link is established between the terminal device 200 and the server 400, through which the display device 200 can obtain relevant media resources from the server 400. A Bluetooth connection is established between the display device 200 and the hearing aid 500. The display device 200 can send audio data or a third volume adjustment command to the hearing aid 500 via the Bluetooth connection between the display device 200 and the hearing aid 500, and the hearing aid 500 can also send audio data to the display device 200 via the Bluetooth connection between the display device 200 and the hearing aid 500.

[0030] According to some embodiments, the display device 200 may have various implementation forms, for example, the display device 200 may be a television, a smart speaker refrigerator with a display function, curtains with a display function, a personal computer (PC), a laser projection device, a monitor, an electronic bulletin board, a wearable device, a vehicle-mounted device, an electronic table, etc., and the present disclosure does not limit this.

[0031] In some embodiments, the control device 100 may be a remote control. Communication between the remote control and the display device 200 may be via infrared protocol, Bluetooth protocol, or other short-range communication methods, allowing the display device 200 to be controlled wirelessly or wired. A user may control the display device 200 by inputting user commands via buttons on the remote control, voice input, control panel input, etc. In some embodiments, the control device 100 may also be a terminal device (such as a mobile phone, tablet computer, computer, laptop computer, etc.). For example, the display device 200 may be controlled using an application running on the terminal device.

[0032] In some embodiments, the display device 200 may also be controlled by a terminal device 300 (such as a mobile phone, tablet computer, computer, laptop computer, etc.). For example, the display device 200 may be controlled by an application running on a smart device.

[0033] In some embodiments, the display device 200 can also be controlled in a manner other than the control device 100. For example, the display device 200 can directly receive the user's voice command control through a module for obtaining voice commands configured inside the display device 200, or receive the user's key operations through physical buttons on the display device 200, or receive the user's touch operations through the touch control panel of the display device 200.

[0034] In some embodiments, the display device 200 may also communicate with a server to obtain relevant media resources from the server. The display device 200 may be connected to the server via a local area network (LAN) or a wireless local area network (WLAN). The server may provide media resource services and various content and interactions to the display device 200. The server may be a single cluster or multiple clusters, and may include one or more types of servers.

[0035] Figure 2 is a block diagram of the configuration of the control device 100 in the embodiment shown in Figure 1. As shown in Figure 2, the control device 100 includes at least one of a processor 110, a communication interface 130, a user input / output interface 140, a memory, and a power supply. The control device 100 can receive user input of operational commands, convert these operational commands into commands that the display device 200 can recognize and respond to, and forward these operational commands or commands converted from voice commands to the display device 200, acting as an intermediary for interaction between the user and the display device 200.

[0036] FIG3 is a block diagram illustrating a configuration of the display device 200 in the embodiment shown in FIG1. ​​As shown in FIG3, the display device 200 includes: a tuner / demodulator 210, a communicator 220, a detector 230, an external device interface 240, at least one processor 250, a display 260, an audio output interface 270, a memory, a power supply, and at least one of a user interface.

[0037] In some embodiments, the tuner / demodulator 210 receives broadcast television signals via wired or wireless reception, and demodulates audio and video signals, such as EPG data signals, from multiple wireless or wired broadcast television signals. In some embodiments, the tuner / demodulator 210 can be located in different separate devices, that is, the tuner / demodulator 210 can also be located in a device external to the physical device where the at least one processor 250 is located, such as an external set-top box.

[0038] Communicator 220 is a component used to communicate with external devices (such as at least one processor 110, server 400, hearing aid 500, etc.) according to various communication protocols. For example, communicator 220 may include at least one of a Wi-Fi module, a Bluetooth module, a wired Ethernet module, or other network communication protocol chip or a near-field communication protocol chip, as well as an infrared receiver. Display device 200 can send and receive control signals and data signals with external devices via communicator 220.

[0039] Detector 230 is used to collect signals from the external environment or external interactions. For example, detector 230 includes a light receiver, a sensor for collecting ambient light intensity; or detector 230 includes an image collector, such as a camera, for collecting external environmental scenes, user attributes, or user interaction gestures; or detector 230 includes a sound collector, such as a microphone, for receiving external sounds.

[0040] The external device interface 240 may include, but is not limited to, any one or more of the following: a high-definition multimedia interface (HDMI), an analog or digital high-definition component input interface (component), a composite video input interface (CVBS), a USB input interface (USB), an RGB port, etc. It may also be a composite input / output interface formed by multiple of the above interfaces.

[0041] At least one processor 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The at least one processor 250 controls the overall operation of the display device 200. For example, in response to receiving a user command for selecting a UI object to be displayed on the display 260, the at least one processor 250 can perform operations related to the object selected by the user command. In some embodiments, the at least one processor includes at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), a random access memory (RAM), a read-only memory (ROM), a first interface to an nth interface for input / output, a communication bus, etc.

[0042] The display 260 includes a display screen component for presenting images, a driver component for driving the image display, a component for receiving image signals output from at least one processor, and a component for displaying video content, image content, and a menu control interface, as well as a user control UI interface. The display 260 can be a liquid crystal display, an OLED display, and a projection display, and can also be a projection device and a projection screen. The user can enter user commands through the graphical user interface (GUI) displayed on the display 260, and the user interface receives the user input commands through the graphical user interface (GUI). Alternatively, the user can enter user commands by inputting specific sounds or gestures, and the user interface recognizes the sounds or gestures through sensors to receive the user input commands. Among them, the user interface is a medium interface for interaction and information exchange between an application or operating system and a user, which realizes the conversion between the internal form of information and the form acceptable to the user. The commonly used form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation that is displayed in a graphical manner. It can be an interface element such as an icon, window, control, etc. displayed on the display screen of an electronic device, where the control can include visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, etc.

[0043] The audio output interface 270 is an audio output component for outputting audio signals, including a speaker, an external audio output terminal, etc.

[0044] The user interface may be used to receive control signals input by the user through the control device 100 (eg, an infrared remote controller, etc.) or through touch or gestures.

[0045] Figure 4 is a block diagram of the configuration of the hearing aid 500 in the embodiment shown in Figure 1. As shown in Figure 4, the hearing aid 500 includes: a communicator 510, an audio acquisition component 520, an external device interface 530, at least one processor 540, an audio output component 550, a memory, a power supply, and at least one of a user interface.

[0046] In some embodiments, the hearing aid 500 can pick up ambient sound through the audio collection component 520, amplify and reduce the noise of the picked up ambient sound through at least one processor 540, and output the picked up processed ambient sound through the audio output component 550 to achieve the function of assisting hearing.

[0047] In some embodiments, the hearing aid 500 may also establish a Bluetooth connection with other devices (such as the display device 200 or the terminal device 300) via the communicator 510, receive audio signals or control instructions sent by the other devices via the Bluetooth connection established with the other devices, and output the received audio signals via the audio output component 550, or respond to control instructions sent by the other devices via the at least one processor 540. The hearing aid 500 may also send audio signals or control instructions to the other devices via the Bluetooth connection established with the other devices.

[0048] As shown in Figure 5, in some embodiments, the operating system of the display device 200 is divided into four layers, from top to bottom, namely, the application layer (referred to as the "application layer"), the application framework layer (referred to as the "framework layer"), the Android runtime (Android runtime) and system library layer (referred to as the "system runtime library layer"), and the kernel layer.

[0049] In some embodiments, at least one application runs in the application layer. These applications can be window programs, system settings programs, clock programs, etc. that come with the operating system, or applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the above examples.

[0050] The framework layer provides applications with an application programming interface (API) and programming framework. The application framework layer includes predefined functions. The application framework layer acts as a processing center, determining the actions taken by applications in the application layer. Through the API, applications can access system resources and services during execution.

[0051] As shown in Figure 5, the application framework layer in the embodiment of the present disclosure includes managers, content providers, etc., wherein the manager includes at least one of the following modules: an activity manager for interacting with all activities running in the system; a location manager for providing system services or applications with access to system location services; a package manager for retrieving various information related to applications currently installed on the device; a notification manager for controlling the display and clearing of notification messages; and a window manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0052] In some embodiments, the activity manager is used to manage the lifecycle of each application and common navigation back functions, such as controlling the exit, opening, and backing of an application. The window manager is used to manage all window programs, such as obtaining the display screen size, determining whether there is a status bar, locking the screen, taking screenshots, and controlling display window changes (such as shrinking the display window, shaking the display, distorting the display, etc.).

[0053] In some embodiments, the system runtime layer provides support for the upper layer, namely the framework layer. When the framework layer is used, the Android operating system will run the C / C++ library contained in the system runtime layer to implement the functions to be implemented by the framework layer.

[0054] In some embodiments, the kernel layer is a layer between hardware and software. As shown in FIG5 , the kernel layer includes at least one of the following drivers: an audio driver, a display driver, a Bluetooth driver, a camera driver, a Wi-Fi driver, a Universal Serial Bus (USB) driver, a High Definition Multimedia Interface (HDMI) driver, a sensor driver (such as a fingerprint sensor, a temperature sensor, a pressure sensor, etc.), and a power driver.

[0055] In some embodiments, the audio architecture in the disclosed embodiments may be a Low Energy Audio (LE audio) audio architecture. As shown in FIG6 , the LE audio audio architecture can be divided into: a top-level profile layer, an audio decoder, a Generic Audio Framework (GAF) layer, and a Bluetooth core specification layer.

[0056] Upper-layer protocols provide additional requirements for specific audio use cases, including the Telephony and Media Audio Profile (TMAP), the Hearing Aid Profile (HAP) and Hearing Aid Service (HAS) for hearing aids, and the Public Broadcasting Profiles (PBP).

[0057] The audio decoder is the Low Complexity Communication Codec (LC3), which is mandatory for LE audio streams. LC3 encodes audio into a single stream, allowing GAF to configure unicast streams to audio playback devices such as hearing aids, earbuds, and headphones to transmit only the audio required by the audio playback device.

[0058] The common audio architecture includes the Common Audio Profile (CAP), Common Audio Service (CAP), audio transport stream management, media control, call control, device coordination, microphone control, and volume control. Audio transport stream management includes the Basic Audio Profile (BAP), Published Audio Capabilities Service (PACS), Audio Stream Control Service (ASCS), and Broadcast Audio Scan Service (BASS). Media control includes the Media Control Profile (MCP) and Media Control Service (MCS). Call control includes the Call Control Profile (CCP) and Telephone Billing Service (TBS). Device coordination includes the Coordinated Set Identification Profile (CSIP) and Coordinated Set Identification Service (CSIS). Microphone control includes the Microphone Control Profile (MICP) and Microphone Control Service (MICS). Volume control includes the Volume Control Profile (VCP), Volume Control Service (VCS), Audio Input Control Service (VICS), and Volume Offset Control Service (VOCS).

[0059] FIG7 is a flow chart of a volume adjustment method according to an embodiment of the present disclosure. The volume adjustment method may be performed by the display device 200 in the embodiment shown in FIG1 . As shown in FIG7 , the method includes the following steps:

[0060] S71: Receive a first volume adjustment instruction.

[0061] In some embodiments, the display device receiving the first volume adjustment instruction may include: the display device receiving the first volume adjustment instruction sent by a remote controller or a terminal device through a user interface.

[0062] In other embodiments, the display device receiving the first volume adjustment instruction may include: the display device receiving a user operation on a volume adjustment button of the display device through a user interface, and generating the first volume adjustment instruction according to the user operation on the volume adjustment button.

[0063] The first volume adjustment instruction in the embodiment of the present disclosure can be a volume adjustment instruction for increasing the volume value by a preset value, or a volume adjustment instruction for decreasing the volume value by a preset value, or a volume adjustment instruction for adjusting the volume value to a specified volume value. For example: if the user operates the "volume +" button on the remote control, the remote control sends a first volume adjustment instruction for increasing the volume value by 1 to the display device, and accordingly, the display device receives the first volume adjustment instruction for increasing the volume value by 1 sent by the remote control. For another example: if the user receives a voice input of "adjust the volume value to 8" through the voice receiving component on the remote control, the remote control sends a first volume adjustment instruction for adjusting the volume value to 8 to the display device, and accordingly, the display device receives the first volume adjustment instruction for adjusting the volume value to 8 sent by the remote control.

[0064] S72: Adjust the volume of the display device according to the first volume adjustment instruction.

[0065] In an embodiment of the present disclosure, when the first volume adjustment instruction is a volume adjustment instruction for increasing the volume value by 1, and the current volume value of the display device is 5, the volume of the display device is adjusted according to the first volume adjustment instruction, including: increasing the volume value of the display device by 1 by executing the first volume adjustment instruction, thereby adjusting the volume value of the display device to 6.

[0066] In an embodiment of the present disclosure, when the first volume adjustment instruction is a volume adjustment instruction for adjusting the volume value to 8, and the current volume value of the display device is 5, the volume of the display device is adjusted according to the first volume adjustment instruction, including: adjusting the volume value of the display device from 5 to 8 by executing the first volume adjustment instruction.

[0067] S73: Determine whether the display device has established a Bluetooth connection with a hearing aid that supports Hearing Aid Service (HAS).

[0068] In some embodiments, the implementation method of determining whether the display device has established a Bluetooth connection with a hearing aid that supports hearing aid services may include: the display device determines, through at least one processor, whether a Bluetooth connection is currently established with other devices; if the display device does not currently establish a Bluetooth connection with other devices, determining that the display device has not established a Bluetooth connection with the hearing aid that supports hearing aid services; and if the display device currently establishes a Bluetooth connection with other devices, determining whether the device is a hearing aid (Hearing Aid, HA) and whether the device supports hearing aid services; if the device is not a hearing aid and / or the device does not support hearing aid services, determining that the display device has not established a Bluetooth connection with the hearing aid that supports hearing aid services; and if the device is a hearing aid and supports hearing aid services, determining that the display device has established a Bluetooth connection with the hearing aid that supports hearing aid services.

[0069] The Bluetooth connection in the embodiment of the present disclosure may be a Bluetooth connection established based on Low Energy Audio (LE audio).

[0070] It should be noted that the execution order of steps S72 and S73 is not limited in the embodiment of the present disclosure. The volume of the display device can be adjusted according to the first volume adjustment instruction first, and then it is determined whether the display device has established a Bluetooth connection with the hearing aid that supports the hearing aid service. Alternatively, it can be determined whether the display device has established a Bluetooth connection with the hearing aid that supports the hearing aid service first, and then the volume of the display device can be adjusted according to the first volume adjustment instruction. Alternatively, the volume of the display device can be adjusted according to the first volume adjustment instruction at the same time, and it can be determined whether the display device has established a Bluetooth connection with the hearing aid that supports the hearing aid service.

[0071] It should also be noted that in the LE Audio technical specification, the hearing aid protocol defines the hearing aid remote control role of the hearing aid, which can send control signals such as volume adjustment to the hearing aid and be executed by the hearing aid. Therefore, only when the hearing aid supports the hearing aid service can the display device act as a hearing aid remote control to send volume adjustment information to the hearing aid and be executed by the hearing aid. Therefore, the present disclosure needs to determine that a Bluetooth connection has been established with the hearing aid that supports the hearing aid service before executing subsequent steps to adjust the volume of the hearing aid.

[0072] In the above step S73, if the display device has not established a Bluetooth connection with the hearing aid supporting the hearing aid service, the volume adjustment method according to some embodiments ends, and the volume of the display is adjusted only according to the received volume adjustment instruction. If the display device has established a Bluetooth connection with the hearing aid supporting the hearing aid service, the following step S74 is executed:

[0073] S74: Obtain a first volume value and a second volume value.

[0074] The first volume value is the volume value of the display device after the volume of the display device is adjusted according to the first volume adjustment instruction, and the second volume value is the volume value of the hearing aid.

[0075] In some embodiments, the display device obtains the second volume value (the volume value of the hearing aid) by sending a volume request message to the hearing aid through the Bluetooth connection, receiving a volume response message returned by the hearing aid through the Bluetooth connection, and parsing the volume response message to obtain the second volume value.

[0076] In some embodiments, the display device obtains the second volume value (the volume value of the hearing aid) in the following manner: the display device maintains the hearing aid volume value in a volume control profile (VCP) module and reads the second volume value from the VCP module.

[0077] S75. Determine whether a hearing aid volume adjustment condition is met according to the first volume value and the second volume value.

[0078] That is, it is determined whether the first volume value and the second volume value meet a condition for adjusting the volume of the hearing aid.

[0079] In the above step S75, if it is determined based on the first volume value and the second volume value that the hearing aid volume adjustment condition is not satisfied, then the volume adjustment method according to some embodiments ends. If it is determined based on the first volume value and the second volume value that the condition for adjusting the hearing aid volume is satisfied, then the following step S76 is executed:

[0080] S76. Obtain the loudness of the ambient sound.

[0081] In some embodiments, the ambient sound may be converted into an electrical signal by a microphone of the display device, and the loudness of the ambient sound may be determined based on the strength of the electrical signal obtained by the conversion of the ambient sound.

[0082] S77: Generate a second volume adjustment instruction according to the loudness of the ambient sound.

[0083] In some embodiments, the second volume adjustment instruction may be a volume adjustment instruction for increasing or decreasing the volume value by a preset value. For example, the second volume adjustment instruction may be a volume adjustment instruction for increasing the volume value by 1.

[0084] In some embodiments, the second volume adjustment instruction may be a volume adjustment instruction for adjusting the volume value to a specified volume value. For example, the second volume adjustment instruction may be a volume adjustment instruction for adjusting the volume value to 8.

[0085] S78. Send the second volume adjustment instruction to the hearing aid through the Bluetooth connection to adjust the volume of the hearing aid.

[0086] In some implementations, before sending the second volume adjustment instruction to the hearing aid via the Bluetooth connection, the display device further encapsulates the second volume adjustment instruction based on a Bluetooth communication protocol between the display device and the hearing aid.

[0087] According to some embodiments, the volume adjustment method adjusts the volume of the display device according to the first volume adjustment instruction when receiving the first volume adjustment instruction, and obtains the first volume value of the display device and the second volume value of the hearing aid after the volume of the display device is adjusted according to the first volume adjustment instruction when a Bluetooth connection is established between the display device and the hearing aid that supports hearing aid services; then, the loudness of the ambient sound is obtained when it is determined that the conditions for adjusting the volume of the hearing aid are met according to the first volume value and the second volume value, a second volume adjustment instruction is generated according to the loudness of the ambient sound, and the second volume adjustment instruction is sent to the hearing aid through the Bluetooth connection to adjust the volume of the hearing aid. Compared to taking off the hearing aid and adjusting the volume of the hearing aid through the volume adjustment button on the hearing aid, or adjusting the volume of the hearing aid through a separate device to realize the hearing aid remote control, in the embodiment of the present disclosure, when the hearing aid supports hearing aid services and establishes a Bluetooth connection with the display device, the display device can adjust the volume of the hearing aid according to its own volume value, the hearing aid volume value and the loudness adaptability of the ambient sound. Therefore, the embodiment of the present disclosure can simplify the user operation when adjusting the hearing aid volume, thereby improving the user experience.

[0088] FIG8 is a schematic diagram of an interactive flow of a volume adjustment method according to an embodiment of the present disclosure. As shown in FIG8 , the method includes the following steps:

[0089] S801: A display device receives a first volume adjustment instruction.

[0090] S802: The display device adjusts the volume of the display device according to the first volume adjustment instruction.

[0091] S803: The display device determines whether a Bluetooth connection is established between the display device and the hearing aid supporting the hearing aid service.

[0092] In the above step S803, if the display device has not established a Bluetooth connection with the hearing aid supporting the hearing aid service, the volume adjustment method according to some embodiments ends, and the volume of the display is adjusted only according to the received volume adjustment instruction. If the display device has established a Bluetooth connection with the hearing aid supporting the hearing aid service, the following step S804 is executed:

[0093] S804: The display device obtains a first volume value and a second volume value.

[0094] The first volume value is the volume value of the display device after the volume of the display device is adjusted according to the first volume adjustment instruction, and the second volume value is the volume value of the hearing aid.

[0095] The implementation of the above steps S801 to S804 is similar to the implementation of steps S71 to S74 in the embodiment shown in FIG. 7 , and will not be described in detail here.

[0096] S805: The display device obtains a first volume difference.

[0097] The first volume difference is the absolute value of the difference between the first volume value and the second volume value.

[0098] For example, after adjusting the volume of the display device according to the first volume adjustment instruction, the volume value of the display device is 8, and the volume value of the hearing aid is 5. Then, the first volume value can be determined to be 8, the second volume value can be determined to be 5, and the first volume difference can be calculated to be 3.

[0099] For another example: after adjusting the volume of the display device according to the first volume adjustment instruction, the volume value of the display device is 4, and the volume value of the hearing aid is 6, then the first volume value can be determined to be 6, the second volume value can be determined to be 4, and then the first volume difference can be calculated to be 2.

[0100] S806: The display device determines whether the first volume difference is greater than a preset threshold.

[0101] The preset threshold in the embodiment of the present disclosure can be set according to the synchronization requirement of the display device volume value and the hearing aid volume value. If the synchronization requirement of the display device volume value and the hearing aid volume value is lower, the preset threshold can be set to a larger value. If the synchronization requirement of the display device volume value and the hearing aid volume value is higher, the preset threshold can be set to a smaller value.

[0102] In one embodiment of the present disclosure, the preset threshold value may be 0, 1, 2, 3, etc. When the preset threshold value is set to 0, it indicates that the volume value of the display device is required to be completely synchronized with the volume value of the hearing aid. As long as the volume value of the display device is different from the volume value of the hearing aid, it is determined that the condition for adjusting the volume of the hearing aid is met.

[0103] In the above step S806, if the first volume difference is not greater than the preset threshold, the following step S807 is executed, and the method flow of the volume adjustment method according to some embodiments ends.

[0104] S807: The display device determines that the condition for adjusting the volume of the hearing aid is not met.

[0105] In the above step S806, if the first volume difference is greater than the preset threshold, the following step S808 and subsequent steps are executed:

[0106] S808: The display device determines that a condition for adjusting the volume of the hearing aid is met.

[0107] S809: The display device obtains the loudness of the ambient sound.

[0108] S810: The display device generates a second volume adjustment instruction according to the loudness of the ambient sound.

[0109] The implementation of the above steps S809 and S810 is similar to the implementation of steps S76 and S77 in the embodiment shown in Figure 7, and will not be repeated here.

[0110] S811. The display device sends the second volume adjustment instruction to the hearing aid through the Bluetooth connection.

[0111] Correspondingly, the hearing aid receives the second volume adjustment instruction sent by the display device through the Bluetooth connection.

[0112] S812: The hearing aid adjusts the volume according to the second volume adjustment instruction.

[0113] In the above embodiment, when the difference between the volume value of the display device and the volume value of the hearing aid is greater than a preset threshold, the loudness of the ambient sound is obtained, and a second volume adjustment instruction is generated based on the loudness of the ambient sound, and the second volume adjustment instruction is sent to the hearing aid via the Bluetooth connection to adjust the volume of the hearing aid. Therefore, the above embodiment can adjust the volume value of the hearing aid according to the volume value of the display device and the adaptability to the ambient sound, so that the volume value of the hearing aid matches the loudness of the ambient sound.

[0114] FIG9 is a schematic diagram of an interactive flow of a volume adjustment method according to an embodiment of the present disclosure. As shown in FIG9 , the method includes the following steps:

[0115] S901: A display device receives a first volume adjustment instruction.

[0116] S902: The display device adjusts the volume of the display device according to the first volume adjustment instruction.

[0117] S903: The display device determines whether a Bluetooth connection is established between the display device and the hearing aid supporting the hearing aid service.

[0118] In the above step S903, if the display device has not established a Bluetooth connection with the hearing aid supporting the hearing aid service, the above volume adjustment process is terminated, and the volume of the display is adjusted only according to the received volume adjustment instruction. If the display device has established a Bluetooth connection with the hearing aid supporting the hearing aid service, the following step S904 is executed:

[0119] S904: The display device obtains a first volume value and a second volume value.

[0120] The first volume value is the volume value of the display device after the volume of the display device is adjusted according to the first volume adjustment instruction, and the second volume value is the volume value of the hearing aid.

[0121] The implementation of the above steps S901 to S904 is similar to the implementation of steps S71 to S74 in the embodiment shown in FIG. 7 , and will not be described in detail here.

[0122] S905: The display device obtains a first volume difference.

[0123] The first volume difference is the absolute value of the difference between the first volume value and the second volume value.

[0124] For example, after adjusting the volume of the display device according to the first volume adjustment instruction, the volume value of the display device is 8, and the volume value of the hearing aid is 5. Then, the first volume value can be determined to be 8, the second volume value can be determined to be 5, and the first volume difference can be calculated to be 3.

[0125] For another example: after adjusting the volume of the display device according to the first volume adjustment instruction, the volume value of the display device is 4, and the volume value of the hearing aid is 6, then the first volume value can be determined to be 6, the second volume value can be determined to be 4, and then the first volume difference can be calculated to be 2.

[0126] S906: The display device determines whether the first volume difference is greater than a preset threshold.

[0127] The preset threshold in the embodiment of the present disclosure can be set according to the synchronization requirement of the display device volume value and the hearing aid volume value. If the synchronization requirement of the display device volume value and the hearing aid volume value is lower, the preset threshold can be set to a larger value. If the synchronization requirement of the display device volume value and the hearing aid volume value is higher, the preset threshold can be set to a smaller value.

[0128] In one embodiment of the present disclosure, the preset threshold value may be 0, 1, 2, 3, etc. When the preset threshold value is set to 0, it indicates that the volume value of the display device is required to be completely synchronized with the volume value of the hearing aid. As long as the volume value of the display device is different from the volume value of the hearing aid, it is determined that the condition for adjusting the volume of the hearing aid is met.

[0129] In the above step S906, if the first volume difference is not greater than the preset threshold, the following step S907 is executed, and the method flow of the volume adjustment method according to some embodiments ends.

[0130] S907: The display device determines that the condition for adjusting the volume of the hearing aid is not met.

[0131] In the above step S906, if the first volume difference is greater than the preset threshold, the following step S908 and subsequent steps are executed:

[0132] S908: The display device determines that a condition for adjusting the volume of the hearing aid is met.

[0133] S909: The display device obtains the loudness of the ambient sound.

[0134] S910: The display device obtains a target volume value according to the loudness of the ambient sound and a preset mapping relationship.

[0135] The preset mapping relationship includes a mapping relationship between the loudness and volume value of each ambient sound.

[0136] In some embodiments, the preset mapping relationship can be stored in the display device in the form of a correspondence table, and the display device obtains the target volume value according to the loudness of the ambient sound and the preset mapping relationship, including: obtaining the volume value corresponding to the loudness of the ambient sound as the target volume value by looking up the table.

[0137] In a certain embodiment of the present disclosure, when the preset mapping relationship is a mapping relationship table, the mapping relationship table may be as shown in Table 1 below:

[0138] Table 1

[0139] If the preset mapping relationship is as shown in Table 1 above, when the loudness of the ambient sound is 58 dB, the target volume value can be determined to be 7; when the loudness of the ambient sound is 47 dB, the target volume value can be determined to be 6.

[0140] S911. The display device generates the second volume adjustment instruction according to the target volume value and the second volume value.

[0141] In some embodiments, the method for generating the second volume adjustment instruction according to the target volume value and the second volume value includes the following steps a and b:

[0142] Step a: Obtain a second volume difference.

[0143] The second volume difference is an absolute value of a difference between the target volume value and the second volume value.

[0144] In an embodiment of the present disclosure, the target volume value is 7, and the second volume value (the volume value of the hearing aid) is 5, then the second volume difference may be 2.

[0145] In an embodiment of the present disclosure, the target volume value is 3, and the second volume value (the volume value of the hearing aid) is 6, then the second volume difference can be obtained as 3.

[0146] Step b: generating a volume adjustment instruction for controlling the volume value of the hearing aid to increase or decrease the second volume difference.

[0147] In an embodiment of the present disclosure, the target volume value is 7 and the second volume value is 5, then the second volume difference may be 2, and two volume adjustment instructions for controlling the volume value of the hearing aid to increase by 1 are generated.

[0148] In an embodiment of the present disclosure, the target volume value is 3 and the second volume value is 6, then the second volume difference can be obtained as 3, and 3 volume adjustment instructions for controlling the volume value of the hearing aid to decrease by 1 are generated.

[0149] S912. The display device sends the second volume adjustment instruction to the hearing aid through the Bluetooth connection.

[0150] Correspondingly, the hearing aid receives the second volume adjustment instruction sent by the display device through the Bluetooth connection.

[0151] S913: The hearing aid adjusts the volume according to the second volume adjustment instruction.

[0152] FIG10 is a schematic diagram of an interactive flow of a volume adjustment method according to an embodiment of the present disclosure. As shown in FIG10 , the method includes the following steps:

[0153] S101: A display device receives a first volume adjustment instruction.

[0154] S102: The display device adjusts the volume of the display device according to the first volume adjustment instruction.

[0155] S103: The display device determines whether a Bluetooth connection is established between the display device and the hearing aid supporting the hearing aid service.

[0156] In the above step S103, if the display device has not established a Bluetooth connection with the hearing aid supporting the hearing aid service, the volume adjustment method according to some embodiments ends, and the volume of the display is adjusted only according to the received volume adjustment instruction. If the display device has established a Bluetooth connection with the hearing aid supporting the hearing aid service, the following step S104 is executed:

[0157] S104: The display device obtains a first volume value and a second volume value.

[0158] The first volume value is the volume value of the display device after the volume of the display device is adjusted according to the first volume adjustment instruction, and the second volume value is the volume value of the hearing aid.

[0159] The implementation of the above steps S101 to S104 is similar to the implementation of steps S71 to S74 in the embodiment shown in FIG. 7 , and will not be described in detail here.

[0160] S105: The display device obtains a first volume difference.

[0161] The first volume difference is the absolute value of the difference between the first volume value and the second volume value.

[0162] S106: The display device determines whether the first volume difference is greater than a preset threshold.

[0163] In the above step S106 , if the first volume difference is not greater than the preset threshold, the following step S107 is executed, and the method flow of the volume adjustment method according to some embodiments ends.

[0164] S107: The display device determines that the condition for adjusting the volume of the hearing aid is not met.

[0165] In the above step S106, if the first volume difference is greater than the preset threshold, the following step S108 and subsequent steps are executed:

[0166] S108: The display device determines that a condition for adjusting the volume of the hearing aid is met.

[0167] S109: The display device obtains the loudness of the ambient sound.

[0168] S110. The display device obtains a target volume value according to the loudness of the ambient sound and a preset mapping relationship.

[0169] The preset mapping relationship includes a mapping relationship between the loudness and volume value of each ambient sound.

[0170] S111. The display device generates a volume adjustment instruction for controlling the volume value of the hearing aid to be adjusted to the target volume value.

[0171] In an embodiment of the present disclosure, the target volume value is 8, and a volume adjustment instruction for controlling the volume value of the hearing aid to be adjusted to 8 may be generated.

[0172] In an embodiment of the present disclosure, the target volume value is 6, and a volume adjustment instruction for controlling the volume value of the hearing aid to be adjusted to 6 may be generated.

[0173] S112: The display device sends the second volume adjustment instruction to the hearing aid through the Bluetooth connection.

[0174] Correspondingly, the hearing aid receives the second volume adjustment instruction sent by the display device through the Bluetooth connection.

[0175] S113: The hearing aid adjusts the volume according to the second volume adjustment instruction.

[0176] FIG11 is a schematic diagram of an interactive flow of another volume adjustment method according to an embodiment of the present disclosure. As shown in FIG11 , the method includes the following steps:

[0177] S1101. The hearing aid broadcasts a broadcast packet for requesting to establish a Bluetooth connection.

[0178] The broadcast packet carries an appearance attribute field (Apperance) of the hearing aid.

[0179] In an embodiment of the present disclosure, when the hearing aid is a hearing aid of no special type, the appearance attribute field carried by the broadcast packet may be "Hearing Aid"; when the hearing aid is a generic hearing aid, the appearance attribute field carried by the broadcast packet may be "Generic Hearing Aid"; when the hearing aid is an in-ear hearing aid, the appearance attribute field carried by the broadcast packet may be "In-ear Hearing Aid"; when the hearing aid is a behind-the-ear hearing aid, the appearance attribute field carried by the broadcast packet may be "Behind-ear Hearing Aid".

[0180] Since the broadcast packet is sent by broadcast, when the display device is located in the broadcast packet sending range of the hearing aid, the display device can receive the broadcast packet sent by the hearing aid for requesting to establish a Bluetooth connection with the display device.

[0181] S1102: The display device parses the broadcast packet to obtain an appearance attribute field carried by the broadcast packet.

[0182] That is, the display device extracts the field corresponding to the appearance attribute field according to the Bluetooth configuration protocol, thereby obtaining the appearance attribute field carried by the broadcast packet.

[0183] S1103: The display device determines whether the appearance attribute field belongs to a preset appearance attribute field set.

[0184] The preset appearance attribute field set includes appearance attribute fields of at least one type of hearing aid.

[0185] It should be noted that to more accurately identify whether a Bluetooth paired device is a hearing aid, the preset appearance attribute field set should include appearance attribute fields for various types of hearing aids as much as possible. In some embodiments, the preset appearance attribute field set may include appearance attribute fields for hearing aids such as "Hearing Aid," "Generic Hearing Aid," "In-ear Hearing Aid," and "Behind-ear Hearing Aid."

[0186] In step S1103, if the appearance attribute field does not belong to the preset appearance attribute field set, it can be determined that the current pairing requesting device is not a hearing aid. Therefore, the current Bluetooth-connected device can be marked as not a hearing aid using the system attribute method, and the information is synchronized to the audio control module, and a Bluetooth connection is established with the pairing requesting device. When a volume adjustment command is subsequently received, the audio control module adjusts the volume of the display device only according to the received volume adjustment command.

[0187] In the above step S1103, if the appearance attribute field belongs to the preset appearance attribute field set, the following step S1104 is executed:

[0188] S1104: The display device determines whether the pairing requesting device supports the hearing aid service.

[0189] In some embodiments, the implementation method of the display device determining whether the pairing requesting device (hearing aid) supports the hearing aid service may include the following steps 1 to 5:

[0190] Step 1: The display device sends a service query request to the pairing request device during the process of establishing a Bluetooth connection with the pairing request device.

[0191] Step 2: The pairing requesting device sends a service query response to the display device.

[0192] The service query response carries a universally unique identifier (UUID) of each service supported by the pairing requesting device.

[0193] That is, if the hearing aid supports HAS, the UUID of HAS is carried in the service query response, and if the hearing aid does not support HAS, the UUID of HAS is not carried in the service query response.

[0194] In some embodiments, the display device may send a service query request to the pairing requesting device via the Attribute Protocol (ATT), and the pairing requesting device may also send a service query response to the display device via the ATT.

[0195] In some embodiments, the service query response may be as shown in Table 2 below:

[0196] Table 2

[0197] Step 3: Determine whether the service query response carries the universal unique identification code of the hearing aid service.

[0198] In some embodiments, the UUID of the hearing aid service is 0x1855, so determining whether the service query response carries the universal unique identifier of the hearing aid service is: determining whether the service query response carries the UUID of 0x1855.

[0199] In step 3 above, if the service query response carries the universal unique identifier of the hearing aid service, then execute step 4 below. If the service query response does not carry the universal unique identifier of the hearing aid service, then execute step 5 below:

[0200] Step 4: The display device determines whether the pairing requesting device supports the hearing aid service.

[0201] Step 5: The display device determines that the pairing requesting device does not support the hearing aid service.

[0202] If the display device determines that the pairing requesting device supports the hearing aid service, the display device can mark the current Bluetooth connected device as a hearing aid that supports the hearing aid service through the system property method, and synchronize it to the audio control module. If the display device determines that the pairing requesting device does not support the hearing aid service, the display device can mark the current Bluetooth connected device as a hearing aid that supports the hearing aid service through the system property method, and synchronize it to the audio control module.

[0203] In the above step S1104 , if the display device determines that the pairing requesting device supports the hearing aid service, the following step S1105 is executed.

[0204] S1105: After establishing a Bluetooth connection with the pairing requesting device, the display device determines that a Bluetooth connection has been established between the display device and the hearing aid supporting the hearing aid service.

[0205] S1106: The display device receives a first volume adjustment instruction.

[0206] S1107: The display device adjusts the volume of the display device according to the first volume adjustment instruction.

[0207] S1108: The display device obtains a first volume value and a second volume value.

[0208] S1109: The display device determines whether a hearing aid volume adjustment condition is met according to the first volume value and the second volume value.

[0209] In the above step S1109, if it is determined based on the first volume value and the second volume value that the hearing aid volume adjustment condition is not satisfied, then the volume adjustment method according to some embodiments ends. If it is determined based on the first volume value and the second volume value that the condition for adjusting the hearing aid volume is satisfied, the following step S1110 is executed:

[0210] S1110: The display device obtains the loudness of the ambient sound.

[0211] S1111. The display device generates a second volume adjustment instruction according to the loudness of the ambient sound.

[0212] S1112. The display device sends the second volume adjustment instruction to the hearing aid through the Bluetooth connection.

[0213] Correspondingly, the hearing aid receives the second volume adjustment instruction sent by the display device through the Bluetooth connection.

[0214] S1113: The hearing aid adjusts the volume according to the second volume adjustment instruction.

[0215] FIG12 is a flow chart showing a method for adjusting volume in an embodiment of the present disclosure. The volume adjustment method may be performed by the display device 200 in the embodiment shown in FIG1 . As shown in FIG12 , the method includes the following steps:

[0216] S121: Receive a third volume adjustment instruction.

[0217] In some embodiments, the display device receiving the third volume adjustment instruction may include: the display device receiving the third volume adjustment instruction sent by a remote controller or a terminal device through a user interface.

[0218] In other embodiments, the display device receiving the third volume adjustment instruction may include: the display device receiving a user operation on a volume adjustment button of the display device through a user interface, and generating the third volume adjustment instruction according to the user operation on the volume adjustment button.

[0219] The third volume adjustment instruction in the disclosed embodiment may be a third volume adjustment instruction for increasing the volume by a preset value, a third volume adjustment instruction for decreasing the volume by a preset value, or a third volume adjustment instruction for adjusting the volume to a specified volume value. For example, if a user presses the "volume +" button on a remote control, the remote control sends a third volume adjustment instruction for increasing the volume by 1 to the display device; in response, the display device receives the third volume adjustment instruction for increasing the volume by 1 sent by the remote control.

[0220] S122: Determine whether the display device has established a Bluetooth connection with a hearing aid that supports Hearing Aid Service (HAS).

[0221] In some embodiments, the implementation method of determining whether the display device has established a Bluetooth connection with a hearing aid that supports hearing aid services may include: the display device determines, through at least one processor, whether a Bluetooth connection is currently established with other devices; if the display device does not currently establish a Bluetooth connection with other devices, determining that the display device has not established a Bluetooth connection with the hearing aid that supports hearing aid services; and if the display device currently establishes a Bluetooth connection with other devices, determining whether the device is a hearing aid (Hearing Aid, HA) and whether the device supports hearing aid services; if the device is not a hearing aid and / or the device does not support hearing aid services, determining that the display device has not established a Bluetooth connection with the hearing aid that supports hearing aid services; and if the device is a hearing aid and supports hearing aid services, determining that the display device has established a Bluetooth connection with the hearing aid that supports hearing aid services.

[0222] It should be noted that in the LE Audio technical specification, the hearing aid protocol defines the hearing aid remote control role of the hearing aid. The hearing aid remote control can send control signals such as volume adjustment to the hearing aid and be executed by the hearing aid. Therefore, only when the hearing aid supports the hearing aid service, the display device can act as a hearing aid remote control to send volume adjustment information to the hearing aid and be executed by the hearing aid. Therefore, the present disclosure needs to determine that a Bluetooth connection has been established with the hearing aid that supports the hearing aid service before executing subsequent steps to adjust the volume of the hearing aid.

[0223] The Bluetooth connection in the embodiment of the present disclosure may be a Bluetooth connection established based on Low Energy Audio (LE audio).

[0224] In the above step S122, if the display device has established a Bluetooth connection with the hearing aid supporting the hearing aid service, the following step S123 is executed:

[0225] S123: Determine, according to a selection operation input by the user, whether the third volume adjustment instruction is used to adjust the volume of the hearing aid.

[0226] In some embodiments, the display device may display a volume adjustment object selection interface through the display device, and determine whether the third volume adjustment instruction is used to adjust the volume of the hearing aid according to a selection operation input by the user in the volume adjustment object selection interface.

[0227] In other embodiments, the display device may also output voice information through an audio output interface to prompt the user to select whether the third volume adjustment instruction is used to adjust the volume of the hearing aid, and obtain at least one of the voice instructions, gestures, posture, body movements, etc. input by the user through a detector, and determine whether the third volume adjustment instruction is used to adjust the volume of the hearing aid based on the user's input.

[0228] In the above step S123, if the third volume adjustment instruction is used to adjust the volume of the hearing aid, the following step S124 is executed:

[0229] S124: Forward the third volume adjustment instruction to the hearing aid through the Bluetooth connection to adjust the volume of the hearing aid.

[0230] In some implementations, before forwarding the third volume adjustment instruction to the hearing aid through the Bluetooth connection, the display device further encapsulates the third volume adjustment instruction based on a Bluetooth communication protocol between the display device and the hearing aid.

[0231] According to some embodiments, when a volume adjustment method receives a third volume adjustment instruction, it first determines whether the display device has established a Bluetooth connection with a hearing aid that supports the hearing aid service. If the display device has established a Bluetooth connection with the hearing aid that supports the hearing aid service, it determines whether the third volume adjustment instruction is used to adjust the volume of the hearing aid based on a selection operation input by the user. If the third volume adjustment instruction is used to adjust the volume of the hearing aid, the method forwards the third volume adjustment instruction to the hearing aid via the Bluetooth connection to adjust the volume of the hearing aid. Compared to taking off the hearing aid and adjusting the volume of the hearing aid using the volume adjustment button on the hearing aid, or adjusting the volume of the hearing aid using a hearing aid remote control device on a separate device, in the embodiment of the present disclosure, if the hearing aid supports the hearing aid service and has established a Bluetooth connection with the display device, the display device can adjust the volume of the hearing aid based on the user's selection operation. Therefore, the embodiment of the present disclosure can simplify the user operation when adjusting the volume of the hearing aid, thereby improving the user experience.

[0232] FIG13 is a schematic diagram of an interactive flow of a volume adjustment method according to an embodiment of the present disclosure. As shown in FIG13 , the method includes the following steps:

[0233] S1301: The display device receives a third volume adjustment instruction.

[0234] In the following embodiments, the third volume adjustment instruction is taken as an example to describe the third volume adjustment instruction for increasing the volume value by 1.

[0235] S1302: The display device determines whether a Bluetooth connection has been established between the display device and the hearing aid supporting HAS.

[0236] In the above step S1302, if the display device does not establish a Bluetooth connection with the hearing aid supporting HAS, the following step S1303 is executed.

[0237] The following situations may occur where the display device fails to establish a Bluetooth connection with the HAS-supported hearing aid:

[0238] Case 1: The display device has not established a Bluetooth connection with other devices.

[0239] Case 2: The display device has established a Bluetooth connection with a device other than the hearing aid.

[0240] Case 3: The display device has established a Bluetooth connection with a hearing aid that does not support HAS.

[0241] S1303: The display device adjusts the volume of the display device according to the third volume adjustment instruction.

[0242] As described in the above example, the third volume adjustment instruction is a third volume adjustment instruction for increasing the volume value by 1. If the current volume value of the display device is 5, the volume value of the display device is increased by 1 by executing the third volume adjustment instruction, thereby adjusting the volume value of the display device to 6.

[0243] In the above step S1302, if the display device establishes a Bluetooth connection with the hearing aid supporting HAS, the following step S1304 is executed.

[0244] S1304: The display device displays a volume adjustment object selection interface.

[0245] The volume adjustment object selection interface includes a first control for representing the display device and a second control for representing the hearing aid.

[0246] That is, the display device displays the volume adjustment object selection interface through the display.

[0247] In one embodiment of the present disclosure, as shown in FIG. 14 , in some embodiments, a volume adjustment object selection interface includes a prompt "Please select the device for volume adjustment," a first control 91 representing the display device, and a second control 92 representing the hearing aid. The user can select the device for volume adjustment based on the prompt, first control 91, and second control 92.

[0248] S1305: The display device receives the selection operation.

[0249] The selection operation is an operation on the first control or the second control.

[0250] In some embodiments, the display device receiving the selection operation may include: the remote control generating the selection operation based on the user operating a physical button on the remote control, and transmitting the selection operation to the display device. For example, the user first selects the first control or the second control by inputting a direction key on the remote control, and then confirms that the selected device is the device for which volume adjustment is to be performed by inputting a confirmation key on the remote control.

[0251] In one embodiment of the present disclosure, as shown in FIG15 , FIG15 illustrates the above embodiment using an example in which a user selects a hearing aid as the device for volume adjustment via a remote control. As shown in FIG15 , the user first presses the directional key 101 on the remote control to select the second control in the volume adjustment object selection interface. The display device highlights the second control by making its border thicker, increasing its brightness, and adding audio and video to the second control, indicating that the second control has been selected. The user then presses the confirmation key 102 on the remote control 100 to confirm the selected device (the device represented by the second control - the hearing aid) as the device for volume adjustment. The display device then jumps to the hearing aid volume adjustment interface for adjusting the hearing aid volume.

[0252] In a certain embodiment of the present disclosure, referring to FIG16 , FIG16 takes the example of a user selecting a display device as a device for which volume adjustment is to be performed through a remote control to illustrate the above embodiment. As shown in FIG16 , the user first inputs the direction key 101 on the remote control to select the first control in the volume adjustment object selection interface. Similarly, the display device can highlight the first control by making the border of the second control thicker, increasing the brightness of the second control, adding audio and video to the second control, etc., to indicate that the first control has been selected; and then input the confirmation key 102 on the remote control 100 to determine the selected device (the device represented by the second control - the display device) as the device for which volume adjustment is to be performed, and the display device further adjusts the volume according to the volume adjustment instruction.

[0253] In the above step S1305, if the selection operation is an operation on the first control, it can be determined that the device on which the user wants to adjust the volume is a display device, so the above step S1306 is executed, and the above step S1303 adjusts the volume of the display device according to the third volume adjustment instruction.

[0254] S1306: The display device determines that the third volume adjustment instruction is used to adjust the volume of the hearing aid.

[0255] In the above step S1305, if the selection operation is an operation on the second control, it can be determined that the device for which the user wants to adjust the volume is a hearing aid, and therefore the above step S1307 and subsequent steps are executed.

[0256] S1307: The display device determines that the third volume adjustment instruction is used to adjust the volume of the display device.

[0257] S1308: The display device forwards the third volume adjustment instruction to the hearing aid through the Bluetooth connection.

[0258] In response, the hearing aid receives the third volume adjustment instruction forwarded by the display device through the Bluetooth connection.

[0259] S1309: The hearing aid adjusts the volume according to the third volume adjustment instruction.

[0260] As described in the above example, the third volume adjustment instruction is a third volume adjustment instruction for increasing the volume value by 1. If the current volume value of the hearing aid is 8, the hearing aid increases the volume value by 1 by executing the third volume adjustment instruction, thereby adjusting the volume value of the hearing aid to 9.

[0261] In the above embodiment, when the display device receives the third volume adjustment instruction and a Bluetooth connection is established between the display device and the hearing aid that supports HAS, the display device displays a volume adjustment object selection interface. The user can choose to adjust the volume of the display device or the hearing aid by displaying the volume adjustment object selection interface. Therefore, the above embodiment can further meet possible volume adjustment needs, thereby improving the user experience.

[0262] FIG17 is a schematic diagram of an interactive flow of another volume adjustment method according to an embodiment of the present disclosure. As shown in FIG17 , the method includes the following steps:

[0263] S171. The hearing aid broadcasts a broadcast packet for requesting to establish a Bluetooth connection.

[0264] The broadcast packet carries an appearance attribute field (Apperance) of the hearing aid.

[0265] In an embodiment of the present disclosure, when the hearing aid is a hearing aid of no special type, the appearance attribute field carried by the broadcast packet may be "Hearing Aid"; when the hearing aid is a generic hearing aid, the appearance attribute field carried by the broadcast packet may be "Generic Hearing Aid"; when the hearing aid is an in-ear hearing aid, the appearance attribute field carried by the broadcast packet may be "In-ear Hearing Aid"; when the hearing aid is a behind-the-ear hearing aid, the appearance attribute field carried by the broadcast packet may be "Behind-ear Hearing Aid".

[0266] Since the broadcast packet is sent by broadcast, when the display device is located in the broadcast packet sending range of the hearing aid, the display device can receive the broadcast packet sent by the hearing aid for requesting to establish a Bluetooth connection with the display device.

[0267] S172: The display device parses the broadcast packet to obtain an appearance attribute field carried by the broadcast packet.

[0268] That is, the display device extracts the field corresponding to the appearance attribute field according to the Bluetooth configuration protocol, thereby obtaining the appearance attribute field carried by the broadcast packet.

[0269] S173: The display device determines whether the appearance attribute field belongs to a preset appearance attribute field set.

[0270] The preset appearance attribute field set includes appearance attribute fields of at least one type of hearing aid.

[0271] It should be noted that to more accurately identify whether a Bluetooth paired device is a hearing aid, the preset appearance attribute field set should include appearance attribute fields for various types of hearing aids as much as possible. In some embodiments, the preset appearance attribute field set may include appearance attribute fields for hearing aids such as "Hearing Aid," "Generic Hearing Aid," "In-ear Hearing Aid," and "Behind-ear Hearing Aid."

[0272] In step S173, if the appearance attribute field does not belong to the preset appearance attribute field set, it can be determined that the current pairing requesting device is not a hearing aid. Therefore, the current Bluetooth-connected device can be marked as not a hearing aid using a system attribute method, and the information is synchronized to the audio control module, and a Bluetooth connection is established with the pairing requesting device. Upon subsequently receiving a third volume adjustment instruction, the audio control module adjusts the volume of the display device according to the received third volume adjustment instruction.

[0273] In the above step S173, if the appearance attribute field belongs to the preset appearance attribute field set, the following step S174 is executed:

[0274] S174: The display device determines whether the pairing requesting device supports the hearing aid service.

[0275] In some embodiments, the implementation method of the display device determining whether the pairing requesting device (hearing aid) supports the hearing aid service may include the following steps 1 to 5:

[0276] Step 1: The display device sends a service query request to the pairing request device during the process of establishing a Bluetooth connection with the pairing request device.

[0277] Step 2: The pairing requesting device sends a service query response to the display device.

[0278] The service query response carries a universally unique identifier (UUID) of each service supported by the pairing requesting device.

[0279] That is, if the hearing aid supports HAS, the UUID of HAS is carried in the service query response, and if the hearing aid does not support HAS, the UUID of HAS is not carried in the service query response.

[0280] In some embodiments, the display device may send a service query request to the pairing requesting device via the Attribute Protocol (ATT), and the pairing requesting device may also send a service query response to the display device via the ATT.

[0281] In some embodiments, the service query response may be as shown in Table 3 below:

[0282] Table 3

[0283] Step 3: Determine whether the service query response carries the universal unique identification code of the hearing aid service.

[0284] In some embodiments, the UUID of the hearing aid service is 0x1855, so determining whether the service query response carries the universal unique identifier of the hearing aid service is: determining whether the service query response carries the UUID of 0x1855.

[0285] In step 3 above, if the service query response carries the universal unique identifier of the hearing aid service, then execute step 4 below. If the service query response does not carry the universal unique identifier of the hearing aid service, then execute step 5 below:

[0286] Step 4: The display device determines whether the pairing requesting device supports the hearing aid service.

[0287] Step 5: The display device determines that the pairing requesting device does not support the hearing aid service.

[0288] If the display device determines that the pairing requesting device supports the hearing aid service, the display device can mark the current Bluetooth connected device as a hearing aid that supports the hearing aid service through the system property method, and synchronize it to the audio control module. If the display device determines that the pairing requesting device does not support the hearing aid service, the display device can mark the current Bluetooth connected device as a hearing aid that supports the hearing aid service through the system property method, and synchronize it to the audio control module.

[0289] In the above step S174 , if the display device determines that the pairing requesting device supports the hearing aid service, the following step S175 is executed.

[0290] S175 . After establishing a Bluetooth connection with the pairing requesting device, determine whether the display device has established a Bluetooth connection with a hearing aid supporting hearing aid service.

[0291] S176: The display device receives a third volume adjustment instruction.

[0292] S177: The display device determines, according to a selection operation input by the user, whether the third volume adjustment instruction is used to adjust the volume of the hearing aid.

[0293] In the above step S177, if the third volume adjustment instruction is used to adjust the volume of the hearing aid, the following step S178 is executed:

[0294] S178. The display device forwards the third volume adjustment instruction to the hearing aid through the Bluetooth connection.

[0295] Correspondingly, the hearing aid receives the third volume adjustment instruction sent by the display device through the Bluetooth connection.

[0296] S179: The hearing aid adjusts the volume according to the third volume adjustment instruction.

[0297] FIG18 is a schematic diagram of an interaction flow diagram of another volume adjustment method in an embodiment of the present disclosure. As shown in FIG18 , the method includes the following steps:

[0298] S181: The display device receives a third volume adjustment instruction.

[0299] S182: The display device determines whether the previous instruction of the third volume adjustment instruction is the third volume adjustment instruction.

[0300] That is, the display device determines whether the control instruction received most recently before receiving the third volume adjustment instruction is also the third volume adjustment instruction.

[0301] In the above step S182, if the previous instruction of the third volume adjustment instruction is also the third volume adjustment instruction, the following step S183 is executed.

[0302] S183: The display device determines whether the previous instruction of the third volume adjustment instruction is a third volume adjustment instruction for adjusting the volume of the hearing aid.

[0303] In the above step S182, if the previous instruction of the third volume adjustment instruction is a third volume adjustment instruction for adjusting the volume of the display device, then execute the following step S184, and if the previous instruction of the third volume adjustment instruction is a third volume adjustment instruction for adjusting the volume of the hearing aid, then execute the following steps S185 and S186.

[0304] S184: The display device adjusts the volume of the display device according to the third volume adjustment instruction.

[0305] S185. The display device forwards the third volume adjustment instruction to the hearing aid through the Bluetooth connection.

[0306] Correspondingly, the hearing aid receives the third volume adjustment instruction sent by the display device through the Bluetooth connection.

[0307] S186. The hearing aid adjusts the volume according to the third volume adjustment instruction.

[0308] In the above step S182, if the previous instruction of the third volume adjustment instruction is not the third volume adjustment instruction, jump to the following step S187.

[0309] S187: The display device determines whether a Bluetooth connection is established between the display device and the hearing aid supporting the hearing aid service.

[0310] In the above step S187, if the display device has not established a Bluetooth connection with the hearing aid supporting the hearing aid service, the process returns to step S184 and adjusts the volume of the display device according to the third volume adjustment instruction.

[0311] In the above step S187, if the display device establishes a Bluetooth connection with the hearing aid supporting the hearing aid service, the following step S188 is executed to adjust the volume of the display device according to the third volume adjustment instruction.

[0312] S188. The display device determines, according to a selection operation input by the user, whether the third volume adjustment instruction is used to adjust the volume of the hearing aid.

[0313] In the above step S188, if the third volume adjustment instruction is used to adjust the volume of the display device, then the process returns to step S184 to adjust the volume of the display device according to the third volume adjustment instruction.

[0314] In the above step S188, if the third volume adjustment instruction is used to adjust the volume of the display device, then the process returns to execute the above steps S185 and S186, and the display device forwards the third volume adjustment instruction to the hearing aid via the Bluetooth connection, and the hearing aid adjusts the volume according to the third volume adjustment instruction. After the display device receives the third volume adjustment instruction, it first determines whether the previous instruction is the third volume adjustment instruction. If the previous instruction is also the third volume adjustment instruction and the previous instruction is the third volume adjustment instruction for adjusting the volume of the display device, the volume of the display device is adjusted according to the third volume adjustment instruction. If the previous instruction is also the third volume adjustment instruction and the previous instruction is the third volume adjustment instruction for adjusting the volume of the hearing aid, the volume of the hearing aid is adjusted according to the third volume adjustment instruction. Therefore, the above embodiment can avoid repeatedly requiring the user to select the volume adjustment object during continuous volume adjustment, thereby simplifying the volume adjustment operation and improving the volume adjustment efficiency.

Claims

1. A display device, comprising: a display configured to display an image and / or a user interface; A user interface configured to receive instructions from a user; a communicator configured to communicate with an external device according to a predetermined protocol; a memory configured to store computer instructions and data associated with a display device; At least one processor, connected to the display, user interface, communicator and memory, is configured to execute computer instructions to cause the display device to perform: receiving a first volume adjustment instruction; Adjusting the volume of the display device according to the first volume adjustment instruction, and obtaining a first volume value and a second volume value when the display device establishes a Bluetooth connection with a hearing aid that supports the hearing assistance service (HAS); the first volume value is the volume value of the display device after the volume of the display device is adjusted according to the first volume adjustment instruction, and the second volume value is the volume value of the hearing aid; obtaining the loudness of the ambient sound when it is determined that a condition for adjusting the volume of the hearing aid is met according to the first volume value and the second volume value; generating a second volume adjustment instruction according to the loudness of the ambient sound; The second volume adjustment instruction is sent to the hearing aid through the Bluetooth connection to adjust the volume of the hearing aid.

2. The display device according to claim 1, wherein the at least one processor is further configured to execute computer instructions to cause the display device to perform: Obtaining a first volume difference, where the first volume difference is an absolute value of a difference between the first volume value and the second volume value; Determining whether the first volume difference is greater than a preset threshold; If so, determining that the condition for adjusting the volume of the hearing aid is met; If not, it is determined that the condition for adjusting the volume of the hearing aid is not met.

3. The display device according to claim 1 , wherein the at least one processor is further configured to execute computer instructions to cause the display device to: Obtaining a target volume value according to the loudness of the ambient sound and a preset mapping relationship; the preset mapping relationship includes a mapping relationship between the loudness of each ambient sound and the volume value; The second volume adjustment instruction is generated according to the target volume value and the second volume value.

4. The display device according to claim 3, wherein the at least one processor is further configured to execute computer instructions to cause the display device to perform: Acquire a second volume difference, where the second volume difference is an absolute value of a difference between the target volume value and the second volume value; A volume adjustment instruction for controlling the volume value of the hearing aid to increase or decrease is generated based on the second volume difference.

5. The display device according to claim 1 , wherein the at least one processor is further configured to execute computer instructions to cause the display device to: Obtaining a target volume value according to the loudness of the ambient sound and a preset mapping relationship; the preset mapping relationship includes a mapping relationship between the loudness of each ambient sound and the volume value; A volume adjustment instruction is generated for controlling the volume value of the hearing aid to be adjusted to the target volume value.

6. The display device according to claim 1 , wherein the at least one processor is further configured to execute computer instructions to cause the display device to: Upon receiving a broadcast packet sent by a pairing requesting device for requesting to establish a Bluetooth connection with the display device, parsing the broadcast packet to obtain an appearance attribute field carried in the broadcast packet; determining whether the appearance attribute field belongs to a preset appearance attribute field set, the preset appearance attribute field set including appearance attribute fields of at least one type of hearing aid; If the appearance attribute field belongs to the preset appearance attribute field set, determining whether the pairing requesting device supports the hearing aid service; If the pairing requesting device supports the hearing aid service, after establishing a Bluetooth connection with the pairing requesting device, it is determined whether the display device has established a Bluetooth connection with the hearing aid supporting the hearing aid service.

7. The display device according to claim 6, wherein the communicator is further configured to send a service query request to the pairing requesting device during the process of establishing a Bluetooth connection with the pairing requesting device, and receive a service query response sent by the pairing requesting device, wherein the service query response carries a universal unique identifier of each service supported by the pairing requesting device; The at least one processor is further configured to execute computer instructions to cause the display device to perform: Determine whether the service query response carries the universal unique identifier of the hearing aid service; if the service query response carries the universal unique identifier of the hearing aid service, determine that the pairing requesting device supports the hearing aid service; if the service query response does not carry the universal unique identifier of the hearing aid service, determine that the pairing requesting device does not support the hearing aid service.

8. The display device according to any one of claims 1 to 7, wherein the user interface is further configured to receive a third volume adjustment instruction; The at least one processor is further configured to execute computer instructions to enable the display device to determine whether a Bluetooth connection is established between the display device and a hearing aid supporting a hearing assistance service (HAS); and When a Bluetooth connection is established between the display device and the hearing aid supporting the hearing aid service, determining, according to a selection operation input by a user, whether the third volume adjustment instruction is used to adjust the volume of the hearing aid; The communicator is further configured to forward the third volume adjustment instruction to the hearing aid via the Bluetooth connection to adjust the volume of the hearing aid when the third volume adjustment instruction is used to adjust the volume of the hearing aid.

9. The display device according to claim 8, wherein the display is further configured to display a volume adjustment object selection interface when a Bluetooth connection is established between the display device and the hearing aid supporting the hearing aid service; the volume adjustment object selection interface includes a first control for representing the display device and a second control for representing the hearing aid; The user interface is further configured to receive a selection operation; the selection operation is an operation on the first control or the second control; The at least one processor is further configured to execute computer instructions so that the display device determines, when the selection operation is an operation on the first control, that the third volume adjustment instruction is used to adjust the volume of the hearing aid; and when the selection operation is an operation on the second control, determines, when the third volume adjustment instruction is used to adjust the volume of the display device.

10. The display device according to claim 9, wherein the at least one processor is further configured to execute computer instructions to cause the display device to: In a case where it is determined that the third volume adjustment instruction is used to adjust the volume of the display device, the volume of the display device is adjusted according to the third volume adjustment instruction.

11. The display device according to claim 8, wherein the at least one processor is further configured to execute computer instructions to cause the display device to: Upon receiving a broadcast packet sent by a pairing requesting device for requesting to establish a Bluetooth connection with the display device, parsing the broadcast packet to obtain an appearance attribute field carried in the broadcast packet; determining whether the appearance attribute field belongs to a preset appearance attribute field set, the preset appearance attribute field set including appearance attribute fields of at least one type of hearing aid; If the appearance attribute field belongs to the preset appearance attribute field set, determining whether the pairing requesting device supports the hearing aid service; If the pairing requesting device supports the hearing aid service, after establishing a Bluetooth connection with the pairing requesting device, it is determined whether the display device has established a Bluetooth connection with the hearing aid supporting the hearing aid service.

12. The display device according to claim 11, wherein the communicator is further configured to send a service query request to the pairing requesting device during a process of establishing a Bluetooth connection with the pairing requesting device, and receive a service query response sent by the pairing requesting device, wherein the service query response carries a universal unique identifier of each service supported by the pairing requesting device; The at least one processor is further configured to execute computer instructions to enable the display device to determine whether the service query response carries the universal unique identifier of the hearing aid service; if the service query response carries the universal unique identifier of the hearing aid service, it is determined that the pairing requesting device supports the hearing aid service; if the service query response does not carry the universal unique identifier of the hearing aid service, it is determined that the pairing requesting device does not support the hearing aid service.

13. The display device according to claim 8, wherein the at least one processor is further configured to execute computer instructions to cause the display device to: Before determining whether a Bluetooth connection is established between the display device and the hearing aid supporting the hearing aid service, determining whether a previous instruction of the third volume adjustment instruction is the third volume adjustment instruction; If the previous instruction of the third volume adjustment instruction is the third volume adjustment instruction, determining whether the previous instruction of the third volume adjustment instruction is a third volume adjustment instruction for adjusting the volume of the hearing aid; If so, the third volume adjustment instruction is forwarded to the hearing aid via the Bluetooth connection to adjust the volume of the hearing aid.

14. The display device according to claim 13, wherein the at least one processor is further configured to execute computer instructions to cause the display device to: If the previous instruction of the third volume adjustment instruction is a third volume adjustment instruction for adjusting the volume of the display device, the volume of the display device is adjusted according to the third volume adjustment instruction.

15. A volume adjustment method for a display device, the method comprising: receiving a first volume adjustment instruction; adjusting the volume of the display device according to the first volume adjustment instruction; When a Bluetooth connection is established between the display device and a hearing aid supporting an assisted hearing service (HAS), obtaining a first volume value and a second volume value; the first volume value is the volume value of the display device after the volume of the display device is adjusted according to the first volume adjustment instruction, and the second volume value is the volume value of the hearing aid; obtaining the loudness of the ambient sound when it is determined that a condition for adjusting the volume of the hearing aid is met according to the first volume value and the second volume value; generating a second volume adjustment instruction according to the loudness of the ambient sound; The second volume adjustment instruction is sent to the hearing aid through the Bluetooth connection to adjust the volume of the hearing aid.

16. The method according to claim 15, further comprising: receiving a third volume adjustment instruction; Determining whether the display device has established a Bluetooth connection with a hearing aid that supports the hearing assistance service HAS; When a Bluetooth connection is established between the display device and the hearing aid supporting the hearing aid service, determining, according to a selection operation input by a user, whether the third volume adjustment instruction is used to adjust the volume of the hearing aid; In a case where the third volume adjustment instruction is used to adjust the volume of the hearing aid, the third volume adjustment instruction is forwarded to the hearing aid via the Bluetooth connection to adjust the volume of the hearing aid.

Images