Display device and wireless networking ranging method

By introducing a time synchronization mechanism into the display device and utilizing the timestamp calculation method of the first processor and the second processor, the problem of inaccurate wireless networking ranging is solved, higher-precision networking ranging is achieved, and hardware changes and cost increases are avoided.

CN119865655BActive Publication Date: 2025-10-21HISENSE VISUAL TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202411911687.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-12-23
Publication Date
2025-10-21
Estimated Expiration
2044-12-23

AI Technical Summary

Technical Problem

Existing wireless networking ranging methods are insufficient in accuracy and cannot effectively determine the appropriate positions of external devices and display devices, affecting audio playback effects.

Method used

By introducing a time synchronization mechanism between the first processor and the second processor in the display device, the timestamp of the audio data is used for distance measurement, including when the display device is networked with an external device, the first processor sends a timing instruction to the second processor, the second processor restarts the timing, and collects the audio data played by the external device through the microphone and adds a timestamp, and the first processor receives and calculates the distance.

Benefits of technology

This achieves more accurate wireless networking ranging, avoids time errors caused by hardware structure differences, improves ranging accuracy without changing the hardware structure, and reduces costs.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119865655B_ABST
    Figure CN119865655B_ABST
Patent Text Reader

Abstract

The application relates to a display device and a wireless networking distance measuring method. The display device comprises a display, a communicator, a first processor configured to send first information to a second processor when the display device is wirelessly networked with an external device, a second processor connected with the first processor, which receives the first information to restart timing, returns second information, the first processor receives the second information to start local timing and transmits first audio data added with a first time stamp to the external device through the communicator, a microphone connected with the second processor, which collects audio played by the external device and transmits the audio to the second processor, the second processor receives second audio data and adds a second time stamp and sends the second audio data to the first processor, and the first processor determines the distance between the display device and the external device according to the first audio data, the first time stamp, the second audio data and the second time stamp. The display device can realize more accurate wireless networking distance measurement.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of smart television technology, and in particular to a display device and a wireless networking ranging method. Background Art

[0002] Display devices typically support wireless networking with external devices, such as wireless speakers. During wireless networking, it's necessary to measure the distance between the external device and the display device to determine the optimal placement of the external device. However, the accuracy of wireless distance measurement still needs to be improved. Summary of the Invention

[0003] The present application provides a display device and a wireless networking distance measurement method to improve the accuracy of wireless networking distance measurement.

[0004] In a first aspect, some embodiments provide a display device, including:

[0005] a display configured to display images from the broadcast system and / or the network;

[0006] a communicator configured to connect to a wired network and / or a wireless network;

[0007] The first processor is configured to: when the display device is wirelessly networked with the external device via the communicator, send a first message to the second processor; the first message carries an instruction to restart the timing;

[0008] The second processor is connected to the first processor and is configured to: restart the timing when receiving the first information and return the second information to the first processor;

[0009] The first processor is further configured to: upon receiving the second information returned by the second processor, record the current time, start local timing with the current time as the starting point, and transmit first audio data with a first timestamp added thereto to the external device via the communicator; the first timestamp is obtained based on the local timing;

[0010] a microphone connected to the second processor and configured to: collect audio played by the external device and transmit the collected audio to the second processor; the second audio data is the audio played by the external device after receiving the first audio data;

[0011] The second processor is further configured to: receive the second audio data, add a second timestamp to the second audio data based on a receiving time, and send the second audio data with the second timestamp to the first processor;

[0012] The first processor is further configured to: receive the second audio data with the second timestamp added thereto and returned by the second processor, and determine the distance between the display device and the external device according to the first audio data, the first timestamp, the second audio data and the second timestamp.

[0013] In one embodiment, the first processor is further configured to: when the display device is wirelessly networked with an external device via the communicator, switch the input / output interface to an output mode, send a first level signal to the second processor based on the input / output interface in the output mode, and switch the input / output interface to an input mode after sending the first level signal;

[0014] The second processor is further configured to: restart timing when receiving the first level signal, and return a second level signal to the first processor;

[0015] The first processor is further configured to: receive the second level signal returned by the second processor based on the input and output interface of the input mode, and upon receiving the second level signal, record the current time and start timing on the local end with the current time as the starting point.

[0016] In one embodiment, the first processor is further configured to: transmit first audio data to an external device through a communicator, where the first audio data is square wave audio; and add a first timestamp to the rising edge and / or falling edge of the square wave of the first audio data based on local timing.

[0017] In one embodiment, the first processor is further configured to:

[0018] Mapping a second timestamp corresponding to the second processor to a third timestamp corresponding to the first processor;

[0019] Fitting a corresponding waveform based on the second audio data and the third timestamp; the waveform has the third timestamp corresponding to the peaks and / or troughs of the waveform;

[0020] determining a time difference between a first timestamp corresponding to the first audio data and a third timestamp corresponding to the waveform;

[0021] The distance between the display device and the external device is determined based on the time difference and the speed of sound propagation.

[0022] In one embodiment, the first processor is further configured to:

[0023] Determine the distance difference between the distance and the preset distance;

[0024] When the distance difference is less than a preset difference, determining that the wireless networking between the display device and the external device is valid;

[0025] When the distance difference is greater than or equal to the preset difference, it is determined that the wireless networking between the display device and the external device is invalid.

[0026] In one embodiment, the first processor is a system-level processor of the display device; the second processor is a digital signal processor in the display device.

[0027] In one embodiment, the input and output interface of the first processor is a general purpose input and output interface.

[0028] In one embodiment, the microphone is further configured to transmit the second audio data to the second processor based on pulse density modulation.

[0029] The first processor and the second processor of the above-mentioned display device realize the time synchronization of the first processor and the second processor through the interaction of the first information and the second information, so that the first timestamp added by the first processor to the audio data sent and the second timestamp added to the audio data returned by the second processor can correspond to the same starting time point. This can avoid the corresponding time error caused by the first processor being unable to directly obtain audio from the microphone of the display device and the time required for the second processor to receive and process the audio collected by the microphone. As a result, the distance between the display device and the external device determined based on the first audio data, the first timestamp, the second audio data and the second timestamp is more accurate. In addition, the display device does not require changes to its own hardware, does not require additional microphones or adjustment of the microphone structure, etc., which improves efficiency and reduces costs.

[0030] In a second aspect, some embodiments further provide a wireless networking ranging method, applied to a first processor of a display device, comprising:

[0031] In the case of wireless networking with an external device through the communicator of the display device, sending a first message to the connected second processor; the first message carries an instruction to restart timing;

[0032] Upon receiving the second information returned by the second processor, the current time is recorded, local timing is started with the current time as the starting point, and the first audio data with the first timestamp added is transmitted to the external device via the communicator; the first timestamp is obtained based on the local timing; the second information is returned by the second processor upon receiving the first information and restarting timing;

[0033] receiving second audio data returned by the second processor and having a second timestamp added thereto; the second audio data corresponding to the audio played by the external device after receiving the first audio data; the second audio data being collected by a microphone of the display device and returned by the second processor after having a second timestamp added thereto;

[0034] A distance between the display device and the external device is determined according to the first audio data, the first timestamp, the second audio data, and the second timestamp.

[0035] The first processor of the above-mentioned display device realizes time synchronization with the second processor in the same display device by sending the first information and receiving the second information; based on the time synchronization, the first audio data sent is added with a first timestamp, and the second audio data with a second timestamp added thereto and returned by the second processor is received; since the second audio data is received and played by the external device after receiving the first audio data, and the second timestamp is added by the second processor based on the audio data reception time when the time synchronization is completed, the difference between the first timestamp and the second timestamp can more accurately reflect the time taken for the audio to be transmitted from the external device to the display device, thereby avoiding the corresponding time error caused by the first processor being unable to directly obtain audio from the microphone and the second processor needing time to receive and process the audio collected by the microphone. Furthermore, the first processor can determine a more accurate distance between the display device and the external device based on the first audio data, the first timestamp, the second audio data, and the second timestamp.

[0036] In a third aspect, some embodiments further provide a wireless networking ranging method, applied to a second processor of a display device, comprising:

[0037] In the case where the display device and the external device are wirelessly networked, upon receiving a first message sent by a first processor of the display device, the timing is restarted and a second message is returned to the first processor; the first message carries an instruction to restart the timing; the second message is used to instruct the first processor to record the current time when receiving the second message, and to start local timing with the current time as the starting point, so as to transmit first audio data with a first timestamp added to it to the external device; the first timestamp is obtained based on the local timing of the first processor;

[0038] Receive the second audio data collected by the microphone of the display device, add a second timestamp to the second audio data based on the reception time, and send the second audio data with the second timestamp to the first processor; the second audio data is the audio played after the external device receives the first audio data.

[0039] The second processor of the above-mentioned display device realizes time synchronization with the first processor in the display device by receiving the first information and sending the second information; based on the time synchronization, a second timestamp is added to the second audio data collected by the received microphone and transmitted to the first processor; since the second audio data is received and played by the external device after receiving the first audio data, and the second timestamp is added by the second processor when the time synchronization is completed, the second timestamp can more accurately reflect the time when the audio is transmitted to the display device, avoiding the corresponding time error caused by the first processor being unable to directly obtain audio from the microphone, the second processor needing time to receive and process the audio collected by the microphone, etc., which helps to determine a more accurate distance between the display device and the external device. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the following briefly introduces the drawings required for use in the embodiments of the present application or related technical descriptions. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying any creative work.

[0041] Figure 1 A schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application;

[0042] Figure 2 A schematic diagram of the hardware configuration of a display device provided in some embodiments of the present application;

[0043] Figure 3 A schematic diagram of the hardware configuration of a control device provided in some embodiments of the present application;

[0044] Figure 4 A schematic diagram of software configuration of a display device provided in some embodiments of the present application;

[0045] Figure 5 A schematic diagram of networking of a display device and external devices provided in some embodiments of the present application;

[0046] Figure 6a A schematic diagram of a flow chart of a first processor configured to execute in a display device according to some embodiments of the present application;

[0047] Figure 6b A schematic diagram of a flow chart of a second processor configured to execute in a display device according to some embodiments of the present application;

[0048] Figure 6c A schematic diagram of a flow chart of a microphone configured and executed in a display device provided in some embodiments of the present application;

[0049] Figure 7 A flowchart of a wireless networking ranging method provided in some embodiments of the present application;

[0050] Figure 8 Another flowchart of a wireless networking ranging method provided in some embodiments of the present application;

[0051] Figure 9 A further flowchart of a wireless networking ranging method provided in some embodiments of the present application is provided;

[0052] Figure 10 A timing diagram for synchronizing the SOC chip and the DSP chip in the display device provided in some embodiments of the present application;

[0053] Figure 11 A framework diagram for synchronizing a SOC chip and a DSP chip in a display device provided in some embodiments of the present application;

[0054] Figure 12 A timing diagram of a wireless networking ranging method provided in some embodiments of the present application. DETAILED DESCRIPTION

[0055] The following embodiments are described in detail, with examples illustrated in the accompanying drawings. When the following description refers to the drawings, identical numbers in different figures represent identical or similar elements unless otherwise indicated. The embodiments described in the following embodiments are not intended to represent all possible implementations consistent with the present application. They are merely examples of systems and methods consistent with certain aspects of the present application, as detailed in the claims.

[0056] It should be noted that the brief descriptions of terms in this application are only for the purpose of facilitating the understanding of the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their ordinary and usual meanings.

[0057] In the specification and claims of this application and the accompanying drawings, the terms "first," "second," "third," etc. are used to distinguish similar or similar objects or entities, and are not necessarily intended to limit a particular order or sequence, unless otherwise noted. It should be understood that the terms used in this manner are interchangeable under appropriate circumstances.

[0058] The terms "comprise," "include," and "have," and any variations thereof, are intended to cover but not exclude inclusion; for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.

[0059] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functionality associated with that element.

[0060] In the embodiments of the present application, the display device 200 generally refers to a device capable of displaying images and processing data. For example, the display device 200 includes but is not limited to a smart TV, a mobile terminal, a computer, a monitor, an advertising screen, a wearable device, a virtual reality device, an augmented reality device, etc.

[0061] Figure 1 This is a schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application. Figure 1 As shown in FIG, a user can operate the display device 200 through touch operation, the mobile terminal 300 and the control device 100. For example, the control device 100 can be a remote controller, a stylus pen, a handle, etc.

[0062] The mobile terminal 300 can function as a control device for performing human-computer interaction between a user and the display device 200. The mobile terminal 300 can also function as a communication device for establishing a communication connection with the display device 200 and exchanging data. In some embodiments, the mobile terminal 300 can install software applications with the display device 200, enabling connection and communication via a network communication protocol, enabling one-to-one control operations and data communication. Audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200 for synchronized display.

[0063] like Figure 1 As shown in FIG, the display device 200 also communicates data with the server 400 through various communication methods. The display device 200 may be allowed to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0064] The display device 200 may provide a broadcast receiving television function, and may also additionally provide an intelligent network television function with a computer support function, including but not limited to network television, smart TV, Internet Protocol television (IPTV), etc.

[0065] Figure 2 Some embodiments of this application provide Figure 1 2 is a block diagram of the hardware configuration of the display device 200.

[0066] In some embodiments, the display device 200 may include at least one of a tuner 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0067] In some embodiments, detector 230 is used to collect signals from the external environment or external interactions. For example, detector 230 may include a light receiver, such as a sensor for collecting ambient light intensity; or an image collector, such as a camera, for collecting external environmental scenes, user attributes, or user interaction gestures; or a sound collector, such as a microphone, for receiving external sounds.

[0068] In some embodiments, the display 260 includes a display component for displaying images and a driver component for driving image display. The display 260 is configured to receive image signals output from the controller 250 for display. For example, the display 260 can be used to display video content, image content, menu control interface components, and user control UI interfaces.

[0069] In some embodiments, the communication device 220 is a component used to communicate with an external device or server 400 according to various communication protocol types. The display device 200 can be provided with multiple communication devices 220 depending on the supported communication methods. For example, if the display device 200 supports wireless network communication, the display device 200 can be provided with a communication device 220 including WiFi functionality. If the display device 200 supports Bluetooth connection communication, the display device 200 needs to be provided with a communication device 220 including Bluetooth functionality.

[0070] The communication device 220 can establish a communication connection between the display device 200 and an external device or server 400 via a wireless or wired connection. A wired connection can connect the display device 200 to an external device via a data cable, an interface, or other components. A wireless connection can connect the display device 200 to an external device via a wireless signal or wireless network. The display device 200 can establish a connection with an external device directly or indirectly through a gateway, router, or connection device.

[0071] In some embodiments, the controller 250 may include at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processor, and a power processor, and first to nth interfaces for input / output. The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in a memory. The controller 250 controls the overall operation of the display device 200.

[0072] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0073] In some embodiments, the user may input a user command through a graphical user interface (GUI) displayed on the display 260 , and the user input interface receives the user input command through the graphical user interface (GUI).

[0074] In some embodiments, the audio output device 270 may be a local speaker of the display device 200, or an external audio output device connected to the display device 200. For the external audio output device connected to the display device 200, the display device 200 may further be provided with an external audio output terminal, through which the audio output device may be connected to the display device 200 to output the sound of the display device 200.

[0075] In some embodiments, the user input interface 280 may be configured to receive instructions from a user.

[0076] Figure 3 Some embodiments of this application provide Figure 1 The hardware configuration diagram of the control device in the figure is as follows. Figure 3 As shown, the control device 100 may include: a controller 110, a communication interface 130, a user input / output interface, a memory, and a power supply.

[0077] The control device 100 is configured to control the display device 200 , and can receive user input operation instructions, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, playing the role of an interactive intermediary between the user and the display device 200 .

[0078] In some embodiments, the control device 100 may be a smart device. For example, the control device 100 may be installed with various applications for controlling the display device 200 according to user needs.

[0079] In some embodiments, as Figure 1 As shown, the mobile terminal 300 or other intelligent electronic devices can play a similar function as the control device 100 after installing the application for controlling the display device 200 .

[0080] The controller 110 includes a processor 112, RAM 113, ROM 114, a communication interface 130, and a communication bus. The controller 110 is used to control the operation and operation of the control device 100, as well as the communication and cooperation between internal components and external and internal data processing functions.

[0081] Under the control of the controller 110, the communication interface 130 communicates control signals and data signals with the display device 200. The communication interface 130 may include at least one of a WiFi chip 131, a Bluetooth module 132, an NFC module 133, or other near field communication modules.

[0082] The user input / output interface 140 includes at least one of a microphone 141 , a touch panel 142 , a sensor 143 , a button 144 and other input interfaces.

[0083] In some embodiments, the control device 100 includes at least one of a communication interface 130 and an input / output interface 140. The control device 100 is configured with the communication interface 130, such as a WiFi, Bluetooth, or NFC module, to encode user input commands via the WiFi protocol, Bluetooth protocol, or NFC protocol and transmit them to the display device 200.

[0084] The memory 190 is used to store various operating programs, data and applications for driving and controlling the control device 100 under the control of the controller. The memory 190 can store various control signal instructions input by the user.

[0085] The power supply 180 is used to provide operating power support for each component of the control device 100 under the control of the controller.

[0086] To facilitate user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program used to manage and control the hardware and software resources of the display device 200. The operating system may provide a user interface (to control the display device), allow the user to interact with the display device 200, and support the running of various application programs.

[0087] It should be noted that the operating system may be a native operating system based on a specific operating platform, or a third-party operating system deeply customized based on a specific operating platform, or an independent operating system specially developed for the display device.

[0088] The operating system can be divided into different modules or layers according to the functions implemented, e.g. Figure 4 As shown, in some embodiments, the system is divided into four layers, from top to bottom: the application layer (abbreviated as "application layer"), the application framework layer (abbreviated as "framework layer"), the system library layer and the kernel layer.

[0089] In some embodiments, the application layer provides services and interfaces for applications, enabling the display device 200 to run applications and interact with the user based on these applications. The application layer can host at least one application, which can include built-in window programs, system settings programs, clock programs, and other applications provided by the operating system, or applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the examples above.

[0090] The framework layer provides applications with an application programming interface (API) and programming framework. The application framework layer includes predefined functions. The application framework layer acts as a processing center, determining the actions taken by applications in the application layer. Through the API, applications can access system resources and services during execution.

[0091] like Figure 4 As shown, in the embodiment of the present application, the application framework layer includes a view system, managers, content providers, etc., wherein the view system can design and implement the interface and interaction of the application, and the view system includes lists, grids, text boxes, buttons, etc. The manager includes at least one of the following modules: an activity manager for interacting with all activities running in the system; a location manager for providing system services or applications with access to the system location service; a package manager for retrieving various information related to the application packages currently installed on the device; a notification manager for controlling the display and clearing of notification messages; and a window manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0092] In some embodiments, the activity manager is used to manage the lifecycle of each application and common navigation back functions, such as controlling application exit, opening, and back. The window manager is used to manage all window programs, such as obtaining the display screen size, determining whether there is a status bar, locking the screen, taking screenshots, and controlling changes in display windows, such as shrinking, shaking, or distorting the display window.

[0093] In some embodiments, the system runtime layer can provide support for the framework layer. When the framework layer is used, the operating system will run the instruction library contained in the system runtime layer, such as the C / C++ instruction library, to implement the functions to be implemented by the framework layer.

[0094] In some embodiments, the kernel layer is a functional layer between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management. Figure 4 As shown, the kernel layer can be configured with hardware drivers, and the drivers included in the kernel layer can be at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0095] It should be noted that the above example is only a simple division of the operating system functions and does not constitute a limitation on the specific operating system form of the display device 200 in the embodiment of the present application. Depending on factors such as the function of the display device and the type of operating system, the number of levels and specific level types contained in the operating system may be expressed in other forms.

[0096] As mentioned above, a display device can be connected to external devices, such as wireless speakers. During networking, it is necessary to measure the distance between the external devices and the display device to determine the appropriate placement of the external devices. For example, if the distance between the wireless speaker and the display device is not appropriate, the audio playback quality of the wireless speaker will be affected.

[0097] Acoustic ranging can be used to measure the distance between an external device and a display device. For example, an external device plays an audio clip, which is captured by the display device. The distance between the two devices can be determined by measuring the propagation time and speed of the audio clip. Therefore, the display device's calculation of the audio propagation time is crucial for distance measurement. However, different display devices have different hardware configurations, which can affect the calculation of the audio propagation time.

[0098] For display devices with a hardware structure that includes a DSP (Digital Signal Processing) chip connected to a microphone, since the far-field voice DSP chip is connected to the microphone array, the display device's mainboard SOC (System on Chip) chip cannot directly obtain recording data from the microphone, resulting in a corresponding time error. At the same time, since the time required for the DSP chip to process the audio collected by the microphone is not fixed, the time error is also not fixed. Since this time error is not fixed, it is impossible to use a fixed value to offset the time error. In addition, if the hardware structure of the display device is changed, the corresponding efficiency will be low and the cost will be high.

[0099] Based on the above analysis, in some embodiments of the present application, the DSP chip and the SOC chip are synchronized, based on the time point of the synchronization; when the audio data used for ranging is sent from the display device to the external device, the SOC chip adds a corresponding timestamp; when the audio is collected and processed, the DSP chip also adds a corresponding timestamp; and ranging is achieved by calculating the difference between the two timestamps.

[0100] Some embodiments of the present application provide Figure 5 The display device 200 shown can collect audio played by the external device 500; the display device 200 can realize wireless connection and networking with the external device 500 through Bluetooth, WIFI, etc.; the external device 500 can be a device with audio playback function and connection function with the display device 200, for example, the external device 500 can be but not limited to various types of wireless speakers, and the speakers can be but not limited to various types of active speakers and passive speakers, etc.

[0101] In an exemplary embodiment, a display device is provided, including: a display configured to display an image from a broadcast system and / or a network; a communicator configured to connect to a wired network and / or a wireless network; a first processor; a second processor; and a microphone.

[0102] The display device may be the display device 200 described above. For understanding the display device and its components, unless otherwise specified, reference may be made to the relevant description of the display device 200 in the preceding text. For example, for understanding the display, reference may be made to the display 260 in the preceding display device 200, for understanding the communicator, reference may be made to the communication device 220 in the preceding display device 200, and for understanding the microphone, reference may be made to the sound collector in the detector 230 in the preceding display device 200. The same content will not be repeated here. The following mainly describes the first processor, the second processor, and the microphone of the display device:

[0103] like Figure 6aAs shown, the first processor is configured to execute step S6011: when the display device is wirelessly networked with an external device through a communicator, send a first message to the second processor; the first message carries an instruction to restart timing.

[0104] like Figure 6b As shown, the second processor is connected to the first processor and is configured to execute step S6021: upon receiving the first information, restart the timing and return the second information to the first processor.

[0105] like Figure 6a As shown, the first processor is also configured to execute step S6012: upon receiving the second information returned by the second processor, record the current time, start the local timing with the current time as the starting point, and transmit the first audio data with the first timestamp added to it to the external device through the communicator; the first timestamp is obtained based on the local timing.

[0106] In some embodiments, the number of first timestamps may be one or more, and the specific position in the first audio data corresponding to the first timestamp may be one or more. For example, the first timestamp may be added at at least one of the starting position, the middle position, and the ending position of the audio. The term "multiple" herein may include two and / or more than two, unless otherwise specified.

[0107] like Figure 6c As shown, the microphone is connected to the second processor and is configured to execute step S6031: collecting audio played by the external device and transmitting it to the second processor; the second audio data is the audio played by the external device after receiving the first audio data.

[0108] In some embodiments, the microphone is connected to the second processor but not directly connected to the first processor, and the second processor is connected to the first processor, so that the audio collected by the microphone can be transmitted to the first processor via the second processor.

[0109] like Figure 6b As shown, the second processor is further configured to execute step S6022: receive second audio data, add a second timestamp to the second audio data based on the receiving time, and send the second audio data with the second timestamp to the first processor.

[0110] In some embodiments, as described above, similar to the first timestamp, the number of the second timestamps can be one or more, and the specific position in the second audio data corresponding to the second timestamp can be one or more.

[0111] In some embodiments, the second timestamp added by the second processor may be a timestamp determined based on the aforementioned restart of timing. Similarly, the first timestamp may also be a timestamp determined based on the aforementioned restart of timing. Therefore, the first timestamp and the second timestamp correspond to the same start time.

[0112] like Figure 6a As shown, the first processor is further configured to execute step S6013: receive the second audio data with the second timestamp added returned by the second processor, and determine the distance between the display device and the external device based on the first audio data, the first timestamp, the second audio data and the second timestamp.

[0113] In some embodiments, one or more identical positions corresponding to the first audio data and the second audio data can be determined, for example, the starting position and the ending position of the audio; at the same time, as mentioned above, since the number of the first timestamp and the second timestamp can be one or more, the first timestamp and the second timestamp corresponding to the above-mentioned identical position can be determined, so that the distance between the display device and the external device can be determined based on the difference between the first timestamp and the second timestamp and combined with the audio propagation speed.

[0114] The first processor and the second processor of the above-mentioned display device realize the time synchronization of the first processor and the second processor through the interaction of the first information and the second information, so that the first timestamp added by the first processor to the audio data sent and the second timestamp added to the audio data returned by the second processor can correspond to the same starting time point. This can avoid the corresponding time error caused by the first processor being unable to directly obtain audio from the microphone of the display device and the time required for the second processor to receive and process the audio collected by the microphone. As a result, the distance between the display device and the external device determined based on the first audio data, the first timestamp, the second audio data and the second timestamp is more accurate. In addition, the display device does not require changes to its own hardware, does not require additional microphones or adjustment of the microphone structure, etc., which improves efficiency and reduces costs.

[0115] In one embodiment, the first processor is further configured to: when the display device is wirelessly networked with an external device through a communicator, switch the input / output interface to an output mode, send a first level signal to the second processor based on the input / output interface in the output mode, and switch the input / output interface to an input mode after sending the first level signal; the second processor is further configured to: when receiving the first level signal, restart the timing and return a second level signal to the first processor; the first processor is further configured to: based on the input / output interface in the input mode, receive the second level signal returned by the second processor, and when receiving the second level signal, record the current time and start timing on this end with the current time as the starting point.

[0116] In some embodiments, high-level and low-level signals may be used to implement time synchronization between the first processor and the second processor. For example, a high-level signal may be used as the first-level signal and a low-level signal may be used as the second-level signal.

[0117] In some embodiments, given that it may take some time for the second processor to return the second level signal to the first processor, there may be a delay between the time the first processor starts local timing and the time the second processor restarts timing. However, this delay is relatively short and has minimal impact. Of course, to further improve ranging accuracy, the time the first processor starts local timing can be corrected to ensure that the time the first processor starts local timing is consistent with the time the second processor restarts timing.

[0118] For example, the second processor restarts timing at T0, and it takes A milliseconds for the second processor to transmit the second-level signal back to the first processor. Accordingly, the first processor receives the second-level signal at T0 + A milliseconds, i.e., the current time = T0 + A milliseconds. Therefore, the current time minus A milliseconds can be used as the starting point for the first processor to restart timing, thereby offsetting the corresponding delay.

[0119] Based on the output mode and input mode of the input / output interface, the first processor of the display device notifies the second processor to reset the timing through a first level signal, and receives a second level signal to start local timing, thereby achieving time synchronization between the first processor and the second processor. This provides the same starting time point for the subsequent addition of the first timestamp and the second timestamp, which in turn helps to more accurately determine the distance between the display device and the external device.

[0120] In one embodiment, the first processor is further configured to: transmit first audio data to an external device through a communicator, where the first audio data is square wave audio; and add a first timestamp to the rising edge and / or falling edge of the square wave of the first audio data based on local timing.

[0121] The square wave audio may be an audio with a square wave waveform.

[0122] In some possible embodiments, since the first audio data is square wave audio, which may exhibit periodic rises and falls, the first timestamp may be added at the rising edge and / or falling edge of the square wave of the first audio data.

[0123] Exemplarily, each period of the first audio data may be determined, and a corresponding first timestamp may be added to a rising edge and / or a falling edge of a square wave in each period.

[0124] Since the first audio data is square wave audio, the square wave can quickly switch from one value to another, such as high value to low value, 1 to 0, 0 to 1, etc., which makes the first audio data have corresponding square wave rising edge and square wave falling edge, thereby facilitating the first processor of the display device to add the first timestamp, and also makes the first timestamp accurately correspond to the first audio data, avoiding the situation where the same timestamp corresponds to multiple specific positions or parts of the first audio data, which helps to add the first timestamp more accurately and quickly.

[0125] In one embodiment, the first processor is further configured to: map the second timestamp corresponding to the second processor to the third timestamp corresponding to the first processor; fit a corresponding waveform based on the second audio data and the third timestamp; the waveform has a third timestamp corresponding to the peaks and / or troughs of the waveform; determine the time difference between the first timestamp corresponding to the first audio data and the third timestamp corresponding to the waveform; and determine the distance between the display device and the external device based on the time difference and the speed of sound propagation.

[0126] In some embodiments, because the first audio data may have multiple rising edges and / or square wave falling edges, multiple first timestamps may be associated with the data. Similarly, the waveform may also have multiple third timestamps. Therefore, multiple time differences may be obtained by calculating the time differences between the multiple first timestamps and the multiple third timestamps, and the distance between the display device and the external device may be determined based on the multiple time differences. For example, the distance may be determined by taking the average of the multiple time differences, or by removing the maximum and minimum values ​​from the multiple time differences and then calculating the average.

[0127] Exemplarily, the first timestamp corresponding to the first rising edge of the first audio data can be determined as the first timestamp 1; at the same time, the third timestamp corresponding to the first peak of the above waveform can be determined as the third timestamp 1, and then the time difference between the third timestamp 1 and the first timestamp 1 is calculated to determine the above distance.

[0128] In some embodiments, the distance between the display device and the external device determined based on the multiple first timestamps and the multiple third timestamps may be multiple.

[0129] In some embodiments, multiple preliminary distances between the display device and the external device may be determined, and the distance between the display device and the external device may be determined based on the multiple preliminary distances. For example, if the determined preliminary distances are 1 meter, 1.5 meters, and 2 meters, the average of the three distances may be calculated as 1.5 meters, and the distance between the display device and the external device may be determined to be 1.5 meters.

[0130] Since the second timestamp corresponds to the second processor of the display device, by mapping the second timestamp to the third timestamp corresponding to the first processor, and at the same time, by fitting the corresponding waveform based on the second audio data and the third timestamp, the first processor can identify the second audio data and its corresponding time situation, and serve the subsequent steps of determining the time difference; by determining the time difference between the first timestamp and the third timestamp, the time taken for the second audio data to be transmitted from the external device to the display device can be more accurately determined, thereby making the determined distance between the display device and the external device more accurate.

[0131] In one embodiment, the first processor is further configured to: determine the distance difference between the distance and the preset distance; when the distance difference is less than the preset difference, determine that the wireless networking between the display device and the external device is valid; when the distance difference is greater than or equal to the preset difference, determine that the wireless networking between the display device and the external device is invalid.

[0132] In some embodiments, as described above, the distance between the display device and the external device can be multiple, and accordingly, multiple distance differences can be obtained; the multiple distance differences can be compared with the preset difference to obtain multiple comparison results, and the validity of the wireless networking invalidation can be comprehensively determined based on the multiple comparison results to improve the accuracy of the above determination.

[0133] Exemplarily, the distances between the display device and the external device are 1 meter, 1.5 meters, and 2 meters. Assuming that the preset distance is 1.5 meters, the corresponding distance differences are -0.5 meters, 0 meters, and +0.5 meters. The preset difference is 0.5 meters, so multiple comparison results can be obtained: invalid, valid, and invalid. The number of comparison results representing valid is less than the number of comparison results representing invalid, so it can be determined that the wireless networking between the display device and the external device is invalid.

[0134] By judging whether the wireless networking between the display device and the external device is effective or not based on the deviation between the determined distance between the display device and the external device and the preset distance, that is, based on the size of the distance difference compared with the preset difference, a judgment on the above-mentioned wireless networking results is provided, which helps to achieve more accurate networking.

[0135] In one embodiment, the first processor is a system-level processor of the display device; the second processor is a digital signal processor in the display device.

[0136] The system-level processor of the display device may correspond to a system-level chip, which may be a SOC chip installed on a mainboard of the display device; and the digital signal processor may be a DSP chip.

[0137] In some possible embodiments, the second processor may not be integrated into the system-on-chip of the display device.

[0138] In one embodiment, the input / output interface is a general-purpose input / output interface. In some embodiments, the general-purpose input / output interface may be a GPIO, ie, general-purpose input / output.

[0139] In one embodiment, the microphone is further configured to transmit the second audio data to the second processor based on pulse density modulation.

[0140] The pulse density modulation may be PDM, which is a modulation method that uses binary numbers 0 and 1 to represent analog signals.

[0141] In some embodiments, the microphone may be a digital microphone, such as a PDM microphone, which may convert the collected audio into a digital signal.

[0142] In addition to the above-mentioned display device, the present application also provides a wireless networking ranging method. In one embodiment, a wireless networking ranging method is provided, which is applied to a first processor of a display device. The method may include steps S701 to S704:

[0143] Step S701: When wireless networking is established between the display device and the external device through the communicator of the display device, a first message is sent to the connected second processor; the first message carries an instruction to restart timing;

[0144] Step S702: upon receiving the second information returned by the second processor, recording the current time, starting local timing with the current time as the starting point, and transmitting first audio data with a first timestamp added to it to the external device via the communicator; the first timestamp is obtained based on local timing; the second information is returned by the second processor upon receiving the first information and restarting timing;

[0145] Step S703: receiving second audio data with a second timestamp added thereto, which is returned by the second processor; the second audio data corresponds to the audio played by the external device after receiving the first audio data; the second audio data is collected by the microphone of the display device and returned by the second processor with a second timestamp added thereto;

[0146] Step S704: determining the distance between the display device and the external device according to the first audio data, the first timestamp, the second audio data, and the second timestamp.

[0147] The first processor of the above-mentioned display device realizes time synchronization with the second processor in the same display device by sending the first information and receiving the second information; based on the time synchronization, the first audio data sent is added with a first timestamp, and the second audio data with a second timestamp added thereto and returned by the second processor is received; since the second audio data is received and played by the external device after receiving the first audio data, and the second timestamp is added by the second processor based on the audio data reception time when the time synchronization is completed, the difference between the first timestamp and the second timestamp can more accurately reflect the time taken for the audio to be transmitted from the external device to the display device, thereby avoiding the corresponding time error caused by the first processor being unable to directly obtain audio from the microphone and the second processor needing time to receive and process the audio collected by the microphone. Furthermore, the first processor can determine a more accurate distance between the display device and the external device based on the first audio data, the first timestamp, the second audio data, and the second timestamp.

[0148] In one embodiment, a wireless networking ranging method is provided, which is applied to a second processor of a display device. The method may include steps S801 to S802:

[0149] Step S801: When the display device and the external device are wirelessly networked, if a first message sent by a first processor of the display device is received, the timing is restarted and a second message is returned to the first processor; the first message carries an instruction to restart the timing; the second message is used to instruct the first processor to record the current time and start local timing based on the current time when the second message is received, so as to transmit first audio data with a first timestamp added thereto to the external device; the first timestamp is obtained based on the local timing of the first processor;

[0150] Step S802: Receive the second audio data collected by the microphone of the display device, add a second timestamp to the second audio data based on the receiving time, and send the second audio data with the second timestamp to the first processor; the second audio data is the audio played by the external device after receiving the first audio data.

[0151] The second processor of the above-mentioned display device realizes time synchronization with the first processor in the display device by receiving the first information and sending the second information; based on the time synchronization, a second timestamp is added to the second audio data collected by the received microphone and transmitted to the first processor; since the second audio data is received and played by the external device after receiving the first audio data, and the second timestamp is added by the second processor when the time synchronization is completed, the second timestamp can more accurately reflect the time when the audio is transmitted to the display device, avoiding the corresponding time error caused by the first processor being unable to directly obtain audio from the microphone, the second processor needing time to receive and process the audio collected by the microphone, etc., which helps to determine a more accurate distance between the display device and the external device.

[0152] In an exemplary embodiment, the example of an external device being a wireless speaker network is used for explanation. The wireless networked speakers need to be calibrated for distance measurement to optimize the audio effect. The existing distance measurement calibration scheme is that the speaker plays a test audio signal, and after the microphone of the display device receives the signal, the distance of each speaker is determined by calculating the return time of the sound wave signal. However, since the microphone array connected to the DSP chip and the mainboard SOC chip cannot directly obtain the recording data from the microphone, the audio signal processing time in the DSP is unstable and cannot be offset by a fixed value, etc., this affects the accuracy of calculating the distance based on the time difference of measuring the sound wave from the speaker to the device. In view of this, a wireless networking distance measurement method is provided for display devices such as televisions that are connected to microphone arrays on DSP chips. Figure 9 As shown in FIG, a possible process diagram of the wireless networking ranging method is given. The relevant process is described below:

[0153] 1) The networked speakers on the motherboard SOC start to calibrate, and the motherboard SOC can synchronize time with the DSP chip.

[0154] like Figure 10 As shown, a possible specific implementation method for time synchronization is provided; Figure 11 As shown, a possible framework diagram of SOC and DSP chip synchronization is provided. In the figure, PCM refers to Pulse Code Modulation (Pulse Code Modulation), and the DSP timestamp can correspond to the second timestamp.

[0155] The motherboard SOC can set the GPIO to output mode, input a high level to notify the DSP chip, and then set the GPIO to input mode, that is Figure 11 GPIO synchronization notification in.

[0156] 2) The DSP chip receives the GPIO high-level notification, clears the reset timer, and the GPIO notifies the SOC of the low-level signal. Figure 11 GPIO timing feedback in.

[0157] 3) The mainboard SOC receives a GPIO low-level signal and records the SOC time point as the DSP chip synchronization time point.

[0158] The high level may correspond to the first level signal mentioned above, and the low level signal may correspond to the second level signal.

[0159] 4) The mainboard SOC sends the square wave audio (first audio data) required for ranging to the speaker, adding timestamp information to the rising and falling points (or rising and falling edges) of the square wave audio as the first timestamp. For example, the timestamp can be added based on the time point of synchronization. When the speaker receives and plays the square wave audio, the display device's microphone can capture the corresponding audio and transmit it to the DSP chip.

[0160] 5) The DSP chip receives the audio transmitted by the microphone PDM, adds corresponding timestamp information to each packet of audio data as the second timestamp, and then sends it to the signal processing module.

[0161] 6) After the DSP chip completes signal processing, the audio is sent to the SOC chip. This corresponds to the first processor receiving the second audio data with the second timestamp added.

[0162] 7) The SOC chip parses the recorded audio and timestamps, and maps the DSP chip timestamp to the SOC chip timestamp. This corresponds to "mapping the second timestamp corresponding to the second processor to the third timestamp corresponding to the first processor" and other related content.

[0163] 8) The SOC chip generates a sine wave with timestamp information. Compare the timestamps of the peaks and troughs of the audio wave with the timestamps of the rising and falling edges of the square wave during playback, and calculate the average time difference.

[0164] 9) Based on the average time difference and the sound propagation speed, for example, the sound propagation speed can be taken as 340 meters per second, and the product of the average time difference and the sound propagation speed can be calculated to obtain the distance between the speaker and the SOC chip, that is, the distance between the external device and the display device.

[0165] 10) Compare the distance above with the recommended value (i.e., the preset difference) to determine the difference. If the difference is less than the rated value, the network distance is considered valid and a corresponding prompt is issued to the user. Conversely, if the difference is greater than or equal to the rated value, the network distance is considered invalid and the user is prompted to adjust the distance and recalibrate the network.

[0166] The above technical solution, by aligning the motherboard SOC with the DSP chip, adding a timestamp to the motherboard SOC, and adding a timestamp to the DSP recording, can correct the time error caused by hardware limitations such as the DSP chip being connected to the microphone and the SOC chip being unable to directly obtain audio from the microphone, thereby achieving more accurate wireless network ranging. At the same time, for the hardware structure of the DSP chip connected to the microphone, the above technical solution can be a software-based solution to optimize the display device to improve the accuracy of network ranging, without the need to increase the number of microphones or adjust the microphone structure. In particular, for products such as televisions that are already on the market, the hardware is already fixed. Compared with the method of changing the hardware, the technical solution of this application has the advantages of high efficiency and low cost.

[0167] It should be understood that, although the various steps in the flowcharts involved in the various embodiments described above are displayed in sequence according to the instructions of the arrows, these steps are not necessarily executed in sequence in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and these steps can be executed in other orders. Moreover, at least a portion of the steps in the flowcharts involved in the various embodiments described above can include multiple steps or multiple stages, and these steps or stages are not necessarily executed and completed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a portion of steps or stages in other steps.

[0168] Based on the same inventive concept, embodiments of the present application further provide a wireless networking ranging device for implementing the wireless networking ranging method described above. The solution provided by this device is similar to the solution described in the method described above. Therefore, the specific limitations of one or more wireless networking ranging device embodiments provided below can be found in the limitations of the wireless networking ranging method described above and will not be further elaborated here.

[0169] In an exemplary embodiment, a wireless networking distance measurement device is provided, which is applied to a first processor of a display device, including:

[0170] An audio transmission module is configured to, when wirelessly networking with an external device via a communicator of the display device, send a first message to a connected second processor; the first message carries an instruction to restart timing; upon receiving a second message returned by the second processor, record the current time, start local timing using the current time as the starting point, and transmit first audio data with a first timestamp added thereto to the external device via the communicator; the first timestamp is obtained based on local timing; and the second message is returned by the second processor upon receiving the first message and restarting timing.

[0171] An audio receiving module, configured to receive second audio data returned by the second processor and having a second timestamp added thereto; the second audio data corresponds to the audio played by the external device after receiving the first audio data; the second audio data is collected by a microphone of the display device and returned by the second processor after having a second timestamp added thereto;

[0172] The distance determination module is configured to determine the distance between the display device and the external device according to the first audio data, the first timestamp, the second audio data, and the second timestamp.

[0173] In an exemplary embodiment, a wireless networking distance measurement device is provided, which is applied to a first processor of a display device, including:

[0174] a first receiving module configured to, when the display device and the external device are wirelessly networked, restart timing upon receiving first information sent by the first processor of the display device and return second information to the first processor; the first information carrying an instruction to restart timing; and the second information being configured to instruct the first processor to record the current time upon receiving the second information and to start local timing based on the current time, so as to transmit first audio data with a first timestamp added thereto to the external device; the first timestamp being obtained based on local timing of the first processor;

[0175] The second receiving module is used to receive the second audio data collected by the microphone of the display device, add a second timestamp to the second audio data based on the receiving time, and send the second audio data with the second timestamp to the first processor; the second audio data is the audio played after the external device receives the first audio data.

[0176] Each module in the wireless networking ranging device described above can be implemented in whole or in part through software, hardware, or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in hardware form, or can be stored in a memory in the computer device in software form, so that the processor can call and execute the corresponding operations of each module.

[0177] In an exemplary embodiment, a computer device is provided, including a memory and a processor. The memory stores a computer program, and the processor implements the steps in the above method embodiments when executing the computer program.

[0178] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps in the above-mentioned method embodiments are implemented.

[0179] In one embodiment, a computer program product is provided, including a computer program, which implements the steps in the above method embodiments when executed by a processor.

[0180] In one embodiment, a processor is provided, which is configured to execute a computer program to implement the steps in the above method embodiments.

[0181] In one embodiment, a chip is provided. The chip includes the processor in the above embodiment.

[0182] Those skilled in the art will understand that all or part of the processes in the above-mentioned embodiments can be implemented by instructing the relevant hardware through a computer program. The computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. In particular, any reference to memory, database, or other media used in the embodiments provided in this application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The databases involved in the various embodiments provided herein may include at least one of a relational database and a non-relational database. Non-relational databases may include, but are not limited to, blockchain-based distributed databases. The processors involved in the various embodiments provided herein may be, but are not limited to, general-purpose processors, central processing units (CPUs), graphics processing units (GPUs), digital signal processors (DSPs), programmable logic devices (PLDs), quantum computing-based data processing logic devices, artificial intelligence (AI) processors, and the like.

[0183] The technical features of the above embodiments can be combined arbitrarily. In order to make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0184] The above-described embodiments merely represent several implementation methods of the present application. While the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the present application. It should be noted that a person of ordinary skill in the art may make various modifications and improvements without departing from the spirit of the present application, and these modifications and improvements fall within the scope of protection of the present application. Therefore, the scope of protection of the present application shall be determined by the appended claims.

Claims

1. A display device, characterized in that: include: a display configured to display images from the broadcast system and / or from a network; a communicator configured to connect to a wired network and / or a wireless network; The first processor is configured to: when the display device is wirelessly networked with the external device through the communicator, send a first message to the second processor; the first message carries an instruction to restart the timing; a second processor, connected to the first processor, and configured to: upon receiving the first information, restart the timing and return second information to the first processor; The first processor is further configured to: upon receiving the second information returned by the second processor, record the current time, start timing on the local end with the current time as the starting point, and transmit the first audio data with the first timestamp added to it to the external device through the communicator; The first timestamp is obtained based on the local end timing; a microphone connected to the second processor and configured to: collect the audio played by the external device and transmit second audio data to the second processor; the audio played by the external device is the audio played by the external device after receiving the first audio data; The second processor is further configured to: receive the second audio data, add a second timestamp to the second audio data based on a receiving time, and send the second audio data with the second timestamp added to the first processor; The first processor is further configured to: receive the second audio data to which the second timestamp is added, and determine the distance between the display device and the external device according to the first audio data, the first timestamp, the second audio data, and the second timestamp.

2. The display device according to claim 1, wherein The first processor is further configured to: when the display device is wirelessly networked with an external device through the communicator, switch the input / output interface to an output mode, send a first level signal to the second processor based on the input / output interface in the output mode, and switch the input / output interface to an input mode after sending the first level signal; The second processor is further configured to: restart timing when receiving the first level signal, and return a second level signal to the first processor; The first processor is further configured to: receive the second level signal returned by the second processor based on the input-output interface of the input mode, and upon receiving the second level signal, record the current time and start timing on this end with the current time as the starting point.

3. The display device according to claim 1, wherein The first processor is further configured to: transmit the first audio data to the external device through the communicator, where the first audio data is square wave audio data; and add the first timestamp to the rising edge and / or falling edge of the square wave based on the local timing.

4. The display device according to claim 3, wherein The first processor is further configured to: Mapping the second timestamp to a third timestamp corresponding to the first processor; fitting a corresponding waveform according to the second audio data and the third timestamp; wherein peaks and / or troughs in the waveform correspond to information of the third timestamp; determining a time difference between the first timestamp corresponding to the first audio data and the third timestamp corresponding to the waveform; The distance between the display device and the external device is determined according to the time difference and the sound propagation speed.

5. The display device according to claim 1, wherein The first processor is further configured to: determining a distance difference between the distance and a preset distance; When the distance difference is less than a preset difference, determining that the wireless networking between the display device and the external device is valid; When the distance difference is greater than or equal to a preset difference, it is determined that the wireless networking between the display device and the external device is invalid.

6. The display device according to any one of claims 1 to 5, characterized in that: The first processor is a system-level processor in the display device; The second processor is a digital signal processor in the display device.

7. The display device according to claim 6, wherein: The input and output interface of the first processor is a general purpose input and output interface.

8. The display device according to any one of claims 1 to 5, characterized in that: The microphone is further configured to transmit the second audio data to the second processor based on pulse density modulation.

9. A wireless networking ranging method, characterized in that: A first processor applied to a display device, comprising: When the display device is wirelessly networked with an external device, sending a first message to a connected second processor; the first message carries an instruction to restart timing; Upon receiving the second information returned by the second processor, recording the current time, starting local timing with the current time as the starting point, and transmitting the first audio data with a first timestamp added thereto to the external device via the communicator; the first timestamp is obtained based on the local timing; the second information is returned by the second processor upon receiving the first information and restarting timing; receiving second audio data returned by the second processor and having a second timestamp added thereto; the second audio data corresponding to the audio played by the external device after receiving the first audio data; the second audio data being collected by the microphone of the display device and returned by the second processor after having a second timestamp added thereto; A distance between the display device and the external device is determined according to the first audio data, the first timestamp, the second audio data, and the second timestamp.

10. A wireless networking distance measurement method, characterized in that: A second processor applied to a display device, comprising: In a case where the display device and the external device are wirelessly networked, if a first message sent by a first processor of the display device is received, the timing is restarted and a second message is returned to the first processor; the first message carries an instruction to restart the timing; the second information is used to instruct the first processor to record the current time when the second message is received, and to start local timing with the current time as the starting point, so as to transmit first audio data with a first timestamp added to it to the external device; the first timestamp is obtained based on the local timing of the first processor; Receive second audio data collected by the microphone of the display device, add a second timestamp to the second audio data based on the reception time, and send the second audio data with the second timestamp added to the first processor, so that the first processor determines the distance between the display device and the external device based on the first audio data, the first timestamp, the second audio data and the second timestamp; the second audio data is the audio played by the external device after receiving the first audio data.

Citation Information

Patent Citations

  • Mobile terminal and controlling method thereof

    KR1020170014608A

  • Display apparatus and recording medium

    US20190320114A1