Screen mirroring method, screen-sharing viewing device, large-screen device, and screen mirroring system

Abstract

A screen mirroring method, a screen-sharing viewing device, a large-screen device, and a screen mirroring system. The method is applied to a screen-sharing viewing device and comprises: on the basis of an audio module of a screen-sharing viewing device, receiving a target ultrasonic carrier signal broadcast by at least one large-screen device to be matched; parsing and decoding the target ultrasonic carrier signal to obtain screen mirroring code information of said at least one large-screen device; initiating a link establishment request on the basis of screen mirroring code information of a target large-screen device to be subjected to screen sharing, wherein the link establishment request is used for requesting to establish a first screen mirroring data link between the screen-sharing viewing device and the target large-screen device; and on the basis of the established first screen mirroring data link, receiving screen mirroring data from the target large-screen device and performing screen mirroring display. Users can use a closer screen-sharing viewing device to view content played on a large-screen device, thereby effectively solving the problem in the related art of unclear vision or poor conference experience caused by the long distance from the large-screen device.

Description

Screen projection method, same-screen viewing device, large-screen device, and screen projection system

[0001] This disclosure is based on the Chinese patent application with application number 202410131082.7, application date January 30, 2024, and invention name “Screen projection method, same-screen viewing device, large-screen device and screen projection system”, and claims the priority of the Chinese patent application. The entire content of the Chinese patent application is hereby introduced into the present disclosure as a reference. Technical Field

[0002] The present disclosure relates to the field of screen projection technology, and in particular to a screen projection method, a same-screen viewing device, a large-screen device, and a screen projection system. Background Art

[0003] Screen projection technology is widely used in various scenarios. Taking the conference scene as an example, the conference room is usually equipped with a large-screen device for displaying conference content; the speaker projects the content played on the projection device to the large-screen device for playback, making it convenient for all participants to watch.

[0004] In the process of realizing the concept of the present disclosure, the inventors found that there are at least the following technical problems in the relevant technology: since the space where the projection device and the large-screen device are located is very large, people who are far away from the large-screen device find it difficult to clearly see the content projected on the large-screen device, and the large-screen device cannot adaptively display for people at different distances, affecting the viewing experience; for example, taking a conference room as an example, viewers sitting in different positions in the conference room are at different distances from the large-screen device. Some participants who are far away from the large-screen device cannot clearly see the content projected on the large-screen device, resulting in a poor meeting experience and affecting the communication effect of the meeting. Summary of the Invention

[0005] In order to solve the above technical problems or at least partially solve the above technical problems, the embodiments of the present disclosure provide a screen projection method, a same-screen viewing device, a large-screen device and a screen projection system.

[0006] In the first aspect, an embodiment of the present disclosure provides a method for screen projection. The above method is applied to a same-screen viewing device, including: based on the audio module of the above-mentioned same-screen viewing device, receiving a target ultrasonic carrier signal broadcast by at least one large-screen device to be matched; parsing and decoding the above-mentioned target ultrasonic carrier signal to obtain the projection code information of at least one large-screen device to be matched; initiating a link establishment request according to the projection code information of the target large-screen device to be matched, the above-mentioned link establishment request is used to request the establishment of a first projection data link between the above-mentioned same-screen viewing device and the above-mentioned target large-screen device; based on the established first projection data link, receiving the projection data from the above-mentioned target large-screen device and performing projection display.

[0007] According to an embodiment of the present disclosure, the above-mentioned target ultrasonic carrier signal is parsed and decoded to obtain the projection code information of at least one large-screen device to be matched, including: parsing the signal header of the above-mentioned target ultrasonic carrier signal to determine at least one large-screen device to be matched corresponding to the pairing identification frequency; the above-mentioned pairing identification frequency is used as an identification frequency to distinguish large-screen devices in different spaces; according to the coding frequency in the target ultrasonic carrier frequency band corresponding to the target large-screen device, the signal body of the above-mentioned target ultrasonic carrier signal is decoded to obtain the projection code information of the above-mentioned target large-screen device.

[0008] According to an embodiment of the present disclosure, the projection code information of the above-mentioned target large-screen device includes: the network address and port number of the above-mentioned target large-screen device in the intranet, and the above-mentioned intranet refers to a local area network that is built and does not generate traffic data of the network operation service provider.

[0009] According to an embodiment of the present disclosure, the above-mentioned target ultrasonic carrier signal is obtained by encoding the respective projection code information based on the target ultrasonic carrier information of the above-mentioned at least one large-screen device to be matched; the above-mentioned target ultrasonic carrier information is used to distinguish large-screen devices in different spaces in at least one dimension of amplitude or frequency, or to distinguish different large-screen devices in the same space.

[0010] According to an embodiment of the present disclosure, the projection data received by the above-mentioned same-screen viewing device is data received and forwarded in real time by the above-mentioned target large-screen device based on a pre-established second projection data link, and the above-mentioned second projection data link is a data transmission channel between the above-mentioned target large-screen device and the projection device; or, the projection data received by the above-mentioned same-screen viewing device is target data received by the above-mentioned target large-screen device based on a pre-established second projection data link and stored in the cache area of ​​the above-mentioned target large-screen device, and the moment when the above-mentioned target data starts to be parsed on the above-mentioned target large-screen device is aligned with the moment when the above-mentioned target data is transmitted to the above-mentioned same-screen viewing device; the delay between the moment when the above-mentioned target data starts to be played on the above-mentioned target large-screen device and the moment when the above-mentioned projection device plays the corresponding data is within the preset delay threshold.

[0011] In the second aspect, an embodiment of the present disclosure provides a method for screen projection. The above method is applied to a large-screen device, including: receiving a same-screen viewing instruction; determining the target ultrasonic carrier information corresponding to the above-mentioned large-screen device according to the above-mentioned same-screen viewing instruction; encoding the screen projection code information of the above-mentioned large-screen device based on the above-mentioned target ultrasonic carrier information to obtain a target ultrasonic carrier signal; broadcasting the above-mentioned target ultrasonic carrier signal based on the audio module of the above-mentioned large-screen device, so that the above-mentioned target ultrasonic carrier signal is transmitted to the same-screen viewing device in the space where the above-mentioned large-screen device is located; the above-mentioned screen projection code information is used to establish a first screen projection data link between the above-mentioned large-screen device and the above-mentioned same-screen viewing device; based on the established first screen projection data link, sending screen projection data to the above-mentioned same-screen viewing device.

[0012] According to an embodiment of the present disclosure, the target ultrasonic carrier information is used to distinguish large-screen devices in different spaces, or to distinguish different large-screen devices in the same space, in at least one dimension of amplitude or frequency. The target ultrasonic carrier information corresponding to the large-screen device is determined according to the same-screen viewing instruction, including: determining the target space where the large-screen device is located according to the same-screen viewing instruction; determining the target ultrasonic carrier frequency band corresponding to the target space according to a mapping table between space and ultrasonic carrier frequency band; the mapping table stores the correspondence between space, large-screen device, and ultrasonic carrier frequency band; and determining the target ultrasonic power or target ultrasonic amplitude corresponding to the large-screen device according to the area information and spatial structure information of the space where the large-screen device and the same-screen viewing device are located.

[0013] According to an embodiment of the present disclosure, based on the above-mentioned target ultrasonic carrier information, the projection code information of the above-mentioned large-screen device is encoded and processed to obtain a target ultrasonic carrier signal, including: determining the pairing identification frequency in the above-mentioned target ultrasonic carrier frequency band as a sequence head; the above-mentioned pairing identification frequency is used as an identification frequency to distinguish large-screen devices in different spaces; parsing the above-mentioned projection code information into a character string corresponding to a preset base; generating a sequence body for encoding the above-mentioned character string according to the coding frequency in the above-mentioned target ultrasonic carrier frequency band used to encode the characters of the above-mentioned preset base; the coding frequencies corresponding to different characters of the above-mentioned preset base have a preset frequency interval; splicing the above-mentioned sequence head and the above-mentioned sequence body to obtain a coding frequency sequence; modulating the amplitude of the above-mentioned coding frequency sequence to the above-mentioned target ultrasonic amplitude, or modulating the power of the above-mentioned coding frequency sequence to the above-mentioned target ultrasonic power; the coding frequency sequence obtained after modulation is used as the target ultrasonic carrier signal.

[0014] According to an embodiment of the present disclosure, in the above-mentioned correspondence, there is at least one of the following situations: when different first large-screen devices and second large-screen devices in the same space perform screen projection of the same content, the above-mentioned first large-screen device and the above-mentioned second large-screen device have the same target ultrasonic carrier frequency band; or, when different first large-screen devices and second large-screen devices in the same space independently perform screen projection, the above-mentioned first large-screen device and the above-mentioned second large-screen device have different target ultrasonic carrier frequency bands; or, when the first space and the second space are different spaces, and the third large-screen device in the first space and the fourth large-screen device in the second space perform independent screen projection, the target ultrasonic power or target ultrasonic amplitude of the above-mentioned third large-screen device meets the following conditions: the signal transmission distance in the first space is met and attenuates to below the first preset threshold after reaching the second space; the target ultrasonic power or target ultrasonic amplitude of the above-mentioned fourth large-screen device meets the following conditions: The following conditions: the signal transmission distance in the second space is met and the signal is attenuated to below the second preset threshold after reaching the first space; the third large screen device and the fourth large screen device have the same target ultrasonic carrier frequency band; or, when the third large screen device in the first space and the fourth large screen device in the second space perform independent screen projection, the target ultrasonic power or target ultrasonic amplitude of the third large screen device meets the following conditions: the signal transmission distance in the first space is met and the signal is attenuated to below the third preset threshold after reaching the second space; the target ultrasonic power or target ultrasonic amplitude of the fourth large screen device meets the following conditions: the signal transmission distance in the second space is met and the signal is attenuated to below the fourth preset threshold after reaching the first space; the third large screen device and the fourth large screen device have different target ultrasonic carrier frequency bands; wherein the third preset threshold is greater than the first preset threshold, and the fourth preset threshold is greater than the second preset threshold.

[0015] According to an embodiment of the present disclosure, different target ultrasonic carrier frequency bands include one of the following situations: different target ultrasonic carrier frequency bands have different pairing identification frequencies; or, different target ultrasonic carrier frequency bands have different pairing identification frequencies, and the above-mentioned pairing identification frequencies correspond to a unique pairing group; or, different target ultrasonic carrier frequency bands have different pairing identification frequencies, and the preset frequency intervals between the coding frequencies used for encoding the characters of the above-mentioned preset base in different target ultrasonic carrier frequency bands are different; or, different target ultrasonic carrier frequency bands have different pairing identification frequencies, and the above-mentioned pairing identification frequencies correspond to a unique pairing group; the preset frequency intervals between the coding frequencies used for encoding the characters of the above-mentioned preset base in different target ultrasonic carrier frequency bands are different; wherein the above-mentioned pairing group is a pairing group composed of a large-screen device and a same-screen viewing device.

[0016] According to an embodiment of the present disclosure, the above-mentioned screen projection code information includes: the network address and port number of the above-mentioned large-screen device in the intranet, and the above-mentioned intranet refers to a local area network that is built and does not generate traffic data of the network operation service provider. The above-mentioned method also includes: receiving a link establishment request initiated by the same-screen viewing device; the above-mentioned link establishment request includes: the target large-screen device requested to be connected is located in the intranet and the target network address and target port number; the above-mentioned target network address and the above-mentioned target port number are obtained by the above-mentioned same-screen viewing device by parsing the received target ultrasonic carrier signal; the above-mentioned target network address and the above-mentioned target port number are verified; if the verification is passed, the first screen projection data link between the above-mentioned large-screen device and the above-mentioned same-screen viewing device is established.

[0017] According to an embodiment of the present disclosure, the projection data sent by the above-mentioned large-screen device is data received and forwarded in real time based on a pre-established second projection data link, and the above-mentioned second projection data link is a data transmission channel between the above-mentioned large-screen device and the projection device; or, the projection data sent by the above-mentioned large-screen device is target data received and stored in the cache area of ​​the above-mentioned large-screen device based on the pre-established second projection data link, and the moment when the above-mentioned target data starts to be parsed on the above-mentioned large-screen device is aligned with the moment when the above-mentioned target data is transmitted to the above-mentioned same-screen viewing device; the delay between the moment when the above-mentioned target data starts to be played on the above-mentioned large-screen device and the moment when the above-mentioned projection device plays the corresponding data is within a preset delay threshold.

[0018] In the third aspect, an embodiment of the present disclosure provides a same-screen viewing device. The same-screen viewing device includes: a signal receiving module, a decoding module, a link establishment module, a data receiving module and a display module. The signal receiving module is arranged in the audio module of the same-screen viewing device, and is used to receive the target ultrasonic carrier signal broadcast by at least one large-screen device to be matched. The decoding module is used to parse and decode the target ultrasonic carrier signal to obtain the projection code information of at least one large-screen device to be matched. The link establishment module is used to initiate a link establishment request according to the projection code information of the target large-screen device to be matched, and the link establishment request is used to request the establishment of a first projection data link between the same-screen viewing device and the target large-screen device. The data receiving module is used to receive projection data from the target large-screen device based on the established first projection data link. The display module is used to perform projection display based on the projection data.

[0019] In a fourth aspect, an embodiment of the present disclosure provides a large-screen device. The large-screen device includes: an instruction receiving module, an ultrasonic carrier information determination module, an encoding module, a signal sending module, and a data sending module. The instruction receiving module is used to receive a same-screen viewing instruction. The ultrasonic carrier information determination module is used to determine the target ultrasonic carrier information corresponding to the large-screen device according to the same-screen viewing instruction. The encoding module is used to encode the projection code information of the large-screen device based on the target ultrasonic carrier information to obtain a target ultrasonic carrier signal. The signal sending module is provided in the audio module of the large-screen device, and is used to broadcast the target ultrasonic carrier signal so that the target ultrasonic carrier signal is transmitted to the same-screen viewing device in the space where the large-screen device is located; the projection code information is used to establish a first projection data link between the large-screen device and the same-screen viewing device. The data sending module is used to send projection data to the same-screen viewing device based on the established first projection data link.

[0020] In a fifth aspect, an embodiment of the present disclosure provides a screen projection system. The above-mentioned screen projection system includes: a same-screen viewing device and a large-screen device. The above-mentioned same-screen viewing device is used to execute the screen projection method provided by the embodiment of the above-mentioned first aspect, or is the same-screen viewing device provided by the embodiment of the above-mentioned third aspect; the above-mentioned large-screen device is used to execute the screen projection method provided by the embodiment of the above-mentioned second aspect, or is the large-screen device provided by the embodiment of the fourth aspect.

[0021] According to an embodiment of the present disclosure, the above-mentioned screen projection system also includes: a screen projection device, which is used to send screen projection data to the target large-screen device based on the established second screen projection data link. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0023] In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or related technical descriptions. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0024] FIG1 schematically shows a system architecture and interaction diagram of a screen projection system according to an embodiment of the present disclosure;

[0025] FIG2 schematically shows a flow chart of a method for screen projection applied to a same-screen viewing device according to an embodiment of the present disclosure;

[0026] FIG3 schematically shows a detailed implementation flow chart of step S220 according to an embodiment of the present disclosure;

[0027] FIG4 schematically shows a timing diagram of the interaction process of a method for performing screen projection between a same-screen viewing device and a large-screen device according to an embodiment of the present disclosure;

[0028] FIG5 schematically shows a structural block diagram of a same-screen viewing device according to an embodiment of the present disclosure;

[0029] FIG6 schematically shows a structural block diagram of a large-screen device according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0030] To make the objectives, technical solutions, and advantages of the embodiments of the present disclosure more clear, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the described embodiments are part of the embodiments of the present disclosure, not all of the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present disclosure without making any creative efforts shall fall within the scope of protection of the present disclosure.

[0031] A first exemplary embodiment of the present disclosure provides a screen projection system.

[0032] FIG1 schematically shows the system architecture and interaction diagram of a screen projection system according to an embodiment of the present disclosure.

[0033] 1 , the screen projection system 100 provided by an embodiment of the present disclosure includes: a same-screen viewing device 110, a large-screen device 120, and a screen projection device 130. In some implementation scenarios, the large-screen device 120 is used to play the projection data from the screen projection device 130. Since the large-screen device 120 and the screen projection device 130 are located in a relatively large space, the same-screen viewing device 110 is configured to receive the projection data from the large-screen device 120 for projection display and display it on the same-screen viewing device 110.

[0034] In some implementation scenarios, the large-screen device 120 is a device located in a closed or open space and configured to receive and display projection data from the projection device 130. The large-screen device 120 is also configured to send projection data to the same-screen viewing device 110. The same-screen viewing device 110 is configured to execute the projection method provided in the second embodiment, and the large-screen device 120 is configured to execute the projection method provided in the third embodiment.

[0035] The display screen size of the large-screen device can vary, and there is a minimum limit. For example, the screen size of the large-screen device is: the width is greater than the first set value (for example, 0.8 meters, 0.9 meters or 1 meter, the specific value can change with the evolution of industry standards or time, and the same will apply later) and the height is greater than the second set value (for example, 1 meter); or the diagonal size is greater than the third set value (for example, 40 inches). It can be understood that the projection system provided by the embodiment of the present disclosure can not only be applied to closed spaces, such as conference rooms, living rooms, living rooms, etc.; the projection system provided by the embodiment of the present disclosure can also be applied to open spaces, such as stadiums, event venues, etc.

[0036] In some implementation scenarios, the transmission process of projection data can be understood with reference to the following example: the projection device 130 refers to an electronic device located in a space and used to send projection data. The projection device 130 itself can play related content. The large-screen device 120 transmits the projection data after establishing a connection with the projection device 130 (the connection is subsequently described as a second projection data link), and the corresponding content is projected and displayed by the large-screen device 120. Since the large-screen device 120 is located in a large space, it will be difficult for people who are far away from the large-screen device 120 to see clearly. In order to improve this problem, by setting a same-screen viewing device 110, the large-screen device 120 sends a target ultrasonic carrier signal carrying projection code information to the same-screen viewing device 110 in an ultrasonic manner, and the same-screen viewing device 110 parses and decodes it to obtain the projection code information, and establishes the first projection data link between the above-mentioned same-screen viewing device 110 and the above-mentioned large-screen device 120 based on the projection code information. The large-screen device 120 transmits the projection data to the same-screen viewing device 110 via the first projection data link, and displays the projection data on the same-screen viewing device 110. In the embodiments of the present disclosure, the interaction process between the large-screen device 120 and the same-screen viewing device 110 is mainly described to clearly illustrate the same-screen playback based on the same-screen viewing device 110 when the large-screen device is located in a large space, thereby solving the problem of poor viewing experience at a distance from the large-screen device 120.

[0037] As shown in the dotted box in Figure 1, the interaction between the projection device 130 and the large-screen device 120 is simplified in the embodiment of the present disclosure. The process of the projection device 130 and the large-screen device 120 establishing a second projection data link and transmitting projection data is a prerequisite for the large-screen device 120 to play the projection data. This process can refer to the detailed description in the patent application entitled "Screen projection method, large-screen device, screen projection device and screen projection system" on the same day. The embodiment of the present disclosure is only briefly described.

[0038] In some embodiments, the projection code information carries the network address (for example, IP address) and port number of the large-screen device 120 in the intranet; the above-mentioned intranet refers to a local area network that is built and does not generate traffic data of the network operation service provider. For example, it is a local office network built within the enterprise and does not require calling external services, so no traffic to access the Internet will be generated.

[0039] In some embodiments, the same-screen viewing device 110 may be an electronic device having an audio module and a processing module, including but not limited to: smartphones, laptops, tablet computers, smart watches, wearable smart devices, etc. The above-mentioned same-screen viewing device 110 is installed with a screen projection application S, which is used to execute the screen projection method provided in the subsequent second embodiment. The above-mentioned screen projection application can call the audio module M in the same-screen viewing device 110, that is, it has the right to call the audio module M. It can be understood that other applications in the above-mentioned same-screen viewing device 110 (such as music playback applications, voice navigation applications, etc.) may also have the right to call the audio module S.

[0040] The above-mentioned same-screen viewing device 110 is used to perform the following steps or has a functional module (which can be a hardware module or a software module, etc.) for implementing the following steps: based on the audio module of the above-mentioned same-screen viewing device, receiving the target ultrasonic carrier signal broadcast by at least one large-screen device to be matched; parsing and decoding the above-mentioned target ultrasonic carrier signal to obtain the projection code information of at least one large-screen device to be matched; initiating a link establishment request based on the projection code information of the target large-screen device to be matched, and the above-mentioned link establishment request is used to request the establishment of the first projection data link between the above-mentioned same-screen viewing device and the above-mentioned target large-screen device; based on the established first projection data link, receiving the projection data from the above-mentioned target large-screen device and performing projection display.

[0041] In some embodiments, the large-screen device 120 may be an electronic device or device system having a display screen (which may be a hardware display screen or a screen projection device) and an audio module, and may include, but is not limited to: an all-in-one conference machine, a multimedia device, or a conference system including hardware devices such as microphones, speakers, display devices, network connection devices (such as switches), and conference software. The large-screen device 120 may be installed with a screen projection control application R, which is used to execute the screen projection method provided in the subsequent third embodiment. The screen projection control application R can call the audio module N in the large-screen device 120, that is, it has the right to call the audio module N.

[0042] The above-mentioned large-screen device 120 is used to execute the following steps or has a functional module (which can be a hardware module or a software module, etc.) for implementing the following steps: receiving a same-screen viewing instruction; determining the target ultrasonic carrier information corresponding to the above-mentioned large-screen device 120 according to the above-mentioned same-screen viewing instruction; encoding the screen projection code information of the above-mentioned large-screen device 120 based on the above-mentioned target ultrasonic carrier information to obtain a target ultrasonic carrier signal; broadcasting the above-mentioned target ultrasonic carrier signal based on the audio module of the above-mentioned large-screen device 120, so that the above-mentioned target ultrasonic carrier signal is transmitted to the same-screen viewing device 110 in the space where the above-mentioned large-screen device 120 is located; the above-mentioned screen projection code information is used to establish a first screen projection data link between the above-mentioned large-screen device 120 and the above-mentioned same-screen viewing device 110; based on the established first screen projection data link, sending screen projection data to the above-mentioned same-screen viewing device 110.

[0043] In some embodiments, the screen projection device 130 can be an electronic device with an audio module and a processing module, including but not limited to: a smartphone, a laptop computer, a tablet computer, a smart watch, a wearable smart device, etc. The screen projection device 130 is installed with a screen projection application T, which can call the audio module Q in the screen projection device 130, that is, it has the right to call the audio module Q. It is understandable that other applications in the screen projection device 130 (such as music playback applications, voice navigation applications, etc.) can also have the right to call the audio module Q.

[0044] The steps performed by the same-screen viewing device 110 and the large-screen device 120 or the more functional modules included in the first embodiment can be combined with the detailed description of subsequent embodiments. In the first embodiment, only the overall description of the system architecture is given and the detailed description will not be repeated.

[0045] A second exemplary embodiment of the present disclosure provides a screen projection method applied to a same-screen viewing device.

[0046] FIG2 schematically shows a flow chart of a method for screen projection applied to a same-screen viewing device according to an embodiment of the present disclosure.

[0047] 2 , the screen projection method for a same-screen viewing device provided by an embodiment of the present disclosure includes the following steps: S210 , S220 , S230 , and S240 .

[0048] In step S210, based on the audio module of the above-mentioned same-screen viewing device, a target ultrasonic carrier signal broadcast by at least one large-screen device to be matched is received.

[0049] In the case that there are multiple large-screen devices to be matched, the multiple large-screen devices to be matched are located in the same space or in different spaces.

[0050] The projection code information is transmitted between the same-screen viewing device 110 and the large-screen device 120 based on ultrasound.

[0051] In some embodiments of the present disclosure, the above-mentioned target ultrasonic carrier signal is obtained by encoding the respective projection code information based on the target ultrasonic carrier information of the above-mentioned at least one large-screen device to be matched; the above-mentioned target ultrasonic carrier information is used to distinguish large-screen devices in different spaces in at least one dimension of amplitude or frequency, or to distinguish different large-screen devices in the same space.

[0052] The target ultrasonic carrier signal includes a signal header and a signal body. Since the large-screen device 120 and the same-screen viewing device 130 have agreed encoding and decoding rules, the decoding side (e.g., the same-screen viewing device 130) can match the encoding rules of the encoding side when decoding.

[0053] As an example, the process of encoding the projection code information based on the target ultrasonic carrier information on the large-screen device 120 to obtain the target ultrasonic carrier signal is as follows:

[0054] Determine the pairing identification frequency in the target ultrasonic carrier frequency band as the sequence head; the pairing identification frequency is used as the identification frequency to distinguish large-screen devices in different spaces;

[0055] Parse the above projection code information into a string corresponding to a preset base; the above preset base includes one of the following: binary, octal, and hexadecimal;

[0056] generating a sequence body for encoding the character string according to the coding frequencies for encoding the characters of the preset base in the target ultrasonic carrier frequency band; wherein the coding frequencies corresponding to different characters of the preset base have a preset frequency interval;

[0057] The sequence header and the sequence body are concatenated to obtain a coding frequency sequence;

[0058] The amplitude of the coding frequency sequence is modulated to the target ultrasonic amplitude, or the power of the coding frequency sequence is modulated to the target ultrasonic power; the coding frequency sequence obtained after modulation is used as the target ultrasonic carrier signal.

[0059] Taking into account the real scenario, there may be multiple large-screen devices 120 in the same space that are simultaneously projecting screens under the control of at least one projection device 130 (they may be projecting the same content or independently projecting different content), and the large-screen devices 120 in multiple adjacent closed spaces may be independently projecting screens. After one or more same-screen viewing devices 110 obtain the ultrasonic carrier signal (carrying projection code information) from the large-screen device 120 transmitted based on ultrasound, how to enable the same-screen viewing devices in each space to identify the target large-screen device corresponding to the projection data to be played on the same screen based on ultrasound, a near-field transmission communication method, without being interfered with by other ultrasonic broadcast signals, is a key issue.

[0060] In view of this, in the embodiments of the present disclosure, target ultrasonic carrier information is provided for distinguishing large-screen devices in different spaces, or for distinguishing different large-screen devices in the same space.

[0061] Because it is a screen projection scenario, when there are multiple large-screen devices in a space, the screen projection code information of these multiple large-screen devices in the local area network is different, but the corresponding target ultrasonic carrier information can be the same. When there are multiple large-screen devices in a space, the target ultrasonic carrier information corresponding to the large-screen devices in different spaces is different, which is used to distinguish different spaces.

[0062] In other embodiments, the target ultrasonic carrier information can also be used to distinguish different large-screen devices in the same space in at least one dimension, either amplitude or frequency. That is, in a projection scenario, different large-screen devices in the same space can correspond to different target ultrasonic carrier information.

[0063] The space here can be either closed or open. For closed spaces, different closed spaces are physically separated. For open spaces, they can be divided into different spaces based on their coverage. For example, along a certain direction (length, width, height, diameter, etc.), 1 meter to 100 meters (the specific values ​​are only examples and can be changed or adjusted based on actual conditions) or a certain spatial range is divided into one space, 101 meters to 200 meters is divided into another space, and so on.

[0064] In step S220, the target ultrasonic carrier signal is parsed and decoded to obtain projection code information of at least one large-screen device to be matched.

[0065] Since there are agreed encoding and decoding rules between the large-screen device and the projection device, the encoding rules of the encoding side can be matched when decoding on the decoding side; in other embodiments, in order to increase the security of signal transmission or avoid cracking, some encryption algorithms or security policies can also be added to the encoding rules.

[0066] FIG3 schematically shows a detailed implementation flowchart of step S220 according to an embodiment of the present disclosure.

[0067] In some embodiments of the present disclosure, as shown in FIG3 , in the above step S220 , the target ultrasonic carrier signal is parsed and decoded to obtain the projection code information of at least one large-screen device to be matched, including the following steps: S310 and S320 .

[0068] In step S310, the signal header of the target ultrasonic carrier signal is parsed to determine at least one large-screen device to be matched corresponding to a pairing identification frequency; the pairing identification frequency is used as an identification frequency to distinguish large-screen devices in different spaces.

[0069] In some embodiments, the pairing identification frequency is also used to distinguish the identification frequencies of different large-screen devices in the same space. It is understood that in the embodiments of the present disclosure, the pairing identification frequencies corresponding to different large-screen devices in the same space can be the same or different; and the projection code information (such as the network address and port number contained in the intranet) corresponding to different large-screen devices in the same space is different.

[0070] In some embodiments, the projection code information of the above-mentioned target large-screen device includes: the network address and port number of the above-mentioned target large-screen device in the intranet, and the above-mentioned intranet refers to a local area network that is built and does not generate traffic data of the network operation service provider.

[0071] In step S320, the signal body of the target ultrasonic carrier signal is decoded according to the coding frequency in the target ultrasonic carrier frequency band corresponding to the target large-screen device to obtain the projection code information of the target large-screen device.

[0072] In some embodiments, large-screen devices in different conference rooms (as an example of a space) or different large-screen devices in the same conference room can be distinguished based on the pairing identification frequency. Then, the same-screen viewing device only needs to decode and process the signal body of the target large-screen device to be played on the same screen in the conference room, and there is no need to decode and process the signal bodies of other unrelated large-screen devices, thereby effectively improving the efficiency of establishing a same-screen connection (the connection between the target large-screen device and the same-screen viewing device is described as a same-screen connection).

[0073] In step S230, a link establishment request is initiated based on the projection code information of the target large-screen device to be viewed on the same screen. The link establishment request is used to request the establishment of a first projection data link between the same-screen viewing device and the target large-screen device.

[0074] For example, the same-screen viewing device sends a link establishment request carrying the screen projection code information to the target large-screen device. During this process, the link establishment request is sent based on the intranet (i.e., the established local area network). After receiving the link establishment request, the target large-screen device verifies the target network address and the target port number; if the verification is successful, the first screen projection data link is established between the large-screen device and the same-screen viewing device.

[0075] In the embodiments of the present disclosure, under some architectures, the link establishment request is sent in a directionally-directed manner, and the link establishment request for a certain network address and port number is sent in a directionally-directed manner to the large-screen device with the corresponding network address and port number, and the large-screen devices with other network addresses and port numbers will not receive the above-mentioned link establishment request; under some architectures, the link establishment request is sent in a non-directional manner, and the link establishment request of the same-screen viewing device can be sent to multiple large-screen devices in the same space, and each large-screen device verifies the target network address and target port number, and responds to the link establishment request that matches its own network address and port number.

[0076] In step S240, based on the established first screen projection data link, the screen projection data from the above-mentioned target large-screen device is received and the screen projection is displayed.

[0077] The same-screen viewing device receives the projection data from the target large-screen device based on the first projection data link and performs projection display.

[0078] In some embodiments, as shown in FIG1 , since the data in the screen projection interface presented by the large-screen device 120 is transmitted from the screen projection device 130, generally speaking, the screen projection device 130 can transmit the data stream obtained by the screen recording (such as PPT playback data, video playback data, document playback data, picture playback data, etc.) to the large-screen device 120 in real time, and the large-screen device 120 performs screen projection display. In the case of a slow intranet speed or the analysis of complex screen projection data will take more time, and delays may occur during this period. First, a delay will be generated between the real-time playback content of the projection device 130 (for example, time t1 when a certain video X is displayed at the same time) and the real-time playback content of the projection device 120 (for example, time t2 when the same video X is displayed at the same time, and time t2 is later than time t1, and the time delay between the two is expressed as δ1); secondly, after the subsequent same-screen viewing device 110 establishes a connection with the large-screen device 120, the large-screen device 120 will send the projection data to the same-screen viewing device 110, which may also cause a delay. In the embodiment of the present disclosure, in order to ensure the same-screen viewing effect, that is, the delay between the real-time playback content presented on the same-screen viewing device 110 and the real-time playback content presented on the large-screen device 120 is almost negligible to the human eye, that is, it is necessary to control the playback delay between the large-screen device 120 and the same-screen viewing device 110 to be controllable and within a preset delay threshold, which is almost imperceptible to the human eye, for example, the preset delay threshold is 0.4s. To achieve this goal, the embodiments of the present disclosure provide two exemplary control methods. It is understandable that in a system including a projection device, the delay between the projection device 130 and the large-screen device 120 also has the above-mentioned control requirements.

[0079] According to an embodiment of the present disclosure, the projection data received by the above-mentioned same-screen viewing device is data received and forwarded in real time by the above-mentioned target large-screen device based on a pre-established second projection data link. The above-mentioned second projection data link is a data transmission channel between the above-mentioned target large-screen device and the projection device.

[0080] In this embodiment, considering that the time consumption of parsing the data stream corresponding to the projection data is greater than the time consumption of data transmission, the following data transmission logic is set to regulate the presentation delay between the large-screen device and the same-screen viewing device: after the target large-screen device receives the projection data from the projection device based on the second projection data link, it is forwarded to the same-screen viewing device in real time without parsing. The target large-screen device and the same-screen viewing device independently and synchronously parse and project the projection data they have received. In this way, it can be ensured that the target large-screen device and the same-screen viewing device each take almost the same time to parse the projection data. The delay mainly occurs in the process of forwarding from the target large-screen device to the same-screen viewing device. For most spaces, this transmission delay is almost controllable and meets the above-mentioned preset delay threshold. Therefore, it can meet the same-screen viewing effect between the large-screen device and the same-screen viewing device in most scenarios.

[0081] According to another embodiment of the present disclosure, the projection data received by the above-mentioned same-screen viewing device is target data received by the above-mentioned target large-screen device based on a pre-established second projection data link and stored in the cache area of ​​the above-mentioned target large-screen device. The moment when the above-mentioned target data starts to be parsed on the above-mentioned target large-screen device is aligned with the moment when the above-mentioned target data is transmitted to the above-mentioned same-screen viewing device; the delay between the moment when the above-mentioned target data starts to be played on the above-mentioned target large-screen device and the moment when the above-mentioned projection device plays the corresponding data is within the preset delay threshold.

[0082] In this embodiment, taking into account that the time consumption of parsing the data stream corresponding to the projection data is greater than the time consumption of data transmission, the presentation delay between the large-screen device and the same-screen viewing device, and between the large-screen device and the projection device is regulated by setting the following data transmission logic: by setting a cache area in the target large-screen device, the cache area can accumulate and store data for a time period, that is, compared with conventional projection display, conventional projection display immediately parses and performs projection display after receiving the data stream corresponding to the projection data; different from this, the present embodiment can temporarily store the data stream in the cache area in chronological order after receiving the data stream corresponding to the projection data, and after the cumulative time period of data storage reaches the set time period condition (which can be adaptively set and regulated according to the size of the space, for example, set to 200ms), the following two synchronously executed operations are triggered at the same time: one operation is to send the data stream corresponding to the cumulative time period temporarily stored in the cache area to the same-screen viewing device; the other operation is to start parsing the data stream corresponding to the cumulative time period temporarily stored in the cache area in the target large-screen device. In this case, it can ensure that the target large-screen device and the same-screen viewing device each parse the data stream corresponding to the cumulative time period at almost the same time. The delay mainly occurs in the process of forwarding from the target large-screen device to the same-screen viewing device. For most spaces, this transmission delay is almost controllable and meets the above-mentioned preset delay threshold. Therefore, it can meet the same-screen viewing effect between the large-screen device and the same-screen viewing device in most scenarios; at the same time, by regulating the above-mentioned cumulative time period, it can indirectly regulate the time difference between the data stream of the projection data received by the target large-screen device from the projection device at each moment and the actual playback, thereby also realizing the delay control between the target large-screen device and the projection device, and realizing that the time delay between the moment when the target data starts to play on the above-mentioned target large-screen device and the moment when the above-mentioned projection device plays the corresponding data is within the preset delay threshold. Overall, the same-screen viewing effect is achieved between the target large-screen device and the same-screen playback device, and between the target large-screen device and the projection device.

[0083] A third exemplary embodiment of the present disclosure provides a screen projection method applied to a large-screen device.

[0084] FIG4 schematically shows a timing diagram of the interaction process of the method for performing screen projection between the same-screen viewing device and the large-screen device according to an embodiment of the present disclosure.

[0085] 4 , the method for screen projection applied to a large-screen device includes the following steps: S410 , S420 , S430 , S440 , and S450 .

[0086] In step S410, a same-screen viewing instruction is received.

[0087] For example, in one implementation scenario, as shown in FIG1 , the same-screen viewing device 110 and the large-screen device 120 are located in the same space and are each in the startup state. The large-screen device 120 serves as the sender of the projection data (the original source may be the projection device 130), and the same-screen viewing device 110 serves as the receiver of the projection data. The same-screen viewing instruction may be manually pressing the screen transfer start button on the large-screen device or clicking the same-screen viewing start function key, which is regarded as the large-screen device receiving the same-screen viewing instruction. For example, the same-screen viewing start function key is a function key in the projection control application R of the large-screen device 120.

[0088] In step S420, according to the same-screen viewing instruction, the target ultrasonic carrier information corresponding to the large-screen device is determined.

[0089] Taking into account the real scenario, there may be multiple large-screen devices 120 in the same space that are simultaneously projecting screens under the control of at least one projection device 130 (they may be projecting the same content or independently projecting different content), and the large-screen devices 120 in multiple adjacent closed spaces may be independently projecting screens. After one or more same-screen viewing devices 110 obtain the ultrasonic carrier signal (carrying projection code information) from the large-screen device 120 transmitted based on ultrasound, how to enable the same-screen viewing devices in each space to identify the target large-screen device corresponding to the projection data to be played on the same screen based on ultrasound, a near-field transmission communication method, without being interfered with by other ultrasonic broadcast signals, is a key issue.

[0090] In view of this, in the embodiments of the present disclosure, target ultrasonic carrier information is provided for distinguishing large-screen devices in different spaces, or for distinguishing different large-screen devices in the same space.

[0091] According to an embodiment of the present disclosure, the target ultrasonic carrier information is used to distinguish large-screen devices in different spaces, or to distinguish different large-screen devices in the same space, in at least one dimension of amplitude or frequency.

[0092] In the above step S420, according to the above same-screen viewing instruction, the target ultrasonic carrier information corresponding to the above-mentioned large-screen device is determined, including: according to the above-mentioned same-screen viewing instruction, the target space where the above-mentioned large-screen device is located is determined; according to the mapping table between space and ultrasonic carrier frequency band, the target ultrasonic carrier frequency band corresponding to the above-mentioned target space is determined; the above-mentioned mapping table stores the correspondence between space, large-screen device and ultrasonic carrier frequency band; according to the area information and spatial structure information of the space where the above-mentioned large-screen device and the above-mentioned same-screen viewing device are located, the target ultrasonic power or target ultrasonic amplitude corresponding to the above-mentioned large-screen device is determined.

[0093] In some embodiments, according to the screen projection start instruction, the device number of the large-screen device can be located, and by querying the preconfigured device list according to the device number, the space information of the target space where the large-screen device corresponding to the device number is located can be obtained. The above-mentioned device list stores information about the devices contained in the space. For example, the above-mentioned space is a plurality of conference rooms of a certain enterprise, and the device list stores relevant information about the large-screen devices placed in each of the plurality of conference rooms contained in the enterprise. For example, the device list contains the following information: {first-floor conference room 1XX, area XXX, internal structure YYY-large-screen device X11, large-screen device X12; second-floor conference room 2X1, area X, internal structure Y-large-screen device X201, large-screen device X202; second-floor conference room 2X2, area XX, internal structure YY-large-screen device X211; ...}.

[0094] The process of determining the target ultrasonic carrier frequency band corresponding to the above-mentioned target space is to determine the target ultrasonic carrier information of the large-screen device in the target space in the frequency dimension.

[0095] The process of determining the target ultrasonic power or target ultrasonic amplitude corresponding to the above-mentioned large-screen device is to determine the target ultrasonic carrier information of the large-screen device in the amplitude dimension (which can also be described as the power dimension) in the target space.

[0096] The corresponding relationship stored in the above mapping table includes at least one of the following situations A to D.

[0097] Scenario A: When different first large-screen devices and second large-screen devices in the same space project the same content, the first large-screen device and the second large-screen device have the same target ultrasonic carrier frequency band.

[0098] For example, if the large-screen device 1 and the large-screen device 2 in a conference room are projecting the same content, then for one or more devices viewing the same screen, if the content corresponding to the large-screen device 1 or the large-screen device 2 is to be displayed on the same screen, then any one of the large-screen devices can be selected to establish the corresponding first projection data link. The target ultrasonic carrier frequency bands corresponding to the large-screen device 1 and the large-screen device 2 can be the same. Setting the same target ultrasonic carrier frequency band can be used to simplify control. It can be understood that in this embodiment, when multiple large-screen devices have the same content projected, when the devices viewing the same screen are connected for the same-screen display, the target ultrasonic carrier frequency bands of the multiple large-screen devices can also be set to different. In this case, you can choose one large-screen device to connect.

[0099] Scenario B: When independently projecting screens on a first and second large-screen device in the same space, the first and second large-screen devices use different target ultrasonic carrier frequency bands. Independent projection means that the first and second large-screen devices are not linked to each other in terms of projected content, and each device independently controls the projection.

[0100] For example, in a conference room, large screen device 1 projects content C1, and large screen device 2 projects content C2. Content C1 and content C2 come from two different projection devices and are displayed independently. Then, the target ultrasonic carrier frequency bands corresponding to large screen device 1 and large screen device 2 are different.

[0101] In situation B, through the frequency control strategy, if a same-screen viewing device can receive multiple ultrasonic carrier signals of comparable strength from different large-screen devices in the same space, it can also identify the target large-screen device to be displayed on the same screen based on the frequency difference and perform corresponding parsing and decoding of the projection code information. There is no need to perform corresponding decoding operations on other unrelated large-screen devices, nor will it be interfered with by the ultrasonic carrier signals of other unrelated large-screen devices in the same space. For example, if the same-screen viewing device simultaneously receives the ultrasonic carrier signals broadcast by large-screen device 1 and large-screen device 2, then it can perform direction identification through the difference in the target ultrasonic carrier frequency bands corresponding to large-screen device 1 and large-screen device 2, parse and decode the projection code information of large-screen device 1 (as an example of the target large-screen device) to be displayed on the same screen, and establish a first projection data link with large-screen device 1; there is no need to decode the ultrasonic carrier signal of large-screen device 2, nor will it be interfered with by the ultrasonic carrier signal broadcast by large-screen device 2, and the projection code information of large-screen device 1 can be smoothly identified.

[0102] Case C: When the first space and the second space are different spaces, and the third large screen device in the first space and the fourth large screen device in the second space are independently projected, the target ultrasonic power or target ultrasonic amplitude of the third large screen device meets the following conditions: the signal transmission distance in the first space is met and the device is attenuated to below the first preset threshold after reaching the second space; the target ultrasonic power or target ultrasonic amplitude of the fourth large screen device meets the following conditions: the signal transmission distance in the second space is met and the device is attenuated to below the second preset threshold after reaching the first space; the third large screen device and the fourth large screen device have the same target ultrasonic carrier frequency band (the target ultrasonic carrier information in the frequency dimension is the same).

[0103] In scenario C, by setting an amplitude (or power) control strategy, the ultrasonic carrier signal strength received by the co-screen viewing devices in different spaces from other spaces is very weak, essentially being ignored as noise. Because the target ultrasonic amplitude (or power) of the third-largest screen device in the first space ensures the signal transmission distance in the first space and decays to below a first threshold (e.g., 2% to 5% of the original signal strength) upon reaching the second space, the target ultrasonic power or amplitude corresponding to the received ultrasonic carrier signal (e.g., ultrasonic carrier signal H3) is very small for the co-screen viewing devices in the second space. Compared to the ultrasonic carrier control signal (e.g., ultrasonic carrier signal H4) from the fourth-largest screen device with a stronger signal strength, the H3 signal can be almost ignored as background noise. Therefore, even if the third and fourth-largest screen devices share the same target ultrasonic carrier frequency band, the aforementioned amplitude or power settings ensure that the H3 signal minimally interferes with the H4 signal to be decoded by the co-screen viewing devices in the second space. Similarly, the H4 signal has minimal interference with the H3 signal being decoded by the co-viewing device in the first space. This allows the co-viewing device to effectively distinguish, decode, and connect to large-screen devices in different spaces.

[0104] Situation D: When the third large screen device in the first space and the fourth large screen device in the second space perform independent screen projection, the target ultrasonic power or target ultrasonic amplitude of the third large screen device meets the following conditions: the signal transmission distance in the first space is met and the device is attenuated to below the third preset threshold after reaching the second space; the target ultrasonic power or target ultrasonic amplitude of the fourth large screen device meets the following conditions: the signal transmission distance in the second space is met and the device is attenuated to below the fourth preset threshold after reaching the first space; the third large screen device and the fourth large screen device have different target ultrasonic carrier frequency bands (the target ultrasonic carrier information in the frequency dimension is different); wherein the third preset threshold is greater than the first preset threshold, and the fourth preset threshold is greater than the second preset threshold.

[0105] In situation D, a comprehensive control strategy is adopted by setting amplitude and frequency. First, by setting the amplitude control strategy, the intensity of the ultrasonic carrier signal received by the same-screen viewing devices in different spaces from the large-screen devices in other spaces is very weak. At the same time, in order to further reduce the interference between ultrasonic carrier signals of different intensities, combined with the frequency control strategy, even if the same same-screen viewing device can receive the ultrasonic carrier signal of the large-screen device with different intensities, it can also identify the ultrasonic carrier signal of the target large-screen device to be displayed on the same screen based on the frequency difference and perform corresponding directional decoding.

[0106] According to an embodiment of the present disclosure, different target ultrasonic carrier frequency bands include one of the following situations:

[0107] Different target ultrasonic carrier frequency bands have different pairing identification frequencies; or,

[0108] Different target ultrasonic carrier frequency bands have different pairing identification frequencies, and the pairing identification frequencies correspond to unique pairing groups; or,

[0109] Different target ultrasonic carrier frequency bands have different pairing identification frequencies, and the preset frequency intervals between the coding frequencies for encoding the characters of the preset base in different target ultrasonic carrier frequency bands are different; or,

[0110] Different target ultrasonic carrier frequency bands have different pairing identification frequencies, and the above pairing identification frequencies correspond to unique pairing groups; the preset frequency intervals between the coding frequencies used to encode the characters in the above preset base in different target ultrasonic carrier frequency bands are different; wherein the above pairing group is a pairing group composed of a large-screen device and a same-screen viewing device.

[0111] For example, the target ultrasonic carrier frequency bands corresponding to the large-screen devices in different conference rooms are different; for example, the starting frequency of the target ultrasonic carrier frequency band corresponding to the large-screen device T1 (for example, as a pairing identification frequency) is 20000 Hz, and the coding frequencies of 20100 Hz, 20200 Hz, 20300 Hz, etc. with a frequency interval of 100 Hz (the numerical value is only for example and can be changed) are used to transmit the encoded (binary, octal or hexadecimal, etc.) projection code information; the starting frequency of the target ultrasonic carrier frequency band corresponding to the large-screen device T2 (for example, as a pairing identification frequency) is 20100 Hz; the carrier band interval used is, for example, 120 Hz, and the coding frequencies of 20220 Hz, 20340 Hz, 20460 Hz, etc. with a frequency interval of 100 Hz (the numerical value is only for example and can be changed) are used to transmit the encoded projection code information; the two are distinguished in the transmission frequency band, that is, the target ultrasonic carrier frequency bands corresponding to large-screen devices in different spaces or different large-screen devices in the same space are different.

[0112] In step S430, based on the target ultrasonic carrier information, the projection code information of the large-screen device is encoded to obtain a target ultrasonic carrier signal.

[0113] According to an embodiment of the present disclosure, in the above-mentioned step S430, based on the above-mentioned target ultrasonic carrier information, the projection code information of the above-mentioned large-screen device is encoded and processed to obtain a target ultrasonic carrier signal, including: determining the pairing identification frequency in the above-mentioned target ultrasonic carrier frequency band as the sequence head; the above-mentioned pairing identification frequency is used to distinguish the identification frequency of large-screen devices in different spaces; parsing the above-mentioned projection code information into a character string corresponding to a preset base; generating a sequence body for encoding the above-mentioned character string according to the coding frequency in the above-mentioned target ultrasonic carrier frequency band for encoding the characters of the above-mentioned preset base; the coding frequencies corresponding to different characters of the above-mentioned preset base have a preset frequency interval; splicing the above-mentioned sequence head and the above-mentioned sequence body to obtain a coding frequency sequence; modulating the amplitude of the above-mentioned coding frequency sequence to the above-mentioned target ultrasonic amplitude, or modulating the power of the above-mentioned coding frequency sequence to the above-mentioned target ultrasonic power; the coding frequency sequence obtained after modulation is used as the target ultrasonic carrier signal.

[0114] In some embodiments, scenarios where large-screen devices in different spaces correspond to different pairing identification frequencies include: multiple large-screen devices in the same conference room (as an example space) correspond to different pairing identification frequencies; and large-screen devices in different conference rooms correspond to different pairing identification frequencies. In other implementation scenarios, if multiple large-screen devices in the same conference room display the same content, these large-screen devices can correspond to the same pairing identification frequency.

[0115] In some embodiments, for a single large-screen device, when it has one or more corresponding co-viewing devices, the pairing groups formed by the multiple co-viewing devices and the corresponding large-screen devices have the same pairing identification frequency. For example, the pairing identification frequency corresponding to the target large-screen device 1 and the two co-viewing devices Y1 and Y2 is F0. This embodiment can be applied to scenarios where the projection content of the same large-screen device is displayed on multiple co-viewing devices.

[0116] In some embodiments, according to the sampling rate of the audio module of 44K, based on the Shannon principle, it can be determined that the highest supported transmission frequency is 22kHz, and the target ultrasonic carrier frequency band can be a frequency band within the range of 20kHz to 22kHz or smaller.

[0117] The coding frequencies are sequentially spliced ​​to obtain a sequence body. According to the capacity of ultrasonic transmission (for example, how long the frequency is transmitted at one time), the projection code information (depending on the length of the code) can be sent once or multiple times.

[0118] In the embodiment of the above-mentioned step S430, in the process of encoding the projection code information, the coding frequency sequence obtained by encoding includes a sequence head and a sequence body, and the sequence body is obtained by frequency encoding the coding frequency according to the character string corresponding to the projection code information; the sequence head is obtained by determining the pairing identification frequency in the target ultrasonic carrier frequency band, and the pairing identification frequency is used to distinguish the identification frequency of large-screen devices in different spaces. By identifying the sequence head, it is possible to distinguish large-screen devices in different spaces, thereby achieving directional control for different large-screen devices. In some embodiments, the starting frequency of the target ultrasonic carrier frequency band can be used as a distinguishing mark that can indicate large-screen devices in different spaces, which is convenient and simple to set up. It can be understood that the frequency of the target ultrasonic carrier frequency band at other positions can also be used as the pairing identification frequency.

[0119] In step S440, the target ultrasonic carrier signal is broadcast based on the audio module of the above-mentioned large-screen device, so that the above-mentioned target ultrasonic carrier signal is transmitted to the same-screen viewing device in the space where the above-mentioned large-screen device is located; the above-mentioned screen projection code information is used to establish the first screen projection data link between the above-mentioned large-screen device and the above-mentioned same-screen viewing device.

[0120] As shown in Figures 1 and 4 , the audio module N of the large-screen device 120 broadcasts a target ultrasonic carrier signal, so that the target ultrasonic carrier signal is transmitted to the same-screen viewing devices 110 within the space where the large-screen device 120 is located. The number of the same-screen viewing devices 110 can be one or more. It is understood that the number of large-screen devices 120 can also be one or more.

[0121] In step S450, based on the established first screen projection data link, the screen projection data is sent to the above-mentioned same-screen viewing device.

[0122] 1 and 4 , the large-screen device 120 sends the projection data to the same-screen viewing device 110 based on the established first projection data link. The same-screen viewing device 110 receives the projection data from the target large-screen device and displays the projection data.

[0123] In an embodiment including steps S410 to S450, by transmitting the projection code information between the large-screen device and the same-screen viewing device based on ultrasound with a frequency greater than 20kHz, the audio modules (built-in hardware devices) of the large-screen device and the same-screen viewing device can be effectively utilized to realize the transmission and reception of the projection code information. Ultrasonic waves can efficiently transmit signals over a short distance, and there is no need to transmit the projection code information based on Internet communication. The same-screen viewing device can conveniently and quickly establish a projection data link with the large-screen device based on the projection code information. By determining the target ultrasonic carrier information corresponding to the large-screen device, in a scenario where there are one or more large-screen devices in a space or large-screen devices in multiple adjacent spaces all broadcast screen projection code information based on ultrasound, corresponding encoding processing of the screen projection code information can be performed based on the target ultrasonic carrier information corresponding to each large-screen device to obtain a target ultrasonic carrier signal. This allows the same-screen viewing device to distinguish between large-screen devices in different spaces or distinguish between different large-screen devices in the same space after receiving the target ultrasonic carrier signal, and establish a corresponding first screen projection data link for the target large-screen device that needs to be projected, thereby realizing a directional connection between the same-screen viewing device and the large-screen device, and reducing or even avoiding mutual interference when multiple large-screen devices simultaneously broadcast screen projection code information based on ultrasound.

[0124] In some embodiments, the above-mentioned projection code information includes: the network address and port number of the above-mentioned large-screen device in the intranet, and the above-mentioned intranet refers to a local area network that is built and does not generate traffic data of the network operation service provider.

[0125] 4 , the method for screen projection applied to a large-screen device, in addition to the above steps S410 to S450 , further includes the following steps: S401 , S402 and S403 .

[0126] In step S401, a link establishment request initiated by a same-screen viewing device is received; the link establishment request includes: the target large-screen device requested to be connected is located in the intranet with a target network address and a target port number; the target network address and the target port number are obtained by the same-screen viewing device by parsing the received target ultrasonic carrier signal.

[0127] In step S402, the target network address and the target port number are verified.

[0128] In step S403, if the verification is successful, a first screen projection data link is established between the above-mentioned large-screen device and the above-mentioned same-screen viewing device.

[0129] According to an embodiment of the present disclosure, the projection data sent by the above-mentioned large-screen device is data received and forwarded in real time based on a pre-established second projection data link, and the above-mentioned second projection data link is a data transmission channel between the above-mentioned large-screen device and the projection device; or, the projection data sent by the above-mentioned large-screen device is target data received and stored in the cache area of ​​the above-mentioned large-screen device based on the pre-established second projection data link, and the moment when the above-mentioned target data starts to be parsed on the above-mentioned large-screen device is aligned with the moment when the above-mentioned target data is transmitted to the above-mentioned same-screen viewing device; the delay between the moment when the above-mentioned target data starts to be played on the above-mentioned large-screen device and the moment when the above-mentioned projection device plays the corresponding data is within a preset delay threshold.

[0130] More details of this embodiment, interaction with the same-screen viewing device, etc. can be understood in conjunction with the relevant contents of the first and second embodiments, and will not be repeated here.

[0131] A fourth exemplary embodiment of the present disclosure provides a same-screen viewing device.

[0132] FIG5 schematically shows a structural block diagram of a same-screen viewing device according to an embodiment of the present disclosure.

[0133] 5 , the same-screen viewing device 500 provided by an embodiment of the present disclosure includes: a signal receiving module 501 , a decoding module 502 , a link establishing module 503 , a data receiving module 504 and a display module 505 .

[0134] The signal receiving module 501 is provided in the audio module of the same-screen viewing device, and is used to receive a target ultrasonic carrier signal broadcast by at least one large-screen device to be matched.

[0135] The decoding module 502 is used to parse and decode the target ultrasonic carrier signal to obtain the projection code information of at least one large-screen device to be matched.

[0136] The link establishment module 503 is used to initiate a link establishment request based on the projection code information of the target large-screen device to be viewed on the same screen. The link establishment request is used to request the establishment of the first projection data link between the same-screen viewing device and the target large-screen device.

[0137] The data receiving module 504 is used to receive the projection data from the target large-screen device based on the established first projection data link.

[0138] The display module 505 is used to perform screen projection display based on the screen projection data.

[0139] For more details and beneficial effects of this embodiment, please refer to the relevant descriptions of the first and second embodiments, which will not be repeated here.

[0140] A fifth exemplary embodiment of the present disclosure provides a large-screen device.

[0141] FIG6 schematically shows a structural block diagram of a large-screen device according to an embodiment of the present disclosure.

[0142] 6 , the large-screen device 600 provided by an embodiment of the present disclosure includes: an instruction receiving module 601 , an ultrasonic carrier information determining module 602 , an encoding module 603 , a signal sending module 604 and a data sending module 605 .

[0143] The instruction receiving module 601 is used to receive instructions for watching on the same screen.

[0144] The ultrasonic carrier information determination module 602 is used to determine the target ultrasonic carrier information corresponding to the large-screen device according to the same-screen viewing instruction.

[0145] The encoding module 603 is used to encode the projection code information of the large-screen device based on the target ultrasonic carrier information to obtain the target ultrasonic carrier signal.

[0146] The above-mentioned signal sending module 604 is arranged in the audio module of the above-mentioned large-screen device, and is used to broadcast the above-mentioned target ultrasonic carrier signal, so that the above-mentioned target ultrasonic carrier signal is transmitted to the same-screen viewing device in the space where the above-mentioned large-screen device is located; the above-mentioned screen projection code information is used to establish the first screen projection data link between the above-mentioned large-screen device and the above-mentioned same-screen viewing device.

[0147] The above-mentioned data sending module 605 is used to send the projection data to the above-mentioned same-screen viewing device based on the established first projection data link.

[0148] The large-screen device 700 further includes: a request receiving module, a verification module and a connection module.

[0149] The above-mentioned request receiving module is used to receive a link establishment request initiated by a same-screen viewing device; the above-mentioned link establishment request includes: the target large-screen device requested to be connected is located in the intranet's target network address and target port number; the above-mentioned target network address and the above-mentioned target port number are obtained by the above-mentioned projection device parsing the received target ultrasonic carrier signal.

[0150] The verification module is used to verify the target network address and the target port number.

[0151] The above-mentioned connection module is used to establish a screen projection data link between the above-mentioned large-screen device and the above-mentioned same-screen viewing device when the verification is passed.

[0152] For more details and beneficial effects of this embodiment, please refer to the relevant descriptions of the first and third embodiments, which will not be repeated here.

[0153] Any number of the functional modules included in the above-mentioned same-screen viewing device 500 or large-screen device 600 can be combined into one module for implementation, or any one of the modules can be split into multiple modules. Alternatively, at least part of the functions of one or more of these modules can be combined with at least part of the functions of other modules and implemented in one module. At least one of the functional modules included in the same-screen viewing device 500 or large-screen device 600 can be at least partially implemented as a hardware circuit, such as a field programmable gate array (FPGA), a programmable logic array (PLA), a system on a chip, a system on a substrate, a system on a package, an application-specific integrated circuit (ASIC), or can be implemented by hardware or firmware such as any other reasonable way of integrating or packaging the circuit, or implemented in any one of the three implementation methods of software, hardware and firmware, or in an appropriate combination of any of them. Alternatively, at least one of the functional modules included in the same-screen viewing device 500 or large-screen device 600 can be at least partially implemented as a computer program module, which can perform the corresponding function when the computer program module is run.

[0154] It should be noted that the collection, collection, updating, analysis, processing, use, transmission, and storage of user personal information involved in the technical solutions provided by the embodiments of this disclosure all comply with the provisions of relevant laws and regulations, are used for legitimate purposes, and do not violate public order and good morals. Necessary measures are taken with respect to user personal information to prevent unauthorized access to user personal information data and to maintain the security of user personal information, network security, and national security.

[0155] It should be noted that, in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article, or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article, or device. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or device comprising the element.

[0156] The foregoing description is intended only to provide specific embodiments of the present disclosure, intended to enable those skilled in the art to understand and implement the present disclosure. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure is not to be limited to the embodiments shown herein, but is to be construed in the broadest manner consistent with the principles and novel features claimed herein.

Claims

1. A method for screen projection, wherein: Applied to a same-screen viewing device, the method includes: Based on the audio module of the same-screen viewing device, receiving at least one target ultrasonic carrier signal broadcast by a large-screen device to be matched; Parsing and decoding the target ultrasonic carrier signal to obtain projection code information of at least one large-screen device to be matched; Initiate a link establishment request based on the projection code information of the target large-screen device to be screen-shared, wherein the link establishment request is used to request the establishment of a first projection data link between the screen-shared viewing device and the target large-screen device; Based on the established first screen projection data link, the screen projection data from the target large-screen device is received and the screen projection is displayed.

2. The method according to claim 1, wherein The target ultrasonic carrier signal is parsed and decoded to obtain projection code information of at least one large-screen device to be matched, including: Parsing the signal header of the target ultrasonic carrier signal to determine at least one large-screen device to be matched corresponding to a pairing identification frequency; the pairing identification frequency is used as an identification frequency to distinguish large-screen devices in different spaces; According to the coding frequency in the target ultrasonic carrier frequency band corresponding to the target large-screen device, the signal body of the target ultrasonic carrier signal is decoded to obtain the projection code information of the target large-screen device.

3. The method according to claim 2, wherein: The projection code information of the target large-screen device includes: the network address and port number of the target large-screen device in the intranet, and the intranet refers to a local area network that does not generate traffic data for the network operation service provider.

4. The method according to claim 1, wherein The target ultrasonic carrier signal is obtained by encoding the respective projection code information based on the target ultrasonic carrier information of the at least one large-screen device to be matched; The target ultrasonic carrier information is used to distinguish large-screen devices in different spaces or to distinguish different large-screen devices in the same space in at least one dimension of amplitude or frequency.

5. The method according to any one of claims 1 to 4, wherein The projection data received by the same-screen viewing device is data received and forwarded in real time by the target large-screen device based on a pre-established second projection data link, where the second projection data link is a data transmission channel between the target large-screen device and the projection device; or The projection data received by the same-screen viewing device is target data received by the target large-screen device based on a pre-established second projection data link and stored in a buffer area of the target large-screen device, and the time when the target data starts to be parsed on the target large-screen device is aligned with the time when the target data is transmitted to the same-screen viewing device; The delay between the moment when the target data starts to be played on the target large-screen device and the moment when the projection device plays the corresponding data is within the preset delay threshold.

6. A method for screen projection, wherein: Applied to large-screen devices, the method includes: Receive instructions for watching on the same screen; Determining target ultrasonic carrier information corresponding to the large-screen device according to the same-screen viewing instruction; Based on the target ultrasonic carrier information, encoding the projection code information of the large-screen device to obtain a target ultrasonic carrier signal; The target ultrasonic carrier signal is broadcast based on the audio module of the large-screen device, so that the target ultrasonic carrier signal is transmitted to the same-screen viewing device in the space where the large-screen device is located; the screen projection code information is used to establish a first screen projection data link between the large-screen device and the same-screen viewing device; Based on the established first screen projection data link, the screen projection data is sent to the same-screen viewing device.

7. The method according to claim 6, wherein: The target ultrasonic carrier information is used to distinguish large-screen devices in different spaces, or to distinguish different large-screen devices in the same space, in at least one dimension of amplitude or frequency; Wherein, determining the target ultrasonic carrier information corresponding to the large-screen device according to the same-screen viewing instruction includes: Determining a target space where the large-screen device is located according to the same-screen viewing instruction; Determine the target ultrasonic carrier frequency band corresponding to the target space according to a mapping table between space and ultrasonic carrier frequency band; the mapping table stores the correspondence between space, large-screen device and ultrasonic carrier frequency band; According to the area information and spatial structure information of the space where the large-screen device and the same-screen viewing device are located, the target ultrasonic power or target ultrasonic amplitude corresponding to the large-screen device is determined.

8. The method according to claim 7, wherein: Based on the target ultrasonic carrier information, encoding the projection code information of the large-screen device to obtain a target ultrasonic carrier signal includes: Determine the pairing identification frequency in the target ultrasonic carrier frequency band as the sequence head; the pairing identification frequency is used as an identification frequency to distinguish large-screen devices in different spaces; Parse the screen projection code information into a character string corresponding to a preset base; generating a sequence body for encoding the character string according to a coding frequency for encoding characters of the preset base in the target ultrasonic carrier frequency band, wherein the coding frequencies corresponding to different characters of the preset base have a preset frequency interval; splicing the sequence header and the sequence body to obtain a coding frequency sequence; The amplitude of the coding frequency sequence is modulated to the target ultrasonic amplitude, or the power of the coding frequency sequence is modulated to the target ultrasonic power; the coding frequency sequence obtained after modulation is used as the target ultrasonic carrier signal.

9. The method according to claim 7, wherein: In the corresponding relationship, at least one of the following situations exists: When different first large-screen devices and second large-screen devices in the same space project the same content, the first large-screen device and the second large-screen device have the same target ultrasonic carrier frequency band; or, In the case where different first large-screen devices and second large-screen devices are independently projected in the same space, the first large-screen device and the second large-screen device have different target ultrasonic carrier frequency bands; or, When the first space and the second space are different spaces, and the third large screen device in the first space and the fourth large screen device in the second space are independently projected, the target ultrasonic power or target ultrasonic amplitude of the third large screen device meets the following conditions: the signal transmission distance in the first space is met and the signal is attenuated to below the first preset threshold after reaching the second space; the target ultrasonic power or target ultrasonic amplitude of the fourth large screen device meets the following conditions: the signal transmission distance in the second space is met and the signal is attenuated to below the second preset threshold after reaching the first space; the third large screen device and the fourth large screen device have the same target ultrasonic carrier frequency band; or, When the third large screen device in the first space and the fourth large screen device in the second space perform independent screen projection, the target ultrasonic power or target ultrasonic amplitude of the third large screen device meets the following conditions: the signal transmission distance in the first space is met and the signal is attenuated to below the third preset threshold after reaching the second space; the target ultrasonic power or target ultrasonic amplitude of the fourth large screen device meets the following conditions: the signal transmission distance in the second space is met and the signal is attenuated to below the fourth preset threshold after reaching the first space; the third large screen device and the fourth large screen device have different target ultrasonic carrier frequency bands; The third preset threshold is greater than the first preset threshold, and the fourth preset threshold is greater than the second preset threshold.

10. The method according to claim 7, wherein: Different target ultrasound carrier frequency bands include one of the following situations: Different target ultrasonic carrier frequency bands have different pairing identification frequencies; or, Different target ultrasonic carrier frequency bands have different pairing identification frequencies, and the pairing identification frequencies correspond to unique pairing groups; or, Different target ultrasonic carrier frequency bands have different pairing identification frequencies, and the preset frequency intervals between the coding frequencies for encoding the characters of the preset base in different target ultrasonic carrier frequency bands are different; or, Different target ultrasonic carrier frequency bands have different pairing identification frequencies, and the pairing identification frequencies correspond to unique pairing groups; the preset frequency intervals between the coding frequencies used to encode the characters in the preset base in different target ultrasonic carrier frequency bands are different; wherein the pairing group is a pairing group consisting of a large-screen device and a same-screen viewing device.

11. The method according to claim 6, wherein: The screen projection code information includes: the network address and port number of the large-screen device in the intranet, where the intranet refers to a local area network that does not generate traffic data for the network operator service provider; The method further comprises: Receiving a link establishment request initiated by a co-screen viewing device; the link establishment request includes: a target network address and a target port number of a target large-screen device to be connected to, located in an intranet; the target network address and the target port number are obtained by parsing a received target ultrasonic carrier signal by the co-screen viewing device; Verifying the target network address and the target port number; If the verification is successful, a first screen projection data link is established between the large-screen device and the same-screen viewing device.

12. The method according to any one of claims 6 to 11, wherein: The projection data sent by the large-screen device is data received and forwarded in real time based on a pre-established second projection data link, which is a data transmission channel between the large-screen device and the projection device; or The projection data sent by the large-screen device is target data received and stored in the buffer area of the large-screen device based on the pre-established second projection data link, and the time when the target data starts to be parsed on the large-screen device is aligned with the time when the target data is transmitted to the same-screen viewing device; The delay between the moment when the target data starts to be played on the large-screen device and the moment when the projection device plays the corresponding data is within the preset delay threshold.

13. A device for watching videos on the same screen, wherein: include: a signal receiving module, provided in the audio module of the same-screen viewing device, for receiving a target ultrasonic carrier signal broadcast by at least one large-screen device to be matched; A decoding module, configured to parse and decode the target ultrasonic carrier signal to obtain projection code information of at least one large-screen device to be matched; A link establishment module is used to initiate a link establishment request based on the projection code information of the target large-screen device to be viewed on the same screen, and the link establishment request is used to request the establishment of a first projection data link between the same-screen viewing device and the target large-screen device; A data receiving module, configured to receive projection data from the target large-screen device based on the established first projection data link; The display module is used to perform screen projection display based on the screen projection data.

14. A large-screen device, wherein: include: An instruction receiving module, for receiving an instruction for watching on the same screen; An ultrasonic carrier information determination module, configured to determine target ultrasonic carrier information corresponding to the large-screen device according to the same-screen viewing instruction; An encoding module is used to encode the projection code information of the large-screen device based on the target ultrasonic carrier information to obtain a target ultrasonic carrier signal; a signal sending module, provided in the audio module of the large-screen device, for broadcasting the target ultrasonic carrier signal so that the target ultrasonic carrier signal is transmitted to the same-screen viewing device in the space where the large-screen device is located; the screen projection code information is used to establish a first screen projection data link between the large-screen device and the same-screen viewing device; The data sending module is used to send the projection data to the same-screen viewing device based on the established first projection data link.

15. A screen projection system, wherein: include: Same-screen viewing devices and large-screen devices; The same-screen viewing device is used to perform the method according to any one of claims 1 to 5, or is the same-screen viewing device according to claim 13; The large-screen device is used to execute the method according to any one of claims 6 to 12, or is the large-screen device according to claim 14.

16. The system according to claim 15, wherein: Also includes: A screen projection device, which is used to send screen projection data to the target large-screen device based on the established second screen projection data link.

Images