Screen mirroring method, device and electronic device
By using ultra-wideband signals to determine the angle angle between the terminal device and the ultra-wideband tag and perform screen projection processing, the problem of smart terminal device information projection is solved, and a simple and fast screen projection experience is achieved, which improves the user experience and reduces the hardware transformation cost.
Patent Information
- Application Number
- CN202110782004.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-07-09
- Publication Date
- 2025-06-27
- Estimated Expiration
- 2041-07-09
AI Technical Summary
The prior art is difficult to realize efficient screen projection of smart terminal device information into other display devices, especially when the distance between the terminal device and the display device is far or inconvenient to contact, the user experience is poor.
By using the ultra-wideband signal, the angle angle between the terminal device and the ultra-wideband tag is determined, and when the angle is within a set range, the screen projection process is performed to project information in the terminal device to the display device corresponding to the ultra-wideband tag.
It realizes simple and fast screen projection without installing screen projection software and scanning code operations. It is suitable for any screen projection information, improves the user experience, and avoids the need for hardware transformation of display devices.
Smart Images

Figure CN113485664B_ABST
Abstract
Description
Technical Field
[0001] This application belongs to the technical field of screen mirroring, and specifically relates to a screen mirroring method, a screen mirroring device, and an electronic device. Background Art
[0002] With the popularization of intelligent terminal devices such as smartphones in life, users are accustomed to storing information in terminal devices. However, users do not necessarily expect to always view the internally stored information on the terminal device, so the information stored in the terminal device can be screen-mirrored to other display devices. For example, since the screen size of a smartphone is relatively small and has certain limitations in terms of visual experience, the information in the mobile phone can be screen-mirrored to a television with a larger screen size for display.
[0003] Thus, it is necessary to provide a screen mirroring method. Summary of the Invention
[0004] The purpose of the embodiments of this application is to provide a screen mirroring method, device, and electronic device, which can solve the problem of information screen mirroring.
[0005] In a first aspect, the embodiments of this application provide a screen mirroring method, which includes: determining the included angle between the terminal device and the ultra-wideband tag according to the ultra-wideband signal between the terminal device and the ultra-wideband tag; and performing screen mirroring processing to screen mirror the information in the terminal device to the display device corresponding to the ultra-wideband tag when the included angle between the terminal device and the ultra-wideband tag is within a set first angle range.
[0006] In a second aspect, the embodiments of this application provide a screen mirroring device, which includes: a first processing module for determining the included angle between the terminal device and the ultra-wideband tag according to the ultra-wideband signal between the terminal device and the ultra-wideband tag; and a second processing module for performing screen mirroring processing to screen mirror the information in the terminal device to the display device corresponding to the ultra-wideband tag when the included angle between the terminal device and the ultra-wideband tag is within a set first angle range.
[0007] In a third aspect, the embodiments of this application provide an electronic device, which includes a processor, a memory, and a program or instruction stored on the memory and executable on the processor. When the program or instruction is executed by the processor, the steps of the method described in the first aspect are implemented.
[0008] In a fourth aspect, the embodiments of this application provide a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.
[0009] Fifth aspect, an embodiment of the present application provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor, and the processor is configured to run programs or instructions to implement the method described in the first aspect.
[0010] In an embodiment of the present application, an included angle between the terminal device and the ultra-wideband tag is determined according to the ultra-wideband signal between the terminal device and the ultra-wideband tag. When the included angle is within a set first angle range, screen mirroring processing is performed to screen mirror the information in the terminal device to the display device corresponding to the ultra-wideband tag. In this way, by adjusting the orientation of the terminal device relative to the ultra-wideband tag, the user can screen mirror the information on the terminal device to the display device, thus solving the problem of screen mirroring information. BRIEF DESCRIPTION OF THE DRAWINGS
[0011] Figure 1 is a flowchart of a screen mirroring method provided in this embodiment;
[0012] Figures 2 to 4 is a schematic diagram of screen mirroring provided in this embodiment;
[0013] Figure 5 is a block schematic diagram of a screen mirroring device provided in this embodiment;
[0014] Figure 6 is a schematic hardware structure diagram of an electronic device provided in this embodiment;
[0015] Figure 7 is a schematic hardware structure diagram of another electronic device provided in this embodiment. DETAILED DESCRIPTION OF THE EMBODIMENTS
[0016] Next, the technical solutions in the embodiments of the present application will be clearly described with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are some, but not all, of the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art belong to the scope of protection of the present application.
[0017] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, rather than to describe a specific order or sequence. It should be understood that such data can be interchanged under appropriate circumstances so that the embodiments of the present application can be implemented in an order different from those illustrated or described herein, and the objects distinguished by "first", "second", etc. generally belong to the same category, and the number of objects is not limited. For example, the first object can be one or multiple. In addition, "and / or" in the specification and claims means at least one of the connected objects, and the character " / " generally means an "or" relationship between the associated objects before and after.
[0018] The following will, in conjunction with the accompanying drawings, elaborate on the screen mirroring method provided in the embodiments of the present application through specific embodiments and their application scenarios.
[0019] Please refer to Figure 1 , a screen mirroring method provided in this embodiment may include the following steps S110 to S120:
[0020] Step S110: Determine the included angle between the terminal device and the ultra-wideband tag according to the ultra-wideband signal between the terminal device and the ultra-wideband tag.
[0021] In this embodiment, the execution subject of the screen mirroring method may be a terminal device. The terminal device may be the user's smart phone, smart tablet, etc.
[0022] Specifically, an ultra-wideband (UWB) antenna is provided in the terminal device. Ultra-wideband technology is a wireless carrier communication technology, which has the advantages of low system complexity, low transmit signal power spectral density, insensitivity to channel fading, low interceptability, high positioning accuracy, etc., and is particularly suitable for high-speed wireless access in indoor and other dense multipath scenarios.
[0023] Specifically, an ultra-wideband antenna is provided in the ultra-wideband tag. The ultra-wideband antenna in the terminal device and the ultra-wideband antenna in the ultra-wideband tag can transmit and receive ultra-wideband signals, and the included angle between the terminal device and the ultra-wideband tag can be determined based on the ultra-wideband signal.
[0024] Among them, by adjusting the orientation of the terminal device relative to the ultra-wideband tag, the value of the included angle between the terminal device and the ultra-wideband tag can be correspondingly changed. For example, when the ultra-wideband tag is facing the display screen of the terminal device, the value of this included angle can be 0°.
[0025] Based on the above content, in an embodiment of the present disclosure, in order to illustrate a possible implementation manner of determining the included angle between the terminal device and the ultra-wideband tag, before determining the included angle between the terminal device and the ultra-wideband tag, the method may further include: constructing a three-dimensional rectangular coordinate system, where the origin of the three-dimensional rectangular coordinate system is on the terminal device, and the first coordinate axis of the three-dimensional rectangular coordinate system is perpendicular to the display screen of the terminal device.
[0026] In this embodiment, considering that the ultra-wideband tag is usually fixed in position, while the user can adjust the orientation of the terminal device as needed, a three-dimensional rectangular coordinate system can be established based on the terminal device. Compared with establishing a three-dimensional rectangular coordinate system based on the ultra-wideband tag, in this embodiment, the user can obtain the included angle that can trigger the screen mirroring operation by adjusting the orientation of the terminal device with a smaller amplitude, so the user experience is better.
[0027] In this embodiment, the first coordinate axis of the three-dimensional rectangular coordinate system is perpendicular to the display screen of the terminal device, and the other two coordinate axes can be parallel to the display screen. The display screen of the terminal device is usually rectangular. Preferably, the other two coordinate axes can be parallel to the long side and the short side of the rectangle respectively.
[0028] As Figure 2 shown, the three coordinate axes of the constructed three-dimensional rectangular coordinate system can be the Figure 2 X-axis, Y-axis, and Z-axis shown. Among them, the Z-axis is the above-mentioned first coordinate axis.
[0029] Based on this, the step S110 of determining the included angle between the terminal device and the ultra-wideband tag according to the ultra-wideband signal between the terminal device and the ultra-wideband tag includes: determining the included angle between the target connection line and the first coordinate axis according to the ultra-wideband signals between at least two ultra-wideband antennas in the terminal device and the ultra-wideband tag respectively, so as to be used as the included angle between the terminal device and the ultra-wideband tag. Among them, the target connection line is the connection line between the origin and the ultra-wideband tag, and the target angle is not greater than 90°.
[0030] In this embodiment, in order to determine the included angle between the terminal device and the ultra-wideband tag, at least two ultra-wideband antennas need to be set in the terminal device. For example, the terminal device includes at least 2 ultra-wideband antennas in the horizontal direction for angle measurement in the two-dimensional plane, and the midpoint of the connection line of these 2 ultra-wideband antennas can be used as the coordinate origin of the three-dimensional rectangular coordinate system.
[0031] Based on the ultra-wideband signals transmitted and received between the ultra-wideband antennas in the terminal device and the ultra-wideband antennas in the ultra-wideband tag, combined with the existing positioning technology, the included angle between the terminal device and the ultra-wideband tag can be determined. For example, the existing TDOA (Time Difference of Arrival) algorithm, PDOA (Phase Difference Of Arrival) algorithm, etc. can be used to achieve accurate angle measurement.
[0032] Please refer to Figure 2 , the included angle between the terminal device and the ultra-wideband tag is the included angle θ (0° ≤ θ ≤ 90°) between the target connection line and the first coordinate axis. The first coordinate axis is the Figure 2 shown Z-axis, and the target connection line is the Figure 2 shown dotted line, which is the connection line between the ultra-wideband antenna in the ultra-wideband tag and the coordinate origin.
[0033] Please refer to Figure 2 , at least two ultra-wideband antennas in the terminal device are as shown by the boxes on the terminal device in Figure 2 the ultra-wideband antenna in the ultra-wideband tag is asFigure 2 As shown by the box on the display device, ultra-wideband signals can be transmitted and received between the antennas of the two devices, and the relative position between the antennas of the two devices determines the value of the included angle between the two devices.
[0034] As Figure 2 shown, for the convenience of the user to adjust the value of the included angle between the terminal device and the ultra-wideband tag with reference to the position of the ultra-wideband tag, the ultra-wideband tag is preferably placed on the display device, such as fixed on the display device. Among them, the ultra-wideband tag can be powered by a battery or directly plugged into the display device through a USB interface for power supply.
[0035] In other embodiments of the present disclosure, the user can also choose not to place the ultra-wideband tag on the display device as needed. As long as the included angle between the terminal device and the ultra-wideband tag is adjusted to have a specific value, the screen mirroring operation can also be triggered.
[0036] After determining the included angle between the terminal device and the ultra-wideband tag, the following step S120 can be executed.
[0037] Step S120: When the included angle between the terminal device and the ultra-wideband tag is within a set first angle range, perform screen mirroring processing to project the information in the terminal device onto the display device corresponding to the ultra-wideband tag.
[0038] Preferably, to ensure the accurate execution of the screen mirroring operation, the first angle range can be set to a relatively small angle range. For example, the first angle range can be set to not greater than 5° (i.e., Figure 2 θ in satisfies 0°≤θ≤5°), so that when the ultra-wideband tag is basically facing the display screen of the terminal device, the included angle between the terminal device and the ultra-wideband tag will fall within the first angle range, and the screen mirroring processing can be executed.
[0039] Specifically, based on the preset correspondence between the ultra-wideband tag and the display device, by performing screen mirroring processing, the information in the terminal device can be projected onto the display device corresponding to the ultra-wideband tag. After the screen mirroring is successful, the user can display information or watch movies on the display device.
[0040] The embodiments of the present disclosure provide a screen mirroring method, which determines the included angle between the terminal device and the ultra-wideband tag according to the ultra-wideband signal between the terminal device and the ultra-wideband tag; when the included angle is within a set first angle range, perform screen mirroring processing to project the information in the terminal device onto the display device corresponding to the ultra-wideband tag. In this way, the user can project the information on the terminal device onto the display device by adjusting the orientation of the terminal device relative to the ultra-wideband tag, thus solving the problem of screen mirroring information.
[0041] In addition, taking a smartphone of a user as the terminal device and a TV set as the display device as an example, by adjusting the orientation of the mobile phone relative to the ultra-wideband tag so that a specific angle is formed between the mobile phone and the ultra-wideband tag, information screen mirroring can be achieved, and the information stored in the mobile phone can be screen-mirrored to the TV set corresponding to the ultra-wideband tag. Subsequently, the user can view the information stored in the mobile phone on the TV set, reducing the limitations in the visual experience and enhancing the visual experience.
[0042] Taking a mobile phone of a user as the terminal device and a projector as the display device as an example, based on the screen mirroring solution provided in this embodiment, the information in the mobile phone can also be screen-mirrored to the projector for display, thus eliminating the need for the user to carry a computer and providing convenience for the user.
[0043] Regarding the implementation method of Near Field Communication (NFC) screen mirroring, the user needs to touch or nearly touch the display device with the terminal device so that information interaction occurs between the NFC chip in the terminal device and the NFC chip in the display device, and then the information in the terminal device can be screen-mirrored to the display device. Since the user usually needs to be close to the display device to achieve the purpose of screen mirroring, it is not applicable to the situation where the display device is far away or inconvenient to touch, so the user experience is poor. Different from the NFC screen mirroring implementation method, based on the screen mirroring method provided in this embodiment, the user can achieve the purpose of screen mirroring by adjusting the orientation of the terminal device without having to be close to the display device, resulting in a better user experience.
[0044] Regarding the implementation method of screen mirroring through a screen mirroring software, the user needs to install the screen mirroring software in the terminal device and operate the screen mirroring software to perform screen mirroring. For example, it is necessary to trigger the display device to display a screen mirroring QR code through the screen mirroring software, and then the user operates the screen mirroring software to scan the code to confirm the screen mirroring. However, the operation is cumbersome and time-consuming, and the user experience is poor. Different from the implementation method of screen mirroring through a screen mirroring software, based on the screen mirroring method provided in this embodiment, the user can achieve the purpose of screen mirroring by adjusting the orientation of the terminal device without having to install the screen mirroring software in the terminal device and perform operations such as scanning the code, which can meet the user's need for simple and fast screen mirroring, so the user experience is better.
[0045] Regarding the implementation method of screen mirroring through the built-in screen mirroring function of a video software, the user can, when watching a video, use the built-in screen mirroring function of the video software to find a display device connected to the same local area network to initiate screen mirroring. However, since the information to be screen-mirrored is not always the video content of the video software, it is not applicable to the screen mirroring of file information in the mobile phone. Different from the implementation method of screen mirroring through the built-in screen mirroring function of a video software, based on the screen mirroring method provided in this embodiment, the user can achieve the purpose of screen mirroring by adjusting the orientation of the terminal device, which is applicable to any information to be screen-mirrored in the mobile phone, resulting in a better user experience.
[0046] As can be seen from the above, in this embodiment, by using the precise ultra-wideband angle measurement technology, an ultra-wideband tag and a terminal device with an ultra-wideband module are used. The ultra-wideband tag is placed on the display device, and the terminal device points to the ultra-wideband tag. The screen mirroring instruction of the terminal is triggered by judging the included angle between the terminal device and the ultra-wideband tag. This implementation method can not only eliminate the cumbersome pre-setting process in the screen mirroring method of the screen mirroring software, but also overcome the drawback that the terminal device must be in contact with the display device in the NFC screen mirroring method, and is applicable to any information to be screen mirrored in the mobile phone.
[0047] In addition, in this embodiment, based on the orientation of the terminal device relative to the ultra-wideband tag, the screen mirroring on the corresponding display device can be triggered, so there is no need to transform the hardware of the display device. The user only needs to prepare an ultra-wideband tag to realize the interaction between the terminal device and the display device, thus avoiding the defect that the display device needs to be upgraded to use the mobile phone product with an ultra-wideband terminal, bringing an excellent experience to the user without adding too much extra burden to the user.
[0048] In this embodiment, the user can project the information in the terminal device onto the display device corresponding to the ultra-wideband tag by adjusting the orientation of the terminal device relative to the ultra-wideband tag so that the included angle between the terminal device and the ultra-wideband tag falls within the first angle range. On this basis, the information can also be projected onto the corresponding display area on the display device based on this orientation to achieve the purpose of split-screen mirroring.
[0049] Based on this, in an embodiment of the present disclosure, in step S110, according to the ultra-wideband signal between the terminal device and the ultra-wideband tag, determining the included angle between the terminal device and the ultra-wideband tag may include the following steps S1101 to S1102:
[0050] Step S1101, according to the ultra-wideband signal between the terminal device and the ultra-wideband tag, determining the relative position relationship between the terminal device and the ultra-wideband tag.
[0051] For example, referring to Figure 2 the coordinate system shown, this relative position relationship may indicate whether the ultra-wideband tag is located on the positive or negative axis side of the X-axis of the terminal device, and whether it is located on the positive or negative axis side of the Y-axis of the terminal device.
[0052] In an embodiment of the present disclosure, before determining the relative position relationship, the user may also be prompted whether to use the split-screen function. If the user confirms to use the split-screen function, the step of determining the relative position relationship is executed. In addition, based on the user's preset information, the split-screen function may be used by default without prompting the user.
[0053] Step S1102: Determine the included angle between the terminal device and the ultra-wideband tag according to the relative position relationship.
[0054] In this step, after determining the relative position relationship between the terminal device and the ultra-wideband tag, the included angle between the two can be determined accordingly.
[0055] Based on the above, step S120, when the included angle between the terminal device and the ultra-wideband tag is within a set first angle range, perform screen mirroring processing to mirror the information in the terminal device to the display device corresponding to the ultra-wideband tag, which may include the following steps S1201 to S1203:
[0056] Step S1201: When the included angle between the terminal device and the ultra-wideband tag is within a set first angle range, determine the target space range corresponding to the relative position relationship from at least two set space ranges, where different space ranges correspond to different display areas on the display device.
[0057] In this embodiment, different space ranges correspond to different display areas.
[0058] For example, to achieve the purpose of split-screen mirroring, two space ranges can be set.
[0059] For example, these two space ranges can respectively correspond to the positive axis side and the negative axis side of the X-axis, and thus respectively correspond to the left side and the right side of the display screen of the display device (as Figure 3 shown). Or, these two space ranges can respectively correspond to the positive axis side and the negative axis side of the Y-axis, and thus respectively correspond to the upper side and the lower side of the display screen of the display device.
[0060] In the split-screen mirroring solution, by using the space perception function supported by ultra-wideband technology and combining with the ultra-wideband tag, it is possible to project different contents in the same mobile phone to different areas on the left and right sides of the screen, or project the contents in different mobile phones to different areas on the left and right sides of the screen.
[0061] In this embodiment, to support the implementation of split-screen mirroring, at least three ultra-wideband antennas need to be set in the terminal device. For example, the terminal device includes at least 2 ultra-wideband antennas in the horizontal direction and 1 ultra-wideband antenna in the vertical direction. As mentioned above, these 2 ultra-wideband antennas are used for angle measurement in the two-dimensional plane, and these three ultra-wideband antennas are used together to determine the spatial position in the two-dimensional plane. These three ultra-wideband antennas are not on the same straight line.
[0062] Again, for example, to achieve the purpose of four-screen mirroring, four space ranges can be set.
[0063] For example, these four spatial ranges can respectively correspond to the four quadrants formed by the X-axis and the Y-axis, and thus respectively correspond to the upper left side, the lower left side, the upper right side, and the lower right side of the display screen of the display device (as Figure 4 shown).
[0064] In the four-screen screen mirroring solution, by utilizing the spatial perception function supported by the ultra-wideband technology and combining with ultra-wideband tags, it is possible to project different contents in the same mobile phone onto four different areas of the screen, or project the contents in different mobile phones onto four different areas of the screen.
[0065] In this embodiment, to support the implementation of four-screen screen mirroring, at least three ultra-wideband antennas need to be set in the terminal device. For example, the terminal device includes at least 2 ultra-wideband antennas in the horizontal direction and 1 ultra-wideband antenna in the vertical direction. As described above, these 2 ultra-wideband antennas are used for angle measurement in the two-dimensional plane, and these three ultra-wideband antennas are used together to determine the spatial position in the two-dimensional plane. These three ultra-wideband antennas are not on the same straight line and not in the same plane.
[0066] Step S1202, determine the target display area of the display device corresponding to the target spatial range.
[0067] According to the correspondence relationship between the set spatial range and the display area, after determining the target spatial range in step S1201, in this step, the target display area corresponding to the target spatial range can be determined, so that in the case where the target display area is not screen mirrored, the information in the terminal device can be screen mirrored to the target display area of the display device.
[0068] Step S1203, perform screen mirroring processing to screen mirror the information in the terminal device to the target display area in the case where the target display area is not screen mirrored.
[0069] In this embodiment, in the case where the target display area is not screen mirrored, the information in the terminal device can be screen mirrored to the target display area. Specifically, the terminal device can send the information to the display device to request screen mirroring to the target display area. When the display device determines that the target display area is not screen mirrored, it can display the received information in the target display area. Or the terminal device can trigger the display device to know whether the target display area has been screen mirrored. If it has been screen mirrored, the information can be sent to the display device so that the display device can display the received information in the target display area.
[0070] It can be seen that in this embodiment, in the case where the included angle between the terminal device and the ultra-wideband tag falls within the first angle range, the information in the terminal device can be screen mirrored to the corresponding split-screen area of the display device by combining the relative position relationship between the terminal device and the ultra-wideband tag, thereby achieving the purpose of split-screen screen mirroring.
[0071] Since there may be other ultra-wideband tags around the above-mentioned ultra-wideband tag, in order to facilitate interference caused by other ultra-wideband tags to the screen mirroring operation of this embodiment, the above first angle range is usually small. Therefore, there may be a situation where after the user adjusts the orientation of the terminal device, the target display area determined by this orientation is not the display area that the user expects to be screen mirrored.
[0072] For example, since the right side of the display device screen has been screen mirrored, the user expects to screen mirror on the left side of the display device screen. However, due to the small first angle range, after the user controls the orientation of the terminal device, this orientation determines that the target display area is the right side of the screen, resulting in the failure to screen mirror as scheduled this time, and the user needs to adjust to a new orientation.
[0073] Therefore, in an embodiment of the present disclosure, after performing the screen mirroring process, the method further includes: receiving notification information sent by the display device indicating that the target display area has been screen mirrored; and in response to the notification information, outputting set corresponding prompt information.
[0074] In this embodiment, if the target display area has been screen mirrored, the display device can send corresponding notification information to the terminal device, so that the terminal device can output corresponding prompt information through prompt methods such as characters and voices to prompt the user to adjust the orientation of the terminal device.
[0075] As described above, since the above first angle range is usually small, there may be a situation where after the user adjusts the orientation of the terminal device, the target display area determined by this orientation is not the display area that the user expects to be screen mirrored. Based on this, to improve the screen mirroring efficiency and enhance the user experience, the target display area determined by this orientation can be indicated on the display screen of the terminal device. In this way, when the user adjusts the orientation, the user can intuitively view in real time whether the target display area determined by this orientation is the desired display area, and if not, the user can quickly adjust the orientation.
[0076] Based on this, in an embodiment of the present disclosure, after determining the included angle between the terminal device and the ultra-wideband tag, the method further includes: when the included angle between the terminal device and the ultra-wideband tag is within the first angle range, displaying a split-screen schematic diagram according to preset configuration information corresponding to at least two display areas of the display device.
[0077] In this embodiment, the operation of displaying the split-screen schematic diagram and the operation of performing the screen mirroring process can be started and executed simultaneously respectively, and there is no set order of precedence for the start execution times of the two operations, and this embodiment does not limit this.
[0078] In this embodiment, as long as the user adjusts the orientation of the terminal device so that the included angle between the terminal device and the ultra-wideband tag falls within the first angle range, it is considered that the user needs screen mirroring. At the same time, a split-screen schematic diagram can be displayed on the display screen of the terminal device (the display screen faces the user). Among them, the split-screen schematic diagram can schematically display each display area on the display device according to the display area configuration information, that is, schematically display each split-screen area.
[0079] Based on this operation, the user can be prompted that the current screen mirroring mode is split-screen mirroring, and the type of split-screen mirroring (such as two-way split screen or four-way split screen) can be indicated, so as to provide a good user experience.
[0080] Correspondingly, after determining the target display area of the display device corresponding to the target space range in step S1202, the method further includes: highlighting the part of the split-screen schematic diagram corresponding to the target display area.
[0081] In this embodiment, after the user adjusts the orientation of the terminal device, the orientation can not only determine whether the included angle between the terminal device and the ultra-wideband tag falls within the first angle range, but also determine the relative position relationship between the terminal device and the ultra-wideband tag. Based on this relative position relationship, the target display area can be determined, and then the target display area can be highlighted in the split-screen schematic diagram.
[0082] For example, please refer to Figure 3 , when the user adjusts the orientation of the terminal device, the orientation determines that the included angle θ between the terminal device and the ultra-wideband tag falls within the first angle range. Therefore, a split-screen schematic diagram corresponding to two display areas can be displayed on the terminal device. The split-screen schematic diagram corresponds to the two split-screen areas of the display device. The two split-screen areas are Figure 3 separated by the dotted line shown, and are respectively the left split-screen area on the left and the right split-screen area on the right.
[0083] Please refer to Figure 3 , the orientation of the terminal device also determines the relative position relationship between the terminal device and the ultra-wideband tag. The ultra-wideband tag is located on the right side of the Z axis (that is, corresponding to the positive half-axis of the X axis). Assuming that this relative position relationship determines that the target display area is the right split-screen area of the display device, the right split-screen area in the split-screen schematic diagram can be highlighted.
[0084] In this way, after the user adjusts the orientation of the terminal device, the user can quickly and intuitively see whether the right split-screen area to be screen mirrored has been screen mirrored. If it has been screen mirrored, the user can adjust the orientation so that the new orientation corresponds to the un-screen mirrored left split-screen area, so as to realize screen mirroring the information in the terminal device to the left split-screen area.
[0085] It can be seen that in this embodiment, by displaying the split-screen schematic diagrams corresponding to each split-screen area on the terminal device and highlighting the split-screen areas determined by the orientation of the terminal device, it is convenient for the user to intuitively check whether the split-screen area is occupied, so as to adjust the orientation of the mobile phone, and further achieve the purpose of split-screen screen mirroring.
[0086] Based on the above content, in an embodiment of the present disclosure, in order to illustrate a possible implementation manner of determining the relative position relationship, the step S1101 of determining the relative position relationship between the terminal device and the ultra-wideband tag according to the ultra-wideband signal between the terminal device and the ultra-wideband tag may include steps S11011 to S11012:
[0087] Step S11011: Construct a three-dimensional rectangular coordinate system, where the origin of the three-dimensional rectangular coordinate system is on the terminal device, and the first coordinate axis of the three-dimensional rectangular coordinate system is perpendicular to the display screen of the terminal device.
[0088] As Figure 3 or Figure 4 shown, the three coordinate axes of the constructed three-dimensional rectangular coordinate system can be respectively Figure 3 the X-axis, Y-axis, and Z-axis shown. Among them, the Z-axis is the above-mentioned first coordinate axis.
[0089] Step S11012: Determine the relative position relationship between the origin and the ultra-wideband tag according to the ultra-wideband signals between at least three ultra-wideband antennas in the terminal device and the ultra-wideband tag, and use it as the relative position relationship between the terminal device and the ultra-wideband tag.
[0090] In this embodiment, in order to determine the relative position relationship, at least three ultra-wideband antennas need to be set in the terminal device. Based on the ultra-wideband signals transmitted and received between the ultra-wideband antennas in the terminal device and the ultra-wideband antennas in the ultra-wideband tag, and combined with the existing positioning technology, the above relative position relationship can be determined.
[0091] Please refer to Figure 3 , the first coordinate axis is the Z-axis as Figure 3 shown, Figure 3 the dotted line shown is the connection line between the ultra-wideband antenna in the ultra-wideband tag and the coordinate origin.
[0092] Please refer to Figure 3 , at least three ultra-wideband antennas in the terminal device are as Figure 3 the squares on the terminal device shown in Figure 3 , the ultra-wideband antennas in the ultra-wideband tag are as the squares on the display device shown in Figure 3 , ultra-wideband signals can be transmitted and received between the antennas of the two devices, and the relative position between the antennas of the two devices determines the relative position relationship between the two devices.
[0093] Based on this, the present embodiment can achieve the purpose of split-screen screen mirroring. The specific split-screen type can be the above-mentioned two-way split-screen or four-way split-screen, and can also be split-screens of other quantities, such as three-way split-screen, etc. Below, the present embodiment will be further described for two-way split-screen screen mirroring and four-way split-screen screen mirroring respectively.
[0094] Specifically, for the case of two-way split-screen screen mirroring:
[0095] In an embodiment of the present disclosure, to illustrate a possible implementation manner of two-way split-screen screen mirroring, the at least two spatial ranges include a first spatial range and a second spatial range.
[0096] Specifically, the first spatial range and the second spatial range can be spatial ranges corresponding to the positive half-axis and the negative half-axis of the X-axis respectively. Assuming that the first spatial range corresponds to the positive half-axis of the X-axis, the projection value of any point in the first spatial range on the X-axis is a positive value. Correspondingly, the projection value of any point in the second spatial range on the X-axis is a negative value. Correspondingly, these two spatial ranges can respectively correspond to the left display area and the right display area of the display screen of the display device (such as Figure 3 the two display areas separated by a dotted line in the figure).
[0097] Similarly, the first spatial range and the second spatial range can also be spatial ranges corresponding to the positive half-axis and the negative half-axis of the Y-axis respectively. Correspondingly, these two spatial ranges can respectively correspond to the upper display area and the lower display area of the display screen of the display device.
[0098] Correspondingly, determining the target spatial range corresponding to the relative position relationship from the set at least two spatial ranges includes: when the relative position relationship indicates that the projection value of the ultra-wideband tag on the target coordinate axis is a positive value, determining the target spatial range as the first spatial range; wherein, the target coordinate axis is any other coordinate axis different from the first coordinate axis of the three-dimensional rectangular coordinate system; when the relative position relationship indicates that the projection value is a negative value, determining the target spatial range as the second spatial range.
[0099] As Figure 3 shown, the target coordinate axis can be the X-axis or the Y-axis.
[0100] In the present embodiment, according to the determined relative position relationship, the sign (positive or negative) of the projection value of the ultra-wideband antenna in the ultra-wideband tag on the target coordinate axis can be obtained, and then it can be determined which spatial range the target spatial range is. Furthermore, according to the preset corresponding relationship between each spatial range and each display area, the target display area to be screen-mirrored can be obtained, so that when the target display area has not been screen-mirrored, the information can be screen-mirrored to the target display area, achieving the purpose of two-way split-screen screen mirroring.
[0101] In addition, for the case of split-screen projection with two screens, preferably, the ultra-wideband tag can be placed at a position between the two split screens. For example, it can be fixed at any position on the virtual line as shown in Figure 3 the figure.
[0102] Specifically, for the case of split-screen projection with four screens:
[0103] In an embodiment of the present disclosure, to illustrate a possible implementation of split-screen projection with four screens, the at least two spatial ranges include a first spatial range, a second spatial range, a third spatial range, and a fourth spatial range.
[0104] Specifically, these four spatial ranges can respectively correspond to the four quadrants divided by the X-axis and the Y-axis. Assuming that the first spatial range corresponds to the first quadrant divided by the X-axis and the Y-axis, then the projection value of any point in the first spatial range on the X-axis is positive, and the projection value on the Y-axis is positive. Assuming that the second spatial range corresponds to the second quadrant divided by the X-axis and the Y-axis, then the projection value of any point in the first spatial range on the X-axis is negative, and the projection value on the Y-axis is positive.
[0105] Correspondingly, these four spatial ranges can respectively correspond to the four display areas of the display screen of the display device (such as Figure 4 the four display areas separated by two virtual lines in the figure).
[0106] Correspondingly, determining the target spatial range corresponding to the relative position relationship from the set at least two spatial ranges includes: when the relative position relationship indicates that the first projection value of the ultra-wideband tag on the second coordinate axis is positive and the second projection value on the third coordinate axis is positive, determining the target spatial range as the first spatial range; where the second coordinate axis and the third coordinate axis are the other two coordinate axes of the three-dimensional rectangular coordinate system different from the first coordinate axis; when the relative position relationship indicates that the first projection value is negative and the second projection value is positive, determining the target spatial range as the second spatial range; when the relative position relationship indicates that the first projection value is negative and the second projection value is negative, determining the target spatial range as the third spatial range; when the relative position relationship indicates that the first projection value is positive and the second projection value is negative, determining the target spatial range as the fourth spatial range.
[0107] As shown in Figure 4 the figure, the second coordinate axis can be the X-axis, and the third coordinate axis can be the Y-axis.
[0108] In this embodiment, according to the determined relative position relationship, the signs (positive or negative) of the projection values of the UWB antenna in the UWB tag on the X-axis and the Y-axis can be obtained, and then the target space range can be determined accordingly. Furthermore, according to the preset corresponding relationship between each space range and each display area, the target display area to be screen-cast can be obtained, so that when the target display area has not been screen-cast, the information can be screen-cast to the target display area to achieve the purpose of four-screen screen-casting.
[0109] In addition, for the case of four-screen screen-casting, preferably, the UWB tag can be placed at the position between the four split screens. For example, it can be fixed at the intersection position of the two dotted lines as Figure 3 shown.
[0110] In this embodiment, based on the communication connection between the terminal device and the display device, the terminal device can send the information to be screen-cast to the display device, and the display device displays the received information, so as to achieve the purpose of screen-casting. In this way, before performing the screen-casting operation, the configuration information of the display device can be obtained, and the above communication connection can be established accordingly to provide support for the sending and receiving of information.
[0111] Based on this, in an embodiment of the present disclosure, when the included angle between the terminal device and the UWB tag is within a set first angle range, performing screen-casting processing may include the following steps A1 to A3:
[0112] Step A1, when the included angle between the terminal device and the UWB tag is within a set second angle range, obtain the configuration information of the display device.
[0113] In this embodiment, after determining the included angle between the terminal device and the UWB tag in step S110, step A1 can be executed to detect whether the included angle falls within the second angle range.
[0114] For example, the second angle range is 0 ≤ θ ≤ 20°.
[0115] In addition, the second angle range is preferably not too large to avoid having too many UWB tags corresponding within this second angle range, so as to exclude unnecessary interference brought by other UWB tags.
[0116] Specifically, based on the UWB signal between the UWB antenna in the terminal device and the UWB antenna in the UWB tag, the terminal device can obtain the configuration information of the corresponding display device. Among them, when the terminal device first connects to the UWB tag, the configuration information of the corresponding display device stored in the UWB tag can be read, and if it has accessed the UWB tag before, the configuration information can be directly called from the internal storage.
[0117] Based on this, in an embodiment of the present disclosure, before performing screen mirroring processing, the terminal device and the ultra-wideband tag can be paired to configure the above configuration information in the ultra-wideband tag. In this way, after the user replaces the terminal device, or when other users use their terminal devices to request screen mirroring, based on the configuration information configured in the ultra-wideband tag, screen mirroring can be quickly performed.
[0118] Step A2, establish a communication connection between the terminal device and the display device according to the configuration information.
[0119] In this step, the terminal device can establish a communication connection with the corresponding display device based on the obtained configuration information, so that the terminal device enters a state of preparing for screen mirroring. In this state, as long as the included angle between the terminal device and the ultra-wideband tag falls within the first angle range, screen mirroring processing can be quickly performed.
[0120] In an embodiment of the present disclosure, the obtained configuration information may include device information of the display device, the LAN IP address accessed by the display device, screen mirroring instruction information, etc.
[0121] Based on this, in an embodiment of the present disclosure, based on the WiFi connection information in the configuration information, the terminal device can detect whether it has accessed the corresponding network. If it has accessed, it means that the terminal device and the display device are connected to the same WiFi local area network, and information interaction between the terminal device and the display device can be realized. Therefore, a screen mirroring instruction can be triggered to establish a communication connection between the two.
[0122] If it has not accessed, the corresponding network can be further detected according to the WiFi connection information (such as the IP address) to see if it is an open network. If it is an open network, it can be directly connected to the corresponding network, and then a screen mirroring instruction is triggered to establish a communication connection between the two. If it is an encrypted network, the user can be prompted to manually access the corresponding network, and a screen mirroring instruction is triggered to establish a communication connection between the two after accessing the network.
[0123] Step A3, when the included angle between the terminal device and the ultra-wideband tag is within a set first angle range, perform screen mirroring processing based on the communication connection, where the first angle range is a part of the second angle range.
[0124] In this embodiment, the first angle range is a part of the second angle range. For example, the second angle range is 0≤θ≤20°, and the first angle range is 0≤θ≤5°.
[0125] In this step, the terminal device performs screen mirroring processing based on the established communication connection. Specifically, it can send the information to be screen mirrored in the terminal device to the display device through this communication connection, so that the display device can display the received information.
[0126] In an embodiment of the present disclosure, when a user needs to perform screen mirroring, the user can operate the terminal device to send a screen mirroring command through the terminal device. In response to the screen mirroring command, the terminal device can execute the above step S110.
[0127] In this way, in one case, if the user sends the screen mirroring command after basically aligning the terminal device with the ultra-wideband tag, the included angle between the terminal device and the ultra-wideband tag obtained can be within both the first angle range and the second angle range. In another case, if the user sends the screen mirroring command first and then adjusts the orientation of the terminal device, during the process of adjusting the orientation of the terminal device, the included angle between the terminal device and the ultra-wideband tag obtained can first fall within the second angle range and then fall within the first angle range.
[0128] In this embodiment, when the included angle between the terminal device and the ultra-wideband tag falls within the second angle range, the terminal device can obtain the configuration information of the display device, and based on this, the communication connection between the terminal device and the display device can be established to provide basic support for subsequent screen mirroring operations. When the included angle between the terminal device and the ultra-wideband tag falls within the first angle range, screen mirroring processing is performed based on the established communication connection. In this way, this embodiment supports the terminal device to establish a communication connection in advance before performing screen mirroring processing, which can improve the screen mirroring response efficiency and thus improve the screen mirroring efficiency.
[0129] It should be noted that for the screen mirroring method provided in the embodiments of the present application, the execution subject can be a screen mirroring device or a control module in the screen mirroring device for executing the screen mirroring method. In the embodiments of the present application, taking the screen mirroring device executing the screen mirroring method as an example, the screen mirroring device provided in the embodiments of the present application is described.
[0130] As Figure 5 shown, a screen mirroring device 200 provided in this embodiment may include: a first processing module 210 and a second processing module 220. Among them, the first processing module 210 is used to determine the included angle between the terminal device and the ultra-wideband tag according to the ultra-wideband signal between the terminal device and the ultra-wideband tag. The second processing module 220 is used to perform screen mirroring processing to mirror the information in the terminal device to the display device corresponding to the ultra-wideband tag when the included angle between the terminal device and the ultra-wideband tag is within a set first angle range.
[0131] In this embodiment, the included angle between the terminal device and the ultra-wideband tag can be determined based on the ultra-wideband signal between the terminal device and the ultra-wideband tag; when the included angle is within a set first angle range, screen mirroring processing is performed to screen mirror the information in the terminal device to the display device corresponding to the ultra-wideband tag. In this way, by adjusting the orientation of the terminal device relative to the ultra-wideband tag, the user can screen mirror the information on the terminal device to the display device, thus solving the problem of screen mirroring information.
[0132] Preferably, the terminal device includes a screen mirroring device 200.
[0133] In an embodiment of the present disclosure, the first processing module 210 includes a first processing unit and a second processing unit;
[0134] Among them, the first processing unit is configured to determine the relative position relationship between the terminal device and the ultra-wideband tag according to the ultra-wideband signal between the terminal device and the ultra-wideband tag;
[0135] The second processing unit is configured to determine the included angle between the terminal device and the ultra-wideband tag according to the relative position relationship;
[0136] The second processing module 220 includes a third processing unit, a fourth processing unit, and a fifth processing unit;
[0137] Among them, the third processing unit is configured to determine a target space range corresponding to the relative position relationship from at least two set space ranges when the included angle between the terminal device and the ultra-wideband tag is within a set first angle range, where different space ranges correspond to different display areas on the display device;
[0138] The fourth processing unit is configured to determine the target display area of the display device corresponding to the target space range;
[0139] The fifth processing unit is configured to perform screen mirroring processing to screen mirror the information in the terminal device to the target display area when the target display area has not been screen mirrored.
[0140] In an embodiment of the present disclosure, the second processing module 220 further includes a sixth processing unit and a seventh processing unit;
[0141] The sixth processing unit is configured to receive notification information sent by the display device indicating that the target display area has been screen mirrored;
[0142] The seventh processing unit is configured to output set corresponding prompt information in response to the notification information.
[0143] In an embodiment of the present disclosure, the screen mirroring device further includes a third processing module and a fourth processing module;
[0144] The third processing module is configured to display a split - screen schematic diagram according to preset configuration information corresponding to at least two display areas of the display device when the included - angle between the terminal device and the ultra - wideband tag is within the first angle range;
[0145] The fourth processing module is configured to highlight the part corresponding to the target display area in the split - screen schematic diagram.
[0146] In an embodiment of the present disclosure, the first processing unit includes a first processing subunit and a second processing subunit;
[0147] The first processing subunit is configured to construct a three - dimensional rectangular coordinate system, where the origin of the three - dimensional rectangular coordinate system is on the terminal device, and the first coordinate axis of the three - dimensional rectangular coordinate system is perpendicular to the display screen of the terminal device;
[0148] The second processing subunit is configured to determine the relative position relationship between the origin and the ultra - wideband tag based on the ultra - wideband signals between at least three ultra - wideband antennas in the terminal device and the ultra - wideband tag, so as to obtain the relative position relationship between the terminal device and the ultra - wideband tag.
[0149] In an embodiment of the present disclosure, the at least two spatial ranges include a first spatial range and a second spatial range;
[0150] The third processing unit is configured to determine that the target spatial range is the first spatial range when the relative position relationship indicates that the projection value of the ultra - wideband tag on the target coordinate axis is positive; and determine that the target spatial range is the second spatial range when the relative position relationship indicates that the projection value is negative; where the target coordinate axis is any other coordinate axis of the three - dimensional rectangular coordinate system different from the first coordinate axis.
[0151] In an embodiment of the present disclosure, the at least two spatial ranges include a first spatial range, a second spatial range, a third spatial range, and a fourth spatial range;
[0152] The third processing unit is configured to determine that the target space range is the first space range when the relative position relationship indicates that the first projection value of the ultra-wideband tag on the second coordinate axis is positive and the second projection value on the third coordinate axis is positive; determine that the target space range is the second space range when the relative position relationship indicates that the first projection value is negative and the second projection value is positive; determine that the target space range is the third space range when the relative position relationship indicates that the first projection value is negative and the second projection value is negative; determine that the target space range is the fourth space range when the relative position relationship indicates that the first projection value is positive and the second projection value is negative; wherein, the second coordinate axis and the third coordinate axis are respectively the other two coordinate axes of the three-dimensional rectangular coordinate system different from the first coordinate axis.
[0153] In an embodiment of the present disclosure, the second processing module 220 includes: an eighth processing unit, a ninth processing unit, and a tenth processing unit;
[0154] The eighth processing unit is configured to obtain the configuration information of the display device when the included angle between the terminal device and the ultra-wideband tag is within a set second angle range;
[0155] The ninth processing unit is configured to establish a communication connection between the terminal device and the display device according to the configuration information;
[0156] The tenth processing unit is configured to perform screen mirroring processing based on the communication connection when the included angle between the terminal device and the ultra-wideband tag is within a set first angle range, where the first angle range is a part of the second angle range.
[0157] The screen mirroring device in the embodiments of the present application may be a device, or a component, an integrated circuit, or a chip in a terminal. The device may be a mobile electronic device or a non-mobile electronic device. Exemplarily, the mobile electronic device may be a mobile phone, a tablet computer, a laptop computer, a handheld computer, a vehicle-mounted electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA), etc., and the non-mobile electronic device may be a server, a Network Attached Storage (NAS), a personal computer (PC), a television (TV), a teller machine, or a self-service machine, etc. The embodiments of the present application do not make specific limitations.
[0158] The screen mirroring device in the embodiments of the present application can be a device with an operating system. The operating system can be the Android operating system, the iOS operating system, or other possible operating systems, which are not specifically limited in the embodiments of the present application.
[0159] The screen mirroring device provided in the embodiments of the present application can implement Figure 1 each process implemented by the method embodiments. To avoid repetition, it will not be elaborated here.
[0160] Optionally, as Figure 6 shown, the embodiments of the present application further provide an electronic device 300, including a processor 310, a memory 320, a program or instruction stored on the memory 320 and executable on the processor 310. When the program or instruction is executed by the processor 310, it implements each process of the above screen mirroring method embodiment and can achieve the same technical effect. To avoid repetition, it will not be elaborated here.
[0161] It should be noted that the electronic devices in the embodiments of the present application include the above-mentioned mobile electronic devices and non-mobile electronic devices.
[0162] Figure 7 FIG. is a schematic diagram of the hardware structure of an electronic device 1000 according to an embodiment of the present application.
[0163] The electronic device 1000 includes, but is not limited to: a radio frequency unit 1001, a network module 1002, an audio output unit 1003, an input unit 1004, a sensor 1005, a display unit 1006, a user input unit 1007, an interface unit 1008, a memory 1009, and a processor 1010, etc.
[0164] Those skilled in the art can understand that the electronic device 1000 may further include a power source (such as a battery) for supplying power to each component. The power source can be logically connected to the processor 1010 through a power management system, so as to implement functions such as management of charging, discharging, and power consumption management through the power management system. Figure 7 The structure of the electronic device shown in does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown, or combine certain components, or have different component arrangements, which will not be elaborated here.
[0165] Among them, the processor 1010 is configured to determine the included angle between the terminal device and the ultra-wideband tag according to the ultra-wideband signal between the terminal device and the ultra-wideband tag; and perform screen mirroring processing to mirror the information in the terminal device to the display device corresponding to the ultra-wideband tag when the included angle between the terminal device and the ultra-wideband tag is within a set first angle range.
[0166] In this embodiment, the included angle between the terminal device and the ultra-wideband tag can be determined according to the ultra-wideband signal between the terminal device and the ultra-wideband tag; when the included angle is within a set first angle range, screen mirroring processing is performed to screen mirror the information in the terminal device to the display device corresponding to the ultra-wideband tag. In this way, by adjusting the orientation of the terminal device relative to the ultra-wideband tag, the user can screen mirror the information on the terminal device to the display device, thus solving the problem of screen mirroring information.
[0167] Optionally, the processor 1010 is configured to determine the relative position relationship between the terminal device and the ultra-wideband tag according to the ultra-wideband signal between the terminal device and the ultra-wideband tag; determine the included angle between the terminal device and the ultra-wideband tag according to the relative position relationship; when the included angle between the terminal device and the ultra-wideband tag is within a set first angle range, determine a target space range corresponding to the relative position relationship from at least two set space ranges, where different space ranges correspond to different display areas on the display device; determine the target display area of the display device corresponding to the target space range; and perform screen mirroring processing to screen mirror the information in the terminal device to the target display area when the target display area has not been screen mirrored.
[0168] Optionally, after performing the screen mirroring processing, the processor 1010 is configured to receive notification information sent by the display device indicating that the target display area has been screen mirrored; and output corresponding set prompt information in response to the notification information.
[0169] Optionally, after determining the included angle between the terminal device and the ultra-wideband tag, when the included angle between the terminal device and the ultra-wideband tag is within the first angle range, the processor 1010 is configured to display a split-screen schematic diagram according to preset configuration information corresponding to at least two display areas of the display device; and after determining the target display area of the display device corresponding to the target space range, highlight the part corresponding to the target display area in the split-screen schematic diagram.
[0170] Optionally, the processor 1010 is configured to construct a three-dimensional rectangular coordinate system, where the origin of the three-dimensional rectangular coordinate system is on the terminal device, and the first coordinate axis of the three-dimensional rectangular coordinate system is perpendicular to the display screen of the terminal device; and determine the relative position relationship between the origin and the ultra-wideband tag according to the ultra-wideband signals between at least three ultra-wideband antennas in the terminal device and the ultra-wideband tag, so as to use it as the relative position relationship between the terminal device and the ultra-wideband tag.
[0171] Optionally, the at least two spatial ranges include a first spatial range and a second spatial range; the processor 1010 is configured to determine that the target spatial range is the first spatial range when the relative position relationship indicates that the projection value of the ultra-wideband tag on the target coordinate axis is positive; wherein the target coordinate axis is any other coordinate axis of the three-dimensional rectangular coordinate system different from the first coordinate axis; and to determine that the target spatial range is the second spatial range when the relative position relationship indicates that the projection value is negative.
[0172] Optionally, the at least two spatial ranges include a first spatial range, a second spatial range, a third spatial range, and a fourth spatial range; the processor 1010 is configured to determine that the target spatial range is the first spatial range when the relative position relationship indicates that the first projection value of the ultra-wideband tag on the second coordinate axis is positive and the second projection value on the third coordinate axis is positive; wherein the second coordinate axis and the third coordinate axis are the other two coordinate axes of the three-dimensional rectangular coordinate system different from the first coordinate axis; to determine that the target spatial range is the second spatial range when the relative position relationship indicates that the first projection value is negative and the second projection value is positive; to determine that the target spatial range is the third spatial range when the relative position relationship indicates that the first projection value is negative and the second projection value is negative; and to determine that the target spatial range is the fourth spatial range when the relative position relationship indicates that the first projection value is positive and the second projection value is negative.
[0173] Optionally, the processor 1010 is configured to obtain the configuration information of the display device when the included angle between the terminal device and the ultra-wideband tag is within a set second angle range; establish a communication connection between the terminal device and the display device according to the configuration information; and perform screen mirroring processing based on the communication connection when the included angle between the terminal device and the ultra-wideband tag is within a set first angle range, wherein the first angle range is a part of the second angle range.
[0174] It should be understood that in the embodiments of the present application, the input unit 1004 may include a Graphics Processing Unit (GPU) 10041 and a microphone 10042. The GPU 10041 processes the image data of static pictures or videos obtained by an image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 1006 may include a display panel 10061, and the display panel 10061 may be configured in the form of a liquid crystal display, an organic light-emitting diode, etc. The user input unit 1007 includes a touch panel 10071 and other input devices 10072. The touch panel 10071 is also called a touch screen. The touch panel 10071 may include two parts: a touch detection device and a touch controller. The other input devices 10072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, power on / off keys, etc.), a trackball, a mouse, and a joystick, which will not be elaborated here. The memory 1009 can be used to store software programs and various data, including but not limited to application programs and operating systems. The processor 1010 may integrate an application processor and a modem processor. Among them, the application processor mainly processes the operating system, user interface, application programs, etc., and the modem processor mainly processes wireless communication. It can be understood that the above-mentioned modem processor may not be integrated into the processor 1010.
[0175] The embodiments of the present application further provide a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, it implements each process of the above-mentioned screen mirroring method embodiments and can achieve the same technical effects. To avoid repetition, it will not be elaborated here.
[0176] Among them, the processor is the processor in the electronic device described in the above embodiments. The readable storage medium includes a computer-readable storage medium, such as a computer Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disc, etc.
[0177] The embodiments of the present application further provide a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor. The processor is used to run a program or instruction to implement each process of the above-mentioned screen mirroring method embodiments and can achieve the same technical effects. To avoid repetition, it will not be elaborated here.
[0178] It should be understood that the chip mentioned in the embodiments of the present application may also be referred to as a system-on-chip, system chip, chip system, or system-on-chip, etc.
[0179] It should be noted that, in this document, the term "including", "comprising" or any other variant thereof is intended to cover non-exclusive inclusion, such that a process, method, article or device comprising a series of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, article or device. Without further limitation, an element defined by the phrase "comprising an..." does not exclude the presence of additional identical elements in the process, method, article or device comprising that element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, but may also include performing functions in a substantially simultaneous manner or in a reverse order according to the functions involved. For example, the described methods may be performed in an order different from that described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.
[0180] Through the description of the above embodiments, those skilled in the art can clearly understand that the above-described example methods can be implemented by means of software plus a necessary general hardware platform. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation. Based on such an understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art can be embodied in the form of a computer software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions for causing a terminal (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of the present application.
[0181] The embodiments of the present application have been described above in conjunction with the accompanying drawings. However, the present application is not limited to the above specific embodiments. The above specific embodiments are merely illustrative and not restrictive. Those of ordinary skill in the art, under the inspiration of the present application and without departing from the spirit of the present application and the scope protected by the claims, can still make many forms, all of which fall within the protection scope of the present application.
Claims
1. A screen mirroring method, characterized in that, The method includes: Determining an included angle between the terminal device and the ultra-wideband tag according to the ultra-wideband signal between the terminal device and the ultra-wideband tag; wherein, the included angle between the terminal device and the ultra-wideband tag is determined according to the relative position relationship between the terminal device and the ultra-wideband tag, and the relative position relationship is determined according to the ultra-wideband signals between at least three ultra-wideband antennas in the terminal device and the ultra-wideband tag respectively; wherein, the at least three ultra-wideband antennas are not on a straight line; When the included angle between the terminal device and the ultra-wideband tag is within a set first angle range, perform screen mirroring processing to mirror the information in the terminal device to the display device corresponding to the ultra-wideband tag, including, when the included angle between the terminal device and the ultra-wideband tag is within the set first angle range, determining a target space range corresponding to the relative position relationship from at least two set space ranges, where different space ranges correspond to different display areas on the display device; determining a target display area on the display device corresponding to the target space range; performing screen mirroring processing to mirror the information in the terminal device to the target display area when the target display area has not been mirrored.
2. The method according to claim 1, wherein After performing the screen mirroring processing, the method further includes: Receiving notification information sent by the display device indicating that the target display area has been mirrored; In response to the notification information, outputting set corresponding prompt information.
3. The method according to claim 1, characterized in that After determining the included angle between the terminal device and the ultra-wideband tag, the method further includes: When the included angle between the terminal device and the ultra-wideband tag is within the first angle range, displaying a split-screen schematic diagram according to preset configuration information corresponding to at least two display areas of the display device; After determining the target display area on the display device corresponding to the target space range, the method further includes: Highlighting the part corresponding to the target display area in the split-screen schematic diagram.
4. The method according to claim 1, wherein The determining the relative position relationship between the terminal device and the ultra-wideband tag according to the ultra-wideband signal between the terminal device and the ultra-wideband tag includes: Constructing a three-dimensional rectangular coordinate system, where the origin of the three-dimensional rectangular coordinate system is on the terminal device, and the first coordinate axis of the three-dimensional rectangular coordinate system is perpendicular to the display screen of the terminal device; Determining the relative position relationship between the origin and the ultra-wideband tag according to the ultra-wideband signals between at least three ultra-wideband antennas in the terminal device and the ultra-wideband tag respectively, to be used as the relative position relationship between the terminal device and the ultra-wideband tag.
5. The method according to claim 4, wherein The at least two space ranges include a first space range and a second space range; The determining the target space range corresponding to the relative position relationship from at least two set space ranges includes: When the relative position relationship indicates that the projection value of the ultra-wideband tag on the target coordinate axis is positive, determining the target space range as the first space range; Wherein, the target coordinate axis is any other coordinate axis of the three-dimensional rectangular coordinate system different from the first coordinate axis; When the relative position relationship indicates that the projection value is negative, determine that the target space range is the second space range.
6. The method according to claim 4, characterized in that, The at least two space ranges include a first space range, a second space range, a third space range, and a fourth space range, and the at least three ultra-wideband antennas are not in the same plane; Determining the target space range corresponding to the relative position relationship from the set at least two space ranges includes: When the relative position relationship indicates that the first projection value of the ultra-wideband tag on the second coordinate axis is positive and the second projection value on the third coordinate axis is positive, determine that the target space range is the first space range; Wherein, the second coordinate axis and the third coordinate axis are respectively the other two coordinate axes of the three-dimensional rectangular coordinate system different from the first coordinate axis; When the relative position relationship indicates that the first projection value is negative and the second projection value is positive, determine that the target space range is the second space range; When the relative position relationship indicates that the first projection value is negative and the second projection value is negative, determine that the target space range is the third space range; When the relative position relationship indicates that the first projection value is positive and the second projection value is negative, determine that the target space range is the fourth space range.
7. The method according to claim 1, characterized in that, Performing screen mirroring processing when the included angle between the terminal device and the ultra-wideband tag is within a set first angle range includes: Obtaining the configuration information of the display device when the included angle between the terminal device and the ultra-wideband tag is within a set second angle range; Establishing a communication connection between the terminal device and the display device according to the configuration information; Performing screen mirroring processing based on the communication connection when the included angle between the terminal device and the ultra-wideband tag is within a set first angle range, where the first angle range is a part of the second angle range.
8. A screen mirroring device, characterized in that, The screen mirroring device includes: A first processing module, configured to determine the included angle between the terminal device and the ultra-wideband tag according to the ultra-wideband signal between the terminal device and the ultra-wideband tag; and A second processing module, configured to perform screen mirroring processing to mirror the information in the terminal device to the display device corresponding to the ultra-wideband tag when the included angle between the terminal device and the ultra-wideband tag is within a set first angle range; The first processing module is specifically configured to determine the relative position relationship between the terminal device and the ultra-wideband tag according to the ultra-wideband signals between at least three ultra-wideband antennas in the terminal device and the ultra-wideband tag respectively; and determine the included angle between the terminal device and the ultra-wideband tag according to the relative position relationship; wherein the at least three ultra-wideband antennas are not on a straight line; Specifically, the second processing module is configured to determine a target spatial range corresponding to the relative position relationship from at least two set spatial ranges when the included angle between the terminal device and the ultra-wideband tag is within a set first angle range, where different spatial ranges correspond to different display areas on the display device; determine a target display area of the display device corresponding to the target spatial range; and perform screen mirroring processing to mirror the information in the terminal device to the target display area when the target display area is not being screen mirrored.
9. An electronic device, characterized in that, It includes a processor, a memory, and a program or instruction stored on the memory and executable on the processor. When the program or instruction is executed by the processor, the steps of the screen mirroring method according to any one of claims 1-7 are implemented.
10. A readable storage medium, characterized in that, A program or instruction is stored on the readable storage medium. When the program or instruction is executed by the processor, the steps of the screen mirroring method according to any one of claims 1-7 are implemented.
Citation Information
Patent Citations
Screen projection method and electronic device
CN110597473A
Screen projection method and device and electronic equipment
CN112929734A