Method, device and device for mirroring screen projection

Abstract

The present application relates to the technical field of smart home appliances, and discloses a method for mirroring screen. By receiving the first picture of a mobile terminal through a mirroring screen device, the mirrored first picture can be displayed in the mirroring screen device, and in the display area of ​​the first picture, the picture of the image area is captured as the second picture, so that the second picture is adjusted so that the adjusted second picture is displayed in full screen in the mirroring screen device. So that the user can watch the display information of the second picture in full screen on the mirroring screen device, which is convenient for the user. The present application also discloses a device for mirroring screen and a mirroring screen device.

Description

Technical Field

[0001] The present application relates to the field of smart home appliance technology, for example, to a method, device and device for mirroring screen projection. Background Art

[0002] With the widespread use of mobile terminals, especially mobile terminals represented by smartphones, they have become an important part of people's lives. People are increasingly using smartphones to mirror screens with large-screen display devices. Among them, mirror screen projection refers to connecting a mobile terminal to a display device via wired or wireless means, so that the screen displayed in the mobile terminal is projected onto the display device.

[0003] However, since the screens of current display devices (such as LCD TVs and computer monitors) are generally placed in landscape orientation, the existing mirroring methods and devices all assume that the mobile terminal is displayed in landscape orientation. At this time, when the content played by the mobile terminal is changed to full screen, it cannot be viewed normally on the display device; when a vertical image is displayed on the screen of the mobile terminal, the display device displays the vertical image in the mobile terminal in the middle of the display screen, and fills the screen areas on both sides of the vertical image with black. It can be seen that the current display devices have a relatively simple display mode when displaying images of mirroring, which results in the user being unable to view the images mirrored to the TV normally. Summary of the invention

[0004] In order to provide a basic understanding of some aspects of the disclosed embodiments, a brief summary is given below. The summary is not an extensive review, nor is it intended to identify key / critical components or delineate the scope of protection of these embodiments, but rather serves as a prelude to the detailed description that follows.

[0005] The embodiments of the present disclosure provide a method, an apparatus and a device for mirroring screen, so as to solve the technical problem that the user cannot normally watch the picture mirrored to the TV.

[0006] In some embodiments, the method includes: the mirror projection device receives and displays a first picture sent by the mobile terminal, the first picture is a mirror projection picture; in the display area of ​​the first picture, a second picture is captured, the second picture is a picture of the image area in the display area; the second picture is adjusted so that the adjusted second picture is displayed in full screen in the mirror projection device.

[0007] In some embodiments, the device includes: a display module configured to receive and display a first picture sent by a mobile terminal; a capture module configured to capture a second picture in a display area of ​​the first picture; and an adjustment module configured to adjust the second picture.

[0008] In some embodiments, the device includes: a processor and a memory storing program instructions, and the processor is configured to execute the aforementioned method for mirroring screen when executing the program instructions.

[0009] In some embodiments, the mirror screen projection device includes: the aforementioned device for mirror screen projection.

[0010] The method, apparatus and mirroring device for mirroring screen provided by the embodiments of the present disclosure can achieve the following technical effects: by receiving the first picture of the mobile terminal through the mirroring screen projection device, the mirrored first picture can be displayed in the mirroring screen projection device, and in the display area of ​​the first picture, the picture of the image area is captured as the second picture, so as to adjust the second picture, so that the adjusted second picture is displayed in full screen in the mirroring screen projection device. In this way, the user can watch the display information of the second picture in full screen on the mirroring screen projection device, which is convenient for the user to use.

[0011] The above general description and the following description are exemplary and explanatory only and are not intended to limit the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] One or more embodiments are exemplarily described by corresponding drawings, which do not limit the embodiments. Elements with the same reference numerals in the drawings are shown as similar elements, and the drawings do not constitute a scale limitation, and wherein:

[0013] Figure 1 is a schematic diagram of a method for mirroring screen projection provided by an embodiment of the present disclosure;

[0014] Figure 2 is a schematic diagram of a device for mirroring screen projection provided by an embodiment of the present disclosure;

[0015] Figure 3 It is a schematic diagram of another device for mirroring screen projection provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0016] In order to be able to understand the features and technical contents of the embodiments of the present disclosure in more detail, the implementation of the embodiments of the present disclosure is described in detail below in conjunction with the accompanying drawings. The attached drawings are for reference only and are not used to limit the embodiments of the present disclosure. In the following technical description, for the convenience of explanation, a full understanding of the disclosed embodiments is provided through multiple details. However, one or more embodiments can still be implemented without these details. In other cases, to simplify the drawings, well-known structures and devices can be simplified for display.

[0017] The terms "first", "second", etc. in the specification and claims of the embodiments of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the terms used in this way can be interchanged where appropriate, so that the embodiments of the embodiments of the present disclosure described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions.

[0018] Unless otherwise stated, the term "plurality" means two or more.

[0019] In the embodiment of the present disclosure, the character " / " indicates that the preceding and following objects are in an "or" relationship. For example, A / B indicates: A or B.

[0020] The term "and / or" is a description of the association relationship between objects, indicating that three relationships can exist. For example, A and / or B means: A or B, or, A and B.

[0021] Figure 1 is a schematic diagram of a method for mirroring screen provided by an embodiment of the present disclosure, combined with Figure 1 As shown, the embodiment of the present disclosure provides a method for mirroring screen, including:

[0022] S11, the mirroring screen projection device receives and displays the first picture sent by the mobile terminal, and the first picture is the mirroring screen projection picture.

[0023] S12, capturing a second picture in the display area of ​​the first picture, where the second picture is a picture of the image area in the display area.

[0024] S13, adjusting the second picture so that the adjusted second picture is displayed in full screen in the mirror projection device.

[0025] The mobile terminal device in the embodiments of the present disclosure may be a mobile device with a mirroring screen mode, such as a mobile phone or a tablet computer, and the mirroring screen device may be a device equipped with a display screen, a smart home device, etc., or any combination thereof. In some embodiments, the smart home device may include, for example, an air conditioner, a refrigerator, a television, etc., or any combination thereof.

[0026] In step 11, the mirroring screen projection device receives and displays the first picture sent by the mobile terminal. Specifically, a connection is established between the mirroring screen projection device and the mobile terminal device, and the mirroring screen projection device and the mobile terminal device can be connected to the same local area network, and after the mobile terminal device selects the screen mirroring mode, that is, after sending a mirroring screen projection request to the mirroring screen projection device, the mirroring screen projection device can receive and display the first picture of the mirroring screen projection, wherein the first picture is the picture of the mirroring screen projection. For example, when the mobile terminal is a mobile phone and the mirroring screen projection device is a TV, the mobile phone and the TV are connected to the same local area network, and after the mobile phone selects the mirroring screen projection mode, the TV can receive and display the first picture of the mobile phone projection. With this solution, the user can view the first picture of the mirroring screen projection on the mirroring device.

[0027] In step 12, a second picture is captured in the display area of ​​the first picture. The second picture is a picture of the image area in the display area.

[0028] In this solution, after the projected screen is displayed on the mirroring device, the display area of ​​the mirroring projection device may include a black area in addition to the image area. In order to determine the target screen for adjustment, the image area in the display area is captured as the second screen. This can prevent the black area from being adjusted during the screen adjustment process, thereby ensuring the accuracy of the adjustment target and facilitating full-screen display of the adjusted second screen in the mirroring projection device.

[0029] In step 13, the display of the second picture can be adjusted by adjusting the display angle and / or the display ratio, so that the adjusted second picture is displayed in full screen in the mirror projection device.

[0030] A method for mirroring screen projection provided by an embodiment of the present disclosure is adopted, a first picture of a mobile terminal is received by a mirroring screen projection device, and the mirrored first picture is displayed on the mirroring screen projection device, so that in the display area of ​​the first picture, a picture of an image area is captured as a second picture, and then the second picture is adjusted so that the adjusted second picture is displayed in full screen on the mirroring screen projection device. So that the user can watch the display information of the second picture in full screen on the mirroring screen projection device, which is convenient for the user to use.

[0031] Optionally, in order to accurately capture the image area in the display area as the second screen, in this solution, the screen information of the display area is obtained, and the boundary of the image area is identified in the screen information, and the image area is captured as the second interface.

[0032] Specifically, the picture information of the display area includes the image area and the black area outside the image area. In order to adjust the image area, the boundary of the image area is identified in the display area. The boundary of the image area is the boundary between the image area and the black area. With this solution, the image area in the display area can be accurately captured so as to further adjust the image area.

[0033] Optionally, in order to adjust the second screen, when the mirror projection device is configured with a remote control device that matches it, the embodiment of the present disclosure obtains key indication information of the remote control device, and adjusts the second screen according to the key indication information.

[0034] Specifically, the button indication information may include the pointing direction of the button, the number of times the button is pressed, and the adjustment angle of each button press. The button indication information can be preset according to the user's usage habits. For example, the adjustment angle for each press is preset to 90°. When the right button is pressed twice, the button indication information is determined to rotate right twice and 90° each time. In this solution, by obtaining the button indication information of the remote control device when a remote control device is configured on the mirroring device, the user's screen adjustment intention can be determined according to the button indication information, and then the second screen can be adjusted so that the adjusted second screen is displayed in full screen in the mirroring projection device, which is convenient for the user to watch the projection content on the projection device and convenient for the user to use.

[0035] Optionally, in order to adjust the second picture, in this solution, the adjustment angle of the second picture can be determined according to the indication information of the button; and the second picture can be adjusted according to the adjustment angle.

[0036] In the embodiment of the present disclosure, the adjustment angle of the second picture can be determined in at least the following three ways:

[0037] The first method: the adjustment angle of the second screen is determined according to the direction of the button and the number of times the button is pressed. For example, the default adjustment angle for each press of the direction key is 90°. When the user wants to adjust the second screen, if the user presses the left button three times, the adjustment angle of the second screen is determined to be rotated 270° to the left at the current screen angle.

[0038] The second method: the adjustment angle of the second screen is determined according to the direction of the button and the number of times the button is pressed within a preset time. For example, the default adjustment angle for each press of the direction key is 90°, and the preset button pressing time is 3 seconds. When the user wants to adjust the second screen, if the number of button presses within 3 seconds is two to the left, the adjustment angle of the second screen is determined to be 180° to the left at the current screen angle.

[0039] The third method: preset the adjustment angle of each time the direction key is pressed according to the user's usage habits. And determine the adjustment angle of the second screen according to the adjustment angle, the direction of the key and the number of times the key is pressed. For example, the adjustment angle of each time the direction key is pressed is preset to 30°. When the user wants to adjust the second screen, if the user presses the left button three times, the adjustment angle of the second screen is determined to be 90 degrees to the left at the current screen angle.

[0040] In this solution, the second picture is adjusted according to the adjustment angle, and the display angle of the second picture can be accurately adjusted so that the user can normally watch the display content of the second picture on the mirror projection device, which is convenient for users.

[0041] Optionally, in order to display the second picture in full screen after adjusting the picture angle, in this solution, the display ratio of the second picture can also be adjusted.

[0042] In this solution, after capturing the second picture or adjusting the angle of the second picture, the display ratio of the second picture can be adjusted according to the size of the display interface of the mirroring device so that the second picture can be displayed in full screen on the display screen of the mirroring device. In another optimization scheme, the display ratio of the second picture can be adjusted according to the user's usage habits of the mirroring device. For example, when the user is a child, in order to avoid eye fatigue caused by a large display ratio, the display ratio of the second picture can be reduced according to the child's usage habits to protect the child's eyesight. With this solution, it is possible to provide users with personalized display services and improve user satisfaction.

[0043] Optionally, in order to ensure accurate identification of the image area in the first picture, in this solution, after displaying the first picture sent by the mobile terminal, when a screen menu closing request is obtained, the screen menu of the mirroring screen projection device is closed.

[0044] In this solution, after the mirroring screen projection device receives the first picture sent by the mobile terminal, the mirroring screen projection device displays the first picture in the Video layer, and at the same time displays the screen menu of the mirroring screen projection device in the first picture. In order to avoid adjusting the screen menu at the same time while adjusting the picture, the screen menu of the mirroring screen projection device is closed when the screen menu closing request is obtained. Specifically, a button of the remote control device can be preset, and when the user presses the button, it can be determined that the user has made a request to close the screen menu. For example, it can be determined that the user has made a request to close the screen menu when the user presses the UP key. With this solution, when the screen menu closing request is obtained, the screen menu of the mirroring screen projection device is closed, avoiding capturing the screen menu that does not need to be adjusted while capturing the second picture, thereby ensuring the accuracy of image area recognition.

[0045] Optionally, after the mirroring screen projection device obtains the mirroring screen projection request sent by the mobile terminal, it receives and displays the first picture.

[0046] In this solution, after the mobile terminal selects the mirror projection mode, the user can select the mirror projection device to which he wants to project the screen in the same area network through the mobile terminal, and send the first picture to the mirror projection device, so that the mirror projection device receives and displays the first picture after receiving the mirror projection request sent by the mobile terminal.

[0047] In actual applications, the mobile terminal device can be a mobile phone, and the mirrored screen projection device can be a TV equipped with a remote control device. When the user needs to project the screen, connect the mobile phone and the TV to the same local area network, and select the screen mirroring mode and the TV to be projected on the mobile phone. After the mobile phone and the TV are connected, the first picture is sent to the TV, and the first picture is displayed on the video layer of the TV. When the TV receives the screen menu closing request sent by the remote control device, the screen menu on the TV is closed, and the image area in the first picture is captured as the second picture. Therefore, when the button indication information of the remote control device is received, the second picture is adjusted according to the indication information, so that the adjusted second picture is displayed in full screen in the mirrored screen projection device.

[0048] The method for mirroring screen projection provided by the embodiments of the present disclosure can enable students to watch the teacher's teaching content normally on TV when taking classes at home during the epidemic, protect students' eyesight, and reduce damage to students' eyes caused by small screens such as mobile phones and tablets.

[0049] Figure 2 is a schematic diagram of a device for mirroring screen provided by an embodiment of the present disclosure, combined with Figure 2 As shown, the embodiment of the present disclosure provides a device for mirror screen projection, including a display module 21, a capture module 22 and an adjustment module 23. The display module 21 is configured to receive and display a first picture sent by a mobile terminal, the first picture being a mirror screen projection picture; the capture module is configured to capture a second picture in the display area of ​​the first picture, the second picture being a picture of the image area in the display area; the adjustment module 23 is configured to adjust the second picture so that the adjusted second picture is displayed in full screen in the mirror screen projection device.

[0050] By using the device for mirroring screen projection provided by the embodiment of the present disclosure, the first picture of the mobile terminal is received by the mirroring screen projection device, and the mirrored first picture can be displayed in the mirroring screen projection device, and the picture of the image area in the display area of ​​the first picture is captured as the second picture. Thus, the second picture is adjusted so that the adjusted second picture is displayed in full screen in the mirroring screen projection device. So that the user can watch the display information of the second picture in full screen on the mirroring screen projection device, which is convenient for the user to use.

[0051] Combination Figure 3 As shown, an embodiment of the present disclosure provides a device for mirroring screen projection, including a processor (processor) 100 and a memory (memory) 101. Optionally, the device may also include a communication interface (Communication Interface) 102 and a bus 103. Among them, the processor 100, the communication interface 102, and the memory 101 can communicate with each other through the bus 103. The communication interface 102 can be used for information transmission. The processor 100 can call the logic instructions in the memory 101 to execute the method for mirroring screen projection of the above embodiment.

[0052] In addition, the logic instructions in the memory 101 described above may be implemented in the form of software functional units and when sold or used as independent products, may be stored in a computer-readable storage medium.

[0053] The memory 101 is a computer-readable storage medium that can be used to store software programs and computer executable programs, such as program instructions / modules corresponding to the method in the embodiment of the present disclosure. The processor 100 executes functional applications and data processing by running the program instructions / modules stored in the memory 101, that is, implementing the method for mirroring screen in the above embodiment.

[0054] The memory 101 may include a program storage area and a data storage area, wherein the program storage area may store an operating system and an application required for at least one function; the data storage area may store data created according to the use of the terminal device, etc. In addition, the memory 101 may include a high-speed random access memory and may also include a non-volatile memory.

[0055] An embodiment of the present disclosure provides a mirroring screen projection device, including the above-mentioned device for mirroring screen projection.

[0056] An embodiment of the present disclosure provides a computer-readable storage medium storing computer-executable instructions, wherein the computer-executable instructions are configured to execute the above-mentioned method for mirror screen projection.

[0057] An embodiment of the present disclosure provides a computer program product, which includes a computer program stored on a computer-readable storage medium, and the computer program includes program instructions. When the program instructions are executed by a computer, the computer executes the above-mentioned method for mirroring the screen.

[0058] The computer-readable storage medium mentioned above may be a transient computer-readable storage medium or a non-transitory computer-readable storage medium.

[0059] The technical solution of the embodiment of the present disclosure can be embodied in the form of a software product, which is stored in a storage medium and includes one or more instructions for enabling a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in the embodiment of the present disclosure. The aforementioned storage medium may be a non-transient storage medium, including: a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and other media that can store program codes, or a transient storage medium.

[0060] The above description and the accompanying drawings fully illustrate the embodiments of the present disclosure so that those skilled in the art can practice them. Other embodiments may include structural, logical, electrical, process and other changes. The embodiments represent only possible changes. Unless explicitly required, separate components and functions are optional, and the order of operation may vary. The parts and features of some embodiments may be included in or replace the parts and features of other embodiments. Moreover, the words used in this application are only used to describe the embodiments and are not used to limit the claims. As used in the description of the embodiments and the claims, unless the context clearly indicates, the singular forms of "a", "an" and "the" are intended to include plural forms as well. Similarly, the term "and / or" as used in this application refers to any and all possible combinations of listings containing one or more associated ones. In addition, when used in the present application, the term "comprise" and its variants "comprises" and / or comprising refer to the presence of stated features, wholes, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or groups thereof. In the absence of further restrictions, the elements defined by the sentence "comprising a ..." do not exclude the presence of other identical elements in the process, method or device comprising the elements. In this article, each embodiment may focus on the differences from other embodiments, and the same and similar parts between the various embodiments may refer to each other. For the methods, products, etc. disclosed in the embodiments, if they correspond to the method part disclosed in the embodiments, then the relevant parts can refer to the description of the method part.

[0061] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software may depend on the specific application and design constraints of the technical solution. The technicians may use different methods for each specific application to implement the described functions, but such implementations should not be considered to exceed the scope of the embodiments of the present disclosure. The technicians may clearly understand that, for the convenience and simplicity of description, the specific working processes of the systems, devices and units described above may refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here.

[0062] In the embodiments disclosed herein, the disclosed methods and products (including but not limited to devices, equipment, etc.) can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units can be only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between each other shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms. The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to implement this embodiment. In addition, each functional unit in the embodiment of the present disclosure may be integrated in a processing unit, or each unit may exist physically alone, or two or more units may be integrated in one unit.

[0063] The flowchart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to the embodiment of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a part of the code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. In some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, which can depend on the functions involved. In the description corresponding to the flowchart and the block diagram in the accompanying drawings, the operations or steps corresponding to different boxes can also occur in a different order from the order disclosed in the description, and sometimes there is no specific order between different operations or steps. For example, two consecutive operations or steps can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, which can depend on the functions involved. Each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented by a dedicated hardware-based system that performs the specified functions or actions, or may be implemented by a combination of dedicated hardware and computer instructions.

Claims

1. A method for mirroring screen, characterized in that: The method comprises: The mirroring screen projection device receives and displays a first picture sent by the mobile terminal, where the first picture is a mirroring screen projection picture; In the display area of ​​the first picture, capturing a second picture, where the second picture is a picture of an image area in the display area; Adjusting the second picture so that the adjusted second picture is displayed in full screen on the mirror projection device; If a remote control device matching the mirroring screen projection device is configured, the adjusting the second picture includes: obtaining key indication information of the remote control device; adjusting the second picture according to the key indication information; The adjusting the second screen according to the button indication information includes: determining the adjustment angle of the second screen according to the button indication information; adjusting the second screen according to the adjustment angle; wherein determining the adjustment angle of the second screen includes: presetting the adjustment angle for each pressing of the direction key according to the user's usage habits; the button indication information includes: the pointing direction of the button, the number of times the button is pressed and the adjustment angle for each pressing of the button; the button indication information is preset according to the user's usage habits.

2. The method according to claim 1, characterized in that In the display area of ​​the first picture, capturing the second picture includes: Acquire picture information of the display area of ​​the first picture; In the picture information, a boundary of the image area is identified, and the image area is captured as a second interface.

3. The method according to claim 1, characterized in that The adjusting the second picture further includes: Adjust the display ratio of the second screen.

4. The method according to any one of claims 1 to 3, if a remote control device matching the mirroring screen projection device is configured, is characterized in that: After displaying the first picture sent by the mobile terminal, the method further includes: When a screen menu closing request is obtained, the screen menu of the mirroring screen projection device is closed.

5. The method according to claim 1, characterized in that Also includes: After the mirroring screen projection device obtains the mirroring screen projection request sent by the mobile terminal, it receives and displays the first picture.

6. A device for mirroring screen, characterized in that: Applied to a mirroring screen projection device, the device comprises: A display module is configured to receive and display a first picture sent by a mobile terminal, wherein the first picture is a mirror projection picture; A capture module is configured to capture a second picture in the display area of ​​the first picture, where the second picture is a picture of the image area in the display area; An adjustment module is configured to adjust the second picture so that the adjusted second picture is displayed in full screen in the mirror projection device; Among them, if a remote control device matching the mirror projection device is configured, the adjusting of the second screen includes: obtaining the button indication information of the remote control device; adjusting the second screen according to the button indication information; adjusting the second screen according to the button indication information includes: determining the adjustment angle of the second screen according to the button indication information; adjusting the second screen according to the adjustment angle; wherein, determining the adjustment angle of the second screen includes: presetting the adjustment angle for each pressing of the direction key according to the user's usage habits; the button indication information includes: the pointing direction of the button, the number of times the button is pressed and the adjustment angle for each pressing of the button; the button indication information is preset according to the user's usage habits.

7. A device for mirroring screen, comprising a processor and a memory storing program instructions, characterized in that: The processor is configured to execute the method for mirroring screen as described in any one of claims 1 to 5 when executing the program instructions.

8. A mirror screen projection device, characterized in that: It comprises the device for mirroring screen as claimed in claim 7.

Images