Mirroring method, device, electronic device and storage medium

Abstract

The present disclosure discloses a mirroring method, device, electronic device, and storage medium. [Solution] The mirroring method includes receiving a mirroring request sent from a terminal device, the mirroring request carrying target mirroring identification information, the target mirroring identification information including target image information and / or target video information, determining a mirroring device for which the terminal device has requested mirroring based on the target mirroring identification information, and establishing a mirroring connection between the terminal device and the mirroring device.

Description

[Technical field]

[0001] The present disclosure relates to the field of computer technology, for example, to a mirroring method, device, electronic device, and storage medium.

[0002] This application claims priority to a Chinese patent application bearing application number 202110666267.4, filed with the China National Intellectual Property Office on June 16, 2021, the entire contents of which are incorporated herein by reference. [Background technology]

[0003] In the related art, wide area network mirroring (SCREEN PROJECTION) is generally performed by a PIN (Personal Identification Number) code or a QR code. However, the mirroring implementation method in the related art is single and has low security, and cannot meet the mirroring needs of users. Summary of the Invention [Problem to be solved by the invention]

[0004] The present disclosure provides a mirroring method, device, electronic device, and storage medium for providing a user with a richer mirroring scheme and improving the safety of mirroring. [Means for solving the problem]

[0005] The present disclosure relates to receiving a mirroring request sent from a terminal device, the mirroring request carrying target mirroring identification information, the target mirroring identification information including target image information and / or target video information; determining a mirroring device requested by the terminal device to perform mirroring based on the target mirroring identification information; establishing a mirroring connection to the terminal device and the mirroring device; A mirroring method is provided.

[0006] The present disclosure relates to displaying, by the mirroring device, a mirroring identifier of the device, including an identifying image and / or an identifying video; Obtaining, by a terminal device, a target mirroring identification corresponding to the mirroring identifier, generating a mirroring request carrying the target mirroring identification, and sending the mirroring request to a server; receiving the mirroring request by a server, determining the mirroring device requested by the terminal device according to the target mirroring identification information, and establishing a mirroring connection between the terminal device and the mirroring device; Another mirroring method is also provided.

[0007] The present disclosure relates to A request receiving module configured to receive a mirroring request sent from a terminal device, the mirroring request carrying a target mirroring identification information, and the target mirroring identification information including target image information and / or target video information; A device determination module configured to determine a mirroring device requested by the terminal device for mirroring based on the target mirroring identification information; a connection establishment module configured to establish a mirroring connection with the terminal device and the mirroring device; A mirroring device is further provided.

[0008] The present disclosure relates to one or more processors; A memory configured to store one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors realize the mirroring method described above. An electronic device is also provided.

[0009] The present disclosure relates to A computer-readable storage medium having a computer program stored thereon, When the program is executed by a processor, the above-mentioned mirroring method is realized. A computer readable storage medium is also provided. [Brief description of the drawings]

[0010] [Figure 1] 4 is a flowchart of a mirroring method according to an embodiment of the present disclosure. [Diagram 2] 1 is a flowchart of another mirroring method according to an embodiment of the present disclosure. [Diagram 3] 4 is a flowchart of a further mirroring method according to an embodiment of the present disclosure. [Figure 4] 1 is a configuration block diagram of a mirroring device according to an embodiment of the present disclosure. [Diagram 5] FIG. 1 is a structural schematic diagram of an electronic device according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, the embodiments of the present disclosure will be described with reference to the drawings. Although the drawings show some embodiments of the present disclosure, the present disclosure can be realized in various forms, and these embodiments are provided for understanding the present disclosure. The drawings and embodiments of the present disclosure are merely illustrative.

[0012] Steps described in method embodiments of the present disclosure may be performed in differing orders and / or in parallel. Method embodiments may also include additional steps and / or steps shown as omitted from the execution. The scope of the present disclosure is not limited in this respect.

[0013] As used herein, the term "comprising" and variations thereof are open inclusive, i.e., "including, but not limited to." The term "based on" means "based at least in part on." The term "one embodiment" refers to "at least one embodiment." The term "another embodiment" refers to "at least one other embodiment." The term "some embodiments" refers to "at least some embodiments." Relevant definitions of other terms are provided below in the description.

[0014] The concepts of "first", "second", etc. referred to in this disclosure are merely intended to distinguish different devices, modules, or units, and are not intended to limit the order or interdependence of functions performed by these devices, modules, or units.

[0015] It should be noted that the modifications "one" and "multiple" referred to in the present disclosure are exemplary and not limiting, and those of skill in the art will appreciate that they should be understood as "one or more" unless the context clearly indicates otherwise.

[0016] The names of messages or information exchanged between multiple devices in the embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of these messages or information.

[0017] FIG. 1 is a flowchart of a mirroring method according to an embodiment of the present disclosure. The method can be performed by a mirroring device. Here, the device can be realized by software and / or hardware, and can be configured in an electronic device such as a computer device (e.g., a server). The mirroring method according to an embodiment of the present disclosure is applied to a mirroring scene in a wide area network. As shown in FIG. 1, the mirroring method according to the embodiment may include the following steps:

[0018] In S101, a mirroring request sent from a terminal device is received, the mirroring request carries target mirroring identification information, and the target mirroring identification information includes target image information and / or target video information.

[0019] A mirroring request can be understood as a request for mirroring to another device. Correspondingly, a terminal device may be a device that has a mirroring need, such as a mobile phone, a tablet computer, or a computer, and can establish a connection with a server via WebSocket or HyperText Transfer Protocol over SecureSocket Layer (HTTPS).

[0020] The target mirroring identification information can be understood as the mirroring identification information of the other device, i.e., the mirroring identification information of the device that the terminal device requests to be mirrored, and the mirroring identification information of one device can be understood as the identification information for the device to be mirrored by another device, which can be used to uniquely identify the device. The target mirroring identification information may include target image information and / or target video information, where the target image information can be understood as the information of an image used as an identification, and the target video information can be understood as the information of a video used as an identification, and correspondingly, the image and / or video can be used as the mirroring identifier of the device.

[0021] When a terminal device intends to project a screen onto another device, the terminal device can obtain target mirroring identification information of the other device to which the screen is to be projected, generate a mirroring request carrying the target mirroring identification information, and send the mirroring request to a server. Correspondingly, when the server receives a mirroring request sent from a terminal device, the server can analyze the mirroring request and obtain the target mirroring identification information carried in the mirroring request.

[0022] In this embodiment, the mirroring identification information of one device may be generated by a server and transmitted to the device, or may be generated by the device based on preset generation rules and transmitted to the server, or may be generated by an identifier generating device other than the device and the server (e.g., another device or server, etc.) and transmitted to the device and the server, and this embodiment is not limited thereto.

[0023] In order to improve the security of the generated mirroring identification information and reduce the requirements for the performance of the terminal device, in this embodiment, the mirroring identification information may be generated by a server, and in this case, when an identification information acquisition request sent from a mirroring device is received before receiving a mirroring request sent from the terminal device, the method may further include determining the mirroring identification information of the mirroring device, and sending and displaying the mirroring identification information to the mirroring device so that the terminal device can acquire the mirroring identification information.

[0024] The identification information acquisition request may be a request for the mirroring device to acquire its own mirroring identification information, and may be generated when a trigger operation to display the mirroring identifier is received.

[0025] In the above embodiment, the mirroring device can establish a persistent connection with the server, for example, the mirroring device can establish a persistent connection with the server by WebSocket. Illustratively, when a user intends to project a screen onto the mirroring device using a terminal device, the user executes a trigger operation to instruct the mirroring device to display the mirroring identifier of the mirroring device itself. When the mirroring device receives the trigger operation, the mirroring device generates an identification information acquisition request and transmits the identification information acquisition request to the server, or determines whether its own mirroring identification information is stored locally, and if its own mirroring identification information is stored locally, displays its own mirroring identifier based on the mirroring identification information, and if its own mirroring identification information is not stored locally, generates an identification information acquisition request and transmits the identification information acquisition request to the server. Correspondingly, when the server receives an identification information acquisition request sent from the mirroring device, it can determine the mirroring identification information of the mirroring device, for example, generate a mirroring identifier of the mirroring device and determine the mirroring identification information of the mirroring identifier, or obtain the mirroring identification information of the mirroring device stored locally, and send the mirroring identification information to the mirroring device. Thus, when the mirroring device receives the mirroring identification information sent from the server, it can display its own mirroring identifier based on the mirroring identification information and store the mirroring identification information. Correspondingly, the terminal device can collect the mirroring identification information of the mirroring identifier displayed on the mirroring device, generate a mirroring request carrying the mirroring identification information, send the mirroring request to the server, and request the server to establish a mirroring connection between the terminal device and the mirroring device.

[0026] In this embodiment, in order to reduce the possibility that the mirroring identification information is stolen illegally and improve the security of mirroring, the mirroring identification information of each device may be set to an expiration date. For example, when the mirroring device receives a trigger operation to display the mirroring identifier, it can generate an identification information acquisition request and send the identification information acquisition request to a server, or it can determine whether its own valid (i.e., within the expiration date) mirroring identification information is stored locally, and if its own valid mirroring identification information is stored locally, it can display its own mirroring identifier based on the mirroring identification information; if its own locally stored mirroring identification information is invalid (i.e., outside the expiration date), it can delete the locally stored mirroring identification information, generate an identification information acquisition request, and send the identification information acquisition request to a server. Correspondingly, when the server receives an identification information acquisition request sent from the mirroring device, it can determine the mirroring identification information of the mirroring device, for example, determine whether or not valid mirroring identification information of the mirroring device is stored locally, and if valid mirroring identification information of the mirroring device is stored locally, send the mirroring identification information (or the mirroring identification information and expiration date information of the mirroring identification information) to the mirroring device, and if the mirroring identification information of the mirroring device stored locally is invalid, delete the mirroring identification information of the mirroring device stored locally, generate a mirroring identifier in accordance with preset mirroring information generation rules, store the mirroring identification information and expiration date information of the mirroring device, and send the mirroring identification information (or the mirroring identification information and expiration date information of the mirroring identification information) to the mirroring device.

[0027] The expiration time of the mirroring identification information can be flexibly set, for example, it may be set to 5 hours, 12 hours, 24 hours, etc. The mirroring identifier can be generated using a generation method, for example, different images (including pictures and / or dynamic images) can be generated randomly by setting a random function, for example, a function picture can be generated by a Matlab tool, a drawing interface can be called and the parameters of the interface can be set to random parameters to draw pictures randomly, or if there are enough pictures stored in the server, pictures can be generated by processing the pictures stored in the server (for example, adding a watermark, a password or a PIN code, etc.) to be used as the identification picture of the mirroring device. Alternatively, after generating pictures, a dynamic image may be generated using the generated pictures to serve as an identification dynamic image for the mirroring device, and / or a video may be generated by adding an effect (e.g., a scene change effect or an animation effect) to one or more generated pictures, or a portion of a video stored in the server may be randomly cut out or selected, and video frames within the video may be processed (e.g., a watermark, a password or a PIN code, etc.) to generate a video to serve as an identification video for the mirroring device, and this embodiment is not limited thereto.

[0028] In S102, a mirroring device requested by the terminal device for mirroring is determined based on the target mirroring identification information.

[0029] The mirroring device can be understood as the device corresponding to the target mirroring identification information, i.e. the device to which the terminal device that sent the mirroring request requests mirroring, and the mirroring device may be a device that can be set for mirroring, such as a television, a smart tablet or a computer.

[0030] For example, after receiving a mirroring request sent from a terminal device, the server can match the target mirroring identification information carried in the mirroring request with the mirroring identification information of each device stored in the server, that is, match the target mirroring identifier corresponding to the target mirroring identification information with the mirroring identifier of each device stored in the server, and if the matching with the mirroring identification information / mirroring identifier of one device is successful, the device corresponding to the mirroring identification information / mirroring identifier that has been successfully matched can be determined as the mirroring device requested by the terminal device. Correspondingly, if the matching with the target mirroring identification information / target mirroring identifier with all the mirroring identification information / mirroring identifiers stored in the server fails, the server can send presentation information to the terminal device, and the terminal device can present to the user that there is no mirroring device corresponding to the target mirroring identification information.

[0031] In S103, a mirroring connection is established between the terminal device and the mirroring device.

[0032] In this embodiment, after the server determines the mirroring device corresponding to the target mirroring identification information carried in the mirroring request, it establishes a mirroring connection between the terminal device that sent the mirroring request and the mirroring device, and allows the terminal device to transmit mirroring data to the mirroring device via the mirroring connection and project the screen.

[0033] In one embodiment, the method further includes, after establishing a mirroring connection between the terminal device and the mirroring device, obtaining mirroring data of the terminal device, and transmitting the mirroring data to the mirroring device for display.

[0034] The mirroring data of the terminal device is devicemay be the content to be projected on the mirroring device, may be video data of a video (e.g., a TV program, a drama, a movie or other video) that the terminal device intends to project on the screen, or page data of a display page of the terminal device, and correspondingly, the server can obtain the mirroring data of the terminal device from a resource database in which the video resources of the corresponding video are stored or from the terminal device.

[0035] In the above embodiment, the manner in which the terminal device projects its screen onto the mirroring device can be set as needed, for example, the terminal device can project the content that needs to be played (e.g., video, etc.) or the screen of its own display page onto the mirroring device.

[0036] Exemplarily, when the mirroring data is video content, the terminal device can determine the video that needs to be projected based on the user's mirroring operation, and send the identification information of the video (e.g., a video identifier (ID) or a resource storage address) to the server. Correspondingly, the server can obtain the video data of the video from the resource database based on the identification information as mirroring data, and send the mirroring data to the mirroring device. Thus, after receiving the mirroring data sent from the server, the mirroring device can display the mirroring data, i.e., play the video corresponding to the mirroring data.

[0037] If the mirroring data is a display page, the terminal device can transmit the page data of its current display page (including the content displayed on the page) to the server as mirroring data in real time or when it detects a change in the page or content in the page displayed on the terminal device. Correspondingly, the server can transmit the mirroring data to the mirroring device after receiving the mirroring data transmitted from the terminal device. Thus, the mirroring device can display the mirroring data transmitted by the server after receiving the mirroring data transmitted by the server, i.e., display the current display page of the terminal device.

[0038] During the mirroring process, the mirroring device may transmit data to the terminal device via the communication connection. For example, if a user adjusts the volume, video playback progress, page, or content within the page of the mirroring device by other means than the terminal device (for example, the remote control of the mirroring device or the adjustment buttons of the mirroring device, etc.), the mirroring device can transmit the adjustment information to the terminal device and synchronously adjust the terminal device, for example, synchronously adjusting the volume of the terminal device, the playback progress of the video projected on the screen, the current display page or the content displayed on the current display page, etc.

[0039] The mirroring method according to the present embodiment receives a mirroring request carrying target mirroring identification information including target image information and / or target video information sent from a terminal device, and determines the mirroring device requested by the terminal device according to the target mirroring identification information, and establishes a mirroring connection with the terminal device and the mirroring device. By adopting the above technical solution, the present embodiment uses images and / or videos as mirroring identifiers to identify mirroring devices when mirroring a wide area network, which not only provides a more diverse mirroring device identification method, but also reduces the risk of mirroring identification information being forged or stolen, and improves the security of mirroring.

[0040] 2 is a flowchart of another mirroring method according to an embodiment of the present disclosure. The embodiment of the present embodiment can be combined with one or more preferred embodiments of the above-mentioned embodiment. Preferably, the target mirroring identification information includes target image information, and the target image information includes target picture information, and determining the mirroring device requested by the terminal device based on the target mirroring identification information includes determining a first target device corresponding to an identified picture whose similarity with the target picture corresponding to the target picture information is greater than a first similarity threshold as the mirroring device requested by the terminal device.

[0041] Preferably, the target mirroring identification information includes target image information, and the target image information includes target dynamic image information; and determining the mirroring device requested by the terminal device for mirroring based on the target mirroring identification information includes identifying a target dynamic image corresponding to the target dynamic image information, and when the number of target dynamic image pictures included in the target dynamic image is greater than a first number threshold, determining a second target device corresponding to an identified dynamic image including similar dynamic image pictures of each target dynamic image picture as the mirroring device requested by the terminal device, the target dynamic image is recorded by the terminal device, and the similarity between the similar dynamic image pictures and each target dynamic image picture is greater than a second similarity threshold.

[0042] Preferably, the target mirroring identification information includes target video information, and determining the mirroring device requested by the terminal device for mirroring based on the target mirroring identification information includes identifying a target video corresponding to the target video information, and when the number of target video frames included in the target video is greater than a second number threshold, determining a third target device corresponding to an identified video including similar video frames of each target video frame as the mirroring device requested by the terminal device for mirroring, and the similarity between the similar video frames and each target video frame is greater than a third similarity threshold.

[0043] Correspondingly, as shown in FIG. 2, the mirroring method according to this embodiment may include the following steps.

[0044] In S201, receive a mirroring request sent from a terminal device, and execute S202, S203, or S204, where the mirroring request carries target mirroring identification information, the target mirroring identification information includes target image information and / or target video information, and the target image identification includes target picture information or target dynamic image information.

[0045] In S202, a first target device corresponding to an identified picture whose similarity to a target picture corresponding to the target picture information is greater than a first similarity threshold is determined as a mirroring device requested by the terminal device, and S205 is executed.

[0046] The target picture information can be understood as picture information carried in the mirroring request, such as color information of each pixel point, etc. Correspondingly, the target picture can be a picture corresponding to the target picture information, and the target picture is obtained by a user taking a picture on a terminal device. The identification picture can be a picture used as a mirroring identifier.

[0047] In this embodiment, when the target mirroring identification information includes target image information, that is, when a picture is used as the mirroring identifier of the device, the target picture corresponding to the target image information can be determined according to the similarity between the target picture and the identification picture of each device stored locally, whether the target picture and the identification picture of the device stored locally match, and if the similarity between the target picture and the identification picture of a device stored locally is greater than a first similarity threshold, it is determined that the target picture and the identification picture of the device match successfully.Here, the first similarity threshold can be set according to need, for example, can be set to 0.95 or 0.9, etc.

[0048] Exemplarily, the mirroring device displays its own identification picture. The terminal device takes the identification picture displayed on the mirroring device by a camera, obtains a target picture, generates a mirroring request including picture information of the target picture (i.e., target picture information), and transmits the mirroring request to a server. Thus, after receiving the mirroring request, the server can obtain the target picture information in the mirroring request, calculate the similarity between the target picture information and the identification picture information of the identification picture of each device stored locally, or calculate the similarity between the target picture corresponding to the target picture information and the identification picture of each device stored locally, and if the similarity between the target picture information and one identification picture information or the similarity between the target picture and one identification picture is greater than a first similarity threshold, the device corresponding to the identification picture information / identification picture (i.e., the first target device) can be determined as the mirroring device requested by the terminal device request for mirroring.

[0049] In S203, a target dynamic image corresponding to the target dynamic image information is identified, and if the number of target dynamic image pictures included in the target dynamic image is greater than a first number threshold, a second target device corresponding to the identified dynamic image including similar dynamic image pictures of each target dynamic image picture is determined as a mirroring device requested by the terminal device for mirroring, and S205 is executed, where the target dynamic image is recorded by the terminal device, and the similarity between the similar dynamic image pictures and each target dynamic image picture is greater than a second similarity threshold.

[0050] The target dynamic image information can be understood as the dynamic image information carried in the mirroring request, and may include picture information of multiple dynamic image pictures. Correspondingly, the target dynamic image can be a dynamic image corresponding to the target dynamic image information, and the target dynamic image can be determined by a user taking a picture on a terminal device. The target dynamic image picture can be a picture included in the target dynamic image. The identifying dynamic image can be a dynamic image used as a mirroring identifier.

[0051] In this embodiment, when the target mirroring identification information includes target dynamic image information, that is, when a dynamic image is used as the mirroring identifier of the device, the mirroring device requested by the terminal device can be determined based on the number of dynamic image pictures included in the target dynamic image corresponding to the target dynamic image information and the similarity between each dynamic image picture and the dynamic image picture in the identification dynamic image of each device stored locally. Here, the first number threshold and the second similarity threshold can be set according to need, for example, the first number threshold can be set to 3 or 5, and the second similarity threshold can be set to 0.8 or 0.9, etc.

[0052] For example, the mirroring device displays its own identification dynamic image, the terminal device takes the identification dynamic image displayed on the mirroring device by a camera, obtains a video including the identification dynamic image, determines a target dynamic image corresponding to the video by a method such as video frame deduplication, determines a mirroring request carrying the target dynamic image information of the target dynamic image, and sends the mirroring request to a server, and the server correspondingly determines a target dynamic image corresponding to the target dynamic image information after receiving the mirroring request. Or, the mirroring device displays its own identification dynamic image, the terminal device takes the identification dynamic image displayed on the mirroring device by a camera, obtains a video including the identification dynamic image, generates a mirroring request carrying the video information of the video (including the target dynamic image information), and sends the mirroring request to a server, and the server correspondingly obtains a video taken by a user according to the video information carried in the mirroring request, and determines a target dynamic image corresponding to the video by a method such as video frame deduplication.

[0053] Thus, after determining the target dynamic image, the server judges whether the number of target dynamic image pictures included in the target dynamic image is greater than a first number threshold. If the number of target dynamic image pictures included in the target dynamic image is equal to or less than the first number threshold, it determines that the terminal device has not found the mirroring device requested for mirroring; if the number of target dynamic image pictures included in the target dynamic image is greater than the first number threshold, it selects, for each target dynamic image picture, dynamic images in the identification dynamic image of each device stored locally that have a similarity with the target dynamic image picture that is greater than a second similarity threshold. The image picture is acquired as a similar dynamic image picture of the target dynamic image picture, and a device corresponding to an identified dynamic image including the similar dynamic image picture of each target dynamic image picture (i.e., the second target device) is determined as a mirroring device requested for mirroring by the terminal device, or a device corresponding to an identified dynamic image including the similar dynamic image picture of each target dynamic image picture and in which the arrangement order of the similar dynamic image pictures is the same as the arrangement order of the target dynamic image picture (i.e., the second target device) is determined as a mirroring device requested for mirroring by the terminal device, thereby improving the accuracy of the determined mirroring device.

[0054] In S204, a target video corresponding to the target video information is identified, and if the number of target video frames included in the target video is greater than a second number threshold, a third target device corresponding to the identified video including similar video frames of each target video frame is determined as a mirroring device requested by the terminal device for mirroring, where the similarity between the similar video frames and each target video frame is greater than a third similarity threshold.

[0055] The target video information can be understood as the video information carried in the mirroring request. Correspondingly, the target video can be a video corresponding to the target video information, and the target video is obtained by a user shooting on a terminal device. The target video frame can be a video frame included in the target video. The identification video can be used as a video of the mirroring identifier.

[0056] In this embodiment, when the target mirroring identification information includes target video information, i.e., when the video is used as the mirroring identifier of the device, the mirroring device requested by the terminal device can be determined based on the number of video frames included in the target video corresponding to the target video information and the similarity between each video frame and the video frame in the identification video of each device stored locally. Here, the second number threshold and the third similarity threshold can be set according to need, for example, the second number threshold can be set to 15 or 20, etc., and the third similarity threshold can be set to 100 or 20, etc. 3 The similarity threshold may be set to 0.8 or 0.9, etc.

[0057] Illustratively, the mirroring device plays its own identification video. The terminal device uses a camera to capture the identification video being played on the mirroring device, obtains a target video, generates a mirroring request carrying the target video information of the target video, and sends the mirroring request to a server. Correspondingly, after receiving the mirroring request, the server can determine a target video corresponding to the target video information, for example, generates a video based on the target video information, performs processing such as video frame deduplication on the video, takes the processed video as the target video, judges whether the number of target video frames included in the target video is greater than a second number threshold, and if the number of target video frames included in the target video is equal to or less than the second number threshold, determines that the terminal device does not find the mirroring device requested for mirroring; if the number of target video frames included in the target video is greater than the second number threshold, obtains an identification video including the target video, and determines the device corresponding to the identification video (i.e., the third target device) as the mirroring device requested for mirroring by the terminal device. Here, an identification video including the target video can be understood as an identification video that includes each target video frame of the target video (or includes each target video frame of the target video, where the arrangement order of the target video frames in the identification video is the same as the shooting order in the target video), and if, for each target video frame, an identification video includes a similar video frame whose similarity to the target video frame is greater than a third similarity threshold, the identification video is considered to include the target video frame.

[0058] In one embodiment, the goal The mirroring identification information further includes target audio information, and the mirroring method of this embodiment further includes determining that a device corresponding to the identified audio, the similarity of which with the target audio corresponding to the target audio information is greater than a fourth similarity threshold, is the same device as the target device, including the first target device, the second target device, or the third target device.

[0059] The target audio information can be understood as audio information carried in the mirroring request, and may be all audio information of the target audio, or may only include text information corresponding to the target audio. Correspondingly, the target audio may be audio corresponding to the target picture information, and the target audio is obtained by a user recording on a terminal device. The identification audio may be an audio used as a mirroring identifier.

[0060] In the above embodiment, in order to improve the security of mirroring, the mirroring identification can be performed for the device by multiple identification items such as picture and audio, dynamic image and audio, or video and audio. In this case, the device corresponding to each identification item can be determined, and if the device corresponding to each identification item is the same device, the device is determined as the device requested by the terminal device to mirror.

[0061] For example, the mirroring device displays its own identification picture / identification dynamic image / identification video and plays its own identification audio. The terminal device collects a video including the identification picture / identification dynamic image / identification video and the identification audio by recording, generates a mirroring request carrying the video information of the video, and sends the mirroring request to the server. Correspondingly, the server determines a target picture / target dynamic image / target video and a target audio based on the video information carried in the mirroring request, determines a first target device / second target device / third target device based on the target picture / target dynamic image / target video, and calculates a similarity between the target audio and an identification audio of each device stored locally, determines an device corresponding to the identification audio whose similarity with the target audio is greater than a fourth similarity threshold, judges whether the first target device / second target device / third target device is the same device as the device, and if the first target device / second target device / third target device is the same device as the device, determines the device as a mirroring device requested by the terminal device for mirroring, and if the first target device / second target device / third target device is not the same device as the device, determines that the terminal device has not found the mirroring device requested by the terminal device for mirroring.

[0062] In S205, a mirroring connection is established between the terminal device and the mirroring device.

[0063] The mirroring method of this embodiment uses a picture, a dynamic image, or a video as a mirroring identifier, and identifies the mirroring device based on the mirroring identifier, thereby providing a more diverse mirroring device identification method, reducing the risk that the mirroring identification information is counterfeited or stolen, and improving the security of mirroring.

[0064] 3 is a flowchart of a further mirroring method according to an embodiment of the present disclosure. The mirroring method is applied to a wide area network mirroring scenario. As shown in FIG. 3, the mirroring method according to this embodiment may include the following steps:

[0065] At S301, the mirroring device displays the mirroring identifier of the device, including an identifying image and / or an identifying video.

[0066] In S302, the terminal device obtains target mirroring identification information corresponding to the mirroring identifier, generates a mirroring request carrying the target mirroring identification information, and sends the mirroring request to a server.

[0067] In S303, the server receives the mirroring request, and determines the mirroring device requested by the terminal device based on the target mirroring identification information, and establishes a mirroring connection between the terminal device and the mirroring device.

[0068] In the mirroring method according to the present embodiment, a mirroring device displays its own mirroring identifier, including an identification image and / or an identification video, a terminal device collects target mirroring identification information corresponding to the mirroring identifier, generates a mirroring request carrying the target mirroring identification information, and sends the mirroring request to a server, and the server receives the mirroring request, and determines the mirroring device requested by the terminal device according to the target mirroring identification information carried in the mirroring request, and establishes a mirroring connection between the terminal device and the mirroring device. By adopting the above technical solution, the present embodiment can not only provide a more diverse mirroring device identification method, but also reduce the risk of mirroring identification information being forged or stolen, and improve the security of mirroring.

[0069] 4 is a block diagram of a mirroring device according to an embodiment of the present disclosure. The device may be realized by software and / or hardware, and may be configured in an electronic device such as a computer device (e.g., a server), and may realize mirroring of a wide area network between a terminal device and a mirroring device by executing a mirroring method. As shown in FIG. 4, the mirroring device according to the present embodiment may include a request receiving module 401, a device determining module 402, and a connection establishing module 403, where the request receiving module 401 is configured to receive a mirroring request carrying target mirroring identification information including target image information and / or target video information transmitted from a terminal device, the device determining module 402 is configured to determine the mirroring device requested by the terminal device based on the target mirroring identification information, and the connection establishing module 403 is configured to establish a mirroring connection between the terminal device and the mirroring device.

[0070] The mirroring device of this embodiment uses a request receiving module to receive a mirroring request carrying target mirroring identification information including target image information and / or target video information sent from a terminal device, uses a device determining module to determine the mirroring device requested by the terminal device according to the target mirroring identification information, and uses a connection establishing module to establish a mirroring connection with the terminal device and the mirroring device. By adopting the above technical solution, this embodiment uses images and / or videos as mirroring identifiers to identify mirroring devices when mirroring a wide area network, which not only provides more diverse mirroring device identification methods, but also reduces the risk of mirroring identification information being forged or stolen, and improves mirroring security.

[0071] In the above embodiment, the target mirroring identification information may include target image information, and the target image information may include target picture information, and the device determination module 402 may be configured to determine a first target device corresponding to an identification picture whose similarity to the target picture corresponding to the target picture information is greater than a first similarity threshold as a mirroring device requested by the terminal device for mirroring.

[0072] In the above embodiment, the target mirroring identification information may include target image information, and the target image information may include target dynamic image information, and the device determination module 402 may be configured to identify a target dynamic image corresponding to the target dynamic image information, and when the number of target dynamic image pictures included in the target dynamic image is greater than a first number threshold, determine a second target device corresponding to an identified dynamic image including similar dynamic image pictures of each target dynamic image picture as a mirroring device requested by the terminal device for mirroring, and the target dynamic image is recorded by the terminal device, and the similarity between the similar dynamic image pictures and each target dynamic image picture is greater than a second similarity threshold.

[0073] In the above embodiment, the target mirroring identification information may include target video information, and the device determination module 402 may be configured to identify a target video corresponding to the target video information, and when the number of target video frames included in the target video is greater than a second number threshold, determine a third target device corresponding to an identified video including similar video frames of each target video frame as a mirroring device requested by the terminal device for mirroring, and the similarity between the similar video frames and each target video frame is greater than a third similarity threshold.

[0074] In the above embodiment, the goalThe mirroring identification information may include target audio information, and the device determination module 402 may be configured to determine that a device corresponding to the identification audio, the similarity of which with the target audio corresponding to the target audio information is greater than a fourth similarity threshold, is the same device as the target device, including the first target device, the second target device, or the third target device.

[0075] Mirroring according to this embodiment Device may further include an identifier determination module configured, when receiving an identification information acquisition request transmitted from a mirroring device before receiving a mirroring request transmitted from the terminal device, to determine mirroring identification information of the mirroring device, and to transmit and display the mirroring identification information to the mirroring device so that the terminal device can acquire the mirroring identification information.

[0076] After establishing a mirroring connection with the terminal device and the mirroring device, a data acquiring module is configured to acquire mirroring data of the terminal device, and transmit the mirroring data to the mirroring device for display.

[0077] The mirroring device according to the embodiment of the present disclosure can execute the mirroring method according to any of the embodiments of the present disclosure, and has a functional module and effect corresponding to the execution of the mirroring method. For technical details not described in detail in this embodiment, please refer to the mirroring method according to any of the embodiments of the present disclosure.

[0078] Hereinafter, referring to FIG. 5, a structural schematic diagram of an electronic device (e.g., a server) 500 suitable for implementing an embodiment of the present disclosure is shown. The terminal device 500 in the embodiment of the present disclosure may include mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, personal digital assistants (PDA), tablet computers (Portable Android Devices, PAD), portable multimedia players (Portable Media Players, PMP), in-vehicle terminals (e.g., in-vehicle navigation terminals), and fixed terminals such as digital televisions (TV), desktop computers, and the like. The electronic device 500 shown in FIG. 5 is merely an example and does not impose any limitations on the functions and scope of use of the embodiment of the present disclosure.

[0079] 5, the electronic device 500 may include a processing unit (e.g., a central processor, a graphic processor, etc.) 501, which can execute various appropriate operations and processes based on a program stored in a read-only memory (ROM) 502 or loaded from a storage device 508 into a random access memory (RAM) 503. The RAM 503 further stores various programs and data necessary for the operation of the electronic device 500. The processing unit 501, the ROM 502, and the RAM 503 are connected to each other via a bus 504. An input / output (I / O) interface 505 is also connected to the bus 504.

[0080] Typically, input devices 506 including, for example, a touch panel, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc., output devices 507 including, for example, a liquid crystal display (LCD), speaker, vibrator, etc., storage devices 508 including, for example, a magnetic tape, hard disk, etc., and communication devices 509 can be connected to the I / O interface 505. The communication devices 509 enable the electronic device 500 to communicate wirelessly or wired with other devices to exchange data. Although FIG. 5 illustrates the electronic device 500 with various devices, it should be understood that it is not necessary to implement or include all the illustrated devices. Instead, more or fewer devices may be implemented or included.

[0081] According to an embodiment of the present disclosure, the process described with reference to the flowchart above may be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product including a computer program carried on a non-transitory computer-readable medium, the computer program including program code for performing the method shown in the flowchart. In such an embodiment, the computer program may be downloaded and installed from a network by the communication device 509, or may be installed from the storage device 508, or may be installed from the ROM 502. When the computer program is executed by the processing device 501, it performs the above-mentioned functions defined in the method of the embodiment of the present disclosure.

[0082] The computer readable medium described in this disclosure may be a computer readable signal medium, a computer readable storage medium, or any combination of the above. The computer readable storage medium may be, for example, but not limited to, an electrical, magnetic optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above. Further specific examples of the computer readable storage medium may include an electrical connection with one or more leads, a portable computer disk, a hard disk, a RAM, a ROM, an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this disclosure, the computer readable storage medium may be any tangible medium that contains or stores a program that can be used in or in conjunction with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, in which computer-readable program code is carried. Such propagated data signals may take various forms, including electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may be any computer-readable medium other than a computer-readable storage medium, which may transmit, propagate, or transmit a program for use in or in conjunction with an instruction execution system, apparatus, or device. The program code contained in the computer-readable medium may be transmitted by any suitable medium, including electrical wires, optical cables, radio frequency (RF), etc., or any suitable combination of the above.

[0083] In some embodiments, the clients and servers may communicate using any now known or later developed network protocol, such as HyperText Transfer Protocol (HTTP), and may interconnect with any form or medium of digital data communication (e.g., a communications network). Examples of communications networks include a Local Area Network (LAN), a Wide Area Network (WAN), a network off a network (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any now known or later developed network.

[0084] The computer-readable medium may be included in the electronic device, or may exist separately and not attached to the electronic device.

[0085] One or more programs are carried on the computer-readable medium, and when the one or more programs are executed by the electronic device, the electronic device receives a mirroring request sent from a terminal device, carrying target mirroring identification information including target image information and / or target video information, determines the mirroring device for which the terminal device has requested mirroring based on the target mirroring identification information, and establishes a mirroring connection between the terminal device and the mirroring device.

[0086] Computer program code for carrying out the operations of the present disclosure can be written in one or more programming languages ​​or combinations thereof. Such programming languages ​​include object-oriented programming languages ​​such as Java, Smalltalk, C++, and also include conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as one separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or business server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network, including a LAN or WAN, or may be connected to an external computer (e.g., connected via the Internet using an Internet Service Provider).

[0087] The flowcharts and block diagrams in the drawings illustrate possible architectures, functions, and operations of the methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowcharts or block diagrams may represent a module, program, or part of code, which includes one or more executable instructions for implementing a certain logical function. It should be noted that in some alternative implementations, the functions described in the blocks may occur in a different order than the order described in the drawings. For example, two blocks shown as connected may actually be executed substantially in parallel or in the reverse order, depending on the functionality involved. Each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts may be implemented in a system based on dedicated hardware that executes a certain function or operation, or may be implemented in a combination of dedicated hardware and computer instructions.

[0088] The units according to the embodiments of the present disclosure may be realized in a software manner or in a hardware manner. unit The names, if any, do not qualify the units themselves.

[0089] The functionality of the present disclosure may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Parts (ASSPs), System on Chip (SOCs), Complex Programmable Logic Devices (CPLDs), etc.

[0090] In the present specification, a machine-readable medium may be a tangible medium that can contain or store a program used in or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the above. Further specific examples of a machine-readable storage medium include an electrical connection by one or more wires, a portable computer disk, a hard disk, a RAM, a ROM, an EPROM, or a flash memory, a portable CD-ROM, an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0091] According to one or more embodiments of the present disclosure, Example 1 comprises: receiving a mirroring request sent from a terminal device, the mirroring request carrying target mirroring identification information, the target mirroring identification information including target image information and / or target video information; determining a mirroring device requested by the terminal device to perform mirroring based on the target mirroring identification information; establishing a mirroring connection to the terminal device and the mirroring device; A mirroring method is provided.

[0092] According to one or more embodiments of the present disclosure, Example 2 is based on the method of Example 1, wherein the target mirroring identification information includes the target image information, and the target image information includes target picture information; and determining a mirroring device requested by the terminal device to mirror based on the target mirroring identification information includes: The method includes determining a first target device corresponding to an identified picture whose similarity to a target picture corresponding to the target picture information is greater than a first similarity threshold as a mirroring device requested by the terminal device for mirroring.

[0093] According to one or more embodiments of the present disclosure, Example 3 is based on the method of Example 1, wherein the target mirroring identification information includes the target image information, and the target image information includes target dynamic image information; and determining a mirroring device that the terminal device has requested mirroring based on the target mirroring identification information includes: The method includes identifying a target dynamic image corresponding to the target dynamic image information, and when the number of target dynamic image pictures included in the target dynamic image is greater than a first number threshold, determining a second target device corresponding to the identified dynamic image including similar dynamic image pictures of each target dynamic image picture as a mirroring device requested by the terminal device, wherein the target dynamic image is recorded by the terminal device, and the similarity between the similar dynamic image pictures and each target dynamic image picture is greater than a second similarity threshold.

[0094] According to one or more embodiments of the present disclosure, Example 4 is based on the method of Example 1, wherein the target mirroring identification information includes the target video information, and determining a mirroring device requested by the terminal device to mirror based on the target mirroring identification information includes: identifying a target video corresponding to the target video information, and if the number of target video frames included in the target video is greater than a second number threshold, determining a third target device corresponding to the identified video including similar video frames of each target video frame as a mirroring device requested by the terminal device for mirroring, and the similarity between the similar video frames and each target video frame is greater than a third similarity threshold.

[0095] According to one or more embodiments of the present disclosure, Example 5 is a method according to any one of Examples 2 to 4, comprising: the goal The mirroring identification information further includes target audio information, and determining a mirroring device requested by the terminal device to mirror based on the mirroring identification information includes: The method further includes determining that a device corresponding to the identified audio, whose similarity to the target audio corresponding to the target audio information is greater than a fourth similarity threshold, is the same device as the target device, including the first target device, the second target device, or the third target device.

[0096] According to one or more embodiments of the present disclosure, Example 6 is a method according to any one of Examples 1 to 4, comprising the steps of: before receiving a mirroring request sent from the terminal device, When an identification information acquisition request sent from a mirroring device is received, the method further includes determining mirroring identification information of the mirroring device, and sending and displaying the mirroring identification information to the mirroring device so that the terminal device can acquire the mirroring identification information.

[0097] According to one or more embodiments of the present disclosure, Example 7 is based on the method according to any one of Examples 1 to 4, after establishing a mirroring connection between the terminal device and the mirroring device, The method further includes obtaining mirroring data of the terminal device, and transmitting the mirroring data to the mirroring device for display.

[0098] According to one or more embodiments of the present disclosure, Example 8 is displaying, by the mirroring device, a mirroring identifier of the device, including an identifying image and / or an identifying video; Obtaining, by a terminal device, a target mirroring identification corresponding to the mirroring identifier, generating a mirroring request carrying the target mirroring identification, and sending the mirroring request to a server; receiving the mirroring request by a server, determining the mirroring device requested by the terminal device according to the target mirroring identification information, and establishing a mirroring connection between the terminal device and the mirroring device; A mirroring method is provided.

[0099] According to one or more embodiments of the present disclosure, Example 9 is A request receiving module configured to receive a mirroring request sent from a terminal device, the mirroring request carrying a target mirroring identification information, and the target mirroring identification information including target image information and / or target video information; A device determination module configured to determine a mirroring device requested by the terminal device for mirroring based on the target mirroring identification information; a connection establishment module configured to establish a mirroring connection with the terminal device and the mirroring device; A mirroring device is provided.

[0100] According to one or more embodiments of the present disclosure, Example 10 comprises: one or more processors; a memory configured to store one or more programs; An electronic device comprising: When the one or more programs are executed by the one or more processors, the one or more processors perform the mirroring method according to any one of examples 1 to 8. Provide electronic devices.

[0101] According to one or more embodiments of the present disclosure, Example 11 provides a computer-readable storage medium having a computer program stored thereon, the computer-readable storage medium performing the mirroring method described in any one of Examples 1 to 8 when the program is executed by a processor.

[0102] Also, although operations have been described in a particular order, it should not be understood that these operations must be performed in the particular order shown, or in a forward order. In certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although the above discussion includes a number of specific implementation details, these should not be understood as limiting the scope of the disclosure. Some features described in the description of a single embodiment may be implemented in combination in a single embodiment. Conversely, various features described in the description of a single embodiment may be implemented in multiple embodiments alone or in any suitable subcombination.

Claims

1. A mirroring method applied to a server, comprising: Receiving a mirroring request sent from a terminal device, the mirroring request carrying target mirroring identification information, the target mirroring identification information including at least one of target image information and target video information, and a mirroring identifier corresponding to the target mirroring identification information including at least one of an identification image and an identification video; determining a mirroring device requested by the terminal device to perform mirroring based on the target mirroring identification information; establishing a mirroring connection to the terminal device and the mirroring device; method.

2. The target mirroring identification information includes the target image information; the target image information includes target picture information; Determining a mirroring device requested by the terminal device to perform mirroring based on the target mirroring identification information; determining a first target device corresponding to an identified picture having a similarity to a target picture corresponding to the target picture information that is greater than a first similarity threshold as a mirroring device requested by the terminal device; The method of claim 1.

3. The target mirroring identification information includes the target image information; the target image information includes target dynamic image information; Determining a mirroring device requested by the terminal device to perform mirroring based on the target mirroring identification information; identifying a target dynamic image corresponding to the target dynamic image information; and when a number of target dynamic image pictures included in the target dynamic image is greater than a first number threshold, determining a second target device corresponding to the identified dynamic image including similar dynamic image pictures of each target dynamic image picture as a mirroring device requested by the terminal device, the target dynamic image is recorded by the terminal device, and a similarity between the similar dynamic image pictures and each target dynamic image picture is greater than a second similarity threshold. The method of claim 1.

4. The target mirroring identification information includes the target video information; Determining a mirroring device requested by the terminal device to perform mirroring based on the target mirroring identification information; Identifying a target video corresponding to the target video information, when the number of target video frames included in the target video is greater than a second number threshold, determining a third target device corresponding to the identified video including similar video frames of each target video frame as a mirroring device requested by the terminal device for mirroring, and the similarity between the similar video frames and each target video frame is greater than a third similarity threshold. The method of claim 1.

5. The target mirroring identification information further includes target audio information; Determining a mirroring device requested by the terminal device to perform mirroring based on the target mirroring identification information; determining that the device corresponding to the identified audio, the similarity of which with the target audio corresponding to the target audio information is greater than a fourth similarity threshold, is the same device as the target device, including a first target device, a second target device, and a third target device; 5. The method according to any one of claims 2 to 4.

6. before receiving a mirroring request transmitted from the terminal device, When receiving an identification information acquisition request sent from a mirroring device, determining mirroring identification information of the mirroring device, and sending and displaying the mirroring identification information to the mirroring device so that the terminal device can acquire the mirroring identification information.

5. The method according to any one of claims 1 to 4.

7. After establishing a mirroring connection with the terminal device and the mirroring device, The method further includes acquiring mirroring data of the terminal device, and transmitting the mirroring data to the mirroring device for display.

5. The method according to any one of claims 1 to 4.

8. displaying, by the mirroring device, a mirroring identifier of the device including at least one of an identifying image and an identifying video; Obtaining, by a terminal device, a target mirroring identification information corresponding to the mirroring identifier, generating a mirroring request carrying the target mirroring identification information, and sending the mirroring request to a server, wherein the target mirroring identification information includes at least one of target image information and target video information; receiving the mirroring request by a server, determining the mirroring device requested by the terminal device according to the target mirroring identification information, and establishing a mirroring connection between the terminal device and the mirroring device; Including, Mirroring methods.

9. A request receiving module configured to receive a mirroring request sent from a terminal device, the mirroring request carrying target mirroring identification information, the target mirroring identification information including at least one of target image information and target video information, and a mirroring identifier corresponding to the target mirroring identification information including at least one of an identification image and an identification video; A device determination module configured to determine a mirroring device requested by the terminal device to perform mirroring based on the target mirroring identification information; a connection establishment module configured to establish a mirroring connection between the terminal device and the mirroring device; Equipped with Mirroring device.

10. The target mirroring identification information includes the target image information, and the target image information includes target picture information; The device determination module includes: determining a first target device corresponding to an identified picture having a similarity to a target picture corresponding to the target picture information that is greater than a first similarity threshold as a mirroring device requested by the terminal device; It is configured as follows:

10. The apparatus of claim 9.

11. The target mirroring identification information includes the target image information, and the target image information includes target dynamic image information; The device determination module includes: identifying a target dynamic image corresponding to the target dynamic image information; When the number of target dynamic image pictures included in the target dynamic image is greater than a first number threshold, determine a second target device corresponding to an identified dynamic image including similar dynamic image pictures of each target dynamic image picture as a mirroring device requested by the terminal device; It is structured as follows: The target dynamic image is recorded by the terminal device, and the similarity between the similar dynamic image picture and each of the target dynamic image pictures is greater than a second similarity threshold; 10. The apparatus of claim 9.

12. The target mirroring identification information includes the target video information; The device determination module includes: identifying a target video corresponding to the target video information; When the number of target video frames included in the target video is greater than a second number threshold, determine a third target device corresponding to the identified video including similar video frames of each target video frame as a mirroring device requested by the terminal device; It is structured as follows: a similarity between the similar video frame and each of the target video frames is greater than a third similarity threshold; 10. The apparatus of claim 9.

13. The target mirroring identification information further includes target audio information; The device determination module includes: determining that a device corresponding to the identified audio, the similarity of which with the target audio corresponding to the target audio information is greater than a fourth similarity threshold, is the same device as the target device, including a first target device, a second target device, or a third target device; It is configured as follows:

13. Apparatus according to any one of claims 9 to 12.

14. At least one processor; a memory configured to store at least one program; An electronic device comprising: The at least one program, when executed by the at least one processor, causes the at least one processor to implement a method according to any one of claims 1 to 4 or 8. electronic equipment.

15. A computer-readable storage medium having a computer program stored thereon, The computer program, when executed by a processor, performs the method according to any one of claims 1 to 4 or 8. A computer-readable storage medium.

Images