Video call method and device, equipment and storage medium

Abstract

The embodiment of the invention discloses a video call method and device, equipment and a storage medium, and the method can comprise the steps: obtaining video information collected by second equipment in screen projection connection with first equipment under the condition that the first equipment is in an interconnected screen projection state and starts a video call; if the privacy content exists in the video information, preprocessing the video information to obtain target video information not including the privacy content; and sending the target video information to opposite-end equipment of the video call. By implementing the method, privacy information in a video call process in a screen projection scene can be protected.

Description

Technical Field

[0001] The present application relates to the technical field of electronic equipment, and in particular to a video calling method, apparatus, device and storage medium. Background Art

[0002] Currently, users often use screen projection technology to transmit the content displayed on the source device to the screen of the destination device through wireless or wired means to improve the user's viewing experience. However, in practice, it is found that when the source device starts a video call in the screen projection state, it usually leaks privacy information such as the user's environment and other unrelated personnel. Summary of the invention

[0003] The embodiments of the present application provide a video call method, apparatus, device and storage medium, which can protect privacy information during a video call in a screen projection scenario.

[0004] A first aspect of an embodiment of the present application provides a video call method, which is applicable to a first device and includes:

[0005] When the screen is in an interconnected projection state and a video call is started, obtaining video information collected by a second device connected to the projection screen of the first device;

[0006] If the video information contains private content, pre-processing the video information to obtain target video information that does not contain the private content;

[0007] The target video information is sent to a peer device of the video call.

[0008] A second aspect of an embodiment of the present application provides a video call method, which is applicable to a second device and includes:

[0009] When the screen is projected to a first device and the first device initiates a video call, the collected video information is sent to the first device, so that when there is privacy content in the video information, the first device pre-processes the video information to obtain target video information that does not include the privacy content, and sends the target video information to the other device of the video call.

[0010] A third aspect of an embodiment of the present application provides a video call apparatus, the apparatus being in a first device, and the apparatus comprising:

[0011] An information acquisition unit, configured to acquire video information collected by a second device connected to the screen projection of the first device when the first device is in an interconnected screen projection state and a video call is started;

[0012] an information processing unit, configured to pre-process the video information if the video information contains private content, to obtain target video information that does not contain the private content;

[0013] The first information sending unit is used to send the target video information to the opposite end device of the video call.

[0014] A fourth aspect of the embodiments of the present application provides a video call apparatus, the apparatus being in a second device, and the apparatus comprising:

[0015] The second information sending unit is used to send the collected video information to the first device when the second device is connected to the first device through screen projection and the first device starts a video call, so that the first device can pre-process the video information when there is privacy content in the video information, obtain target video information that does not include the privacy content, and send the target video information to the other end device of the video call.

[0016] A fifth aspect of an embodiment of the present application provides a first device, including:

[0017] A memory storing executable program code;

[0018] and a processor coupled to the memory;

[0019] The processor calls the executable program code stored in the memory, and when the executable program code is executed by the processor, the processor implements the method described in the first aspect of the embodiment of the present application.

[0020] A sixth aspect of the embodiments of the present application provides a second device, including:

[0021] A memory storing executable program code;

[0022] and a processor coupled to the memory;

[0023] The processor calls the executable program code stored in the memory, and when the executable program code is executed by the processor, the processor implements the method described in the second aspect of the embodiment of the present application.

[0024] A seventh aspect of the embodiments of the present application provides a computer-readable storage medium having executable program code stored thereon. When the executable program code is executed by a processor, the method described in the first aspect or the second aspect of the embodiments of the present application is implemented.

[0025] An eighth aspect of the embodiments of the present application discloses a computer program product. When the computer program product runs on a computer, the computer executes the method described in the first aspect or the second aspect of the embodiments of the present application.

[0026] A ninth aspect of an embodiment of the present application discloses an application publishing platform, which is used to publish a computer program product. When the computer program product runs on a computer, the computer executes the method described in the first aspect or the second aspect of the embodiment of the present application.

[0027] It can be seen from the above technical solutions that the embodiments of the present application have the following advantages:

[0028] In an embodiment of the present application, when the first device is in an interconnected screen projection state and a video call is started, video information collected by a second device connected to the screen projection of the first device is obtained; if the video information contains private content, the video information is preprocessed to obtain target video information that does not include private content; and the target video information is sent to the other device of the video call.

[0029] By implementing this method, when the first device is in an interconnected screen projection state and a video call is started, if there is privacy content in the video information collected by the second device connected to the screen projection of the first device, the first device pre-processes the video information to obtain target video information that does not include privacy content, and sends the target video information to the other device of the video call, thereby realizing the protection of privacy information during the video call in the screen projection scenario. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments and the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application, and other drawings can be obtained based on these drawings.

[0031] Figure 1 It is a scenario diagram of the video calling method disclosed in the embodiment of the present application;

[0032] Figure 2 It is a diagram of the system architecture of the first device 10 disclosed in the embodiment of the present application;

[0033] Figure 3 It is a diagram of the system architecture of the second device 20 disclosed in the embodiment of the present application;

[0034] Figure 4 It is a flowchart of the video calling method disclosed in the embodiment of the present application;

[0035] Figure 5is another flowchart of the video calling method disclosed in the embodiment of the present application;

[0036] Figure 6 It is a flowchart illustrating the face entry disclosed in the embodiment of the present application;

[0037] Figure 7 is another illustration of the system architecture of the first device 10 disclosed in the embodiment of the present application;

[0038] Figure 8 It is another flowchart of the video calling method disclosed in the embodiment of the present application;

[0039] Fig. 9 It is another flowchart of the video calling method disclosed in the embodiment of the present application;

[0040] Fig.10 It is a structural diagram of a video call device disclosed in an embodiment of the present application;

[0041] Fig.11 is another structural diagram of the video calling device disclosed in the embodiment of the present application;

[0042] Fig.12 is a structural diagram of the first device disclosed in the embodiment of the present application;

[0043] Fig.13 It is a structural diagram of the second device disclosed in the embodiment of the present application. DETAILED DESCRIPTION

[0044] In order to make the technical personnel in the technical field better understand the scheme of the present application, the technical scheme in the embodiment of the present application will be described below in conjunction with the drawings in the embodiment of the present application. Obviously, the described embodiment is only a part of the embodiment of the present application, not all of the embodiments. Based on the embodiments in the present application, they should all fall within the scope of protection of the present application.

[0045] It should be noted that, in this application, words such as "exemplarily" or "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described as "exemplarily" or "for example" in this application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplarily" or "for example" is intended to present related concepts in a specific way.

[0046] "At least one" means one or more, and "plurality" means two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. "At least one of the following items" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b and c can mean: a, or b, or c, or a and b, or a and c, or b and c, or a, b and c, where a, b, c can be single or plural.

[0047] See also Figure 1 , Figure 1 It is a scenario diagram of the video call method disclosed in the embodiment of the present application. Figure 1 The scene diagram shown includes a first device 10 and a second device 20. The first device 10 and the second device 20 establish a screen projection connection, and the first device 10 starts a video call.

[0048] Among them, establishing a screen projection connection between the first device 10 and the second device 20 means that the first device 10 can send the display content on the display screen of the first device 10 to the second device 20, so that the second device 20 displays the display content on the display interface of the second device 20.

[0049] exist Figure 1 In the scenario shown, the video information sent by the first device 10 to the other device of the video call is collected by the second device 20. The second device 20 can be a public device (such as a TV, a car terminal, a tablet, etc.), and the users are mostly not unique. Therefore, the video information collected by the second device 20 is often more complex, which usually causes the leakage of privacy information.

[0050] At present, the problem of privacy information leakage is mostly solved by manually turning off the camera of the second device 20, which requires the user to operate on the second device 20. For example, the TV needs to be operated by a remote control, which is not convenient enough; for example, the car terminal requires the driver to operate, which affects driving safety.

[0051] In the technical solution of the present application, if there is private content in the video information sent by the second device 20, the first device 10 pre-processes the video information to obtain target video information that does not include private content, and sends the target video information to the peer device of the video call. It can be seen that the pre-processing of the video information by the first device 10 can eliminate the private content on it, which not only realizes the protection of private information during the video call in the screen projection scenario, but also overcomes the defects of manually turning on and off the camera of the second device 20.

[0052] Among them, the first device 10 may include a general handheld screen electronic device, such as a mobile phone, a smart phone, a portable terminal, a terminal, a personal digital assistant (PDA), a portable multimedia player (Personal Media Player, PMP) device, a laptop computer, a notebook (Note Pad), a wireless broadband (Wireless Broadband, Wibro) terminal, a tablet computer (Personal Computer, PC), a smart PC, a sales terminal (Point of Sales, POS) and a car computer, etc.

[0053] The first device 10 may also include a wearable device. A wearable device is a portable electronic device that can be worn directly on the user, or integrated into the user's clothes or accessories. Wearable devices are not only hardware devices, but can also realize powerful intelligent functions through software support, data interaction, and cloud server interaction, such as: computing function, positioning function, and alarm function. At the same time, they can also connect to mobile phones and various terminals. Wearable devices may include but are not limited to watches supported by wrists (such as watches, wrists, etc.), shoes supported by feet (such as shoes, socks or other products worn on the legs), glasses supported by the head (such as glasses, helmets, headbands, etc.), and various non-mainstream product forms such as smart clothing, school bags, crutches, accessories, etc.

[0054] It should be noted that, for the explanation of the second device 20, reference can be made to the above explanation of the electronic device 10, which will not be repeated here.

[0055] Combine the following Figure 2-Figure 3 , the system architecture of the first device 10 and the second device 20 is described:

[0056] See also Figure 2 , Figure 2 is a diagram of the system architecture of the first device 10. Figure 2As shown, the first device 10 includes a video call application 210, a device interconnection application 220, a device virtualization service 230, a screen projection service 240, a camera service 250, and a virtual screen 260. Among them, the video call application 210 is in the application layer, and the camera service 250 and the virtual screen 260 are in the Android framework layer.

[0057] The video call application 210 is used to send or receive video call requests. The device interconnection application 220 includes a device interconnection module 2201 and a privacy protection module 2202. The device interconnection module 2201 is used to implement trusted connections, data transmission channels, and screen projection based on near-field transmission protocols such as BT (BitTorrent), Bluetooth (BLE, Bluetooth Low Energy, BLE), WIFI-P2P (Wi-Fi Peer-to-Peer), and Universal Serial Bus (USB). The privacy protection module 2202 is used to process video information.

[0058] The device virtualization service 230 is used to implement virtualization of the hardware devices of the second device 20, for example, virtualizing the hardware devices such as the camera and microphone on the second device 20 as local devices of the first device 10 for use.

[0059] The screen projection service 240 is used to draw the projection content of the first device onto the virtual screen 260, and project the virtual screen 260 onto the screen of the second device 20 for display.

[0060] The video service 250 is used to receive and forward video information.

[0061] See also Figure 3 , Figure 3 is a diagram of the system architecture of the second device 20. Figure 3 The second device 20 shown includes a device interconnection application 310, a device virtualization service 320, a screen projection service 330, a camera service 340, and a virtual screen 350. Among them, the camera service 340 and the virtual screen 350 are in the system layer.

[0062] Among them, the device interconnection application 310 includes a device interconnection module 3101. For explanations of the device interconnection module 3101, the device virtualization service 320, the screen projection service 330, the camera service 340, and the virtual screen 350, please refer to the system architecture description for the first device, which will not be repeated here.

[0063] The technical solution of the present application is further described below in conjunction with specific embodiments.

[0064] See also Figure 4 , Figure 4 This is a flowchart of the video call method disclosed in the embodiment of the present application. Figure 4 The video calling method shown may include the following steps:

[0065] 401. When the first device is in an interconnected screen projection state and a video call is started, the second device sends the collected video information to the first device.

[0066] The first device and the second device are connected to each other through screen projection, and there is a screen projection channel between the first device and the second device. The second device can send video information to the first device through the screen projection channel. The video information can be collected by the second device through the camera device of the second device.

[0067] 402. If the video information contains private content, the first device pre-processes the video information to obtain target video information that does not contain private content.

[0068] In some embodiments, the private content may include, but is not limited to, at least one of the following: non-specified human faces, non-head body parts, and environmental backgrounds.

[0069] The non-specified face refers to a face that does not match the specified face, and the specified face refers to a face pre-stored in the first device. Exemplarily, the specified face includes the face of the user of the first device.

[0070] The non-head body part may include a non-head body part of a designated user and / or a non-head body part of a non-designated user. Exemplarily, the designated user may be the first device owner.

[0071] When receiving the video information, the first device can determine whether the video information contains private content.

[0072] In some embodiments, the first device determines whether the video information contains private content by analyzing the video information, or by analyzing the video information sent by the second device, which is not limited in the embodiments of the present application.

[0073] In some embodiments, when the first device receives the video information, it determines whether the video information contains private content, which may include: when the first device receives the video information, it detects whether the privacy protection function is turned on; if the privacy protection function is turned on, it determines whether the video information contains private content.

[0074] It is understandable that if the first device does not have the privacy protection function enabled, the video information can be directly sent to the other device of the video call.

[0075] The first device may enable the privacy protection function when detecting a privacy protection enabling operation, wherein the privacy protection enabling operation may include but is not limited to at least one of the following: a voice operation, a gesture operation, and a touch operation.

[0076] In some embodiments, when the first device is in the interconnected screen projection state, if a video call request is received, the first device can detect whether the privacy protection function is turned on, and if the privacy protection function is not turned on, output a prompt message for turning on the privacy protection function. The prompt message may include at least one of the following: voice, text, and animation.

[0077] By implementing this method, when the first device is in an interconnected screen projection state, the first device can detect whether the privacy protection function of the first device is turned on or not when receiving a video call request, and when the privacy protection function is not turned on, output a prompt message for turning on the privacy protection function, so as to be used to turn on the privacy protection function in time.

[0078] In some embodiments, the first device pre-processes the video information to obtain target video information that does not include private content, which may include but is not limited to:

[0079] The first device performs mosaic processing on the private content in the video information to obtain the target video information;

[0080] or,

[0081] The first device performs blurring processing on the private content in the video information to obtain the target video information;

[0082] or,

[0083] The first device uses the designated video information as the target video information.

[0084] The specified video information may include but is not limited to any of the following:

[0085] The previous frame of video information that does not contain private content can enhance the continuity of the picture during the video call;

[0086] The pre-set screen may include a user image of the first device, a blank screen, a landscape screen or an animation frame, etc., which is not limited in the embodiments of the present application.

[0087] In some embodiments, when the private content includes non-specified faces, the first device may also replace the non-specified faces in the video information with a specified avatar to obtain the target video information. The specified avatar may be a cartoon avatar or the like.

[0088] 403. The first device sends target video information to the other end device of the video call.

[0089] In some embodiments, the first device preprocesses the video information to obtain target video information that does not include privacy content, which may include: a privacy protection module of a device interconnection application of the first device preprocesses the video information to obtain target video information that does not include privacy content, and sends the target video information to the camera service of the first device.

[0090] Based on this, the first device sending the target video information to the other end device of the video call may include:

[0091] The camera service of the first device sends the target video information to the video call application, and the video call application sends the target video information to the other end device of the video call.

[0092] By implementing the above method, when the first device is in an interconnected screen projection state and a video call is started, if there is privacy content in the video information collected by the second device connected to the screen projection of the first device, the first device pre-processes the video information to obtain target video information that does not include privacy content, and sends the target video information to the other device of the video call, thereby realizing the protection of privacy information during the video call in the screen projection scenario.

[0093] See also Figure 5 , Figure 5 FIG. 1 is another flowchart of the video call method disclosed in the embodiment of the present application. Figure 5 The video calling method shown may include the following steps:

[0094] 501. When the first device is in an interconnected screen projection state and a video call is started, the second device sends the collected video information to the first device.

[0095] For a detailed introduction to step 501, please refer to the explanation to step 401, which will not be repeated here.

[0096] 502. The first device analyzes the video information to determine whether there is privacy content in the video information.

[0097] In some embodiments, the private content includes non-specified faces, which can protect other users' information during the video call. The first device analyzes the video information to determine whether there is private content in the video information, which may include:

[0098] The first device recognizes a face in the video information;

[0099] If the video information includes a non-specified face, the first device determines that there is privacy content in the video information;

[0100] If the video information does not include a non-specified face, the first device determines that there is no privacy content in the video information.

[0101] The first device recognizes a face in the video information, which may include:

[0102] The first device extracts facial features of a face in the video information;

[0103] The first device matches the facial features of the face in the video information with the facial features of the designated face;

[0104] When there is a face in the video information whose facial features are not successfully matched with the designated face, the first device determines if the video information includes a non-designated face;

[0105] When there is no face in the video information whose facial features are not successfully matched with the designated face, the first device determines that the video information does not include a non-designated face.

[0106] Among them, successfully matching the facial features of the designated face may mean that the similarity between the facial features of the face in the video information and the facial features of the designated face is greater than the similarity threshold; and unsuccessfully matching the facial features of the designated face may mean that the similarity between the facial features of the face in the video information and the facial features of the designated face is less than or equal to the similarity threshold. Exemplarily, the similarity threshold is 80%, 85%, 90%, or 95%, etc.

[0107] It is understandable that the first device can support face entry. Specifically, the first device captures a specified face and extracts facial features of the specified face for storage.

[0108] In some embodiments, the first device may store the facial features of the specified face in a privacy protection application. The privacy protection application is a trusted application that runs in a trusted execution environment (TEE). The privacy protection application can only interact with the device interconnection application of the first device, and other applications have no permission to access it, which can effectively prevent malicious third-party applications from extracting the facial features of the specified face.

[0109] Among them, TEE is a secure area that exists in the first device and is separated from the Rich Execution Environment (REE). The specific implementation can be a security mode of the main processor or a coprocessor isolated from the main processor. TEE can provide basic security functions, including secure storage, secure boot, isolation mechanism, etc. REE is a non-secure area that exists in the first device and is used to run common operating systems such as Android, iOS, Linux, etc., and provides all the functions of the device to upper-level applications and is separated from TEE.

[0110] The first device may perform a face recording operation when detecting the privacy protection opening operation. For the specific face recording process, please refer to Figure 6 ,like Figure 6 The following steps may be included:

[0111] 610. The first device detects a privacy protection activation operation.

[0112] 611. The first device detects whether the specified face is recorded. If so, execute step 615; if not, continue to execute steps 612-615.

[0113] 612. The first device collects a facial image.

[0114] 613. The first device extracts facial features of the facial image.

[0115] 614. The first device encrypts the facial features and stores the encrypted facial features in a privacy protection application.

[0116] 615. The first device starts the privacy protection function.

[0117] Based on the above description, another diagram of the system architecture of the first device can be seen below Figure 7 .like Figure 7 The first device shown includes Figure 2 In addition to the content shown, it also includes a privacy protection application 270 running in a trusted execution environment TEE, and the device interconnection application 220 can also include a face entry module 2203 and a face detection module 2204 for implementing face entry.

[0118] Among them, the face entry module 2203 is used to collect the specified face; the face detection module 2204 is used to extract the facial features of the specified face and send them to the privacy protection application 270, and the privacy protection application 270 is used to receive the facial features of the specified face.

[0119] In some embodiments, the face detection module 2204 is further used to detect faces in the video information, extract facial features of faces in the video information, and send the facial features of faces in the video information to the privacy protection application 270. The privacy protection application 270 is further used to match the facial features of faces in the video information with the facial features of a specified face, and send the matching results to the privacy protection module 2202.

[0120] In some embodiments, the private content includes body parts other than the head, which can prevent the disclosure of more information about the user. The first device analyzes the video information to determine whether there is private content in the video information, which may include:

[0121] If the video information includes a body part other than the head, the first device determines that there is private content in the video information;

[0122] If the video information does not include any body parts other than the head, the first device determines that there is no privacy content in the video information.

[0123] 503. If the video information contains private content, the first device pre-processes the video information to obtain target video information that does not contain private content.

[0124] In some embodiments, when the private content includes non-specified faces, if the non-specified faces exist in the video information and the first device receives a notification message from at least one application of the first device, the first device is prohibited from projecting the notification message to the second device.

[0125] In some embodiments, the notification message of the at least one application mentioned above may include a notification message of any application (such as text messages, real-time news messages of news applications, real-time activity messages of shopping applications, chat messages of social applications, etc.).

[0126] In some embodiments, the notification message of the at least one application mentioned above may include a notification message of a specified application (such as a notification message of a banking application, a chat message of a social application, etc.).

[0127] It is understandable that if there is no non-specified face in the video information, the first device will project the above notification message of the first device to the second device.

[0128] By implementing this method, if there is a non-specified face in the video information, the first device is prohibited from projecting the notification message received from at least one application of the first device to the second device. The notification message is only displayed on the first device to achieve the purpose of hiding the notification message, and the user's privacy can be actively protected in the screen projection scenario.

[0129] 504. The first device sends target video information to the other end device of the video call.

[0130] For a detailed description of step 503 - step 504 , please refer to the description of step 402 - step 403 above, which will not be repeated here.

[0131] By implementing the above method, when the first device is in an interconnected screen projection state and a video call is started, the second device directly sends the collected video information to the first device. The first device analyzes the video information to determine whether there is privacy content in the video information. If there is privacy content, the video information is pre-processed to obtain target video information that does not contain privacy content, and the target video information is sent to the other device of the video call. This not only achieves privacy protection during the video call in the screen projection scenario, but also reduces data interaction between the first device and the second device, avoiding affecting the normal screen projection between the first device and the second device.

[0132] Exemplarily, the designated face is the face of the user of the first device, and the private content is the faces of other users.

[0133] Combine the following Figure 8 The following describes the video call method in this example scenario:

[0134] 810. The first device receives a video call request through a video call application.

[0135] 811. The first device projects the video call screen to the second device.

[0136] 812. The second device displays the video call screen.

[0137] 813. The second device collects video information.

[0138] 814. The second device sends the video information to the first device.

[0139] 815. The first device detects whether the privacy protection function is turned on. If it is turned on, continue to execute step 816. If not, execute steps 821-822.

[0140] 816. The first device identifies whether there is a face in the video information. If so, continue to step 817; if not, execute steps 821-822.

[0141] 817. The first device extracts facial features of the face in the video information.

[0142] 818. The first device matches the facial features of the face in the video information with the facial features of the user of the first device to determine whether there are faces of other users in the video information. If so, execute step 819; if not, execute steps 821-822.

[0143] 819. The first device blurs the body areas of other users in the video information.

[0144] 820. The first device determines whether the processed video information contains content other than the user of the first device. If so, continue to execute step 817; if not, execute steps 821-822.

[0145] 821. The first device sends the processed video information / unprocessed video information to the video call application through the camera service.

[0146] 822. The first device sends processed video information / unprocessed video information to a peer device of the video call through a video call application.

[0147] It should be noted that when the judgment results of step 815, step 816, and step 818 are negative, step 821 and step 822 are both directed to unprocessed video information.

[0148] See also Fig. 9 , Fig. 9 FIG. 1 is another flowchart of the video call method disclosed in the embodiment of the present application. Fig. 9 The video calling method shown may include the following steps:

[0149] 901. When the first device is in an interconnected screen projection state and a video call is started, the second device analyzes the video information to obtain privacy indication information.

[0150] The privacy indication information may include first indication information indicating the existence of private content, or second indication information indicating the absence of private content. When the privacy indication information includes the first indication information, the privacy indication information may also include third indication information indicating the area where the private content is located.

[0151] In some embodiments, the second device analyzing the video information to obtain the privacy indication information may include:

[0152] The second device analyzes the video information according to the designated privacy information to obtain the privacy indication information; wherein the designated privacy information includes the type of the private content, and the designated privacy information is sent by the first device.

[0153] Among them, the first device can support setting operations on the type of private content, and the user of the first device can flexibly set the type of private content according to user needs.

[0154] When the type of the private content includes the non-specified face, the specified private information may further include the facial features of the specified face.

[0155] The first device sending the facial features of a specified face to the second device may include:

[0156] The first device identifies whether the second device is a designated device;

[0157] When the second device is a designated device, the first device sends facial features of the designated face to the second device.

[0158] The specified device may include at least one of the following:

[0159] A device that has been connected to the first device for screen projection more than the threshold number of times;

[0160] The corresponding user is the same device as the user of the first device.

[0161] The device identification of the designated device may be pre-stored on the first device, and the first device determines whether the device identification of the second device matches the device identification of the designated device. If so, the second device is the designated device, otherwise, the second device is not the designated device. The device identification is used to uniquely identify a device, and the device identification may include but is not limited to at least one of the following: numbers, letters, and special characters. By implementing this method, the first device only sends the facial features of the designated face to the designated device, which can effectively prevent the facial features of the designated face from being leaked.

[0162] The way in which the second device analyzes the video information can refer to the way in which the first device analyzes the video information, which will not be described again here.

[0163] 902. The second device sends privacy indication information to the first device.

[0164] 903. The first device determines whether there is privacy content in the video information according to the privacy indication information.

[0165] The first device determining, according to the privacy indication information, whether there is privacy content in the video information may include:

[0166] When the first device receives the first indication information, it determines that there is private content in the video information;

[0167] When receiving the second indication information, the first device determines that there is no private content in the video information.

[0168] 904. If the video information contains private content, the first device pre-processes the video information to obtain target video information that does not contain private content.

[0169] In some embodiments, when the privacy indication information includes the first indication information, the privacy indication information may further include third indication information indicating the area where the private content is located, and the first device pre-processes the video information to obtain the target video information that does not include the private content, which may include:

[0170] The first device pre-processes the video information according to the third indication information to obtain target video information that does not include private content.

[0171] 905. The first device sends target video information to the other end device of the video call.

[0172] For a detailed description of step 905, please refer to the description of step 403 above, which will not be repeated here.

[0173] By implementing the above method, when the first device is in an interconnected screen projection state and a video call is started, the second device can analyze the collected video information to obtain privacy indication information, and send the privacy indication information to the first device. The first device determines whether there is privacy content in the video information based on the privacy indication information, and when there is privacy content in the video information, pre-processes the video information to obtain target video information without privacy content, and sends the target video information to the other device of the video call. This not only achieves privacy protection during the video call in the screen projection scenario, but also reduces the device power consumption of the first device.

[0174] See also Fig.10 , Fig.10 Schematic diagram of a video call device disclosed in an embodiment of the present application. Fig.10 The video calling device shown may be located on a first device, such as Fig.10 The video call device shown may include: an information acquisition unit 1001, an information processing unit 1002 and a first information sending unit 1003; wherein:

[0175] The information acquisition unit 1001 is used to acquire video information collected by a second device connected to the first device for screen projection when the first device is in an interconnected screen projection state and a video call is started;

[0176] The information processing unit 1002 is used to pre-process the video information if the video information contains private content, so as to obtain target video information that does not contain private content;

[0177] The first information sending unit 1003 is used to send target video information to the other end device of the video call.

[0178] In some embodiments, Fig.10 The video call device shown may also include a first information analysis unit ( Fig.10 (not shown), a first information analysis unit, configured to analyze the video information to determine whether there is privacy content in the video information.

[0179] In some embodiments, the first information analysis unit is used to analyze the video information to determine whether there is privacy content in the video information, which may specifically include:

[0180] The first information analysis unit is used to identify faces in the video information; and if the video information includes a non-specified face, it is determined that there is privacy content in the video information, and the non-specified face refers to a face that does not match the specified face.

[0181] In some embodiments, the first information analysis unit is used to analyze the video information to determine whether there is privacy content in the video information, which may specifically include:

[0182] The first information analysis unit is used to determine that there is privacy content in the video information if the video information includes a body part other than the head, where the body part other than the head refers to a body part other than the head.

[0183] In some embodiments, Fig.10 The video call device shown may also include a notification message unit ( Fig.10 (not shown), a notification message unit is used to prohibit screen projection of the notification message to the second device if the video information contains private content and a notification message from at least one application of the first device is received.

[0184] In some embodiments, the first information analysis unit is further used to receive privacy indication information for video information sent by the second device, where the privacy indication information is obtained by the second device by analyzing the video information; and, based on the privacy indication information, determine whether there is privacy content in the video information.

[0185] In some embodiments, Fig.10 The video call device shown may also include a third information sending unit ( Fig.10 (not shown), a third information sending unit is used to send specified privacy information to the second device before the first information analysis unit receives the privacy indication information for the video information sent by the second device, so that the second device analyzes the video information according to the specified privacy information; wherein the specified privacy information includes the type of privacy content.

[0186] In some embodiments, when the private content includes a non-specified face, the specified private information includes facial features of the specified face; the manner in which the third information sending unit sends the facial features of the specified face to the second device may specifically include:

[0187] The third information sending unit is used to identify whether the second device is a designated device; and when the second device is a designated device, send facial features of the designated face to the second device.

[0188] In some embodiments, the information processing unit 1002 is used to pre-process the video information, and the method of obtaining the target video information that does not include the private content may specifically include:

[0189] The information processing unit 1002 is used to perform mosaic processing on the private content in the video information to obtain the target video information;

[0190] or,

[0191] The information processing unit 1002 is used to use the designated video information as the target video information.

[0192] In some embodiments, the designated video information includes a previous frame of video information that does not contain private content.

[0193] In some embodiments, the information processing unit 1002 is used to pre-process the video information, and the method of obtaining the target video information that does not include privacy content may specifically include: the information processing unit 1002 is used to replace the non-specified faces in the video information with the specified avatar to obtain the target video information.

[0194] In some embodiments, the first information analysis unit is also used to detect whether the privacy protection function is turned on before the information processing unit 1002 pre-processes the video information to obtain the target video information that does not include the privacy content if the video information contains privacy content; and, if the privacy protection function is turned on, determine whether there is privacy content in the video information.

[0195] See also Fig.11 , Fig.11 FIG. 1 is another structural diagram of the video call device disclosed in the embodiment of the present application. Fig.11 The video call device shown may be located on a second device, such as Fig.11 The video call device shown may include: a second information sending unit 1101;

[0196] Among them, the second information sending unit 1101 is used to send the collected video information to the first device when the second device is connected to the first device through screen projection and the first device starts a video call, so that the first device can pre-process the video information when there is privacy content in the video information, obtain target video information that does not include privacy content, and send the target video information to the other device of the video call.

[0197] In some embodiments, Fig.11 The video calling device shown may also include a second information analysis unit ( Fig.11 (not shown), a second information analysis unit, configured to analyze the video information to obtain privacy indication information; and send the privacy indication information to the first device, so that the first device determines whether there is privacy content in the video information according to the privacy indication information.

[0198] In some embodiments, the method in which the second information analysis unit is used to analyze video information to obtain privacy indication information may specifically include: the second information analysis unit is used to analyze video information according to specified privacy information to obtain privacy indication information; wherein the specified privacy information includes the type of privacy content, and the specified privacy information is sent by the first device.

[0199] See also Fig.12 , Fig.12 is a structural diagram of the first device disclosed in the embodiment of the present application. Fig.12 The first device shown may include: a processor 1210, a memory 1220, a display unit 1230, an input unit 1240, a sensor 1250, an audio circuit 1260 and other components.

[0200] The processor 1210 is the control center of the first device, and uses various interfaces and lines to connect various parts of the entire first device, and executes various functions of the first device and processes data by running or executing software programs and / or modules stored in the memory 1220, and calling data stored in the memory 1220, so as to monitor the first device as a whole. Optionally, the processor 1210 may include one or more processing units; optionally, the processor 1210 may integrate an application processor, and the application processor mainly processes operating devices, user interfaces, and application programs, etc. Of course, other processors may also be included, which are not listed here one by one.

[0201] The memory 1220 can be used to store software programs and modules. The processor 1210 executes various functional applications and data processing of the first device by running the software programs and modules stored in the memory 1220. The memory 1220 may mainly include a program storage area and a data storage area, wherein the program storage area may store operating means, at least one application required for a function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area may store data created according to the use of the first device (such as audio data, a phone book, etc.), etc. In addition, the memory 1220 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.

[0202] The display unit 1230 can be used to display information input by the user or information provided to the user and various menus of the first device. The display unit 1230 may include a display panel. Optionally, the display panel may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), etc. Further, the touch panel may cover the display panel. When the touch panel detects a touch operation on or near it, it is transmitted to the processor 1210 to determine the type of touch event. Then, the processor 1210 provides a corresponding visual output on the display panel according to the type of touch event. Among them, the touch panel and the display panel are not in Fig.12 The touch panel and the display panel can be used as two independent components to implement the input and output functions of the first device, or the touch panel and the display panel can be integrated to implement the input and output functions of the first device.

[0203] The input unit 1240 can be used to receive input digital or character information, and to generate key signal input related to the user settings and function control of the first device. Specifically, the input unit 1240 may include a touch panel and other input devices. A touch panel, also known as a touch screen, can collect user touch operations on or near it (such as operations performed by a user using any suitable object or accessory such as a finger, stylus, etc. on or near the touch panel), and drive the corresponding connection device according to a pre-set program. In addition, a variety of types such as resistive, capacitive, infrared, and surface acoustic waves can be used to implement the touch panel. In addition to the touch panel, the input unit 1240 may also include other input devices. Specifically, other input devices may include, but are not limited to, one or more of function keys (such as volume control keys, switch keys, etc.), trackballs, joysticks, etc.

[0204] The first device may also include at least one sensor 1250, such as a magnetometer, a gyroscope sensor, a motion sensor, and other sensors. Specifically, the magnetometer is used to determine the orientation of the first device, and the gyroscope sensor can be used to determine the motion posture of the first device, which can be used for anti-shake shooting, navigation, and somatosensory game scenes. As a type of motion sensor, the accelerometer can detect the magnitude of acceleration in all directions, and can detect the magnitude and direction of gravity when stationary. It can be used for applications that identify the posture of the first device, such as horizontal and vertical screen switching, related games, magnetometer posture calibration, etc.; as for other sensors that can also be configured with the first device, such as pressure gauges, barometers, hygrometers, thermometers, infrared sensors, etc., they will not be repeated here.

[0205] The audio circuit 1260 may include a speaker and a microphone, and may provide an audio interface between the user and the first device. The audio circuit 1260 may transmit the electrical signal converted from the received audio data to the speaker, which is converted into a sound signal for output; on the other hand, the microphone converts the collected sound signal into an electrical signal, which is received by the audio circuit 1260 and converted into audio data, and then the audio data is output to the processor 1210 for processing, and then sent to another device through the video circuit, or the audio data is output to the memory 1220 for further processing.

[0206] Although not shown, the first device may further include a power supply and a camera. Optionally, the camera may be located at the front or rear of the first device, which is not limited in the embodiment of the present application.

[0207] It is understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the first device. In other embodiments of the present application, the first device may include more or fewer components than shown in the figure, or combine certain components, or split certain components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0208] In the embodiment of the present application, the processor 1210 also has the following functions:

[0209] When the screen is in the interconnected projection state and a video call is started, video information collected by a second device connected to the first device for projection is obtained;

[0210] If the video information contains private content, the video information is preprocessed to obtain target video information that does not contain private content;

[0211] Send the target video information to the other end device of the video call.

[0212] In the embodiment of the present application, the processor 1210 also has the following functions:

[0213] Analyze the video information to determine whether there is any privacy content in the video information.

[0214] In the embodiment of the present application, the processor 1210 also has the following functions:

[0215] Recognize faces in video information;

[0216] If the video information includes a non-specified face, it is determined that there is privacy content in the video information, and the non-specified face refers to a face that does not match the specified face.

[0217] In the embodiment of the present application, the processor 1210 also has the following functions:

[0218] If the video information includes a body part other than the head, it is determined that there is privacy content in the video information, and the body part other than the head refers to a body part other than the head.

[0219] In the embodiment of the present application, the processor 1210 also has the following functions:

[0220] If the video information contains private content and a notification message from at least one application of the first device is received, it is prohibited to project the notification message to the second device.

[0221] In the embodiment of the present application, the processor 1210 also has the following functions:

[0222] receiving privacy indication information for the video information sent by the second device, where the privacy indication information is obtained by the second device by analyzing the video information;

[0223] According to the privacy indication information, it is determined whether there is privacy content in the video information.

[0224] In the embodiment of the present application, the processor 1210 also has the following functions:

[0225] The designated private information is sent to the second device so that the second device analyzes the video information according to the designated private information; wherein the designated private information includes the type of private content.

[0226] In the embodiment of the present application, when the private content includes a non-specified face, the specified private information includes facial features of the specified face; the processor 1210 further has the following functions:

[0227] identifying whether the second device is a designated device;

[0228] When the second device is a designated device, facial features of the designated face are sent to the second device.

[0229] In the embodiment of the present application, the processor 1210 also has the following functions:

[0230] Mosaic processing is performed on the private content in the video information to obtain the target video information;

[0231] or,

[0232] Set the specified video information as the target video information.

[0233] In the embodiment of the present application, the designated video information includes the previous frame of video information that does not contain private content.

[0234] In the embodiment of the present application, the processor 1210 also has the following functions:

[0235] Replace the non-specified faces in the video information with the specified avatar to obtain the target video information.

[0236] In the embodiment of the present application, the processor 1210 also has the following functions:

[0237] Check whether the privacy protection function is turned on;

[0238] If the privacy protection function is turned on, determine whether there is any privacy content in the video information.

[0239] See also Fig.13 , Fig.13 is a structural diagram of the second device disclosed in the embodiment of the present application. Fig.13 The second device shown may include: a processor 1310 , a memory 1320 , a display unit 1330 , an input unit 1340 , a sensor 1350 , an audio circuit 1360 , and other components.

[0240] It should be noted that the explanation of components such as the processor 1310, the memory 1320, the display unit 1330, the input unit 1340, the sensor 1350, the audio circuit 1360 can be found in the above description of the first device, and will not be repeated here.

[0241] In the embodiment of the present application, the processor 1310 also has the following functions:

[0242] When the screen projection is connected to the first device and the first device starts a video call, the collected video information is sent to the first device, so that when there is privacy content in the video information, the first device pre-processes the video information to obtain target video information that does not include privacy content, and sends the target video information to the other device of the video call.

[0243] In the embodiment of the present application, the processor 1310 also has the following functions:

[0244] Analyzing the video information to obtain privacy indication information;

[0245] The privacy indication information is sent to the first device, so that the first device determines whether there is privacy content in the video information according to the privacy indication information.

[0246] In the embodiment of the present application, the processor 1310 also has the following functions:

[0247] The video information is analyzed according to the designated privacy information to obtain the privacy indication information; wherein the designated privacy information includes the type of the privacy content, and the designated privacy information is sent by the first device.

[0248] An embodiment of the present application discloses a computer-readable storage medium having executable program code stored thereon. When the executable program code is executed by a processor, the method described in the first device of the embodiment of the present application is implemented.

[0249] An embodiment of the present application discloses another computer-readable storage medium having executable program code stored thereon. When the executable program code is executed by a processor, the method described in the second device of the embodiment of the present application is implemented.

[0250] The embodiment of the present application discloses a computer program product. When the computer program product is executed on a computer, the computer implements the method described in the first device of the embodiment of the present application.

[0251] The embodiment of the present application discloses another computer program product. When the computer program product is executed on a computer, the computer implements the method described in the second device of the embodiment of the present application.

[0252] An embodiment of the present application discloses an application publishing platform, which is used to publish a computer program product. When the computer program product runs on a computer, the computer implements the method described in the first device in the embodiment of the present application.

[0253] An embodiment of the present application discloses another application publishing platform, which is used to publish a computer program product. When the computer program product runs on a computer, the computer implements the method described in the second device in the embodiment of the present application.

[0254] It should be noted here that the description of the above storage medium and device embodiments is similar to the description of the above method embodiments, and has similar beneficial effects as the method embodiments. For technical details not disclosed in the storage medium, storage medium and device embodiments of this application, please refer to the description of the method embodiments of this application for understanding.

[0255] It should be understood that "one embodiment" or "an embodiment" or "some embodiments" mentioned throughout the specification means that specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, "in one embodiment" or "in one embodiment" or "in some embodiments" appearing throughout the specification may not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in various embodiments of the present application, the size of the sequence number of the above-mentioned processes does not mean the order of execution, and the execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present application. The above-mentioned sequence numbers of the embodiments of the present application are only for description and do not represent the advantages and disadvantages of the embodiments. The above description of each embodiment tends to emphasize the differences between the various embodiments, and the same or similarities can be referenced to each other. For the sake of brevity, this article will not repeat them.

[0256] The term "and / or" in this article is only a description of the association relationship of associated objects, indicating that there may be three relationships. For example, object A and / or object B can represent three situations: object A exists alone, object A and object B exist at the same time, and object B exists alone.

[0257] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0258] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. The embodiments described above are only schematic. For example, the division of the modules is only a logical function division. There may be other division methods in actual implementation, such as: multiple modules or components can be combined, or can be integrated into another system, or some features can be ignored, or not executed. In addition, the coupling, direct coupling, or communication connection between the components shown or discussed can be through some interfaces, and the indirect coupling or communication connection of devices or modules can be electrical, mechanical or other forms.

[0259] The modules described above as separate components may or may not be physically separated, and the components displayed as modules may or may not be physical modules; they may be located in one place or distributed on multiple network units; some or all of the modules may be selected according to actual needs to achieve the purpose of the present embodiment.

[0260] In addition, all functional modules in the embodiments of the present application may be integrated into one processing unit, or each module may be a separate unit, or two or more modules may be integrated into one unit; the above-mentioned integrated modules may be implemented in the form of hardware or in the form of hardware plus software functional units.

[0261] A person skilled in the art can understand that all or part of the steps of implementing the above method embodiment can be completed by hardware related to program instructions, and the aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it executes the steps of the above method embodiment; and the aforementioned storage medium includes: mobile storage devices, read-only memories (ROM), magnetic disks or optical disks, etc., various media that can store program codes.

[0262] Alternatively, if the above-mentioned integrated unit of the present application is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application can essentially or in other words, the part that contributes to the relevant technology can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for enabling an electronic device to execute all or part of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as mobile storage devices, ROMs, magnetic disks, or optical disks.

[0263] The methods disclosed in several method embodiments provided in this application can be arbitrarily combined without conflict to obtain new method embodiments.

[0264] The features disclosed in several product embodiments provided in this application can be arbitrarily combined without conflict to obtain new product embodiments.

[0265] The features disclosed in several method or device embodiments provided in this application can be arbitrarily combined without conflict to obtain new method embodiments or device embodiments.

[0266] The above is only an implementation method of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A video calling method, characterized in that: The method is applicable to a first device, comprising: When the screen is in an interconnected projection state and a video call is started, obtaining video information collected by a second device connected to the projection screen of the first device; If the video information contains private content, pre-processing the video information to obtain target video information that does not contain the private content; The target video information is sent to a peer device of the video call.

2. The method according to claim 1, characterized in that After obtaining the video information collected by the second device connected to the first device for screen projection, the method further includes: The video information is analyzed to determine whether there is any privacy content in the video information.

3. The method according to claim 2, characterized in that The analyzing the video information to determine whether there is privacy content in the video information includes: Recognizing faces in the video information; If the video information includes a non-specified face, it is determined that there is privacy content in the video information, and the non-specified face refers to a face that does not match the designated face.

4. The method according to claim 2, characterized in that: The analyzing the video information to determine whether there is privacy content in the video information includes: If the video information includes a body part other than the head, it is determined that there is privacy content in the video information, and the body part other than the head refers to a body part other than the head.

5. The method according to claim 3, characterized in that: The method further comprises: If the video information contains private content and a notification message from at least one application of the first device is received, it is prohibited to project the notification message to the second device.

6. The method according to claim 1, characterized in that If the video information contains private content, the method further includes: receiving privacy indication information for the video information sent by the second device, where the privacy indication information is obtained by the second device by analyzing the video information; It is determined whether there is any privacy content in the video information according to the privacy indication information.

7. The method according to claim 6, characterized in that Before receiving the privacy indication information for the video information sent by the second device, the method further includes: Sending designated private information to the second device so that the second device analyzes the video information according to the designated private information; wherein the designated private information includes a type of private content.

8. The method according to claim 7, characterized in that When the private content includes a non-specified face, the specified private information includes facial features of the specified face; Wherein, sending the facial features of the designated face to the second device includes: identifying whether the second device is a designated device; When the second device is the designated device, the facial features of the designated face are sent to the second device.

9. The method according to any one of claims 1 to 8, characterized in that ,, the preprocessing of the video information to obtain target video information that does not include the privacy content includes: Mosaic processing is performed on the private content in the video information to obtain target video information; or, Set the specified video information as the target video information.

10. The method according to claim 9, characterized in that The designated video information includes the previous frame of video information that does not contain privacy content.

11. The method according to claim 3, characterized in that The preprocessing of the video information to obtain target video information excluding the privacy content includes: The non-specified human face in the video information is replaced with a specified avatar to obtain target video information.

12. The method according to any one of claims 1 to 8, characterized in that After obtaining the video information collected by the second device connected to the first device for screen projection, the method further includes: Check whether the privacy protection function is turned on; If the privacy protection function is enabled, it is determined whether there is any privacy content in the video information.

13. A video calling method, characterized in that: The method is applicable to the second device, comprising: When the screen is projected to a first device and the first device initiates a video call, the collected video information is sent to the first device, so that when there is privacy content in the video information, the first device pre-processes the video information to obtain target video information that does not include the privacy content, and sends the target video information to the other device of the video call.

14. The method according to claim 13, characterized in that The method further comprises: Analyzing the video information to obtain privacy indication information; The privacy indication information is sent to the first device, so that the first device determines whether there is privacy content in the video information according to the privacy indication information.

15. The method according to claim 14, characterized in that The step of analyzing the video information to obtain the privacy indication information includes: The video information is analyzed according to designated privacy information to obtain privacy indication information; wherein the designated privacy information includes the type of private content, and the designated privacy information is sent by the first device.

16. A video call device, characterized in that: The apparatus is in a first device, and comprises: An information acquisition unit, configured to acquire video information collected by a second device connected to the screen projection of the first device when the first device is in an interconnected screen projection state and a video call is started; an information processing unit, configured to pre-process the video information if the video information contains private content, to obtain target video information that does not contain the private content; The first information sending unit is used to send the target video information to the opposite end device of the video call.

17. A video call device, characterized in that: The apparatus is in a second device, and the apparatus includes: The second information sending unit is used to send the collected video information to the first device when the second device is connected to the first device through screen projection and the first device starts a video call, so that the first device can pre-process the video information when there is privacy content in the video information, obtain target video information that does not include the privacy content, and send the target video information to the other end device of the video call.

18. A first device, characterized in that: include: A memory storing executable program code; and a processor coupled to the memory; The processor calls the executable program code stored in the memory, and when the executable program code is executed by the processor, the processor implements the method according to any one of claims 1 to 12.

19. A second device, characterized in that: include: A memory storing executable program code; and a processor coupled to the memory; The processor calls the executable program code stored in the memory, and when the executable program code is executed by the processor, the processor implements the method according to any one of claims 13 to 15.

20. A computer-readable storage medium having executable program code stored thereon, characterized in that: When the executable program code is executed by a processor, the method according to any one of claims 1 to 15 is implemented.

Images