Data processing method, device and equipment based on central control system, medium and product
By detecting the portrait features in the video data collected by the intelligent central control device and virtualizing it, the problem of data leakage cannot be guaranteed, and the effect of improving user privacy is achieved.
Patent Information
- Application Number
- CN202411601095.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-11
- Publication Date
- 2025-03-28
AI Technical Summary
The data collected by intelligent central control devices are prone to the risk of data leakage, resulting in the inability to effectively protect users' privacy.
By obtaining the video data collected by the camera connected to the central control system, detect the portrait characteristics of the video portrait in the video data, and judge whether the target user's target video portrait exists based on the characteristics. If present, obtain the target user's target virtual portrait from the preset virtual image library and virtualize the target video portrait in the video data.
It realizes virtual imaging of video portraits in the video data collected by the central control system, avoids the risk of user personal privacy leakage, improves the security of user privacy data, and expands the diversified data presentation method.
Smart Images

Figure CN119722994A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of data processing technology, and in particular to a data processing method, device, equipment, medium and product based on a central control system. Background Art
[0002] With the continuous development of science and technology, smart central control devices are gradually being used in people's lives. By using the cameras built into smart central control devices or connected cameras, the internal or external environment of the house can be monitored, or video calls can be made, etc. However, the data collected by smart central control devices is prone to the risk of data leakage, which in turn leads to the loss of user privacy. Summary of the invention
[0003] In view of the above problems, a data processing method, device, equipment, medium and product based on a central control system are proposed to overcome the above problems or at least partially solve the above problems, including:
[0004] A data processing method based on a central control system, the method comprising:
[0005] Obtaining video data collected by a camera connected to the central control system;
[0006] Detecting portrait features of a video portrait in the video data, and judging whether a target video portrait of a target user exists in the video data according to the portrait features;
[0007] When a target video portrait of a target user exists in the video data, obtaining a target virtual portrait corresponding to the target user from a preset virtual image library;
[0008] The target virtual portrait is used to virtualize the target video portrait in the video data.
[0009] Optionally, it also includes:
[0010] Obtaining pre-set environmental area division data;
[0011] According to the environmental area division data, the environmental area video objects in the video data are virtualized or shielded.
[0012] Optionally, the environmental area division data includes a first environmental area and a second environmental area, and the virtualizing or shielding processing of the environmental area video objects in the video data according to the environmental area division data includes:
[0013] When a first environment area video object of a first environment area exists in the video data, virtualizing the first environment area video object in the video data;
[0014] When a second environment area video object of a second environment area exists in the video data, shielding processing is performed on the second environment area video object in the video data.
[0015] Optionally, it also includes:
[0016] A target device video object of a target device in the video data is virtualized.
[0017] Optionally, the target device is an intelligent device that is communicatively connected to the central control system, and the virtualizing the target device video object of the target device in the video data includes:
[0018] When it is detected that the target device is awakened by voice, a target device video object of the target device in the video data is virtualized.
[0019] Optionally, it also includes:
[0020] The background video object in the video data is virtualized.
[0021] Optionally, the video data is surveillance video data, and after the target virtual human portrait in the video data is virtualized by using the target virtual human portrait, the method further includes:
[0022] In response to user operations, the virtualized surveillance video data is shared to a third-party platform.
[0023] Optionally, the video data is call video data, and after the target virtual portrait is used to virtualize the target video portrait in the video data, the method further includes:
[0024] During a video call, the virtualized call video data is sent to the communication peer.
[0025] A data processing device based on a central control system, the device comprising:
[0026] A video data acquisition module, used to acquire video data collected by a camera connected to the central control system;
[0027] A target video portrait detection module is used to detect portrait features of a video portrait in the video data, and determine whether there is a target video portrait of a target user in the video data based on the portrait features;
[0028] A target virtual portrait acquisition module, configured to acquire a target virtual portrait corresponding to the target user from a preset virtual image library when a target video portrait of the target user exists in the video data;
[0029] The portrait virtualization module is used to virtualize the target video portrait in the video data using the target virtual portrait.
[0030] An electronic device comprises a processor, a memory and a computer program stored in the memory and capable of running on the processor, wherein the computer program implements the method described above when executed by the processor.
[0031] A computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method described above is implemented.
[0032] A computer program product comprises a computer program, wherein when the computer program is executed by a processor, the computer program implements the method as described above.
[0033] The embodiments of the present invention have the following advantages:
[0034] In an embodiment of the present invention, video data collected by a camera connected to a central control system is obtained; portrait features of a video portrait in the video data are detected, and based on the portrait features, it is determined whether a target video portrait of a target user exists in the video data; when a target video portrait of a target user exists in the video data, a target virtual portrait corresponding to the target user is obtained from a preset virtual image library; the target video portrait in the video data is virtualized using the target virtual portrait, thereby realizing virtualized imaging of the video portrait in the video data collected by the central control system, avoiding the risk of leakage of user personal privacy, improving the security of user privacy data, and expanding the diversified presentation methods of data. BRIEF DESCRIPTION OF THE DRAWINGS
[0035] In order to more clearly illustrate the technical solution of the present invention, the accompanying drawings required for use in the description of the present invention will be briefly introduced below. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative labor.
[0036] Figure 1 is a flowchart of a data processing method based on a central control system provided by an embodiment of the present invention;
[0037] Figure 2 is a flowchart of another data processing method based on a central control system provided by an embodiment of the present invention;
[0038] Figure 3 is a flowchart of another data processing method based on a central control system provided by an embodiment of the present invention;
[0039] Figure 4is a flowchart of another data processing method based on a central control system provided by an embodiment of the present invention;
[0040] Figure 5 It is a structural block diagram of a data processing device based on a central control system provided by an embodiment of the present invention. DETAILED DESCRIPTION
[0041] In order to make the above-mentioned purposes, features and advantages of the present invention more obvious and easy to understand, the present invention is further described in detail below in conjunction with the accompanying drawings and specific embodiments. Obviously, the described embodiments are part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0042] Reference Figure 1 , showing a step flow chart of a data processing method based on a central control system provided by an embodiment of the present invention. The method can be applied to the central control system, which can be a multimedia central control system. The central control system is a central control system that integrates multiple multimedia devices and functions. It can centrally control and manage multimedia devices through one device.
[0043] Specifically, the following steps may be included:
[0044] Step 101, obtaining video data collected by a camera connected to the central control system.
[0045] In some examples, the central control system is applied to an intelligent central control device; wherein, the intelligent central control device can be bound to other devices through the same network for data communication; for example, a user can connect to a camera through a smart central control terminal based on WiFi (Wireless Fidelity, wireless local area network communication technology), thereby obtaining video data or image data collected by the camera connected to the central control system.
[0046] In some examples, the central control system is connected to a main camera and a slave camera. The main camera is located in the smart central control device itself and can be used for application scenarios such as video communication and live video. The slave camera is an external camera that can be installed according to actual user needs. A network connection is established between the smart central control device and the slave camera to obtain video data collected by the slave camera.
[0047] Step 102 , detecting portrait features of the video portrait in the video data, and judging whether a target video portrait of a target user exists in the video data according to the portrait features.
[0048] As some examples, portrait features may include facial feature information and body feature information; the target user is a user who has previously created a virtual portrait in the virtual image library.
[0049] After obtaining the collected video data, the video portrait of the user in the video data can be identified, and based on the portrait features of the user's video portrait, it can be determined whether the video data contains a user whose virtual portrait has been established in the central control system in advance. If the video data contains a user whose virtual portrait has been established in the central control system in advance, the target video portrait of the target user exists in the video data; if the video data does not contain a user whose virtual portrait has been established in the central control system in advance, the target video portrait of the target user does not exist in the video data.
[0050] Step 103 , when a target video portrait of a target user exists in the video data, a target virtual portrait corresponding to the target user is obtained from a preset virtual image library.
[0051] As some examples, users can collect their own portrait features in advance through the smart central control device, set a virtual portrait corresponding to the user's own portrait features based on the virtual image materials in the virtual image library, and store the association between the portrait features and the virtual portrait as the target virtual portrait corresponding to the target user in the virtual image library.
[0052] When the camera detects that there is a target video portrait of the target user in the video data, the virtual image library can be called through the central control system to obtain the target virtual portrait corresponding to the target user from the virtual image library based on the association between the portrait features and the virtual portrait.
[0053] As some examples, the virtual image library may include cartoon special effects, mosaics, etc. When the target virtual portrait corresponding to the target user is a mosaic, the target video portrait corresponding to the target user in the video data may be mosaic processed, thereby making the target video portrait appear blurred.
[0054] Step 104: virtualize the target video portrait in the video data using the target virtual portrait.
[0055] After the target virtual portrait corresponding to the target user is obtained, the target virtual portrait may be used to virtualize the target video portrait in the video data to perform virtual imaging.
[0056] In some examples, after virtualizing the target video portrait in the video data using the target virtual portrait, the virtualized target video portrait may be encrypted to prevent illegal intrusion to obtain the portrait feature information of the target user.
[0057] In some embodiments of the present invention, the method further includes: obtaining preset environmental area division data; and virtualizing or shielding the environmental area video objects in the video data according to the environmental area division data.
[0058] As some examples, the camera can collect video data in the current environment at 0-360 degrees. Since users do not want certain areas to be monitored, the areas in the environment can be divided to determine the areas that can be monitored and the areas that do not want to be monitored.
[0059] In some examples, users can divide areas in advance through a smart central control device or an APP (Application software) of a terminal device connected to the smart central control device; for example, users can control the angle of the camera through the smart central control device, capture images at a certain angle, and set monitoring areas and privacy areas as environmental area division data. Since each area contains different video objects, users can choose to virtualize or shield video objects in the area according to actual needs; for example, users can virtualize or shield the content contained in the privacy area.
[0060] As some examples, in the case where there is overlap between the monitoring area and the privacy area, the central control system can prompt the user of the overlap, and the user can adjust the area according to the actual situation.
[0061] In actual applications, the virtualized data of the target video portrait in the video data and the environmental area division data will be encrypted and processed in the central control system. These data cannot be read and obtained by a third party over the network and can only be obtained locally with user permissions to prevent illegal intrusion and acquisition of user portrait feature information.
[0062] In some embodiments of the present invention, the environmental area division data includes a first environmental area and a second environmental area, and the virtualization or shielding processing of the environmental area video objects in the video data based on the environmental area division data includes: when there is a first environmental area video object of the first environmental area in the video data, virtualizing the first environmental area video object in the video data; when there is a second environmental area video object of the second environmental area in the video data, shielding the second environmental area video object in the video data.
[0063] As some examples, the first environment area and the second environment area can be the same area or different areas; for example, the first environment area can be a monitoring area, the second environment area can be a privacy area, or both the first environment area and the second environment area are privacy areas. The video object in the first environment area is the object that needs to be virtualized, and the video object in the second environment area is the object that needs to be shielded.
[0064] In practical applications, after obtaining the environmental area division data from the camera, the video objects in the video data can be interval imaged or interval shielded and interval hidden visually imaged according to the environmental area division data to protect user privacy.
[0065] In some embodiments of the present invention, the further step includes: virtualizing a target device video object of a target device in the video data.
[0066] As some examples, the user can call the virtual image library through the smart central control device to set the virtual image for the smart device connected to the central control system. When the smart device exists in the video data, the video object of the device can be virtualized.
[0067] In some embodiments of the present invention, the target device is an intelligent device that is communicatively connected to the central control system, and the virtualization of the target device video object of the target device in the video data includes: when it is detected that the target device is awakened by voice, virtualization of the target device video object of the target device in the video data.
[0068] In some embodiments of the present invention, the method further includes: virtualizing background video objects in the video data.
[0069] In actual applications, the camera can also virtualize the background in the video data, such as a virtual scene, mosaic or other atomize the background in the video data, or perform scene virtual imaging processing to facilitate the protection of user privacy.
[0070] In some embodiments of the present invention, the video data is surveillance video data. After the target video portrait in the video data is virtualized using the target virtual portrait, the process further includes: in response to user operations, sharing the virtualized surveillance video data to a third-party platform.
[0071] In actual applications, the virtualized surveillance video data can be stored in the cloud and locally. Users can share the virtualized surveillance video data to third-party platforms, such as social software platforms, through the smart central control device or the terminal device APP connected to the smart central control device.
[0072] In some embodiments of the present invention, the video data is call video data. After the target video portrait in the video data is virtualized using the target virtual portrait, the process further includes: during the video call, the virtualized call video data is sent to the communication counterpart.
[0073] In actual applications, the smart central control device has a video communication function. When a user makes a video call through the smart central control device, the camera carried by the smart central control device itself can identify the user's portrait features and match them with the virtual image library. When there is a target user, the target virtual portrait corresponding to the target user is called to virtualize the target video portrait in the video data, and the virtualized call video data is sent to the communication peer.
[0074] In an embodiment of the present invention, video data collected by a camera connected to a central control system is acquired; portrait features of a video portrait in the video data are detected, and based on the portrait features, it is determined whether a target video portrait of a target user exists in the video data; when a target video portrait of a target user exists in the video data, a target virtual portrait corresponding to the target user is acquired from a preset virtual image library; the target virtual portrait is used to virtualize the target video portrait in the video data, thereby realizing virtual imaging of the target video portrait by detecting the video data, avoiding the risk of leakage of user personal privacy due to leakage of video data, and improving the security of user privacy data.
[0075] Reference Figure 2 , showing a step flow chart of another data processing method based on a central control system provided by an embodiment of the present invention. The method can be applied to a central control system, which can be a multimedia central control system. The central control system is a central control system that integrates multiple multimedia devices and functions. It can centrally control and manage multimedia devices through one device.
[0076] Specifically, the following steps may be included:
[0077] Step 201, obtaining video data collected by a camera connected to the central control system.
[0078] In some examples, the central control system is applied to an intelligent central control device; wherein, the intelligent central control device can be bound to other devices through the same network for data communication; for example, a user can connect to a camera through a smart central control terminal based on WiFi (Wireless Fidelity, wireless local area network communication technology), thereby obtaining video data or image data collected by the camera connected to the central control system.
[0079] In some examples, the central control system is connected to a main camera and a slave camera. The main camera is located in the smart central control device itself and can be used for application scenarios such as video communication and live video. The slave camera is an external camera that can be installed according to actual user needs. A network connection is established between the smart central control device and the slave camera to obtain video data collected by the slave camera.
[0080] Step 202 , detecting portrait features of the video portrait in the video data, and judging whether a target video portrait of a target user exists in the video data based on the portrait features.
[0081] As some examples, portrait features may include facial feature information and body feature information; the target user is a user who has previously created a virtual portrait in the virtual image library.
[0082] After obtaining the collected video data, the video portrait of the user in the video data can be identified, and based on the portrait features of the user's video portrait, it can be determined whether the video data contains a user whose virtual portrait has been established in the central control system in advance. If the video data contains a user whose virtual portrait has been established in the central control system in advance, the target video portrait of the target user exists in the video data; if the video data does not contain a user whose virtual portrait has been established in the central control system in advance, the target video portrait of the target user does not exist in the video data.
[0083] Step 203 , when a target video portrait of a target user exists in the video data, a target virtual portrait corresponding to the target user is obtained from a preset virtual image library.
[0084] As some examples, users can collect their own portrait features in advance through the smart central control device, set a virtual portrait corresponding to the user's own portrait features based on the virtual image materials in the virtual image library, and store the association between the portrait features and the virtual portrait as the target virtual portrait corresponding to the target user in the virtual image library.
[0085] When the camera detects that there is a target video portrait of the target user in the video data, the virtual image library can be called through the central control system to obtain the target virtual portrait corresponding to the target user from the virtual image library based on the association between the portrait features and the virtual portrait.
[0086] As some examples, the virtual image library may include cartoon special effects, mosaics, etc. When the target virtual portrait corresponding to the target user is a mosaic, the target video portrait corresponding to the target user in the video data may be mosaic processed, thereby making the target video portrait appear blurred.
[0087] Step 204: virtualize the target video portrait in the video data using the target virtual portrait; wherein the video data is call video data.
[0088] After the target virtual portrait corresponding to the target user is obtained, the target virtual portrait may be used to virtualize the target video portrait in the video data to perform virtual imaging.
[0089] In some examples, after virtualizing the target video portrait in the video data using the target virtual portrait, the virtualized target video portrait may be encrypted to prevent illegal intrusion to obtain the portrait feature information of the target user.
[0090] Step 205: During the video call, the virtualized call video data is sent to the communication peer.
[0091] In actual applications, the smart central control device has a video communication function. When a user makes a video call through the smart central control device, the camera carried by the smart central control device itself can identify the user's portrait features and match them with the virtual image library. When there is a target user, the target virtual portrait corresponding to the target user is called to virtualize the target video portrait in the video data, and the virtualized call video data is sent to the communication peer.
[0092] In some embodiments of the present invention, the method further includes: obtaining preset environmental area division data; and virtualizing or shielding the environmental area video objects in the video data according to the environmental area division data.
[0093] As some examples, the camera can collect video data in the current environment at 0-360 degrees. Since users do not want certain areas to be monitored, the areas in the environment can be divided to determine the areas that can be monitored and the areas that do not want to be monitored.
[0094] In some examples, users can divide areas in advance through a smart central control device or an APP (Application software) of a terminal device connected to the smart central control device; for example, users can control the angle of the camera through the smart central control device, capture images at a certain angle, and set monitoring areas and privacy areas as environmental area division data. Since each area contains different video objects, users can choose to virtualize or shield video objects in the area according to actual needs; for example, users can virtualize or shield the content contained in the privacy area.
[0095] As some examples, in the case where there is overlap between the monitoring area and the privacy area, the central control system can prompt the user of the overlap, and the user can adjust the area according to the actual situation.
[0096] In actual applications, the virtualized data of the target video portrait in the video data and the environmental area division data will be encrypted and processed in the central control system. These data cannot be read and obtained by a third party over the network and can only be obtained locally with user permissions to prevent illegal intrusion and acquisition of user portrait feature information.
[0097] In some embodiments of the present invention, the environmental area division data includes a first environmental area and a second environmental area, and the virtualization or shielding processing of the environmental area video objects in the video data based on the environmental area division data includes: when there is a first environmental area video object of the first environmental area in the video data, virtualizing the first environmental area video object in the video data; when there is a second environmental area video object of the second environmental area in the video data, shielding the second environmental area video object in the video data.
[0098] As some examples, the first environment area and the second environment area can be the same area or different areas; for example, the first environment area can be a monitoring area, the second environment area can be a privacy area, or both the first environment area and the second environment area are privacy areas. The video object in the first environment area is the object that needs to be virtualized, and the video object in the second environment area is the object that needs to be shielded.
[0099] In practical applications, after obtaining the environmental area division data from the camera, the video objects in the video data can be interval imaged or interval shielded and interval hidden visually imaged according to the environmental area division data to protect user privacy.
[0100] In some embodiments of the present invention, the further step includes: virtualizing a target device video object of a target device in the video data.
[0101] As some examples, the user can call the virtual image library through the smart central control device to set the virtual image for the smart device connected to the central control system. When the smart device exists in the video data, the video object of the device can be virtualized.
[0102] In some embodiments of the present invention, the target device is an intelligent device that is communicatively connected to the central control system, and the virtualization of the target device video object of the target device in the video data includes: when it is detected that the target device is awakened by voice, virtualization of the target device video object of the target device in the video data.
[0103] In some embodiments of the present invention, the method further includes: virtualizing background video objects in the video data.
[0104] In actual applications, the camera can also virtualize the background in the video data, such as a virtual scene, mosaic or other atomize the background in the video data, or perform scene virtual imaging processing to facilitate the protection of user privacy.
[0105] In some embodiments of the present invention, the video data is surveillance video data. After the target video portrait in the video data is virtualized using the target virtual portrait, the process further includes: in response to user operations, sharing the virtualized surveillance video data to a third-party platform.
[0106] In actual applications, the virtualized surveillance video data can be stored in the cloud and locally. Users can share the virtualized surveillance video data to third-party platforms, such as social software platforms, through the smart central control device or the terminal device APP connected to the smart central control device.
[0107] In an embodiment of the present invention, video data collected by a camera connected to a central control system is obtained; portrait features of a video portrait in the video data are detected, and based on the portrait features, it is determined whether a target video portrait of a target user exists in the video data; when a target video portrait of a target user exists in the video data, a target virtual portrait corresponding to the target user is obtained from a preset virtual image library; the target virtual portrait is used to virtualize the target video portrait in the video data; during a video call, the virtualized call video data is sent to the communication peer, thereby realizing virtual imaging of the target video portrait by detecting the video data, avoiding the risk of user personal privacy leakage due to video data leakage, and improving the security of user privacy data.
[0108] refer to Figure 3 , showing a step flow chart of another data processing method based on a central control system provided by an embodiment of the present invention. The method can be applied to a central control system, which can be a multimedia central control system. The central control system is a central control system that integrates multiple multimedia devices and functions. It can centrally control and manage multimedia devices through one device.
[0109] Specifically, the following steps may be included:
[0110] Step 301, obtaining video data collected by a camera connected to the central control system.
[0111] In some examples, the central control system is applied to an intelligent central control device; wherein, the intelligent central control device can be bound to other devices through the same network for data communication; for example, a user can connect to a camera through a smart central control terminal based on WiFi (Wireless Fidelity, wireless local area network communication technology), thereby obtaining video data or image data collected by the camera connected to the central control system.
[0112] In some examples, the central control system is connected to a main camera and a slave camera. The main camera is located in the smart central control device itself and can be used for application scenarios such as video communication and live video. The slave camera is an external camera that can be installed according to actual user needs. A network connection is established between the smart central control device and the slave camera to obtain video data collected by the slave camera.
[0113] Step 302: Detect portrait features of the video portrait in the video data, and determine whether a target video portrait of a target user exists in the video data based on the portrait features.
[0114] As some examples, portrait features may include facial feature information and body feature information; the target user is a user who has previously created a virtual portrait in the virtual image library.
[0115] After obtaining the collected video data, the video portrait of the user in the video data can be identified, and based on the portrait features of the user's video portrait, it can be determined whether the video data contains a user whose virtual portrait has been established in the central control system in advance. If the video data contains a user whose virtual portrait has been established in the central control system in advance, the target video portrait of the target user exists in the video data; if the video data does not contain a user whose virtual portrait has been established in the central control system in advance, the target video portrait of the target user does not exist in the video data.
[0116] Step 303 , when a target video portrait of a target user exists in the video data, a target virtual portrait corresponding to the target user is obtained from a preset virtual image library.
[0117] As some examples, users can collect their own portrait features in advance through the smart central control device, set a virtual portrait corresponding to the user's own portrait features based on the virtual image materials in the virtual image library, and store the association between the portrait features and the virtual portrait as the target virtual portrait corresponding to the target user in the virtual image library.
[0118] When the camera detects that there is a target video portrait of the target user in the video data, the virtual image library can be called through the central control system to obtain the target virtual portrait corresponding to the target user from the virtual image library based on the association between the portrait features and the virtual portrait.
[0119] As some examples, the virtual image library may include cartoon special effects, mosaics, etc. When the target virtual portrait corresponding to the target user is a mosaic, the target video portrait corresponding to the target user in the video data may be mosaic processed, thereby making the target video portrait appear blurred.
[0120] Step 304: virtualize the target video portrait in the video data using the target virtual portrait; wherein the video data is surveillance video data.
[0121] After the target virtual portrait corresponding to the target user is obtained, the target virtual portrait may be used to virtualize the target video portrait in the video data to perform virtual imaging.
[0122] In some examples, after virtualizing the target video portrait in the video data using the target virtual portrait, the virtualized target video portrait may be encrypted to prevent illegal intrusion to obtain the portrait feature information of the target user.
[0123] Step 305: In response to the user operation, the virtualized surveillance video data is shared to a third-party platform.
[0124] In actual applications, the virtualized surveillance video data can be stored in the cloud and locally. Users can share the virtualized surveillance video data to third-party platforms, such as social software platforms, through the smart central control device or the terminal device APP connected to the smart central control device.
[0125] In some embodiments of the present invention, the method further includes: obtaining preset environmental area division data; and virtualizing or shielding the environmental area video objects in the video data according to the environmental area division data.
[0126] As some examples, the camera can collect video data in the current environment at 0-360 degrees. Since users do not want certain areas to be monitored, the areas in the environment can be divided to determine the areas that can be monitored and the areas that do not want to be monitored.
[0127] In some examples, users can divide areas in advance through a smart central control device or an APP (Application software) of a terminal device connected to the smart central control device; for example, users can control the angle of the camera through the smart central control device, capture images at a certain angle, and set monitoring areas and privacy areas as environmental area division data. Since each area contains different video objects, users can choose to virtualize or shield video objects in the area according to actual needs; for example, users can virtualize or shield the content contained in the privacy area.
[0128] As some examples, in the case where there is overlap between the monitoring area and the privacy area, the central control system can prompt the user of the overlap, and the user can adjust the area according to the actual situation.
[0129] In actual applications, the virtualized data of the target video portrait in the video data and the environmental area division data will be encrypted and processed in the central control system. These data cannot be read and obtained by a third party over the network and can only be obtained locally with user permissions to prevent illegal intrusion and acquisition of user portrait feature information.
[0130] In some embodiments of the present invention, the environmental area division data includes a first environmental area and a second environmental area, and the virtualization or shielding processing of the environmental area video objects in the video data based on the environmental area division data includes: when there is a first environmental area video object of the first environmental area in the video data, virtualizing the first environmental area video object in the video data; when there is a second environmental area video object of the second environmental area in the video data, shielding the second environmental area video object in the video data.
[0131] As some examples, the first environment area and the second environment area can be the same area or different areas; for example, the first environment area can be a monitoring area, the second environment area can be a privacy area, or both the first environment area and the second environment area are privacy areas. The video object in the first environment area is the object that needs to be virtualized, and the video object in the second environment area is the object that needs to be shielded.
[0132] In practical applications, after obtaining the environmental area division data from the camera, the video objects in the video data can be interval imaged or interval shielded and interval hidden visually imaged according to the environmental area division data to protect user privacy.
[0133] In some embodiments of the present invention, the further step includes: virtualizing a target device video object of a target device in the video data.
[0134] As some examples, the user can call the virtual image library through the smart central control device to set the virtual image for the smart device connected to the central control system. When the smart device exists in the video data, the video object of the device can be virtualized.
[0135] In some embodiments of the present invention, the target device is an intelligent device that is communicatively connected to the central control system, and the virtualization of the target device video object of the target device in the video data includes: when it is detected that the target device is awakened by voice, virtualization of the target device video object of the target device in the video data.
[0136] In some embodiments of the present invention, the method further includes: virtualizing background video objects in the video data.
[0137] In actual applications, the camera can also virtualize the background in the video data, such as a virtual scene, mosaic or other atomize the background in the video data, or perform scene virtual imaging processing to facilitate the protection of user privacy.
[0138] In some embodiments of the present invention, the video data is call video data. After the target video portrait in the video data is virtualized using the target virtual portrait, the process further includes: during the video call, the virtualized call video data is sent to the communication counterpart.
[0139] In actual applications, the smart central control device has a video communication function. When a user makes a video call through the smart central control device, the camera carried by the smart central control device itself can identify the user's portrait features and match them with the virtual image library. When there is a target user, the target virtual portrait corresponding to the target user is called to virtualize the target video portrait in the video data, and the virtualized call video data is sent to the communication peer.
[0140] In an embodiment of the present invention, video data collected by a camera connected to a central control system is obtained; portrait features of a video portrait in the video data are detected, and based on the portrait features, it is determined whether a target video portrait of a target user exists in the video data; when a target video portrait of a target user exists in the video data, a target virtual portrait corresponding to the target user is obtained from a preset virtual image library; the target virtual portrait is used to virtualize the target video portrait in the video data; wherein the video data is surveillance video data; in response to user operations, the virtualized surveillance video data is shared to a third-party platform, thereby realizing virtualized imaging of the target video portrait by detecting the video data, avoiding the risk of user personal privacy leakage due to video data leakage, and improving the security of user privacy data.
[0141] refer to Figure 4 , showing a step flow chart of another data processing method based on a central control system provided by an embodiment of the present invention. The method can be applied to a central control system, which can be a multimedia central control system. The central control system is a central control system that integrates multiple multimedia devices and functions. It can centrally control and manage multimedia devices through one device.
[0142] Specifically, the following steps may be included:
[0143] Step 401, obtaining video data collected by a camera connected to the central control system.
[0144] In some examples, the central control system is applied to an intelligent central control device; wherein, the intelligent central control device can be bound to other devices through the same network for data communication; for example, a user can connect to a camera through a smart central control terminal based on WiFi (Wireless Fidelity, wireless local area network communication technology), thereby obtaining video data or image data collected by the camera connected to the central control system.
[0145] In some examples, the central control system is connected to a main camera and a slave camera. The main camera is located in the smart central control device itself and can be used for application scenarios such as video communication and live video. The slave camera is an external camera that can be installed according to actual user needs. A network connection is established between the smart central control device and the slave camera to obtain video data collected by the slave camera.
[0146] Step 402 , detecting portrait features of the video portrait in the video data, and judging whether a target video portrait of a target user exists in the video data according to the portrait features.
[0147] As some examples, portrait features may include facial feature information and body feature information; the target user is a user who has previously created a virtual portrait in the virtual image library.
[0148] After obtaining the collected video data, the video portrait of the user in the video data can be identified, and based on the portrait features of the user's video portrait, it can be determined whether the video data contains a user whose virtual portrait has been established in the central control system in advance. If the video data contains a user whose virtual portrait has been established in the central control system in advance, the target video portrait of the target user exists in the video data; if the video data does not contain a user whose virtual portrait has been established in the central control system in advance, the target video portrait of the target user does not exist in the video data.
[0149] Step 403 , when a target video portrait of a target user exists in the video data, a target virtual portrait corresponding to the target user is obtained from a preset virtual image library.
[0150] As some examples, users can collect their own portrait features in advance through the smart central control device, set a virtual portrait corresponding to the user's own portrait features based on the virtual image materials in the virtual image library, and store the association between the portrait features and the virtual portrait as the target virtual portrait corresponding to the target user in the virtual image library.
[0151] When the camera detects that there is a target video portrait of the target user in the video data, the virtual image library can be called through the central control system to obtain the target virtual portrait corresponding to the target user from the virtual image library based on the association between the portrait features and the virtual portrait.
[0152] As some examples, the virtual image library may include cartoon special effects, mosaics, etc. When the target virtual portrait corresponding to the target user is a mosaic, the target video portrait corresponding to the target user in the video data may be mosaic processed, thereby making the target video portrait appear blurred.
[0153] Step 404: virtualize the target video portrait in the video data using the target virtual portrait.
[0154] After the target virtual portrait corresponding to the target user is obtained, the target virtual portrait may be used to virtualize the target video portrait in the video data to perform virtual imaging.
[0155] In some examples, after virtualizing the target video portrait in the video data using the target virtual portrait, the virtualized target video portrait may be encrypted to prevent illegal intrusion to obtain the portrait feature information of the target user.
[0156] Step 405, obtaining preset environmental area division data; and virtualizing or shielding the environmental area video objects in the video data according to the environmental area division data.
[0157] As some examples, the camera can collect video data in the current environment at 0-360 degrees. Since users do not want certain areas to be monitored, the areas in the environment can be divided to determine the areas that can be monitored and the areas that do not want to be monitored.
[0158] In some examples, users can divide areas in advance through a smart central control device or an APP (Application software) of a terminal device connected to the smart central control device; for example, users can control the angle of the camera through the smart central control device, capture images at a certain angle, and set monitoring areas and privacy areas as environmental area division data. Since each area contains different video objects, users can choose to virtualize or shield video objects in the area according to actual needs; for example, users can virtualize or shield the content contained in the privacy area.
[0159] As some examples, in the case where there is overlap between the monitoring area and the privacy area, the central control system can prompt the user of the overlap, and the user can adjust the area according to the actual situation.
[0160] In actual applications, the virtualized data of the target video portrait in the video data and the environmental area division data will be encrypted and processed in the central control system. These data cannot be read and obtained by a third party over the network and can only be obtained locally with user permissions to prevent illegal intrusion and acquisition of user portrait feature information.
[0161] Step 406, the environmental area division data includes a first environmental area and a second environmental area; when a first environmental area video object of the first environmental area exists in the video data, the first environmental area video object in the video data is virtualized; when a second environmental area video object of the second environmental area exists in the video data, the second environmental area video object in the video data is shielded.
[0162] As some examples, the first environment area and the second environment area can be the same area or different areas; for example, the first environment area can be a monitoring area, the second environment area can be a privacy area, or both the first environment area and the second environment area are privacy areas. The video object in the first environment area is the object that needs to be virtualized, and the video object in the second environment area is the object that needs to be shielded.
[0163] In practical applications, after obtaining the environmental area division data from the camera, the video objects in the video data can be interval imaged or interval shielded and interval hidden visually imaged according to the environmental area division data to protect user privacy.
[0164] In some embodiments of the present invention, the further step includes: virtualizing a target device video object of a target device in the video data.
[0165] As some examples, the user can call the virtual image library through the smart central control device to set the virtual image for the smart device connected to the central control system. When the smart device exists in the video data, the video object of the device can be virtualized.
[0166] In some embodiments of the present invention, the target device is an intelligent device that is communicatively connected to the central control system, and the virtualization of the target device video object of the target device in the video data includes: when it is detected that the target device is awakened by voice, virtualization of the target device video object of the target device in the video data.
[0167] In some embodiments of the present invention, the method further includes: virtualizing background video objects in the video data.
[0168] In actual applications, the camera can also virtualize the background in the video data, such as a virtual scene, mosaic or other atomize the background in the video data, or perform scene virtual imaging processing to facilitate the protection of user privacy.
[0169] In some embodiments of the present invention, the video data is surveillance video data. After the target video portrait in the video data is virtualized using the target virtual portrait, the process further includes: in response to user operations, sharing the virtualized surveillance video data to a third-party platform.
[0170] In actual applications, the virtualized surveillance video data can be stored in the cloud and locally. Users can share the virtualized surveillance video data to third-party platforms, such as social software platforms, through the smart central control device or the terminal device APP connected to the smart central control device.
[0171] In some embodiments of the present invention, the video data is call video data. After the target video portrait in the video data is virtualized using the target virtual portrait, the process further includes: during the video call, the virtualized call video data is sent to the communication counterpart.
[0172] In actual applications, the smart central control device has a video communication function. When a user makes a video call through the smart central control device, the camera carried by the smart central control device itself can identify the user's portrait features and match them with the virtual image library. When there is a target user, the target virtual portrait corresponding to the target user is called to virtualize the target video portrait in the video data, and the virtualized call video data is sent to the communication peer.
[0173] In an embodiment of the present invention, video data collected by a camera connected to a central control system is obtained; portrait features of a video portrait in the video data are detected, and based on the portrait features, it is determined whether there is a target video portrait of a target user in the video data; when there is a target video portrait of a target user in the video data, a target virtual portrait corresponding to the target user is obtained from a preset virtual image library; the target video portrait in the video data is virtualized using the target virtual portrait; pre-set environmental area division data is obtained; according to the environmental area division data, an environmental area video object in the video data is virtualized or shielded; the environmental area division data includes a first environmental area and a second environmental area; when there is a first environmental area video object of the first environmental area in the video data, the first environmental area video object in the video data is virtualized; when there is a second environmental area video object of the second environmental area in the video data, the second environmental area video object in the video data is shielded, thereby realizing virtual imaging of the target video portrait by detecting the video data, and virtualizing or shielding the environmental area video objects, avoiding the risk of leakage of user personal privacy due to leakage of video data, and improving the security of user privacy data.
[0174] Reference Figure 5, shows a schematic diagram of the structure of a data processing device based on a central control system provided by an embodiment of the present invention, which may specifically include the following modules:
[0175] The video data acquisition module 501 is used to acquire the video data collected by the camera connected to the central control system;
[0176] A target video portrait detection module 502 is used to detect portrait features of a video portrait in the video data, and determine whether there is a target video portrait of a target user in the video data according to the portrait features;
[0177] A target virtual portrait acquisition module 503 is used to acquire a target virtual portrait corresponding to the target user from a preset virtual image library when a target video portrait of the target user exists in the video data;
[0178] The portrait virtualization module 504 is used to virtualize the target video portrait in the video data using the target virtual portrait.
[0179] In some embodiments of the present invention, the device further comprises:
[0180] An environmental area division data acquisition module is used to acquire preset environmental area division data;
[0181] The video data processing module is used to virtualize or shield the video objects of the environmental area in the video data according to the environmental area division data.
[0182] In some embodiments of the present invention, the environmental area division data includes a first environmental area and a second environmental area, and the video data processing module includes:
[0183] An environment area video object virtualization submodule, configured to virtualize the first environment area video object in the video data when there is a first environment area video object in the video data;
[0184] The environmental area video object shielding processing submodule is used to shield the second environmental area video object in the video data when there is a second environmental area video object of the second environmental area in the video data.
[0185] In some embodiments of the present invention, the device further comprises:
[0186] The target device virtualization module is used to virtualize the target device video object of the target device in the video data.
[0187] In some embodiments of the present invention, the target device is an intelligent device that is communicatively connected to the central control system, and the target device virtualization module includes:
[0188] The voice wake-up detection submodule is used to virtualize the target device video object of the target device in the video data when it is detected that the target device is woken up by voice.
[0189] In some embodiments of the present invention, the device further comprises:
[0190] The background video object virtualization module is used to virtualize the background video object in the video data.
[0191] In some embodiments of the present invention, the device further comprises:
[0192] The video data sharing module is used to share the virtualized surveillance video data to a third-party platform in response to user operations.
[0193] In some embodiments of the present invention, the device further comprises:
[0194] The video call module is used to send the virtualized call video data to the communication peer during the video call.
[0195] An embodiment of the present invention further provides an electronic device, which may include a processor, a memory, and a computer program stored in the memory and capable of running on the processor, and the computer program implements the above-mentioned method when executed by the processor.
[0196] An embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the method described above is implemented.
[0197] An embodiment of the present invention further provides a computer program product, including a computer program, wherein the computer program implements the method as described above when executed by a processor.
[0198] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.
[0199] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.
[0200] Those skilled in the art will appreciate that the embodiments of the present invention may be provided as methods, devices, or computer program products. Therefore, the embodiments of the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the embodiments of the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.
[0201] The embodiments of the present invention are described with reference to the flowcharts and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of the processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing terminal device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0202] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing terminal device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0203] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device so that a series of operating steps are executed on the computer or other programmable terminal device to produce a computer-implemented process, thereby providing instructions for implementing the process in the computer or other programmable terminal device. Figure 1 A process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.
[0204] Although the preferred embodiments of the present invention have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present invention.
[0205] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "including one..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the above elements.
[0206] The data processing methods, devices, equipment, media and products based on the central control system are introduced in detail above. Specific examples are used in this article to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea; at the same time, for general technical personnel in this field, according to the idea of the present invention, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present invention.
Claims
1. A data processing method based on a central control system, characterized in that: The method comprises: Obtaining video data collected by a camera connected to the central control system; Detecting portrait features of a video portrait in the video data, and judging whether a target video portrait of a target user exists in the video data according to the portrait features; When a target video portrait of a target user exists in the video data, obtaining a target virtual portrait corresponding to the target user from a preset virtual image library; The target virtual portrait is used to virtualize the target video portrait in the video data.
2. The method according to claim 1, characterized in that Also includes: Obtaining pre-set environmental area division data; According to the environmental area division data, the environmental area video objects in the video data are virtualized or shielded.
3. The method according to claim 2, characterized in that The environmental area division data includes a first environmental area and a second environmental area, and the virtualization or shielding processing of the environmental area video objects in the video data according to the environmental area division data includes: When a first environment area video object of a first environment area exists in the video data, virtualizing the first environment area video object in the video data; When a second environment area video object of a second environment area exists in the video data, shielding processing is performed on the second environment area video object in the video data.
4. The method according to any one of claims 1 to 3, characterized in that: Also includes: A target device video object of a target device in the video data is virtualized.
5. The method according to claim 4, characterized in that The target device is an intelligent device that is in communication with the central control system, and the virtualizing the target device video object of the target device in the video data includes: When it is detected that the target device is awakened by voice, a target device video object of the target device in the video data is virtualized.
6. The method according to any one of claims 1 to 3, characterized in that: Also includes: The background video object in the video data is virtualized.
7. The method according to claim 1, characterized in that The video data is monitoring video data, and after the target virtual portrait is used to virtualize the target video portrait in the video data, the method further includes: In response to user operations, the virtualized surveillance video data is shared to a third-party platform.
8. The method according to claim 1, characterized in that The video data is call video data, and after the target virtual portrait is used to virtualize the target video portrait in the video data, the method further includes: During a video call, the virtualized call video data is sent to the communication peer.
9. A data processing device based on a central control system, characterized in that: The device comprises: A video data acquisition module, used to acquire video data collected by a camera connected to the central control system; A target video portrait detection module is used to detect portrait features of a video portrait in the video data, and determine whether there is a target video portrait of a target user in the video data based on the portrait features; A target virtual portrait acquisition module, configured to acquire a target virtual portrait corresponding to the target user from a preset virtual image library when a target video portrait of the target user exists in the video data; The portrait virtualization module is used to virtualize the target video portrait in the video data using the target virtual portrait.
10. An electronic device, characterized in that: The method comprises a processor, a memory, and a computer program stored in the memory and capable of running on the processor, wherein the computer program implements the method according to any one of claims 1 to 7 when executed by the processor.
11. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.
12. A computer program product, characterized in that The invention comprises a computer program which, when executed by a processor, implements the method according to any one of claims 1 to 7.
Citation Information
Patent Citations
Shadowing method of privacy area in video surveillance
CN101540894A
Video image display method and device, equipment and readable storage medium
CN110502974A
Video frame generation method and device, storage medium and electronic equipment
CN112492383A
Monitoring video transmission method and monitoring video receiving method based on scene modeling
CN116489423A
Picture display method and device, computer equipment and storage medium
CN116560511A