Data transmission mode control method and device and home host

Abstract

The invention provides a data transmission mode control method and device and a home host, and the method comprises the steps: obtaining a behavior state of a target object in a target place, and obtaining a residence position of the target object in the target place; according to the behavior state and the residence position, a scene privacy level of the user terminal is configured, and the scene privacy level is used for indicating a data transmission range and a data encryption level when a data server of the target place carries out data transmission to the user terminal. The data server user stores the user data of the target place; and controlling a data transmission mode between the user terminal and the data server based on the scene privacy level. The technical problem that data transmitted by the data server of the target place is easy to leak in the related technology is solved, and the security and confidentiality of transmission between the data server and the user terminal are improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of data security, in particular to a data transmission mode control method and device and a home host. BACKGROUND

[0002] In related technologies, the existing technical solution is that the traditional smart home system mainly relies on wireless communication technologies such as Wi-Fi and Bluetooth to transmit data, and a fixed encryption strategy is usually adopted when storing private data in a home host, but data security cannot be guaranteed.

[0003] The existing solution in related technologies has the following problems: Problem 1: The existing solution realizes data transmission through wireless communication technologies such as Wi-Fi and Bluetooth; since wireless signals propagate in the form of electromagnetic waves, the coverage range is uncontrollable, which makes data vulnerable to interception by external devices. Therefore, it is difficult to meet the demand for secure transmission of sensitive data within a specific physical range in a home environment, resulting in insufficient data transmission security and easy interception. The coverage range of traditional wireless communication signals is wide, and unauthorized devices can steal data within the signal range, and the transmission mode is not dynamically adjusted for complex home scenarios, resulting in a risk of leakage when sensitive data is transmitted in an unsafe environment. Problem 2: The privacy protection strategy lacks environmental adaptability and cannot meet the demand for dynamically adjusting the privacy protection level according to the actual scenario.

[0004] In view of the above problems in related technologies, no efficient and accurate solution has been found. SUMMARY

[0005] The present application provides a data transmission mode control method and device, and a home host, to solve the technical problem of easy leakage of data transmitted by a data server in a target place in related technologies.

[0006] According to one embodiment of the present application, a data transmission mode control method is provided, comprising: obtaining the behavior state of a target object in a target place, and obtaining the residence position of the target object in the target place; configuring the scene privacy level of a user terminal according to the behavior state and the residence position, wherein the scene privacy level is used to indicate the data transmission range and data encryption level when the data server of the target place transmits data to the user terminal, and the data server stores user data of the target place; and controlling the data transmission mode between the user terminal and the data server based on the scene privacy level.

[0007] Optionally, the acquiring the behavior state of the target object in the target site comprises: acquiring image data collected by a camera; extracting facial features and body features of the target object from the image data; analyzing behavior participants of the target object by using the facial features, and analyzing a behavior type of the target object by using the body features, wherein the behavior state comprises the behavior participants and the behavior type.

[0008] Optionally, the acquiring the staying position of the target object in the target site comprises: acquiring image data collected by a camera; inputting the image data into a target detection model to output a target detection result; if there is a human body in the target detection result, acquiring an infrared signal collected by an infrared sensor and a pressure signal collected by a pressure sensor, wherein the pressure sensor is arranged on a floor layer of the target site; judging whether triggering positions of the infrared signal and the pressure signal are same; if the triggering positions of the infrared signal and the pressure signal are same, determining the triggering position of the infrared signal or the pressure signal as the staying position of the target object in the target site.

[0009] Optionally, the configuring the scene privacy level of the user terminal according to the behavior state and the staying position comprises: searching for a position privacy level matched with the staying position in preset configuration data, and searching for a behavior privacy level matched with the behavior state in preset configuration data; and configuring the scene privacy level of the user terminal according to the position privacy level and the behavior privacy level.

[0010] Optionally, the configuring the scene privacy level of the user terminal according to the position privacy level and the behavior privacy level comprises: if the position privacy level and the behavior privacy level are both high privacy levels, configuring a high privacy level for the user terminal; if the position privacy level or the behavior privacy level is a high privacy level, or the position privacy level or the behavior privacy level is both a medium privacy level, configuring a medium privacy level for the user terminal; if the position privacy level or the behavior privacy level is a medium privacy level, or the position privacy level or the behavior privacy level is both a low privacy level, configuring a low privacy level for the user terminal.

[0011] Optionally, the controlling the data transmission mode between the user terminal and the data server based on the scene privacy level comprises: if the scene privacy level is a high privacy level, disabling a wireless transmission module of the data server, and controlling the data server to start a visible light communication (VLC) module; and controlling the data server to transmit data to the user terminal through the VLC module.

[0012] Optionally, the controlling the data server to transmit data to the user terminal through the VLC module comprises: locating a visible light source in an area where the residence location is located; analyzing a data privacy level of target user data to be transmitted; searching for secret key data matched with the data privacy level; encrypting the target user data by using the secret key data to obtain encrypted data; and calling the VLC module to modulate the encrypted data into a flickering frequency, and controlling the visible light source according to the flickering frequency.

[0013] Optionally, after the scene privacy level of the user terminal is configured according to the behavior state and the residence location, the method further comprises: if the scene privacy level is a high privacy level, detecting a residence duration of the target object in the residence location and detecting an access behavior of the user terminal to the data server; identifying whether the target object has an abnormal behavior according to the residence duration and the access behavior; and generating an early warning signal and / or a control instruction for the data server if the target object has an abnormal behavior, wherein the control instruction is used to instruct to turn off a power supply of the data server or interrupt a communication link between the data server and the user terminal.

[0014] According to another embodiment of the present application, a control device of a data transmission mode is provided, comprising: an acquisition module configured to acquire a behavior state of a target object in a target place and a residence location of the target object in the target place; a configuration module configured to configure a scene privacy level of a user terminal according to the behavior state and the residence location, wherein the scene privacy level is used to indicate a data transmission range and a data encryption level when a data server of the target place transmits data to the user terminal, and the data server is configured to store user data of the target place; and a control module configured to control a data transmission mode between the user terminal and the data server based on the scene privacy level.

[0015] Optionally, the acquisition module comprises: a first acquisition unit configured to acquire image data collected by a camera; an extraction unit configured to extract facial features and body features of the target object from the image data; and an analysis unit configured to analyze behavior participants of the target object by using the facial features and analyze a behavior type of the target object by using the body features, wherein the behavior state comprises the behavior participants and the behavior type.

[0016] Optionally, the acquisition module comprises: a first acquisition unit, configured to acquire image data collected by a camera; a processing unit, configured to input the image data into a target detection model, and output a target detection result; a second acquisition unit, configured to acquire an infrared signal collected by an infrared sensor and a pressure signal collected by a pressure sensor if the target detection result contains a human body, wherein the pressure sensor is arranged on a floor layer of a target site; a judgment unit, configured to judge whether trigger positions of the infrared signal and the pressure signal are the same; and a determination unit, configured to determine the trigger position of the infrared signal or the pressure signal as a residence position of the target object in the target site if the trigger positions of the infrared signal and the pressure signal are the same.

[0017] Optionally, the configuration module comprises: a searching unit, configured to search for a position privacy level matched with the residence position and a behavior privacy level matched with the behavior state in preset configuration data; and a configuration unit, configured to configure a scene privacy level of the user terminal according to the position privacy level and the behavior privacy level.

[0018] Optionally, the configuration unit comprises: a first configuration sub-unit, configured to configure a high privacy level for the user terminal if both the position privacy level and the behavior privacy level are high privacy levels; a second configuration sub-unit, configured to configure a medium privacy level for the user terminal if either the position privacy level or the behavior privacy level is a high privacy level, or both the position privacy level and the behavior privacy level are medium privacy levels; and a third configuration sub-unit, configured to configure a low privacy level for the user terminal if either the position privacy level or the behavior privacy level is a medium privacy level, or both the position privacy level and the behavior privacy level are low privacy levels.

[0019] Optionally, the control module comprises: a processing unit, configured to disable a wireless transmission module of the data server and control the data server to start a visible light communication (VLC) module if the scene privacy level is a high privacy level; and a control unit, configured to control the data server to transmit data to the user terminal through the VLC module.

[0020] Optionally, the control unit comprises: a positioning sub-unit, configured to position a visible light source in an area where the residence position is located; an analysis sub-unit, configured to analyze a data privacy level of target user data to be transmitted; a searching sub-unit, configured to search for secret key data matched with the data privacy level; an encryption sub-unit, configured to encrypt the target user data by using the secret key data to obtain encrypted data; a modulation sub-unit, configured to call the VLC module to modulate the encrypted data into a flickering frequency; and a control sub-unit, configured to control the visible light source according to the flickering frequency.

[0021] Optionally, the apparatus further comprises: a detection module, configured to, after the configuration module configures the scene privacy level of the user terminal according to the behavior state and the camping position, if the scene privacy level is a high privacy level, detect a staying duration of the target object in the camping position and detect an access behavior of the user terminal to the data server; an identification module, configured to identify whether the target object has an abnormal behavior according to the staying duration and the access behavior; and a generation module, configured to generate an early warning signal and / or a control instruction for the data server if the target object has an abnormal behavior, wherein the control instruction is used to instruct to turn off a power supply of the data server or interrupt a communication link between the data server and the user terminal.

[0022] According to another embodiment of the present application, a home host is provided, wherein the home host comprises the control device of the data transmission mode according to the above-mentioned embodiments.

[0023] According to another aspect of the embodiments of the present application, a storage medium is also provided, which comprises a stored program, and the program performs the above-mentioned steps when running.

[0024] According to another aspect of the embodiments of the present application, an electronic device is also provided, which comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory complete mutual communication through the communication bus; wherein: the memory is used to store a computer program; and the processor is used to execute the steps in the above-mentioned method by running the program stored in the memory.

[0025] According to still another embodiment of the present application, a storage medium is also provided, which stores a computer program, and the computer program is set to execute the steps in any of the above-mentioned device embodiments when running.

[0026] By the embodiment of the present application, the behavior state of the target object in the target site is acquired, and the residence position of the target object in the target site is acquired; a scene privacy level of a user terminal is configured according to the behavior state and the residence position, wherein the scene privacy level is used to indicate a data transmission range and a data encryption level when a data server of the target site transmits data to the user terminal, and the data server stores user data of the target site; and a data transmission mode between the user terminal and the data server is controlled based on the scene privacy level. By configuring the scene privacy level of the user terminal by using the behavior state and the residence position, and then controlling the data transmission range and the data encryption level when the data server of the target site transmits data to the user terminal, the technical problem that the data transmitted by the data server of the target site is easily leaked in the related art is solved, and the security and confidentiality of the transmission between the data server and the user terminal are improved. BRIEF DESCRIPTION OF DRAWINGS

[0027] The accompanying drawings, which are included to provide a further understanding of the present application and are incorporated in and constitute a part of this application, illustrate embodiments of the present application and together with the description serve to explain the present application. In the drawings:

[0028] Figure 1 is a hardware structure block diagram of a home host according to an embodiment of the present application;

[0029] Figure 2 is a flow chart of a data transmission mode control method according to an embodiment of the present application;

[0030] Figure 3 is a work flow chart according to an embodiment of the present application;

[0031] Figure 4 is a structure block diagram of a data transmission mode control device according to an embodiment of the present application. DETAILED DESCRIPTION

[0032] In order to enable persons skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, but not all the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by persons skilled in the art without creative labor should fall within the protection scope of the present application. It should be noted that, in the case of no conflict, the embodiments in the present application and the features in the embodiments can be combined with each other.

[0033] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0034] Example 1

[0035] The method embodiment provided in Embodiment 1 of this application can be executed in a home host, server, or similar device management device. Taking running on a home host as an example, Figure 1 This is a hardware structure block diagram of a home host according to an embodiment of the present invention. Figure 1 As shown, a home console can include one or more ( Figure 1 Only one is shown in the diagram. A processor 102 (which may include, but is not limited to, a microprocessor MCU or a programmable logic device FPGA, etc.) and a memory 104 for storing data are also shown. Optionally, the aforementioned home host may further include a transmission device 106 for communication functions and an input / output device 108. Those skilled in the art will understand that... Figure 1 The structure shown is for illustrative purposes only and does not limit the structure of the home host described above. For example, the home host may also include components that are larger than... Figure 1 The more or fewer components shown, or having the same Figure 1 The different configurations shown.

[0036] The memory 104 can be used to store home host programs, such as application software programs and modules, like the home host program corresponding to a data transmission mode control method in this embodiment of the invention. The processor 102 executes various functional applications and data processing by running the home host program stored in the memory 104, thus implementing the aforementioned method. The memory 104 may include high-speed random access memory and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory 104 may further include memory remotely located relative to the processor 102, and these remote memories can be connected to the home host via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.

[0037] The transmission device 106 is configured to receive or send data via a network. The network can include a wireless network provided by a communication provider of a home host. In an example, the transmission device 106 includes a network interface controller (NIC) configured to connect to other network devices via a base station and communicate with the Internet. In an example, the transmission device 106 can be a radio frequency (RF) module configured to communicate with the Internet via a wireless manner.

[0038] In the embodiment, a control method of a data transmission mode is provided, Figure 2 is a flowchart of the control method of the data transmission mode according to the embodiment of the present application, as shown in the figure, the flowchart includes the following steps: Figure 2

[0039] In step S201, a behavior state of a target object in a target place is acquired, and a residence position of the target object in the target place is acquired.

[0040] In step S202, a scene privacy level of a user terminal is configured according to the behavior state and the residence position, wherein the scene privacy level is used to indicate a data transmission range and a data encryption level when a data server of the target place transmits data to the user terminal, and the data server is used to store user data of the target place.

[0041] Optionally, the scene privacy level includes a high privacy level, a middle privacy level and a low privacy level. The scene privacy level is negatively correlated with the data transmission range of the data server and is positively correlated with the data encryption level. The higher the scene privacy level is, the smaller the data transmission range is, and the higher the data encryption level is.

[0042] Optionally, the user terminal can be a mobile phone or a computer, or can be a central control panel or a control screen. The central control panel or the control screen can be a mobile terminal or can be fixedly installed in a room. When the target object operates a certain central control panel or control screen in the target place, the central control panel or the control screen is the user terminal.

[0043] Optionally, the data server can be a home host or a local server of the target place. The user data of the target place includes data collected and generated by various intelligent terminals in the target place.

[0044] In step S203, a data transmission mode between the user terminal and the data server is controlled based on the scene privacy level.

[0045] ​By the above steps, the behavior state of the target object in the target place is obtained, and the residence position of the target object in the target place is obtained; a scene privacy level of a user terminal is configured according to the behavior state and the residence position, wherein the scene privacy level is used to indicate a data transmission range and a data encryption level when a data server of the target place transmits data to the user terminal, and the data server stores user data of the target place; and a data transmission mode between the user terminal and the data server is controlled based on the scene privacy level. The scene privacy level of the user terminal is configured by using the behavior state and the residence position, and then the data transmission range and the data encryption level when the data server of the target place transmits data to the user terminal are controlled, thereby solving the technical problem that the data server of the target place easily leaks data in the related art, and improving the security and confidentiality of transmission between the data server and the user terminal.

[0046] In one embodiment of the present embodiment, obtaining the behavior state of the target object in the target place includes: obtaining image data collected by a camera; extracting facial features and body features of the target object from the image data; analyzing behavior participants of the target object by using the facial features, and analyzing a behavior type of the target object by using the body features, wherein the behavior state includes the behavior participants and the behavior type.

[0047] Optionally, the behavior participants include a number of participants, whether strangers are included in the participants, and the behavior type can be a private conversation, an entertainment activity, walking, etc. Each behavior state corresponds to a different privacy level.

[0048] In one embodiment of the present embodiment, obtaining the residence position of the target object in the target place includes: obtaining image data collected by a camera; inputting the image data into a target detection model to output a target detection result; if a human body exists in the target detection result, obtaining an infrared signal collected by an infrared sensor and a pressure signal collected by a pressure sensor, wherein the pressure sensor is arranged on a floor layer of the target place; determining whether the triggering positions of the infrared signal and the pressure signal are the same; and if the triggering positions of the infrared signal and the pressure signal are the same, determining the triggering position of the infrared signal or the pressure signal as the residence position of the target object in the target place.

[0049] Optionally, the residence position can be a living room, a bedroom, a study, etc., and each position corresponds to a different privacy level.

[0050] The data source of the embodiment includes various types such as an RGB camera, a depth camera, a pressure sensor, an infrared sensor and the like. The RGB camera collects an RGB image, and an edge computing box outputs a target position (x, y, z), a behavior label (such as a private conversation), and a personnel identity (family member / stranger) in real time. The infrared sensor confirms the existence of a human body coordinate, and the pressure sensor feeds back whether a region is activated (for example, a study room floor pressure value greater than a threshold value indicates that a person is active). Kalman filtering is used to fuse visual coordinates and sensor data, eliminate single sensor errors (for example, when the camera is blocked, the position is assisted by the pressure sensor), and output an accurate position state vector.

[0051] A computer vision detection algorithm (such as YOLO target detection and LSTM behavior recognition) is used to analyze user behavior (such as a private conversation and visitor reception) and an activity state, combined with environmental sensor (infrared and pressure sensor) data, to construct a multi-modal scene recognition model, and to analyze a behavior label (such as a private conversation) and a personnel identity (family member / stranger).

[0052] By analyzing the behavior participants and the behavior type of the target object from the image data, the scheme of the embodiment improves the recognition ability and the environmental perception ability of the behavior state of the target object in the target place.

[0053] By using image data, infrared signals and pressure signals to perceive the residence position of the target object, the scheme of the embodiment improves the recognition accuracy of the object position and eliminates the error of a single sensor.

[0054] In the embodiment, configuring the scene privacy level of the user terminal according to the behavior state and the residence position includes: finding a position privacy level matched with the residence position in preset configuration data, and finding a behavior privacy level matched with the behavior state in preset configuration data; and configuring the scene privacy level of the user terminal according to the position privacy level and the behavior privacy level.

[0055] The space function area (such as a bedroom, a living room and a porch) of the target place can be labeled in advance through a mobile phone APP, and the position privacy level of each region (such as a high privacy level in a bedroom by default and a medium privacy level in a living room) is set. The behavior privacy level includes: a high privacy level (private conversation of a family member and being alone of a family member in a bedroom / study room); a medium privacy level (strange visitor in a public area (living room)); and a low privacy level (unmanned area and daily family activities).

[0056] The final output is {residence position (x, y), position sensitive level; behavior type, personnel identity set, behavior privacy level, time stamp}.

[0057] By adopting the scheme of the embodiment, the scene privacy level of the user terminal is configured by fusing the location privacy level and the behavior privacy level, the scene privacy level of the user terminal is simultaneously decided by the privacy levels of the user behavior and the user location, the accuracy of the scene privacy level is improved, and the perception ability of the privacy behavior in the place is improved.

[0058] In one example, configuring the scene privacy level of the user terminal according to the location privacy level and the behavior privacy level includes: if the location privacy level and the behavior privacy level are both high privacy levels, configuring a high privacy level for the user terminal; if the location privacy level or the behavior privacy level is a high privacy level, or, the location privacy level or the behavior privacy level is both a medium privacy level, configuring a medium privacy level for the user terminal; if the location privacy level or the behavior privacy level is a medium privacy level, or, the location privacy level or the behavior privacy level is both a low privacy level, configuring a low privacy level for the user terminal.

[0059] In the example, by the multi-modal decision tree model, the behavior privacy level of the behavior state (person identity, behavior type) is fused with the location privacy level of the resident location (such as whether the bedroom area is judged by the pressure sensor, the light intensity is detected by the infrared sensor) collected by the environment sensor, and a three-level privacy scene label is output: for example, if the area sensitivity level = high and the behavior type = private conversation, or the person identity set contains strangers and the location ∈ study, it is determined as a high privacy level; if the person identity set contains strangers and the location ∈ living room, or S. the behavior type = multi-person activity, it is determined as a medium privacy level; and other cases are low privacy levels.

[0060] By adopting the scheme of the embodiment, when the location privacy level and the behavior privacy level are both high privacy levels, a high privacy level is configured for the user terminal, when one of them is a high privacy level or both are medium privacy levels, a medium privacy level is configured, and when one of them is a medium privacy level or both are low privacy levels, a low privacy level is configured, the accuracy of the scene privacy level of the user terminal is improved, it is avoided to enter a higher scene privacy level when the risk is lower, data security is ensured while resource waste is avoided, and user experience and security are balanced.

[0061] In one implementation scenario, controlling the data transmission mode between the user terminal and the data server based on the scene privacy level includes: if the scene privacy level is a high privacy level, disabling the wireless transmission module of the data server, and controlling the data server to start the VLC (Visible Light Communication) module; and controlling the data server to transmit data to the user terminal through the VLC module.

[0062] In another implementation scenario, controlling the data transmission mode between the user terminal and the data server based on the scene privacy level includes: if the scene privacy level is a medium privacy level, limiting the transmission parameter of a wireless transmission module (such as a Wi-Fi / BLE (Bluetooth) module) of the data server, obtaining a limited parameter of the wireless transmission module, and reconfiguring the wireless transmission module based on the limited parameter; and controlling the data server to transmit data to the user terminal through the data server.

[0063] Optionally, limiting the transmission parameter of the wireless transmission module of the data server and obtaining the limited parameter of the wireless transmission module include: calculating the data transmission distance between the residence location and the data server, calculating the transmission power of the wireless transmission module with the data transmission distance as the maximum transmission radius, wherein the transmission power is positively correlated with the transmission range, determining whether the behavior participant includes strangers, and counting the number of strangers, if the behavior participant includes strangers, configuring an encryption algorithm, configuring the encryption level of the encryption algorithm based on the number of strangers, and the encryption level is positively correlated with the number of strangers. The limited parameter includes the transmission power and the encryption parameter (including the encryption algorithm and the encryption level, and the higher the encryption level, the more difficult it is to decipher).

[0064] In the embodiment, the generation logic of the different strategies of the scene privacy level is as follows: high privacy level: generating an instruction set {turning on VLC modulation, turning off Wi-Fi, encryption algorithm = AES-256, disabling device remote access}; medium privacy level: generating an instruction set {VLC backup, Wi-Fi transmission needs TLS encryption, encryption algorithm = AES-128, limiting visitor device permissions}; and low privacy level: generating an instruction set {normal Wi-Fi transmission, encryption algorithm = none (access control), open basic device control}.

[0065] By adopting the scheme of the embodiment, in a high privacy level scene, the wireless transmission module is disabled, and the VLC module is enabled to transmit data to the user terminal, thereby improving the security and confidentiality of the data and preventing the data server from being wirelessly intercepted and eavesdropped.

[0066] In one embodiment, controlling the data server to transmit data to the user terminal through the VLC module includes: positioning a visible light source in the area where the residence location is located; analyzing the data privacy level of the target user data to be transmitted; finding secret key data matched with the data privacy level; encrypting the target user data by using the secret key data to obtain encrypted data; calling the VLC module to modulate the encrypted data into a flicker frequency; and controlling the visible light source according to the flicker frequency.

[0067] Optionally, the target data of different data privacy levels is encrypted (or not encrypted) for targeted encryption processing, and the data levels are classified: high privacy data usually includes user's biometric information (such as fingerprint, facial recognition data), financial information (such as bank account data, payment records), private communication content and other data related to personal core privacy; medium privacy data, for example, user's daily browsing records, ordinary device usage data, etc.; low privacy data is some public or non-personal sensitive information data, such as non-personalized data collected by ordinary sensors in the home environment (indoor temperature, humidity, etc.).

[0068] The data server of the embodiment can be a local server of the home host. In the privacy data security system, VLC technology is used to realize physically isolated data transmission, ensuring that data is only transmitted within the light range, thereby avoiding data leakage through wireless signals (such as Wi-Fi or Bluetooth). The working process of VLC is as follows:

[0069] Data generation and encryption: image and audio data collected by smart devices (such as cameras, microphones, etc.) in the home host are first encrypted by the privacy protection module. These data will be converted into signals that can be transmitted through LED lights.

[0070] Data modulation and transmission: the encrypted data is embedded into the light signal of the LED light through modulation (for example: converting the encrypted data into flashing frequency or changing light intensity). Since the LED light source can flash frequently in a very short time and the human eye cannot perceive it, this flashing actually carries encrypted data.

[0071] Data reception and demodulation: other devices in the home (such as smartphones, tablets or home hosts) capture the light signal emitted by the LED light through light receiving sensors (such as photodiodes). Devices outside the visible light range cannot receive the light signal and cannot demodulate it. The receiving device demodulates the light signal to recover the original encrypted data and transmits it to the host for processing through a secure communication channel.

[0072] For mobile user terminals (such as smart phones, tablets, etc.), they do not need to directly support VLC communication, but only need to have demodulation capability. In the system, the user terminal acts as a data receiving and control role, rather than directly participating in the visible light communication transmission of data. The VLC technology relies on a home host or home lighting device (such as an LED lamp) for data transmission. Therefore, the role of the user terminal is to receive the transmitted data from the LED lamp signal and interact with the home host. The mobile terminal device mainly uses a light sensor (such as a camera, a photodiode, etc.) for data reception and decoding, and does not need to perform VLC modulation or light signal transmission. The visible light source of the VLC communication can be the LED light source of the room lighting, which is the carrier of the visible light communication. The LED lamp in the home can modulate the light intensity through a driving circuit to achieve the purpose of data transmission. The user's device (such as a smart phone or a smart home control panel) in the home environment receives the modulated signal from the LED light source and recovers the data through a demodulation process.

[0073] Since the mobile terminal generally does not have the modulation capability of the VLC mode, it has the demodulation capability of the VLC mode. In order to ensure the reliability of the mobile terminal data transmission, the mobile terminal can first send a data transmission request (used to indicate the data content to be transmitted) through a wireless mode such as wifi, and the data server can then send data to the mobile terminal through the VLC mode.

[0074] In one example, controlling the data server to transmit data to the user terminal through the VLC module includes: analyzing the terminal type of the user terminal; if the terminal type is a mobile terminal (such as a mobile phone, etc.), calling a wireless transmission module of the data server to receive the data transmission request of the mobile terminal, after receiving the data transmission request, switching the wireless transmission module of the data server to the VLC module, and controlling the data server to transmit data to the user terminal through the VLC module; if the terminal type is a fixed terminal (such as a central control screen, a television, etc.), controlling the data server to send a mode switching request (used to request the user terminal to switch to the VLC mode) to the user terminal through the VLC module, receiving the data transmission request sent by the user terminal through the VLC mode, and controlling the data server to transmit data to the user terminal through the VLC module, thereby ensuring the reliability of communication between the user terminal and the data server.

[0075] By using the scheme of the embodiment, the sensitive data transmission range is strictly limited within the light area by using visible light. External devices cannot intercept data through wireless signals, which significantly improves the physical security of data transmission, completely prohibits the possibility of remote interception and eavesdropping of data, and improves the security and privacy of the data transmission process by encrypting target user data with secret key data according to the data privacy level, avoiding local plaintext transmission, preventing local eavesdropping.

[0076] In the embodiment, after the scene privacy level of the user terminal is configured according to the behavior state and the residence position, if the scene privacy level is a high privacy level, the staying duration of the target object in the residence position is detected, and the access behavior of the user terminal to the data server is detected; whether the target object has an abnormal behavior is identified according to the staying duration and the access behavior; and if the target object has an abnormal behavior, a warning signal and / or a control instruction for the data server is generated, wherein the control instruction is used to instruct to turn off the power supply of the data server or interrupt the communication link between the data server and the user terminal.

[0077] Optionally, the access behavior can be a cracking behavior of an administrator login password of the data server or a plurality of attempts of administrator login behavior, or an access behavior of an unauthorized VLC terminal, or a plurality of access behaviors of a new user terminal, and the like. In the abnormal behavior detection algorithm, an abnormal behavior model is constructed based on an isolation forest, and the following is monitored in real time: a stranger stays in a sensitive area (such as a study) for more than 5 minutes; a same device attempts to crack a storage module access password for a plurality of times; and an unauthorized VLC signal receiving end is accessed (verified through a light signal MAC address).

[0078] When an abnormality is detected, a three-level response mechanism is triggered: a first-level warning (push terminal reminder), a second-level blocking (interrupt the current transmission), and a third-level physical lock (turn off the power supply of all modules, and needs a local key to unlock). The first-level warning: when the system detects some potential risks that may exist, but have not yet posed a direct threat to data security, the first-level warning is triggered. For example, a device without user authorization attempts to connect to the home network, but has not yet successfully obtained data access permission; or an abnormal network request mode is detected, but the system security line has not been broken through. At this time, the system reminds the user through the push terminal, informs the user of the possible security risks, and lets the user know in time and take appropriate measures, such as a sound and light alarm (home host buzzer + screen flicker). The second-level blocking: when the detected abnormal behavior has posed a direct threat to data transmission security, or there is a high risk of data leakage, the second-level blocking is triggered. For example, it is detected that a device continuously attempts to brute force crack the access password of the storage module, and the number of attempts exceeds a certain threshold; or it is found that an unauthorized VLC signal receiving end is accessed, which may cause data to be stolen. At this time, the system will immediately interrupt the current data transmission to prevent further data leakage and minimize the loss, such as transmission interruption (VLC module stops modulation, wireless module is physically powered off.

[0079] By adopting the scheme of the embodiment, the detection mechanism of abnormal behavior is added, frequent high-risk access and frequent high-privilege access to the data server are avoided, and the protection of the data server is realized.

[0080] Figure 3 is a workflow diagram of an embodiment of the application. After the system is started, user settings and environment calibration are performed, and then data acquisition is performed. The behavior state and position state of the acquisition are displayed on the user terminal. If there is an abnormal behavior, transmission is interrupted. If not, it is determined whether the scene is sensitive based on the acquired data, and the privacy level is determined, and then the corresponding strategy is executed, such as turning on the VLC and turning off the wifi, limiting the wifi, and not limiting the wifi.

[0081] After the system is started, user settings and environment settings are performed, and the initialization and scene modeling stage is performed. The user labels the functional areas of the home space (such as the bedroom, living room, and entrance) through the mobile phone APP, sets the privacy sensitivity level of each area (such as the bedroom defaulting to high privacy), and defines the special scene trigger conditions (such as detecting a stranger's face and entering the study, automatically triggering a high privacy mode). For physical layer calibration, the camera establishes the coordinate system of each room through Zhang Zhengyou's calibration method, determines the VLC lighting area boundary (such as the LED ceiling light covering a 5m x 5m rectangular area), collects the facial features of family members (with user authorization), and establishes a whitelist library (supporting dynamic updates, such as temporary authorization of new visitors). Real-time sensing and data fusion multi-source data acquisition, the camera collects RGB images, and the edge computing box outputs the target position (x, y, z), behavior label (such as private conversation), and personnel identity (family member / stranger) in real time. The environment sensors synchronously upload data: the infrared sensor confirms the existence of human coordinates, and the pressure sensor feedbacks whether the area is activated (such as the floor pressure value in the study being greater than the threshold value indicating that someone is active). Data fusion algorithm: Kalman filter is used to fuse visual coordinates and sensor data, eliminating single sensor errors (such as when the camera is blocked, the position is assisted by the pressure sensor), and outputting an accurate scene state vector. Then, the privacy level is determined: if S. area sensitivity level = high and S. behavior type = private conversation, or S. personnel identity set contains strangers and S. location ∈ study, it is determined as high privacy level; if S. personnel identity set contains strangers and S. location ∈ living room, or S. behavior type = multi-person activity, it is determined as medium privacy level; other cases are low privacy level. Then, the control logic is generated based on the scene privacy level: high privacy level: generate instruction set {turn on VLC modulation, turn off Wi-Fi, encryption algorithm = AES-256, disable device remote access}; medium privacy level: generate instruction set {VLC backup, Wi-Fi transmission requires TLS encryption, limit performance, encryption algorithm = AES-128, limit visitor device permissions}; low privacy level: generate instruction set {Wi-Fi normal transmission, encryption algorithm = none (access control), open basic device control}.

[0082] By adopting the scheme of the embodiment, the VLC module is integrated with the home host by constructing a regionalized data transmission protection mechanism based on visible light communication, the data transmission range is limited by the LED light source, and the user position is monitored in real time by combining the computer vision detection module to ensure that the data is transmitted only in the illumination area where the user is located. When the system determines to enter a high privacy scene, the wireless connection such as Wi-Fi is automatically turned off, and the transmission mode is switched to the VLC transmission mode to realize the data transmission safety at the physical isolation level. The physical isolation characteristics of visible light communication and the user position tracking technology of computer vision are deeply integrated to form a safe transmission link of "position awareness-dynamic switching of transmission mode", which breaks through the uncontrollable defect of signal coverage of traditional wireless communication. The sensitive data transmission range is strictly limited in the illumination area, and external devices cannot intercept data through wireless signals, which significantly improves the physical security of data transmission, and is especially suitable for privacy protection in private spaces such as bedrooms and study rooms in the home.

[0083] By adopting the scheme of the embodiment, the privacy protection regulation mechanism is used to analyze user behavior (such as private conversation, visitor reception) and activity state by using computer vision detection algorithm (such as YOLO target detection, LSTM behavior recognition), and a multi-modal scene recognition model is constructed by combining environmental sensor (infrared, pressure sensor) data. According to the identification result, the privacy level is dynamically adjusted, the differential encryption (such as AES-256 encryption of high privacy data and AES-128 encryption of general data) of the data is driven by the hierarchical encryption storage module, and the function permission (such as turning off the camera remote access in the high privacy mode) of the intelligent device is controlled. Through multi-modal data fusion, the fine understanding of the home scene is realized, the scene recognition limitation of a single sensor is broken through, and a closed-loop regulation system of "behavior analysis-level determination-strategy execution" is established, so that the privacy protection strategy has self-adaptability. The system can identify different privacy risk scenes in real time, automatically match the corresponding protection strategy (such as improving the encryption level in the visitor mode and shielding external connection in the private mode), ensure data security, avoid resource waste, and balance user experience and security.

[0084] Through the description of the above embodiments, those skilled in the art can clearly understand that the method according to the above embodiments can be realized by means of software and a general hardware platform as necessary, of course, it can also be realized by hardware, but in many cases the former is a better embodiment. Based on such understanding, the technical solutions of the present application can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes a plurality of instructions for causing a terminal device (which can be a mobile phone, computer, server, or network device) to execute the method described in each embodiment of the present application.

[0085] Embodiment 2

[0086] A data transmission mode control device and a home server are also provided in the embodiment, which are used to implement the above-mentioned embodiments and preferred embodiments, and will not be described herein. The term "module" as used below can be a combination of software and hardware that implements a predetermined function. Although the device described in the following embodiments is preferably implemented in software, implementation of hardware or a combination of software and hardware can also be conceived.

[0087] Figure 4 is a structural block diagram of a data transmission mode control device according to an embodiment of the present application, as shown in the figure, comprising: Figure 4

[0088] The acquisition module 41 is configured to acquire a behavior state of a target object in a target site and a residence position of the target object in the target site.

[0089] The configuration module 42 is configured to configure a scene privacy level of a user terminal according to the behavior state and the residence position, wherein the scene privacy level is used to indicate a data transmission range and a data encryption level when a data server of the target site transmits data to the user terminal, and the data server is used to store user data of the target site.

[0090] The control module 43 is configured to control a data transmission mode between the user terminal and the data server based on the scene privacy level.

[0091] Optionally, the acquisition module comprises: a first acquisition unit configured to acquire image data collected by a camera; an extraction unit configured to extract facial features and body features of the target object from the image data; and an analysis unit configured to analyze behavior participants of the target object by using the facial features and analyze a behavior type of the target object by using the body features, wherein the behavior state comprises the behavior participants and the behavior type.

[0092] Optionally, the acquisition module comprises: a first acquisition unit configured to acquire image data collected by a camera; a processing unit configured to input the image data into a target detection model and output a target detection result; a second acquisition unit configured to acquire an infrared signal collected by an infrared sensor and acquire a pressure signal collected by a pressure sensor if a human body exists in the target detection result, wherein the pressure sensor is arranged on a floor layer of the target site; a judgment unit configured to judge whether trigger positions of the infrared signal and the pressure signal are the same; and a determination unit configured to determine the trigger position of the infrared signal or the pressure signal as a residence position of the target object in the target site if the trigger positions of the infrared signal and the pressure signal are the same.

[0093] ​Optionally, the configuration module comprises: a searching unit, configured to search for a location privacy level matched with the residence location in preset configuration data, and search for a behavior privacy level matched with the behavior state in preset configuration data; and a configuration unit, configured to configure a scene privacy level of the user terminal according to the location privacy level and the behavior privacy level.

[0094] Optionally, the configuration unit comprises: a first configuration sub-unit, configured to configure a high privacy level for the user terminal if both the location privacy level and the behavior privacy level are high privacy levels; a second configuration sub-unit, configured to configure a medium privacy level for the user terminal if either the location privacy level or the behavior privacy level is a high privacy level, or both the location privacy level and the behavior privacy level are medium privacy levels; and a third configuration sub-unit, configured to configure a low privacy level for the user terminal if either the location privacy level or the behavior privacy level is a medium privacy level, or both the location privacy level and the behavior privacy level are low privacy levels.

[0095] Optionally, the control module comprises: a processing unit, configured to disable a wireless transmission module of the data server and control the data server to start a visible light communication (VLC) module if the scene privacy level is a high privacy level; and a control unit, configured to control the data server to transmit data to the user terminal through the VLC module.

[0096] Optionally, the control unit comprises: a positioning sub-unit, configured to position a visible light source in a region where the residence location is located; an analysis sub-unit, configured to analyze a data privacy level of target user data to be transmitted; a searching sub-unit, configured to search for secret key data matched with the data privacy level; an encryption sub-unit, configured to encrypt the target user data by using the secret key data to obtain encrypted data; a modulation sub-unit, configured to call the VLC module to modulate the encrypted data into a flickering frequency; and a control sub-unit, configured to control the visible light source according to the flickering frequency.

[0097] Optionally, the apparatus further comprises: a detection module, configured to detect a staying duration of the target object in the residence location and detect an access behavior of the user terminal to the data server if the scene privacy level is a high privacy level after the configuration module configures the scene privacy level of the user terminal according to the behavior state and the residence location; an identification module, configured to identify whether the target object has an abnormal behavior according to the staying duration and the access behavior; and a generation module, configured to generate an early warning signal and / or a control instruction for the data server if the target object has an abnormal behavior, wherein the control instruction is used to instruct to turn off a power supply of the data server or interrupt a communication link between the data server and the user terminal.

[0098] The embodiment also provides a home host, wherein the home host comprises the control device of the data transmission mode described in the above embodiment.

[0099] It should be noted that the above modules can be implemented by software or hardware, and for the latter, the following implementation manners can be used, but are not limited thereto: the above modules are located in the same processor; or the above modules are located in different processors in any combination.

[0100] Embodiment 3

[0101] The embodiment of the application also provides a storage medium, which stores a computer program, and the computer program is configured to execute the steps in any method embodiment described above when running.

[0102] Optionally, in the embodiment, the storage medium can be configured to store the computer program for execution.

[0103] S1, obtaining a behavior state of a target object in a target place and obtaining a residence position of the target object in the target place;

[0104] S2, configuring a scene privacy level of a user terminal according to the behavior state and the residence position, wherein the scene privacy level is used to indicate a data transmission range and a data encryption level when a data server of the target place transmits data to the user terminal, and the data server stores user data of the target place;

[0105] S3, controlling a data transmission mode between the user terminal and the data server based on the scene privacy level.

[0106] Optionally, in the embodiment, the storage medium can include but is not limited to a U disk, a read-only memory (ROM), a random access memory (RAM), a mobile hard disk, a magnetic disk or an optical disk and various storage media that can store computer programs.

[0107] The embodiment of the application also provides an electronic device, which comprises a memory and a processor, the memory stores a computer program, and the processor is configured to execute the computer program to execute the steps in any method embodiment described above.

[0108] Optionally, the electronic device can further comprise a transmission device and an input and output device, wherein the transmission device is connected with the processor, and the input and output device is connected with the processor.

[0109] Optionally, in the embodiment, the processor can be configured to execute the following steps by a computer program:

[0110] S1, obtaining a behavior state of a target object in a target site, and obtaining a residence position of the target object in the target site;

[0111] S2, configuring a scene privacy level of a user terminal according to the behavior state and the residence position, wherein the scene privacy level is used to indicate a data transmission range and a data encryption level when a data server of the target site transmits data to the user terminal, and the data server stores user data of the target site;

[0112] S3, controlling a data transmission mode between the user terminal and the data server based on the scene privacy level.

[0113] Optionally, specific examples in the embodiment can refer to examples described in the above embodiments and optional implementation manners, and the embodiment will not be described here.

[0114] The serial numbers of the embodiments of the application are only for description, and do not represent the advantages and disadvantages of the embodiments.

[0115] In the above embodiments of the application, the description of each embodiment has its own emphasis, and the parts not described in detail in a certain embodiment can refer to the related description of other embodiments.

[0116] In the several embodiments provided by the present application, it should be understood that the disclosed technology can be implemented in other ways. Of course, the unit embodiment described above is only schematic. For example, the division of the units is only a logical function division. There can be another division manner for actual implementation. For example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the displayed or discussed coupling or direct coupling or communication connection between the units can be indirect coupling or communication connection through some interface, or electrical or other form.

[0117] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they can be located in one place, or distributed on a plurality of network units. According to actual needs, some or all of the units can be selected to achieve the purpose of the embodiment.

[0118] In addition, each function unit in each embodiment of the present application can be integrated in one processing unit, or each unit can be physically present separately, or two or more units can be integrated in one unit. The integrated unit can be realized in the form of hardware or in the form of a software function unit.

[0119] If the integrated unit is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the present application, essentially or in the form of a contribution to the prior art, or all or part of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a storage medium, and includes several instructions for causing a computer device (which can be a personal computer, a controller, or a network device, etc.) to execute all or part of the steps of the methods in each embodiment of the present application. The foregoing storage medium includes: a U disk, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), a mobile hard disk, a magnetic disk or an optical disk, and various media that can store program codes.

[0120] The above is only the preferred embodiment of the present application, and it should be pointed out that, for those skilled in the art, without departing from the principles of the present application, a number of improvements and refinements can be made, and these improvements and refinements should be considered as the protection scope of the present application.

Claims

1. A method of controlling a data transmission mode, characterized by, The method comprises the following steps: obtaining the behavior state of the target object in the target place, and obtaining the residence position of the target object in the target place; configuring the scene privacy level of the user terminal according to the behavior state and the residence position, wherein the scene privacy level is used to indicate the data transmission range and data encryption level of the data server of the target place when transmitting data to the user terminal, and the data server is used to store the user data of the target place; controlling the data transmission mode between the user terminal and the data server based on the scene privacy level.

2. The method of claim 1, wherein, The method for obtaining the behavior state of the target object in the target place comprises the following steps: obtaining image data collected by a camera; extracting facial features and body features of the target object from the image data; analyzing the behavior participants of the target object by using the facial features, and analyzing the behavior type of the target object by using the body features, wherein the behavior state comprises the behavior participants and the behavior type.

3. The method of claim 1, wherein, The method for obtaining the residence position of the target object in the target place comprises the following steps: obtaining image data collected by a camera; inputting the image data into a target detection model to output a target detection result; if there is a human body in the target detection result, obtaining an infrared signal collected by an infrared sensor, and obtaining a pressure signal collected by a pressure sensor, wherein the pressure sensor is arranged on the floor layer of the target place; judging whether the triggering positions of the infrared signal and the pressure signal are the same; if the triggering positions of the infrared signal and the pressure signal are the same, determining the triggering position of the infrared signal or the pressure signal as the residence position of the target object in the target place.

4. The method of claim 1, wherein, The method for configuring the scene privacy level of the user terminal according to the behavior state and the residence position comprises the following steps: finding a position privacy level matched with the residence position in preset configuration data, and finding a behavior privacy level matched with the behavior state in preset configuration data; configuring the scene privacy level of the user terminal according to the position privacy level and the behavior privacy level.

5. The method of claim 4, wherein, The method for configuring the scene privacy level of the user terminal according to the position privacy level and the behavior privacy level comprises the following steps: if both the position privacy level and the behavior privacy level are high privacy levels, configuring a high privacy level for the user terminal; if either the position privacy level or the behavior privacy level is a high privacy level, or both the position privacy level and the behavior privacy level are medium privacy levels, configuring a medium privacy level for the user terminal; if either the position privacy level or the behavior privacy level is a medium privacy level, or both the position privacy level and the behavior privacy level are low privacy levels, configuring a low privacy level for the user terminal.

6. The method of claim 1, wherein, The method for controlling the data transmission mode between the user terminal and the data server based on the scene privacy level comprises the following steps: if the scene privacy level is a high privacy level, disabling the wireless transmission module of the data server, and controlling the data server to start a visible light communication (VLC) module; controlling the data server to transmit data to the user terminal through the VLC module.

7. The method of claim 6, wherein, controlling the data server to transmit data to the user terminal through the VLC module comprises: locating a visible light source in the area where the residence location is located; analyzing a data privacy level of target user data to be transmitted; finding secret key data matching the data privacy level; encrypting the target user data using the secret key data to obtain encrypted data; calling the VLC module to modulate the encrypted data into a flicker frequency; controlling the visible light source according to the flicker frequency.

8. The method of claim 1, wherein, After configuring the scene privacy level of the user terminal according to the behavior state and the residence location, the method further comprises: if the scene privacy level is a high privacy level, detecting a residence duration of the target object in the residence location and detecting an access behavior of the user terminal to the data server; according to the residence duration and the access behavior, identifying whether the target object has an abnormal behavior; if the target object has an abnormal behavior, generating an early warning signal and / or a control instruction to the data server, wherein the control instruction is used to instruct to turn off the power supply of the data server or interrupt the communication link between the data server and the user terminal.

9. A control device for a data transmission mode, characterized in that, comprises: an acquisition module configured to acquire a behavior state of a target object in a target place and acquire a residence location of the target object in the target place; a configuration module configured to configure a scene privacy level of a user terminal according to the behavior state and the residence location, wherein the scene privacy level is used to indicate a data transmission range and a data encryption level when a data server of the target place transmits data to the user terminal, and the data server stores user data of the target place; a control module configured to control a data transmission mode between the user terminal and the data server based on the scene privacy level.

10. A home server, characterized by comprising: wherein the home server comprises the data transmission mode control device of claim 8.

11. A storage medium, characterized by A computer program is stored in a storage medium, wherein the computer program is configured to execute the steps of the data transmission mode control method of any one of claims 1 to 8 when running.

12. An electronic device comprising a processor, a communication interface, a memory and a communication bus, wherein, The processor, the communication interface, and the memory complete mutual communication through a communication bus; wherein: the memory is configured to store a computer program; the processor is configured to execute the steps of the data transmission mode control method of any one of claims 1 to 8 by running the program stored in the memory. the processor is configured to execute the steps of the data transmission mode control method of any one of claims 1 to 8 by running the program stored in the memory.

Images