Data processing method, device, electronic device and computer readable storage medium

Abstract

The present application provides a data processing method, device, electronic device and computer-readable storage medium. The method establishes a connection with a target device when a preset instruction is detected, receives session data sent by the target device, and silently processes the session data to obtain silent session data, and finally detects the real session operation, and processes the silent session data according to the detection result. The method allows the session data to run in the background in advance by establishing a connection with the target device in advance and silently processing the session data, so that after the real session operation is detected, the session data can be quickly displayed, thereby improving the user experience.

Description

Technical Field

[0001] The present application relates to the field of video call technology, and in particular to a data processing method, device, electronic device and computer-readable storage medium. Background Art

[0002] Nowadays, many smart homes have the function of video calling. After the user terminal is connected to the smart home device, the user can actively initiate a video call through the relevant APP to communicate with family members or check the situation in front of the smart home device.

[0003] However, when a user actively initiates a video call to a smart home device through the relevant APP of the user terminal, it usually takes several seconds to actually establish a video call with the smart home device and see the video screen due to the complexity of the video call process and factors such as network quality. When an abnormal situation occurs and the user wants to see the current situation immediately, these few seconds seem particularly long, resulting in a poor user experience.

[0004] Therefore, it is necessary to provide a data processing method to alleviate the technical problem of long waiting time for picture display during current video calls, thereby improving user experience. Summary of the invention

[0005] The present application provides a data processing method, device, electronic device and computer-readable storage medium, which are used to alleviate the technical problem of long waiting time for screen display during current video calls, thereby improving user experience.

[0006] In order to solve the above technical problems, this application provides the following technical solutions:

[0007] The present application provides a data processing method, comprising:

[0008] When a preset instruction is detected, a connection is established with the target device;

[0009] receiving the session data sent by the target device, and performing silent processing on the session data to obtain silent session data;

[0010] The real session operation is detected, and the silent session data is processed according to the detection result.

[0011] Accordingly, the present application also provides a data processing device, comprising:

[0012] A connection establishing unit, configured to establish a connection with a target device when a preset instruction is detected;

[0013] a silent processing unit, configured to receive the session data sent by the target device, and perform silent processing on the session data to obtain silent session data;

[0014] The detection unit is used to detect the real session operation and process the silent session data according to the detection result.

[0015] At the same time, the present application provides an electronic device, which includes a processor and a memory, the memory is used to store a computer program, and the processor is used to run the computer program in the memory to execute the steps in the above-mentioned data processing method.

[0016] In addition, the present application also provides a computer-readable storage medium, which stores multiple instructions, and the instructions are suitable for a processor to load to execute the steps in the above-mentioned data processing method.

[0017] Beneficial effects: The present application provides a data processing method, device, electronic device and computer-readable storage medium. Specifically, the method establishes a connection with the target device when a preset instruction is detected, receives the session data sent by the target device, and silently processes the session data to obtain silent session data, and finally detects the real session operation, and processes the silent session data according to the detection result. The method establishes a virtual connection with the target device in advance when a preset instruction is detected, and silently processes the session data to obtain silent session data, so that the video call established in advance runs in the background and the user cannot perceive it. After detecting the real session operation, there is no need to re-establish a connection with the target device, but directly restore the silent session data to obtain the session data, thereby achieving the purpose of quickly displaying the session data and improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The technical solution and other beneficial effects of the present application will be made apparent by describing in detail the specific implementation methods of the present application in conjunction with the accompanying drawings.

[0019] Figure 1 It is a system architecture diagram of the data processing system provided in an embodiment of the present application.

[0020] Figure 2 It is a flow chart of the data processing method provided in the embodiment of the present application.

[0021] Figure 3 It is another flow chart of the data processing method provided in the embodiment of the present application.

[0022] Figure 4 This is a schematic diagram of an interface of a user terminal provided in an embodiment of the present application.

[0023] Figure 5 It is a schematic diagram of the interface of the device control page provided in the embodiment of the present application.

[0024] Figure 6It is a structural diagram of a data processing device provided in an embodiment of the present application.

[0025] Figure 7 It is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0026] The technical solutions in the embodiments of the present application will be described clearly and completely below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present application.

[0027] The terms "including" and "having" and any variations thereof in the specification and claims of this application are intended to cover non-exclusive inclusions; the division of modules appearing in this application is merely a logical division, and there may be other division methods when implemented in actual applications, for example, multiple modules may be combined or integrated into another system, or some features may be ignored or not executed.

[0028] In the present application, the preset instructions include a user opening a device control page in a corresponding application through a user terminal, and also include an application in the user terminal receiving an abnormal event message pushed by the Internet of Things (IOT) cloud.

[0029] In this application, session data refers to communication data such as video data and voice data transmitted after the target device establishes a communication connection with the user terminal through an audio and video module such as a camera.

[0030] In the present application, the silent processing includes turning off the video data display, performing silent processing on the voice data, etc.

[0031] In the present application, the real session operation refers to the operation of clicking a session initiation control performed by a user in a corresponding application through a user terminal, or the operation of touching a session button performed through a user terminal, etc.

[0032] The present application provides a data processing method, device, electronic device and computer-readable storage medium.

[0033] See also Figure 1 , Figure 1 is a schematic diagram of the system architecture of the data processing system provided by this application, such as Figure 1 As shown, the data processing system at least includes a target device 101, a storage server 102 and a user terminal 103, wherein:

[0034] A communication link is provided between the target device 101, the storage server 102 and the user terminal 103 to realize information exchange. The type of the communication link may include a wired or wireless communication link or an optical fiber cable, etc., which is not limited in this application.

[0035] The target device 101 may be a smart device equipped with an audio / video module and a communication module and having abnormality monitoring functions; for example, a smart door lock, a smart doorbell, a smart speaker, and a smart refrigerator.

[0036] The storage server 102 can be an independent server or a server network or server cluster composed of servers; for example, the server described in this application includes but is not limited to a computer, a network host, a database server, and an application server or a cloud server composed of multiple servers, wherein the cloud server is composed of a large number of computers or network servers based on cloud computing (Cloud Computing).

[0037] The user terminal 103 may be a smart phone, tablet computer, laptop computer, wearable device, remote control or other device with a smart home application.

[0038] The present application proposes a data processing system, which includes a target device, a storage server, and a user terminal. Specifically, when the smart home application in the user terminal detects a preset instruction, a virtual session instruction is issued to establish a connection with the target device. At this time, the virtual reply instruction only has a session initiation function. The interface of the smart home application in the user terminal is actually unchanged, which is equivalent to running a session connection in the background. After the connection is successfully established, the user terminal receives the session data sent by the target device, and silently processes the session data to obtain silent session data. Finally, the user terminal detects whether the user has performed a real session operation, and processes the silent session data according to the detection result.

[0039] In the above data processing process, when the smart home application detects a preset instruction (for example, opening the corresponding device control page through the smart home application in the user terminal, or receiving an abnormal situation push), it will actively initiate a virtual session request to the target device. At this time, the target device will accept the request by default and send the session data to the user terminal. In order to make the user imperceptible, the session data needs to be processed silently (for example, turning off the screen display of video data, muting the voice data, etc.). When the user operates the smart home application to initiate a real session request, the smart home application will turn on the screen display of the video data and cancel the mute processing to reduce the user's waiting time in the process of initiating the session and achieve the effect of opening the session in seconds.

[0040] It should be noted that Figure 1The system architecture diagram shown is only an example. The server, terminal, device and scenario described in the embodiment of the present application are intended to more clearly illustrate the technical solution of the embodiment of the present application, and do not constitute a limitation on the technical solution provided in the embodiment of the present application. It is known to those skilled in the art that with the evolution of the system and the emergence of new business scenarios, the technical solution provided in the embodiment of the present application is also applicable to similar technical problems. The following are described in detail. It should be noted that the description order of the following embodiments is not intended to limit the preferred order of the embodiments.

[0041] Based on the system architecture of the above data processing system, the data processing method in this application will be introduced in detail below. Figure 2 As shown, Figure 2 The data processing method in the present application is described in detail below. The method includes at least the following steps:

[0042] S201: When a preset instruction is detected, a connection is established with a target device.

[0043] The preset instruction can be that the user opens the device control page (such as Figure 4 As shown, the device control page is opened from the "Device Control Page Portal" in the smart home application interface), or the application in the user terminal receives an abnormal event message pushed by the Internet of Things (IOT) cloud. Among them, since the target device has an abnormal monitoring function, when the target device detects an abnormal situation (including a person who is not recognized by the system appearing in the monitoring range for 1 minute, a lock core abnormality, and a door lock is damaged, etc.), an abnormal event will be reported to the Internet of Things cloud, and then the Internet of Things cloud will push the message to the smart home application of the user terminal.

[0044] In one embodiment, when the smart home application in the user terminal detects the above-mentioned preset instructions, it is necessary to establish a connection with the target device in advance, and the specific steps of establishing the connection include: obtaining the preset instructions; generating a virtual session instruction when the preset instructions are detected; sending the virtual session instruction to the target device to establish a connection with the target device. Among them, the smart home application generally obtains the preset instructions through the system default / manual setting method, and then generates a virtual session instruction when the relevant preset instructions are detected, and sends the virtual session instruction to the target device to establish a virtual connection with the target device. As the name implies, the virtual session instruction is not a real session instruction. The instruction only has the function of initiating a session and establishing a communication connection with the target device, which is equivalent to running all the session data in the background. It will not be displayed in the front-end interface, and no sound will be made for the user to perceive.

[0045] In the above process, the smart home application can send a virtual session request for live video broadcast with the target device. Specifically, the live broadcast solution can use technologies such as WebRTC technology, RTMP and UDP. Among them, WebRTC technology is web instant communication, which is an API that supports web browsers for real-time voice or video conversations. Its advantage is that the user experience is good, and there is no need to install anything. You can watch it by sharing a link. However, WebRTC has high bandwidth requirements for the target device / user terminal. Since it is necessary to encode and decode multiple channels of video, the device configuration requirements for the target device / user terminal are also high; for RTMP technology, the access cost of this technology is relatively low, but the disadvantages are also obvious. For example, when the two ends interact, the sound will interfere and form an echo; for another example, the transmission delay during the two-end interaction is large, and it consumes a lot of resources such as CPU; while UDP technology can achieve relatively low latency, but its compatibility is poor.

[0046] S202: receiving session data sent by the target device, and performing silent processing on the session data to obtain silent session data.

[0047] In order to achieve the effect of opening the real conversation in seconds when the user initiates it, the smart home application establishes a virtual conversation connection with the target device after detecting the preset command. With the connection, there will be data interaction between the target device and the smart home application. Therefore, the smart home application receives the conversation data sent by the target device. In order to prevent the user from perceiving that a communication connection has been established with the target device in advance, the received conversation data needs to be processed silently. The silent processing includes turning off the video screen display so that the current video data cannot be displayed in the current interface, and also includes muting the audio data so that the user cannot hear the current audio.

[0048] S203: Detect the real conversation operation, and process the silent conversation data according to the detection result.

[0049] In one embodiment, after the target device establishes a virtual session connection with the smart home application in the user terminal, the processed silent session data is equivalent to running in the background of the user terminal, and the smart home application will process the silent session data by detecting the detection results of the real session operation, and the specific steps include: obtaining the connection establishment time and the preset connection duration; determining the connection end time according to the connection establishment time and the preset connection duration; detecting the real session operation within the interval between the connection establishment time and the connection end time, and processing the silent session data according to the detection results. Among them, the connection establishment time is the time when the smart home application establishes a virtual session with the target device; the preset connection duration is the duration set by the countdown timer, and the duration of the timer can be the system default duration (for example, 3 minutes), and can also be set manually according to needs.

[0050] For example, the target device detects an abnormal situation of damaging the door lock and sends a message push to the smart home application through the IoT cloud. The smart home application and the target device successfully establish a virtual session connection at 9:00. The connection establishment time is 9:00, and the system default preset connection duration is 3 minutes. According to the connection establishment time and the preset connection duration, the connection deadline can be determined to be 9:03. Therefore, it is necessary to process the silent session data according to the detection results of the real session operation of the smart home application in the time period from 9:00 to 9:03.

[0051] Furthermore, if a real session operation is detected in the interval between the connection establishment time and the connection termination time, the silent session data is restored, and the specific steps include: detecting the real session operation in the interval between the connection establishment time and the connection termination time to obtain the detection result; when the detection result indicates that the real session operation is detected, the silent session data is restored to obtain and display the session data. The restoration process refers to opening the video screen display interface to display the video data, and canceling the aforementioned mute process to play the current audio data. Therefore, the session data before the mute process can be obtained through the restoration process.

[0052] Specifically, the steps of restoring the data and displaying the session data include: generating a real session instruction when the detection result indicates that a real session operation is detected; in response to the real session instruction, restoring the silent session data to obtain the session data; and displaying the session data in the current interface. That is, when a real session operation is detected within the interval between the connection establishment time and the connection termination time, the smart home application will actively generate a real session instruction and send the real session instruction to the control module in the user terminal, and the control module will respond to the real session instruction and restore the running silent session data (including opening the video screen display and canceling the mute processing) to obtain the session data before the mute processing, and directly display the session data in the current interface, so that the user can quickly see the session screen and hear the session audio after initiating the real session.

[0053] Furthermore, if no real session operation is detected within the interval between the connection establishment time and the connection end time, it is necessary to close the session connection and release resources to avoid continuous data interaction between the target device and the smart home application, which causes power consumption. The specific steps include: detecting the real session operation within the interval between the connection establishment time and the connection end time to obtain the detection result; when the detection result indicates that no real session operation is detected, generating a connection cancellation instruction and sending it to the target device to cancel the connection with the target device.

[0054] In the above process, the user can perform real conversation operations through the smart home application by Figure 5 This is implemented by the “Click to view home door” control in the device control page shown.

[0055] In addition, in order to allow users to view historical session data, the session data can also be stored in a storage server. Specifically, it can be classified and stored according to the time / type of the session data, which is convenient for users to view.

[0056] In one embodiment, the data processing flow is described by taking the session type of live video as an example, namely: when the user actively opens the device control page or the smart home application receives an abnormal message, the smart home application initiates a live video (i.e., a virtual session) in advance, and hides the video player and mutes the sound so that the user cannot perceive it. When the user operates the smart home application to open the live video, the video player is displayed and the sound muting is turned off, so that the user can quickly see the live broadcast screen.

[0057] For a clear description of the entire data processing flow, please refer to Figure 3 , Figure 3 Another flow chart of the data processing method provided in the embodiment of the present application, the specific flow can be as follows:

[0058] S301: Start.

[0059] Before the smart home application communicates with the target device, it needs to go through network configuration. The network configuration process can be that the user terminal transmits the WIFI password to the target device through the smart home application. After the target device is connected to the network, it is associated with the account in the smart home application. Then the smart home application and the target device can interact through the cloud or through the local area network.

[0060] S302: Detecting a preset instruction.

[0061] After the smart home application establishes a communication connection with the target device, the preset instructions are obtained by the system default / manual setting method, and then the relevant preset instructions are detected. Among them, the preset instructions can be the user opening the device control page in the corresponding application through the user terminal, or the application in the user terminal receives an abnormal event message pushed by the Internet of Things (IOT) cloud.

[0062] S303: Establishing a connection with the target device.

[0063] When the above preset instruction is detected, a virtual session instruction is generated (only the session initiation function is available, it will not be displayed in the front-end interface, and no sound will be emitted for the user to perceive), and the virtual session instruction is sent to the target device to establish a virtual connection with the target device. At the same time, a countdown timer with a preset time (for example, 3 minutes) is set.

[0064] S304: receiving session data, and performing silent processing on the session data to obtain silent session data.

[0065] After the connection is established, data will be exchanged between the target device and the smart home application. Therefore, the smart home application receives the session data sent by the target device. In order to prevent the user from being aware that a communication connection has been established with the target device in advance, the received session data needs to be muted. The muting process includes turning off the video screen display so that the current video data cannot be displayed in the current interface, and muting the audio data so that the user cannot hear the current audio.

[0066] S305: Detecting real session operations.

[0067] After the target device establishes a virtual session connection with the smart home application in the user terminal, it is necessary to detect whether the user performs a real session operation through the smart home application.

[0068] S306: Determine whether a real session operation is detected within the countdown.

[0069] Since a countdown timer with a preset time (which can be set according to actual conditions) is also set when the virtual session connection is established with the target device, the countdown starts from the moment the virtual session is established, and it is detected whether the user performs a real session operation during the countdown.

[0070] For example, the smart home application successfully establishes a virtual session connection with the target device at 10:00 and sets a 5-minute countdown timer. Therefore, it is determined whether a real session operation is detected during the time period from 10:00 to 10:05.

[0071] If a real session operation is detected within the time period, S307 is executed: the silent session data is restored, the session data is obtained and displayed, and the countdown is canceled.

[0072] Specifically, the smart home application will actively generate a real conversation instruction and send the real conversation instruction to the control module in the user terminal. The control module responds to the real conversation instruction and restores the running silent conversation data (including opening the video screen display and canceling the mute process) to obtain the conversation data before the silent process, and directly displays the conversation data in the current interface, so that the user can quickly see the conversation screen and hear the conversation audio after initiating a real conversation. At the same time, the countdown timer function needs to be canceled so that the user can use the conversation function normally.

[0073] If no real session operation is detected within the time period, S308 is executed: disconnecting the session connection with the target device to release resources.

[0074] Specifically, if no real session operation is detected between the connection establishment time and the connection termination time, a connection cancellation instruction needs to be generated and sent to the target device to cancel the connection with the target device (i.e., close the session connection), release resources, and avoid continuous data interaction between the target device and the smart home application, which causes power consumption.

[0075] S309: End.

[0076] The data processing method provided in this application can enable the video live broadcast function in advance according to the user's operation path, so as to achieve the effect of starting the video live broadcast in seconds, avoiding the need to wait for a long time for the live broadcast to be displayed in an emergency.

[0077] Based on the content of the above embodiment, the embodiment of the present application provides a data processing device, which can be set in a user terminal. The data processing device is used to execute the data processing method provided in the above method embodiment. Specifically, please refer to Figure 6 , the device comprises:

[0078] The connection establishing unit 601 is used to establish a connection with a target device when a preset instruction is detected;

[0079] A silent processing unit 602 is used to receive the session data sent by the target device and perform silent processing on the session data to obtain silent session data;

[0080] The detection unit 603 is used to detect the real session operation and process the silent session data according to the detection result.

[0081] In one embodiment, the connection establishing unit 601 includes:

[0082] An instruction acquisition unit, used for acquiring preset instructions;

[0083] An instruction generating unit, configured to generate a virtual session instruction when the preset instruction is detected;

[0084] The instruction sending unit is used to send the virtual session instruction to the target device to establish a connection with the target device.

[0085] In one embodiment, the silence processing unit 602 includes:

[0086] A first acquisition unit, used to acquire a connection establishment time and a preset connection duration;

[0087] A first determining unit, configured to determine a connection expiration time according to the connection establishment time and the preset connection duration;

[0088] The first processing unit is used to detect the real session operation within the interval between the connection establishment time and the connection termination time, and process the silent session data according to the detection result.

[0089] In one embodiment, the first processing unit includes:

[0090] A first result acquisition unit, configured to detect a real session operation within a period between the connection establishment time and the connection termination time, and obtain a detection result;

[0091] The restoration processing unit is used to restore the silent session data when the detection result indicates that the real session operation is detected, so as to obtain and display the session data.

[0092] In one embodiment, the restoration processing unit includes:

[0093] a real conversation instruction generating unit, configured to generate a real conversation instruction when the detection result indicates that the real conversation operation is detected;

[0094] An instruction response unit, configured to respond to the real session instruction, restore the silent session data, and obtain the session data;

[0095] The data display unit is used to display the session data in the current interface.

[0096] In one embodiment, the first processing unit further includes:

[0097] A second result acquisition unit, configured to detect a real session operation within the interval between the connection establishment time and the connection termination time, and obtain a detection result;

[0098] The connection canceling unit is configured to generate a connection canceling instruction and send the instruction to the target device to cancel the connection with the target device when the detection result indicates that the real session operation is not detected.

[0099] In one embodiment, the data processing device further includes:

[0100] The storage unit is used to store the session data in a storage server.

[0101] The data processing device of the embodiment of the present application can be used to execute the technical solution of the aforementioned method embodiment. Its implementation principle and technical effect are similar and will not be repeated here.

[0102] Different from the current technology, the data processing device provided by the present application is provided with a connection establishment unit and a silent processing unit. The connection establishment unit is used to establish a virtual connection with the target device in advance, and then the silent processing unit is used to receive the session data sent by the target device, and the silent processing unit is used to silently process the session data to obtain the silent session data, so that the video call established in advance can run in the background without being perceived by the user. Therefore, after detecting the real session operation, there is no need to re-establish the connection with the target device, but the silent session data is directly restored to obtain the session data, thereby achieving the purpose of quickly displaying the session data and improving the user experience.

[0103] Accordingly, the present application also provides an electronic device, such as Figure 7 As shown, the electronic device may include a processor 701 having one or more processing cores, a wireless (WiFi, Wireless Fidelity) module 702, a memory 703 having one or more computer-readable storage media, an audio circuit 704, a display unit 705, an input unit 706, a sensor 707, a power supply 708, and a radio frequency (RF, Radio Frequency) circuit 709 and other components. Those skilled in the art will understand that Figure 7The structure of the electronic device shown in the figure does not constitute a limitation on the electronic device, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0104] The processor 701 is the control center of the electronic device. It uses various interfaces and lines to connect various parts of the entire electronic device. By running or executing software programs and / or modules stored in the memory 703 and calling data stored in the memory 703, it executes various functions of the electronic device and processes data, thereby monitoring the electronic device as a whole. In one embodiment, the processor 701 may include one or more processing cores; preferably, the processor 701 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 701.

[0105] WiFi is a short-range wireless transmission technology. Electronic devices can help users send and receive emails, browse web pages, and access streaming media through wireless modules 702. It provides users with wireless broadband Internet access. Figure 7 The wireless module 702 is shown, but it is understandable that it is not an essential component of the terminal and can be omitted as required without changing the essence of the invention.

[0106] The memory 703 can be used to store software programs and modules. The processor 701 executes various functional applications and data processing by running the computer programs and modules stored in the memory 703. The memory 703 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area may store data created according to the use of the terminal (such as audio data, a phone book, etc.), etc. In addition, the memory 703 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices. Accordingly, the memory 703 may also include a memory controller to provide the processor 701 and the input unit 706 with access to the memory 703.

[0107] The audio circuit 704 includes a speaker, which can provide an audio interface between the user and the electronic device. The audio circuit 704 can transmit the electrical signal converted from the received audio data to the speaker, which is converted into a sound signal for output; on the other hand, the speaker converts the collected sound signal into an electrical signal, which is received by the audio circuit 704 and converted into audio data, and then the audio data is output to the processor 701 for processing, and then sent to another electronic device through the radio frequency circuit 709, or the audio data is output to the memory 703 for further processing. The audio circuit 704 may also include an earplug jack to provide communication between an external headset and the electronic device.

[0108] The display unit 705 can be used to display information input by the user or information provided to the user and various graphical user interfaces of the terminal, which can be composed of graphics, text, icons, videos and any combination thereof. The display unit 705 may include a display panel. In one embodiment, the display panel may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like. Furthermore, the touch-sensitive surface may cover the display panel. When the touch-sensitive surface detects a touch operation on or near it, it is transmitted to the processor 701 to determine the type of touch event. Subsequently, the processor 701 provides corresponding visual output on the display panel according to the type of touch event. Although in Figure 7 In the embodiment, the touch-sensitive surface and the display panel are implemented as two independent components to realize input and output functions, but in some embodiments, the touch-sensitive surface and the display panel can be integrated to realize input and output functions.

[0109] The input unit 706 can be used to receive input digital or character information, and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control. Specifically, in a specific embodiment, the input unit 706 may include a touch-sensitive surface and other input devices. The touch-sensitive surface, also known as a touch display screen or a touch pad, can collect the user's touch operations on or near it (such as the user's operation on or near the touch-sensitive surface using any suitable object or accessory such as a finger, a stylus, etc.), and drive the corresponding connection device according to a pre-set program. In one embodiment, the touch-sensitive surface may include a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into the touch point coordinates, and then sends it to the processor 701, and can receive and execute the command sent by the processor 701. In addition, the touch-sensitive surface can be implemented using multiple types such as resistive, capacitive, infrared and surface acoustic waves. In addition to the touch-sensitive surface, the input unit 706 may also include other input devices. Specifically, other input devices may include, but are not limited to, one or more of a physical keyboard, function keys (such as a volume control key, a switch key, etc.), a trackball, a mouse, a joystick, and the like.

[0110] The electronic device may also include at least one sensor 707, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a distance sensor, wherein the ambient light sensor may adjust the brightness of the display panel according to the brightness of the ambient light (the proximity sensor may turn off the display panel and / or backlight when the terminal is moved to the ear. As a type of motion sensor, the gravity acceleration sensor can detect the magnitude of acceleration in all directions (generally three axes), and can detect the magnitude and direction of gravity when stationary. It can be used for applications that identify the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.); as for other sensors that may be configured in the electronic device, such as gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., they will not be repeated here.

[0111] The electronic device also includes a power supply 708 (such as a battery) for supplying power to each component. Preferably, the power supply can be logically connected to the processor 701 through a power management system, so that the power management system can manage charging, discharging, and power consumption management. The power supply 708 can also include one or more DC or AC power supplies, recharging systems, power failure detection circuits, power converters or inverters, power status indicators, and other arbitrary components.

[0112] The radio frequency circuit 709 can be used for receiving and sending signals during the process of sending and receiving information or making calls. In particular, after receiving the downlink information of the base station, it is handed over to one or more processors 701 for processing; in addition, the data related to the uplink is sent to the base station. Usually, the radio frequency circuit 709 includes but is not limited to an antenna, at least one amplifier, a tuner, one or more oscillators, a subscriber identity module (SIM, Subscriber Identity Module) card, a transceiver, a coupler, a low noise amplifier (LNA, Low Noise Amplifier), a duplexer, etc. In addition, the radio frequency circuit 709 can also communicate with the network and other devices through wireless communication. Wireless communication can use any communication standard or protocol, including but not limited to Global System of Mobile Communication (GSM, Global System of Mobile communication), General Packet Radio Service (GPRS, General Packet Radio Service), Code Division Multiple Access (CDMA, Code Division Multiple Access), Wideband Code Division Multiple Access (WCDMA, Wideband Code Division Multiple Access), Long Term Evolution (LTE, Long Term Evolution), email, Short Messaging Service (SMS, Short Messaging Service), etc.

[0113] Although not shown, the electronic device may also include a camera, a Bluetooth module, etc., which will not be described in detail here. Specifically in this embodiment, the processor 701 in the electronic device will load the executable files corresponding to the processes of one or more applications into the memory 703 according to the following instructions, and the processor 701 will run the application stored in the memory 703, thereby realizing the following functions:

[0114] When a preset instruction is detected, a connection is established with the target device;

[0115] receiving the session data sent by the target device, and performing silent processing on the session data to obtain silent session data;

[0116] The real session operation is detected, and the silent session data is processed according to the detection result.

[0117] A person of ordinary skill in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be completed by instructions, or by controlling related hardware through instructions. The instructions may be stored in a computer-readable storage medium and loaded and executed by a processor.

[0118] To this end, an embodiment of the present application provides a computer-readable storage medium, in which multiple instructions are stored, and the instructions can be loaded by a processor to implement the functions of the above-mentioned data processing method.

[0119] The computer-readable storage medium may include: a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0120] The data processing method, device, electronic device and computer-readable storage medium provided in the embodiments of the present application are introduced in detail above. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea; at the same time, for technical personnel in this field, according to the idea of ​​the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A data processing method, characterized in that: include: When a preset instruction is detected, a connection is established with the target device; Receiving the session data sent by the target device, and performing silent processing on the session data to obtain silent session data, wherein the silent processing includes closing the video data display and performing silent processing on the voice data; Detecting the real session operation, and restoring the silent session data according to the detection result; The step of detecting the real session operation and restoring the silent session data according to the detection result includes: Get the connection establishment time and preset connection duration; Determining a connection end time according to the connection establishment time and the preset connection duration; The real session operation is detected within the interval between the connection establishment time and the connection termination time, and the silent session data is restored according to the detection result.

2. The data processing method according to claim 1, characterized in that: The step of establishing a connection with the target device when a preset instruction is detected includes: Get preset instructions; When the preset instruction is detected, a virtual session instruction is generated; The virtual session instruction is sent to a target device to establish a connection with the target device.

3. The data processing method according to claim 1, characterized in that: The step of detecting the real session operation within the interval between the connection establishment time and the connection termination time, and processing the silent session data according to the detection result, comprises: Detecting a real session operation within the interval between the connection establishment time and the connection termination time to obtain a detection result; When the detection result indicates that the real session operation is detected, the silent session data is restored to obtain and display the session data.

4. The data processing method according to claim 3, characterized in that: When the detection result indicates that the real session operation is detected, the step of restoring the silent session data to obtain and display the session data includes: When the detection result indicates that the real conversation operation is detected, generating a real conversation instruction; In response to the real session instruction, the silent session data is restored to obtain the session data; The session data is displayed in the current interface.

5. The data processing method according to claim 1, characterized in that: The step of detecting the real session operation within the interval between the connection establishment time and the connection termination time, and processing the silent session data according to the detection result, comprises: Detecting a real session operation within the interval between the connection establishment time and the connection termination time to obtain a detection result; When the detection result indicates that the real session operation is not detected, a connection cancellation instruction is generated and sent to the target device to cancel the connection with the target device.

6. The data processing method according to claim 1, characterized in that: Also includes: The session data is stored in a storage server.

7. A data processing device, characterized in that: include: A connection establishing unit, configured to establish a connection with a target device when a preset instruction is detected; A silent processing unit, configured to receive the session data sent by the target device, and perform silent processing on the session data to obtain silent session data, wherein the silent processing includes closing the display of video data and performing silent processing on voice data; A detection unit, used to detect the real session operation and restore the silent session data according to the detection result; The step of detecting the real session operation and restoring the silent session data according to the detection result includes: Get the connection establishment time and preset connection duration; Determining a connection end time according to the connection establishment time and the preset connection duration; The real session operation is detected within the interval between the connection establishment time and the connection termination time, and the silent session data is restored according to the detection result.

8. An electronic device, characterized in that: It comprises a processor and a memory, wherein the memory is used to store a computer program, and the processor is used to run the computer program in the memory to execute the steps in the data processing method according to any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a plurality of instructions, and the instructions are suitable for being loaded by a processor to execute the steps in the data processing method according to any one of claims 1 to 6.

Images