Data processing method and device, electronic equipment and computer readable medium

Abstract

The invention discloses a data processing method and device, electronic equipment and a computer readable medium, and relates to the technical field of mobile terminals, the data processing method and device are applied to first equipment, the first equipment is connected with at least one second equipment, the at least one second equipment comprises an intelligent display terminal, and the first equipment is further connected with image acquisition equipment. The method comprises the following steps: when the intelligent display terminal is in a video conference scene, acquiring posture information of a user acquired by the image acquisition equipment; determining a target device to be operated from the at least one second device based on the attitude information; and controlling the target equipment to execute specified operation. Therefore, aiming at the scene of the video conference, the user can control the equipment expected to be controlled to execute the corresponding operation through the posture, so that the user can remotely control the equipment more flexibly in the conference scene, a more intuitive operation mode is provided, and the interactivity of the electronic equipment is improved.

Description

Technical Field

[0001] The present application relates to the field of mobile terminal technology, and more specifically, to a data processing method, device, electronic device and computer-readable medium. Background Art

[0002] As the types of applications installed in electronic devices increase, the functions that electronic devices can achieve are becoming increasingly rich. For example, electronic devices can search for information on the Internet and display it. For another example, electronic devices can play audio and video, etc. However, the related methods of triggering electronic devices to perform corresponding functions are not flexible and convenient enough. Summary of the invention

[0003] The present application proposes a data processing method, device, electronic device and computer-readable medium to improve the above-mentioned defects.

[0004] In a first aspect, an embodiment of the present application provides a data processing method, which is applied to a first device, wherein the first device is connected to at least one second device, wherein the at least one second device includes a smart display terminal, and the first device is also connected to an image acquisition device. The method includes: when the smart display terminal is in a video conferencing scenario, obtaining posture information of the user acquired by the image acquisition device; determining a target device to be operated from the at least one second device based on the posture information; and controlling the target device to perform a specified operation.

[0005] In the second aspect, the embodiment of the present application also provides a data processing device, which is applied to a first device, wherein the first device is connected to at least one second device, wherein the at least one second device includes a smart display terminal, and the first device is also connected to an image acquisition device, and the device includes: an acquisition unit, a determination unit, and a control unit. The acquisition unit is used to acquire the posture information of the user collected by the image acquisition device when the smart display terminal is in a video conference scenario. The determination unit is used to determine the target device to be operated from the at least one second device based on the posture information. The control unit is used to control the target device to perform a specified operation.

[0006] In a third aspect, an embodiment of the present application further provides an electronic device, comprising: one or more processors; a memory; and one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, and the one or more applications are configured to execute the above method.

[0007] In a fourth aspect, an embodiment of the present application further provides a computer-readable storage medium, wherein the readable storage medium stores a program code executable by a processor, and when the program code is executed by the processor, the processor executes the above method.

[0008] The data processing method, device, electronic device and computer-readable medium provided by the present application, when the intelligent display terminal is in a video conference scenario, obtains the user's posture information collected by the image acquisition device; determines the target device to be operated from the at least one second device based on the posture information; and controls the target device to perform a specified operation. Therefore, for the video conference scenario, the user can control the device to be controlled to perform the corresponding operation through gesture, so that in the conference scenario, the user can remotely control the device more flexibly, provide a more intuitive operation method, and improve the interactivity of the electronic device.

[0009] Other features and advantages of the embodiments of the present application will be described in the subsequent description, and partly become apparent from the description, or can be understood by practicing the embodiments of the present application. The purposes and other advantages of the embodiments of the present application can be realized and obtained by the structures specifically pointed out in the written description, claims, and drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0011] Figure 1 A schematic diagram of an intelligent interaction system provided by an embodiment of the present application is shown;

[0012] Figure 2 A schematic diagram showing the internal modules of the intelligent interaction system provided in an embodiment of the present application is shown;

[0013] Figure 3 A schematic diagram showing the data flow between various devices of the intelligent interaction system provided in an embodiment of the present application is shown;

[0014] Figure 4 A method flow chart of a data processing method provided by an embodiment of the present application is shown;

[0015] Figure 5 A method flow chart of a data processing method provided by another embodiment of the present application is shown;

[0016] Figure 6 A schematic diagram showing the first content provided by an embodiment of the present application;

[0017] Figure 7 A schematic diagram of a first scenario provided by an embodiment of the present application is shown;

[0018] Figure 8 A method flow chart of a data processing method provided by another embodiment of the present application is shown;

[0019] Fig. 9 A schematic diagram of a second scenario provided by an embodiment of the present application is shown;

[0020] Fig.10 A module block diagram of a data processing device provided by an embodiment of the present application is shown;

[0021] Fig.11 A structural block diagram of an electronic device provided in an embodiment of the present application is shown;

[0022] Fig.12 A storage unit for storing or carrying a program code for implementing a method for setting a reporting rate according to an embodiment of the present application is shown. DETAILED DESCRIPTION

[0023] In order to make those skilled in the art better understand the present application scheme, the technical scheme in the present application embodiment will be clearly and completely described below in conjunction with the drawings in the present application embodiment. Obviously, the described embodiment is only a part of the present application embodiment, rather than all the embodiments. The components of the present application embodiment usually described and shown in the drawings here can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present application provided in the drawings is not intended to limit the scope of the present application for protection, but merely represents the selected embodiment of the present application. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without making creative work belong to the scope of protection of the present application.

[0024] It should be noted that similar reference numerals and letters represent similar items in the following drawings, so once an item is defined in one drawing, it does not need to be further defined and explained in subsequent drawings. At the same time, in the description of this application, the terms "first", "second", etc. are only used to distinguish the description and cannot be understood as indicating or implying relative importance.

[0025] The Internet of Things (IOT) is a network concept that extends and expands the user end of the "Internet concept" to any object to exchange information and communicate. With the development of IoT technology, some scenarios can be configured in the IoT system. For the configured scenarios, multiple smart devices may be involved, and multiple smart devices have a certain linkage relationship and can work together. For example, the configured scenarios may include that when one device is close to another device, at least one of the two devices will perform a specified operation. Or when a device performs an operation, part of the data of the operation is processed by itself, and the other part of the data is processed by another device.

[0026] As people's lives become more diverse, users have more and more electronic devices, and the technologies of Bluetooth communication and Wi-Fi are also advancing rapidly. At present, in order to facilitate users' work and life, an electronic device can be connected to an external device via Bluetooth or Wi-Fi so that users can control the electronic device to send data to the connected device. The electronic device can be a smart phone, tablet computer, e-book, wireless audio player, display, etc., which has a communication module inside and can establish a wireless communication connection with other devices and exchange data. The wireless audio player can include a Bluetooth headset or a Bluetooth speaker, etc.

[0027] However, the inventors found in their research that the current common way to control each device in the Internet of Things is to control other devices by operating the operation interface of the electronic device after the electronic device is connected to other devices. However, the related way of triggering the electronic device to perform the corresponding function is not flexible and convenient enough.

[0028] Therefore, in order to overcome the above-mentioned defects, the embodiment of the present application provides a data processing method to provide a more convenient and convenient operation mode for the intelligent interactive system. Before introducing the method embodiment of the present application, the application scenario of the method, i.e., the intelligent interactive system, is first introduced. The intelligent interactive system includes a plurality of electronic devices, and data can be directly or indirectly exchanged between different electronic devices. Usually, at least one device in the intelligent interactive system has the ability to process data, which can be named as the first device. At the same time, the interactive system also includes at least one device that can be controlled by the first device. Of course, the first device itself can also be controlled by the first device. In addition, the intelligent interactive system also includes a data acquisition device, for example, to collect the user's voice or image, etc. Usually, the data acquisition device can send the data to the first device, and the first device analyzes the data and makes a decision on whether to control a certain device in the intelligent interactive system to perform the corresponding operation, and then, based on the decision, controls the device to be controlled to perform the corresponding operation. The various electronic devices in the intelligent interactive system complement each other and cooperate with each other to provide users with a variety of interactive operation methods.

[0029] like Figure 1 As shown, the intelligent interactive system includes a smart screen 101, a speaker 102, a smart lamp 103, a smart phone 104, a tablet computer 105, a headset 106 and a watch 107, etc. Figure 1 Not all electronic devices that can be used in the intelligent interactive system are listed completely. Generally, electronic devices that can control other devices or be controlled by other devices are suitable for the intelligent interactive system, which is not limited here. Among them, the smart screen 101 can be a smart TV. In addition to the function of displaying multimedia content (text, images, videos, etc.), it also has wireless communication with other electronic devices and even has the function of image acquisition. Speakers 102, smart lamps 103, smart phones 104, tablets 105, headphones 106 and watches 107 can all communicate wirelessly with other electronic devices. For example, the speaker 102 can be a Bluetooth speaker and the headphones 106 can be Bluetooth headphones.

[0030] like Figure 1 As shown, assuming that the tablet computer 105 is the aforementioned first device, and the smart screen 101, the speaker 102, the smart lamp 103, the smart phone 104, the earphone 106, and the watch 107 are all second devices, then the smart screen 101, the speaker 102, the smart lamp 103, the smart phone 104, the earphone 106, and the watch 107 are directly or indirectly connected to the tablet computer 105. For example, the smart screen 101, the speaker 102, the smart lamp 103, the smart phone 104, and the earphone 106 are directly connected to the tablet computer 105, and the watch 107 is connected to the tablet computer 105 through the smart phone 104. Figure 1In the intelligent interactive system shown, considering that the tablet computer 105 has a larger screen and stronger data processing capability, the tablet computer 105 is selected as the control center of all devices and the data processing center, i.e., the first device. Of course, other devices can also be selected as the first device. For example, if the smart phone 104 is selected as the first device, then other devices also need to be directly or indirectly connected to the smart phone 104. It can be understood that Figure 1 This is only an example of an intelligent interactive system. Figure 1 At least part of the various devices in the shown intelligent interactive system constitutes a new interactive system applied to the scene, and even new devices can be added. Moreover, the devices in the system can be selected to play the roles of the first device and the second device according to the requirements of the scene.

[0031] like Figure 2 As shown, Figure 2 The data processing and control modules in each device in the above-mentioned intelligent interactive system are shown. Among them, the smart screen and the tablet computer both have modules such as service flow, camera recognition, gesture interaction, voice interaction and communication. In addition, the tablet computer also includes a headset management module. Usually, a smart phone can also have various modules in a tablet computer, but in Figure 2 In the corresponding implementation manner, the aforementioned modules of the smart phone are not shown. In addition, the smart phone also has a gesture data mobile phone module. Figure 3 , Figure 3 The data transmission process between the various devices in the above-mentioned intelligent interactive system is shown. Figure 2 and Figure 3 The specific description of is not elaborated here. In the subsequent embodiments, various specific scenarios will be combined to illustrate Figure 2 The functions and Figure 3 Data interaction in .

[0032] It should be noted that the application scenario of the embodiment of the present application is a video conferencing scenario, and the intelligent interactive system corresponding to the video conferencing scenario can generally include an intelligent display terminal (for example, the aforementioned smart screen), a main device as a control center (for example, a tablet computer), and other intelligent devices (for example, smart lamps, speakers, etc.). Usually, in a video conferencing scenario, the intelligent display terminal is used to display screens related to the video conference, such as video screens captured by the terminals of each participant, and content shared by the participants (video, text, etc.). Among them, the intelligent display terminal can be installed with applications and run the installed applications. Of course, it can also display content projected by other devices.

[0033] See also Figure 4 , Figure 4A data processing method is shown, and the method is applied to a first device, which can be the main device in the above-mentioned video conferencing scenario. The first device is connected to at least one second device, and the at least one second device includes an intelligent display terminal. The first device is also connected to an image acquisition device. It should be noted that the image acquisition device can be a camera of the intelligent display terminal. Of course, it can also be a camera independent of the intelligent display terminal, which is not limited here. In an embodiment of the present application, the executor of the method is the first device, and the implementation methods of the first device and the second device can refer to the above description and will not be repeated here. Specifically, the method includes: S401 to S403.

[0034] S401: When the intelligent display terminal is in a video conference scenario, obtaining user posture information acquired by the image acquisition device.

[0035] As an implementation method, determining whether a smart display terminal is in a video conferencing scene may be, when a first device and the smart display terminal are directly or indirectly connected, determining whether the content displayed by the smart display terminal corresponds to a conference application or whether the currently displayed interface belongs to a video conferencing-related interface; if so, determining that the smart display terminal is in a video conferencing scene.

[0036] Exemplarily, the user's posture information may include the user's overall body posture, the orientation of specified parts, and operation gestures, etc., wherein the body posture refers to the posture of the user's limbs, such as standing, sitting, lying, etc. The orientation of the specified part may refer to the direction of the fingers, the orientation of the face, or the annotated direction of the pupil, etc. The operation gesture refers to a touch gesture, for example, a touch gesture on the touch screen of a mobile phone.

[0037] It should be noted that the image acquisition device may be a camera provided in the smart display terminal, the camera of the smart display terminal being provided on the same side of the screen of the smart display terminal and being used to acquire an image of the area in front of the screen of the smart display terminal.

[0038] S402: Determine a target device to be operated from the at least one second device based on the posture information.

[0039] The first device can identify at least one device to be operated as the target device from multiple second devices that are currently directly or indirectly connected by identifying the posture information. Exemplarily, the target device can be determined by the correspondence between the pre-set posture and the device. It should be noted that the posture information corresponding to the same device can be the same or different in different application scenarios, and this is not limited here. Therefore, when it is determined that the smart display terminal is in a video conferencing scene, the posture relationship corresponding to the video conferencing scene can be determined. The posture relationship includes multiple posture information and a device identifier corresponding to each posture information. Based on the posture relationship corresponding to the video conferencing scene, the device corresponding to the posture information of the user collected by the image acquisition device, that is, the target device, is determined.

[0040] S403: Control the target device to perform a specified operation.

[0041] As an implementation method, the specified operation can be regarded as an operation instruction for controlling the target device to perform a certain operation corresponding to the gesture information. For example, if a user controls a certain device to start by inputting a certain action, the specified operation corresponding to the action is the start instruction. Therefore, by presetting the correspondence between the operation instructions corresponding to different action information, the specified instruction corresponding to the currently acquired action information (the specified instruction is the operation instruction corresponding to the specified operation) can be determined through the correspondence, and the target device is controlled to perform the specified operation in response to the specified instruction. Among them, the action information can be the aforementioned gesture information, or it can be the action after the gesture information, that is, the specified operation can control the default operation performed by the target device after the first device determines the target device through the aforementioned gesture information, that is, the specified operation corresponds to the gesture information, for example, the gesture information is the finger direction, the user points the finger at device A, the first device determines that the target device is device A, and directly controls device A to perform the default operation, such as the start operation. Of course, it can also be that after the first device determines the target device through the gesture information, based on other action information collected subsequently, the target device is controlled to perform the specified operation corresponding to the action information.

[0042] It is understandable that in the embodiment of the present application, the first device can not only determine the device to be operated, but also determine the specified operation through the posture information, that is, the specified operation corresponds to the posture information. As an implementation method, an action information table can be pre-set, and the action information table includes multiple action information and the operation intention corresponding to each action information. As shown in the following Table 1:

[0043] Table 1

[0044] Action Information Operational Intention Finger pointing The device to which the operation is requested Waving left and right Flip pages left and right nod Confirmation Specify posture Request flow data

[0045] It can be seen from Table 1 above that the operation intention refers to the operation that the user expects to perform when inputting the action information, and the operation intention can represent the device that the user currently requests to operate (ie, the device to be operated).

[0046] Exemplarily, the action information of the user obtained this time is used as the target action information, and the operation intention corresponding to the action information is searched in the action information table. In addition, an operation instruction table can be pre-set, and the operation instruction table includes multiple operation intentions and operation instructions corresponding to each operation intention. Exemplarily, the operation instruction can be regarded as an instruction to control a specific device to perform a specific action, and the operation intention can be regarded as an operation request corresponding to the action information, so each operation instruction in the operation instruction table can be an execution method as the operation request. For example, the user informs the interactive system through a certain action that the current operation intention is to turn on the desk lamp, so the user can point to the desk lamp, so the determined operation intention is to request to turn on the pointed desk lamp, then the desk lamp is the target device to be operated, then after the first device determines the operation intention, it needs to determine the start instruction to control the desk lamp to turn on, that is, find the start instruction corresponding to the operation intention in the operation instruction table. Then, send the start instruction to the desk lamp, so as to control the desk lamp to perform the start operation, that is, the specified operation corresponding to the operation intention.

[0047] It should be noted that some operation instructions are recorded in the operation instruction table, so that the operation instruction corresponding to the operation intention can be determined in the operation instruction table, so that the device responding to the operation instruction can perform the specified operation corresponding to the operation intention. Of course, it is also possible that the user inputs the operation instruction after inputting the operation intention through the action information. In other words, if the operation intention corresponding to the gesture information is to determine the target device to be operated from multiple devices, then the operation instruction table may include a default instruction corresponding to the operation intention. The default instruction may be an instruction to control the target device to perform a preset operation, and the default instruction may also include a waiting instruction to control the target device to be in a state of waiting for the user to input an operation instruction. Among them, the preset operation may be a default operation of a preset target device, for example, default startup, default playback of a certain music, etc. The specified operation corresponding to the waiting instruction refers to controlling the target device to be in a state of waiting to be operated, in which the target device detects the operation instruction. Specifically, in the subsequent embodiments, different scenarios will be described.

[0048] In addition, by setting the action information table and the operation instruction table, the action information table can be regarded as a user-oriented operation method, and the operation instruction table can be regarded as an instruction set set in the device. When the user sets a new operation method, the operation instruction table can remain unchanged, which is convenient for the device to manage the operation instructions. For example, the operation intention of the gesture of waving upward in the air is to turn the page up, then in the action information table, the operation intention corresponding to "waving the hand upward" is "turning the page up", and in the operation instruction table, the operation instruction corresponding to "turning the page up" is instruction 1, which is used to trigger the target device to perform the operation of displaying the previous page of the current page. If the user adds "clapping" to the action information table and corresponds the "clapping" to the operation of "turning the page up", when the user inputs clapping, the first device can still recognize the action information and obtain the operation instruction corresponding to the "clapping", that is, instruction 1, thereby realizing the operation of "turning the page up" by clapping. In this way, the user can set the user-oriented action information table arbitrarily according to the needs, and the operation instruction table does not need to perform the change operation every time the user adds new action information.

[0049] Therefore, when the smart display terminal is in a video conference scenario, the user's posture information collected by the image acquisition device is obtained; based on the posture information, the target device to be operated is determined from the at least one second device; and the target device is controlled to perform a specified operation. Therefore, for the video conference scenario, the user can control the device to be controlled to perform the corresponding operation through gestures, so that in the conference scenario, the user can remotely control the device more flexibly, providing a more intuitive operation method and improving the interactivity of the electronic device.

[0050] See also Figure 5 , Figure 5 A data processing method is shown, the method is applied to a first device, the execution subject of the method is the first device, the aforementioned posture information is the first posture information of the user in front of the smart display terminal, the first device can be a smart phone, a tablet computer or a smart watch, etc. In the embodiment of the present application, the first device is a tablet computer as an example to illustrate the embodiment. Specifically, the method includes: S501 to S504.

[0051] S501: When the intelligent display terminal is in a video conference scenario, obtaining user posture information acquired by the image acquisition device.

[0052] As an embodiment, the smart display terminal has a camera, and the image acquisition area of ​​the camera is located in front of the smart display device. Specifically, it may refer to the front of the screen of the smart display device. The screen and image acquisition area of ​​the smart display terminal are arranged on the same side of the smart display device, so the image acquisition device is the camera of the smart display terminal.

[0053] The intelligent display terminal can collect images in the front area, such as Figure 2 As shown, the smart display terminal is a smart screen, which is provided with a camera recognition module. The image captured by the camera of the smart display terminal obtains image data and sends it to the camera recognition module. The camera recognition module of the smart display terminal analyzes the image data, thereby being able to recognize the posture of the user in front of the smart display terminal, that is, the first posture information.

[0054] S502: If it is determined that the posture information is the first designated posture, the intelligent display terminal is determined as the target device.

[0055] The designated posture may be a pre-set posture for triggering the first device to forward the multimedia content played on the screen of the first device to the smart display terminal, and the first designated posture may be set based on actual usage requirements. In the embodiment of the present application, the first designated posture belongs to a sitting posture, that is, whether it is sitting cross-legged or sitting with legs crossed, which is not specifically limited in the present application.

[0056] In the case where the posture information is determined to be the first specified posture, it can be determined that the current user may have a need to transfer the content displayed on the screen of the first device to the smart display terminal. Therefore, in the case where the posture information is determined to be the first specified posture, the smart display terminal is used as the target device to be operated. Taking the aforementioned operation intention as an example, the operation intention corresponding to the first specified posture is the first operation intention, wherein the first operation intention is used to characterize the user's need to transfer the multimedia content played on the screen of the first device to the smart display terminal. In other words, the user can inform the first device that he has the need to display the display content of the first device through the smart display terminal by inputting the first specified gesture, and whether the first device will transfer the display content of the first device to the smart display terminal depends on whether the first device will respond to the first operation intention or under what conditions to respond to the first operation intention.

[0057] S503: Acquire first content displayed by the first device through the screen of the first device.

[0058] As an implementation manner, the first content may be multimedia content such as video content or text content displayed on a screen of the first device.

[0059] S504: Send the first content to the smart display terminal, and instruct the smart display terminal to display the first content.

[0060] As an implementation mode, after detecting that the posture information is the first specified posture, the first device can directly perform a flow operation, that is, obtain the first content displayed by the first device through the screen, send the first content to the smart display terminal, and after the smart display terminal obtains the first content, display the multimedia content through the screen of the smart display terminal. It should be noted that the first content played by the first device through the screen can be understood as the file to be displayed corresponding to the content displayed on the screen of the first device. For example, if the screen of the first device displays the content of a specified page of a document, then the first content is the document, and is not limited to the content of the specified page. Therefore, in the embodiment of the present application, the flow of the display content of the first device can also be understood as performing a flow operation on the first content played through the screen of the first device, and the flow object is the smart display terminal. Figure 2 and Figure 3 As shown, the intelligent display terminal is a smart screen, and the first device is a tablet computer. The tablet computer sends the first content played on the screen of the tablet computer to the smart screen through the service flow module, and the smart screen plays the received first content on its screen.

[0061] As another implementation, the first device may perform the transfer operation after detecting that the posture information is the first specified posture and determining that the transfer condition is met. Exemplarily, the implementation of the aforementioned S503 may be to output a first prompt message, the first prompt message is used to ask whether to agree to transfer the content displayed by the first device through the screen to the smart display terminal for display; detect confirmation information for the first prompt message, and obtain the first content displayed by the first device through the screen of the first device. Exemplarily, the first prompt message is used to ask whether to agree to transfer the multimedia content played by the first device through the screen to the smart display terminal for display. Then the first prompt message may be a prompt voice, and the way for the user to input confirmation information for the first prompt message may be to input a confirmation voice. For example, the first device outputs a prompt voice, for example, the first device outputs a voice of "whether to agree to cast the screen to the smart screen" through the first device or other playback devices connected to the first device, the user sends a confirmation voice of "agree", the first device collects the confirmation voice, determines to obtain the confirmation information for the first prompt message, and then the first device performs the aforementioned transfer operation.

[0062] As another implementation, the first prompt information may also be a prompt content displayed on the screen of the first device, and the implementation method of outputting the first prompt information is to display the second content on the screen of the first device. As an implementation, the first prompt information may be a first pop-up window displayed on the screen of the first device, and the second content and the first control component and the second control component corresponding to the second content are displayed in the first pop-up window. The second content may be multimedia content such as text and video. Among them, the first operation control is used to input confirmation information when it is touched, and the second operation control is used to input rejection information when it is touched. Figure 6 As shown, a first pop-up window 600 is displayed on the screen of the first device, wherein the second content 601, a first control component 602 and a second control component 603 are displayed therein. The second content 601 may be a preset text content. For example, the preset text content is "Whether to project the screen to the smart screen" or "Whether to project the screen to the smart screen if there is a collaborative device". The user touches the first control component 602 to input confirmation information, and then the first device executes the acquisition of the multimedia content played by the first device through the screen and subsequent flow operations.

[0063] like Figure 7As shown, the intelligent interactive system includes a smart screen 701 and a tablet computer 702, which are used in a video conferencing scenario. In the video conferencing scenario, the first device is the tablet computer 702, and the second device is the smart screen 701. The smart screen 701 can capture images in the area in front of its screen. The smart screen 701 is displaying images related to the video conference. The user walks to the sofa 703, which has a tablet computer 702. The user sits on the sofa 703, and the posture matching the first specified posture, i.e., the sitting posture, is captured by the smart screen 701. Then, the first prompt information is output through the tablet computer 702, for example, Tablet computer 702 is currently displaying the first content (for example, a video, document, or PPT). Then, the smart screen sends the collected sitting posture information to the tablet computer 702. The tablet computer 702 displays the aforementioned first pop-up window containing preset text content on its screen. The user clicks on the first operation component, and the tablet computer 702 sends the first content to the smart screen 701. At this time, the smart screen 701 can continue to play the first content through the screen of the smart screen 701 based on the playback progress of the first content on the tablet computer 702. The tablet computer 702 can stop playing the first content or continue playing the first content. In addition, as an embodiment, the smart screen 701 can also obtain a specified time after reversing the playback progress of the first content on the tablet computer 702 for a specified period of time, and play the first content from the specified time, so that the user can appropriately trace back the content of the first content when casting the first content to avoid the user missing the playback content of the first content. For example, assuming that the playback progress of the first content on the tablet computer 702 is 10 minutes and 25 seconds, the specified duration is 20 seconds, and the determined specified time is 10 minutes and 5 seconds. That is to say, when the playback progress of the first content on the tablet computer 702 is 10 minutes and 25 seconds, the first content is streamed to the smart screen 701, and the smart screen 701 starts playing from the 10 minutes and 5 seconds position of the first content.

[0064] It should be noted that, considering that the position of the sofa 703 is relatively fixed, after the scene is set up, that is, after the smart screen 701 and the tablet computer 702 are connected and combined into an intelligent interactive system, since the sofa 703 is located in front of the smart screen 701, the camera of the smart screen 701 can capture the outline of the sofa 703 and obtain the distance between the sofa 703 and the smart screen 701. For example, the distance between the sofa 703 and the smart screen 701 can be determined by the depth information in the collected image containing the sofa 703. Based on this determination, the first range can be determined, for example, the range of the specified width of the front, back, left, and right of the distance. Then, when the smart screen 701 collects the first posture information of the user in front of the smart screen 701, the first distance between the user and the smart screen 701 can also be obtained. Then, the smart screen 701 sends the first posture information and the first distance to the tablet computer 702. When the tablet computer 702 determines that the first posture information is a specified posture, it further determines whether the first distance is within the first range. If it is within the first range, the subsequent flow operation is performed.

[0065] Therefore, in the scenario of smart screen, the user can maintain a specific posture to enable the first content being played on the first device to be streamed to the smart screen for playback. For example, the presentation (PowerPoint, PPT) of the first device can be shared on the smart screen.

[0066] See also Figure 8 , Figure 8 A data processing method is shown, which is applied to the above-mentioned intelligent interactive system. The execution subject of the method is a first device of the intelligent interactive system. The intelligent interactive system also includes an image acquisition device. The first device is connected to the image acquisition device. The image acquisition device can be the above-mentioned Figure 1 Any electronic device equipped with a camera, for example, can be a smart screen, and of course, it can also be a device other than the aforementioned first device and second device. In addition, the intelligent interaction system also includes at least one second device, and the number of the second devices is multiple, and the relative position between each second device and the image acquisition device is different. In addition, the first device can be a device such as a smart phone, a tablet computer or a smart watch. In the embodiment of the present application, the first device is a tablet computer as an example to illustrate the embodiment. Specifically, the method includes: S801 to S804.

[0067] S801: When the intelligent display terminal is in a video conference scenario, obtaining user posture information acquired by the image acquisition device.

[0068] Exemplarily, the image acquisition device is a camera of the smart display terminal. As an implementation mode, the image acquisition device may be a camera of a smart screen, or may be another device that does not belong to any first device or second device. In the embodiment of the present application, the scenario to which the embodiment is applied may be set as a video conferencing scenario. In this scenario, the first device may be the aforementioned smart phone or tablet computer, etc., and the second device may be an electronic device that can be controlled by the first device, such as a smart home device. It should be noted that the smart screen also belongs to the second device, that is, the smart screen can not only collect the second posture information through the camera provided therein, but also can be controlled by the first device as a second device.

[0069] S802: Determine a target device to be operated from the at least one second device based on the posture information.

[0070] As an implementation mode, each of the second devices corresponds to a reference posture, and the implementation mode of S802 is to determine a target reference posture matching the posture information in the reference posture corresponding to each second device; and use the second device corresponding to the target reference posture as the target device.

[0071] It can be understood that, since the relative position between each second device and the image acquisition device is different, in theory, when the user stands at the same position in front of the image acquisition device and faces different second devices, the posture of the user captured by the image acquisition device is different. For example, when one second device is above the image acquisition device and one second device is below the image acquisition device, and the user points to the two second devices at the same position, it can be clearly seen in the image captured by the image acquisition device that one hand is raised upward and the other hand is facing downward. Therefore, it is possible to obtain in advance an image of a simulated user facing different second devices with a first specified body part (e.g., hand) within the image acquisition range of the image acquisition device, extract the user's posture image as reference posture information, and then obtain a posture correspondence table, which includes multiple reference posture information and the device corresponding to each reference posture information. For example, the first device includes device 1 and device 2, reference posture 1 corresponds to device 1, and reference posture 2 corresponds to device 2. Then, in an embodiment of the present application, after acquiring the user's posture information captured by the image acquisition device through S801, the posture information is compared with each reference posture information to determine the reference posture information that matches the posture information, and then the device corresponding to the matching reference posture information in the posture correspondence table is determined as the second device corresponding to the posture information, that is, the target device.

[0072] As another implementation, the relative position relationship between each of the second devices and the image acquisition device is different, and the implementation method of S802 is: determine the orientation of the first designated body part of the user based on the posture information; based on the orientation of the first designated body part of the user and the relative position relationship between each of the second devices and the image acquisition device, determine the second device to which the designated body part points from a plurality of the second devices as the target device.

[0073] It should be noted that the image captured by the image acquisition device includes the image of the user's designated body part, so the posture information determined by the image acquisition device includes the orientation of the user's designated body part.

[0074] Exemplarily, the first designated body part may be a human hand, or other parts, which are not limited here. The first device obtains the posture information of the user acquired by the image acquisition device, and can determine the orientation of the first designated body part of the user by analyzing the posture information. For example, the first designated body part is a hand, and the pointing direction of the finger can be determined by analyzing the contour of the finger on the hand, thereby determining the orientation information of the first designated body part.

[0075] After establishing the communication connection and installation position between the various electronic devices of the intelligent interactive system applied to the second scene, the image acquisition device acquires images of the various devices and other objects within its image acquisition range, thereby being able to obtain the image of the scene, and then being able to determine the position coordinates of all devices in the intelligent interactive system under the scene in a preset physical coordinate system, wherein the preset physical coordinate system is a world coordinate system with the image acquisition device as the origin. At the same time, the intelligent interactive system can also establish a mapping relationship between the camera coordinate system and the preset physical coordinate system, so that the pixel coordinates of each pixel point in the acquired image can find the corresponding position point in the preset physical coordinate system.

[0076] Therefore, after the image acquisition device acquires the user's posture information, it can determine the position coordinates of the user's center point in the preset coordinate system based on the pixel coordinates of the user's image in the camera coordinate system and the mapping relationship between the camera coordinate system and the preset physical coordinate system, which are named the user center point position coordinates, and then obtain the position coordinates of the user's first designated body part in the preset physical coordinate system, which are named the part position coordinates. Based on the user center point position coordinates and the part position coordinates, a vector direction can be determined, and then the second device distributed in the position area along the vector direction is determined as the target device. In addition, the vector direction can also be obtained in the following way: assuming that the first body part is the user's hand, when the user points to a certain direction with his hand, the arm is often in an extended state, so the position coordinates of the elbow joint in the preset physical coordinate system can be extracted, which are named the starting point coordinates. Similarly, the position coordinates of the finger or hand in the preset physical coordinate system are extracted, which are named the end point coordinates. The vector direction can be obtained based on the starting point coordinates and the end point coordinates. Therefore, the user can be provided with an experience that the device can be controlled by pointing to it.

[0077] S803: Determine body movement information corresponding to the second designated body part.

[0078] S804: Control the target device to execute a control operation corresponding to the body motion information.

[0079] As an implementation mode, the control operation may be a preset operation for the target device, that is, the control operation may be a default operation, that is, an operation corresponding to the posture information is pre-configured for each second device. After the posture information of the user acquired by the image acquisition device is acquired and the target device is determined, the target device is directly controlled to perform the preset operation. For example, the posture information includes the orientation of a specified body part of the user. When it is determined that the specified body part of the user is toward device 1, device 1 is controlled to perform the preset operation corresponding to device 1. For example, device 1 is a speaker. When it is determined that the user is pointing to the speaker, the speaker is started and song 1 is played. The preset operation of the speaker is to start and play song 1. Of course, the preset operation of each second device can also be set arbitrarily according to actual usage requirements.

[0080] As another implementation, after the target device is determined, the implementation of controlling the target device to perform the control operation also includes performing the operation corresponding to the operation gesture based on some operation gestures of the user, and the input of the operation gesture can be input through the second designated body part of the user, that is, the orientation of the first designated body part is used to determine the device to be operated, that is, the target device, from multiple second devices, and then, the body movement of the second designated body part is used to control the first target device to perform a specific operation. It should be noted that the first designated body part and the second designated body part can be the same body part, for example, both are hands, of course, they can also be different body parts, which is not limited here. Therefore, the implementation of controlling the target device to perform the control operation includes determining the body movement information corresponding to the second designated body part; controlling the target device to perform the control operation corresponding to the body movement information. In the embodiment of the present application, the following implementation is explained by taking the first designated body part and the second designated body part as the same part as an example, for example, both are hands.

[0081] Exemplarily, each second device can be set up with an operation relationship table, which includes multiple action information and operation instructions corresponding to each action information, wherein the action information is the action of the second designated body part. Therefore, the first device determines the device that the user wants to operate, that is, the target device, and then continues to obtain the body action information of the second designated body part of the user. Then, through the operation relationship table, the operation instruction corresponding to the currently obtained body action information is determined, and the target device is controlled based on the operation instruction to perform the control operation corresponding to the operation instruction. It should be noted that the body action information of the second designated body part can be collected by the aforementioned image acquisition device, or by a posture acquisition device. For example, the posture acquisition device can be a smart wearable device worn on the second designated body part of the user. For example, if the second designated body part is a hand, the smart wearable device can be a smart watch. The smart watch is provided with a sensor, which can collect the action information of the second designated body part, that is, the body action information, and send the collected body action information to the first device.

[0082] The following describes implementation methods of controlling the target device to execute the first control operation corresponding to the body motion information for different types of target devices.

[0083] Assume that the target device is a lighting device, for example, it can be a smart lamp, which can be connected to the first device, can receive the control of the command of the first device, and perform the operation corresponding to the command. Correspondingly, the body motion information corresponding to the second specified body part includes the motion direction of the second specified body part (which can be named the first motion direction), and the motion direction can include the rotation direction around the second specified body part or the movement direction in space. Exemplarily, in the scenario where the target device is a lighting device, if the first motion direction is the first rotation direction, the lighting device is controlled to increase the brightness, and if the first motion direction is the second rotation direction, the lighting device is controlled to reduce the brightness. That is to say, in this embodiment, the first motion direction is the rotation direction of the hand, that is, the direction in which the hand flips around the first axis, then the first axis is the axis formed by the line connecting the hand and the elbow joint, and the rotation plane generated by the rotation of the hand around the first axis is perpendicular to the first axis or the angle is greater than 85 degrees and less than or equal to 100 degrees, that is, approximately vertical. The first rotation direction can be a clockwise rotation or counterclockwise rotation along the line from the elbow joint to the hand. The second rotation direction is different from the first rotation direction, that is, if the first rotation direction is clockwise, the second rotation direction is counterclockwise, or if the first rotation direction is counterclockwise, the second rotation direction is clockwise. There is no limitation here.

[0084] It should be noted that the lighting device acts on the video conference scene to provide lighting for the participants of the video conference. Accordingly, when the intelligent display terminal is in the video conference scene, the first device can obtain the user's posture information collected by the image acquisition device according to the specified scanning interval. That is to say, in some embodiments, in the video conference scene, and when there is an intelligent lighting device in the intelligent interactive system corresponding to the scene, it can be determined in real time based on the user's posture information collected by the image acquisition device whether the user wants to control the lighting device. In other embodiments, it can be determined under certain conditions based on the user's posture information collected by the image acquisition device whether the user wants to control the lighting device. Exemplarily, when the intelligent display terminal is in the video conference scene, it is detected that the ambient light intensity is lower than the specified threshold, and the user's posture information collected by the image acquisition device is obtained. That is to say, during the video conference, if the user's current ambient light intensity is too low, the image acquisition device will start to collect the user's posture information.

[0085] Assume that the target device is a speaker, for example, it can be a smart Bluetooth speaker, which can be connected to the first device, can receive the control of the command of the first device, and perform the operation corresponding to the command. Correspondingly, the body movement information corresponding to the second specified body part includes the movement direction of the second specified body part (named as the second movement direction). Exemplarily, in the scenario where the target device is a speaker, if the second movement direction is the third rotation direction, the speaker is controlled to increase the volume; if the second movement direction is the fourth rotation direction, the speaker is controlled to reduce the volume. In this embodiment, the second movement direction is similar to the aforementioned first movement direction, both of which are the rotation direction of the hand, that is, the direction in which the hand flips around the first axis. The first axis is the axis formed by the line connecting the hand and the elbow joint. The rotation plane generated by the rotation of the hand around the first axis is perpendicular to the first axis or the angle is greater than 85 degrees and less than or equal to 100 degrees, that is, approximately vertical. The third rotation direction can be a clockwise rotation or counterclockwise rotation along the line from the elbow joint to the hand. The fourth rotation direction is different from the third rotation direction, that is, if the third rotation direction is clockwise, the fourth rotation direction is counterclockwise, or if the third rotation direction is counterclockwise, the fourth rotation direction is clockwise. No limitation is made here.

[0086] It should be noted that the speaker acts on the video conference scene and is used as an audio output device for the video conference scene, that is, the speaker can be connected to the intelligent display terminal to play the audio output by the intelligent display terminal. In some embodiments, in the video conference scene, and when the speaker exists in the intelligent interactive system corresponding to the scene, it can be determined in real time whether the user wants to control the speaker based on the user's posture information collected by the image acquisition device. In other embodiments, it can be determined whether the user wants to control the speaker based on the user's posture information collected by the image acquisition device under certain conditions. Exemplarily, when the intelligent display terminal is in the video conference scene, the degree of change of the ambient sound is detected. If the degree of change is greater than a specified threshold, the posture information of the user collected by the image acquisition device is obtained. Among them, the degree of change can be the difference in the change of the audio intensity of the ambient sound within a preset time period, that is, the difference between the maximum value and the minimum value, wherein the ambient sound can be collected by an audio acquisition device, and the audio acquisition device can be a microphone on the first device, or a microphone of the intelligent display terminal, or a microphone of the speaker, which is not limited here. When the degree of change is greater than the specified threshold, it means that the ambient sound has changed significantly, which may be suddenly noisy or quiet. Therefore, at this time, the user's posture information collected by the image acquisition device is obtained to determine whether the user wants to control the speaker.

[0087] Assume that the target device is an intelligent display terminal, for example, it can be the aforementioned smart screen, and the intelligent display terminal can be connected to the first device, can receive the control of the instruction of the first device, and perform the operation corresponding to the instruction. In addition, in an embodiment of the present application, the aforementioned image acquisition device can be a camera contained in the intelligent display terminal. Correspondingly, the movement direction of the second specified body part can be named as the third movement direction. Exemplarily, the third movement direction can be the movement of the second specified body part, for example, waving, which is equivalent to the movement of the second specified body part in space. For the scenario where the target device is an intelligent display terminal, if the third movement direction is the first waving direction, the intelligent display terminal is controlled to perform a backward operation; if the third movement direction is the second waving direction, the intelligent display terminal is controlled to perform a forward operation. Among them, the backward operation is used to play the content after the current content based on the playback sequence of the content played on the screen of the intelligent display terminal, and the forward operation is used to play the content before the current content based on the playback sequence of the content played on the screen of the intelligent display terminal. Specifically, if the content played on the screen of the intelligent display terminal is a video file, the playback sequence is a playback sequence of multiple video frames of the video file, so the backward operation can also be a fast-rewind operation, and the forward operation can also be a fast-forward operation. If the content played on the screen of the intelligent display terminal is a PPT file, the playback sequence is a sequence of multiple pages of the PPT file, so the backward operation can also be a backward page turning operation, and the forward operation can also be a forward page turning operation. It should be noted that in the playback sequence, the content before the current content is the content played later than the current content, and the content after the current content is the content played earlier than the current content.

[0088] In addition, when the target device is a smart display terminal, the third action direction can be used to control the smart display terminal to display different content. Exemplarily, if the action direction is the fifth rotation direction, the content displayed by the smart display terminal is controlled to change from the real-time collected video screen corresponding to the video conference scene to the specified content. Among them, the real-time collected video screen corresponding to the video conference scene can be the video screen of each participant, and the specified content can be the content that the user wants to share. Therefore, by rotating the second designated body part, such as the hand, according to the fifth rotation direction, it is possible to switch the content displayed by the smart display terminal to the user's shared content, such as the aforementioned PPT. In addition, through the sixth rotation direction of the second designated body part, the content displayed by the smart display terminal can be switched back to the real-time collected video screen corresponding to the video conference scene. Among them, the sixth rotation direction and the fifth rotation direction are opposite directions to each other.

[0089] As an implementation mode, the first motion direction, the second motion direction and the third motion direction can all be collected by an acceleration sensor in a smart wearable device worn on a second designated body part. For example, when the user performs different motions, the acceleration data collected by the acceleration sensor is different, so the current motion direction can be determined by the acceleration data.

[0090] like Fig. 9 The second scenario of the intelligent interactive system shown in the figure, the intelligent interactive system in this scenario includes a smart screen 701, a lighting device 901, a speaker 902, a tablet computer 702 and a wearable device (for example, a smart watch, not shown in the figure). In this scenario, the first device is the tablet computer 702, and the second device is the smart screen 701 and the lighting device 901 and the speaker 902, and the relative positions of the lighting device 901 and the speaker 902 and the smart screen 701 are different. Suppose that the user is in the second scene, for example, sitting on the sofa 703, and when the user points his finger at the lighting device 901, the action can be captured and recognized by the smart screen 701, and then the smart screen 701 informs the tablet computer 702 of the direction of the user's hand. The tablet computer 702 determines that the device currently specified by the user is the lighting device 901 based on the direction of the hand and the positional relationship between the various devices. That is, the tablet computer 702 determines that the target device that the current user wants to operate is the lighting device 901. Then, the smart watch worn on the user's hand monitors the gesture action through the watch gesture detection module WatchController, that is, obtains the aforementioned body movement information and sends it to the tablet computer 702.

[0091] In addition, considering that the user may be accustomed to establishing a Bluetooth connection between his own smart phone and the smart watch, that is, the smart watch and the smart phone will automatically establish a Bluetooth connection and maintain the Bluetooth connection under the condition of satisfying the Bluetooth connection, therefore, the smart watch can send the collected body motion information to the tablet computer 702 through the connected smart phone, and the tablet computer determines the rotation direction or swing direction of the body motion information. Of course, it can also be that the smart phone detects the rotation direction or swing direction of the body motion information, and sends the corresponding information to the tablet computer, and the tablet computer determines the rotation direction or swing direction of the body motion information based on the information. For example, the smart phone obtains the body motion information sent by the smart watch, that is, the aforementioned acceleration data, and then the smart phone analyzes the acceleration data to determine the rotation direction or swing direction of the body motion information, if the body motion information is the aforementioned clockwise rotation, the first information is determined, if it is the aforementioned counterclockwise rotation, the second information is determined, if the body motion information is the first swing direction, the third information is determined, and if the body motion information is the second swing direction, the fourth information is determined. Therefore, the tablet computer can determine the rotation direction or swing direction through the first information, second information, third information and fourth information sent by the smart phone. It should be noted that the smart phone may also belong to the aforementioned intelligent interaction system, but it does not belong to the second device.

[0092] For example, a user wears a smart watch and points to lighting device 901, and the tablet computer lights up lighting device 901, or points to lighting device 901 and selects lighting device 901 as the device to be operated, i.e., the target device. Then, the user opens his hand and waves it, and at least one of the smart watch and the smart screen collects the start action (i.e., opening his hand and waving it, of course, it can also be other gestures, which are not limited here), and sends the start action to the tablet computer. The tablet computer determines the start instruction corresponding to the start action and sends the start instruction to lighting device 901. Lighting device 901 is lit based on the start instruction, and then the rotation of the user's hand is detected by the smart watch to determine the direction of the rotation, that is, the brightness of the light is adjusted by rotating it clockwise / counterclockwise. Similarly, the user points to the speaker and selects the speaker as the device to be operated, and then rotates it clockwise / counterclockwise to adjust the volume of the speaker. Similarly, point to the smart screen and rotate it clockwise / counterclockwise to adjust the display layout of the smart screen (it can also be a video or a PPT), and wave left and right to realize the function of turning pages of PPT or fast forward and rewinding videos.

[0093] See also Fig.10 , which shows a structural block diagram of a data processing device 1000 provided in an embodiment of the present application. The device may include: an acquisition unit 1001, a determination unit 1002 and a control unit 1003.

[0094] The acquisition unit 1001 is used to acquire the user's posture information acquired by the image acquisition device when the intelligent display terminal is in a video conference scenario.

[0095] The determining unit 1002 is configured to determine a target device to be operated from the at least one second device based on the posture information.

[0096] Furthermore, the determining unit 1002 is further configured to determine that the intelligent display terminal is the target device if it is determined that the posture information is the first specified posture.

[0097] Furthermore, the number of the second devices is multiple, each of the second devices corresponds to a reference posture, and the determination unit 1002 is further used to determine a target reference posture that matches the posture information in the reference posture corresponding to each second device; and the second device corresponding to the target reference posture is used as the target device.

[0098] Furthermore, there are multiple second devices, and the relative position relationship between each second device and the image acquisition device is different. The determination unit 1002 is also used to determine the orientation of the user's first designated body part based on the posture information; based on the orientation of the user's first designated body part and the relative position relationship between each second device and the image acquisition device, determine the second device to which the first designated body part points from the multiple second devices as the target device.

[0099] The control unit 1003 is used to control the target device to perform a specified operation.

[0100] Furthermore, the control unit 1003 is further configured to obtain first content displayed by the first device through a screen of the first device; send the first content to the smart display terminal, and instruct the smart display terminal to display the first content.

[0101] Furthermore, the control unit 1003 is also used to output a first prompt message, wherein the first prompt message is used to ask whether you agree to transfer the content displayed on the screen of the first device to the smart display terminal for display; detect confirmation information for the first prompt message, and obtain the first content displayed by the first device through the screen of the first device.

[0102] Furthermore, the control unit 1003 is further configured to display preset text content on the screen of the first device.

[0103] Furthermore, the control unit 1003 is further configured to determine body motion information corresponding to the second designated body part of the user; and control the target device to execute a control operation corresponding to the body motion information.

[0104] Furthermore, the target device is the lighting device, and the body movement information corresponding to the second designated body part includes the movement direction of the second designated body part. The control unit 1003 is also used to control the lighting device to increase the brightness if the movement direction is the first rotation direction; and control the lighting device to reduce the brightness if the movement direction is the second rotation direction.

[0105] Furthermore, the control unit 1003 is further configured to, when the intelligent display terminal is in a video conference scenario and detects that the ambient light intensity is lower than a specified threshold, obtain the user's posture information acquired by the image acquisition device.

[0106] Furthermore, the target device is the speaker, and the body movement information corresponding to the second designated body part includes the movement direction of the second designated body part. The control unit 1003 is also used to control the speaker to increase the volume if the movement direction is the third rotation direction; and control the speaker to lower the volume if the movement direction is the fourth rotation direction.

[0107] Furthermore, the target device is the smart display terminal, and the body movement information corresponding to the second designated body part includes the movement direction of the second designated body part. The control unit 1003 is also used to control the smart display terminal to perform a backward operation if the movement direction is a first waving direction, and the backward operation is used to play the content after the current content based on the playback sequence of the content played on the screen of the smart display terminal; if the movement direction is a second waving direction, control the smart display terminal to perform a forward operation, and the forward operation is used to play the content before the current content based on the playback sequence of the content played on the screen of the smart display terminal.

[0108] Furthermore, the target device is the smart display terminal, and the body movement information corresponding to the second designated body part includes the movement direction of the second designated body part. The control unit 1003 is also used to control the content displayed by the smart display terminal to change from the real-time collected video screen corresponding to the video conferencing scene to the designated content if the movement direction is the fifth rotation direction.

[0109] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described devices and modules can refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here.

[0110] In several embodiments provided in the present application, the coupling between modules may be electrical, mechanical or other forms of coupling.

[0111] In addition, each functional module in each embodiment of the present application can be integrated into a processing module, or each module can exist physically separately, or two or more modules can be integrated into one module. The above integrated modules can be implemented in the form of hardware or software functional modules.

[0112] Please refer to Fig.11 , which shows a structural block diagram of an electronic device provided in an embodiment of the present application. The electronic device 100 may be an electronic device capable of running applications, such as a smart phone, a tablet computer, an e-book, etc. The electronic device 100 in the present application may include one or more of the following components: a processor 110, a memory 120, and one or more applications, wherein the one or more applications may be stored in the memory 120 and configured to be executed by one or more processors 110, and the one or more programs are configured to execute the method described in the aforementioned method embodiment.

[0113] The processor 110 may include one or more processing cores. The processor 110 uses various interfaces and lines to connect various parts of the entire electronic device 100, and executes various functions and processes data of the electronic device 100 by running or executing instructions, programs, code sets or instruction sets stored in the memory 120, and calling data stored in the memory 120. Optionally, the processor 110 can be implemented in at least one hardware form of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), and programmable logic array (Programmable Logic Array, PLA). The processor 110 can integrate one or a combination of a central processing unit (Central Processing Unit, CPU), a graphics processing unit (Graphics Processing Unit, GPU) and a modem. Among them, the CPU mainly processes the operating system, user interface and application programs; the GPU is responsible for rendering and drawing display content; and the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 110, but may be implemented separately through a communication chip.

[0114] The memory 120 may include a random access memory (RAM) or a read-only memory (ROM). The memory 120 may be used to store instructions, programs, codes, code sets or instruction sets. The memory 120 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the following various method embodiments, etc. The data storage area may also store data (such as a phone book, audio and video data, chat record data) created by the electronic device 100 during use.

[0115] Please refer to Fig.12 , which shows a structural block diagram of a computer-readable medium provided in an embodiment of the present application. The computer-readable medium 1200 stores program codes, which can be called by a processor to execute the method described in the above method embodiment.

[0116] The computer readable medium 1200 may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read-only memory), an EPROM, a hard disk, or a ROM. Optionally, the computer readable medium 1200 includes a non-transitory computer-readable storage medium. The computer readable medium 1200 has storage space for program code 1210 that performs any method step of the above method. These program codes can be read from or written to one or more computer program products. The program code 1210 can be compressed, for example, in an appropriate form.

[0117] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A data processing method, characterized in that: Applied to a first device, the first device is connected to at least one second device, the at least one second device includes an intelligent display terminal, and the first device is also connected to an image acquisition device, the method includes: When the intelligent display terminal is in a video conference scenario, acquiring posture information of the user acquired by the image acquisition device; Determine a target device to be operated from the at least one second device based on the posture information; Control the target device to perform a specified operation.

2. The method according to claim 1, characterized in that The determining a target device to be operated from the at least one second device based on the posture information includes: If it is determined that the posture information is the first specified posture, the intelligent display terminal is determined to be the target device.

3. The method according to claim 2, characterized in that The controlling the target device to perform a specified operation includes: Acquire first content displayed by the first device through a screen of the first device; The first content is sent to the smart display terminal, and the smart display terminal is instructed to display the first content.

4. The method according to claim 3, characterized in that The acquiring the first content displayed by the first device through the screen of the first device includes: Outputting first prompt information, where the first prompt information is used to inquire whether to agree to transfer the content displayed on the screen of the first device to the smart display terminal for display; Confirmation information for the first prompt information is detected, and first content displayed by the first device through a screen of the first device is acquired.

5. The method according to claim 4, characterized in that Output the first prompt information, including: The preset text content is displayed on the screen of the first device.

6. The method according to claim 1, characterized in that There are multiple second devices, each of which corresponds to a reference posture, and determining a target device to be operated from the at least one second device based on the posture information includes: Determining a target reference posture matching the posture information among the reference postures corresponding to each second device; A second device corresponding to the target reference posture is used as a target device.

7. The method according to claim 1, characterized in that There are multiple second devices, and the relative position relationship between each second device and the image acquisition device is different. The determining the target device to be operated from the at least one second device based on the posture information includes: determining an orientation of a first designated body part of the user based on the posture information; Based on the orientation of the first designated body part of the user and the relative positional relationship between each of the second devices and the image acquisition device, the second device to which the first designated body part points is determined from a plurality of the second devices as the target device.

8. The method according to claim 6 or 7, characterized in that: The controlling the target device to perform a specified operation includes: determining body motion information corresponding to a second designated body part of the user; The target device is controlled to execute a control operation corresponding to the body motion information.

9. The method according to claim 8, characterized in that The target device is a lighting device, the body motion information corresponding to the second designated body part includes a motion direction of the second designated body part, and controlling the target device to perform a control operation corresponding to the body motion information includes: If the movement direction is the first rotation direction, controlling the lighting device to increase the brightness; If the movement direction is the second rotation direction, the lighting device is controlled to reduce the brightness.

10. The method according to claim 9, characterized in that When the intelligent display terminal is in a video conference scenario, obtaining the user's posture information acquired by the image acquisition device includes: When the intelligent display terminal is in a video conference scenario and detects that the ambient light intensity is lower than a specified threshold, the user's posture information acquired by the image acquisition device is acquired.

11. The method according to claim 8, characterized in that The target device is a speaker, the body motion information corresponding to the second designated body part includes a motion direction of the second designated body part, and controlling the target device to perform a control operation corresponding to the body motion information includes: If the movement direction is the third rotation direction, controlling the speaker to increase the volume; If the movement direction is the fourth rotation direction, the speaker is controlled to lower the volume.

12. The method according to claim 8, characterized in that The target device is the intelligent display terminal, the body motion information corresponding to the second designated body part includes a motion direction of the second designated body part, and controlling the target device to perform a control operation corresponding to the body motion information includes: If the motion direction is the first swiping direction, controlling the intelligent display terminal to perform a backward operation, wherein the backward operation is used to play content after the current content based on a play sequence of content played on the screen of the intelligent display terminal; If the motion direction is the second swiping direction, the intelligent display terminal is controlled to perform a forward operation, wherein the forward operation is used to play content before the current content based on a play sequence of content played on the screen of the intelligent display terminal.

13. The method according to claim 8, characterized in that The target device is the intelligent display terminal, the body motion information corresponding to the second designated body part includes a motion direction of the second designated body part, and controlling the target device to perform a control operation corresponding to the body motion information includes: If the motion direction is the fifth rotation direction, the content displayed by the intelligent display terminal is controlled to change from the real-time collected video picture corresponding to the video conference scene to the specified content.

14. A data processing device, characterized in that: Applied to a first device, the first device is connected to at least one second device, the at least one second device includes an intelligent display terminal, the first device is also connected to an image acquisition device, and the apparatus includes: An acquisition unit, configured to acquire the user's posture information acquired by the image acquisition device when the intelligent display terminal is in a video conference scenario; a determining unit, configured to determine a target device to be operated from the at least one second device based on the posture information; A control unit is used to control the target device to perform a specified operation.

15. An electronic device, characterized in that: include: one or more processors; Memory; One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, and the one or more applications are configured to execute the method according to any one of claims 1-13.

16. A computer readable medium, characterized in that The computer-readable medium stores a program code executable by a processor, and when the program code is executed by the processor, the processor executes the method according to any one of claims 1 to 13.

Images