Terminal, terminal interaction method and device and computer readable storage medium

Abstract

The invention discloses a terminal, a terminal interaction method and device and a computer readable storage medium, and the method comprises the steps: controlling each input device to collect the interaction information of a terminal corresponding to each interaction scene, and transmitting the collected interaction information to other terminals corresponding to each interaction scene through a transmitting module; and receiving interaction information of other terminals corresponding to the interaction scenes through the receiving modules respectively, and controlling the output devices to output the received interaction information respectively. According to the invention, a scheme of outputting multiple interaction scenes is realized, so that low limitation of terminal interaction is realized.

Description

Technical Field

[0001] The present invention relates to the field of communication technologies, and in particular to a terminal, a terminal interaction method, a device, and a computer-readable storage medium. Background Art

[0002] At present, traditional terminals are usually used to run interactive scenarios such as online meetings. Since traditional terminals can only run a single interactive scenario, when there are multiple interactive scenarios, the traditional terminal needs to exit the current interactive scenario and run another interactive scenario, resulting in high limitations on terminal interaction. Summary of the invention

[0003] The main purpose of the present invention is to provide a terminal, a terminal interaction method, a device and a computer-readable storage medium, aiming to provide a solution for outputting multiple interaction scenarios to achieve low limitations of terminal interaction.

[0004] In a first aspect, a terminal is provided, the terminal comprising: at least two groups of input interfaces, at least two groups of output interfaces, a sending module and a receiving module, each input interface is respectively used to connect to each input device corresponding to each interaction scene, the input device is used to collect interaction information of the terminal, the sending module is connected to each input interface, and the sending module is connected to other terminals corresponding to each interaction scene, the other terminal is at least one terminal that interacts with the terminal, the sending module is used to send the collected interaction information to other terminals corresponding to each interaction scene, the receiving module is connected to each output interface, and the receiving module is connected to other terminals corresponding to each interaction scene, and the receiving module is used to receive the interaction information of each interaction scene. The received interaction information of other terminals corresponding to each interaction scene is sent to each output interface, and each output interface is used to connect to each output device corresponding to each interaction scene, and the output device is used to output the received interaction information of other terminals in each interaction scene. In this way, by setting multiple groups of input interfaces and multiple groups of output interfaces, the interaction information of terminals in multiple interaction scenes can be collected through the input devices connected to the multiple groups of input interfaces, and the interaction information of other terminals in multiple interaction scenes can be output through the output devices connected to the multiple groups of output interfaces, thereby realizing the solution of outputting multiple interaction scenes, thereby reducing the terminal interaction limitations.

[0005] In a second aspect, a terminal interaction method is provided, which is applied to a terminal. The terminal includes at least two groups of input interfaces, at least two groups of output interfaces, a sending module and a receiving module. Each input interface is respectively connected to each input device corresponding to each interaction scene. The sending module is connected to each input interface, and the sending module is connected to other terminals corresponding to each interaction scene. The receiving module is connected to each output interface, and the receiving module is connected to other terminals corresponding to each interaction scene. Each output interface is respectively connected to each output device corresponding to each interaction scene, wherein the other terminal is at least one terminal that interacts with the terminal. The terminal interaction method includes: controlling each input device to respectively collect interaction information of the terminal corresponding to each interaction scene, and sending the collected interaction information to other terminals corresponding to each interaction scene through the sending module; receiving the interaction information of other terminals corresponding to each interaction scene through each receiving module, and controlling each output device to respectively output the received interaction information. In this way, by respectively controlling the input devices connected to multiple groups of input interfaces to collect interaction information of terminals in multiple interaction scenes, and respectively controlling the output devices connected to multiple groups of output interfaces to output interaction information of other terminals in multiple interaction scenes, a solution for outputting multiple interaction scenes is realized, thereby reducing the limitations of terminal interaction.

[0006] In a third aspect, a terminal interaction device is provided, comprising: a memory, a processor, and a terminal interaction program stored in the memory and executable on the processor, wherein when the terminal interaction program is executed by the processor, the terminal interaction device executes the steps of the above method.

[0007] The third aspect corresponds to any implementation of the first aspect. The technical effects corresponding to the third aspect can refer to the technical effects corresponding to the first aspect, which will not be described in detail here.

[0008] In a fourth aspect, a computer-readable storage medium is proposed, on which a terminal interaction program is stored. When the terminal interaction program is executed by a processor, the terminal interaction device executes the terminal interaction method in the first aspect.

[0009] The fourth aspect corresponds to any implementation of the first aspect. The technical effects corresponding to the fourth aspect can refer to the technical effects corresponding to the above-mentioned first aspect, which will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] Figure 1 A schematic diagram of the structure of the hardware operating environment involved in the embodiment of the present invention;

[0011] Figure 2 A schematic diagram of a flow chart of a first embodiment of a terminal interaction method of the present invention;

[0012] Figure 3A schematic diagram of the structure of a terminal involved in an embodiment of the present invention;

[0013] Figure 4 A schematic diagram of a correspondence relationship between an input device and an output device of a terminal involved in an embodiment of the present invention and an interaction scenario;

[0014] Figure 5 A schematic diagram of another correspondence relationship between the input device and the output device of the terminal involved in the embodiment of the present invention and the interaction scene;

[0015] Figure 6 It is a schematic diagram of functional modules of a preferred embodiment of the terminal interaction device of the present invention.

[0016] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0017] It should be understood that the specific embodiments described herein are only used to explain the present invention, and are not used to limit the present invention.

[0018] like Figure 1 As shown, Figure 1 It is a schematic diagram of the device structure of the hardware operating environment involved in the embodiment of the present invention.

[0019] It should be noted that the terminal interaction device in the embodiment of the present invention may be a smart phone, a personal computer, a server or other device, and no specific limitation is made here.

[0020] like Figure 1 As shown, the terminal interaction device may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, and a communication bus 1002. Among them, the communication bus 1002 is used to realize the connection and communication between these components. The user interface 1003 may include a display (Display), an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface). The memory 1005 may be a high-speed RAM memory, or a stable memory (non-volatile memory), such as a disk memory. The memory 1005 may also be a storage device independent of the aforementioned processor 1001.

[0021] Those skilled in the art will understand that Figure 1 The device structure shown in the figure does not constitute a limitation on the terminal interaction device, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0022] like Figure 1 As shown, the memory 1005 as a computer storage medium may include an operating system, a network communication module, a user interface module, and a terminal interaction program. The operating system is a program that manages and controls the hardware and software resources of the device and supports the operation of the terminal interaction program and other software or programs. Figure 1 In the device shown, the user interface 1003 is mainly used for data communication with the client; the network interface 1004 is mainly used for establishing a communication connection with the server; and the processor 1001 can be used to call the terminal interaction program stored in the memory 1005 and perform the following operations:

[0023] Controlling each input device to respectively collect interaction information of the terminal corresponding to each interaction scene, and sending the collected interaction information to other terminals corresponding to each interaction scene through the sending module;

[0024] The receiving modules receive the interaction information of other terminals corresponding to each interaction scenario respectively, and control the output devices to output the received interaction information respectively.

[0025] Furthermore, the operation of controlling each output device to respectively output the received interaction information includes:

[0026] For any target interaction scenario in each interaction scenario, obtain the importance of the target interaction scenario in all interaction scenarios;

[0027] Based on the importance corresponding to the target interaction scenario, the information proportion of the received interaction information corresponding to the target interaction scenario is generated, wherein the higher the importance, the greater the information proportion;

[0028] According to the information proportion, the output device corresponding to the target interaction scene is controlled to output the received interaction information corresponding to the target interaction scene.

[0029] Furthermore, based on the importance corresponding to the target interaction scenario, the operation of generating the information ratio of the received interaction information corresponding to the target interaction scenario includes:

[0030] If there is at least one first interaction scene in each interaction scene, obtaining the importance of each first scene in all interaction scenes, wherein the output interface of the first interaction scene and the output interface of the target interaction scene are connected to a single shared output device;

[0031] According to the magnitude relationship between the importance of the target interaction scene and the importance of each first scene, the information ratio of the received interaction information corresponding to the target interaction scene is generated.

[0032] Further, after the operation of generating the information ratio of the received interaction information corresponding to the target interaction scenario based on the importance corresponding to the target interaction scenario, the processor 1001 may also be used to call the terminal interaction program stored in the memory 1005 to perform the following operations:

[0033] If it is detected that the total amount of interaction information data received corresponding to the target interaction scenario increases, and the increase is greater than the preset change threshold, the information proportion of the interaction information received corresponding to the target interaction scenario is increased;

[0034] If it is detected that the total amount of interaction information data received corresponding to the target interaction scenario decreases, and the decrease is greater than a preset change threshold, the information proportion of the interaction information received corresponding to the target interaction scenario is reduced.

[0035] Furthermore, the operation of controlling each input device to respectively collect the interaction information of the terminal corresponding to each interaction scene includes:

[0036] If the control authority corresponding to the terminal is lower than the preset authority threshold, a first control instruction sent by a terminal whose corresponding control authority is higher than the preset authority threshold is received, and based on the first control instruction, each input device is controlled to respectively collect interaction information of the terminal corresponding to each interaction scenario;

[0037] Controlling each output device to output the received interactive information respectively, including:

[0038] If the control authority corresponding to the terminal is lower than the preset authority threshold, a second control instruction sent by a terminal whose corresponding control authority is higher than the preset authority threshold is received, and based on the second control instruction, each output device is controlled to output the received interaction information respectively.

[0039] Furthermore, before controlling each input device to respectively collect the interaction information of the terminal corresponding to each interaction scene, the processor 1001 may also be used to call the terminal interaction program stored in the memory 1005 to perform the following operations:

[0040] Displaying the corresponding usage status of each input device and each output device on the terminal so that the input device and output device corresponding to each interactive scene can be selected;

[0041] For any target interaction scene in each interaction scene, the input device corresponding to the selected target interaction scene is bound to the target interaction scene, and the output device corresponding to the selected target interaction scene is bound to the target interaction scene.

[0042] Furthermore, the operation of controlling each input device connected to each input interface to respectively collect the interaction information of the terminal in each interaction scenario includes:

[0043] For any target interaction scene in each interaction scene, if the input device corresponding to the target interaction scene includes a camera, the camera is controlled to collect corresponding screen information in the target interaction scene as interaction information; and / or,

[0044] If the input device corresponding to the target interaction scene includes a microphone, the microphone is controlled to collect sound information in the target interaction scene as the interaction information.

[0045] Based on the above structure, various embodiments of the terminal interaction method are proposed.

[0046] Reference Figure 2 , Figure 2 It is a flowchart diagram of the first embodiment of the terminal interaction method of the present invention.

[0047] The embodiments of the present invention provide embodiments of the terminal interaction method. It should be noted that although the logical order is shown in the flowchart, in some cases, the steps shown or described may be performed in a different order than that shown here. In this embodiment, the execution subject of the terminal interaction method may be a personal computer, a smart phone or other device, which is not limited in this embodiment. For the sake of ease of description, the following description of each embodiment is omitted. In this embodiment, the terminal interaction method includes:

[0048] Step S10, controlling each input device to respectively collect interaction information of the terminal corresponding to each interaction scene, and sending the collected interaction information to other terminals corresponding to each interaction scene through a sending module;

[0049] In this embodiment, it should be noted that each input device includes a camera and / or a microphone, the number of cameras can be single or multiple, the number of microphones can be single or multiple, the placement position of each input device can be set by the user or randomly set, and it can be understood that different placement positions of the input device correspond to different collection areas, and therefore, also correspond to different interaction information. Each input device is connected to the sending module through its corresponding input interface. The interaction scene is a scene in which multiple terminals interact, and the scene can be a multi-terminal display scene or a call scene, wherein the call scene can be a conference scene, a social scene, or a learning scene, which is not limited here. It can be understood that when the number of terminals of other terminals is one, the corresponding interaction scene is a one-to-one call scene, and when the number of terminals of other terminals is multiple, the corresponding interaction scene is a one-to-many call scene or a multi-terminal display scene. The other terminals corresponding to different interaction scenes can be the same or different, which is not limited here. When there is a correlation between interaction scenes, there are corresponding relationships with other corresponding terminals. For example, when the correlation between interaction scene 1 and interaction scene 2 is a parent-child scene relationship (interaction scene 2 is a small-scale scene corresponding to interaction scene 1. When interaction scene 1 and interaction scene 2 are both conference scenes, interaction scene 2 is the "meeting-in-meeting scene" of interaction scene 1, or in other words, interaction scene 1 is a large conference scene and interaction scene 2 is a small conference scene), other terminals corresponding to interaction scene 1 include other terminals corresponding to interaction scene 2.

[0050] Exemplarily, each input device is controlled to collect interaction information of a terminal corresponding to each interaction scene in a collection area corresponding to its placement position, and each collected interaction information is sent to other terminals corresponding to each interaction scene through a sending module.

[0051] In a feasible embodiment, each input device is controlled to collect interaction information of the terminal corresponding to each interaction scene, and a scene label corresponding to each interaction information is generated. The sending module sends each collected interaction information to other terminals corresponding to each interaction scene according to the scene label corresponding to each collected interaction information.

[0052] In another possible embodiment, referring to Figure 3 , Figure 3 This is a structural diagram of a terminal involved in an embodiment of the present invention. At this time, the input device of the terminal includes microphone 1, microphone 2, camera 1 and camera 2, and the output device of the terminal includes speaker 1, speaker 2, display 1 and display 2.

[0053] Among them, in step S10, before controlling each input device to respectively collect the interaction information of the terminal corresponding to each interaction scene, it includes:

[0054] Step S01, displaying the corresponding usage status of each input device and each output device on the terminal, so as to select the input device and output device corresponding to each interactive scene;

[0055] In this embodiment, it should be noted that each output device includes a display and / or a speaker. The number of displays can be single or multiple, and the number of speakers can be single or multiple, which is not limited here.

[0056] In this embodiment, it should be noted that the use state can be an occupied state or an idle state.

[0057] Exemplarily, the corresponding usage status of each input device and each output device is displayed on the display of the terminal, so that the input device and output device corresponding to each interaction scene can be selected.

[0058] It can be understood that by displaying the corresponding usage status of each input device and each output device, the user can intuitively and quickly understand each usage status, thereby improving the efficiency of selecting input devices and output devices for each interaction scene.

[0059] In a feasible embodiment, in response to the user's selection operation on the input device and the output device corresponding to each interaction scene, the input device and the output device corresponding to each interaction scene selected by the user are obtained.

[0060] In another feasible embodiment, any input device and any output device in an idle state are used as the input device and output device corresponding to each interaction scenario.

[0061] In another feasible embodiment, the correlation between the interaction scenarios is obtained, and the input device and the output device corresponding to each interaction scenario are jointly selected based on the correlation and the usage status.

[0062] Furthermore, based on the correlation between each interaction scene, the correlation between each interaction scene is generated. If there is at least one group of interaction scenes in each interaction scene, and the correlation between each interaction scene in each group of interaction scenes is greater than a preset correlation threshold, then each interaction scene in each group of interaction scenes corresponds to the same output device and / or the same input device.

[0063] It is understandable that when the correlation between interaction scenes is high, for example, the two interaction scenes mentioned above are in a parent-child relationship, if the interaction scenes with high correlation correspond to different output devices and / or input devices, the user may need to frequently switch to use different output devices, resulting in poor user convenience of terminal interaction, and / or, there may be actual collection of interaction information of the same content for different interaction scenes, resulting in unnecessary waste of device occupancy.

[0064] Step S02: for any target interaction scene in each interaction scene, the input device corresponding to the selected target interaction scene is bound to the target interaction scene, and the output device corresponding to the selected target interaction scene is bound to the target interaction scene.

[0065] In one possible embodiment, referring to Figure 4 , Figure 4 This is a schematic diagram of a correspondence relationship between the input devices and output devices of the terminals involved in the embodiment of the present invention and the interaction scenes. The input devices of the terminals 1 and N in the occupied state include microphone 1 and camera 1, the input devices in the idle state include microphone 2 and camera 2, the output devices in the occupied state include speaker 1 and display 1, and the output devices in the idle state include speaker 2 and display 2. The input devices and output devices of the terminals 1 and N in the occupied state correspond to an interaction scene (the video conference 1 shown in the figure).

[0066] In another possible embodiment, referring to Figure 5 , Figure 5 This is another schematic diagram of the correspondence between the input devices and output devices of the terminals involved in the embodiment of the present invention and the interaction scenarios. The input devices of the terminals 1 and N in the occupied state include microphone 1, camera 1, microphone 2 and camera 2, and the output devices in the occupied state include speaker 1, display 1, speaker 2 and display 2. The input devices and output devices of the terminals 1 and N in the occupied state correspond to two interaction scenarios (video conference 1 and video conference 2 shown in the figure).

[0067] It is understandable that by making a one-to-one correspondence between the interaction scene and the output device, and making a one-to-one correspondence between the interaction scene and the input device, control disorder is avoided and the accuracy of the interaction information transmitted between the terminals before the interaction is ensured.

[0068] Wherein, after step S03, the method further includes: if it is detected that the target interaction scene is closed, unbinding the output device and the input device corresponding to the target interaction scene from the target interaction scene.

[0069] Among them, in step S10, controlling each input device connected to each input interface to respectively collect interaction information of the terminal in each interaction scenario includes:

[0070] Step S11, for any target interaction scene in each interaction scene, if the input device corresponding to the target interaction scene includes a camera, control the camera to collect corresponding screen information in the target interaction scene as interaction information; and / or,

[0071] In this embodiment, it should be noted that the picture information may be a still picture frame, or may be video data obtained by splicing a plurality of picture frames.

[0072] Exemplarily, the camera is controlled to collect image information of a collection area corresponding to the current placement position and shooting angle as the interaction information.

[0073] In a feasible embodiment, the camera is moved to a placement position corresponding to the target interaction scene, and / or the shooting angle of the camera is rotated to a shooting angle corresponding to the target interaction scene, wherein one interaction scene corresponds to a placement position of a camera, and / or one interaction scene corresponds to a shooting angle of a camera. For example, when the target interaction scene is a painting interaction course, the shooting angle and / or placement position of the camera needs to be adjusted so that the acquisition area corresponding to the camera is a drawing board.

[0074] Step S12: If the input device corresponding to the target interaction scene includes a microphone, the microphone is controlled to collect sound information in the target interaction scene as interaction information.

[0075] Exemplarily, the microphone is controlled to collect sound information of a collection area corresponding to the current placement position as the interaction information.

[0076] In a feasible embodiment, the microphone is moved to a placement position corresponding to the target interaction scene, wherein one interaction scene corresponds to a placement position of one microphone.

[0077] In a feasible embodiment, if the input device corresponding to the target interaction scene includes a microphone and a camera, the camera is controlled to collect image information in the target interaction scene, and the microphone is controlled to collect sound information in the target interaction scene, and the image information and sound information are spliced ​​according to their respective corresponding time sequences to obtain audio and video information as interaction information.

[0078] It can be understood that by moving the camera to a placement position corresponding to the target interaction scene, and / or rotating the camera's shooting angle to a shooting angle corresponding to the target interaction scene, and / or by moving the microphone to a placement position corresponding to the target interaction scene, the camera's placement position and / or shooting angle are adapted to the interaction scene, and / or the microphone's placement position is adapted to the interaction scene, so that the collected image information and / or sound information is consistent with the interaction scene, thereby improving the adaptability of terminal interaction information collection.

[0079] Among them, in step S10, controlling each input device to respectively collect the interaction information of the terminal corresponding to each interaction scene includes:

[0080] Step A10, if the control authority corresponding to the terminal is lower than the preset authority threshold, receiving a first control instruction sent by a terminal whose corresponding control authority is higher than the preset authority threshold, and based on the first control instruction, controlling each input device to respectively collect interaction information of the terminal corresponding to each interaction scenario;

[0081] In this embodiment, it should be noted that the preset authority threshold is a pre-set control authority critical value for determining whether the terminal has the authority to control the output device and / or the input device. The first control instruction is a control instruction for the input device, and the control instruction can be a control opening and closing instruction or a control parameter instruction, which is not limited here.

[0082] It can be understood that the control authority corresponding to the terminal corresponds to the interaction scene, one interaction scene corresponds to one control authority, and the control authority of each terminal is allocated by the dominant terminal corresponding to the interaction scene. For example, when the interaction scene is a conference scene, the dominant terminal is the conference initiating terminal.

[0083] Exemplarily, if the control authority of the terminal corresponding to the target interaction scene is lower than a preset authority threshold, a first control instruction sent by a terminal whose control authority corresponding to the target interaction scene is higher than the preset authority threshold is received, and based on the first control instruction, the input device corresponding to the target interaction scene is controlled to collect interaction information of the terminal corresponding to the target interaction scene.

[0084] In a feasible embodiment, the input device corresponding to the target interaction scene includes a camera. If the first control instruction includes an on-off control instruction, the on-off of the camera corresponding to the target interaction scene is controlled based on the on-off control instruction, and / or, if the first control instruction includes a control parameter instruction, the shooting angle and / or placement position of the camera corresponding to the target interaction scene is adjusted based on the control parameter instruction, and the camera corresponding to the target interaction scene is controlled to collect the screen information of the terminal corresponding to the target interaction scene at the adjusted shooting angle and / or placement position.

[0085] In another feasible embodiment, the input device corresponding to the target interaction scene includes a microphone. If the first instruction includes a control on-off instruction, the on-off of the microphone corresponding to the target interaction scene is controlled based on the control on-off instruction, and / or, if the first control instruction includes a control parameter instruction, the collection volume of the microphone corresponding to the target interaction scene is adjusted based on the control parameter instruction, and the microphone is controlled to collect sound information of the terminal corresponding to the target interaction scene with the adjusted collection volume.

[0086] Step S20: receiving interaction information of other terminals corresponding to each interaction scenario through each receiving module, and controlling each output device to output the received interaction information.

[0087] For any target interaction scene in each interaction scene, in a feasible embodiment, if the received interaction information corresponding to the target interaction scene is screen information, the display corresponding to the target interaction scene is controlled to output the received screen information.

[0088] In another feasible embodiment, if the received interaction information corresponding to the target interaction scene is sound information, the speaker corresponding to the target interaction scene is controlled to output the received sound information.

[0089] In another feasible embodiment, if the received interaction information corresponding to the target interaction scene is audio and video information, where the audio and video information includes sound information and picture information, then the display corresponding to the target interaction scene is controlled to output the received picture information, and at the same time, the speaker corresponding to the target interaction scene is controlled to output the received sound information.

[0090] In step S20, each output device is controlled to output the received interaction information respectively, including:

[0091] Step S21, if the control authority corresponding to the terminal is lower than the preset authority threshold, a second control instruction sent by a terminal whose corresponding control authority is higher than the preset authority threshold is received, and based on the second control instruction, each output device is controlled to output the received interaction information respectively.

[0092] In this embodiment, it should be noted that the second control instruction is a control instruction for the output device, and the control instruction may be a control switch instruction or a control parameter instruction, which is not limited here.

[0093] Exemplarily, if the control authority of the terminal corresponding to the target interaction scene is lower than a preset authority threshold, a second control instruction is sent by a terminal whose control authority corresponding to the target interaction scene is higher than the preset authority threshold, and based on the second control instruction, the output device corresponding to the target interaction scene is controlled to output the received interaction information corresponding to the target interaction scene.

[0094] In a feasible embodiment, the output device corresponding to the target interaction scene includes a speaker. If the second instruction includes a control on / off instruction, the on / off of the speaker corresponding to the target interaction scene is controlled based on the control on / off instruction, and / or, if the second control instruction includes a control parameter instruction, the output volume of the speaker corresponding to the target interaction scene is adjusted based on the control parameter instruction, and the speaker is controlled to output the sound information of other terminals corresponding to the target interaction scene at the adjusted output volume.

[0095] In another feasible embodiment, the output device corresponding to the target interaction scene includes a display. If the second instruction includes a control opening and closing instruction, the opening and closing of the display corresponding to the target interaction scene is controlled based on the control opening and closing instruction, and / or, if the second control instruction includes a control parameter instruction, the display mode of the screen information of other terminals corresponding to the target interaction scene on the display corresponding to the target interaction scene is adjusted based on the control parameter instruction, wherein the display mode includes at least one of minimized display, window display, full screen display and vertical screen display, and the display corresponding to the target interaction scene is controlled to output the screen information of other terminals corresponding to the target interaction scene according to the display mode.

[0096] An embodiment of the present invention provides a terminal interaction method, which first controls each input device to respectively collect interaction information of a terminal corresponding to each interaction scene, and respectively sends the collected interaction information to other terminals corresponding to each interaction scene through a sending module, and then respectively receives the interaction information of other terminals corresponding to each interaction scene through each receiving module, and controls each output device to respectively output the received interaction information. In this way, by respectively controlling the input devices connected to multiple groups of input interfaces to collect interaction information of terminals in multiple interaction scenes, and respectively controlling the output devices connected to multiple groups of output interfaces to output interaction information of other terminals in multiple interaction scenes, a solution for outputting multiple interaction scenes is implemented, thereby reducing the limitations of terminal interaction.

[0097] Further, based on the above first embodiment, a second embodiment of the terminal interaction method of the present invention is proposed. For the same or similar contents as the above embodiment, please refer to the above introduction and will not be described in detail later. In this embodiment, in step S20, each output device is controlled to output the received interaction information respectively, including:

[0098] Step B10, for any target interaction scene in each interaction scene, obtaining the importance of the target interaction scene in all interaction scenes;

[0099] In a feasible embodiment, the importance of each interaction scenario set by the user is obtained.

[0100] In another feasible embodiment, the scene start time corresponding to each interaction scene is obtained, and the importance of each interaction scene is generated based on the scene start time corresponding to each interaction scene, wherein the earlier the scene start time is, the higher the importance is, or the later the scene start time is, the higher the importance is.

[0101] Step B20, based on the importance corresponding to the target interaction scenario, generating an information ratio of the received interaction information corresponding to the target interaction scenario, wherein the higher the importance, the greater the information ratio;

[0102] In this embodiment, it should be noted that the information ratio is at least one of the volume ratio, the image quality ratio, and the screen size ratio.

[0103] In a feasible embodiment, if the received interaction information corresponding to the target interaction scene is sound information, the volume ratio of the sound information of other terminals corresponding to the target interaction scene is generated based on the importance corresponding to the target interaction scene, wherein the higher the importance, the greater the volume ratio.

[0104] It is understandable that when various interaction scenarios are carried out at the same time, if the volume ratio of the sound information of other terminals in each interaction scenario is set to the same ratio, the sound information of other terminals in the interaction scenario with higher importance is easily ignored, resulting in poor targeted volume output of terminal interaction. By setting a larger volume ratio for the interaction scenario with higher importance, the sound information of other terminals corresponding to the interaction scenario with high importance is output with a high volume ratio, which improves the targeted volume output of terminal interaction. At the same time, it also saves the power of the speaker corresponding to the interaction scenario with lower importance, and improves its battery life.

[0105] In another feasible embodiment, if the received interaction information corresponding to the target interaction scene is screen information, the picture quality ratio and / or screen size ratio of the screen information of other terminals corresponding to the target interaction scene is generated based on the importance corresponding to the target interaction scene, wherein the higher the importance, the higher the picture quality ratio and the larger the screen size ratio.

[0106] It is understandable that when various interactive scenes are carried out simultaneously, if the picture quality ratio and / or picture size ratio of the screen information of other terminals in each interactive scene are set to the same ratio, the screen information of other terminals in interactive scenes with higher importance is easily ignored, resulting in poor pertinence of the screen output of terminal interaction. By setting a larger picture quality ratio and / or screen size ratio for interactive scenes with higher importance, larger and / or clearer screen information is output for interactive scenes with higher importance, thereby improving the pertinence of the screen output of terminal interaction, and at the same time, saving the device performance occupancy of the display corresponding to interactive scenes with lower importance.

[0107] In step B20, based on the importance of the target interaction scenario, the information ratio of the received interaction information corresponding to the target interaction scenario is generated, including:

[0108] Step B21, if there is at least one first interaction scene in each interaction scene, obtaining the importance of each first scene in all interaction scenes, wherein the output interface of the first interaction scene and the output interface of the target interaction scene are connected to a single shared output device;

[0109] In this embodiment, it should be noted that the shared output device is an output device shared by multiple interactive scenes, and the shared output device may be a speaker or a display.

[0110] Step B22: generating an information ratio of the received interaction information corresponding to the target interaction scene according to the magnitude relationship between the importance of the target interaction scene and the importance of each first scene.

[0111] Exemplarily, the importance corresponding to the target interaction scene is summed with the importance corresponding to each first scene to obtain the total importance, and the ratio between the importance corresponding to the target interaction scene and the total importance is used as the information ratio of the received interaction information corresponding to the target interaction scene.

[0112] In a feasible embodiment, if the output device corresponding to the target interaction scene includes a speaker, the ratio is used as the volume proportion of the received interaction information corresponding to the target interaction scene.

[0113] In another feasible embodiment, if the output device corresponding to the target interaction scene includes a display, the ratio is used as the image quality ratio and / or screen size ratio of the received interaction information corresponding to the target interaction scene.

[0114] Among them, in step B20, after generating the information ratio of the received interaction information corresponding to the target interaction scenario based on the importance corresponding to the target interaction scenario, it also includes:

[0115] Step B23, if it is detected that the total amount of interaction information data received corresponding to the target interaction scenario increases, and the increase is greater than a preset change threshold, then the information proportion of the interaction information received corresponding to the target interaction scenario is increased;

[0116] In this embodiment, it should be noted that if the interaction information includes sound information, the louder the sound information volume, the larger the total amount of interaction information data. The preset change threshold is a preset critical value of the total amount of interaction information data for determining that the interaction information of other terminals corresponding to the interaction scene has a large change.

[0117] It is understandable that there may be a situation where the sound information of other terminals corresponding to the target interaction scene suddenly appears, or the picture information of other terminals suddenly appears, or the volume of the sound information of other terminals suddenly increases. If the received interaction information corresponding to the target interaction scene is still output at the originally lower information ratio of the target interaction scene, it is easy to ignore the sudden change of interaction scene, resulting in poor real-time performance of terminal interaction.

[0118] Step B24: if it is detected that the total amount of interaction information data received corresponding to the target interaction scenario is reduced, and the reduction is greater than a preset change threshold, the information proportion of the interaction information received corresponding to the target interaction scenario is reduced.

[0119] It is understandable that there may be a situation where the sound information of other terminals corresponding to the target interaction scene disappears from existence, or the picture information of other terminals disappears from existence, or the volume of the sound information of other terminals drops suddenly. If the received interaction information corresponding to the target interaction scene is still output at the originally higher information ratio of the target interaction scene, unnecessary resource occupation of the output device corresponding to the interaction scene may easily occur, resulting in poor real-time performance of terminal interaction.

[0120] Step B30, according to the information ratio, controlling the output device corresponding to the target interaction scene to output the received interaction information corresponding to the target interaction scene.

[0121] In a feasible embodiment, according to the volume ratio, the speaker corresponding to the target interaction scene is controlled to output the received interaction information corresponding to the target interaction scene.

[0122] In another feasible embodiment, according to the image quality ratio and / or the screen size ratio, the display corresponding to the target interaction scene is controlled to output the received interaction information corresponding to the target interaction scene.

[0123] An embodiment of the present invention provides a terminal interaction method. First, for any target interaction scene in each interaction scene, the importance of the target interaction scene in all interaction scenes is obtained, so that based on the importance corresponding to the target interaction scene, the information ratio of the interaction information received corresponding to the target interaction scene is generated, wherein the higher the importance, the greater the information ratio. Then, according to the information ratio, the output device corresponding to the target interaction scene is controlled to output the interaction information received corresponding to the target interaction scene, so that the output device outputs the interaction information with a larger information ratio for higher importance, and outputs the interaction information with a smaller information ratio for lower importance, thereby highlighting the interaction information of other terminals of the interaction scene with higher importance, and improving the targeted nature of the terminal interaction.

[0124] In addition, the embodiment of the present invention also provides a terminal interaction device, referring to Figure 6 , the terminal interaction device comprises:

[0125] The collection module 10 is used to control each input device to collect the interaction information of the terminal corresponding to each interaction scene, and send the collected interaction information to other terminals corresponding to each interaction scene through the sending module;

[0126] The output module 20 is used to receive the interaction information of other terminals corresponding to each interaction scenario through each receiving module, and control each output device to output the received interaction information.

[0127] Furthermore, the output module 20 is also used for:

[0128] For any target interaction scenario in each interaction scenario, obtain the importance of the target interaction scenario in all interaction scenarios;

[0129] Based on the importance corresponding to the target interaction scenario, the information proportion of the received interaction information corresponding to the target interaction scenario is generated, wherein the higher the importance, the greater the information proportion;

[0130] According to the information proportion, the output device corresponding to the target interaction scene is controlled to output the received interaction information corresponding to the target interaction scene.

[0131] Furthermore, the output module 20 is also used for:

[0132] If there is at least one first interaction scene in each interaction scene, obtaining the importance of each first scene in all interaction scenes, wherein the output interface of the first interaction scene and the output interface of the target interaction scene are connected to a single shared output device;

[0133] According to the magnitude relationship between the importance of the target interaction scene and the importance of each first scene, the information ratio of the received interaction information corresponding to the target interaction scene is generated.

[0134] Further, after generating the information ratio of the received interaction information corresponding to the target interaction scenario based on the importance corresponding to the target interaction scenario, the terminal interaction device further includes:

[0135] If it is detected that the total amount of interaction information data received corresponding to the target interaction scenario increases, and the increase is greater than the preset change threshold, the information proportion of the interaction information received corresponding to the target interaction scenario is increased;

[0136] If it is detected that the total amount of interaction information data received corresponding to the target interaction scenario decreases, and the decrease is greater than a preset change threshold, the information proportion of the interaction information received corresponding to the target interaction scenario is reduced.

[0137] Furthermore, the acquisition module 10 is also used for:

[0138] If the control authority corresponding to the terminal is lower than the preset authority threshold, a first control instruction sent by a terminal whose corresponding control authority is higher than the preset authority threshold is received, and based on the first control instruction, each input device is controlled to respectively collect interaction information of the terminal corresponding to each interaction scenario;

[0139] The output module 20 is also used for:

[0140] If the control authority corresponding to the terminal is lower than the preset authority threshold, a second control instruction sent by a terminal whose corresponding control authority is higher than the preset authority threshold is received, and based on the second control instruction, each output device is controlled to output the received interaction information respectively.

[0141] Furthermore, before controlling each input device to respectively collect the interaction information of the terminal corresponding to each interaction scene, the terminal interaction device further includes:

[0142] Displaying the corresponding usage status of each input device and each output device on the terminal so that the input device and output device corresponding to each interactive scene can be selected;

[0143] For any target interaction scene in each interaction scene, the input device corresponding to the selected target interaction scene is bound to the target interaction scene, and the output device corresponding to the selected target interaction scene is bound to the target interaction scene.

[0144] Furthermore, the acquisition module 10 is also used for:

[0145] For any target interaction scene in each interaction scene, if the input device corresponding to the target interaction scene includes a camera, the camera is controlled to collect corresponding screen information in the target interaction scene as interaction information; and / or,

[0146] If the input device corresponding to the target interaction scene includes a microphone, the microphone is controlled to collect sound information in the target interaction scene as the interaction information.

[0147] The various embodiments of the terminal interaction device of the present invention may refer to the various embodiments of the terminal interaction method of the present invention, and will not be described in detail here.

[0148] In addition, an embodiment of the present invention further provides a computer-readable storage medium, on which a terminal interaction program is stored. When the terminal interaction program is executed by a processor, the following steps of the terminal interaction method are implemented.

[0149] The various embodiments of the terminal interaction device and the computer-readable storage medium of the present invention may refer to the various embodiments of the terminal interaction method of the present invention, and will not be described in detail here.

[0150] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0151] The serial numbers of the above embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.

[0152] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, a magnetic disk, or an optical disk), and includes a number of instructions for a terminal device (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods of various embodiments of the present invention.

[0153] The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. A terminal, characterized in that: The terminal includes a sending module, a receiving module, at least two groups of input interfaces and at least two groups of output interfaces, each of the input interfaces is respectively used to connect to each input device corresponding to each interaction scene, each of the input devices is used to collect interaction information of the terminal, the sending module is connected to each of the input interfaces, and the sending module is connected to other terminals corresponding to each of the interaction scenes, the other terminals are at least one terminal that interacts with the terminal, the sending module is used to send the interaction information of the terminal collected by each of the input devices to the other terminals corresponding to each of the interaction scenes, the receiving module is connected to each of the output interfaces, and the receiving module is connected to the other terminals corresponding to each of the interaction scenes, the receiving module is used to receive the interaction information of the other terminals corresponding to each of the interaction scenes, and send the received interaction information of the other terminals corresponding to each of the interaction scenes to each of the output interfaces, each of the output interfaces is respectively used to connect to each of the output devices corresponding to each of the interaction scenes, and the output devices are used to output the received interaction information of the other terminals in each of the interaction scenes.

2. The terminal according to claim 1, characterized in that A group of the input interfaces includes a camera interface and / or a microphone interface, the input device corresponding to the camera interface is a camera, and the input device corresponding to the microphone interface is a microphone; a group of the output interfaces includes a display interface and / or a speaker interface, the output device corresponding to the display interface is a display, and the output device corresponding to the speaker interface is a speaker.

3. A terminal interaction method, characterized in that: Applied to a terminal, the terminal comprises a sending module, a receiving module, at least two groups of input interfaces and at least two groups of output interfaces, each of the input interfaces is respectively connected to each input device corresponding to each interaction scenario, the sending module is connected to each input interface, and the sending module is connected to other terminals corresponding to each interaction scenario, the receiving module is connected to each output interface, and the receiving module is connected to other terminals corresponding to each interaction scenario, and each of the output interfaces is respectively connected to each output device corresponding to each interaction scenario, wherein the other terminal is at least one terminal that interacts with the terminal, The terminal interaction method comprises: Controlling each of the input devices to respectively collect interaction information of the terminal corresponding to each of the interaction scenarios, and sending the collected interaction information to the other terminals corresponding to each of the interaction scenarios through the sending module; The interaction information of the other terminals corresponding to each interaction scenario is received respectively by each receiving module, and each output device is controlled to output the received interaction information respectively.

4. The terminal interaction method according to claim 3, wherein the step of controlling each of the output devices to respectively output the received interaction information comprises: For any target interaction scene in each of the interaction scenes, obtaining the importance of the target interaction scene in all the interaction scenes; Based on the importance corresponding to the target interaction scenario, generating an information proportion of the received interaction information corresponding to the target interaction scenario, wherein the higher the importance, the greater the information proportion; According to the information proportion, the output device corresponding to the target interaction scene is controlled to output the received interaction information.

5. The terminal interaction method according to claim 4, wherein generating the information ratio of the received interaction information corresponding to the target interaction scenario based on the importance corresponding to the target interaction scenario comprises: If there is at least one first interaction scene in each of the interaction scenes, obtaining the importance of each of the first interaction scenes in all the interaction scenes, wherein the output interface of the first interaction scene and the output interface of the target interaction scene are connected to a single shared output device; According to the magnitude relationship between the importance of the target interaction scene and the importance of each of the first scenes, an information ratio of the received interaction information corresponding to the target interaction scene is generated.

6. The terminal interaction method according to claim 4, after generating the information ratio of the received interaction information corresponding to the target interaction scenario based on the importance corresponding to the target interaction scenario, further comprising: If it is detected that the total amount of interaction information data received corresponding to the target interaction scenario increases, and the increase is greater than a preset change threshold, then the information proportion of the interaction information received corresponding to the target interaction scenario is increased; If it is detected that the total amount of interaction information data received corresponding to the target interaction scenario decreases, and the decrease is greater than the preset change threshold, the information proportion of the interaction information received corresponding to the target interaction scenario is reduced.

7. The terminal interaction method according to claim 3, characterized in that: The controlling each of the input devices to respectively collect the interaction information of the terminal corresponding to each of the interaction scenarios includes: If the control authority corresponding to the terminal is lower than the preset authority threshold, a first control instruction sent by a terminal whose corresponding control authority is higher than the preset authority threshold is received, and based on the first control instruction, each of the input devices is controlled to respectively collect the interaction information of the terminal corresponding to each of the interaction scenarios; The controlling each of the output devices to respectively output the received interaction information comprises: If the control authority corresponding to the terminal is lower than the preset authority threshold, a second control instruction sent by a terminal whose corresponding control authority is higher than the preset authority threshold is received, and based on the second control instruction, each of the output devices is controlled to output the received interaction information respectively.

8. The terminal interaction method according to claim 3, characterized in that: Before controlling each of the input devices to respectively collect the interaction information of the terminal corresponding to each of the interaction scenarios, the method includes: Displaying the corresponding usage status of each input device and each output device on the terminal so as to select the input device and output device corresponding to each interaction scenario; For any target interaction scene in each of the interaction scenes, the input device corresponding to the selected target interaction scene is bound to the target interaction scene, and the output device corresponding to the selected target interaction scene is bound to the target interaction scene.

9. The terminal interaction method according to any one of claims 3 to 8, characterized in that: The controlling each input device connected to each input interface to respectively collect interaction information of the terminal in each interaction scenario includes: For any target interaction scene in each of the interaction scenes, if the input device corresponding to the target interaction scene includes a camera, the camera is controlled to collect the corresponding screen information of the target interaction scene as the interaction information; and / or, If the input device corresponding to the target interaction scene includes a microphone, the microphone is controlled to collect sound information in the target interaction scene as the interaction information.

10. A terminal interaction device, characterized in that: The terminal interaction device comprises: a memory, a processor, and a terminal interaction program stored in the memory and executable on the processor, wherein the terminal interaction program implements the steps of the terminal interaction method according to any one of claims 3 to 9 when executed by the processor.

11. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a terminal interaction program, and when the terminal interaction program is executed by the processor, the steps of the terminal interaction method according to any one of claims 3 to 9 are implemented.

Images