Device control method, host device, education terminal system and storage medium

By monitoring the USB interface and confirming the device type in a multi-person communication scenario, displaying the device control interface and generating function trigger commands, the problem of insufficient linkage between personal computers and other devices is solved, and efficient device control and multi-person communication support is achieved.

CN119829486APending Publication Date: 2025-04-15GUANGZHOU SHIYUAN ELECTRONICS CO LTD +1
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202311324893.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-10-12
Publication Date
2025-04-15

AI Technical Summary

Technical Problem

In the existing multi-person communication scenario, the linkage between personal computers and other devices is insufficient and cannot provide efficient operation support.

Method used

By monitoring the USB interface to connect to a new device, confirm the device type, and display the device control interface when confirming it as a slave device, and generate and send function trigger commands through functional controls to achieve efficient control of the slave device.

Benefits of technology

It realizes efficient operation of the host device on the slave device, ensures the comprehensive linkage required during the multi-person communication process, and supports diverse multi-person communication scenarios.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119829486A_ABST
    Figure CN119829486A_ABST
Patent Text Reader

Abstract

The embodiment of the invention discloses a device control method, a host device, an education terminal system and a storage medium, the device control method can be applied to the host device, the host device obtains a device type when monitoring that a new device is accessed to a USB interface, and if the new device is enumerated as a preset slave device, the slave device is started; if yes, the new device is a device capable of being subjected to online control, at the moment, the device control interface corresponding to the slave device is directly displayed, the trigger operation is detected through the function control in the device control interface, and the state of the target function of the slave device can be directly adjusted; therefore, efficient operation of one host device on the slave device is achieved, comprehensive linkage of the externally-connected host device on the whole device system is achieved under the condition that the slave device serves as a control center of multiple devices, and powerful support is provided for efficient operation needed in the multi-person communication process.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The embodiments of the present invention relate to the field of communication technology, and in particular to a device control method, a host device, an educational terminal system and a storage medium. Background Art

[0002] With the continuous development of electronic technology, various forms of electronic devices continue to emerge and are applied to various fields of social production activities. For example, in scenarios such as electronic classrooms for multi-person communication, a large interactive tablet is usually set up to present the focus information for multi-person communication, and the interactive tablet is usually equipped with multiple microphones, speakers and other devices to assist in information collection and output. In addition to the above devices directly used for multi-person communication, the podium can also be set up in the form of a podium machine, which is equivalent to integrating a terminal device in the podium as a podium host, and the podium host comprehensively manages various devices in the electronic classroom. In the actual use of the electronic classroom, teachers may also bring personal computers, operate the personal computers in collaboration with various devices in the electronic classroom, and use personal computers as data sources to carry out teaching or other multi-person communication activities.

[0003] When the inventor used the existing electronic classroom to carry out multi-person communication activities, he found that the existing personal computers are usually used as the data source of focus information in multi-person communication scenarios, and various other devices are mainly used as peripherals of the personal computers. In multi-person communication scenarios with rich and diverse needs, the personal computers and other devices are insufficiently linked and cannot provide support for the efficient operations required in the multi-person communication process. Summary of the invention

[0004] The present invention provides a device control method, a host device, an educational terminal system and a storage medium to solve the technical problem that in existing multi-person communication scenarios, personal computers and other devices are not sufficiently linked and cannot provide support for efficient operations required in the multi-person communication process.

[0005] In a first aspect, an embodiment of the present invention provides a device control method, which is applied to a host device and includes:

[0006] When a new device is detected to be connected to the USB interface, the device type of the new device is confirmed;

[0007] When confirming that the device type is a preset slave device, displaying a device control interface corresponding to the slave device, the device control interface includes at least one function control, each function control corresponding to a device function of the slave device;

[0008] When receiving a trigger operation acting on a target control in the functional control, a function trigger instruction is generated according to a target function corresponding to the target control;

[0009] The function trigger instruction is sent to the new device through the USB interface, so that the new device switches the running state of the target function in response to the function trigger instruction.

[0010] In a second aspect, an embodiment of the present invention provides a device control method, which is applied to an educational terminal system, wherein the educational terminal system includes a host device and a slave device; the device control method includes:

[0011] When the host device detects that a new device is connected to the USB interface, it confirms the device type of the new device;

[0012] When the host device confirms that the device type is a preset slave device, the host device displays a device control interface corresponding to the slave device, wherein the device control interface includes at least one function control, and each function control corresponds to a device function of the slave device;

[0013] When the host device receives a trigger operation acting on a target control in the function control, it generates a function trigger instruction according to the target function corresponding to the target control;

[0014] The host device sends the function trigger command to the new device through the USB interface;

[0015] When the slave device receives a function trigger instruction through the USB interface, it switches the running state of the target function in response to the function trigger instruction.

[0016] In a third aspect, an embodiment of the present invention provides a host device, the host device comprising:

[0017] one or more processors;

[0018] a memory for storing one or more computer programs;

[0019] When one or more computer programs are executed by one or more processors, the host device implements the device control method of the first aspect.

[0020] In a fourth aspect, an embodiment of the present invention provides an educational terminal system, the educational terminal system comprising a host device and a slave device, the host device and the slave device both comprising:

[0021] one or more processors;

[0022] a memory for storing one or more computer programs;

[0023] When one or more computer programs are executed by one or more processors, the host device and the slave device cooperate to implement any device control method as described in the second aspect.

[0024] In a fifth aspect, an embodiment of the present invention provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the device control method of the first aspect or the second aspect.

[0025] The above-mentioned device control method, host device, educational terminal system and storage medium, the device control method is applied to the host device, including: when monitoring the connection of a new device to the USB interface, confirming the device type of the new device; when confirming that the device type is a preset slave device, displaying the device control interface corresponding to the slave device, the device control interface includes at least one function control, each function control corresponds to a device function of the slave device; when receiving a trigger operation acting on a target control in the function control, generating a function trigger instruction according to the target function corresponding to the target control; sending the function trigger instruction to the new device through the USB interface, so that the new device switches the operating state of the target function in response to the function trigger instruction. When the host device detects that a new device is connected to the USB interface, it obtains the device type. If the new device is enumerated as a preset slave device, it means that the new device can be controlled online. At this time, the device control interface corresponding to the slave device is directly displayed. The trigger operation is detected by the function control in the device control interface, and the state of the target function of the slave device can be directly adjusted, thereby realizing efficient operation of the slave device by a host device. When the slave device serves as the control center of multiple devices, the externally connected host device realizes the comprehensive linkage of the entire device system, which provides strong support for the efficient operation required in the communication process of multiple people. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0027] Figure 1 A schematic diagram of a host device and a slave device in an exemplary scenario provided in an embodiment of the present application;

[0028] Figure 2 A method flow chart of a device control method provided in an embodiment of the present application;

[0029] Figure 3 A schematic diagram of the internal connection between a host device and a slave device in an exemplary scenario of an embodiment of the present application;

[0030] Figure 4 This is a schematic diagram of the pin arrangement of the Type-C interface plug;

[0031] Figure 5 A schematic diagram of a display interface of a slave device in an exemplary scenario of an embodiment of the present application;

[0032] Figure 6 A schematic diagram of a device control interface provided in an exemplary scenario of an embodiment of the present application;

[0033] Figure 7 A schematic diagram of a data processing and transmission process in a device control method provided in an embodiment of the present application;

[0034] Figure 8 A schematic diagram of the structure of a host device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0035] In order to make the purpose, technical scheme and advantages of the present application clearer, the embodiments of the present application will be further described in detail below in conjunction with the accompanying drawings. It is understood that the specific embodiments described herein are used to explain the present invention, rather than to limit the present invention. It should also be noted that, for the sake of ease of description, only parts related to the present invention, rather than all structures, are shown in the accompanying drawings.

[0036] It should be noted that due to space limitations, this application description does not list all optional implementation methods. After reading this application description, those skilled in the art should be able to understand that as long as the technical features do not contradict each other, any combination of technical features can constitute an optional implementation method.

[0037] Each embodiment is described in detail below.

[0038] In an electronic classroom, a large interactive tablet is usually set up to present the focus information for multi-person communication. The interactive tablet will be equipped with multiple microphones, speakers and other devices to assist in information collection and output. In addition to the above devices directly used for multi-person communication, in order to realize the control of related equipment, the podium is also set in the form of a podium complete machine. The podium complete machine is equivalent to integrating a podium host with data processing capabilities in a traditional podium, and the podium host performs comprehensive management of various devices in the electronic classroom. When using this type of electronic classroom, the lecturer usually carries a personal computer, and the personal computer and various devices in the electronic classroom are operated in collaboration, and the personal computer is used as the data source of the focus information to carry out teaching or other multi-person communication activities. Various other devices are mainly used as peripherals of personal computers. In the multi-person communication scenarios with rich and diverse needs, the linkage between personal computers and other devices is insufficient, and the efficient operations required in the multi-person communication process cannot be supported. For example, the operation of the focus information and the control of the equipment in the electronic classroom require switching the operation object back and forth. This switching behavior will interrupt the normal multi-person communication and disrupt the rhythm of information transmission during the communication process.

[0039] Based on the technical problems existing in the prior art, a solution of an embodiment of the present invention is proposed. When the host device monitors that a new device is connected to the USB interface, it obtains the device type. If the new device is enumerated as a preset slave device, it means that the new device is a device that can be controlled online. At this time, the device control interface corresponding to the slave device is directly displayed. By detecting the trigger operation through the function control in the device control interface, the state of the target function of the slave device can be directly adjusted, thereby realizing efficient operation of the slave device by a host device. When the slave device serves as the control center of multiple devices, the host device connected externally realizes the comprehensive linkage of the entire device system, providing strong support for the efficient operation required in the multi-person communication process.

[0040] In a multi-person communication scenario, a speaker usually brings a terminal device into the communication environment. In the communication environment, there are various devices that directly participate in the communication and terminal devices that perform comprehensive management of the devices in the communication environment. In the embodiment of the present application, considering that the speaker is most familiar with the terminal device he carries with him, which is the data source of the focus information and also the device with a high operation rate, when realizing the linkage between the terminal device carried by the individual and the devices in the communication environment, the terminal device carried by the individual is used as the host device in the linkage process, and the other devices in the communication environment are used as slave devices. The control direction is mainly the control of the slave device by the host device. Please refer to Figure 1 , taking the electronic classroom as an exemplary multi-person communication scenario, when using the electronic classroom, the teacher 20 usually carries a personal computer 20 into the electronic classroom, and the electronic classroom is equipped with a podium machine 10, and the podium machine 10 is provided with a podium host 11, and the podium host 11 can perform comprehensive management of the electronic classroom. The control process after the personal computer 20 in the electronic classroom is connected to the podium host is exemplified, and other possible slave device forms are supplemented to the embodiment of the present application.

[0041] Figure 2 is a method flow chart of a device control method provided by an embodiment of the present application, such as Figure 2 As shown, the device control method includes but is not limited to step S110 to step S140. When describing the device control method from the perspective of the host device, for a clearer description, the corresponding implementation process performed by the slave device will be described.

[0042] Step S110: when a new device is detected to be connected to the USB interface, the device type of the new device is confirmed.

[0043] In existing electronic devices, USB (Universal Serial Bus) interfaces are basically standard interfaces. Common USB interface types include type-A, type-B, type-C, etc. Any one of them can be used in the embodiments of the present application. After the host device detects that a new device is connected to the USB interface, it will complete the power-on, device information inquiry and other processes according to the prescribed procedures of the USB protocol until the device type of the new device is confirmed or the new device cannot be identified and an alarm is issued. The hardware connection realized based on the USB interface is convenient, simple and convenient to connect and has high compatibility. For example, host devices based on the Windows system can send corresponding protocol data to facilitate interaction, control and communication with slave devices.

[0044] When the host device of the embodiment of the present application monitors the preset level change of the power pin in the USB interface, it is confirmed that a new device is connected. For example, it is monitored whether the signal level value of the power pin in the USB interface is greater than the level threshold; or the signal level value of the power pin in the USB interface is not greater than the level threshold; or the signal waveform on the power pin in the USB interface within the preset time length matches the preset waveform, then it is confirmed that a new device is connected. The new device in the embodiment of the present application refers to a newly connected device relative to the existing external device state.

[0045] After a new device is detected, an inquiry data packet is sent to the new device so that the new device responds to the inquiry data packet and feeds back response information describing the device type. Taking the Type-C type USB interface as an example, after a new device is detected, the host device can send an inquiry data packet to the new device through the CC pin of the Type-C interface. The inquiry data packet can be information customized by the supplier for implementing device control; after receiving the inquiry data packet, the new device sends a response information to the host device through its CC pin. The response information is used to describe the device properties of the new device, which may include the current working mode or supported working mode of the new device (such as whether it supports DP mode), the specific power supply range (such as 5V), and other information, as well as a description of the device type of the new device (such as an external storage device).

[0046] The device type in the standard USB protocol does not correspond to the type of controllable slave device. In the slave device that can implement the device control method in the embodiment of the present application, it describes itself as a predefined controllable specific slave device type. After receiving the inquiry data packet, the slave device adds the information used to characterize the actual slave device type to the preset available field of the response information of the standard USB protocol according to the preset field data, thereby completing the response notification of the device type. The length of the response information is relatively fixed, and some of the fields are fixed to record only specified information, such as manufacturer information, device identification information, etc. Therefore, the device type information should select a field in the available fields that can be used flexibly to record the custom slave device type, such as the field dedicated to recording the device type agreed in the USB protocol, or other fields that can be used freely. It should be understood that the host device and the slave device protocol agree on the same specific field to ensure that after the slave device records the device type in the response information, the host device can accurately complete the confirmation of the device type.

[0047] After receiving the application information, the host device reads field data from a preset field in the received response information, and confirms the device type of the new device according to the field data.

[0048] Of course, there are multiple size standards and corresponding data protocol standards for USB interfaces, but the overall communication logic is the same. For the specific implementation logic of other types of USB interfaces besides the Type-C interface, you can refer to the specific implementation pins of the Type-C interface described above and make corresponding adjustments.

[0049] Step S120: when it is confirmed that the device type is a preset slave device, a device control interface corresponding to the slave device is displayed, the device control interface includes at least one function control, and each function control corresponds to a device function of the slave device.

[0050] For the host device, it is impossible to predict what type of device may be connected from the USB interface, but based on the basic structure of the response information and the agreed record fields, it is possible to identify the device type and respond to the newly connected device in a targeted manner. For example, if the user inserts a USB flash drive, when the host device monitors the USB interface to connect to a new device, it can confirm that the device type of the new device is an external storage device according to the above inquiry process, and the corresponding response is to display the drive letter of the new device, and can display a browsing option menu for the user to confirm the subsequent viewing target. Specifically, with respect to the slave device defined in the embodiments of the present application, when the user establishes a connection between the host device and the slave device via USB, when the host device monitors the USB interface to connect to a new device, it can confirm that the new device is a slave device according to the above inquiry process.

[0051] In the embodiment of the present application, the slave device is a device type specifically designed for the online control requirements in a specific application scenario, and the main connection response mechanism of this device type is that after connecting with other devices that can identify this type of device, the other devices implement a complete set of mechanisms that can control this type of device. This complete set of mechanisms at least includes displaying a device control interface corresponding to the slave device, the device control interface includes at least one function control, each function control corresponds to a device function of the slave device, and based on the device control interface, a control instruction can be generated and sent to the slave device, and the slave device can respond to the control instruction.

[0052] Specifically speaking of the devices that may be used in electronic classrooms and other educational scenarios, the slave devices may more specifically include the three types of the podium host, the interactive tablet in the electronic classroom, and the learning tablet used by individual students as exemplified in the previous text. Correspondingly, the host device may be a personal computer used by teachers or parents, or a mobile terminal device used by parents. When the teacher's personal computer is connected to the podium host or interactive tablet through a USB interface, the personal computer as a host device can confirm that the new device is a slave device, and confirm that it is a more specific slave device type of the podium host or interactive tablet. When the parent's personal computer or mobile terminal device is connected to the learning tablet through a USB interface as a host device, the personal computer or mobile terminal device can confirm that the new device is a slave device, and confirm that it is a more specific slave device type of the learning tablet. Although the above specific slave device types all belong to slave devices, their own design goals and supporting functions are different, and the corresponding controls that the host device can control are also different. Therefore, in the device control interface, the device control pages corresponding to different types of slave devices are also different.

[0053] The device functions that can be realized by a specific slave device type can refer to the design of existing related products. In the embodiments of this application, an online control strategy based on existing device functions is provided as an example. The device functions are divided according to the device body associated with the process of realizing the device functions, which can be regarded as including stand-alone functions completed inside the slave device, and online functions completed by the slave device and the host device. Stand-alone functions include volume adjustment function, brightness adjustment function, etc.; online functions include recording function, class recording function, etc.

[0054] Step S130: upon receiving a trigger operation acting on a target control in the functional control, a function trigger instruction is generated according to a target function corresponding to the target control.

[0055] There are multiple function controls, and the function control triggered by each trigger operation is the target control of the current operation. Each trigger operation generates a function trigger instruction. It should be noted that the same function control may not be fixed to perform a specific function. For example, two adjacent trigger operations on the mute function control, one for unmute and the other for sound stillness, that is, different function trigger instructions may be generated for the same function control. This implementation belongs to the conventional implementation of the interaction logic. The embodiment of the present application can generate the function trigger instruction in a targeted manner. The specific instruction generation process refers to the existing interaction logic.

[0056] Step S140: Send the function trigger instruction to the new device through the USB interface, so that the new device switches the running state of the target function in response to the function trigger instruction.

[0057] The host device sends a function trigger instruction through a pre-established communication connection, and the slave device receives and responds accordingly, switching the operating state of the target function. For example, the podium host 11 and the personal computer 21 in the above text can interact as follows: implement the control application software developed for the corresponding Windows system to perform some control interactions on the podium host 11 of the Android system, such as turning on and off the Android podium, turning on or off the network function of the Android podium, turning off the podium screen, lighting up the podium screen, special key function response, control of the podium elevator, volume increase and decrease, turning on and off the eye protection function, and managing the Android system process. A series of customized functions. Start the application software that serves the teaching needs in the Android system in the Windows system to achieve cross-device online collaboration, such as starting various teaching-related applications (recording the screen, opening courseware, etc.). The function trigger instruction is specifically sent to the new device through the communication connection created in the above text, and the new device as the podium host switches the operating state of the target function in response to the function trigger instruction. The communication connection is also used to transmit data generated during the function implementation process, that is, when the target function is an online function and the operating state is switched from the disabled state to the enabled state, the function data generated by the target function in the enabled state is received from the slave device through the USB interface. For example, the podium host 11 sends screen recording data to the personal computer 21.

[0058] In the process of using various devices, the device status may be updated due to the control behavior of other terminals. At this time, the podium host 11, as a device for comprehensive management of the entire electronic classroom, will obtain all status changes. It can send all status changes to the personal computer 21, so that the personal computer 21 updates and displays the corresponding device function status information. That is, for the personal computer 21, it receives the device function status information sent by the new device and displays the device function status information on the device control interface. The device function status information is used to characterize the current operating status of the device function.

[0059] In the embodiment of the present application, the host device, which is an exemplary device form of a personal computer, of course needs to install various applications, and the slave device also needs to install various corresponding applications to realize various functions. The host device and the slave device generally require corresponding operating systems to realize various functions. For the corresponding existing more common device types, the host device is a Windows system device; the slave device is an Android system device, and the specific hardware architecture, software architecture and connection process are described in detail.

[0060] For host devices, refer to Figure 3 Taking personal computer 21 as an example, it is a Windows system device and its hardware architecture has any one of the USB interface types Type-A, Type-B and Type-C.

[0061] For slave devices, refer to Figure 3 Taking the podium host 11 as an example, it is an Android system device, and its hardware architecture has any one of the USB interface types Type-A, Type-B and Type-C, and also has a USB OTG controller.

[0062] As a Windows system device, the USB standard driver of the personal computer 21 recognizes that a new device (such as the podium host 11) is connected. When the device type is confirmed to be a slave device, the new device is identified as a HID device and mounted on the Windows system. The Windows system application finds the podium host 11 according to the PID and VID number of the new device, opens the private port vendor-defined device, and sends a USB data packet with private communication content encapsulation through the private port. The USB data packet will be transmitted through the USB bus to achieve interaction, control and communication with the podium host 11. At the same time, the application can also receive the data packet transmitted from the podium host 11 by monitoring the port. The protocol data packet specified by the Windows system and the Android system is, for example: 0xAA 0xBB 0xCC main-id sub-id data

[128] 0xDD0xEE 0xFF, where the specific protocol meaning is jointly specified by the podium host 11 as an Android system device and the application developed for the Windows system according to the usage scenario.

[0063] The software system of the podium host 11 can be divided into a three-layer architecture. The first layer of the three-layer architecture is the USB kernel driver layer, which is mainly used to realize the registration, simulation, enumeration of USB-HID devices and private ports, as well as specific USB protocol communication work, and finally recognize the podium host 11 as a USB device with a preset device type by other host devices, and is mainly responsible for receiving and sending USB data packets.

[0064] The second layer in the three-layer architecture is the central management layer, which has two main purposes: the first purpose is to receive the USB data packets passed by the USB kernel driver layer for parsing, and parse the USB data packets (remove the shell of the USB data packets) to extract the valid content of the custom private communication. At the same time, it is identified according to the content in the private communication. If it is related to the Android system level, it is passed to the Android system kernel execution layer. If it is related to the Android application, it is broadcasted to the Android application execution layer. The second purpose is to receive the private communication content related to the Android system kernel execution layer and the Android application execution layer, and package it into a USB data packet format, pass it to the USB kernel driver layer, and let the USB kernel driver layer send the data packet to the host device.

[0065] The third layer in the three-layer architecture is mainly the actual execution layer of private communication, which is mainly divided into the Android system kernel execution layer and the Android application execution layer. The Android system kernel execution layer is mainly responsible for some hardware-related controls, such as soft power on / off, network switch, volume increase / decrease, screen off, and some hardware-related parameter information interaction. The device functions corresponding to these controls are usually stand-alone functions. The Android application execution layer is mainly responsible for starting some Android applications and controlling these Android applications to complete certain functions, such as recording classes and recording broadcasts based on independent applications. The device functions corresponding to these controls are usually online functions.

[0066] After the user connects the podium host 11 and the personal computer 21 via the USB interface, the host device actually implements the specific processing in step S110 and step S120. Figure 4 As shown, when all pins are used, the Type-C interface can be used normally in both forward and reverse directions, and powerful data transmission capabilities can be achieved through all used pins. When the podium host 11 is connected to the Type-C interface of the personal computer 21 through the Type-C interface, the personal computer 21 monitors the access of a new device. When the podium host 11 is not externally powered, the host device 21 can provide the podium host 11 with basic working or charging voltage through the power pin of the Type-C interface. When the podium host 11 is in the powered-on working state, the personal computer 21 will send an inquiry data packet to the podium host 11 through the CC pin. The inquiry data packet can be a predefined signal. After receiving the signal, the podium host 11 sends a response message to the personal computer 21 through its CC pin. The response information is used to describe the device attributes of the podium host 11, which may specifically include information such as the power supply range of the podium host 11, and the device type of the description podium host 11 is a kind of slave device. After receiving the response information sent by the podium host 11, the personal computer 21 displays the device control interface corresponding to the specific device type (i.e., the podium host 11) according to the description of the device type. The specific Type-C is divided into male and female ports in appearance, but the internal pin definitions are the same, and the data processing process after establishing the connection is also the same. The interface type of the podium host 11 and the personal computer 21 is not specifically limited here, and the two can achieve connection.

[0067] like Figure 5 As shown, in order to realize the convenient control of the entire electronic classroom, the podium host 11 may simplify the display of applications and functions, and finally present the following Figure 5The display interface 211 shown includes various functions based on application implementation as described above (mainly functions of educational applications) and various functions for controlling hardware (mainly controlled by shortcut keys). On the basis of completing the above device type confirmation and connection, the personal computer 21 displays the device control interface 111, wherein the device control interface 111 is a Windows application for realizing quick control in the electronic classroom, such as an application named Podium Butler, which is used to realize convenient control of the podium host 11 on the personal computer 21. Through this design of identification, connection and display, the presenter of the teaching or meeting does not need to switch the operation object, and can realize the boundary control of all devices in the multi-person communication scene with the personal computer 21 that uses the most. In the specific implementation process, the device control interface 111 can be independent of the projection screen, that is, when the personal computer 21 is in the projection state, the device control interface 111 does not belong to the content of the projection area and will not be sent to the projection target device for display.

[0068] Based on the confirmation of the above device types, the slave device of the Android system (such as the podium host 11) will simulate itself as a specific type of USB device through the USB-HID technology and mount it on the host device of the Windows system (such as a personal computer 21). The Windows application on the personal computer 21 can identify the podium host 11 by simulating the private PID and VID number, and communicate with the podium host through the USB port after identification. The Android system simulates the definition of a private USB-HID device port HID-compliant vendor-defined device, and creates a thread to monitor the USB port data, establishes a communication connection with the Windows system to achieve mutual communication, transmit control instructions to each other, and respond to each other's instructions and commands. Any Windows application in the personal computer 21 can transmit private data packets to the podium host 11 through the private USB-HID port to achieve cross-device and cross-system control, interaction and communication of the podium host 11.

[0069] In addition to the podium host 11 and the personal computer 21, the electronic classroom may also include an interactive tablet 31. The function of the podium host 11 may be a management function for the interactive tablet 31 or even other devices. When this type of function is triggered, the podium host 11 needs to send a headset control instruction generated according to the function trigger instruction to the interactive tablet 31. If the personal computer 21 is connected to the interactive tablet 31 through a USB interface, and the two can cooperate to implement the device control method in the embodiment of the present application, the control of the interactive tablet 31 can also be implemented on the personal computer 21 accordingly.

[0070] The data processing and transmission process in the above specific embodiment based on the podium host 11, the personal computer 21 and the interactive tablet 31 can be referred to. Figure 7 .

[0071] Based on the above cross-system implementation description, it can be found that based on the various devices appearing in the existing teaching scenarios, the linkage between Android system devices and Windows system devices can be realized without making hardware changes, and the implementation cost is low; and what is realized is the control of the hardware layer of the Android system device from the Windows system device based on the control instruction. The two devices can be connected through the USB interface to display the device control interface. Triggering a function control once in the device control interface can generate a function trigger instruction. Users only need one device to conveniently realize cross-system linkage.

[0072] In the above device control method, when a new device is connected to the USB interface, the device type of the new device is confirmed; when the device type is confirmed to be a preset slave device, a device control interface corresponding to the slave device is displayed, and the device control interface includes at least one function control, and each function control corresponds to a device function of the slave device; when a trigger operation acting on a target control in the function control is received, a function trigger instruction is generated according to the target function corresponding to the target control; the function trigger instruction is sent to the new device through the USB interface, so that the new device switches the running state of the target function in response to the function trigger instruction. When the host device monitors that a new device is connected to the USB interface, the device type is obtained. If the new device is enumerated as a preset slave device, it means that the new device is a device that can be controlled online. At this time, the device control interface corresponding to the slave device is directly displayed. The trigger operation is detected by the function control in the device control interface, and the state of the target function of the slave device can be directly adjusted, thereby realizing efficient operation of the slave device by a host device. When the slave device serves as the control center of multiple devices, the externally connected host device realizes the comprehensive linkage of the entire device system, which provides strong support for the efficient operation required in the multi-person communication process.

[0073] The embodiment of the present application also provides a device control method applied to an educational terminal system. Specifically, the process of implementing the device control method is described from the perspective of the educational terminal system. The device control method applied to the host device can be referred to in the previous text. The detailed description of data processing and data transmission between the host device and the slave device is not repeated here. Only the overall implementation process of the device control method applied to the educational terminal system is described. The device control method applied to the educational terminal system includes:

[0074] When the host device detects that a new device is connected to the USB interface, it confirms the device type of the new device;

[0075] When the host device confirms that the device type is a preset slave device, the host device displays a device control interface corresponding to the slave device, wherein the device control interface includes at least one function control, and each function control corresponds to a device function of the slave device;

[0076] When the host device receives a trigger operation acting on a target control in the function control, it generates a function trigger instruction according to the target function corresponding to the target control;

[0077] The host device sends the function trigger command to the new device through the USB interface;

[0078] When the slave device receives a function trigger instruction through the USB interface, it switches the running state of the target function in response to the function trigger instruction.

[0079] Based on the above embodiment, when the host device monitors that a new device is connected to the USB interface, the device type of the new device is confirmed, including:

[0080] When the host device detects a change in the preset level of the power pin in the USB interface, it confirms that a new device is connected;

[0081] The host device sends an inquiry packet to the new device;

[0082] When the slave device receives the inquiry data packet through the USB interface, it feeds back response information for describing the device type in response to the inquiry data packet;

[0083] The host device reads field data from a preset field in the received response information, and confirms the device type of the new device according to the field data.

[0084] Based on the above embodiment, when the host device monitors that a new device is connected to the USB interface, after confirming the device type of the new device, the following further includes:

[0085] When the host device confirms that the device type is a preset slave device, the host device establishes a communication connection based on a private USB-HID port with the new device through the USB interface;

[0086] Accordingly, the host device sends a function trigger instruction to the new device via the USB interface, including:

[0087] The host device sends the function trigger instruction to the new device through the communication connection.

[0088] On the basis of the above embodiments, the device functions include a stand-alone function completed inside the slave device, and an online function completed by the slave device in cooperation with the host device.

[0089] On the basis of the above embodiment, when the slave device receives the function trigger instruction through the USB interface, after switching the running state of the target function in response to the function trigger instruction, the further comprising:

[0090] When the target function is an online function and the operation state is switched from a disabled state to an enabled state, the slave device sends function data generated by the target function in the enabled state to the host device through the USB interface.

[0091] On the basis of the above embodiment, when the slave device receives the function trigger instruction through the USB interface, after switching the running state of the target function in response to the function trigger instruction, the further comprising:

[0092] The slave device sends device function status information in real time, and the device function status information is used to represent the current operating status of the device function;

[0093] The host device receives the device function status information and displays the device function status information on the device control interface. Based on the above embodiment, the host device is a Windows system device; and the slave device is an Android system device.

[0094] In the educational terminal system, the host device obtains the device type when it detects that a new device is connected to the USB interface. If the new device is enumerated as a preset slave device, it means that the new device can be controlled online. At this time, the device control interface corresponding to the slave device is directly displayed. The trigger operation is detected by the function control in the device control interface, and the state of the target function of the slave device can be directly adjusted, thereby realizing efficient operation of the slave device by a host device. When the slave device serves as the control center of multiple devices, the externally connected host device realizes the comprehensive linkage of the entire device system, which provides strong support for the efficient operation required in the multi-person communication process.

[0095] Figure 8 This is a schematic diagram of the structure of a host device provided in an embodiment of the present application. Figure 8 As shown, the electronic device includes a processor 310 and a memory 320. In a common product form, it may also include an input device 330, an output device 340, and a communication device 350. The number of processors 310 in the host device may be one or more. Figure 8 A processor 310 is taken as an example; the processor 310, the memory 320, the input device 330, the output device 340 and the communication device 350 in the host device can be connected via a bus or other means. Figure 8 The example of connecting through bus is taken in the following.

[0096] The memory 320 is a computer-readable storage medium that can be used to store software programs, computer executable programs and modules, such as program instructions / modules corresponding to the strength training data auxiliary processing method in the embodiment of the present application. The processor 310 executes various functional applications and data processing of the electronic device by running the software programs, instructions and modules stored in the memory 320, that is, implements the above-mentioned device control method.

[0097] The memory 320 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function; the data storage area may store data created according to the use of the electronic device, etc. In addition, the memory 320 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other non-volatile solid-state storage device. In some instances, the memory 320 may further include a memory remotely arranged relative to the processor 310, and these remote memories may be connected to the electronic device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0098] The input device 330 may be used to receive network configuration information. The output device 340 may include a display device such as a display screen.

[0099] The above-mentioned host device can be used to execute any device control method and has corresponding functions and beneficial effects.

[0100] The embodiment of the present application further provides an educational terminal system, which includes a host device and a slave device, and the host device and the slave device both include: one or more processors; a memory for storing one or more computer programs; when one or more computer programs are executed by one or more processors, the host device and the slave device cooperate to implement the device control method provided in any of the above embodiments, and have corresponding functions and beneficial effects. The specific hardware architecture of the host device and the slave device in the educational terminal system can refer to the description of the host device in the previous embodiment.

[0101] An embodiment of the present application also provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, it implements the relevant operations in the device control method provided in any embodiment of the present application and has corresponding functions and beneficial effects.

[0102] Those skilled in the art should understand that the embodiments of the present application may be provided as methods, systems, or computer program products.

[0103] An embodiment of the present invention also provides a storage medium containing computer executable instructions. When the computer executable instructions are executed by a computer processor, they are used to perform relevant operations in the device control method provided in any embodiment of the present application, and have corresponding functions and beneficial effects.

[0104] Those skilled in the art should understand that the embodiments of the present application may be provided as methods, systems, or computer program products.

[0105] Therefore, the present application may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present application may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code. The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the functions in the process. Figure 1 A process or multiple processes and / or boxes Figure 1 These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing device to work in a specific way, so that the instructions stored in the computer-readable memory produce a product including an instruction device, which implements the functions specified in the process. Figure 1 A process or multiple processes and / or boxes Figure 1 These computer program instructions can also be loaded onto a computer or other programmable data processing device, so that a series of operation steps are executed on the computer or other programmable device to produce a computer-implemented process, so that the instructions executed on the computer or other programmable device provide for implementing the process in the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0106] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory. The memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0107] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0108] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0109] Note that the above are only preferred embodiments of the present invention and the technical principles used. Those skilled in the art will understand that the present invention is not limited to the specific embodiments described herein, and that various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the scope of protection of the present invention. Therefore, although the present invention has been described in more detail through the above embodiments, the present invention is not limited to the above embodiments, and may include more other equivalent embodiments without departing from the concept of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims

1. A device control method, applied to a host device, characterized in that: include: When a new device is detected to be connected to the USB interface, the device type of the new device is confirmed; In the case of confirming that the device type is a preset slave device, displaying a device control interface corresponding to the slave device, the device control interface comprising at least one function control, each of the function controls corresponding to a device function of the slave device; When receiving a trigger operation acting on a target control in the functional controls, generating a function trigger instruction according to a target function corresponding to the target control; The function trigger instruction is sent to the new device through the USB interface, so that the new device switches the running state of the target function in response to the function trigger instruction.

2. The device control method according to claim 1, characterized in that: When monitoring that a new device is connected to the USB interface, confirming the device type of the new device includes: When a preset level change of a power pin in the USB interface is detected, it is confirmed that a new device is connected; Sending an inquiry data packet to the new device, so that the new device feeds back response information for describing the device type in response to the inquiry data packet; Field data is read from a preset field in the received response information, and the device type of the new device is confirmed according to the field data.

3. The device control method according to claim 1 or 2, characterized in that: When a new device is connected to the USB interface, after confirming the device type of the new device, the method further includes: When confirming that the device type is a preset slave device, establishing a communication connection based on a private USB-HID port with the new device through a USB interface; Correspondingly, sending the function trigger instruction to the new device through the USB interface so that the new device switches the running state of the target function in response to the function trigger instruction includes: The function trigger instruction is sent to the new device through the communication connection, so that the new device switches the running state of the target function in response to the function trigger instruction.

4. The device control method according to claim 1 or 2, characterized in that: The device functions include a stand-alone function completed inside the slave device, and an online function completed by the slave device in cooperation with the host device.

5. The device control method according to claim 4, characterized in that: After sending the function trigger instruction to the new device so that the new device switches the running state of the target function in response to the function trigger instruction, the method further includes: When the target function is an online function and the running state is switched from a disabled state to an enabled state, function data generated by the target function in the enabled state is received from the slave device through the USB interface.

6. The device control method according to claim 1 or 2, characterized in that: After sending the function trigger instruction to the new device through the USB interface so that the new device switches the running state of the target function in response to the function trigger instruction, the method further includes: Receive device function status information sent by the new device, and display the device function status information on the device control interface, where the device function status information is used to represent the current operating status of the device function.

7. The device control method according to claim 1 or 2, characterized in that: The host device is a Windows system device; the slave device is an Android system device.

8. A device control method, applied to an educational terminal system, characterized in that: The educational terminal system includes a host device and a slave device; The device control method comprises: When the host device detects that a new device is connected to the USB interface, the host device determines the device type of the new device; When the host device confirms that the device type is a preset slave device, the host device displays a device control interface corresponding to the slave device, wherein the device control interface includes at least one function control, each of which corresponds to a device function of the slave device; When the host device receives a trigger operation acting on a target control in the function controls, it generates a function trigger instruction according to a target function corresponding to the target control; The host device sends the function trigger instruction to the new device through the USB interface; When the slave device receives the function trigger instruction through the USB interface, it switches the running state of the target function in response to the function trigger instruction.

9. The device control method according to claim 8, characterized in that: When the host device monitors that a new device is connected to the USB interface, the device type of the new device is confirmed, including: When the host device monitors a change in the preset level of the power pin in the USB interface, it confirms that a new device is connected; The host device sends an inquiry data packet to the new device; When the slave device receives the inquiry data packet through the USB interface, the slave device feeds back response information for describing the device type in response to the inquiry data packet; The host device reads field data from a preset field in the received response information, and confirms the device type of the new device according to the field data.

10. The device control method according to claim 8 or 9, characterized in that: When the host device monitors that a new device is connected to the USB interface, after confirming the device type of the new device, the method further includes: When confirming that the device type is a preset slave device, the host device establishes a communication connection based on a private USB-HID port with the new device through a USB interface; Correspondingly, the host device sends the function trigger instruction to the new device through the USB interface, including: The host device sends the function trigger instruction to the new device through the communication connection.

11. The device control method according to claim 8 or 9, characterized in that: The device functions include a stand-alone function completed inside the slave device, and an online function completed by the slave device in cooperation with the host device.

12. The device control method according to claim 11, characterized in that: When the slave device receives the function trigger instruction through the USB interface, after switching the running state of the target function in response to the function trigger instruction, the slave device further includes: When the target function is an online function and the operation state is switched from a disabled state to an enabled state, the slave device sends the function data generated by the target function in the enabled state to the host device through the USB interface.

13. The device control method according to claim 8 or 9, characterized in that: When the slave device receives the function trigger instruction through the USB interface, after switching the running state of the target function in response to the function trigger instruction, the slave device further includes: The slave device sends device function status information in real time, where the device function status information is used to represent the current operating status of the device function; The host device receives the device function status information and displays the device function status information on the device control interface.

14. The device control method according to claim 8 or 9, characterized in that: The host device is a Windows system device; the slave device is an Android system device.

15. A host device, characterized in that include: one or more processors; a memory for storing one or more computer programs; When the one or more computer programs are executed by the one or more processors, the host device implements the device control method as described in any one of claims 1-7.

16. The educational terminal system is characterized in that: The invention comprises a host device and a slave device, wherein the host device and the slave device both comprise: one or more processors; a memory for storing one or more computer programs; When the one or more computer programs are executed by the one or more processors, the host device and the slave device cooperate to implement the device control method as described in any one of claims 8-14.

17. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the device control method as described in any one of claims 1 to 14 is implemented.