A control method, control device, control system, and terminal of an external device

Abstract

This invention provides a method, device, system, and terminal for controlling external devices. The method includes the following steps: in response to establishing a physical connection with any one of a plurality of external devices, determining whether the currently connected external device supports a preset interaction protocol; in response to the currently connected external device supporting the interaction protocol, authenticating the currently connected external device; in response to the currently connected external device passing the authentication, establishing a session with the currently connected external device; based on the session, receiving multiple functional data segments sent by the currently connected external device; and controlling the currently connected external device based on the received multiple functional data segments. The control method provided by this invention can flexibly control any one of a plurality of external devices without requiring separate control schemes for each of the multiple external devices.

Description

Technical Field

[0001] This invention relates to the field of human-computer interaction, and more particularly to control methods, control devices, control systems, terminals, and computer-readable storage media for external devices. Background Technology

[0002] With economic development, especially the automotive industry, the number of cars in society is increasing. As people's living standards improve, using cars as a means of transportation has become very common. Consumers are also demanding higher levels of vehicle features when purchasing cars. Although existing vehicles are equipped with mature in-vehicle systems, such as in-vehicle infotainment (IVI), which effectively enhance the vehicle's electronic, networked, and intelligent capabilities, there is still a desire for vehicles to be even more user-friendly and intelligent with technological advancements.

[0003] In particular, with the increasing prevalence of external devices, the demand for dynamically connecting external devices to in-vehicle systems is growing. However, in current technologies, connecting external devices to in-vehicle systems requires excessive customization of the system, typically with one device corresponding to one application within the system, lacking flexibility and being extremely cumbersome.

[0004] In view of this, it is desirable to provide a method, device, control system, terminal, and computer-readable storage medium for controlling external devices, which can enable external devices to be flexibly and conveniently connected to the vehicle system and realize data interaction and control without requiring excessive customization or development of the vehicle system. Summary of the Invention

[0005] The following provides a brief overview of one or more aspects to offer a basic understanding of them. This overview is not an exhaustive summary of all conceived aspects, nor is it intended to identify key or decisive elements of all aspects, nor to define the scope of any or all aspects. Its sole purpose is to present some concepts of one or more aspects in a simplified form to prepare for the more detailed descriptions that follow.

[0006] One object of the present invention is to provide a control method, control device, control system, terminal and computer-readable storage medium for external devices. Its advantage is that the present invention can flexibly and conveniently interact and control multiple external devices without the need to customize separate control schemes for each external device.

[0007] Another objective of this invention is to provide a method, device, control system, terminal, and computer-readable storage medium for controlling external devices. Its advantage is that this invention can flexibly and dynamically generate corresponding human-computer interaction interfaces based on feedback from external devices.

[0008] Another objective of this invention is to provide a method, device, system, terminal, and computer-readable storage medium for controlling external devices. The advantage of this invention is that it enables users to control external devices based on a dynamically generated human-computer interaction interface, and it can update the status of the external device in response to user control on the human-computer interaction interface.

[0009] The advantages and features of the present invention will be fully apparent from the following detailed description and can be realized through the illustrative embodiments appended.

[0010] One aspect of the present invention provides a control method for an external device, the control method comprising the following steps:

[0011] In response to establishing a physical connection with any one of multiple external devices, determine whether the current external device with which the physical connection is established supports a preset interaction protocol;

[0012] In response to the fact that the current external device supports the interaction protocol, the current external device is authenticated.

[0013] In response to the current external device passing the authentication, a session is established with the current external device;

[0014] Based on the session, receive multiple functional data segments sent by the current external device;

[0015] Control the current external device based on the received multiple functional data segments.

[0016] Another aspect of the present invention provides a control device that establishes a physical connection with at least one external device; wherein

[0017] In response to the establishment of a physical connection with the at least one external device, the control device determines whether the currently established external device supports a preset interaction protocol;

[0018] In response to the fact that the current external device supports the interaction protocol, the control device authenticates the current external device;

[0019] In response to the current external device successfully authenticating, the control device establishes a session with the current external device;

[0020] Based on the session, the control device receives multiple functional data segments sent by the current external device;

[0021] The control device controls the current external device based on the received multiple functional data segments.

[0022] Another aspect of the present invention provides a control system, the control system comprising a control device and at least one external device, wherein the control device and the at least one external device are physically connected; wherein

[0023] In response to the establishment of a physical connection with the at least one external device, the control device determines whether the currently established external device supports a preset interaction protocol;

[0024] In response to the fact that the current external device supports the interaction protocol, the control device authenticates the current external device;

[0025] In response to the current external device successfully authenticating, the control device establishes a session with the current external device;

[0026] Based on the session, the control device receives multiple functional data segments sent by the current external device;

[0027] The control device controls the current external device based on the received multiple functional data segments.

[0028] Another aspect of the present invention provides a terminal, the terminal including a communication module, a memory, and a processor, the terminal establishing a physical connection with at least one external device through the communication module, and the processor performing the following steps when executing a computer program stored in the memory:

[0029] In response to the establishment of a physical connection with the at least one external device, it is determined whether the currently established external device supports a preset interaction protocol;

[0030] In response to the fact that the current external device supports the interaction protocol, the current external device is authenticated.

[0031] In response to the current external device passing the authentication, a session is established with the current external device;

[0032] Based on the session, receive multiple functional data segments sent by the current external device;

[0033] Control the current external device based on the received multiple functional data segments.

[0034] Another aspect of the present invention provides a terminal including a memory and a processor, wherein the processor implements the control method described above when executing a computer program stored in the memory.

[0035] Another aspect of the present invention provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the control method described above. Attached Figure Description

[0036] The above-described features and advantages of the present invention will be better understood after reading the following detailed description of embodiments of the present disclosure in conjunction with the accompanying drawings. In the drawings, components are not necessarily drawn to scale, and components having similar related properties or features may have the same or similar reference numerals.

[0037] Figure 1 A flowchart of a method for controlling an external device provided by one aspect of the present invention is shown.

[0038] Figure 2 A flowchart illustrating a specific embodiment of a method for controlling an external device provided by one aspect of the present invention is shown.

[0039] Figure 3 This illustrates the interaction between the execution terminal and the external device in the process of implementing the external device control method provided in one aspect of the present invention.

[0040] Figure 4 A schematic diagram of the structure of a control device for an external device provided in another aspect of the present invention is shown.

[0041] Figure 5 A schematic diagram of the structure of the control system for an external device provided in another aspect of the present invention is shown.

[0042] Figure 6 A schematic diagram of the structure of a terminal provided by another aspect of the present invention is shown.

[0043] Figure Labels

[0044] 400 Control device;

[0045] 401 Memory;

[0046] 402 Processor;

[0047] 403 bus;

[0048] 404 Random Access Memory;

[0049] 405 Cache Memory;

[0050] 406 Storage System;

[0051] 407 Program Module;

[0052] 408 External devices;

[0053] 409 Monitor;

[0054] 410 Input / Output (I / O) Interface;

[0055] 411 Network adapter;

[0056] 500 external devices;

[0057] 600 terminal

[0058] 610 processor;

[0059] 620 memory;

[0060] 630 Communication Module. Detailed Implementation

[0061] The present invention will now be described in detail with reference to the accompanying drawings and specific embodiments. It should be noted that the aspects described below with reference to the accompanying drawings and specific embodiments are merely exemplary and should not be construed as limiting the scope of protection of the present invention in any way.

[0062] The following description is provided to enable those skilled in the art to implement and use the invention and adapt it to specific application contexts. Various modifications and uses in different applications will be readily apparent to those skilled in the art, and the general principles defined herein are applicable to a wide range of embodiments. Therefore, the invention is not limited to the embodiments given herein, but should be granted the broadest scope consistent with the principles and novel features disclosed herein.

[0063] In the following detailed description, numerous specific details are set forth to provide a more thorough understanding of the invention. However, it will be apparent to those skilled in the art that practice of the invention is not necessarily limited to these specific details. In other words, well-known structures and devices are shown in block diagram form without being depicted in detail to avoid obscuring the invention.

[0064] Readers should note all documents and references submitted concurrently with this specification and open to public inspection, the contents of which are incorporated herein by reference. Unless otherwise expressly stated, all features disclosed in this specification (including any appended claims, abstracts, and drawings) may be replaced by alternative features for the same, equivalent, or similar purposes. Therefore, unless explicitly stated otherwise, each disclosed feature is merely one example of a set of equivalent or similar features.

[0065] Note that, where used, the markings left, right, front, back, top, bottom, front, back, clockwise, and counterclockwise are merely for convenience and do not imply any specific fixed direction. In fact, they are used to reflect the relative position and / or orientation between different parts of an object. Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance.

[0066] Note that, in practice, "further," "preferably," "even further," and "more preferably" are simply starting points for describing another embodiment based on the foregoing embodiments. The combination of the content following "further," "preferably," "even further," or "more preferably" with the foregoing embodiments constitutes the complete configuration of another embodiment. Any combination of several "further," "preferably," "even further," or "more preferably" settings following the same embodiment can form yet another embodiment.

[0067] The present invention will now be described in detail with reference to the accompanying drawings and specific embodiments. It should be noted that the aspects described below with reference to the accompanying drawings and specific embodiments are merely exemplary and should not be construed as limiting the scope of protection of the present invention in any way.

[0068] As described above, in order to solve the problem that the in-vehicle system needs to be customized in many aspects when multiple external devices are connected to the in-vehicle system, which is quite cumbersome, the present invention provides a control method, control device, control system, terminal and computer-readable storage medium for external devices, which can flexibly and conveniently interact and control multiple external devices without the need to customize separate control schemes for each external device.

[0069] First, those skilled in the art should understand that the in-vehicle system described in this invention refers to an operating system that, through early embedded installation or later addition to a vehicle, can achieve one or more of the following functions: vehicle control, vehicle status data feedback, navigation, entertainment and audio-visual functions, and existing or future functions that may be implemented in a vehicle, thereby effectively improving the vehicle's level of electrification, networking, and intelligence. For example, existing in-vehicle infotainment systems (IVI) are examples. It is understood that the above examples of in-vehicle systems are merely illustrative and should not unduly limit the scope of protection of this invention.

[0070] Please refer to Figure 1 To understand the interaction method of the external device provided by this invention. Figure 1 As shown, the method for controlling an external device provided by one aspect of the present invention includes the following steps:

[0071] Step S110: In response to establishing a physical connection with any one of the multiple external devices, determine whether the current external device with which the physical connection is established supports a preset interaction protocol;

[0072] Step S120: In response to the current external device supporting the interaction protocol, authenticate the current external device;

[0073] Step S130: In response to the current external device passing the authentication, establish a session with the current external device;

[0074] Step S140: Based on the session, receive multiple functional data segments sent by the current external device; and

[0075] Step S150: Control the current external device based on the received multiple functional data segments.

[0076] In step S110 above, establishing a physical connection refers to establishing a communication connection between the external device and the subject performing the above interaction method. The communication connection can be established through existing or future wired or wireless communication such as USB, WiFi, and Bluetooth.

[0077] In the interaction method provided by the present invention, as long as any external device is connected to the subject executing the above interaction method, that is, a communication connection is established, the current external device that has established the physical connection will be determined in step S110 to see if it supports the preset interaction protocol.

[0078] The aforementioned preset interaction protocol refers to a preset set of access standards or access protocols. The interaction protocol includes the part applied to various external devices, as well as the part applied to the execution body of the aforementioned interaction method.

[0079] The entire interaction protocol includes application layer protocols, presentation layer protocols, session layer protocols, transport layer protocols, and physical layer protocols, the relevant definitions of which are as follows:

[0080] Application layer protocol: For the entity executing the interaction method, it provides interfaces related to device interaction; for external devices, it performs various interactive controls on the device according to the requests of the entity executing the interaction method.

[0081] Presentation layer protocol: The execution entity of the interaction method and the external device are at this layer, and the main tasks are as follows: negotiating the operation of the external device (functional message or functional data segment), encoding / decoding operations, so that the operation on the device is expressed in a specified format, etc.

[0082] Session layer protocol: responsible for verifying and validating device identity, negotiating transmission encryption standards, managing the establishment of device connections and ports, and providing management of business sessions, etc.

[0083] Transport layer protocols provide transport services to the upper layers, including: selecting the interaction format based on the physical layer of the actual link, providing various link controls, and business processing feedback, etc.

[0084] Physical layer protocol: responsible for identifying devices and transmitting actual physical data.

[0085] Step S110 primarily involves physical layer protocols and transport layer protocols. Steps S120 and S130 primarily involve session layer protocols. Step S140 primarily involves presentation layer protocols. Step S150 primarily involves application layer protocols.

[0086] In step S140, the received multiple functional data segments are various functional messages or functional data segments defined by the presentation layer protocol. The functional data segments include display data segments, status data segments, capability data segments, and control data segments. Specifically, the display data segments are associated with the human-machine interface, the status data segments are associated with the status data of peripheral devices, the capability data segments are associated with the capabilities of the external devices (i.e., what the external devices can do), and the control data segments are associated with the control of the external devices.

[0087] Specifically, the capability data segment includes a device description, a capability description linked list, and an initial state linked list. The device description contains information such as device type, device name, and manufacturer. The capability description includes: capability name and ID, capability type (in / out), the corresponding control interface in the external device, and the control interface parameter format. In the initial stage of interaction with the execution subject (i.e., in step S140), a capability linked list is sent to the execution subject of the interaction method so that the execution subject can register all the capabilities possessed by the external device. The initial state linked list is a key-value pair that represents the state of the external device and the execution subject of the interaction method when the connection is first established.

[0088] For the status data segment, its content mainly includes a status description and a key-value array. The status description includes: the status direction, such as from an external device to the execution entity, and the status name.

[0089] For the control data segment, its content mainly includes an operation description and operation parameters. The operation description contains the capability name of the corresponding external device.

[0090] The display data segment is primarily used to organize the display of the human-computer interaction interface (HCI) and defines all possible interfaces and their hierarchical relationships. An initial display interface, called the "root layout," is pre-set within the display data segment; this is the most basic HCI interface displayed when controlling external devices from the execution entity. The smallest component of each HCI interface is an "ability view."

[0091] Furthermore, the content of the data display segment mainly includes an organizational section and a detailed section. The organizational section is a linked list of various human-computer interaction interfaces, mainly used to define the hierarchical relationship between all possible human-computer interaction interfaces. The detailed section mainly provides a detailed description of each human-computer interaction interface, primarily containing the ability view collection for each interface.

[0092] The detailed descriptions of each human-computer interaction interface mainly include: the name and ID of the interface, the parent interface (NULL if none), whether it is a "root layout", the next level interface list (interface ID list), and the conditions for the interface to exit automatically. The conditions for entering a sub-interface are described in the corresponding ability view.

[0093] The capability view, which details how the various capabilities of the external device are displayed in the interface, mainly includes: defining the icon size, display position, name, corresponding capability ID, the icon used for display ("imagethumbnail"), (the size can be limited, such as a small icon in a specific format, like a 10x10 PNG image), whether it triggers entry into the next level interface, and the conditions for entering the next level interface.

[0094] Please combine Figure 2 and Figure 3 To further understand a specific embodiment of the external device control method provided by one aspect of the present invention, a flowchart is provided, as well as the interaction between the execution terminal and the external device in the process of implementing the external device control method provided by one aspect of the present invention.

[0095] Figure 2 The control method provided by one aspect of the present invention is illustrated in a more intuitive way. It can be seen that the identification and legality verification steps correspond to steps S110 and S120. The session establishment step corresponds to step S130, while the interactive function data segment and the creation of the business session correspond to step S140, and the final interaction with the external device corresponds to step S150.

[0096] and Figure 3This demonstrates the interaction between the execution terminal and external devices in the process of implementing the control method provided by this invention.

[0097] in, Figure 3 Steps 1 and 2 in the above text correspond to step S110 described earlier. Figure 3 Steps 3 and 4 correspond to step S120 described above. Figure 3 Steps 5 and 6 correspond to step S130 described above. Figure 3 Steps 7 and 8 correspond to step S140 described above. Figure 3 Steps 8 and 9 correspond to step S150 described above, especially the preparation step of step S150, which means that the preparation for controlling the external device based on the received multiple functional data segments has been completed.

[0098] In step S150, according to an embodiment of the present invention, controlling the current external device based on the received plurality of functional data segments further includes the following steps:

[0099] A human-computer interaction interface is generated based at least on the displayed data segment, and the human-computer interaction interface is used to control the current external device.

[0100] In the above embodiments, it is understood that a "root layout" can be generated at least based on the display data segment, and corresponding sub-interfaces can be generated in subsequent human-computer interaction by combining various operations.

[0101] In another embodiment, step S150, controlling the current external device based on the received plurality of functional data segments, further includes the following step: obtaining device status data of the current external device according to the status data segments. Therefore, the step of generating the human-computer interaction interface further includes: generating the human-computer interaction interface according to the device status data and the display data segments.

[0102] In another embodiment, step S150, which controls the current external device based on the received plurality of functional data segments, further includes the following steps: receiving the user's operation request based on the human-computer interaction interface;

[0103] Control instructions are generated based on the capability data segment, control data segment, and operational requirements. These control instructions are used to control the current external device.

[0104] Output the control command to the current external device.

[0105] Meanwhile, in the above embodiments, generating the human-computer interaction interface further includes: updating the human-computer interaction interface based on the device status data returned by the current external device after responding to the control command and the display data segment.

[0106] This concludes the description of a specific implementation of the external device control method provided by one aspect of the present invention. The external device control method provided by one aspect of the present invention can flexibly control any one of multiple external devices without requiring separate control schemes for each external device.

[0107] Another aspect of the present invention provides a control device and a control system, please refer to... Figure 4 and Figure 5 To understand another aspect of the present invention, the control device and control system provided are described. In this context, Figure 4 A schematic diagram of an embodiment of the control device 400 provided in another aspect of the present invention is shown. Figure 5 This illustrates a control system that includes a control device 400 and at least one external device 500.

[0108] The control device 400 provided by the present invention establishes a physical connection with at least one external device 500. In response to the establishment of a physical connection with the at least one external device 500 (i.e., after establishing a physical connection with any external device 500), the control device 400 determines whether the currently connected external device supports a preset interaction protocol (the currently connected external device refers to any external device 500 that has established a physical connection with the control device 400).

[0109] In response to the fact that the current external device supports the interaction protocol, the control device 400 authenticates the current external device;

[0110] In response to the current external device successfully authenticating, the control device 400 establishes a session with the current external device;

[0111] The control device 400 receives multiple functional data segments sent by the current external device based on the session;

[0112] The control device 400 controls the current external device based on the received multiple functional data segments.

[0113] Any external device 500 included in the control system points to an intelligent functional device that supports a preset interaction protocol. For example, the control device 400 may point to the in-vehicle infotainment system described above, while the external device 500 may point to an intelligent massage device that can be used in a vehicle.

[0114] like Figure 4As shown, in this embodiment, the control device 400 is manifested in the form of a general-purpose computer device, used to implement the control method for the external device described in any of the above embodiments. For details, please refer to the description of the control method for the external device above; it will not be repeated here.

[0115] The components of the control device 400 may include one or more memories 401, one or more processors 402, and a bus 403 connecting different system components (including memories 401 and processors 402).

[0116] Bus 403 includes a data bus, an address bus, and a control bus. The number of bits in the data bus is proportional to the data transfer rate (product of the operating frequency). The number of bits in the address bus determines the maximum addressable memory space. The control bus (read / write) indicates the type of bus cycle and the time when the current input / output operation is completed. Processor 402 is connected to memory 401 via bus 403 and configured to implement the control method for the external device provided in any of the above embodiments.

[0117] Processor 402, as the computational and control core of control device 400, is the final execution unit for information processing and program execution. All software layer operations in the computer system are ultimately mapped to operations of processor 402 through the instruction set. The main functions of processor 402 are processing instructions, executing operations, controlling time, and processing data.

[0118] Memory 401 refers to various storage devices in a computer that store programs and data. Memory 401 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 404 and / or cache memory 405.

[0119] Random Access Memory (RAM) 404 is an internal memory that directly exchanges data with the processor 402. It can be read and written at any time (except during refresh) and is very fast. It is typically used as a temporary data storage medium for the operating system or other running programs. Data stored in it will be lost if power is lost. Cache Memory 405 is a level-one memory located between main memory and the processor 402. It has a smaller capacity but a much higher speed than main memory, approaching the speed of the processor 402.

[0120] It should be noted that when the control device 400 includes multiple memories 401 and multiple processors 402, the multiple memories 401 and the multiple processors 402 can have a distributed structure. For example, it can include memories and processors located on a local end and a background cloud, respectively, with the local end and the background cloud jointly implementing the aforementioned control method for external devices. Furthermore, in embodiments employing a distributed structure, the specific execution terminal for each step can be adjusted according to actual conditions, and the specific implementation scheme of each step on a particular terminal should not unduly limit the scope of protection of this invention.

[0121] The control device 400 may further include other removable / non-removable, volatile / non-volatile computer system storage media. In this embodiment, the storage system 406 can be used to read and write non-removable, non-volatile magnetic media.

[0122] The memory 401 may also include at least one set of program modules 407. Program modules 407 may be stored in the memory 401. Program modules 407 include, but are not limited to, an operating system, one or more application programs, other program modules, and program data; each or some combination of these examples may include an implementation of a network environment. Program modules 407 typically perform the functions and / or methods described in the embodiments of the present invention.

[0123] The control device 400 can also communicate with one or more external devices 408. In this embodiment, the external device 408 can refer to any external device 500 included in the control system, that is, an intelligent functional device that supports a preset interaction protocol. For example, the control device 400 can refer to the in-vehicle infotainment system described above, while the external devices 408 and 500 can refer to intelligent massage devices, etc., that can be used in a vehicle.

[0124] The external device 408 also includes a display 409. When implementing the control method of the external device, the control device 400 can display the generated human-computer interaction interface through the display 409, thereby realizing interaction with the user.

[0125] The control device 400 may also communicate with one or more devices that enable a user to interact with the control device 400, and / or with any device (e.g., a network card, modem, etc.) that enables the control device 400 to communicate with one or more other computing devices. Such communication may be performed through the input / output (I / O) interface 410.

[0126] The control device 400 can also communicate with one or more networks (e.g., local area networks (LANs), wide area networks (WANs), and / or public networks, such as the Internet) via network adapter 411. Figure 4 As shown, network adapter 411 communicates with other modules of control device 400 via bus 403. It should be understood that, although not shown in the figure, other hardware and / or software modules can be used in conjunction with control device 400, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0127] Another aspect of the present invention provides a terminal, please refer to Figure 6 ,like Figure 6 As shown, the terminal 600 includes a communication module 630, a memory 620, and a processor 610. The terminal 600 establishes a physical connection with at least one external device through the communication module 630. When the processor 610 executes a computer program stored in the memory 620, it performs the following steps:

[0128] In response to the establishment of a physical connection with the at least one external device, it is determined whether the currently established external device supports a preset interaction protocol;

[0129] In response to the fact that the current external device supports the interaction protocol, the current external device is authenticated.

[0130] In response to the current external device passing the authentication, a session is established with the current external device;

[0131] Based on the session, receive multiple functional data segments sent by the current external device;

[0132] Control the current external device based on the received multiple functional data segments.

[0133] Another aspect of the present invention provides a terminal including a memory and a processor connected to the memory. When the processor of the terminal executes computer-readable instructions stored in the memory, it correspondingly implements the external device control method described above. For details, please refer to the description of the external device control method above; it will not be repeated here.

[0134] Another aspect of the present invention provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the control method for an external device as described above.

[0135] This concludes the description of the control method, control device, control system, terminal, and computer-readable storage medium for external devices provided by the present invention. The control method, control device, control system, terminal, and computer-readable storage medium for external devices provided by the present invention can flexibly control any one of multiple external devices without requiring separate control schemes for each external device.

[0136] The various illustrative logic modules and circuits described in conjunction with the embodiments disclosed herein may be implemented or performed using a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof designed to perform the functions described herein. The general-purpose processor may be a microprocessor, but in alternatives, it may be any conventional processor, controller, microcontroller, or state machine. The processor may also be implemented as a combination of computing devices, such as a combination of a DSP and a microprocessor, multiple microprocessors, one or more microprocessors cooperating with a DSP core, or any other such configuration.

[0137] The steps of the methods or algorithms described in conjunction with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of both. The software module may reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, removable disk, CD-ROM, or any other form of storage medium known in the art. An exemplary storage medium is coupled to a processor such that the processor can read and write information to / from the storage medium. In an alternative, the storage medium may be integrated into the processor. The processor and storage medium may reside in an ASIC. The ASIC may reside in a user terminal. In an alternative, the processor and storage medium may reside as discrete components in the user terminal.

[0138] In one or more exemplary embodiments, the described functionality may be implemented in hardware, software, firmware, or any combination thereof. If implemented in software as a computer program product, the functionality may be stored or transmitted as one or more instructions or code on or through a computer-readable medium. A computer-readable medium includes both computer storage media and communication media, encompassing any medium that facilitates the transfer of a computer program from one location to another. A storage medium may be any available medium accessible to a computer. By way of example and not limitation, such a computer-readable medium may include RAM, ROM, EEPROM, CD-ROM or other optical disc storage, disk storage or other magnetic storage devices, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and is accessible to a computer. Any connection is also legitimately referred to as a computer-readable medium. For example, if the software is transmitted from a website, server, or other remote source using coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL), or wireless technologies such as infrared, radio, and microwave, then the coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave are included in the definition of a medium. As used in this article, disk and disc include compact discs (CDs), laser discs, optical discs, digital multi-purpose discs (DVDs), floppy disks, and Blu-ray discs. Disks typically reproduce data magnetically, while discs reproduce data optically using lasers. Combinations of these should also be included within the scope of computer-readable media.

[0139] The preceding description is provided to enable any person skilled in the art to practice the various aspects described herein. However, it should be understood that the scope of protection of this invention should be determined by the appended claims and should not be limited to the specific structures and components of the embodiments described above. Various changes and modifications can be made to the embodiments by those skilled in the art within the spirit and scope of this invention, and these changes and modifications also fall within the scope of protection of this invention.

Claims

1. A method for controlling an external device, characterized in that, The control method is applied to a terminal, and the control method includes the following steps: In response to establishing a physical connection with any one of multiple external devices, determine whether the current external device with which the physical connection is established supports a preset interaction protocol; In response to the fact that the current external device supports the interaction protocol, the current external device is authenticated. In response to the current external device passing the authentication, a session is established with the current external device; Based on the session, multiple functional data segments sent by the current external device are received. Each functional data segment includes at least a display data segment and a capability data segment. The capability data segment is associated with the capabilities possessed by the current external device and includes a capability description list for registering the capabilities of the current external device at the terminal. The display data segment includes an organizational portion and a detailed portion. The organizational portion defines the hierarchical relationship of the possible human-computer interaction interface, and the detailed portion describes how the various capabilities of the current external device are displayed in the human-computer interaction interface. At least based on the displayed data segment, a human-computer interaction interface is generated and displayed at the terminal, the human-computer interaction interface being used to control the current external device.

2. The control method as described in claim 1, wherein the functional data segment further includes a status data segment; Controlling the current external device based on the received plurality of functional data segments further includes the following steps: Obtain the current device status data of the external device based on the status data segment; The process of generating the human-computer interaction interface further includes the following steps: A human-computer interaction interface is generated based on the device status data and the display data segment.

3. The control method as described in claim 1, wherein the functional data segment further includes a control data segment; Controlling the current external device based on the received plurality of functional data segments further includes the following steps: The user's operation requirements are received based on the human-computer interaction interface; Control instructions are generated based on the capability data segment, control data segment, and operational requirements. These control instructions are used to control the current external device. Output the control command to the current external device.

4. The control method as described in claim 3, wherein generating the human-computer interaction interface further includes the following steps: The human-machine interface is updated based on the device status data returned by the external device after responding to the control command and the display data segment.

5. A control device, characterized in that, The control device includes a memory, a processor, and an I / O interface. The control device establishes a physical connection with at least one external device through the I / O interface. The memory includes a program module. When the processor executes the program in the program module, it includes the following steps: In response to the establishment of a physical connection with the at least one external device, it is determined whether the currently established external device supports a preset interaction protocol; In response to the fact that the current external device supports the interaction protocol, the current external device is authenticated. In response to the current external device passing the authentication, a session is established with the current external device; Based on the session, multiple functional data segments sent by the current external device are received. Each functional data segment includes at least a display data segment and a capability data segment. The capability data segment is associated with the capabilities possessed by the current external device and includes a capability description list for registering the capabilities of the current external device at the terminal. The display data segment includes an organizational portion and a detailed portion. The organizational portion defines the hierarchical relationship of the possible human-computer interaction interface, and the detailed portion describes how the various capabilities of the current external device are displayed in the human-computer interaction interface. At least based on the displayed data segment, a human-computer interaction interface is generated and displayed at the terminal, the human-computer interaction interface being used to control the current external device.

6. A control system, characterized in that, The control system includes a control device and at least one external device, wherein the control device and the at least one external device are physically connected; wherein In response to the establishment of a physical connection with the at least one external device, the control device determines whether the currently established external device supports a preset interaction protocol; In response to the fact that the current external device supports the interaction protocol, the control device authenticates the current external device; In response to the current external device successfully authenticating, the control device establishes a session with the current external device; Based on the session, the control device receives multiple functional data segments sent by the current external device. Each functional data segment includes at least a display data segment and a capability data segment. The capability data segment is associated with the capabilities of the current external device and includes a capability description list for registering the capabilities of the current external device at the terminal. The display data segment includes an organization part and a detail part. The organization part is used to define the hierarchical relationship of the human-computer interaction interface that may be displayed. The detail part is used to describe how the various capabilities of the current external device are displayed in the human-computer interaction interface. as well as The control device generates and displays a human-machine interface at the terminal based on at least the display data segment, and the human-machine interface is used to control the current external device.

7. A terminal, characterized in that, The terminal includes a communication module, a memory, and a processor. The terminal establishes a physical connection with at least one external device through the communication module. When the processor executes a computer program stored in the memory, it performs the following steps: In response to the establishment of a physical connection with the at least one external device, it is determined whether the currently established external device supports a preset interaction protocol; In response to the fact that the current external device supports the interaction protocol, the current external device is authenticated. In response to the current external device passing the authentication, a session is established with the current external device; Based on the session, multiple functional data segments sent by the current external device are received. Each functional data segment includes at least a display data segment and a capability data segment. The capability data segment is associated with the capabilities of the current external device and includes a capability description list for registering the capabilities of the current external device at the terminal. The display data segment includes an organization part and a detail part. The organization part is used to define the hierarchical relationship of the human-computer interaction interface that may be displayed, and the detail part is used to describe how the various capabilities of the external device are displayed in the human-computer interaction interface. as well as At least based on the displayed data segment, a human-computer interaction interface is generated and displayed at the terminal, the human-computer interaction interface being used to control the current external device.

8. A terminal, characterized in that, The terminal includes a memory and a processor, which implements the control method as described in any one of claims 1-4 when executing a computer program stored in the memory.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the control method as described in any one of claims 1-4.

Images