Terminal, earphone-based external terminal control method and storage medium

Abstract

The present invention provides a terminal and an external terminal control method based on earphones, the external terminal control method comprising the following steps: in response to a first terminal establishing a communication connection with a vehicle-mounted terminal, and the first terminal being in an interactive state of interacting with the vehicle-mounted terminal, monitoring the key value of a key of an earphone that has established a communication connection with the first terminal; in response to monitoring the key value of the earphone, based on a preset key value mapping relationship, converting the key value into a key event of a display interface of a vehicle-mounted display device; and outputting the key event to the vehicle-mounted terminal so that the vehicle-mounted terminal responds to the key event. According to the present invention, the control of an external terminal can be realized based on earphones, thereby expanding the application of the earphone device and facilitating the control of an external terminal, especially in a vehicle-mounted environment.

Description

Technical Field

[0001] The present invention relates to the field of intelligent terminals, and in particular to the control of intelligent terminals and the application of earphones in intelligent terminals in the vehicle-mounted field. Background Art

[0002] With the development of science and technology, intelligent appliances have become very popular. Intelligent appliances or intelligent terminals contain embedded computer system equipment, and the application scenarios are relatively clear. As intelligent terminals become more and more popular, they are also interconnected.

[0003] Since different smart terminals have different control methods and interaction methods, if users can only independently control the smart terminals in a targeted manner, it is inconvenient for users to operate as smart terminals become more and more popular.

[0004] Headphones are a common output component of smart terminals. Although they are output components, they can also integrate a number of control keys as input components to achieve control related to the audio played by the headphones. Due to the portability of headphones, if the control keys of headphones can be used to control other smart terminals, it will be convenient for users to control other smart terminals, and it can also broaden the application scenarios of headphones and improve the utilization rate of headphones.

[0005] For example, in a car environment, passengers sitting in the back row are usually unable to control the in-vehicle terminal in the front row due to distance, which is not conducive to the riding experience of the passengers in the back row. If the in-vehicle terminal can be controlled through the headphones carried by the passengers in the back row, the riding experience of the passengers in the back row can be effectively improved.

[0006] Therefore, it is hoped that a headset-based external terminal control method can be provided, which can facilitate users to control the smart terminal in a vehicle environment. Summary of the invention

[0007] A brief summary of one or more aspects is given below to provide a basic understanding of these aspects. This summary is not an exhaustive overview of all conceived aspects, and is neither intended to identify the key or critical elements of all aspects nor to define the scope of any or all aspects. Its only purpose is to give some concepts of one or more aspects in a simplified form as a prelude to a more detailed description that will be given later.

[0008] One object of the present invention is to provide a terminal and an external terminal control method based on headphones, which has the advantage that the key events of the headphones can be converted into key events of the display interface of the vehicle-mounted display device, thereby realizing the function of controlling the external terminal using the headphones, and especially enabling passengers to conveniently control the out-of-reach vehicle-mounted terminals, thereby broadening the application scenarios of the headphones and improving the utilization rate of the headphones.

[0009] Another object of the present invention is to provide a terminal and an external terminal control method based on headphones, the advantage of which is that the present invention determines whether the terminal is in an interactive state to clarify the control of the external terminal represented by the key events of the headphones, thereby being able to correctly respond to the user's operations.

[0010] Another object of the present invention is to provide a terminal and an external terminal control method based on headphones, the advantage of which is that the present invention can actively put the headphones and the terminal in a state where they can respond to user operations to control the external terminal, thereby realizing the function of controlling the external terminal using headphones.

[0011] Another object of the present invention is to provide a terminal and an external terminal control method based on headphones. The advantage of the present invention is that the external terminal controlled by the headphones corresponds to the external terminal that generates the display interface, and can therefore be applied to various screen projection scenarios, thereby further expanding the application scenarios.

[0012] The advantages and features of the present invention can be fully reflected by the following detailed description and can be realized by the accompanying illustrative embodiments.

[0013] One aspect of the present invention provides an external terminal control method based on headphones, which includes the following steps: in response to a first terminal establishing a communication connection with a vehicle-mounted terminal, and the first terminal is in an interactive state of interacting with the vehicle-mounted terminal, monitoring a button key value of the headphones that have established a communication connection with the first terminal; in response to monitoring the button key value of the headphones, based on a preset key value mapping relationship, converting the button key value into a button event of a display interface of a vehicle-mounted display device; and outputting the button event to the vehicle-mounted terminal so that the vehicle-mounted terminal responds to the button event.

[0014] According to an embodiment of the present invention, the external terminal control method further comprises the step of: judging whether the first terminal is in the interactive state at least according to the authorization information of the vehicle-mounted terminal and the occupancy information of the headset.

[0015] According to an embodiment of the present invention, the external terminal control method further comprises the step of: in response to the interactive program being in operation and the earphone not being occupied by any application other than the interactive program running on the first terminal, the interactive program occupies the earphone to play silent audio.

[0016] According to one embodiment of the present invention, in response to the display interface being projected to the vehicle-mounted terminal by a second terminal that has established a communication connection with the vehicle-mounted terminal, it is also determined whether the first terminal is in the interactive state based on the authorization information of the second terminal.

[0017] Another aspect of the present invention also provides a terminal for realizing external terminal control based on headphones, the terminal comprising a communication module, at least one processor and a memory coupled to the at least one processor; the communication module is used to realize communication connection with the headphones and the external terminal; the memory contains instructions stored therein, and when the instructions are executed by the at least one processor, the terminal executes the external terminal control method described in any embodiment of the present invention.

[0018] Another aspect of the present invention further provides a computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, the external terminal control method as described in any one of the embodiments of the present invention is implemented. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] The above features and advantages of the present invention can be better understood after reading the detailed description of the embodiments of the present disclosure in conjunction with the following drawings. In the drawings, the components are not necessarily drawn to scale, and components with similar related properties or features may have the same or similar reference numerals.

[0020] Figure 1 A schematic diagram of an application scenario of an external terminal control method provided in one aspect of the present invention is shown.

[0021] Figure 2 A schematic flow chart of an external terminal control method provided in one aspect of the present invention is shown.

[0022] Figure 3 A schematic flow chart of the step of determining whether a first terminal is in an interactive state in an external terminal control method provided in one aspect of the present invention is shown.

[0023] Figure 4 A schematic flow chart of a step in which an interactive program occupies headphones to play silent audio in an external terminal control method provided by one aspect of the present invention is shown.

[0024] Figure 5 A schematic structural diagram of a terminal provided by another aspect of the present invention is shown.

[0025] Reference numerals

[0026] 100 users;

[0027] 200 Headphones;

[0028] 310 first terminal;

[0029] 320 vehicle terminal;

[0030] 321 Vehicle display device;

[0031] 330 second terminal;

[0032] 500 Terminal;

[0033] 501 memory;

[0034] 502 processor;

[0035] 503 bus;

[0036] 504 Random Access Memory;

[0037] 505 cache memory;

[0038] 506 storage system;

[0039] 507 program module;

[0040] 508 external devices;

[0041] 509 display;

[0042] 510 Input / output (I / O) interface;

[0043] 511 network adapter. DETAILED DESCRIPTION

[0044] The present invention is described in detail below in conjunction with the accompanying drawings and specific embodiments. Note that the aspects described below in conjunction with the accompanying drawings and specific embodiments are only exemplary and should not be construed as limiting the scope of protection of the present invention in any way.

[0045] The following description is given to enable those skilled in the art to implement and use the invention and incorporate it into a specific application context. Various modifications, as well as various uses in different applications will be readily apparent to those skilled in the art, and the general principles defined herein are applicable to a wide range of embodiments. Thus, the present invention is not limited to the embodiments given herein, but should be granted the broadest scope consistent with the principles and novel features disclosed herein.

[0046] In the following detailed description, many specific details are set forth to provide a more thorough understanding of the present invention. However, it will be apparent to those skilled in the art that the practice of the present invention need not be limited to these specific details. In other words, known structures and devices are shown in block diagram form without detailed display to avoid obscuring the present invention.

[0047] The reader is reminded of all documents and literature filed simultaneously with this specification and open to public inspection, and the contents of all such documents and literature are incorporated herein by reference. Unless otherwise directly stated, all features disclosed in this specification (including any attached claims, abstracts and drawings) can be replaced by alternative features for achieving the same, equivalent or similar purposes. Therefore, unless otherwise explicitly stated, each feature disclosed is only an example of a group of equivalent or similar features.

[0048] Note that, where used, the symbols left, right, front, back, top, bottom, forward, reverse, clockwise and counterclockwise are used only for convenience and do not imply any specific fixed direction. In fact, they are used to reflect the relative position and / or direction between the various parts of the object. In addition, the terms "first" and "second" are used only for descriptive purposes and should not be understood as indicating or implying relative importance.

[0049] Note that, in the case of use, further, preferably, further and more preferably are simple beginnings for explaining another embodiment based on the previous embodiment, and the content of further, preferably, further or more preferably followed by the above embodiment is combined with the previous embodiment as a complete composition of another embodiment. Several further, preferably, further or more preferably settings followed by the same embodiment can be arbitrarily combined to form another embodiment.

[0050] As described above, the present invention provides a method for controlling an external terminal based on a headset, thereby facilitating the user to control the external terminal, expanding the application scenarios of the headset, and facilitating the user to use the headset. Figure 1-Figure 5 The specific implementation method of the terminal and the earphone-based external terminal control method provided by the present invention will be described in detail.

[0051] First, please refer to Figure 1 To understand the application scenario of the present invention. Figure 1 As shown, the present invention is applied between multiple terminals, and in particular, it involves the interaction between the headset 200, the first terminal 310 (having a communication connection with the headset 200), and the vehicle terminal 320 (the terminal where the vehicle display device 321 is located). In some embodiments applied to screen projection, it also involves the interaction between the headset 200, the first terminal 310, the vehicle terminal 320, and the second terminal 330 (the terminal of the vehicle display device 321 projected to the vehicle terminal 320). According to the present invention, the user 100 can control the vehicle terminal 320 and / or the second terminal 330 based on the display interface on the vehicle display device 321 through the headset 200 using the first terminal 310 to achieve human-computer interaction.

[0052] Please refer to further Figure 2 To understand the external terminal control method based on earphone provided in one aspect of the present invention. The main steps in the external terminal control method provided in one aspect of the present invention are performed by the first terminal 310 that has established a communication connection with the earphone 200. Figure 2 As shown, the external terminal control method provided by the present invention comprises the following steps:

[0053] In response to the first terminal 310 establishing a communication connection with the vehicle terminal 320, and the first terminal 310 being in an interactive state with the vehicle terminal 320, monitoring a key value of a key of the headset 200 that has established a communication connection with the first terminal 310;

[0054] In response to monitoring the key value of the key of the headset 200, based on a preset key value mapping relationship, convert the key value of the key into a key event of the display interface of the vehicle-mounted display device 321; and

[0055] The key event is output to the vehicle terminal 320 so that the vehicle terminal 320 responds to the key event.

[0056] Further, in response to the first terminal 310 establishing a communication connection with the vehicle terminal 320, it is necessary to determine whether the first terminal 310 is in an interactive state with the vehicle terminal 320. The communication connection between the first terminal 310 and the vehicle terminal 320 may include a wired connection or a wireless connection, and the above communication connection may be based on various existing or future communication protocols, which are not limited here. It is understandable that after the communication connection is established, the first terminal 310 and the vehicle terminal 320 can know their own communication connection status.

[0057] The key values ​​of the buttons of the headset 200 monitored by the first terminal 310 can represent some conventional audio operations, such as play / pause audio, increase / decrease volume, previous / next song, etc. In the present invention, it can also represent the operation of the external terminal. Therefore, it is necessary to confirm the operation intention of the user 100 represented by the key values ​​of the buttons of the headset 200 monitored.

[0058] In the present invention, the operation intention of the user 100 is determined by the state of the first terminal 310. That is, when the first terminal 310 is in an interactive state and a key value is monitored in the interactive state, it is considered that the key value monitored in the interactive state represents the control of the external terminal. Therefore, it is necessary to perform a step of converting the key value monitored in the interactive state based on a preset key value mapping relationship.

[0059] Furthermore, in the present invention, whether the first terminal 310 is in an interactive state is determined at least based on the authorization information of the vehicle-mounted terminal 320 and the occupancy information of the headset 100 .

[0060] Please combine Figure 3 To understand the step of determining whether the first terminal 310 is in an interactive state. First, it can be understood that if the vehicle-mounted terminal 320 needs to be controlled, the authorization of the vehicle-mounted terminal 320 needs to be obtained. The above authorization information can be obtained when the first terminal 310 establishes a communication connection with the vehicle-mounted terminal 320. When the vehicle-mounted terminal 320 agrees to the authorization, it is considered that the first terminal 310 can interact with the vehicle-mounted terminal 320.

[0061] Furthermore, the key values ​​of the buttons of the headset 200 need to be performed when the headset 200 is occupied. However, if the headset 200 is occupied by other applications running on the first terminal 310, it is assumed that the key values ​​of the buttons of the headset 200 correspond to the related operations defined by the other applications. Therefore, it is necessary to determine the interaction state of the first terminal 310 based on the occupation information of the headset 200.

[0062] In one embodiment, if the first terminal 310 is in an interactive state, the occupancy information of the headset 200 should be: occupied by the interactive program running on the first terminal 310 to play silent audio.

[0063] That is, when the vehicle terminal 320 agrees to the authorization and the headset 200 is occupied by the interactive program to play silent audio, the first terminal 310 is in an interactive state, in which the button values ​​of the headset 200 monitored represent the user's control over the external terminal.

[0064] The above-mentioned interactive program refers to an application program installed on the first terminal 310 for implementing the headset-based external terminal control method. Since the control of the external terminal is based on the manipulation of the user 100, if the user 100 wants to control the external terminal based on the headset 200 and the first terminal 310, it is necessary to make the first terminal 310 "aware" of the user's intention, and the user's choice to run the interactive program for interaction can be considered as a way to make the first terminal 310 "aware" of the user's intention.

[0065] Therefore, in another aspect of the external terminal control method provided by the present invention, Figure 4 As shown, in response to the interactive program being in operation and the earphone 200 not being occupied by any application program other than the interactive program running on the first terminal 310, the interactive program occupies the earphone 200 to play silent audio.

[0066] The interactive program being in the running state includes the interactive application program being kept running in the foreground, or the interactive program being switched to the background and kept running. When the user 100 keeps the interactive program in the running state, it means that the user needs to control the external terminal based on the interactive program.

[0067] If the earphone 200 is occupied by other applications on the first terminal 310, it is assumed that the user 100 is using the earphone 200 to listen to audio played by other applications. Therefore, the button values ​​monitored at this time should correspond to the relevant operations defined by other applications, rather than representing the user 100's intention to control the external terminal.

[0068] In another preferred embodiment, in order to satisfy the user's need to control the external terminal through the headset as much as possible, if the vehicle-mounted terminal 320 agrees to the authorization, if the headset 200 is occupied by an application other than the interactive program running on the first terminal 310, the user 100 may be asked in a pop-up window or the like whether to enable the function of controlling the external terminal through the headset 200 when the headset 200 is occupied by other applications. In other words, it is determined whether the first terminal is in an interactive state according to the user's instruction.

[0069] If the earphone 200 is occupied by other applications and the user 100 still wants this operation on the earphone 200 to represent the control of the external terminal, it can be achieved through user instructions.

[0070] After the user 100 changes the operation represented by the button value of the headset 200 through user instructions, related operations on the audio being played in the headset 200 through other applications can be achieved through direct operations by the user 100 on the first terminal 310, thereby ensuring the normal use of other applications while controlling the external terminal through the headset 200.

[0071] It is understandable that when the user 100 controls the external terminal, it is actually realizing human-computer interaction with the external terminal. In the process of human-computer interaction, an interactive interface is required so that the user 100 can realize human-computer interaction based on the interactive interface and complete the control of the external terminal.

[0072] In the present invention, the human-computer interaction interface of the external terminal is a display interface displayed on the vehicle-mounted display device 321. Further, for the human-computer interaction interface, a plurality of controls (views) that can be selected by focus are usually designed on the interface. Human-computer interaction based on the interaction interface may include operations such as moving the focus, clicking the focus control, returning to the main interaction interface, etc., that is, key events of the focus.

[0073] Since the key values ​​of the input components of the headset usually correspond to audio control events, it is necessary to convert the key values ​​of the headset into key events of the focus of the display interface when the user needs to use the headset to control the external terminal, so that the external terminal can directly receive the key events that can be directly responded to. In the present invention, the conversion of the key values ​​of the headset buttons and the key events of the display interface can be achieved through a preset key value mapping relationship.

[0074] In another aspect of the present invention, the external terminal control method further comprises the step of setting a key value mapping relationship according to the number of key values ​​of the key, wherein the key events include function events and direction events based on the display interface.

[0075] It is understandable that, unlike a dedicated input component, the input component of a headset is usually a button for controlling audio playback, and the number of buttons is limited. For example, a traditional wired headset includes an OK button, a + button, and a - button, and multiple button values ​​are generated by single-clicking, double-clicking, long-pressing, short-pressing, etc., corresponding to multiple audio button events. However, in existing in-ear wireless Bluetooth headsets, the input components are set as touch buttons located on the surfaces of the left and right headsets, respectively, and more than two button values ​​can be generated by single-clicking, double-clicking, long-pressing, short-pressing, etc., corresponding to multiple button events.

[0076] Therefore, when setting the key value mapping relationship, it is necessary to determine the number of key values ​​that the headset can provide according to the physical properties of the input component of the headset 200, so as to allocate the function events and direction events of the corresponding display interface. It is understandable that if the number of key values ​​is small, the function events and direction events can be traded off.

[0077] The above-mentioned function event may be a click event corresponding to a selection confirmation key such as the OK key, or a return to home page event corresponding to the HOME key, or a return to the previous interface event corresponding to the BACK key, etc. The above-mentioned direction event may be an event corresponding to the up key to move the focus upward, an event corresponding to the down key to move the focus downward, an event corresponding to the left key to move the focus left, an event corresponding to the right key to move the focus right, etc.

[0078] The first terminal 310 can set the key-value mapping relationship by default, and the user 100 can also customize the key-value mapping relationship on the first terminal 310. The user performs related operations on the headset 200 based on the key-value mapping relationship, thereby converting the external terminal control method provided by the present invention into operations on the external terminal.

[0079] In one embodiment, in response to the display interface displayed on the vehicle display device 321 being generated by the vehicle terminal 320, the human-computer interaction based on the display interface needs to be executed by the vehicle terminal 320. Therefore, after the first terminal 310 outputs the converted key event to the vehicle terminal 320, the vehicle terminal 320 directly executes the relevant key event.

[0080] In another embodiment, if Figure 1 and Figure 2 As shown, the display interface displayed on the vehicle display device 321 is projected by the second terminal 330 to the vehicle display device 321 for display, that is, the human-computer interaction based on the display interface needs to be performed by the second terminal 330. Therefore, in this embodiment, after the first terminal 310 outputs the converted key event to the vehicle terminal 320, the vehicle terminal 320 needs to output the received key event to the second terminal 330, so that the second terminal 330 executes the key event, thereby responding to the key event output by the first terminal 310.

[0081] Further, in the embodiment where the display interface is projected from the second terminal 330 to the vehicle-mounted display device 321 for display, please refer to Figure 3 Whether the first terminal 310 is in an interactive state also needs to be determined based on the authorization information of the second terminal 330. That is to say, the second terminal 330 also needs to agree to the authorization before the first terminal 310 is considered to be in an interactive state and the control of the second terminal 330 can be realized based on the headset 200.

[0082] It is understandable that the second terminal 330 can achieve communication connection with the vehicle terminal 320 through existing or future technologies, and realize the function of projecting the display interface generated by the second terminal 330 to the vehicle display device of the vehicle terminal 320 for display, which is not limited here.

[0083] In the above-mentioned screen projection embodiment, based on the external terminal control method provided by the present invention, it is possible to operate across multiple terminals, realizing the interconnection of all things. The above-mentioned screen projection embodiment also has a very wide range of application scenarios, for example, including but not limited to vehicle-mounted scenarios. User 100 can be a passenger (such as a co-pilot) located in the vehicle. The first terminal 100 can be a passenger's smart mobile terminal (such as a smart phone, a tablet computer, etc.), and the vehicle-mounted display device of the vehicle-mounted terminal 320 can be a central control screen, a head-up display screen, etc. of the vehicle. The second terminal 300 can point to the smart mobile terminal of another passenger (such as the driver). The driver can project the display interface he needs to the vehicle-mounted display device of the vehicle-mounted terminal 320 through the smart mobile terminal, so that the driver can view it during driving. The co-pilot can also see the vehicle-mounted display device of the vehicle-mounted terminal 320. Based on the present invention, the co-pilot can realize human-computer interaction with the display interface of the driver's smart mobile terminal based on headphones.

[0084] Those skilled in the art should know that the vehicle-mounted terminal 320 described in the present invention refers to an operating system that is installed in an embedded system in the early stage or installed in the vehicle later, and can realize one or more of the functions of controlling the vehicle, feedback of vehicle status data, navigation function, entertainment audio and video function, existing or future functions that may be carried on the vehicle, so as to effectively improve the level of electronicization, networking and intelligence of the vehicle. For example, the in-vehicle infotainment system (IVI) in the prior art, it can be understood that the above examples of the vehicle-mounted system are only illustrative and should not unduly limit the scope of protection of the present invention.

[0085] So far, the earphone-based external terminal control method provided by one aspect of the present invention has been described. According to the present invention, the external terminal can be controlled based on the earphone, thereby expanding the application of the earphone device and facilitating the control of the external terminal.

[0086] Another aspect of the present invention provides a terminal, comprising a communication module, at least one processor and a memory coupled to the at least one processor; the communication module is used to realize communication connection with the headset and the external terminal; the memory contains instructions stored therein, and when the instructions are executed by the at least one processor, the terminal executes the headset-based external terminal control method described in any one of the above embodiments.

[0087] That is to say, another aspect of the present invention further provides the first terminal described above. In one embodiment, the above-mentioned terminal can also be Figure 5The general computer device shown is used to implement the steps of the headphone-based external terminal control described in any of the above embodiments. For details, please refer to the above description of the headphone-based external terminal control, which will not be repeated here.

[0088] like Figure 5 As shown, in this embodiment, the terminal 500 is in the form of a general computer device, which is used to implement the steps of the headphone-based external terminal control method described in any of the above embodiments. Please refer to the above description of the headphone-based external terminal control method for details, which will not be repeated here.

[0089] The components of the terminal 500 may include one or more memories 501 , one or more processors 502 , and a bus 503 that connects different system components (including the memories 501 and the processors 502 ).

[0090] The bus 503 includes a data bus, an address bus, and a control bus. The product of the number of bits of the data bus and the operating frequency is proportional to the data transmission rate. The number of bits of the address bus determines the maximum addressable memory space. The control bus (read / write) indicates the type of bus cycle and the time when the input / output operation is completed. The processor 502 is connected to the memory 501 via the bus 503 and is configured to implement the headphone-based external terminal control method provided by any of the above embodiments.

[0091] Processor 502 is the computing and control core of terminal 500 and is the final execution unit for information processing and program running. All software layer operations in the computer system will eventually be mapped to processor 502 operations through the instruction set. The functions of processor 502 are mainly to process instructions, execute operations, control time, and process data.

[0092] The memory 501 refers to various storage devices in a computer for storing programs and data. The memory 501 may include a computer system readable medium in the form of a volatile memory, such as a random access memory (RAM) 504 and / or a cache memory 505 .

[0093] Random Access Memory (RAM) 504 is an internal memory that directly exchanges data with the processor 502. It can be read and written at any time (except when refreshing) and is very fast. It is usually used as a temporary data storage medium for the operating system or other running programs. Once the power is off, the data stored in it will be lost. Cache 505 is a primary memory between the main memory and the processor 502. Its capacity is relatively small but its speed is much higher than the main memory, close to the speed of the processor 502.

[0094] It should be noted that, when the terminal 500 includes multiple memories 501 and multiple processors 502, the multiple memories 501 and the multiple processors 502 can have a distributed structure, for example, it can include memories and processors located at the local end and the background cloud, respectively, and the local end and the background cloud jointly implement the above-mentioned headphone-based external terminal control method. Furthermore, in the embodiment adopting the distributed structure, the specific execution terminal of each step can be adjusted according to the actual situation, and the specific scheme of each step implemented in a specific terminal should not unduly limit the protection scope of the present invention.

[0095] The terminal 500 may further include other removable / immovable, volatile / non-volatile computer system storage media. In this embodiment, the storage system 506 may be used to read and write immovable, non-volatile magnetic media.

[0096] The memory 501 may also include at least one set of program modules 507. The program modules 507 may be stored in the memory 501. The program modules 507 include, but are not limited to, an operating system, one or more application programs, other program modules, and program data, each of which or some combination thereof may include an implementation of a network environment. The program modules 507 generally perform the functions and / or methods of the embodiments described herein.

[0097] The terminal 500 may also communicate with one or more external devices 508. The external device 508 in this embodiment includes the vehicle-mounted terminal 320, the second terminal 330, etc. described above. The external device 508 also includes a display 509. When implementing the headset-based external terminal control method, the terminal 500 may run interactive programs, set key-value mapping relationships, etc. through the display 509.

[0098] Terminal 500 may also communicate with one or more devices that enable a user to interact with the terminal 500, and / or with any device that enables the terminal 500 to communicate with one or more other computing devices (e.g., a network card, a modem, etc.). Such communication may be performed through input / output (I / O) interface 510.

[0099] The terminal 500 can also communicate with one or more networks (such as a local area network (LAN), a wide area network (WAN) and / or a public network, such as the Internet) through the network adapter 511. Figure 5 As shown, the network adapter 511 communicates with other modules of the terminal 500 via the bus 503 .

[0100] Another aspect of the present invention further provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the external terminal control method as described in any of the above embodiments.

[0101] So far, the specific implementation method of the terminal and the headset-based external terminal control method provided by the present invention has been described. The present invention can convert the key events of the headset into key events of the display interface, so that the function of controlling the external terminal by using the headset can be realized, which broadens the application scenarios of the headset and improves the utilization rate of the headset. The present invention determines the occupancy information of the headset and the interaction status between the terminals to clarify the control of the external terminal represented by the key events of the headset, so as to correctly respond to the user's operation. The present invention can actively put the headset and the terminal in a state that can respond to the user's operation to control the external terminal, so as to realize the function of controlling the external terminal by using the headset. The present invention is based on the fact that the external terminal controlled by the headset corresponds to the external terminal that generates the display interface, so it can be applicable to various screen projection scenarios, thereby further expanding the application scenarios.

[0102] It should be understood that although not shown in the figures, other hardware and / or software modules can be used in conjunction with terminal 500, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0103] The various illustrative logic modules and circuits described in conjunction with the embodiments disclosed herein may be implemented or executed with a general purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof designed to perform the functions described herein. A general purpose processor may be a microprocessor, but in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. The processor may also be implemented as a combination of computing devices, such as a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in cooperation with a DSP core, or any other such configuration.

[0104] The steps of the method or algorithm described in conjunction with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. The software module may reside in a RAM memory, a flash memory, a ROM memory, an EPROM memory, an EEPROM memory, a register, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art. An exemplary storage medium is coupled to a processor so that the processor can read and write information from / to the storage medium. In an alternative, a storage medium may be integrated into a processor. The processor and the storage medium may reside in an ASIC. The ASIC may reside in a user terminal. In an alternative, the processor and the storage medium may reside in a user terminal as discrete components.

[0105] In one or more exemplary embodiments, the functions described may be implemented in hardware, software, firmware, or any combination thereof. If implemented as a computer program product in software, each function may be stored on or transmitted by a computer-readable medium as one or more instructions or codes. Computer-readable media include both computer storage media and communication media, including any medium that facilitates the transfer of a computer program from one place to another. Storage media may be any available medium that can be accessed by a computer. As an example and not limitation, such a computer-readable medium may include RAM, ROM, EEPROM, CD-ROM or other optical disk storage, disk storage or other magnetic storage device, or any other medium that can be used to carry or store the desired program code in the form of an instruction or data structure and can be accessed by a computer. Any connection is also properly referred to as a computer-readable medium. For example, if the software is transmitted from a website, a server, or other remote source using a coaxial cable, a fiber optic cable, a twisted pair, a digital subscriber line (DSL), or wireless technologies such as infrared, radio, and microwaves, the coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwaves are included in the definition of the medium. Disk and disc as used herein include compact disc (CD), laser disc, optical disc, digital versatile disc (DVD), floppy disk and Blu-ray disc, wherein disk often reproduces data magnetically, while disc reproduces data optically with lasers. Combinations of the above should also be included within the scope of computer-readable media.

[0106] The foregoing description is provided to enable any person skilled in the art to practice the various aspects described herein. However, it should be understood that the scope of protection of the present invention shall be subject to the appended claims and shall not be limited to the specific structures and components of the above-described embodiments. Those skilled in the art may make various changes and modifications to the embodiments within the spirit and scope of the present invention, and these changes and modifications also fall within the scope of protection of the present invention.

Claims

1. A method for controlling an external terminal based on earphones, It is characterized in that The following steps are involved: In response to a first terminal establishing a communication connection with a vehicle-mounted terminal, and the first terminal being in an interactive state of interacting with the vehicle-mounted terminal, monitoring a key value of a button of a headset that has established a communication connection with the first terminal; In response to monitoring the key value of the headset, converting the key value into a key event of a display interface of the vehicle-mounted display device based on a preset key value mapping relationship; as well as Outputting the key event to the vehicle-mounted terminal so that the vehicle-mounted terminal responds to the key event; Among them, if the display interface is projected by the second terminal to the vehicle display device for display, after the first terminal outputs the converted key event to the vehicle terminal, the vehicle terminal outputs the received key event to the second terminal, so that the second terminal executes the key event, thereby responding to the key event output by the first terminal.

2. The external terminal control method according to claim 1, further comprising the steps of: Whether the first terminal is in the interactive state is determined at least according to the authorization information of the vehicle-mounted terminal and the occupancy information of the headset.

3. The external terminal control method as described in claim 2, in response to the vehicle-mounted terminal agreeing to the authorization, and the occupancy information of the headset is: occupied by the interactive program running on the first terminal to play silent audio, it is determined that the first terminal is in the interactive state.

4. The external terminal control method according to claim 3 further comprises the steps of: In response to the interactive program being in a running state and the earphone not being occupied by an application other than the interactive program running on the first terminal, the interactive program occupies the earphone to play silent audio.

5. The external terminal control method according to claim 4, wherein the interactive program is in a running state include: The interactive application remains in the foreground, or After being switched to the background, the interactive program keeps running continuously.

6. The external terminal control method as described in claim 2, in response to the vehicle-mounted terminal agreeing to the authorization, and the occupancy information of the headset is: occupied by an application other than the interactive program running on the first terminal, and also judging whether the first terminal is in the interactive state according to user instructions.

7. An external terminal control method as described in any one of claims 2-6, in response to the display interface being projected to the vehicle-mounted terminal by a second terminal that has established a communication connection with the vehicle-mounted terminal, it is also determined whether the first terminal is in the interactive state based on the authorization information of the second terminal.

8. The external terminal control method according to claim 1, further comprising the steps of: The key-value mapping relationship is set according to the number of the key values ​​of the button, in, The key events include function events and direction events based on the display interface.

9. A terminal for realizing external terminal control based on earphones, It is characterized in that The terminal includes a communication module, at least one processor, and a memory coupled to the at least one processor; The communication module is used to realize communication connection with the headset and the external terminal; The memory includes instructions stored therein, and when the instructions are executed by the at least one processor, the terminal executes the external terminal control method according to any one of claims 1 to 8.

10. A computer-readable storage medium having a computer program stored thereon, It is characterized in that When the computer program is executed by a processor, the external terminal control method according to any one of claims 1 to 8 is implemented.

Images