Data processing method and device, electronic equipment and computer readable medium

Abstract

The invention discloses a data processing method and device, electronic equipment and a computer readable medium, and relates to the technical field of mobile terminals, the data processing method and device are applied to first equipment, the first equipment is connected with multiple pieces of second equipment, and the multiple pieces of second equipment comprise intelligent display terminals and earphones. Playing specified audio related to the travel through the earphone; detecting the action information of the earphone within a specified time length after the earphone plays the specified audio; under the condition that the action information meets a preset condition, determining target navigation information based on the audio content of the specified audio; and playing the target navigation information through the earphone. Therefore, the audio related to the travel can be automatically played for the scene where the video conference is ended to remind the user, and the earphone can be directly controlled to play the target navigation information corresponding to the travel after the user inputs the action information through the earphone, so that a more intuitive operation mode is provided, and the interactivity of the electronic equipment is improved.

Description

Technical Field

[0001] The present application relates to the field of mobile terminal technology, and more specifically, to a data processing method, device, electronic device and computer-readable medium. Background Art

[0002] As the types of applications installed in electronic devices increase, the functions that electronic devices can achieve are becoming increasingly rich. For example, electronic devices can search for information on the Internet and display it. For another example, electronic devices can play audio and video. However, the related methods of triggering electronic devices to perform corresponding functions are not flexible and convenient enough. Summary of the invention

[0003] The present application proposes a data processing method, device, electronic device and computer-readable medium to improve the above-mentioned defects.

[0004] In a first aspect, an embodiment of the present application provides a data processing method, which is applied to a first device, wherein the first device is connected to multiple second devices, and the multiple second devices include a smart display terminal and a headset. The method includes: after the smart display terminal exits the video conference scene, playing a specified audio related to the itinerary through the headset; within a specified time length after the headset plays the specified audio, detecting action information of the headset; when the action information meets a preset condition, determining target navigation information based on the audio content of the specified audio; and playing the target navigation information through the headset.

[0005] In the second aspect, an embodiment of the present application further provides a data processing device, which is applied to a first device, wherein the first device is connected to multiple second devices, wherein the multiple second devices include a smart display terminal and a headset, and the device includes: a travel unit, a detection unit, a determination unit, and a playback unit. The travel unit is used to play a specified audio related to the travel through the headset after the smart display terminal exits the video conference scene. The detection unit is used to detect the action information of the headset within a specified time length after the headset plays the specified audio. The determination unit is used to determine the target navigation information based on the audio content of the specified audio when the action information meets a preset condition. The playback unit is used to play the target navigation information through the headset.

[0006] In a third aspect, an embodiment of the present application also provides an electronic device, comprising: one or more processors; a memory; one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, and the one or more applications are configured to execute the above method.

[0007] In a fourth aspect, an embodiment of the present application further provides a computer-readable storage medium, wherein the readable storage medium stores a program code executable by a processor, and when the program code is executed by the processor, the processor executes the above method.

[0008] The data processing method, device, electronic device and computer-readable medium provided by the present application play the specified audio related to the itinerary through the headset after the smart display terminal exits the video conference scene; detect the action information of the headset within a specified time length after the headset plays the specified audio; determine the target navigation information based on the audio content of the specified audio when the action information meets the preset conditions; and play the target navigation information through the headset. Therefore, for the scenario where the video conference ends, it is possible to automatically play the audio related to the itinerary to remind the user, and after the user inputs the action information through the headset, the headset can be directly controlled to play the target navigation information corresponding to the itinerary, providing a more intuitive operation method and improving the interactivity of the electronic device.

[0009] Other features and advantages of the embodiments of the present application will be described in the subsequent description, and partly become apparent from the description, or can be understood by practicing the embodiments of the present application. The purposes and other advantages of the embodiments of the present application can be realized and obtained by the structures specifically pointed out in the written description, claims, and drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0011] Figure 1 A schematic diagram of an intelligent interaction system provided by an embodiment of the present application is shown;

[0012] Figure 2 A schematic diagram showing the internal modules of the intelligent interaction system provided in an embodiment of the present application is shown;

[0013] Figure 3 A schematic diagram showing the data flow between various devices of the intelligent interaction system provided in an embodiment of the present application is shown;

[0014] Figure 4 A method flow chart of a data processing method provided by an embodiment of the present application is shown;

[0015] Figure 5 A method flow chart of a data processing method provided by another embodiment of the present application is shown;

[0016] Figure 6 A method flow chart of a data processing method provided by another embodiment of the present application is shown;

[0017] Figure 7 A module block diagram of a data processing device provided by an embodiment of the present application is shown;

[0018] Figure 8 A structural block diagram of an electronic device provided in an embodiment of the present application is shown;

[0019] Fig. 9 A storage unit for storing or carrying program codes for implementing a data processing method according to an embodiment of the present application is shown. DETAILED DESCRIPTION

[0020] In order to make those skilled in the art better understand the present application scheme, the technical scheme in the present application embodiment will be clearly and completely described below in conjunction with the drawings in the present application embodiment. Obviously, the described embodiment is only a part of the present application embodiment, rather than all the embodiments. The components of the present application embodiment usually described and shown in the drawings here can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present application provided in the drawings is not intended to limit the scope of the present application for protection, but merely represents the selected embodiment of the present application. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without making creative work belong to the scope of protection of the present application.

[0021] It should be noted that similar reference numerals and letters represent similar items in the following drawings, so once an item is defined in one drawing, it does not need to be further defined and explained in subsequent drawings. At the same time, in the description of this application, the terms "first", "second", etc. are only used to distinguish the description and cannot be understood as indicating or implying relative importance.

[0022] The Internet of Things (IoT) is a network concept that extends and expands the user end of the "Internet concept" to any object to exchange information and communicate. With the development of IoT technology, some scenarios can be configured in the IoT system. For the configured scenario, multiple smart devices may be involved, and multiple smart devices have a certain linkage relationship and can work together. For example, the configured scenario may include that when one device is close to another device, at least one of the two devices will perform a specified operation. Or when a device performs an operation, part of the data of the operation is processed by itself, and the other part of the data is processed by another device.

[0023] As people's lives become more diverse, users have more and more electronic devices, and the technologies of Bluetooth communication and Wi-Fi are also advancing rapidly. At present, in order to facilitate users' work and life, an electronic device can be connected to an external device via Bluetooth or Wi-Fi so that users can control the electronic device to send data to the connected device. The electronic device can be a smart phone, tablet computer, e-book, wireless audio player, display, etc., which has a communication module inside and can establish a wireless communication connection with other devices and exchange data. The wireless audio player can include a Bluetooth headset or a Bluetooth speaker, etc.

[0024] However, the inventors found in their research that the current common way to control each device in the Internet of Things is to control other devices by operating the operation interface of the electronic device after the electronic device is connected to other devices. However, the related way of triggering the electronic device to perform the corresponding function is not flexible and convenient enough.

[0025] Therefore, in order to overcome the above-mentioned defects, the embodiment of the present application provides a data processing method to provide a more convenient and convenient operation mode for the intelligent interactive system. Before introducing the method embodiment of the present application, the application scenario of the method, i.e., the intelligent interactive system, is first introduced. The intelligent interactive system includes a plurality of electronic devices, and data can be directly or indirectly exchanged between different electronic devices. Usually, at least one device in the intelligent interactive system has the ability to process data, which can be named as the first device. At the same time, the interactive system also includes at least one device that can be controlled by the first device. Of course, the first device itself can also be controlled by the first device. In addition, the intelligent interactive system also includes a data acquisition device, for example, to collect the user's voice or image, etc. Usually, the data acquisition device can send the data to the first device, and the first device analyzes the data and makes a decision on whether to control a certain device in the intelligent interactive system to perform the corresponding operation, and then, based on the decision, controls the device to be controlled to perform the corresponding operation. The various electronic devices in the intelligent interactive system complement each other and cooperate with each other to provide users with a variety of interactive operation methods.

[0026] like Figure 1 As shown, the intelligent interactive system includes a smart screen 101, a speaker 102, a smart lamp 103, a smart phone 104, a tablet computer 105, a headset 106 and a watch 107, etc. Figure 1Not all electronic devices that can be used in the intelligent interactive system are listed completely. Generally, electronic devices that can control other devices or be controlled by other devices are suitable for the intelligent interactive system, which is not limited here. Among them, the smart screen 101 can be a smart TV. In addition to the function of displaying multimedia content (text, images, videos, etc.), it also has wireless communication with other electronic devices and even has the function of image acquisition. Speakers 102, smart lamps 103, smart phones 104, tablets 105, headphones 106 and watches 107 can all communicate wirelessly with other electronic devices. For example, the speaker 102 can be a Bluetooth speaker and the headphones 106 can be Bluetooth headphones.

[0027] like Figure 1 As shown, assuming that the tablet computer 105 is the aforementioned first device, and the smart screen 101, the speaker 102, the smart lamp 103, the smart phone 104, the earphone 106, and the watch 107 are all second devices, then the smart screen 101, the speaker 102, the smart lamp 103, the smart phone 104, the earphone 106, and the watch 107 are directly or indirectly connected to the tablet computer 105. For example, the smart screen 101, the speaker 102, the smart lamp 103, the smart phone 104, and the earphone 106 are directly connected to the tablet computer 105, and the watch 107 is connected to the tablet computer 105 through the smart phone 104. Figure 1 In the intelligent interactive system shown, considering that the tablet computer 105 has a larger screen and stronger data processing capability, the tablet computer 105 is selected as the control center of all devices and the data processing center, i.e., the first device. Of course, other devices can also be selected as the first device. For example, if the smart phone 104 is selected as the first device, then other devices also need to be directly or indirectly connected to the smart phone 104. It can be understood that Figure 1 This is only an example of an intelligent interactive system. Figure 1 At least part of the various devices in the shown intelligent interactive system constitutes a new interactive system applied to the scene, and even new devices can be added. Moreover, the devices in the system can be selected to play the roles of the first device and the second device according to the requirements of the scene.

[0028] like Figure 2 As shown, Figure 2 The data processing and control modules in each device in the above-mentioned intelligent interactive system are shown. Among them, the smart screen and the tablet computer both have modules such as service flow, camera recognition, gesture interaction, voice interaction and communication. In addition, the tablet computer also includes a headset management module. Usually, a smart phone can also have various modules in a tablet computer, but in Figure 2In the corresponding implementation manner, the aforementioned modules of the smart phone are not shown. In addition, the smart phone also has a gesture data mobile phone module. Figure 3 , Figure 3 The data transmission process between the various devices in the above-mentioned intelligent interactive system is shown. Figure 2 and Figure 3 The specific description of is not elaborated here. In the subsequent embodiments, various specific scenarios will be combined to illustrate Figure 2 The functions and Figure 3 Data interaction in .

[0029] It should be noted that the application scenario of the embodiment of the present application is a video conferencing scenario, and the intelligent interactive system corresponding to the video conferencing scenario can generally include an intelligent display terminal (for example, the aforementioned smart screen), a main device as a control center (for example, a tablet computer), and other intelligent devices (for example, smart lamps, speakers, etc.). Usually, in a video conferencing scenario, the intelligent display terminal is used to display screens related to the video conference, such as video screens captured by the terminals of each participant, and content shared by the participants (video, text, etc.). Among them, the intelligent display terminal can be installed with applications and run the installed applications. Of course, it can also display content projected by other devices.

[0030] See also Figure 4 , Figure 4 A data processing method is shown, which is applied to a first device, which may be the main device in the above-mentioned video conferencing scenario, the first device is connected to multiple second devices, and the multiple second devices include smart display terminals and headphones. In the embodiment of the present application, the execution subject of the method is the first device, and the implementation of the first device and the second device can refer to the above description, which will not be repeated here. Specifically, the method includes: S401 to S404.

[0031] S401: After the smart display terminal exits the video conference scene, the designated audio related to the itinerary is played through the earphone.

[0032] As an implementation method, the implementation method for determining whether the smart display terminal is in a video conference scene can be, when the first device and the smart display terminal are directly or indirectly connected, determining whether the content displayed by the smart display terminal corresponds to a conference application or whether the currently displayed interface belongs to a video conference related interface, if so, determining that the smart display terminal is in a video conference scene. If it does not belong to a video conference related interface, it is determined that the smart display terminal is not in a video conference scene. Therefore, after the smart display terminal enters the video conference scene, the content displayed by the smart display terminal is detected, and it can be detected that the smart display terminal exits the video conference scene.

[0033] As an implementation method, the specified audio related to the itinerary may be the audio content corresponding to the itinerary information pre-acquired in the first device. For example, the itinerary information pre-set by the user in the itinerary application, or the itinerary information automatically generated by the itinerary application through analysis of the preset content received by the first device with the authorization of the user. The preset content may be a text message received by the first device, etc. After obtaining the itinerary information, the first device generates the audio content corresponding to the itinerary information. The audio content may be the reminder voice corresponding to the itinerary information, which is used to remind the user of the content of the itinerary information. For example, if the itinerary information is a meeting itinerary, the corresponding specified audio may be "There is a meeting at 3 pm in XX Building".

[0034] S402: Detecting action information of the headset within a specified time length after the headset plays the specified audio.

[0035] Among them, the specified time length can be used as the effective input time of the action information of the headset, that is, within the specified time length after the headset plays the specified audio, the detected action information of the headset can be used to determine whether to serve as a response to the specified audio, that is, for the execution of subsequent operations. If the action information of the headset is not detected within the specified time length after the specified audio, it can be determined that the user has not responded to the specified audio. The specified time length can be set according to actual usage requirements, and is usually a shorter time length, for example, 10 to 30 seconds. It should be noted that the action information of the headset may include the user's touch gestures for the headset, and may also include the movement trajectory of the headset, etc. The subsequent embodiments will explain different implementation methods for different actions.

[0036] S403: When the action information satisfies a preset condition, target navigation information is determined based on the audio content of the designated audio.

[0037] It can be understood that the aforementioned specified time length is used as the time limit for detecting the action information of the headset after the headset plays the specified audio, and the preset condition is used as the judgment condition for the validity of the action information, that is, it is used to determine whether the action information can trigger the headset to perform subsequent operations, that is, play the navigation information corresponding to the trip. The preset condition is related to the type of action information, that is, the action information can include two types: the user's touch gesture for the headset and the motion trajectory of the headset. Each type corresponds to different judgment conditions, which can be referred to in the description of the subsequent embodiments.

[0038] S404: Playing the target navigation information through the earphone.

[0039] As an implementation method, the itinerary information corresponding to the specified audio may include destination information. If the itinerary information records that there is a meeting at XX Building at 3 pm, then the "XX Building" is the destination information. Therefore, by analyzing the itinerary information, information related to the address can be found from the itinerary information. Combined with the contextual semantics of the itinerary information, it can be determined whether the address information is a starting address or a destination address. If it is a destination address, the address is used as the destination information. If the destination address does not exist in the itinerary information, it is determined whether there is a specified type of content in the itinerary information, wherein the specified type of content can be pre-set content that can be used to find the destination, such as flight number, train number, etc. If it exists, the specified type of content is obtained, and the destination information is found based on the specified type of content. If the specified type of content does not exist, a query message is output to obtain the address information input by the user based on the query message as the destination information.

[0040] After obtaining the destination information corresponding to the trip information, the starting point information is determined, navigation information is generated based on the starting point information and the destination information, and the target navigation information is played through the headphones. The starting point information can be the current address position of the first device, or it can be the starting point position determined based on the address position. Exemplarily, after obtaining the current address position of the first device, the current address position is used as a reference address position, and the starting point position is determined within a preset range of the reference address position. Specifically, with the authorization of the user, the historical starting point position within the preset range can be obtained, and the historical starting point position can be the starting point position and the recommended location point in the user's historical navigation route. Then, the number of times each historical starting point position is used is determined, and the position with the highest number of uses is determined as the user's commonly used starting position. Then, after obtaining the destination information corresponding to the trip information this time, the commonly used starting position is used as the starting point position so that the target navigation information can be determined.

[0041] As an implementation method, the target navigation information may be played through the earphone after the target navigation information is obtained, or the target navigation information may be played after the navigation information is obtained and a preset condition is met. The preset condition may be that the target navigation information is played through the earphone when it is detected that the user has reached the starting position of the target navigation information.

[0042] Therefore, in the data processing method provided by the embodiment of the present application, after the smart display terminal exits the video conference scene, the specified audio related to the itinerary is played through the headset; within a specified time length after the headset plays the specified audio, the action information of the headset is detected; when the action information meets the preset conditions, the target navigation information is determined based on the audio content of the specified audio; and the target navigation information is played through the headset. Therefore, for the scenario where the video conference ends, the audio related to the itinerary can be automatically played to remind the user, and after the user inputs the action information through the headset, the headset can be directly controlled to play the target navigation information corresponding to the itinerary, providing a more intuitive operation method and improving the interactivity of the electronic device.

[0043] See also Figure 5 , Figure 5 A data processing method is shown, which is applied to a first device, which may be the main device in the above-mentioned video conferencing scenario, the first device is connected to multiple second devices, and the multiple second devices include smart display terminals and headphones. In the embodiment of the present application, the execution subject of the method is the first device, and the implementation of the first device and the second device can refer to the above description, which will not be repeated here. Specifically, the method includes: S501 to S504.

[0044] S501: After the smart display terminal exits the video conference scene, the designated audio related to the itinerary is played through the earphone.

[0045] As an implementation mode, in an embodiment of the present application, the headset can be directly connected to the first device. Of course, the headset can also be connected to the second device through a smart phone. This is not limited here. The headset plays the specified audio based on the playback conditions.

[0046] Exemplarily, the playback condition may be the aforementioned detection of the smart display terminal exiting the video conference scene. Therefore, when the smart display terminal is detected to exit the video conference scene, it is determined that the headset meets the playback condition. Therefore, the headset plays the specified audio. It can be understood that the specified audio played by the headset may be the audio sent to the headset by the first device after determining that the smart display terminal exits the video conference scene, or it may be the audio pre-stored in the headset, which is not limited here. In addition, the playback condition may also be that the smart display terminal exits the video conference scene and the headset is in a wearing state. Specifically, after the smart display terminal exits the video conference scene, the implementation method of playing the specified audio related to the itinerary through the headset may be that after the smart display terminal exits the video conference scene, the use state of the headset is obtained; if the use state of the headset is a wearing state, the specified audio related to the itinerary is played through the headset. Exemplarily, since the user may not wear the headset when participating in a video conference through the smart display terminal, such as playing the audio data during the video conference through the player of the video display terminal, it is necessary to first determine whether the user is still wearing the headset after determining that the smart display terminal exits the video conference scene. For example, the earphone has a designated surface. When the earphone is worn, the designated surface corresponds to the ear canal of the user, so the designated surface will be blocked. Therefore, a preset sensor is set on the designated surface. The preset sensor can detect whether the designated surface of the earphone is blocked, and then determine the use state of the earphone, that is, whether it is worn. Exemplarily, the preset sensor can be a light sensor or a distance sensor, etc., which is not limited here. After the preset sensor detects that the designated surface is blocked, it is determined whether the earphone is located in the earphone box. If the designated surface is blocked and the earphone is not located in the earphone box, it is determined that the use state of the earphone is worn. If it is located in the earphone box or the designated surface is not blocked, it is determined that the use state of the earphone is not worn.

[0047] In addition, when it is determined that the earphone is in a wearing state, if the user has not used the earphone recently, suddenly playing the specified audio may make the user feel abrupt, so the specified audio can be played after the user finishes playing the first audio or in the process of playing the first audio. Among them, the first audio can be a pre-set audio file of a specified type, for example, it can be a song, it can also be audio data in a voice call, it can also be a voice message, etc., which can be set based on actual usage and can be determined based on the user's personal preferences. For example, under the premise of user authorization, the user's historical audio data can be obtained, and the historical audio data includes the audio data played by the user in the time period after the previous video conference and before the travel information is checked through the first device, and the attribute information of each type of audio of the historical audio data is determined, and the aforementioned specified type is determined based on the attribute information, wherein the time period is less than the preset time threshold, for example, the preset time threshold can be 10 minutes to 1 hour, etc., to determine that the time length between the operation of checking the travel information and the video conference is not too long. The attribute information may include the number of uses or the frequency of use, etc. Then the implementation method of determining the aforementioned specified type based on the attribute information can be to use the type with the highest attribute information as the specified type. For example, by analyzing the user's historical data, it is determined that the user usually makes a voice call after a video conference and before checking the itinerary information. The specified type is the audio data in the voice call. Therefore, after determining that the smart display terminal exits the video conference scene this time and when determining that the usage status of the headset is in the wearing state, after detecting that the voice call ends, the specified audio related to the itinerary is played through the headset. Therefore, it can be avoided that the playback of the specified audio interferes with the user's use needs for the playback of other audio data.

[0048] Exemplarily, if the use state of the headset is in the wearing state, the implementation method of playing the specified audio related to the itinerary through the headset may be that if the use state of the headset is in the wearing state, when it is detected that the headset ends playing the audio file, the specified audio related to the itinerary is played through the headset. Among them, the audio file can refer to the aforementioned determination method of the first audio, or it can be any audio played through the headset after the video conference. For example, after determining that the smart display terminal exits the video conference scene, and when it is determined that the use state of the headset is in the wearing state, it is detected that the user uses the headset to play the first audio, and the first audio is not the aforementioned specified audio related to the itinerary. After determining that the first audio has finished playing, the specified audio related to the itinerary is played through the headset. For example, if the first audio is a song, then after the video conference ends, the user plays the song through the headset, and after the song ends playing, the specified audio related to the itinerary is played through the headset.

[0049] As another implementation, the earphone can also play the designated audio through the earphone during the process of playing the first audio. Since the designated audio is played during the process of playing the audio, that is, the user is currently listening to the audio through the earphone, the playing of the designated audio will not be too abrupt. The designated type of the first audio is a type other than a preset type, and the preset type includes a voice call audio type. That is, if the user uses the earphone to make a voice call with other users, the designated audio is not played to avoid affecting the user's call instructions and causing the user to miss important information.

[0050] S502: Detecting a touch gesture applied to the earphone within a specified time period after the earphone plays the specified audio.

[0051] Among them, the touch gesture can be single-click, slide, multi-click and other operations, which are not limited here. For example, an acceleration sensor is provided in the headset. When the user inputs different touch gestures to the headset, it can cause the headset to produce a movement corresponding to the touch gesture. The movement can be reflected in the acceleration change of the headset in different directions. Therefore, the acceleration change can be collected by the acceleration sensor to determine the touch gesture applied by the user to the headset. Of course, it is also possible to set a touchpad in a preset area of ​​the headset shell, and collect the touch gestures applied by the user to the touchpad based on the touchpad. For example, the touchpad can be a touch screen.

[0052] In addition, the specified time length may be a shorter time length. For example, after hearing the earphone play the specified audio, the user inputs a touch gesture to the earphone. Therefore, in an embodiment of the present application, the touch gesture applied to the earphone may be collected within a shorter time length after the earphone plays the specified audio. For example, the specified time length may be a time length of less than half a minute.

[0053] S503: If the touch gesture is a designated tapping operation, target navigation information is determined based on the audio content of the designated audio.

[0054] As an implementation mode, the designated tapping operation is a double-click operation. In an embodiment of the present application, the audio content of the designated audio includes a destination address. By analyzing the audio content of the designated audio, the destination address in the audio content can be extracted, and target navigation information can be generated based on the destination address. For example, if the audio content is "Go to the customer at Building A to get information at 3 pm", then Building A is the address information. By analyzing the words near Building A, words with action meanings such as "go", "arrive", and "go to" can be determined, so that the address information can be determined to be the destination address.

[0055] S504: Playing the target navigation information through the earphone.

[0056] It should be noted that the aforementioned determination of the target navigation information and the playback of the target navigation information and other parts not described in detail may refer to the aforementioned embodiments and will not be described in detail here.

[0057] The technical effect of the embodiment of the present application is explained below through an example. The user is participating in a video conference, and the smart display terminal is in a video conference scene. Then, at the end of the video conference, the user wears headphones, triggers the playback of song 1 on the mobile phone, and plays the song 1 through the headphones connected to the mobile phone. When the playback of song 1 ends, the specified audio related to the itinerary is played through the headphones, for example, "Go to the customer in Building A to get information at 3 pm". After hearing the audio, the user double-clicks the headphones to trigger the mobile phone to generate a navigation route to Building A. Then, the mobile phone plays the navigation audio corresponding to the navigation route through the headphones, and at the same time, the mobile phone can also display the display content corresponding to the navigation route.

[0058] See also Figure 6 , Figure 6 A data processing method is shown, which is applied to a first device, which can be the main device in the above-mentioned video conferencing scenario, and the first device is connected to multiple second devices, which include smart display terminals and headphones. In the embodiment of the present application, the execution subject of the method is the first device, and the implementation of the first device and the second device can refer to the above description, which will not be repeated here. Specifically, the method includes: S601 to S604.

[0059] S601: After the smart display terminal exits the video conference scene, the earphone plays designated audio related to the itinerary.

[0060] S602: Detecting a motion trajectory acting on the earphone within a specified time length after the earphone plays the specified audio.

[0061] The principle is the same as that of detecting the touch gesture of the earphone. The movement trajectory of the earphone during movement can be detected by the acceleration sensor in the earphone. It should be noted that the movement trajectory of the earphone refers to the movement trajectory of the earphone when it is worn. Therefore, within a specified time length after the earphone plays the specified audio, the movement trajectory acting on the earphone is obtained when the earphone is in the worn state. The explanation of the specified time length can refer to the above embodiment.

[0062] S603: If the motion trajectory is a designated trajectory, determining target navigation information based on the audio content of the designated audio.

[0063] The designated trajectory may be the movement trajectory of the earphones when the user nods while wearing the earphones. Therefore, the acceleration data obtained by the acceleration sensor in the earphones when the user nods while wearing the earphones may be collected in advance as reference data. Then, the acceleration data collected by the acceleration sensor of the earphones under the currently collected motion trajectory may be compared with the reference data. If they match, the motion trajectory is determined to be the designated trajectory, and the target navigation information is determined based on the audio content of the designated audio.

[0064] S604: Playing the target navigation information through the earphone.

[0065] It should be noted that the aforementioned determination of the target navigation information and the playback of the target navigation information and other parts not described in detail may refer to the aforementioned embodiments and will not be described in detail here.

[0066] As an implementation manner, if the motion trajectory is a designated trajectory, then the implementation manner of determining the target navigation information based on the audio content of the designated audio may include obtaining the usage status of the headset; if the usage status of the headset is a wearing status and the motion trajectory is a designated trajectory, then determining the target navigation information based on the audio content of the designated audio. Among them, the usage status of the headset includes a wearing status and a not-wearing status. The detection of the usage status of the headset can refer to the aforementioned embodiment and will not be repeated here. By detecting that the motion trajectory of the headset matches the designated trajectory when the headset is in a wearing state, it is determined that the user has a need to play the target navigation information.

[0067] For example, a user is participating in a video conference, and the smart display terminal is in a video conference scene. Then, at the end of the video conference, the user wears headphones, triggers the playback of song 1 on the mobile phone, and plays song 1 through the headphones connected to the mobile phone. When song 1 ends, the headphones play a specified audio related to the itinerary, for example, "Go to the customer at Building A to get information at 3 pm." After hearing the audio, the user nods, and the headphones can collect their own motion trajectory at this time, and the motion trajectory matches the motion trajectory of the user's head when nodding (that is, the specified trajectory), thereby determining that the user nods to confirm, triggering the mobile phone to generate a navigation route to Building A, and then, the mobile phone plays the navigation audio corresponding to the navigation route through the headphones. At the same time, the mobile phone can also display the display content corresponding to the navigation route.

[0068] As an implementation method, the headset is a binaural headset, that is, it has a first headset and a second headset, wherein one of the first headset and the second headset is used as a left headset and the other headset is used as a right headset. Then, the implementation method of S602 is to obtain the use status of the first headset and the second headset within a specified time length after the headset plays the specified audio, and when the first headset is in a wearing state and the second headset is in an unworn state, obtain the motion trajectory of the second headset as the motion trajectory of the headset, and then, if the motion trajectory is a specified trajectory, determine the target navigation information based on the audio content of the specified audio. In this example, the specified trajectory can be a preset motion trajectory, for example, a single swing, or multiple swings in succession, wherein multiple swings in succession refer to at least two consecutive times. Such an implementation method brings the user the experience that after the user listens to the specified audio through the headset, within a specified time length, the user can wear one headset, hold another headset, and swing the handheld headset to simulate a determination gesture, and then trigger the first device to generate the target navigation information, and then play the navigation audio corresponding to the target navigation information through the headset.

[0069] See also Figure 7 , which shows a structural block diagram of an xxx device provided in an embodiment of the present application. The device is applied to a first device, the first device is connected to multiple second devices, the multiple second devices include a smart display terminal and a headset, and the device includes: a travel unit 701, a detection unit 702, a determination unit 703 and a playback unit 704.

[0070] The itinerary unit 701 is used to play the specified audio related to the itinerary through the earphone after the intelligent display terminal exits the video conference scene.

[0071] Furthermore, the itinerary unit 701 is also used to obtain the usage status of the headset after the smart display terminal exits the video conference scene; if the usage status of the headset is a wearing state, the specified audio related to the itinerary is played through the headset.

[0072] Furthermore, the itinerary unit 701 is also used to play designated audio related to the itinerary through the headset if the headset is in the wearing state and it is detected that the headset ends playing the audio file.

[0073] The detection unit 702 is used to detect the action information of the headset within a specified time length after the headset plays the specified audio.

[0074] The determination unit 703 is configured to determine target navigation information based on the audio content of the designated audio when the action information satisfies a preset condition.

[0075] Furthermore, the action information is a touch gesture acting on the earphone, and the determination unit 703 is further configured to determine the target navigation information based on the audio content of the specified audio if the touch gesture is a specified tapping operation, wherein the specified tapping operation is a double-click operation.

[0076] Furthermore, the action information is a motion trajectory of the earphone, and the determination unit 703 is further configured to determine the target navigation information based on the audio content of the specified audio if the motion trajectory is a specified trajectory.

[0077] Furthermore, the determination unit 703 is further configured to obtain a usage state of the headset; if the usage state of the headset is a wearing state and the motion trajectory is a designated trajectory, the target navigation information is determined based on the audio content of the designated audio.

[0078] The playing unit 704 is used to play the target navigation information through the earphone.

[0079] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described devices and modules can refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here.

[0080] In several embodiments provided in the present application, the coupling between modules may be electrical, mechanical or other forms of coupling.

[0081] In addition, each functional module in each embodiment of the present application can be integrated into a processing module, or each module can exist physically separately, or two or more modules can be integrated into one module. The above integrated modules can be implemented in the form of hardware or software functional modules.

[0082] Please refer to Figure 8 , which shows a structural block diagram of an electronic device provided in an embodiment of the present application. The electronic device 100 may be an electronic device capable of running applications, such as a smart phone, a tablet computer, an e-book, etc. The electronic device 100 in the present application may include one or more of the following components: a processor 110, a memory 120, and one or more applications, wherein the one or more applications may be stored in the memory 120 and configured to be executed by one or more processors 110, and the one or more programs are configured to execute the method described in the aforementioned method embodiment.

[0083] The processor 110 may include one or more processing cores. The processor 110 uses various interfaces and lines to connect various parts of the entire electronic device 100, and executes various functions and processes data of the electronic device 100 by running or executing instructions, programs, code sets or instruction sets stored in the memory 120, and calling data stored in the memory 120. Optionally, the processor 110 can be implemented in at least one hardware form of digital signal processing (DSP), field-programmable gate array (FPGA), and programmable logic array (PLA). The processor 110 can integrate one or a combination of a central processing unit (CPU), a graphics processing unit (GPU), and a modem. Among them, the CPU mainly processes the operating system, user interface, and application programs; the GPU is responsible for rendering and drawing display content; and the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 110, but may be implemented separately through a communication chip.

[0084] The memory 120 may include a random access memory (RAM) or a read-only memory (ROM). The memory 120 may be used to store instructions, programs, codes, code sets or instruction sets. The memory 120 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the following various method embodiments, etc. The data storage area may also store data (such as a phone book, audio and video data, chat record data) created by the electronic device 100 during use.

[0085] Please refer to Fig. 9 , which shows a structural block diagram of a computer-readable medium provided in an embodiment of the present application. The computer-readable medium 900 stores program codes, which can be called by a processor to execute the method described in the above method embodiment.

[0086] The computer readable medium 900 may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read-only memory), an EPROM, a hard disk, or a ROM. Optionally, the computer readable medium 900 includes a non-transitory computer-readable storage medium. The computer readable medium 900 has storage space for program code 910 that performs any method step in the above method. These program codes can be read from or written to one or more computer program products. The program code 910 can be compressed, for example, in an appropriate form.

[0087] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A data processing method, characterized in that: Applied to a first device, the first device is connected to a plurality of second devices, the plurality of second devices include a smart display terminal and a headset, the method includes: After the smart display terminal exits the video conference scene, playing the specified audio related to the trip through the headset; Detecting action information of the headset within a specified time length after the headset plays the specified audio; In the case where the action information satisfies a preset condition, determining target navigation information based on the audio content of the designated audio; The target navigation information is played through the earphone.

2. The method according to claim 1, characterized in that The action information is a touch gesture acting on the earphone, and when the action information satisfies a preset condition, determining the target navigation information based on the audio content of the designated audio includes: If the touch gesture is a designated tapping operation, target navigation information is determined based on the audio content of the designated audio.

3. The method according to claim 2, characterized in that The designated tapping operation is a double-click operation.

4. The method according to claim 1, characterized in that: The action information is a motion track of the earphone, and when the action information satisfies a preset condition, determining the target navigation information based on the audio content of the designated audio includes: If the motion trajectory is a designated trajectory, target navigation information is determined based on the audio content of the designated audio.

5. The method according to claim 4, characterized in that If the motion trajectory is a designated trajectory, determining target navigation information based on the audio content of the designated audio includes: Obtaining the usage status of the headset; If the usage state of the earphone is a wearing state and the motion trajectory is a designated trajectory, target navigation information is determined based on the audio content of the designated audio.

6. The method according to claim 1, characterized in that After the smart display terminal exits the video conference scene, the specified audio related to the trip is played through the headset, including: After the smart display terminal exits the video conference scene, obtaining the usage status of the headset; If the earphone is in a wearing state, designated audio related to the trip is played through the earphone.

7. The method according to claim 6, characterized in that If the earphone is in the wearing state, playing the specified audio related to the itinerary through the earphone includes: If the usage state of the earphone is the wearing state, when it is detected that the earphone finishes playing the audio file, the designated audio related to the trip is played through the earphone.

8. A data processing device, characterized in that: Applied to a first device, the first device is connected to a plurality of second devices, the plurality of second devices include a smart display terminal and a headset, the apparatus includes: A trip unit, configured to play a designated audio related to the trip through the headset after the smart display terminal exits the video conference scene; a detection unit, configured to detect action information of the headset within a specified time length after the headset plays the specified audio; a determining unit, configured to determine target navigation information based on the audio content of the designated audio when the action information satisfies a preset condition; The playing unit is used to play the target navigation information through the earphone.

9. An electronic device, characterized in that: include: one or more processors; Memory; One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, and the one or more applications are configured to execute the method according to any one of claims 1-7.

10. A computer-readable medium, characterized in that The computer-readable medium stores a program code executable by a processor, and when the program code is executed by the processor, the processor executes the method according to any one of claims 1 to 7.

Images