Data processing method, device, equipment and storage medium
By implementing data processing methods in speaker equipment and mobile terminals, the problem of inconvenient connection between speaker equipment and mobile terminals in the prior art is solved, convenient connection and interaction are achieved, and user experience is improved.
Patent Information
- Application Number
- CN201910473390.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2019-05-31
- Publication Date
- 2025-02-18
- Estimated Expiration
- 2039-05-31
AI Technical Summary
There is inconvenience in the connection and interaction between existing speaker devices and mobile terminals. It is necessary to match Bluetooth first to establish a connection, which has a poor user experience.
By implementing data processing methods in speaker equipment and mobile terminals, including establishing connections, sending commands, and interactive outputs, the convenient connection and data interaction between speaker equipment and mobile terminals are realized.
It realizes convenient connection and interaction between speaker equipment and mobile terminals. Users can view the display information corresponding to the audio data output by the speaker equipment through the mobile terminal as a display, improving the user experience.
Smart Images

Figure CN112015567B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of computer technology, and in particular to a data processing method and device, a speaker device, an electronic device and a storage medium. Background Art
[0002] A speaker is a device that can convert audio signals into sound. The speaker has a built-in power amplifier, which amplifies the audio signal and plays it back, making the sound louder. Users can usually connect external speakers to TVs and other audio and video devices to output external sound.
[0003] Speakers are usually connected to devices via data cables. Some speakers also support Bluetooth connection to devices, but they often need to be matched with Bluetooth before a connection can be established. The speaker can then be used as the audio output component of the device. Summary of the invention
[0004] The embodiment of the present application provides a data processing method to enable a speaker device to conveniently connect and interact with a mobile terminal.
[0005] Correspondingly, the embodiments of the present application also provide a data processing device, a speaker device, an electronic device and a storage medium to ensure the implementation and application of the above method.
[0006] In order to solve the above problems, an embodiment of the present application discloses a data processing method applied to a speaker device, the method comprising: establishing a connection with a mobile terminal; sending a first instruction to the mobile terminal, the mobile terminal having an application corresponding to the speaker device; and outputting audio data corresponding to the information displayed on the application on the speaker device through data interaction with the mobile terminal.
[0007] An embodiment of the present application also discloses a data processing method, which is applied to a mobile terminal, and the method includes: establishing a connection with a speaker device; receiving a first instruction from the speaker device, and running an application corresponding to the speaker device according to the first instruction; and interacting with the speaker device based on display information of the application, so as to output audio data corresponding to the information displayed on the application on the speaker device.
[0008] An embodiment of the present application also discloses a data processing device, which is applied to a speaker device, and the device includes: a connection module, which is used to establish a connection with the mobile terminal; an instruction sending module, which is used to send a first instruction to the mobile terminal, and the mobile terminal has an application corresponding to the speaker device; an interactive output module, which is used to output audio data corresponding to the information displayed on the application on the speaker device through data interaction with the mobile terminal.
[0009] An embodiment of the present application also discloses a data processing device, which is applied to a mobile terminal, and the device includes: a connection establishment module, which is used to establish a connection with a speaker device; an instruction receiving module, which is used to receive a first instruction from the speaker device and run an application corresponding to the speaker device according to the first instruction; and an interactive display module, which is used to interact with the speaker device based on the display information of the application, so as to output audio data corresponding to the display information on the application on the speaker device.
[0010] The embodiments of the present application also disclose a speaker device, including: a processor; and a memory, on which executable code is stored. When the executable code is executed, the processor executes the data processing method as described in one or more of the embodiments of the present application.
[0011] The embodiments of the present application also disclose one or more machine-readable media on which executable codes are stored. When the executable codes are executed, the processor executes the data processing method as described in one or more of the embodiments of the present application.
[0012] An embodiment of the present application also discloses an electronic device, including: a processor; and a memory, on which executable code is stored. When the executable code is executed, the processor executes the data processing method as described in one or more of the embodiments of the present application.
[0013] The embodiments of the present application also disclose one or more machine-readable media on which executable codes are stored. When the executable codes are executed, the processor executes the data processing method as described in one or more of the embodiments of the present application.
[0014] An embodiment of the present application also discloses a data processing method, which is applied to a first smart device that does not have a screen. The method includes: establishing a connection with a second smart device, the second smart device has a screen; the first smart device outputs audio data; and outputs display information corresponding to the audio data through the screen of the second smart device.
[0015] An embodiment of the present application also discloses a data processing device, which is applied to a first smart device that does not have a screen. The device includes: a device connection module, which is used to establish a connection with a second smart device, and the second smart device has a screen; an output module, which is used for the first smart device to output audio data; and output display information corresponding to the audio data through the screen of the second smart device.
[0016] An embodiment of the present application further discloses an electronic device, comprising: a processor; and a memory, on which executable code is stored. When the executable code is executed, the processor executes the data processing method described in the embodiment of the present application.
[0017] The embodiments of the present application also disclose one or more machine-readable media on which executable codes are stored. When the executable codes are executed, the processor executes the data processing method as described in the embodiments of the present application.
[0018] Compared with the prior art, the embodiments of the present application have the following advantages:
[0019] In an embodiment of the present application, the speaker device can establish a connection with the mobile terminal so that the speaker device and the mobile terminal can be easily connected. The speaker device can then send a first instruction to the mobile terminal, and can run an application corresponding to the speaker device in the mobile terminal, so that the mobile terminal can serve as a display of the speaker device. Through data interaction with the mobile terminal, the display information of the application and the audio data output by the speaker device respond to each other. While providing the user with high-quality sound effects, the speaker device can also display the required information to the user through the connected mobile terminal. BRIEF DESCRIPTION OF THE DRAWINGS
[0020] Figure 1 is a schematic diagram of a data processing system in an embodiment of the present application;
[0021] Figure 2 This is a flow chart of steps on the speaker device side of a data processing method embodiment of the present application;
[0022] Figure 3 This is a flowchart of the steps on the mobile terminal side of a data processing method embodiment of the present application;
[0023] Figure 4 is an interactive schematic diagram of a data processing method in an embodiment of the present application;
[0024] Figure 5 is an interactive schematic diagram of another data processing method of an embodiment of the present application;
[0025] Figure 6 is an interactive schematic diagram of another data processing method in an embodiment of the present application;
[0026] Figure 7 is an interactive schematic diagram of a wireless charging method according to an embodiment of the present application;
[0027] Figure 8 is an interactive schematic diagram of yet another data processing method of an embodiment of the present application;
[0028] Fig. 9is a structural block diagram of an embodiment of a data processing device of the present application;
[0029] Fig.10 is a structural block diagram of an optional embodiment of a data processing device of the present application;
[0030] Fig.11 is a structural block diagram of another data processing device embodiment of the present application;
[0031] Fig.12 is a structural block diagram of another optional embodiment of a data processing device of the present application;
[0032] Fig.13 is a structural block diagram of another data processing device embodiment of the present application;
[0033] Fig.14 It is a schematic diagram of the structure of a device provided in one embodiment of the present application. DETAILED DESCRIPTION
[0034] In order to make the above-mentioned objects, features and advantages of the present application more obvious and easy to understand, the present application is further described in detail below in conjunction with the accompanying drawings and specific implementation methods.
[0035] In the embodiment of the present application, the speaker device is an upgraded product of the speaker, and can also be called a smart speaker. In addition to the common audio output components such as power amplifiers and speakers in the speaker, the speaker device can also include audio input components such as microphones and wireless network modules. The wireless network module can include Internet access modules such as wifi chips, Bluetooth modules such as Bluetooth chips, etc., and can also be modules related to other wireless connection technologies. Therefore, in addition to providing basic audio output functions, the speaker device can also be used as a tool for voice Internet access, such as ordering songs, shopping online, or understanding weather forecasts. In addition, it can also be used as an Internet of Things device for intelligent control of the home and control of various home appliances. Mobile terminals refer to computer devices that can be used on the move, such as mobile phones, tablet computers, etc.
[0036] Reference Figure 1 , showing a schematic diagram of a data processing system in an embodiment of the present application.
[0037] The data processing system includes a speaker device 10 and a mobile terminal 20, wherein the speaker device 10 may include sensors, such as pressure sensors, so that the speaker device can sense contact with the mobile terminal, so that when the mobile terminal is placed on the speaker device, the speaker device and the mobile terminal are interconnected. For example, an infrared sensor allows the speaker device to sense the approach of the mobile terminal and automatically connect to the mobile terminal.
[0038] An application corresponding to the mobile terminal can be installed in the mobile terminal, so that when the speaker device is connected to the mobile terminal, the speaker device can interact with the application of the mobile terminal. The application serves as a display component such as the face or display of the speaker device, and correspondingly, the speaker device serves as an audio input / output component of the mobile terminal to achieve interaction between audio and display.
[0039] Reference Figure 2 , shows a step flow chart of the speaker device side of a data processing method embodiment of the present application.
[0040] Step 202: Establish a connection with the mobile terminal.
[0041] The speaker device is provided with a sensor that can detect the contact, proximity, etc. between the speaker device and other devices. Therefore, when a mobile terminal is placed on the speaker, the speaker device can sense the contact of the mobile terminal based on the sensor, and the speaker device establishes a connection with the mobile terminal.
[0042] In the embodiment of the present application, the mobile terminal and the speaker device can be connected wirelessly using a variety of wireless technologies, such as Bluetooth technology, Near Field Communication (NFC) technology, WiFi technology, etc. In one example, when the speaker device senses that the mobile terminal is in contact, it can send a connection instruction to the mobile terminal, so that the mobile terminal and the speaker device are connected.
[0043] Step 204: Send a first instruction to the mobile terminal, which has an application corresponding to the speaker device.
[0044] After the speaker device and the mobile terminal are connected, the speaker device may generate a first instruction, and if the mobile terminal has an application corresponding to the speaker device, the mobile terminal may run the application corresponding to the speaker device based on the first instruction. The first instruction is used to indicate that the mobile terminal is successfully connected to the speaker device.
[0045] After receiving the first instruction, the mobile terminal can determine the application corresponding to the speaker device based on the first instruction, such as the application identifier of the application included in the first instruction, and the device identifier of the speaker device, the connection success identifier and other identification information. Then the mobile terminal can query the application identifier of the matching application based on the identification information, etc. After determining the application, it can be determined whether the application is already running. If the application is not running on the mobile terminal, the application can be run. After the application is run, a prompt message of successful connection can be displayed on the application corresponding to the speaker device, notifying the user that the application and the speaker device are connected and can perform interaction. Therefore, the prompt message of successful connection can be displayed on both the speaker device and the mobile terminal, which is convenient for the user to perform subsequent operations.
[0046] Step 206: Outputting audio data corresponding to the information displayed on the application on the speaker device through data interaction with the mobile terminal.
[0047] After the application is started in the mobile terminal, the speaker device and the application can be interconnected or connected to the server on the network side. The speaker device and the application can log in to the same user account or log in to a matching account. The speaker device and the mobile terminal can interact with each other. For the message at one end, the other end can match the response. Thus, the speaker device acts as an audio input / output end to provide audio input and output, and the mobile terminal acts as a display end in combination with the application to provide display information.
[0048] In the embodiment of the present application, the speaker device and the mobile terminal can interact with each other, and the display information of the application and the audio data of the speaker device respond to each other, so that the audio data corresponding to the display information on the application is output on the speaker device, and the display information corresponding to the audio data is displayed on the application level. For example, the speaker device outputs weather-related audio data, and the application can display the corresponding weather forecast page; for another example, the application can determine the corresponding expression based on the audio data output by the speaker device and display it, providing chat interaction for users.
[0049] The user can indicate the required service by speaking, so that the speaker device and the mobile terminal can respectively output corresponding response messages to provide the required service to the user. Therefore, in an optional embodiment of the present application, voice data can also be received, and a corresponding second instruction can be determined based on the voice data; the second instruction is sent to the mobile terminal so that the application executes the operation corresponding to the second instruction.
[0050] In one example, the speaker device can receive voice data, and then the speaker device can recognize and process the voice data, analyze the recognition result of the recognition process, determine the second instruction corresponding to the required service, and then send the second instruction to the server or mobile terminal for processing. In some other examples, the speaker device can send voice data to the mobile terminal, and then the application of the mobile terminal recognizes and processes the received voice data, analyzes it according to the recognition result, determines the second instruction corresponding to the required service, and then sends the second instruction to the server for processing. The application of the server or mobile terminal can perform corresponding processing based on the second instruction, such as searching for information, determining output information, etc., so as to determine the display information output on the application, and the audio data output corresponding to the speaker device, wherein the display information corresponds to the audio data. In some other examples, after the speaker device transmits the second instruction to the application, the application can also determine the display information and audio data corresponding to the second instruction, thereby outputting the display information based on the application, and feeding back the audio data to the speaker device for output.
[0051] In the embodiment of the present application, the second instruction includes at least one of the following: a charging instruction, a query instruction, and an interaction instruction. The charging instruction refers to an instruction for instructing charging; the query instruction refers to an instruction for instructing query; and the interaction instruction refers to an instruction for instructing to perform interaction.
[0052] Based on the query instruction, query services can be provided to users, wherein the query includes query of various service information in the network, such as query services for entertainment content such as music, crosstalk, talk show, story, novel, commentary, opera, etc., query services for news content such as current affairs news, financial information, etc., and query services such as weather, time, train, flight, etc. The query instruction of the above query service can be determined based on the recognition of the received voice data by the speaker device, such as being obtained by analysis based on the wake-up word + query content. The wake-up word can be set according to the demand, such as "check" or "query", or it can be the name of the speaker or the name of the application, etc. The query content is the specific content to be queried. The query instruction can be sent directly by the speaker device to the server or application, or it can be forwarded to the server after the application receives and determines that it cannot process it. At the server end, the speaker device and the application can be bound based on the account, so that the response message corresponding to the query instruction can be synchronously fed back to the speaker device and the application, or the server feeds back to the application, and then the application feeds back to the speaker device. The embodiment of the present application does not limit this. Among them, for the response message of the feedback query, the audio part can be decoded and output by the speaker device, and the other parts can be synchronously displayed and output in the application program interface of the terminal device, such as the interface displaying the story, the album cover of the music or the music video (Music Video, MV), the text part of the news content such as current affairs, financial information, etc., which can be determined according to the specific needs and actual business.
[0053] For interactive instructions, the speaker device can be sent to the server, or the speaker device can be sent to the application. The application processes it by itself or sends it to the server for processing to obtain the corresponding interactive response message. For example, one interactive mode is chat interaction. The user can speak arbitrarily to interact with the speaker device. The speaker device determines the corresponding semantic information based on voice processing, and finds the reply content corresponding to the semantic information, and then returns it to the speaker device for voice output. Among them, the reply content matching the chat can display the corresponding display information in the interface of the application, such as the display information includes expression information, and the expression information refers to the display information expressing emotions, such as smiling faces, crying faces, angry expressions, etc., so that the user can get corresponding emotional feedback, as if chatting with people. In some other examples, interactive instructions can also interact with the corresponding functions of the mobile terminal based on the application, such as making calls, reading and writing text messages, checking time, setting schedules, etc., for the convenience of user use.
[0054] In the embodiment of the present application, in order to facilitate the use of the user, a wireless charging coil can also be built into the speaker device, so that the speaker device also has a wireless charging function, and the mobile terminal is charged through the built-in wireless charging coil. In one example, the speaker device can automatically charge the mobile terminal after contacting and successfully connecting with the mobile terminal. In another example, the user can say instructions such as charging the mobile phone, so that the speaker device can obtain charging instructions based on voice recognition analysis, and then start the charging function of the speaker device to charge the mobile device placed on it. Among them, wireless charging can be based on electromagnetic induction, and charging without data cable connection can be achieved by converting magnetic fields and electrical energy. Therefore, the mobile terminal and the speaker device are connected and can not only respond and interact with each other, but also charge wirelessly.
[0055] Based on the above embodiments, corresponding to the embodiments on the speaker device side, the mobile terminal side can adopt the following steps to implement:
[0056] Reference Figure 3 , showing a step flow chart of a data processing method embodiment of the present application on the mobile terminal side.
[0057] Step 302, establish a connection with the speaker device. The connection may be established based on contact, proximity, etc. with the speaker device. After the user places the mobile terminal on the speaker device, the speaker device may connect to the mobile terminal through a predetermined wireless communication method when the contact is detected.
[0058] Step 304, receiving a first instruction, and running the application corresponding to the speaker device according to the first instruction. After the speaker device and the mobile terminal are connected, the speaker device can generate a first instruction, and the first instruction is used to indicate that the mobile terminal is successfully connected to the speaker device. After receiving the first instruction, the mobile terminal determines the application corresponding to the speaker device according to the first instruction; then determines whether the application corresponding to the speaker device is already running in the mobile terminal; if the application corresponding to the speaker device is not running, runs the application corresponding to the speaker device; after the application corresponding to the speaker device is successfully run, a prompt message of successful connection can be displayed on the application corresponding to the speaker device. Thereafter, the mobile terminal can be used as a display of the speaker device to display information.
[0059] Step 306: perform data interaction with the speaker device according to the display information of the application program, so as to output audio data corresponding to the display information of the application program on the speaker device.
[0060] After the application corresponding to the speaker device is run in the mobile terminal, the speaker device and the application can be interconnected and exchange data, and can also be connected to the server on the network side. Among them, the speaker device and the application can log in to the same user's account, or log in to a matching account, so that for the message on one end, the other end can match the response, and the speaker device is used as an audio input / output end to provide audio input and output. The mobile terminal is combined with the application as a display end to provide display information.
[0061] After the speaker device and the mobile terminal are connected, data interaction can be performed. For the display information on the application, the corresponding audio data to be output can be determined, and the audio data can be output on the speaker device. For the second instruction obtained by the voice data on the speaker device, the corresponding display information can also be displayed on the application of the mobile terminal. In an optional embodiment, a second instruction is received, and the operation corresponding to the second instruction is performed by the application, wherein the second instruction is determined based on the voice data received by the speaker device. After receiving the second instruction sent by the speaker device, the corresponding processing operation can be performed based on the second instruction, such as search query, play audition program, etc., so that the display information and audio data corresponding to the second instruction can be determined, or the instruction can be sent to the server to perform the processing operation corresponding to the second instruction to obtain the corresponding display information and audio data. Then the display information can be displayed in the interface of the application, and the corresponding audio data can be output on the speaker device. Among them, the audio data determined according to the second instruction can be fed back to the speaker device by the server or the application, and the audio data also corresponds to the display information displayed in the application, so that the display content of the application and the audio output on the speaker device correspond to each other.
[0062] In an embodiment of the present application, the speaker device also provides a wireless charging function, so that after the speaker device and the mobile terminal are connected, the signal of the speaker device can be received to perform wireless charging based on the wireless charging coil built into the speaker device.
[0063] The interactive response process between the mobile terminal and the speaker device and the wireless charging process are similar to those in the above embodiment, so they will not be repeated here.
[0064] Based on the above embodiments, the embodiments of the present application provide a data processing method. After the mobile terminal and the speaker device are connected and interconnected, the mobile terminal and the speaker device can be bound on the server side, so that they respond to each other for display and audio input / output. In this example, the speaker device directly interacts with the server to obtain audio data.
[0065] Reference Figure 4 , showing an interactive schematic diagram of a data processing method of an embodiment of the present application.
[0066] Step 402: After the user places the mobile terminal on the speaker device, the speaker device and the mobile terminal are connected via a predetermined wireless communication method. If it is detected that the speaker device is in contact with the mobile terminal, a connection with the mobile terminal is established.
[0067] Step 404: the speaker device sends a first instruction to the mobile terminal, where the first instruction is used to indicate that the mobile terminal is successfully connected to the speaker device.
[0068] Step 406: The mobile terminal runs the application corresponding to the speaker device according to the first instruction.
[0069] The mobile terminal and the speaker device can perform data interaction, so that the display information output by the application program of the mobile terminal corresponds to the audio data output by the speaker device.
[0070] Step 408A: Play an audio prompt message indicating successful connection with the mobile terminal.
[0071] Step 408B: Display a prompt message indicating successful connection on the application corresponding to the speaker device.
[0072] Step 410, the user speaks the service he needs, the speaker device receives the corresponding voice data, and determines the corresponding second instruction through recognition and analysis, such as a query instruction, an interactive instruction, etc. For example, querying Beijing weather, telling jokes, listening to music, etc.
[0073] Step 412: The speaker device sends the second instruction to the server.
[0074] In step 414, the server determines the corresponding response information according to the second instruction, and the response information includes audio response information and display response information. In step 414A, the server returns audio data to the speaker device; in step 414B, the server returns display information to the terminal device. The server has recorded the binding relationship between the speaker device and the mobile terminal, so it can feed back the corresponding audio data to the speaker device and the corresponding display information to the mobile terminal. For example, the weather forecast page, the text content of the joke, and the album cover of the music are given to the mobile terminal, and the voice forecast data of the weather, the voice data of the joke, and the audio data of the music are given to the speaker device.
[0075] Step 416A: output the audio data in the speaker device, where the audio data corresponds to the information displayed in the application of the mobile terminal.
[0076] Step 416B: display the display information in the application of the mobile terminal, where the display information corresponds to the audio data in the speaker device.
[0077] Therefore, based on the interaction among the speaker device, the mobile terminal and the server, feedback of the required instructions can be achieved, and the corresponding display information can be displayed on the mobile terminal while the audio data is output in the speaker device, thereby achieving synchronous response of the display and audio output.
[0078] Based on the above embodiments, the embodiment of the present application provides a data processing method. After the mobile terminal and the speaker device are connected and interconnected, the mobile terminal and the speaker device can be bound on the server side, so that they respond to each other for display and audio input / output. In this example, the speaker device can obtain audio data through the mobile terminal and the server.
[0079] Reference Figure 5 , showing an interactive schematic diagram of another data processing method of an embodiment of the present application.
[0080] Step 502: After the user places the mobile terminal on the speaker device, the speaker device and the mobile terminal are connected via an agreed wireless communication method.
[0081] Step 504: The speaker device sends a first instruction to the mobile terminal.
[0082] Step 506: The mobile terminal runs the application corresponding to the speaker device according to the first instruction.
[0083] The mobile terminal and the speaker device can perform data interaction, so that the display information output by the application program of the mobile terminal corresponds to the audio data output by the speaker device.
[0084] Step 508A: Play an audio prompt message indicating successful connection with the mobile terminal.
[0085] Step 508B: Display a prompt message indicating successful connection on the application corresponding to the speaker device.
[0086] Step 510: The user speaks out the service he needs, and the speaker device receives the corresponding voice data and determines the corresponding second instruction through recognition and analysis.
[0087] Step 512: The speaker device sends the second instruction to the mobile terminal.
[0088] In step 514, the application program of the mobile terminal may receive the second instruction and then forward it to the corresponding server.
[0089] Step 516, the server determines the corresponding response information according to the second instruction, and the response information includes audio response information and display response information, so as to be able to feed back the corresponding audio data to the speaker device and feed back the corresponding display information to the mobile terminal, such as the weather forecast page, the text content of the joke, and the album cover of the music to the mobile terminal, and the weather voice forecast data, the voice data of the joke, and the audio data of the music to the speaker device.
[0090] Step 518: The mobile terminal sends the audio data to the speaker device.
[0091] Step 520A: output the audio data in the speaker device, where the audio data corresponds to the information displayed in the application of the mobile terminal.
[0092] Step 520B: display the display information in the application of the mobile terminal, where the display information corresponds to the audio data in the speaker device.
[0093] Therefore, based on the interaction among the speaker device, the mobile terminal and the server, feedback of the required instructions can be achieved, and the corresponding display information can be displayed on the mobile terminal while the audio data is output in the speaker device, thereby achieving synchronous response of the display and audio output.
[0094] On the basis of the above-mentioned embodiments, the embodiments of the present application provide a data processing method. After the mobile terminal and the speaker device are in contact and interconnected, the mobile terminal and the speaker device can respond to each other to perform display and audio input / output.
[0095] Reference Figure 6 , showing an interactive schematic diagram of yet another data processing method of an embodiment of the present application.
[0096] Step 602: After the user places the mobile terminal on the speaker device, the speaker device and the mobile terminal are connected via an agreed wireless communication method.
[0097] Step 604: The speaker device sends a first instruction to the mobile terminal.
[0098] Step 606: The mobile terminal runs the application corresponding to the speaker device according to the first instruction.
[0099] The mobile terminal and the speaker device can perform data interaction, so that the display information output by the application program of the mobile terminal corresponds to the audio data output by the speaker device.
[0100] Step 608A: Play an audio prompt message indicating successful connection with the mobile terminal.
[0101] Step 608B: Display a prompt message indicating successful connection on the application corresponding to the speaker device.
[0102] Step 610: The user speaks out the service he needs, and the speaker device receives the corresponding voice data and determines the corresponding second instruction through recognition and analysis.
[0103] Step 612: The speaker device sends the second instruction to the mobile terminal.
[0104] Step 614: The application of the mobile terminal may determine corresponding response information based on the second instruction, where the response information includes audio data and display information.
[0105] Step 616: The mobile terminal sends the audio data to the speaker device.
[0106] Step 618A: output the audio data in the speaker device, where the audio data corresponds to the information displayed in the application of the mobile terminal.
[0107] Step 618B: display the display information in the application of the mobile terminal, where the display information corresponds to the audio data in the speaker device.
[0108] Therefore, based on the interaction between the speaker device and the mobile terminal, feedback on the required instructions can be achieved, and the required services can be provided to the user based on the mobile terminal, such as time reminders, schedule equipment, etc., and the corresponding display information can be displayed on the mobile terminal while outputting audio data in the speaker device, thereby achieving synchronous response of display and audio output.
[0109] On the basis of the above-mentioned embodiments, the embodiments of the present application provide a wireless charging method. After the mobile terminal and the speaker device are in contact and interconnected, the mobile terminal and the speaker device can respond to each other to perform display and audio input / output.
[0110] Reference Figure 7 , showing an interactive schematic diagram of a wireless charging method in an embodiment of the present application.
[0111] Step 702: After the user places the mobile terminal on the speaker device, the speaker device and the mobile terminal are connected via a predetermined wireless communication method. The speaker device then sends a first instruction to the mobile terminal, and the mobile terminal runs an application corresponding to the speaker device according to the first instruction.
[0112] Step 704, when the user wants to charge the mobile terminal, he can directly say "charge XX" and the like, and the speaker device receives the corresponding voice data and determines that it corresponds to a charging instruction through recognition and analysis.
[0113] In step 706, the speaker device may start the wireless charging function based on the charging instruction, thereby charging the mobile terminal through the built-in wireless charging coil.
[0114] Thereby, the mobile terminal can be charged conveniently, and the mobile terminal can display the charging power information while responding to the display information of the speaker device.
[0115] On the basis of the above embodiments, the embodiments of the present application can also be applied to the connection and interaction between various devices without screens and devices with screens. Among them, the first smart device can be a device without a screen, for example, the first smart device is a speaker device, a voice recorder, a smart bracelet and other wearable devices without a screen, etc.; the second smart device can be a device with a screen, such as the second smart device is a mobile device such as a mobile phone, a tablet computer, a wearable device with a screen such as a smart watch, etc. The smart devices in the embodiments of the present application include devices that can provide one or more functions such as voice recognition, interaction, and Internet access.
[0116] Reference Figure 8 , shows an interactive schematic diagram of yet another data processing method of an embodiment of the present application.
[0117] Step 802: Establish a connection with a second smart device, where the second smart device has a screen.
[0118] The first smart device may have a pressure sensor, an infrared sensor, etc., so as to detect that the connection conditions such as contact and proximity between the first smart device and the second smart device are met, and then the first smart device establishes a connection with the second smart device. The connection between the two smart devices can be achieved by wireless connection using a variety of wireless technologies, such as Bluetooth technology, NFC technology, WiFi technology, etc.
[0119] In some optional embodiments, after the connection is successful, the first smart device may also send a first instruction to the second smart device to notify the connection is successful. After receiving the first instruction, the second smart device may determine the application corresponding to the first smart device based on the first instruction, such as the application identifier of the application included in the first instruction, and the device identifier of the first smart device, the connection success identifier and other identification information. Then, the second smart device may query the application identifier of the matching application based on the identification information, and after determining the application, it may determine whether the application is already running. If the application is not running on the second smart device, the application may be run.
[0120] Step 804: the first smart device outputs audio data.
[0121] Step 806: output display information corresponding to the audio data through the screen of the second smart device.
[0122] After the connection between the first smart device and the second smart device is successfully established, the first smart device can output audio data, and correspondingly, display information corresponding to the audio data can be synchronously output through the screen of the second smart device.
[0123] In an optional embodiment, after the first smart device and the second smart device are successfully connected and the application corresponding to the first smart device is running in the second smart device, the first smart device can output a voice prompt message indicating a successful connection, and the second smart device can display a prompt message indicating a successful connection on the application corresponding to the first smart device, informing the user that the application has been connected to the first smart device and can perform interaction. Thus, prompt messages indicating a successful connection can be output on both the first smart device and the second smart device, facilitating the user to perform subsequent operations.
[0124] In some other optional embodiments, the first smart device can receive voice data, and can determine the corresponding second instruction by recognizing and processing the voice data, and then can send the second instruction to determine the voice data and display information corresponding to the second instruction, so that the first smart device can output audio data, and accordingly, the display information corresponding to the audio data can be synchronously output through the screen of the second smart device. In some other optional embodiments, while the display information is output through the screen of the second smart device, the audio data corresponding to the display information can also be synchronously output on the first smart device.
[0125] In the embodiment of the present application, the first smart device and the second smart device can also be connected to the server on the network side. The first smart device and the second smart device can log in to the same user's account, or log in to matching accounts, and the first smart device and the second smart device can interact with each other. For the message at one end, the other end can match the response, so that the first smart device acts as an audio input / output end to provide audio input and output, and the second smart device acts as a display end in combination with the application to provide display information.
[0126] In the embodiment of the present application, the first smart device and the second smart device can interact with each other, and the display information of the second smart device and the audio data of the first smart device respond to each other, so that the audio data corresponding to the display information on the second smart device is output on the first smart device, and the display information corresponding to the audio data is displayed at the application level. For example, the first smart device outputs weather-related audio data, and the second smart device can display the corresponding weather forecast page; for another example, the second smart device can determine the corresponding expression based on the audio data output by the first smart device and display it, providing chat interaction for the user, etc.
[0127] The user can indicate the required service by speaking, so that the first smart device and the second smart device can respectively output corresponding response messages to provide the required service to the user. Therefore, in an optional embodiment of the present application, voice data can also be received, and the corresponding second instruction can be determined according to the voice data; the second instruction is sent to the second smart device, so that the second smart device executes the operation corresponding to the second instruction.
[0128] In one example, the first smart device can receive voice data, and then the first smart device can recognize and process the voice data, analyze the recognition result of the recognition process, determine the second instruction corresponding to the required service, and then send the second instruction to the server or the second smart device for processing. In some other examples, the first smart device can send voice data to the second smart device, and then the second smart device can recognize and process the received voice data, analyze it according to the recognition result, determine the second instruction corresponding to the required service, and then send the second instruction to the server for processing. The server or the second smart device can perform corresponding processing based on the second instruction, such as searching for information, determining output information, etc., so as to determine the display information output on the second smart device and the audio data output corresponding to the first smart device, wherein the display information corresponds to the audio data. In some other examples, after the first smart device transmits the second instruction to the second smart device, the second smart device can also determine the display information and audio data corresponding to the second instruction, so as to output the display information based on the second smart device, and feed back the audio data to the first smart device for output.
[0129] In the embodiment of the present application, the second instruction includes at least one of the following: a charging instruction, a query instruction, and an interaction instruction. The charging instruction refers to an instruction for instructing charging; the query instruction refers to an instruction for instructing query; and the interaction instruction refers to an instruction for instructing to perform interaction.
[0130] Based on the query instruction, query services can be provided to users, wherein the query includes querying various service information in the network, such as query services for entertainment content such as music, crosstalk, talk show, story, novel, commentary, opera, etc., query services for news content such as current affairs news, financial information, etc., and query services such as weather, time, train, flight, etc. The query instruction of the above query service can be determined based on the recognition of the received voice data by the first smart device, such as being obtained by analysis based on the wake-up word + query content. The wake-up word can be set according to the needs, such as "check" or "query", or it can be the name of the speaker or the name of the second smart device, etc. The query content is the specific content to be queried. The query instruction can be sent directly by the first smart device to the server or the second smart device, or it can be forwarded to the server after the second smart device receives and determines that it cannot process it. At the server end, the first smart device and the second smart device can be bound based on the account, so that the response message corresponding to the query instruction can be synchronously fed back to the first smart device and the second smart device, or the server end feeds back to the second smart device, and then the second smart device feeds back to the first smart device. The embodiment of the present application does not limit this. Among them, for the response message of the feedback query, the audio part can be decoded and output by the first smart device, and the other parts can be synchronously displayed and output in the second smart device interface of the terminal device, such as an interface displaying a story, displaying the album cover or music video (Music Video, MV) of music, the text part of news content such as current affairs, financial information, etc., which can be determined according to needs and actual business.
[0131] The interactive instruction can be sent from the first smart device to the server, or from the first smart device to the second smart device, and the second smart device processes it by itself or sends it to the server for processing to obtain the corresponding interactive response message. For example, one interactive mode is chat interaction, and the user can speak arbitrarily to interact with the first smart device. The first smart device determines the corresponding semantic information based on voice processing, and finds the reply content corresponding to the semantic information, and then returns it to the first smart device for voice output. The reply content matching the chat can display the corresponding display information in the interface of the second smart device, such as the display information includes expression information, and the expression information refers to the display information expressing emotions, such as smiling faces, crying faces, angry expressions, etc., so that the user can get corresponding emotional feedback, as if chatting with people. In some other examples, the interactive instruction can also be based on the second smart device to interact with the corresponding functions, such as making calls, reading and writing text messages, checking time, setting schedules, etc., for the convenience of user use.
[0132] In the embodiment of the present application, in order to facilitate the use of the user, a wireless charging coil can be built into the first smart device, so that the first smart device also has a wireless charging function, and the second smart device can be charged through the built-in wireless charging coil. In one example, the first smart device can automatically charge the second smart device after contacting and successfully connecting with the second smart device. In another example, the user can say instructions such as charging the mobile phone, so that the first smart device can obtain the charging instruction based on voice recognition analysis, and then start the charging function of the first smart device to charge the mobile device placed on it. Among them, wireless charging can be based on electromagnetic induction, and charging without data cable connection can be achieved by converting magnetic fields and electrical energy. Therefore, the second smart device and the first smart device are connected not only to respond and interact with each other, but also to charge wirelessly.
[0133] It should be noted that, for the method embodiments, for the sake of simplicity, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the embodiments of the present application are not limited by the described order of actions, because according to the embodiments of the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present application.
[0134] On the basis of the above embodiments, this embodiment further provides a data processing device, which is applied to a speaker device.
[0135] Reference Fig. 9 , shows a structural block diagram of a data processing device embodiment of the present application, which may specifically include the following modules:
[0136] The connection module 902 is used to establish a connection with the mobile terminal.
[0137] The instruction sending module 904 is used to send a first instruction to the mobile terminal, and the mobile terminal has an application corresponding to the speaker device.
[0138] The interactive output module 906 is used to output the audio data corresponding to the information displayed on the application on the speaker device through data interaction with the mobile terminal.
[0139] In summary, the speaker device can establish a connection with the mobile terminal, so that the speaker device and the mobile terminal can be easily connected. Then the speaker device can send a first instruction to the mobile terminal, and can run an application corresponding to the speaker device in the mobile terminal, so that the mobile terminal can serve as a display of the speaker device. Through data interaction with the mobile terminal, the display information of the application and the audio data output by the speaker device respond to each other. While providing the user with high-quality sound effects, the speaker device can also display the required information to the user through the connected mobile terminal.
[0140] Reference Fig.10 , shows a structural block diagram of an optional embodiment of a data processing device of the present application, which may specifically include the following modules:
[0141] The connection module 902 is used to establish a connection with the mobile terminal.
[0142] The instruction sending module 904 is used to send a first instruction to the mobile terminal, which has an application corresponding to the speaker device. The first instruction is used to indicate that the mobile terminal is successfully connected to the speaker device.
[0143] The interactive output module 906 is used to output the audio data corresponding to the information displayed on the application on the speaker device through data interaction with the mobile terminal.
[0144] The wireless charging module 908 is used to charge the mobile terminal via a built-in wireless charging coil.
[0145] The voice instruction module 910 is used to receive voice data and determine the corresponding second instruction according to the voice data. The instruction sending module 904 is used to send the second instruction to the mobile terminal so that the application program executes the operation corresponding to the second instruction.
[0146] The second instruction includes at least one of the following: a charging instruction, a query instruction, and an interaction instruction. The display information includes expression information.
[0147] The connection module 902 is used to detect that the speaker device is in contact with the mobile terminal and establish a connection with the mobile terminal.
[0148] The interactive output module 906 is further configured to play an audio prompt message indicating successful connection with the mobile terminal.
[0149] On the basis of the above embodiments, this embodiment further provides a data processing device, which is applied to mobile terminals such as mobile phones and tablet computers.
[0150] Reference Fig.11, shows a structural block diagram of another data processing device embodiment of the present application, which may specifically include the following modules:
[0151] The connection establishing module 1102 is used to establish a connection with a speaker device.
[0152] The instruction receiving module 1104 is used to receive a first instruction from the speaker device, and run an application corresponding to the speaker device according to the first instruction.
[0153] The interactive display module 1106 is used to perform data interaction with the speaker device according to the display information of the application program, so as to output audio data corresponding to the display information of the application program on the speaker device.
[0154] In summary, the speaker device can establish a connection with the mobile terminal, so that the speaker device and the mobile terminal can be easily connected. Then the mobile terminal can receive the first instruction of the speaker device, and can start the application corresponding to the speaker device in the mobile terminal, so that the mobile terminal can serve as a display of the speaker device. Through the interactive data between the speaker device and the mobile terminal, the display information of the application and the audio data output by the speaker device respond to each other. While providing the user with high-quality sound effects, the speaker device can also display the required information to the user through the connected mobile terminal.
[0155] Reference Fig.12 , shows a structural block diagram of another optional embodiment of a data processing device of the present application, which may specifically include the following modules:
[0156] The connection establishing module 1102 is used to establish a connection with a speaker device.
[0157] The instruction receiving module 1104 is used to receive a first instruction from the speaker device and run an application corresponding to the speaker device according to the first instruction. The first instruction is used to indicate that the mobile terminal is successfully connected to the speaker device.
[0158] The response display module 1106 is used to perform data interaction with the speaker device according to the display information of the application program, so as to output the audio data corresponding to the display information of the application program on the speaker device.
[0159] The charging module 1108 is used to receive the signal from the speaker device for wireless charging, wherein the speaker device has a built-in wireless charging coil.
[0160] The instruction receiving module 1104 is further used to receive a second instruction and execute an operation corresponding to the second instruction through the application program, wherein the second instruction is determined based on the voice data received by the speaker device.
[0161] The second instruction includes at least one of the following: a charging instruction, a query instruction, and an interaction instruction. The display information includes expression information.
[0162] The connection establishing module 1102 is used to detect that the mobile terminal is in contact with the speaker device and establish a connection with the speaker device.
[0163] The instruction receiving module 1104 is used to determine the application corresponding to the speaker device according to the first instruction; if the application corresponding to the speaker device is not running, run the application corresponding to the speaker device; and display a prompt message of successful connection on the application corresponding to the speaker device.
[0164] The display information includes expression information, and the expression information corresponds to the audio data of the speaker device.
[0165] In the embodiment of the present application, after the mobile terminal and the speaker device are connected and interconnected, the mobile terminal and the speaker device can be bound on the server side, so that they can respond to each other for display and audio input / output. The speaker device directly interacts with the server to obtain audio data, or the speaker device can interact with the server to obtain audio data through the mobile terminal.
[0166] Based on the interaction between the speaker device, mobile terminal and server, feedback of the required instructions is realized, and the corresponding display information can be displayed on the mobile terminal while the audio data is output in the speaker device, realizing synchronous response of display and audio output. It is also possible to provide users with the required services based on the mobile terminal, such as time reminders, schedule devices, etc., and the corresponding display information can be displayed on the mobile terminal while the audio data is output in the speaker device, realizing synchronous response of display and audio output.
[0167] It can also conveniently charge the mobile terminal, and the mobile terminal can display the charging power information while responding to the display information of the speaker device.
[0168] On the basis of the above embodiments, the embodiments of the present application further provide a data processing device, which is applied to a first smart device without a screen, such as a speaker device, a smart bracelet, etc.
[0169] Reference Fig.13 , shows a structural block diagram of another data processing device embodiment of the present application, which may specifically include the following modules:
[0170] The device connection module 1302 is used to establish a connection with a second smart device, where the second smart device has a screen.
[0171] The output module 1304 is used for the first smart device to output the audio data; and output display information corresponding to the audio data through the screen of the second smart device.
[0172] In an optional embodiment, the first smart device also has a built-in wireless charging coil, and the apparatus further includes: a coil charging module 1306, which is used to charge the second smart device through the built-in wireless charging coil.
[0173] The output module 1304 is further configured to receive voice data, determine a corresponding second instruction according to the voice data, and send the second instruction to the second smart device, so that the second smart device executes the operation corresponding to the second instruction. The second smart device can run an application corresponding to the first smart device and interact with the first smart device based on the application.
[0174] The second instruction includes at least one of the following: a charging instruction, a query instruction, and an interaction instruction. The display information includes expression information.
[0175] The device connection module 1302 is configured to detect that the first smart device is in contact with the second smart device and establish a connection with the mobile terminal.
[0176] The output module 1304 is further configured to play an audio prompt message indicating that the second smart device is successfully connected. Correspondingly, the second smart device may also display a prompt message indicating that the second smart device is successfully connected.
[0177] Based on the interconnection between the first smart device and the second smart device, the first smart device can be used as an audio input / output terminal to provide audio input and output, and the second smart device can be used as a display terminal in combination with an application to provide display information, thereby providing convenience for users.
[0178] The embodiment of the present application also provides a non-volatile readable storage medium, which stores one or more modules (programs). When the one or more modules are applied to a device, the device can execute instructions (instructions) of each method step in the embodiment of the present application.
[0179] The present application embodiment provides one or more machine-readable media on which instructions are stored, and when executed by one or more processors, an electronic device executes one or more of the methods described in the above embodiments. In the present application embodiment, the electronic device includes various types of devices such as terminal devices and server terminals (clusters).
[0180] The embodiments of the present disclosure may be implemented as a device that uses any appropriate hardware, firmware, software, or any combination thereof to perform desired configurations, and the device may include electronic devices such as terminal devices and server (cluster). Fig.14 An exemplary apparatus 1400 that can be used to implement various embodiments described in this application is schematically illustrated.
[0181] For one embodiment, Fig.14 An exemplary apparatus 1400 is shown having one or more processors 1402, a control module (chip set) 1404 coupled to at least one of the (one or more) processors 1402, a memory 1406 coupled to the control module 1404, a non-volatile memory (NVM) / storage device 1408 coupled to the control module 1404, one or more input / output devices 1410 coupled to the control module 1404, and a network interface 1412 coupled to the control module 1404.
[0182] The processor 1402 may include one or more single-core or multi-core processors, and the processor 1402 may include any combination of general-purpose processors or special-purpose processors (such as graphics processors, application processors, baseband processors, etc.). In some embodiments, the device 1400 can be used as a terminal device, a server (cluster), and other devices described in the embodiments of the present application.
[0183] In some embodiments, the device 1400 may include one or more computer-readable media (e.g., memory 1406 or NVM / storage device 1408) having instructions 1414 and one or more processors 1402 configured to execute the instructions 1414 in combination with the one or more computer-readable media to implement a module to perform the actions described in the present disclosure.
[0184] For one embodiment, the control module 1404 may include any suitable interface controller to provide any suitable interface to at least one of the processor(s) 1402 and / or any suitable device or component in communication with the control module 1404 .
[0185] The control module 1404 may include a memory controller module to provide an interface to the memory 1406. The memory controller module may be a hardware module, a software module, and / or a firmware module.
[0186] The memory 1406 may be used, for example, to load and store data and / or instructions 1414 for the device 1400. For one embodiment, the memory 1406 may include any suitable volatile memory, such as a suitable DRAM. In some embodiments, the memory 1406 may include double data rate type four synchronous dynamic random access memory (DDR4 SDRAM).
[0187] For one embodiment, control module 1404 may include one or more input / output controllers to provide an interface to NVM / storage device 1408 and input / output device(s) 1410 .
[0188] For example, NVM / storage 1408 may be used to store data and / or instructions 1414. NVM / storage 1408 may include any suitable non-volatile memory (e.g., flash memory) and / or may include any suitable non-volatile storage device(s) (e.g., one or more hard disk drives (HDDs), one or more compact disk (CD) drives, and / or one or more digital versatile disk (DVD) drives).
[0189] NVM / storage device 1408 may include storage resources that are physically part of the device on which apparatus 1400 is installed, or it may be accessible to the device without being part of the device. For example, NVM / storage device 1408 may be accessed via input / output device(s) 1410 over a network.
[0190] (One or more) input / output devices 1410 may provide an interface for the apparatus 1400 to communicate with any other appropriate device, and the input / output device 1410 may include a communication component, an audio component, a sensor component, etc. The network interface 1412 may provide an interface for the apparatus 1400 to communicate through one or more networks, and the apparatus 1400 may wirelessly communicate with one or more components of a wireless network according to any of one or more wireless network standards and / or protocols, for example, accessing a wireless network based on a communication standard, such as WiFi, 2G, 3G, 4G, 5G, etc., or a combination thereof for wireless communication.
[0191] For one embodiment, at least one of the processor(s) 1402 may be packaged together with the logic of one or more controllers (e.g., a memory controller module) of the control module 1404. For one embodiment, at least one of the processor(s) 1402 may be packaged together with the logic of one or more controllers of the control module 1404 to form a system-in-package (SiP). For one embodiment, at least one of the processor(s) 1402 may be integrated on the same die with the logic of one or more controllers of the control module 1404. For one embodiment, at least one of the processor(s) 1402 may be integrated on the same die with the logic of one or more controllers of the control module 1404 to form a system-on-chip (SoC).
[0192] In various embodiments, the device 1400 may be, but is not limited to, a terminal device such as a server, a desktop computing device, or a mobile computing device (e.g., a laptop computing device, a handheld computing device, a tablet computer, a netbook, etc.). In various embodiments, the device 1400 may have more or fewer components and / or different architectures. For example, in some embodiments, the device 1400 includes one or more cameras, a keyboard, a liquid crystal display (LCD) screen (including a touch screen display), a non-volatile memory port, multiple antennas, a graphics chip, an application-specific integrated circuit (ASIC), and a speaker.
[0193] Among them, the main control chip can be used as a processor or control module in the detection device, sensor data, location information, etc. are stored in a memory or NVM / storage device, the sensor group can be used as an input / output device, and the communication interface may include a network interface.
[0194] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.
[0195] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.
[0196] The embodiments of the present application are described with reference to the flowcharts and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing terminal device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0197] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing terminal device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0198] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device so that a series of operating steps are executed on the computer or other programmable terminal device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable terminal device to implement the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.
[0199] Although the preferred embodiments of the present application have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present application.
[0200] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements.
[0201] The data processing method and device, a speaker device, an electronic device and a storage medium provided by the present application are introduced in detail above. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea; at the same time, for general technical personnel in this field, according to the idea of the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.
Claims
1. A data processing method, characterized in that: Applied to a speaker device, the speaker device includes a sensor, and the method includes: The sensor detects that the speaker device is in contact with the mobile terminal, and establishes a connection with the mobile terminal; Sending a first instruction to the mobile terminal, so as to run an application corresponding to the speaker device on the mobile terminal based on the first instruction; By interacting with the mobile terminal, audio data corresponding to the information displayed on the application is output on the speaker device.
2. The method according to claim 1, characterized in that Also includes: receiving voice data, and determining a corresponding second instruction according to the voice data; The second instruction is sent to the mobile terminal so that the application program executes the operation corresponding to the second instruction.
3. The method according to claim 1, characterized in that Also includes: The mobile terminal is charged via a built-in wireless charging coil.
4. The method according to claim 2, characterized in that: The second instruction includes at least one of the following: a charging instruction, a query instruction, and an interaction instruction.
5. The method according to claim 1, characterized in that The first instruction is used to indicate that the mobile terminal is successfully connected to the speaker device.
6. The method according to claim 5, characterized in that Also includes: Play an audio prompt message indicating successful connection with the mobile terminal.
7. A data processing method, characterized in that: Applied to a mobile terminal, the method comprises: Establishing a connection with a speaker device, wherein the speaker device includes a sensor, and the speaker device establishes a connection when the sensor detects contact with the mobile terminal; receiving a first instruction from the speaker device, and running an application corresponding to the speaker device according to the first instruction; According to the display information of the application, data interaction is performed with the speaker device, so that audio data corresponding to the display information on the application is output on the speaker device.
8. The method according to claim 7, characterized in that Also includes: A second instruction is received, and an operation corresponding to the second instruction is executed through the application program, wherein the second instruction is determined based on the voice data received by the speaker device.
9. The method according to claim 7, characterized in that: Also includes: The signal from the speaker device is received to perform wireless charging, wherein the speaker device has a built-in wireless charging coil.
10. The method according to claim 8, characterized in that The second instruction includes at least one of the following: a charging instruction, a query instruction, and an interaction instruction.
11. The method according to claim 7, characterized in that The first instruction is used to indicate that the mobile terminal is successfully connected to the speaker device.
12. The method according to claim 11, characterized in that The step of running the application corresponding to the speaker device according to the first instruction includes: Determining an application corresponding to the speaker device according to the first instruction; If the application corresponding to the speaker device is not running, running the application corresponding to the speaker device; A prompt message indicating successful connection is displayed on the application corresponding to the speaker device.
13. The method according to claim 7, characterized in that The display information includes expression information, and the expression information corresponds to the audio data of the speaker device.
14. A data processing device, characterized in that: Applied to a speaker device, the speaker device includes a sensor, and the device includes: A connection module, configured to detect that the speaker device is in contact with the mobile terminal through the sensor and establish a connection with the mobile terminal; An instruction sending module, used for sending a first instruction to the mobile terminal, so as to run an application corresponding to the speaker device on the mobile terminal based on the first instruction; The interactive output module is used to output the audio data corresponding to the information displayed on the application on the speaker device through data interaction with the mobile terminal.
15. A data processing device, characterized in that: Applied to a mobile terminal, the device comprises: A connection establishing module, used to establish a connection with a speaker device, wherein the speaker device includes a sensor, and the speaker device establishes a connection when the sensor detects contact with the mobile terminal; An instruction receiving module, used for receiving a first instruction of the speaker device, and running an application corresponding to the speaker device according to the first instruction; The interactive display module is used to perform data interaction with the speaker device according to the display information of the application program, so as to output audio data corresponding to the display information of the application program on the speaker device.
16. A speaker device, characterized in that: include: processor; and A memory having executable codes stored thereon, which, when executed, causes the processor to execute the data processing method as claimed in one or more of claims 1-6.
17. One or more machine-readable media having executable codes stored thereon, which, when executed, cause a processor to perform the data processing method according to one or more of claims 1-6.
18. An electronic device, characterized in that: include: processor; and A memory having executable codes stored thereon, which, when executed, causes the processor to execute the data processing method as described in one or more of claims 7-13.
19. One or more machine-readable media having executable codes stored thereon, which, when executed, cause a processor to perform the data processing method according to one or more of claims 7-13.
20. A data processing method, characterized in that: Applied to a first smart device without a screen, the first smart device includes a sensor, and the method includes: The sensor detects that the first smart device is in contact with the second smart device, and establishes a connection with the second smart device, wherein the second smart device has a screen; The first smart device outputs audio data; Display information corresponding to the audio data is output through the screen of the second smart device.
21. A data processing device, characterized in that: Applied to a first smart device without a screen, the first smart device includes a sensor, and the apparatus includes: a device connection module, configured to detect, through the sensor, that the first smart device is in contact with a second smart device, and establish a connection with the second smart device, wherein the second smart device has a screen; The output module is used for the first smart device to output audio data; and output display information corresponding to the audio data through the screen of the second smart device.
22. An electronic device, characterized in that: include: processor; and A memory having executable codes stored therein, which, when executed, causes the processor to execute the data processing method according to claim 20.
23. One or more machine-readable media having executable codes stored thereon, which, when executed, cause a processor to perform the data processing method according to claim 20.
Citation Information
Patent Citations
Method and device for controlling display
CN108320745A
Multi-directional wireless charging sound box
CN108449664A