Intelligent input method and device based on IPTV system

Abstract

The invention discloses an intelligent input method and device based on an IPTV system, and the method comprises the steps: collecting and receiving a remote control instruction inputted by a user, and the remote control instruction comprises a first remote control instruction and a second remote control instruction; wherein the first remote control instruction is voice, and the second remote control instruction is that a two-dimensional code identifier is triggered; the remote control instruction is judged, if the remote control instruction is a first remote control instruction, a key execution mode is started, in the key execution mode, voice data input by a user are recognized, the voice data are processed and stored, and the processing comprises the step of converting the voice data into text data; if the remote control instruction is a second remote control instruction, starting a two-dimensional code execution mode, identifying and reading two-dimensional code content in the two-dimensional code execution mode, and displaying the two-dimensional code content through text data; and responding to a remote control instruction input by a user. Through the two coexistence input modes of the scheme, the use experience feeling and the interaction feeling of different user groups are improved.

Description

Technical Field

[0001] The present invention relates to the field of input methods, and in particular to an intelligent input method and device based on an IPTV system. Background Art

[0002] With the maturity of IPTV technology, various IPTV applications have entered many households. People's personalized demand for interactive scenes is gradually increasing, and the requirements for interactive experience on the TV side are also getting higher and higher.

[0003] Although the existing IPTV remote controller has added many special buttons, it lacks a recording function and cannot be directly associated with the IPTV display screen through voice control of the remote controller, which reduces the efficiency of IPTV use for some special groups. This technical solution defines the intelligent input method technology for the user interaction link of the IPTV set-top box, which includes two technical features: one is the remote control voice input method, and the other is the mobile phone WeChat applet scan code input method. Through the above two coexisting input methods, the user experience and interaction of different user groups are improved. Summary of the invention

[0004] The main purpose of the present invention is to disclose an intelligent input method and device based on an IPTV system, which realizes the coexistence of two input modes and improves the user experience and interaction of different user groups.

[0005] In a first aspect, an intelligent input method based on an IPTV system is provided.

[0006] An intelligent input method based on an IPTV system according to the present invention comprises:

[0007] Collecting and receiving remote control instructions input by a user, wherein the remote control instructions include a first remote control instruction and a second remote control instruction; wherein the first remote control instruction is a voice, and the second remote control instruction is triggered by a two-dimensional code mark;

[0008] Determine the remote control command, if it is a first remote control command, start a key execution mode, in which voice data input by a user is recognized, and the voice data is processed and stored, wherein the processing includes converting the voice data into text data; if it is a second remote control command, start a QR code execution mode, in which QR code content is recognized and read, and the QR code content is displayed through text data;

[0009] Respond to remote control commands input by the user.

[0010] Preferably, the collection includes monitoring and judging the audio recording state, and when the audio recording is triggered to start, the first remote control instruction is collected, and the voice data is recorded and stored.

[0011] Preferably, after recording the voice data, the method further comprises: starting the audio recording countdown and displaying it on the IPTV page.

[0012] Preferably, after collecting the first remote control instruction, the method further includes: ending the recording, wherein the ending of the recording includes one or more of when the audio recording is in a closed state and when the audio recording countdown ends.

[0013] Preferably, the two-dimensional code logo is triggered including: requesting to generate and display the two-dimensional code logo on the IPTV page end, and the user triggering the two-dimensional code logo by scanning the code.

[0014] Preferably, the starting of the QR code execution mode further comprises: periodically receiving a query message of the QR code identifier, wherein the query message is used to query a current QR code identifier status, wherein the QR code identifier status includes not being scanned and being scanned.

[0015] Preferably, the code being scanned further includes: after the two-dimensional code identification status has been scanned, updating the two-dimensional code identification and resetting the two-dimensional code identification status on the IPTV page end.

[0016] Preferably, the QR code content includes one of text data and voice data.

[0017] Preferably, the responding to the remote control instruction input by the user further comprises: if the remote control instruction is the first remote control instruction and the second remote control instruction, responding to the first remote control instruction first.

[0018] In a second aspect, an intelligent input device based on an IPTV system is provided.

[0019] An intelligent input device based on an IPTV system according to the present invention comprises:

[0020] A collection and receiving unit, used for collecting and receiving remote control instructions input by a user, wherein the remote control instructions include a first remote control instruction and a second remote control instruction; wherein the first remote control instruction is a voice, and the second remote control instruction is triggered by a two-dimensional code mark;

[0021] an identification unit, configured to determine the remote control command, and if it is a first remote control command, start a key execution mode, in which voice data input by a user is identified, and the voice data is processed and stored, wherein the processing includes converting the voice data into text data; if it is a second remote control command, start a QR code execution mode, in which QR code content is identified and read, and the QR code content is displayed through text data;

[0022] The response unit is used to respond to the remote control command input by the user. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 is a flow chart of an intelligent input method based on an IPTV system according to an embodiment of the present invention;

[0024] Figure 2 It is a structural schematic diagram of an intelligent input device based on an IPTV system according to an embodiment of the present invention. DETAILED DESCRIPTION

[0025] In order to make the objectives, technical solutions and advantages of the embodiments of the present invention more clearly understood, the spirit of the contents disclosed by the present invention will be clearly explained with the accompanying drawings and detailed descriptions below. After understanding the embodiments of the contents of the present invention, any technician in the relevant technical field can change and modify the techniques taught by the contents of the present invention without departing from the spirit and scope of the contents of the present invention.

[0026] Figure 1 A flowchart of an implementation method of an intelligent input method based on an IPTV system provided by an embodiment of the present invention is shown in FIG. Figure 1 As shown, the method includes:

[0027] S1, collecting and receiving remote control instructions input by a user, wherein the remote control instructions include a first remote control instruction and a second remote control instruction; wherein the first remote control instruction is a voice, and the second remote control instruction is triggered by a two-dimensional code logo.

[0028] In this embodiment, the user has two remote control commands that can be input. The first remote control command is voice. In the specific implementation process, the first remote control command sent by the user can be received through Bluetooth technology or wireless network, such as finding an ordinary remote control with Bluetooth function, formulating a remote control customization plan, and adjusting the command for the keys or special keys (SEARCH keys) that cannot be used on the remote control, and changing them to recording commands. The key callback interface has onKeyDown and onKeyUp; onKeyDown indicates that the callback is triggered when the key is pressed, and onKeyUp indicates that the callback is triggered when the key is popped up. The second remote control command is that the QR code mark is triggered. Specifically, the TV end (client) requests the WeChat applet server (carrying user ID and channel number channelId), and the server generates Base64 format data of the applet QR code, and also returns the scene value scene. After receiving the data, the client decodes the base64 pixel, and then renders it on the IPTV page interface through the setImageBitmap method, and saves the scene value to the memory at the same time. When the user scans the code, the QR code mark is triggered.

[0029] When collecting the remote control commands input by the user, the collection includes monitoring and judging the audio recording status. In specific implementation, when the user presses a key, an onKeyDown event is received. First, it is determined whether it is the key of the event and whether it is the designated recording key. If so, a signal is sent through the voiceStart method to start recording. After receiving the notification to start recording, the system interface (ActivityCompat.checkSelfPermission) is called to determine whether there is permission to turn on the microphone. If not, the user is prompted and guided to manually authorize. If there is recording permission, the recording thread is started, and the thread is created through the system method Executors.newCachedThreadPool. When the audio recording is triggered, the first remote control command is collected, the voice data is recorded and stored. After recording the voice data, it also includes turning on the audio recording countdown and displaying it on the IPTV page.

[0030] After the first remote control instruction is collected, the recording is ended. The end of recording includes when the audio recording is in the off state and the audio recording countdown is over. Specifically, when the user releases the button and receives the onKeyUp event, it is first determined whether the button of the event is the designated recording button. If so, a signal is sent to notify the end of recording; or when the user's recording time is up, a signal is sent to notify the end of recording. When the end of recording notification is received, the recording is ended, the microphone is released, and the recording thread is closed.

[0031] S2, judging the remote control command, if it is the first remote control command, starting the key execution mode, in which the voice data input by the user is recognized, and the voice data is processed and stored, wherein the processing includes converting the voice data into text data; if it is the second remote control command, starting the QR code execution mode, in which the QR code content is recognized and read, and the QR code content is displayed through text data.

[0032] In this embodiment, if the user turns on the microphone and records via the remote control, the PCM (Pulse Code Modulation) raw digital audio data read from the microphone is written into the cache, and at the same time, a thread is created using Runnable and thrown to the Handler for processing. When the remote control command is determined to be the first remote control command, the PCM data in the cache is Base64 encoded and sent to the ASR server for voice recognition, and the text content is displayed after it is obtained.

[0033] After determining that the remote control command is the second remote control command, the QR code execution mode is started. The starting QR code execution mode includes: regularly receiving a query message of the QR code identifier, the query message is used to query the current QR code identifier status, wherein the QR code identifier status includes not being scanned and being scanned. In specific implementation, after the QR code is displayed, a new thread is created, and the TV end (client) periodically polls the status of the QR code (whether it has been scanned, or whether there is data after scanning) through the interface queryQRCodeState carrying the scene value scene. In addition, when the user enters the mini program by scanning the QR code through WeChat, if the TV end polls that the QR code has been scanned, a mask is covered at the original QR code, and it is explained that this QR code has been scanned and cannot be scanned again unless the user refreshes the QR code. After the QR code identifier status has been scanned, the QR code identifier is updated on the IPTV page end and the QR code identifier status is reset.

[0034] In this embodiment, the QR code content input through the second remote control command includes one of text data and voice data. Specifically, the user can perform text input and voice input on the mini program. If the user uses voice input on the mini program, the input voice will be recognized through the mini program ASR plug-in interface to obtain the text content corresponding to the voice. When the user presses the input, the startVoice interface is called, and the stopVoice interface is called when the input ends. The text content obtained by the mini program input is transmitted to the mini program server through the interface and saved to the database for the client to extract. Then continue to poll through the scene value scene and the queryQuestion interface to check whether there is any data input after scanning the code. If there is, it will be read out and displayed to complete the input process.

[0035] S3, responding to the remote control command input by the user.

[0036] In this embodiment, if both the first remote control instruction and the second remote control instruction have content input, the content of the input method of the remote control instruction that arrives first will be responded to first; if they arrive at the same time, the content input by the first remote control instruction will be used first to solve the concurrency problem.

[0037] According to an embodiment of the present invention, an intelligent input device based on an IPTV system is also provided. Figure 1 The input method corresponds to Figure 2 As shown, the device comprises:

[0038] The collection and receiving unit 210 is used to collect and receive remote control instructions input by the user, wherein the remote control instructions include a first remote control instruction and a second remote control instruction; wherein the first remote control instruction is voice, and the second remote control instruction is triggered by a two-dimensional code logo.

[0039] In this embodiment, the collection receiving unit 210 includes monitoring and judging the audio recording state during collection. When the audio recording is triggered to start, the first remote control instruction is collected, the voice data is recorded and stored, including opening the audio recording countdown and displaying it on the IPTV page end, and when the audio recording is in the off state or the audio recording countdown ends, the recording ends. The second remote control instruction is that when the QR code on the IPTV page interface is scanned by the user, the QR code mark is triggered.

[0040] The identification unit 220 is used to determine the remote control command. If it is a first remote control command, a key execution mode is started. In the key execution mode, the voice data input by the user is identified, and the voice data is processed and stored, wherein the processing includes converting the voice data into text data. If it is a second remote control command, a QR code execution mode is started. In the QR code execution mode, the QR code content is identified and read, and the QR code content is displayed through text data.

[0041] In this embodiment, the QR code execution mode further includes periodically receiving a query message of the QR code identifier, the query message is used to query the current QR code identifier state, wherein the QR code identifier state includes not being scanned and being scanned, and after the QR code identifier state is scanned, the IPTV page end updates the QR code identifier and resets the QR code identifier state. In addition, the content input through the QR code includes one of text data and voice data.

[0042] The response unit 230 is used to respond to the remote control command input by the user.

[0043] In this embodiment, if both the first remote control instruction and the second remote control instruction have content input, the content of the input method of the remote control instruction that arrives first will be responded to first; if they arrive at the same time, the content input by the first remote control instruction will be used first to solve the concurrency problem.

[0044] In summary, with the aid of the above-mentioned embodiments provided by the present invention, an intelligent input method and device based on an IPTV system are disclosed, which realize the coexistence of two input modes and improve the user experience and interaction of different user groups.

[0045] So far, the technical solutions of the present invention have been described in conjunction with the embodiments shown in the accompanying drawings, but it is easy for those skilled in the art to understand that the protection scope of the present invention is obviously not limited to these specific embodiments. Without departing from the principle of the present invention, those skilled in the art can make equivalent changes or substitutions to the relevant technical features, and the technical solutions after these changes or substitutions will fall within the protection scope of the present invention.

[0046] The above descriptions are only several specific embodiments of the present invention and are not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. An intelligent input method based on IPTV system, characterized in that: The method comprises: Collecting and receiving remote control instructions input by a user, wherein the remote control instructions include a first remote control instruction and a second remote control instruction; wherein the first remote control instruction is a voice, and the second remote control instruction is triggered by a two-dimensional code mark; Determine the remote control command, if it is a first remote control command, start a key execution mode, in which voice data input by a user is recognized, and the voice data is processed and stored, wherein the processing includes converting the voice data into text data; if it is a second remote control command, start a QR code execution mode, in which QR code content is recognized and read, and the QR code content is displayed through text data; Respond to remote control commands input by the user.

2. The intelligent input method based on the IPTV system according to claim 1, characterized in that: The collection includes monitoring and judging the audio recording state. When the audio recording is triggered to start, the first remote control instruction is collected, and the voice data is recorded and stored.

3. The intelligent input method based on IPTV system according to claim 2, characterized in that: After recording the voice data, the method further includes: starting the audio recording countdown and displaying it on the IPTV page.

4. The intelligent input method based on the IPTV system according to claim 2, characterized in that: After the first remote control instruction is collected, the method further includes: ending the recording, wherein the ending of the recording includes one or more of when the audio recording is in a closed state and when the audio recording countdown ends.

5. The intelligent input method based on IPTV system according to claim 1, characterized in that: The two-dimensional code logo is triggered including: requesting to generate and display the two-dimensional code logo on the IPTV page end, and the user triggering the two-dimensional code logo by scanning the code.

6. The intelligent input method based on IPTV system according to claim 1, characterized in that: The starting of the two-dimensional code execution mode also includes: regularly receiving a query message of the two-dimensional code identification, wherein the query message is used to query the current two-dimensional code identification status, wherein the two-dimensional code identification status includes not scanned and scanned.

7. The intelligent input method based on IPTV system according to claim 6, characterized in that: The code has been scanned further includes: after the two-dimensional code identification state has been scanned, updating the two-dimensional code identification and resetting the two-dimensional code identification state on the IPTV page end.

8. The intelligent input method based on IPTV system according to claim 1, characterized in that: The two-dimensional code content includes one of text data and voice data.

9. The intelligent input method based on IPTV system according to claim 1, characterized in that: The responding to the remote control instruction input by the user further includes: if the remote control instruction is the first remote control instruction and the second remote control instruction, responding to the first remote control instruction first.

10. An intelligent input device based on an IPTV system, characterized in that: include: A collection and receiving unit, used for collecting and receiving remote control instructions input by a user, wherein the remote control instructions include a first remote control instruction and a second remote control instruction; wherein the first remote control instruction is a voice, and the second remote control instruction is triggered by a two-dimensional code mark; an identification unit, configured to determine the remote control command, and if it is a first remote control command, start a key execution mode, in which voice data input by a user is identified, and the voice data is processed and stored, wherein the processing includes converting the voice data into text data; if it is a second remote control command, start a QR code execution mode, in which QR code content is identified and read, and the QR code content is displayed through text data; The response unit is used to respond to the remote control command input by the user.

Images