A semantic slot extraction method and a display device

Abstract

This application discloses a semantic slot extraction method and display device that improves the accuracy of semantic slot extraction. The method includes: responding to a request sent by a user, performing deep learning semantic slot parsing on the request to determine a first semantic slot; detecting whether an error occurs in the first semantic slot of the request; if an error occurs, modifying the content of the request corresponding to the first semantic slot to obtain a modified request; performing grammatical semantic slot parsing on the modified request to determine a second semantic slot; and combining the first semantic slot and the second semantic slot to obtain the semantic slot of the request.

Description

Technical Field

[0001] The present application relates to the field of semantic slots, and in particular to a semantic slot extraction method and a display device. Background Art

[0002] With the rapid development of artificial intelligence, voice interaction has become a hallmark of intelligent products. Semantic understanding, specifically semantic slot extraction, is the foundation of voice interaction. Semantic slots are typically used as search keywords to find the content users desire. However, current speech recognition-based semantic understanding suffers from inaccurate semantic understanding due to three main issues. The first is that errors in the text retrieved by semantic understanding can occur due to user misinterpretation or speech recognition issues, which creates difficulties. For example, when users make voice queries, the recognized text may differ from the user's expectations due to misremembering or inability to accurately recall the desired film or television title, or due to dialect or speech recognition noise. The second issue is the inherent diversity of language expression, which also poses challenges to semantic understanding. The third issue is the rapid development of the internet, with the emergence of new video and music titles, which presents challenges to current lexicon-based semantic understanding.

[0003] Therefore, how to accurately extract semantic slots and improve the accuracy of semantic understanding has become an urgent problem to be solved by those skilled in the art. Summary of the Invention

[0004] The embodiments of the present application provide a semantic slot extraction method and a display device to improve the accuracy of semantic slot extraction.

[0005] In a first aspect, a display device is provided, comprising:

[0006] monitor;

[0007] The controller is configured to: in response to a request sent by a user, perform deep learning semantic slot parsing on the request to determine a first semantic slot;

[0008] Detecting whether an error occurs in the first semantic slot of the request; if an error occurs, modifying the content corresponding to the first semantic slot in the request to obtain a modified request;

[0009] Perform grammatical semantic slot parsing on the modified request to determine the second semantic slot;

[0010] The first semantic slot and the second semantic slot are combined to obtain the semantic slot of the request.

[0011] In some embodiments, the controller is further configured to execute:

[0012] If no error occurs, directly perform grammatical semantic slot parsing on the request to determine the third semantic slot;

[0013] The first semantic slot and the third semantic slot are combined to obtain the semantic slot of the request.

[0014] In some embodiments, the step of modifying the content corresponding to the first semantic slot in the request to obtain a modified request includes:

[0015] Searching for replacement content corresponding to the first semantic slot;

[0016] Using the replacement content, replacing the content corresponding to the first semantic slot in the request to form a request to be determined;

[0017] If the number of the pending request is one, determining that the pending request is a modified request;

[0018] In some embodiments, the step of modifying the content corresponding to the first semantic slot in the request to obtain a modified request further includes:

[0019] If the number of the pending requests is greater than one, an optimal pending request is screened out from the multiple pending requests as the modified request.

[0020] In some embodiments, the step of searching for replacement content corresponding to the first semantic slot includes:

[0021] Identify the business area of the request;

[0022] According to the business field, the replacement content corresponding to the first semantic slot is determined by using the pinyin index, the glyph index, the phonetic code index and the semantic index.

[0023] In a second aspect, a semantic slot extraction method is provided, comprising:

[0024] In response to a request sent by a user, performing deep learning semantic slot parsing on the request to determine a first semantic slot;

[0025] Detecting whether an error occurs in the first semantic slot of the request; if an error occurs, modifying the content corresponding to the first semantic slot in the request to obtain a modified request;

[0026] Perform grammatical semantic slot parsing on the modified request to determine the second semantic slot;

[0027] The first semantic slot and the second semantic slot are combined to obtain the semantic slot of the request.

[0028] In some embodiments, the method further comprises:

[0029] If no error occurs, the request is directly parsed for grammatical semantic slots to determine a third semantic slot; the first semantic slot and the third semantic slot are combined to obtain the semantic slot of the request.

[0030] In some embodiments, the step of modifying the content corresponding to the first semantic slot in the request to obtain a modified request includes:

[0031] Searching for replacement content corresponding to the first semantic slot;

[0032] Using the replacement content, replacing the content corresponding to the first semantic slot in the request to form a request to be determined;

[0033] If the number of the request to be determined is one, it is determined that the request to be determined is a modified request.

[0034] In some embodiments, the step of modifying the content corresponding to the first semantic slot in the request to obtain a modified request further includes:

[0035] If the number of the pending requests is greater than one, an optimal pending request is screened out from the multiple pending requests as the modified request.

[0036] In some embodiments, the step of searching for replacement content corresponding to the first semantic slot includes:

[0037] Identify the business area of the request;

[0038] According to the business field, the replacement content corresponding to the first semantic slot is determined by using the pinyin index, the glyph index, the phonetic code index and the semantic index.

[0039] In the above embodiment, a semantic slot extraction method and display device are provided to improve the accuracy of semantic slot extraction. The method includes: in response to a request sent by a user, performing deep learning semantic slot parsing on the request to determine a first semantic slot; detecting whether an error occurs in the first semantic slot of the request, and if an error occurs, modifying the content corresponding to the first semantic slot in the request to obtain a modified request; performing grammatical semantic slot parsing on the modified request to determine a second semantic slot; and combining the first semantic slot and the second semantic slot to obtain the semantic slot of the request. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] Figure 1 Schematic diagram showing an operation scenario between a display device and a control apparatus according to some embodiments;

[0041] Figure 2exemplarily shows a hardware configuration block diagram of a display device 200 according to some embodiments;

[0042] Figure 3 exemplarily shows a hardware configuration block diagram of the control device 100 according to some embodiments;

[0043] Figure 4 exemplarily shows a schematic diagram of software configuration in the display device 200 according to some embodiments;

[0044] Figure 5 exemplarily shows a schematic diagram of an icon control interface display of an application in a display device 200 according to some embodiments;

[0045] Figure 6 hereinafter is a flowchart of a semantic slot extraction method;

[0046] Figure 7 The schematic diagram of semantic slot parsing based on deep learning is shown in FIG.

[0047] Figure 8 A flowchart of another semantic slot extraction method is shown in FIG. DETAILED DESCRIPTION

[0048] In order to make the purpose, implementation mode and advantages of the present application clearer, the exemplary implementation mode of the present application will be clearly and completely described below in conjunction with the drawings in the exemplary embodiments of the present application. Obviously, the described exemplary embodiments are only part of the embodiments of the present application, not all of the embodiments.

[0049] All other embodiments derived by persons of ordinary skill in the art based on the exemplary embodiments described herein without inventive effort are within the scope of protection of the claims appended hereto. Furthermore, although the disclosure herein is presented based on one or more exemplary embodiments, it should be understood that each aspect of the disclosure may constitute a complete embodiment on its own.

[0050] It should be noted that the brief descriptions of terms in this application are only for the purpose of facilitating the understanding of the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their ordinary and usual meanings.

[0051] In the specification and claims of this application and the drawings, the terms "first," "second," "third," etc. are used to distinguish similar or similar objects or entities, and are not necessarily intended to limit a particular order or precedence, unless otherwise indicated. It should be understood that the terms used in this manner are interchangeable under appropriate circumstances, for example, they can be implemented in an order other than those given in the drawings or descriptions of the embodiments of this application.

[0052] In addition, the terms "comprise" and "have" and any variations thereof are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to those components expressly listed but may include other components not expressly listed or inherent to such product or device.

[0053] The term "module" as used in this application refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0054] As used herein, the term "remote control" refers to a component of an electronic device (such as the display device disclosed herein) that is capable of wirelessly controlling the electronic device, typically over a short distance. It typically connects to the electronic device using infrared and / or radio frequency (RF) signals and / or Bluetooth, and may also include functional modules such as WiFi, wireless USB, Bluetooth, and motion sensors. For example, a handheld touch remote control replaces most of the physical built-in hard keys found in conventional remote controls with a touchscreen user interface.

[0055] The term "gesture" used in this application refers to a user's behavior of expressing an intended idea, action, purpose, or result through a change in hand shape or hand movement.

[0056] Figure 1 FIG2 is a schematic diagram showing an operation scenario between a display device and a control device according to an embodiment. Figure 1 As shown in FIG, a user can operate the display device 200 through the mobile terminal 300 and the control apparatus 100 .

[0057] In some embodiments, the control device 100 may be a remote control. Communication between the remote control and the display device may include infrared protocol communication, Bluetooth protocol communication, or other short-range communication methods, thereby controlling the display device 200 wirelessly or through wired methods. A user may control the display device 200 by inputting user commands through buttons on the remote control, voice input, control panel input, and the like. For example, a user may control the display device 200 by inputting corresponding control commands through the volume up / down keys, channel control keys, up / down / left / right movement keys, voice input keys, menu keys, power on / off keys, and the like on the remote control.

[0058] In some embodiments, a mobile terminal, tablet computer, computer, laptop computer, or other smart device can also be used to control the display device 200. For example, an application running on the smart device can be used to control the display device 200. The application can be configured to provide the user with various controls in an intuitive user interface (UI) on a screen associated with the smart device.

[0059] In some embodiments, the mobile terminal 300 can install software applications on the display device 200 and establish communication via a network communication protocol, enabling one-to-one control operations and data communication. For example, a control command protocol can be established between the mobile terminal 300 and the display device 200, synchronizing a remote control keyboard to the mobile terminal 300, and controlling the user interface on the mobile terminal 300 to control the display device 200. Alternatively, audio and video content displayed on the mobile terminal 300 can be transmitted to the display device 200 for synchronized display.

[0060] like Figure 1 It is also shown that the display device 200 also communicates data with the server 400 through various communication methods. The display device 200 may be allowed to communicate via a local area network (LAN), a wireless local area network (WLAN) and other networks. The server 400 may provide various content and interactions to the display device 200. For example, the display device 200 receives software program updates or accesses a remotely stored digital media library by sending and receiving information and interacting with an electronic program guide (EPG). The server 400 may be a cluster or multiple clusters, and may include one or more types of servers. Other network service content such as video on demand and advertising services is provided through the server 400.

[0061] The display device 200 can be a liquid crystal display, an OLED display, or a projection display device. The specific display device type, size, and resolution are not limited. Those skilled in the art will appreciate that the display device 200 can be modified in terms of performance and configuration as needed.

[0062] In addition to providing broadcast reception television functions, the display device 200 may also provide intelligent network television functions with computer support functions, including but not limited to network television, smart TV, Internet Protocol television (IPTV), etc.

[0063] Figure 2 exemplarily shows a hardware configuration block diagram of the display device 200 according to an exemplary embodiment.

[0064] In some embodiments, the display device 200 includes at least one of a controller 250, a tuner and demodulator 210, a communicator 220, a detector 230, an input / output interface 255, a display 275, an audio output interface 285, a memory 260, a power supply 290, a user interface 265, and an external device interface 240.

[0065] In some embodiments, the display 275 is a component for receiving the image signal output from the first processor and displaying video content and images as well as a menu control interface.

[0066] In some embodiments, the display 275 includes a display screen component for presenting images and a driving component for driving image display.

[0067] In some embodiments, the displayed video content may be from broadcast television content, or various broadcast signals received via wired or wireless communication protocols, or various image content received from a network server via a network communication protocol.

[0068] In some embodiments, the display 275 is used to present a user manipulation UI interface generated in the display device 200 and used to control the display device 200 .

[0069] In some embodiments, depending on the type of display 275 , a driving component for driving the display is also included.

[0070] In some embodiments, the display 275 is a projection display and may further include a projection device and a projection screen.

[0071] In some embodiments, the communicator 220 is a component for communicating with external devices or external servers according to various communication protocols. For example, the communicator may include at least one of a Wi-Fi chip, a Bluetooth communication protocol chip, a wired Ethernet communication protocol chip, or other network communication protocol chip or a near-field communication protocol chip, as well as an infrared receiver.

[0072] In some embodiments, the display device 200 may establish transmission and reception of control signals and data signals with the external control device 100 or the content providing device through the communicator 220 .

[0073] In some embodiments, the user interface 265 may be configured to receive infrared control signals from the control device 100 (eg, an infrared remote controller, etc.).

[0074] In some embodiments, the detector 230 is a signal used by the display device 200 to collect external environment or interact with the outside.

[0075] In some embodiments, the detector 230 includes a light receiver, a sensor for collecting ambient light intensity, and can adaptively display parameter changes by collecting ambient light.

[0076] In some embodiments, the detector 230 may also include an image collector, such as a camera, a camera, etc., which can be used to collect external environment scenes, as well as to collect user attributes or gestures for interacting with the user. It can adaptively change display parameters and recognize user gestures to realize the function of interacting with the user.

[0077] In some embodiments, the detector 230 may further include a temperature sensor, such as by sensing the ambient temperature.

[0078] In some embodiments, the display device 200 can adaptively adjust the color temperature of the image displayed. For example, when the temperature is high, the display device 200 can be adjusted to display a cooler color temperature image, or when the temperature is low, the display device 200 can be adjusted to display a warmer color temperature image.

[0079] In some embodiments, the detector 230 may also be a sound collector, such as a microphone, for receiving the user's voice, illustratively including a voice signal of a user's control command for controlling the display device 200, or collecting ambient sound for identifying the type of ambient scene, so that the display device 200 can adaptively adapt to the ambient noise.

[0080] In some embodiments, as Figure 2 As shown, the input / output interface 255 is configured to perform data transmission between the controller 250 and other external devices or other controllers 250, such as receiving video signal data and audio signal data, or command instruction data from external devices.

[0081] In some embodiments, the external device interface 240 may include, but is not limited to, any one or more interfaces such as a high-definition multimedia interface (HDMI), an analog or digital high-definition component input interface, a composite video input interface, a USB input interface, an RGB port, etc. Alternatively, multiple interfaces may be combined to form a composite input / output interface.

[0082] In some embodiments, as Figure 2As shown, the tuner-demodulator 210 is configured to receive broadcast television signals through wired or wireless reception, and can perform modulation and demodulation processing such as amplification, mixing and resonance, and demodulate audio and video signals from multiple wireless or wired broadcast television signals. The audio and video signals may include television audio and video signals carried in the television channel frequency selected by the user, as well as EPG data signals.

[0083] In some embodiments, the frequency demodulated by the tuner-demodulator 210 is controlled by the controller 250, which can send a control signal based on the user's selection to enable the modem to respond to the TV signal frequency selected by the user and modulate and demodulate the TV signal carried by the frequency.

[0084] In some embodiments, broadcast television signals can be classified as terrestrial broadcast signals, cable broadcast signals, satellite broadcast signals, or Internet broadcast signals based on the broadcast format of the television signal. Alternatively, they can be classified as digital modulation signals, analog modulation signals, etc. based on the modulation type. Alternatively, they can be classified as digital signals, analog signals, etc. based on the type of signal.

[0085] In some embodiments, the controller 250 and the tuner / demodulator 210 may be located in different separate devices, that is, the tuner / demodulator 210 may be located in an external device of the main device where the controller 250 is located, such as an external set-top box. In this way, the set-top box modulates and demodulates the received broadcast television signal into television audio and video signals and outputs them to the main device, which then receives the audio and video signals via the first input / output interface.

[0086] In some embodiments, controller 250 controls the operation of the display device and responds to user operations via various software control programs stored in memory. Controller 250 can control the overall operation of display device 200. For example, in response to receiving a user command to select a UI object for display on display 275, controller 250 can perform operations related to the object selected by the user command.

[0087] In some embodiments, the object can be any one of selectable objects, such as a hyperlink or an icon. Operations related to the selected object, for example, displaying a page, document, image connected to the hyperlink, or executing a program corresponding to the icon. User commands for selecting UI objects can be commands input through various input devices connected to the display device 200 (e.g., a mouse, keyboard, touchpad, etc.) or voice commands corresponding to voice spoken by the user.

[0088] like Figure 2As shown, the controller 250 includes at least one of a random access memory 251 (RAM), a read-only memory 252 (ROM), a video processor 270, an audio processor 280, other processors 253 (e.g., a graphics processing unit (GPU)), a central processing unit (CPU) 254, a communication interface (Communication Interface), and a communication bus 256 (Bus). The communication bus connects the various components.

[0089] In some embodiments, RAM 251 is used to store temporary data for the operating system or other running programs.

[0090] In some embodiments, ROM 252 is used to store various system startup instructions.

[0091] In some embodiments, ROM 252 is used to store a basic input / output system, called a Basic Input / Output System (BIOS), which is used to perform a power-on self-test of the system, initialize various functional modules in the system, provide basic input / output drivers for the system, and boot the operating system.

[0092] In some embodiments, upon receiving a power-on signal, the display device 200 starts up, and the CPU executes system startup instructions in the ROM 252, copying temporary operating system data stored in the memory to the RAM 251 to facilitate booting or running the operating system. After the operating system boot is complete, the CPU copies temporary data for various application programs in the memory to the RAM 251 to facilitate booting or running the various application programs.

[0093] In some embodiments, the CPU processor 254 is configured to execute operating system and application instructions stored in the memory, and to execute various applications, data, and content based on various interactive instructions received from external input, so as to ultimately display and play various audio and video content.

[0094] In some exemplary embodiments, the CPU processor 254 may include multiple processors. The multiple processors may include a main processor and one or more sub-processors. The main processor is used to perform certain operations of the display device 200 in pre-power mode and / or display images in normal mode. The one or more sub-processors are used to perform certain operations in states such as standby mode.

[0095] In some embodiments, the graphics processor 253 is used to generate various graphical objects, such as icons, operation menus, and graphics displayed in response to user input commands. It includes an operator that performs operations based on various user interaction commands and displays various objects according to display attributes. It also includes a renderer that renders the various objects generated by the operator. These rendered objects are then displayed on the display.

[0096] In some embodiments, the video processor 270 is configured to receive an external video signal and perform video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image synthesis, etc. according to the standard codec protocol of the input signal, and obtain a signal that can be directly displayed or played on the display device 200.

[0097] In some embodiments, the video processor 270 includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, and the like.

[0098] The demultiplexing module is used to demultiplex the input audio and video data streams. For example, if MPEG-2 is input, the demultiplexing module demultiplexes the data into video signals and audio signals.

[0099] The video decoding module is used to process the demultiplexed video signal, including decoding and scaling.

[0100] The image synthesis module, such as an image synthesizer, is used to superimpose and mix the GUI signal generated by the graphics generator according to user input or itself with the scaled video image to generate an image signal for display.

[0101] The frame rate conversion module is used to convert the input video frame rate, such as converting the 60Hz frame rate to 120Hz frame rate or 240Hz frame rate. The common format is implemented by interpolation.

[0102] The display formatting module is used to convert the received frame rate converted video output signal and change the signal to conform to the display format signal, such as outputting RGB data signal.

[0103] In some embodiments, the graphics processor 253 can be integrated with the video processor or can be separately configured. When integrated, it can perform processing of the graphics signals output to the display. When separately configured, it can perform different functions separately, such as a GPU+FRC (Frame Rate Conversion) architecture.

[0104] In some embodiments, the audio processor 280 is used to receive an external audio signal, and perform decompression and decoding, as well as noise reduction, digital-to-analog conversion, and amplification processing according to the standard codec protocol of the input signal to obtain a sound signal that can be played in a speaker.

[0105] In some embodiments, the video processor 270 may include one or more chips. The audio processor may also include one or more chips.

[0106] In some embodiments, the video processor 270 and the audio processor 280 may be separate chips, or may be integrated with the controller into one or more chips.

[0107] In some embodiments, the audio output receives the sound signal output by the audio processor 280 under the control of the controller 250, such as: the speaker 286, and in addition to the speaker carried by the display device 200 itself, can be output to the external audio output terminal of the generating device of the external device, such as: an external audio interface or a headphone interface, etc., and can also include a short-range communication module in the communication interface, for example: a Bluetooth module for Bluetooth speaker sound output.

[0108] The power supply 290, under the control of the controller 250, uses the power input from the external power source to provide power supply support for the display device 200. The power supply 290 can include a built-in power supply circuit installed inside the display device 200, or it can be installed externally to the display device 200 and provide a power interface for the display device 200 to connect to an external power source.

[0109] The user interface 265 is used to receive user input signals and then send the received user input signals to the controller 250. The user input signals may be remote control signals received by an infrared receiver or various user control signals received by a network communication module.

[0110] In some embodiments, the user inputs a user command through the control device 100 or the mobile terminal 300 , the user input interface is based on the user input, and the display device 200 responds to the user input through the controller 250 .

[0111] In some embodiments, the user may input a user command through a graphical user interface (GUI) displayed on the display 275, and the user input interface receives the user input command through the graphical user interface (GUI). Alternatively, the user may input a user command through a specific sound or gesture, and the user input interface may recognize the sound or gesture through a sensor to receive the user input command.

[0112] In some embodiments, a "user interface" is a medium interface for interaction and information exchange between an application or operating system and a user. It enables the conversion between the internal form of information and a form acceptable to the user. A common form of user interface is a graphical user interface (GUI), which refers to a user interface related to computer operations that uses a graphical display. It can be an icon, window, control, or other interface element displayed on the display of an electronic device. Controls can include visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets.

[0113] The memory 260 stores various software modules for driving the display device 200. For example, the various software modules stored in the first memory include at least one of a basic module, a detection module, a communication module, a display control module, a browser module, and various service modules.

[0114] The basic module is a low-level software module used to communicate signals between various hardware components in the display device 200 and send processing and control signals to upper-level modules. The detection module is a management module used to collect various information from various sensors or user input interfaces, perform digital-to-analog conversion, and perform analysis and management.

[0115] For example, the speech recognition module includes a speech parsing module and a speech command database module. The display control module is used to control the display to display image content and can be used to play multimedia image content and UI interface information. The communication module is used to control and communicate data with external devices. The browser module is used to perform data communication between browsing servers. The service module is used to provide various services and various applications. Memory 260 is also used to store received external data and user data, images of various items in the user interface, and visual effects of focus objects.

[0116] Figure 3 FIG. 1 exemplarily shows a configuration block diagram of the control device 100 according to an exemplary embodiment. Figure 3 As shown, the control device 100 includes a controller 110, a communication interface 130, a user input / output interface, a memory, and a power supply.

[0117] The control device 100 is configured to control the display device 200 and receive user input commands. It converts these commands into commands that the display device 200 can recognize and respond to, acting as an intermediary for interaction between the user and the display device 200. For example, a user may press the channel up / down keys on the control device 100, and the display device 200 may respond to these channel up / down operations.

[0118] In some embodiments, the control device 100 may be a smart device. For example, the control device 100 may be installed with various applications for controlling the display device 200 according to user needs.

[0119] In some embodiments, as Figure 1 As shown, after installing the application for controlling the display device 200, the mobile terminal 300 or other smart electronic device can perform similar functions to control the device 100. For example, the user can install the application and use various function keys or virtual buttons of the graphical user interface provided on the mobile terminal 300 or other smart electronic device to realize the functions of the physical buttons of the control device 100.

[0120] The controller 110 includes a processor 112, RAM 113, ROM 114, a communication interface 130, and a communication bus. The controller is used to control the operation and operation of the control device 100, as well as the communication and cooperation between internal components and external and internal data processing functions.

[0121] Under the control of the controller 110, the communication interface 130 communicates control signals and data signals with the display device 200. For example, it transmits received user input signals to the display device 200. The communication interface 130 may include at least one of a WiFi chip 131, a Bluetooth module 132, an NFC module 133, or other near-field communication modules.

[0122] The user input / output interface 140 includes at least one of a microphone 141, a touchpad 142, a sensor 143, a keypad 144, and other input interfaces. For example, a user can input user commands through voice, touch, gestures, pressing, and other actions. The input interface converts received analog signals into digital signals, and then converts the digital signals into corresponding command signals, which are then sent to the display device 200.

[0123] The output interface includes an interface for transmitting received user commands to the display device 200. In some embodiments, this can be either an infrared interface or a radio frequency interface. For example, in an infrared signal interface, user input commands need to be converted into infrared control signals according to an infrared control protocol and then transmitted to the display device 200 via an infrared transmission module. Alternatively, in a radio frequency signal interface, user input commands need to be converted into digital signals, modulated according to a radio frequency control signal modulation protocol, and then transmitted to the display device 200 via a radio frequency transmission terminal.

[0124] In some embodiments, the control device 100 includes at least one of a communication interface 130 and an input / output interface 140. The control device 100 is configured with a communication interface 130, such as a WiFi, Bluetooth, or NFC module, to encode user input commands via the WiFi, Bluetooth, or NFC protocols and transmit them to the display device 200.

[0125] The memory 190 is used to store various operating programs, data and applications for driving and controlling the control device 200 under the control of the controller. The memory 190 can store various control signal instructions input by the user.

[0126] The power supply 180 is used to provide operating power support for various components of the control device 100 under the control of the controller. It can be a battery and related control circuits.

[0127] In some embodiments, the system may include a kernel, a command parser (shell), a file system, and applications. The kernel, shell, and file system together form the basic operating system structure, allowing users to manage files, run programs, and use the system. After power is applied, the kernel boots up, activates kernel space, abstracts hardware, initializes hardware parameters, and runs and maintains virtual memory, a scheduler, signals, and inter-process communication (IPC). After the kernel boots up, the shell and user applications are loaded. After booting up, the application is compiled into machine code to form a process.

[0128] See also Figure 4 In some embodiments, the system is divided into four layers, namely, from top to bottom, the application layer (referred to as "application layer"), the application framework layer (referred to as "framework layer"), the Android runtime and system library layer (referred to as "system runtime library layer"), and the kernel layer.

[0129] In some embodiments, at least one application runs in the application layer. These applications may be window programs, system settings programs, clock programs, camera applications, etc. that come with the operating system; or they may be applications developed by third-party developers, such as hi-view programs, karaoke programs, and magic mirror programs. In specific implementations, the application packages in the application layer are not limited to the above examples and may actually include other application packages, which are not limited in this embodiment of the present application.

[0130] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications in the application layer. The application framework layer includes some predefined functions. The application framework layer is equivalent to a processing center that determines the actions taken by applications in the application layer. Applications can access system resources and obtain system services through the API interface during execution.

[0131] like Figure 4 As shown, in the embodiment of the present application, the application framework layer includes managers, content providers, etc., wherein the manager includes at least one of the following modules: an activity manager (ActivityManager) is used to interact with all activities running in the system; a location manager (Location Manager) is used to provide system services or applications with access to system location services; a package manager (Package Manager) is used to retrieve various information related to the application packages currently installed on the device; a notification manager (NotificationManager) is used to control the display and clearing of notification messages; a window manager (Window Manager) is used to manage icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0132] In some embodiments, the activity manager is used to: manage the life cycle of each application and the usual navigation back function, such as controlling the exit of the application (including switching the user interface currently displayed in the display window to the system desktop), opening, backing (including switching the user interface currently displayed in the display window to the upper-level user interface of the currently displayed user interface), etc.

[0133] In some embodiments, the window manager is used to manage all window programs, such as obtaining the display screen size, determining whether there is a status bar, locking the screen, capturing the screen, controlling display window changes (for example, shrinking the display window, shaking the display, distorting the display, etc.), etc.

[0134] In some embodiments, the system runtime layer provides support for the upper layer, namely the framework layer. When the framework layer is used, the Android operating system will run the C / C++ library contained in the system runtime layer to implement the functions to be implemented by the framework layer.

[0135] In some embodiments, the kernel layer is a layer between hardware and software. Figure 4As shown, the kernel layer includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, touch sensor, pressure sensor, etc.), etc.

[0136] In some embodiments, the core layer further includes a power driver module for performing power management.

[0137] In some embodiments, Figure 4 The software programs and / or modules corresponding to the software architecture in Figure 2 or Figure 3 In the first memory or the second memory shown.

[0138] In some embodiments, taking the Magic Mirror application (photography application) as an example, when the remote control receiving device receives a remote control input operation, a corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes the input operation into a raw input event (including the value of the input operation, the timestamp of the input operation, and other information). The raw input event is stored in the kernel layer. The application framework layer obtains the raw input event from the kernel layer, identifies the control corresponding to the input event based on the current focus position, and determines that the input operation is a confirmation operation. The control corresponding to the confirmation operation is the control of the Magic Mirror application icon. The Magic Mirror application calls the interface of the application framework layer to start the Magic Mirror application, and then starts the camera driver by calling the kernel layer to capture still images or videos through the camera.

[0139] In some embodiments, for a display device with a touch function, taking a split-screen operation as an example, the display device receives an input operation (such as a split-screen operation) performed by a user on the display screen, and the kernel layer can generate a corresponding input event based on the input operation and report the event to the application framework layer. The activity manager of the application framework layer sets the window mode (such as a multi-window mode) and the window position and size corresponding to the input operation. The window management of the application framework layer draws the window according to the settings of the activity manager, and then sends the drawn window data to the display driver of the kernel layer, which displays the corresponding application interface in different display areas of the display screen.

[0140] In some embodiments, as Figure 5 As shown in , the application layer includes at least one application that can display corresponding icon controls on the display, such as: live TV application icon controls, video on demand application icon controls, media center application icon controls, application center icon controls, game application icon controls, etc.

[0141] In some embodiments, the live TV application can provide live TV from various signal sources. For example, the live TV application can provide a TV signal using an input from a cable TV service, over-the-air broadcast, satellite service, or other type of live TV service. Furthermore, the live TV application can display video from the live TV signal on the display device 200.

[0142] In some embodiments, a video-on-demand application can provide videos from various storage sources. Unlike a live TV application, a video-on-demand application provides video display from a storage source. For example, the video-on-demand application can be served from a cloud storage server or from a local hard drive containing stored video programs.

[0143] In some embodiments, a media center application may be an application that provides various multimedia content playback applications. For example, a media center may be a service that is different from live TV or video on demand, and a user may access various images or audio services through the media center application.

[0144] In some embodiments, an application center can provide storage for various applications. These applications can be games, apps, or other applications related to computer systems or other devices that can be run on a smart TV. The application center can obtain these applications from various sources, store them in local storage, and then run them on the display device 200.

[0145] With the rapid development of artificial intelligence, voice interaction has become a hallmark of intelligent products. Semantic understanding, specifically semantic slot extraction, is the foundation of voice interaction. Semantic slots are typically used as search keywords to find the content users desire. However, current inaccurate semantic understanding based on speech recognition suffers from three main issues. First, errors in the text retrieved by semantic understanding can occur due to user misinterpretation or speech recognition issues, which can create difficulties in semantic understanding. For example, when users make voice queries, the recognized text may differ from the user's expectations due to misremembering or inability to accurately recall the desired film or television title, or due to dialect or speech recognition noise. Second, the inherent diversity of language also poses challenges to semantic understanding. Third, the rapid development of the internet and the emergence of new video and music titles pose challenges to current lexicon-based semantic understanding. Therefore, how to accurately extract semantic slots and improve the accuracy of semantic understanding has become a pressing issue for those skilled in the art.

[0146] The present application embodiment provides a semantic slot extraction method, such as Figure 6 Shown, including:

[0147] S101. In response to a request sent by a user, perform deep learning semantic slot parsing on the request to determine a first semantic slot.

[0148] It should be noted that the request can be a text message converted from a user's voice message. In this request, the user can express the content they want to watch or search for. For example, the request can be "Agai's Chen Xiang Just Cut Half Variety Show." Then, through deep learning semantic slot parsing, a first semantic slot is obtained. For example, the first semantic slot can be: Agai: name, Chen Xiang Just Cut Half: video title, Variety Show: video type.

[0149] The semantic slot parsing of deep learning is data-driven, and it performs probabilistic modeling on the text and trains the relevant deep learning parsing model offline. It mainly solves the problem of some unregistered words or generalized expressions. The semantic slot entity types it handles include dynamically growing entities such as TV series and music; entities such as time, which are required in all fields; and entities such as place names, which have large data volumes and diverse expressions and cannot be included in the vocabulary. Specifically, Figure 7 As shown, the deep learning parsing model used in the deep learning semantic slot parsing includes an input representation layer, a model building layer, and an attribute annotation layer. The input representation layer is used to encode the characters or words in the input sentence so that semantically similar characters or words are expressed similarly. The model building layer is used to model the contextual relationships between characters or words. The attribute annotation layer is used to model the contextual relationships between tags.

[0150] Figure 7 In the input representation layer (word embeddings), the input is the user's request Mark Watney visited Mars. The final output of the network structure for "Mark" is "B-PER", which represents the beginning of a person's name; the final output of the network structure for Watney is "E-PER", which represents the end of a person's name; the final output of the network structure for visited is "O", which means that the current word is meaningless; and the final output of the network structure for Mars is "S-LOC", which means it is a place name. In the model modeling layer (Bi_LSTMencoder) in the figure, I i Indicates that word i considers the left context; r i Indicates that word i considers the right context; c i It represents the result of word i considering the context on both sides.

[0151] Since the first semantic slot is directly determined by parsing the semantic slots of the request through deep learning, if there are incorrect text contents in the request, there may also be incorrect text contents in the first semantic slot. Exemplarily, in the above example, Chen Xiang Halved: Video Name, the correct content should be Chen Xiang's Six-and-a-Half O'clock: Video Name. Therefore, in the embodiment S102 of the present application, it is detected whether there is an error in the first semantic slot of the request. S103, if an error occurs, the content corresponding to the first semantic slot in the request is modified to obtain a modified request.

[0152] In some embodiments, to detect whether there is an error in the first semantic slot of the request, it can be searched through a dictionary. The dictionary stores preset semantic slot contents. If the content of the first semantic slot does not appear in the dictionary, it is determined that there is an error in the first semantic slot. In other embodiments, to detect whether there is an error in the first semantic slot of the request, it can also be detected by a classifier. Through the classifier, if an error occurs, the output of the classifier is 1, if no error occurs, the output of the classifier is 0. The classifier is a deep learning model. After being trained, this model can directly determine whether there is an error in the first semantic slot of the request. In addition, the embodiments of the present application do not limit the specific type of the model for determining whether there is an error in the first semantic slot of the request. If there are other models that can implement this function, they are also within the protection scope of the present application.

[0153] In some embodiments, when detecting whether there is an error in the first semantic slot, only the important part of the first semantic slot can be detected, which can reduce the consumption of computer resources. Exemplarily, only the contents corresponding to the video name, music name, and application name can be detected. In the above example, it can be detected for Chen Xiang Halved: Video Name, and the detection is not performed on A Gai: Person Name, Variety Show: Video Type. When an error occurs in the first semantic slot, the content corresponding to the first semantic slot is modified.

[0154] In some embodiments, the step of modifying the content corresponding to the first semantic slot in the request to obtain a modified request is as Figure 8 shown, including:

[0155] S1021, search for replacement content corresponding to the first semantic slot.

[0156] In some embodiments, the step of searching for replacement content corresponding to the first semantic slot includes:

[0157] Determine the business domain of the request. According to the vertical domain, determine the business domain of the request, which includes video, music, and applications. Specifically, input the user request into the pre-trained model for prediction. Predict and output the corresponding business domain. For example, if I want to watch a movie or I want to watch Chen Xiang at 6:30, the video business domain will be output; if I want to listen to music or I want to listen to Andy Lau's songs, the music business domain will be output. The pre-trained model uses a large amount of user data to model the business domain of the user's request using deep learning, and stores the model.

[0158] Since an error may occur in the first semantic slot, the error in the first semantic slot needs to be corrected. According to the business field, the embodiment of the present application uses the pinyin index, the glyph index, the phonetic code index and the semantic index to determine the replacement content corresponding to the first semantic slot.

[0159] The pinyin index refers to replacing the same pinyin or similar pinyin content in the wrong first semantic slot within the scope of the business field. The glyph index refers to replacing the same glyph or similar glyph content in the wrong first semantic slot within the scope of the business field. The phonetic code index refers to replacing the same phonetic code or similar phonetic code content in the wrong first semantic slot within the scope of the business field. The semantic index refers to replacing the wrong first semantic slot with semantically identical or similar content within the scope of the business field. The present application is not limited to the above-mentioned method for determining the replacement content corresponding to the first semantic slot. Any method that does not violate the meaning of the present application is within the scope of protection of the present application.

[0160] In this way, when the user uses a dialect or language to identify errors such as wrong characters (homophones, homographs), extra characters, missing characters, and disordered order, the purpose of finding replacement content can be achieved based on media resources using methods such as pinyin index, glyph index, phonetic code index, and semantic index. In order to avoid missing replacement content, the embodiment of the present application can use the above multiple methods for determining replacement content at the same time.

[0161] S1022: Use the replacement content to replace the content corresponding to the first semantic slot in the request to form a request to be determined.

[0162] Since there may be one or more methods for finding and replacing content, the number of replacement contents found may be one or more, and the number of requests to be determined is also uncertain. Therefore, the embodiment of the present application determines the method for determining the modified request based on the number of requests to be determined.

[0163] S1023. If the number of the request to be determined is one, determine that the request to be determined is a modified request;

[0164] S1024: If the number of the pending requests is greater than one, select an optimal pending request from the multiple pending requests as the modified request.

[0165] In this embodiment of the application, multiple pending requests can be input into a deep learning model trained by pinyin, characters, popularity, business fields, tags, etc. to obtain a score for each pending request. Finally, the pending request with the highest score is selected as the modified request.

[0166] Since the first semantic slot determined by the semantic slot parsing using deep learning may contain erroneous content. Therefore, S104, the modified request is subjected to grammatical semantic slot parsing to determine the second semantic slot. The grammatical semantic slot parsing refers to the use of grammatical semantic slot parsing, which refers to the use of vocabulary tags and grammatical rules composed of tags to determine the second semantic slot. Multiple grammatical rules in the vocabulary constitute a grammatical tree. For example, name tags: Yang Mi, Qin Hao, video name tags: Eternal Love, The Secret Corner, grammatical rules: grammatical rules composed of name tags and video name tags. If the modified request is Eternal Love starring Yang Mi, this grammatical rule will be matched, and the second semantic slot will be determined to be Eternal Love: video name, Yang Mi: name.

[0167] In this way, by parsing the modified request through the grammatical semantic slots, a second semantic slot with no erroneous content can be obtained. For example, based on the example mentioned above, the second semantic slot is: Chen Xiang 6:30: video title; Variety show: video type. Since the dictionary is incomplete for names, A Gai is not included.

[0168] In the embodiment of the present application, S105 combines the first semantic slot and the second semantic slot to obtain the semantic slot of the request. Since grammatical semantic slot parsing is processed using a dictionary, but the content of the dictionary has certain limitations, while deep learning semantic slot parsing has no limitations, combining the two can obtain accurate semantic slots and correct semantic slots, thereby achieving the purpose of improving the accuracy of semantic slot extraction and improving fault tolerance.

[0169] For example, the first semantic slot is: "Agai": person's name, "Chen Xiang's Half-Time": video title; "Variety Show": video type. The second semantic slot is: "Chen Xiang Six-Thirty": video title; "Variety Show": video type. Combining the two, the resulting semantic slots are: "Agai": person's name; "Chen Xiang Six-Thirty": video title; "Variety Show": video type. Content not in the second semantic slot is supplemented by the first semantic slot.

[0170] In some embodiments, S106, if no error occurs, directly performing grammatical semantic slot parsing on the request to determine a third semantic slot;

[0171] S107: Combine the first semantic slot and the third semantic slot to obtain the requested semantic slot. The method for combining the first semantic slot and the third semantic slot is the same as the method for combining the first semantic slot and the second semantic slot, and will not be repeated here.

[0172] In the above embodiment, a semantic slot extraction method and display device are provided to improve the accuracy of semantic slot extraction. The method includes: in response to a request sent by a user, performing deep learning semantic slot parsing on the request to determine a first semantic slot; detecting whether an error occurs in the first semantic slot of the request; if an error occurs, modifying the content corresponding to the first semantic slot in the request to obtain a modified request; performing grammatical semantic slot parsing on the modified request to determine a second semantic slot; and combining the first semantic slot and the second semantic slot to obtain the semantic slot of the request.

[0173] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some or all of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present application.

[0174] For ease of explanation, the above description has been made with reference to specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Based on the above teachings, various modifications and variations are possible. The above embodiments are selected and described to better explain the principles and practical applications, so that those skilled in the art can better utilize the embodiments and various different variations of the embodiments suitable for specific use considerations.

Claims

1. A display device, characterized in that: include: monitor; The controller is configured to: in response to a request sent by a user, perform deep learning semantic slot parsing on the request to determine a first semantic slot; Detecting whether an error occurs in the first semantic slot of the request, and if an error occurs, determining the business domain of the request; and determining replacement content corresponding to the first semantic slot based on the business domain using a pinyin index, a glyph index, a phonetic code index, and a semantic index; Using the replacement content, replacing the content corresponding to the first semantic slot in the request to form a request to be determined; obtaining a modified request according to the request to be determined; Perform grammatical semantic slot parsing on the modified request to determine the second semantic slot; The first semantic slot and the second semantic slot are combined to obtain the semantic slot of the request.

2. The display device according to claim 1, wherein The controller is further configured to execute: If no error occurs, directly perform grammatical semantic slot parsing on the request to determine the third semantic slot; The first semantic slot and the third semantic slot are combined to obtain the semantic slot of the request.

3. The display device according to claim 1, wherein The step of obtaining a modified request according to the request to be determined comprises: If the number of the request to be determined is one, it is determined that the request to be determined is a modified request.

4. The display device according to claim 3, wherein: The step of obtaining a modified request according to the request to be determined further includes: If the number of the pending requests is greater than one, an optimal pending request is screened out from the multiple pending requests as the modified request.

5. A semantic slot extraction method, characterized in that: include: In response to a request sent by a user, performing deep learning semantic slot parsing on the request to determine a first semantic slot; Detecting whether an error occurs in the first semantic slot of the request, and if an error occurs, determining the business domain of the request; and determining replacement content corresponding to the first semantic slot based on the business domain using a pinyin index, a glyph index, a phonetic code index, and a semantic index; Using the replacement content, replacing the content corresponding to the first semantic slot in the request to form a request to be determined; obtaining a modified request according to the request to be determined; Perform grammatical semantic slot parsing on the modified request to determine the second semantic slot; The first semantic slot and the second semantic slot are combined to obtain the semantic slot of the request.

6. The method according to claim 5, characterized in that The method further comprises: If no error occurs, directly perform grammatical semantic slot parsing on the request to determine the third semantic slot; The first semantic slot and the third semantic slot are combined to obtain the semantic slot of the request.

7. The method according to claim 5, characterized in that The step of obtaining a modified request according to the request to be determined comprises: If the number of the request to be determined is one, it is determined that the request to be determined is a modified request.

8. The method according to claim 7, characterized in that The step of obtaining a modified request according to the request to be determined further includes: If the number of the pending requests is greater than one, an optimal pending request is screened out from the multiple pending requests as the modified request.

Images