A kind of association recommendation method, intelligent device and service device
By finding associated entities in the knowledge graph between smart devices and service devices, the problem that existing recommendation systems are difficult to provide comprehensive associated recommendations is solved, and user experience and information discovery efficiency is improved.
Patent Information
- Application Number
- CN202010692647.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-07-17
- Publication Date
- 2024-11-08
- Estimated Expiration
- 2040-07-17
AI Technical Summary
In the era of information overload, existing recommendation systems are difficult to provide users with more comprehensive and rich related recommendations, especially when users query specific information, they fail to effectively improve the user experience.
By establishing a knowledge graph between smart devices and service devices, using query statements to determine the target entity and find associated entities in the graph, providing more comprehensive correlation recommendations.
It realizes a more comprehensive correlation recommendation for the query statements entered by users during user interaction, improves the user experience and helps users quickly discover more interesting information.
Smart Images

Figure CN111914134B_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present application relate to the field of computer technology, and more specifically, to a method for recommending associations, a smart device, and a service device. Background Art
[0002] At present, users can query and obtain information through smart devices such as smart TVs and smart speakers. In order to better meet users' needs for information acquisition, recommendation systems have emerged. Recommendation systems can make related recommendations for the information queried by users, thereby providing users with relevant information about the queried information.
[0003] Related recommendations have many advantages. For example, in this era of information overload, faced with massive amounts of data, it is difficult for users to search for all the information they may be interested in one by one. In this case, if related recommendations are made for the information that the user has already searched for, it can help the user quickly discover more information that may be of interest to him or her. For example, when a user searches for certain information, such as a specified person, if the specified person is not found, recommending related people of the specified person can improve the user experience better than simply returning the result of "query failed".
[0004] In order to further improve the user experience, how to provide more comprehensive and rich related recommendations is a problem that still needs to be solved. Summary of the invention
[0005] The embodiments of the present application provide a correlation recommendation method, a smart device, and a service device for performing correlation recommendation based on a query statement.
[0006] In a first aspect, a smart device is provided, comprising: an input interface and a controller;
[0007] The controller is configured to:
[0008] Sending the query statement input through the above-mentioned input interface to the service device, so that the service device searches for the associated entity corresponding to the target entity in the established knowledge graph, wherein the above-mentioned knowledge graph is used to represent the semantic relationship between entities, and the above-mentioned target entity is the entity determined according to the above-mentioned query statement;
[0009] The associated entity is obtained from the service device and outputted.
[0010] In a second aspect, a service device is provided, comprising:
[0011] A receiving module, used for receiving a current query statement from a smart device;
[0012] The associated recommendation module is used to find the associated entities corresponding to the target entity in the established knowledge graph. The above knowledge graph is used to represent the semantic relationship between entities. The above target entity is the entity determined based on the above current query statement.
[0013] In a third aspect, a method for association recommendation is provided, which is applied to a smart device and includes:
[0014] Sending the query statement input through the input interface to the service device, so that the service device searches for the associated entity corresponding to the target entity in the established knowledge graph, wherein the knowledge graph is used to represent the semantic relationship between entities, and the target entity is the entity determined according to the query statement;
[0015] The associated entity is obtained from the service device and outputted.
[0016] In a fourth aspect, a method for association recommendation is provided, which is applied to a service device, and includes:
[0017] Receive the current query statement from the smart device;
[0018] Search for associated entities corresponding to the target entity in the established knowledge graph, where the knowledge graph is used to represent the semantic relationship between entities, and the target entity is the entity determined based on the current query statement.
[0019] In the above embodiment, the smart device can send the received query statement to the service device to obtain and output the associated entity corresponding to the target entity determined by the service device according to the query statement. In this way, a more comprehensive associated recommendation can be achieved for the query statement input by the user during the interaction between the smart device and the user. BRIEF DESCRIPTION OF THE DRAWINGS
[0020] In order to more clearly illustrate the implementation methods in the embodiments of the present application or the related technologies, the following is a brief introduction to the drawings required for use in the embodiments or the related technology descriptions. Obviously, the drawings described below are some embodiments of the present application, and a person skilled in the art can also obtain other drawings based on these drawings.
[0021] Figure 1 Schematic diagram of an operation scenario between a display device and a control device according to some embodiments is exemplarily shown in FIG.
[0022] Figure 2 exemplarily shows a hardware configuration block diagram of a display device 200 according to some embodiments;
[0023] Figure 3 exemplarily shows a hardware configuration block diagram of a control device 100 according to some embodiments;
[0024] Figure 4 exemplarily shows a schematic diagram of software configuration in a display device 200 according to some embodiments;
[0025] Figure 5 exemplarily shows a schematic diagram of an icon control interface display of an application in a display device 200 according to some embodiments;
[0026] Figure 6 A schematic diagram of a network architecture provided by an embodiment of the present application is exemplarily shown in FIG.
[0027] Figure 7 The flowchart of the association recommendation method provided by the embodiment of the present application is exemplarily shown in FIG.
[0028] Figures 8A-8G exemplarily shows a schematic diagram of a display screen when outputting associated entities;
[0029] Fig. 9 A flowchart of an association recommendation method applied to a service device is shown in FIG. DETAILED DESCRIPTION
[0030] In order to make the purpose, embodiments and advantages of the present application clearer, the exemplary embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the exemplary embodiments of the present application. Obviously, the described exemplary embodiments are only part of the embodiments of the present application, not all of the embodiments.
[0031] Based on the exemplary embodiments described in this application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the claims attached to this application. In addition, although the disclosure in this application is introduced according to one or several exemplary examples, it should be understood that each aspect of the disclosure can also constitute a complete embodiment separately.
[0032] It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their common and usual meanings.
[0033] The terms "first", "second", "third", etc. in the specification and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise indicated. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances, for example, they can be implemented according to orders other than those given in the diagrams or descriptions of the embodiments of this application.
[0034] In addition, the terms "include" and "have" and any variations thereof are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to those components expressly listed but may include other components not expressly listed or inherent to such products or devices.
[0035] The term "module" as used in this application refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.
[0036] The term "remote control" as used in this application refers to a component of an electronic device (such as the display device disclosed in this application), which can usually wirelessly control the electronic device within a short range. It is generally connected to the electronic device using infrared and / or radio frequency (RF) signals and / or Bluetooth, and may also include functional modules such as WiFi, wireless USB, Bluetooth, motion sensors, etc. For example: a handheld touch remote control replaces most of the physical built-in hard keys in a general remote control device with a user interface in a touch screen.
[0037] The term "gesture" used in this application refers to a user's behavior of expressing an intended idea, action, purpose, or result through a change in hand shape or hand movement.
[0038] To facilitate understanding of the method and smart device provided in the embodiments of the present application, the structure of the display device and the interaction between the display device and the control device are described below by taking a display device in a smart device as an example:
[0039] Figure 1 FIG. 2 is a schematic diagram showing an operation scenario between a display device and a control device according to an embodiment. Figure 1 As shown in FIG. 1 , a user can operate the display device 200 through the mobile terminal 300 and the control apparatus 100 .
[0040] In some embodiments, the control device 100 may be a remote controller, and the communication between the remote controller and the display device includes infrared protocol communication or Bluetooth protocol communication, and other short-range communication methods, etc., to control the display device 200 wirelessly or in a wired manner. The user may input user commands through buttons on the remote controller, voice input, control panel input, etc. to control the display device 200. For example, the user may input corresponding control commands through the volume plus and minus keys, channel control keys, up / down / left / right movement keys, voice input keys, menu keys, power on / off keys, etc. on the remote controller to realize the function of controlling the display device 200.
[0041] In some embodiments, a mobile terminal, a tablet computer, a computer, a laptop computer, and other smart devices may also be used to control the display device 200. For example, an application running on the smart device is used to control the display device 200. The application may be configured to provide the user with various controls in an intuitive user interface (UI) on a screen associated with the smart device.
[0042] In some embodiments, the mobile terminal 300 can install software applications with the display device 200, and realize connection and communication through a network communication protocol to achieve the purpose of one-to-one control operation and data communication. For example, it is possible to establish a control instruction protocol with the mobile terminal 300 and synchronize the remote control keyboard to the mobile terminal 300, and realize the function of controlling the display device 200 by controlling the user interface on the mobile terminal 300. It is also possible to transmit the audio and video content displayed on the mobile terminal 300 to the display device 200 to realize the synchronous display function.
[0043] like Figure 1 It is also shown that the display device 200 also communicates data with the server 400 through various communication methods. The display device 200 may be allowed to communicate and connect via a local area network (LAN), a wireless local area network (WLAN), and other networks. The server 400 may provide various content and interactions to the display device 200. For example, the display device 200 receives software program updates or accesses a remotely stored digital media library by sending and receiving information and interacting with an electronic program guide (EPG). The server 400 may be a cluster or multiple clusters, and may include one or more types of servers. Other network service content such as video on demand and advertising services is provided through the server 400.
[0044] The display device 200 may be a liquid crystal display, an OLED display, or a projection display device. The specific display device type, size, and resolution are not limited. It is understood by those skilled in the art that the display device 200 may be modified in performance and configuration as required.
[0045] In addition to providing the broadcast receiving television function, the display device 200 may also provide an intelligent network television function with computer support functions, including but not limited to network television, smart television, Internet Protocol television (IPTV), etc.
[0046] Figure 2 Schematically shows a hardware configuration block diagram of a display device 200 according to an exemplary embodiment.
[0047] In some embodiments, the display device 200 includes at least one of a controller 250, a tuner and demodulator 210, a communicator 220, a detector 230, an input / output interface 255, a display 275, an audio output interface 285, a memory 260, a power supply 290, a user interface 265, and an external device interface 240.
[0048] In some embodiments, the display 275 is a component for receiving the image signal outputted from the first processor and displaying video content and images as well as a menu control interface.
[0049] In some embodiments, the display 275 includes a display screen component for presenting images and a driving component for driving image display.
[0050] In some embodiments, the displayed video content may be from broadcast television content, or may be various broadcast signals received through wired or wireless communication protocols, or may be from various image content sent from a network server via a network communication protocol.
[0051] In some embodiments, the display 275 is used to present a user manipulation UI interface generated in the display device 200 and used to control the display device 200 .
[0052] In some embodiments, depending on the type of display 275, a driving component for driving the display is also included.
[0053] In some embodiments, the display 275 is a projection display, and may also include a projection device and a projection screen.
[0054] In some embodiments, the communicator 220 is a component for communicating with an external device or an external server according to various communication protocol types. For example, the communicator may include at least one of a Wifi chip, a Bluetooth communication protocol chip, a wired Ethernet communication protocol chip, other network communication protocol chips or a near field communication protocol chip, and an infrared receiver.
[0055] In some embodiments, the display device 200 may establish transmission and reception of control signals and data signals with the external control device 100 or the content providing device through the communicator 220 .
[0056] In some embodiments, the user interface 265 may be used to receive infrared control signals from the control device 100 (eg, an infrared remote controller, etc.).
[0057] In some embodiments, the detector 230 is a signal used by the display device 200 to collect external environment or interact with the outside.
[0058] In some embodiments, the detector 230 includes a light receiver, a sensor for collecting ambient light intensity, and can adaptively display parameter changes by collecting ambient light.
[0059] In some embodiments, the detector 230 may also include an image collector, such as a camera, a webcam, etc., which can be used to collect external environment scenes, as well as to collect user attributes or gestures for interacting with the user. It can adaptively change display parameters and recognize user gestures to achieve the function of interacting with the user.
[0060] In some embodiments, the detector 230 may also include a temperature sensor or the like, such as by sensing the ambient temperature.
[0061] In some embodiments, the display device 200 can adaptively adjust the display color temperature of the image. For example, when the temperature is high, the display device 200 can be adjusted to display a cooler color temperature of the image, or when the temperature is low, the display device 200 can be adjusted to display a warmer color temperature of the image.
[0062] In some embodiments, the detector 230 may also be a sound collector, such as a microphone, which can be used to receive the user's voice, for example, including a voice signal of a control instruction of the user controlling the display device 200, or collect environmental sounds to identify the type of environmental scene, so that the display device 200 can adapt to the environmental noise.
[0063] In some embodiments, Figure 2 As shown, the input / output interface 255 is configured to perform data transmission between the controller 250 and other external devices or other controllers 250, such as receiving video signal data and audio signal data, or command instruction data from external devices.
[0064] In some embodiments, the external device interface 240 may include, but is not limited to, any one or more interfaces such as a high-definition multimedia interface HDMI interface, an analog or digital high-definition component input interface, a composite video input interface, a USB input interface, an RGB port, etc. It is also possible that the above multiple interfaces form a composite input / output interface.
[0065] In some embodiments, Figure 2 As shown, the tuner-demodulator 210 is configured to receive broadcast television signals through wired or wireless reception, and can perform modulation and demodulation processing such as amplification, mixing and resonance, and demodulate audio and video signals from multiple wireless or wired broadcast television signals. The audio and video signals may include television audio and video signals carried in the television channel frequency selected by the user, as well as EPG data signals.
[0066] In some embodiments, the frequency demodulated by the tuner-demodulator 210 is controlled by the controller 250, which can send a control signal based on the user's selection to make the modem respond to the TV signal frequency selected by the user and modulate and demodulate the TV signal carried by the frequency.
[0067] In some embodiments, the broadcast television signal can be classified into terrestrial broadcast signals, cable broadcast signals, satellite broadcast signals, or Internet broadcast signals according to different broadcasting formats of the television signal. Or it can be classified into digital modulation signals, analog modulation signals, etc. according to different modulation types. Or it can be classified into digital signals, analog signals, etc. according to different signal types.
[0068] In some embodiments, the controller 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box. In this way, the set-top box outputs the TV audio and video signals modulated and demodulated from the received broadcast TV signals to the main device, and the main device receives the audio and video signals through the first input / output interface.
[0069] In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The controller 250 can control the overall operation of the display device 200. For example, in response to receiving a user command for selecting a UI object to be displayed on the display 275, the controller 250 can perform operations related to the object selected by the user command.
[0070] In some embodiments, the object may be any one of the selectable objects, such as a hyperlink or an icon. Operations related to the selected object may include, for example, displaying a page, document, image, etc. connected to the hyperlink, or executing a program corresponding to the icon. User commands for selecting UI objects may be commands inputted through various input devices (e.g., a mouse, keyboard, touchpad, etc.) connected to the display device 200 or voice commands corresponding to voices spoken by the user.
[0071] like Figure 2As shown, the controller 250 includes at least one of a random access memory 251 (Random Access Memory, RAM), a read-only memory 252 (Read-Only Memory, ROM), a video processor 270, an audio processor 280, other processors 253 (for example: a graphics processor (Graphics Processing Unit, GPU), a central processing unit 254 (Central Processing Unit, CPU), a communication interface (Communication Interface), and a communication bus 256 (Bus). Among them, the communication bus connects various components.
[0072] In some embodiments, RAM 251 is used to store temporary data for the operating system or other running programs.
[0073] In some embodiments, ROM 252 is used to store various system startup instructions.
[0074] In some embodiments, ROM 252 is used to store a basic input / output system, called Basic Input Output System (BIOS), which is used to complete the power-on self-test of the system, the initialization of each functional module in the system, the basic input / output driver of the system, and the booting operating system.
[0075] In some embodiments, when a power-on signal is received, the display device 200 starts to power on, and the CPU runs the system startup instruction in the ROM 252, and copies the temporary data of the operating system stored in the memory to the RAM 251, so as to start or run the operating system. After the operating system is started, the CPU copies the temporary data of various application programs in the memory to the RAM 251, so as to start or run various application programs.
[0076] In some embodiments, the CPU processor 254 is used to execute operating system and application instructions stored in the memory, and to execute various applications, data and content according to various interactive instructions received from external input, so as to finally display and play various audio and video contents.
[0077] In some exemplary embodiments, the CPU processor 254 may include multiple processors. The multiple processors may include a main processor and one or more sub-processors. The main processor is used to perform some operations of the display device 200 in the pre-power-on mode and / or the operation of displaying the picture in the normal mode. The one or more sub-processors are used for an operation in the standby mode and the like.
[0078] In some embodiments, the graphics processor 253 is used to generate various graphic objects, such as icons, operation menus, and user input command display graphics, etc. It includes an operator that performs operations by receiving various interactive instructions input by the user and displays various objects according to display attributes. It also includes a renderer that renders various objects obtained based on the operator, and the rendered objects are used to be displayed on the display.
[0079] In some embodiments, the video processor 270 is configured to receive an external video signal and perform video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image synthesis, etc. according to the standard codec protocol of the input signal, and obtain a signal that can be directly displayed or played on the display device 200.
[0080] In some embodiments, the video processor 270 includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, etc.
[0081] Among them, the demultiplexing module is used to demultiplex the input audio and video data stream. For example, if MPEG-2 is input, the demultiplexing module demultiplexes it into video signals and audio signals.
[0082] The video decoding module is used to process the demultiplexed video signal, including decoding and scaling.
[0083] The image synthesis module, such as an image synthesizer, is used to superimpose and mix the GUI signal generated by the graphics generator according to the user input or itself with the scaled video image to generate an image signal for display.
[0084] The frame rate conversion module is used to convert the input video frame rate, such as converting the 60Hz frame rate to 120Hz frame rate or 240Hz frame rate. The usual format is implemented by interpolation.
[0085] The display formatting module is used to receive the frame rate converted video output signal and change the signal to conform to the display format signal, such as outputting RGB data signal.
[0086] In some embodiments, the graphics processor 253 can be integrated with the video processor or can be separately configured. When integrated, it can perform processing of graphic signals output to the display. When separately configured, it can perform different functions respectively, such as a GPU+FRC (Frame Rate Conversion) architecture.
[0087] In some embodiments, the audio processor 280 is used to receive an external audio signal, and perform decompression and decoding, as well as noise reduction, digital-to-analog conversion, and amplification processing according to the standard codec protocol of the input signal to obtain a sound signal that can be played in a speaker.
[0088] In some embodiments, the video processor 270 may include one or more chips. The audio processor may also include one or more chips.
[0089] In some embodiments, the video processor 270 and the audio processor 280 may be integrated into separate chips, or may be integrated into one or more chips together with the controller.
[0090] In some embodiments, the audio output receives the sound signal output by the audio processor 280 under the control of the controller 250, such as the speaker 286, and in addition to the speaker carried by the display device 200 itself, can be output to the external audio output terminal of the generating device of the external device, such as an external audio interface or a headphone interface, etc., and can also include a short-range communication module in the communication interface, for example, a Bluetooth module for Bluetooth speaker sound output.
[0091] The power supply 290, under the control of the controller 250, uses the power input from the external power supply to provide power supply support for the display device 200. The power supply 290 may include a built-in power supply circuit installed inside the display device 200, or may be an external power supply installed in the display device 200, providing a power supply interface for an external power supply in the display device 200.
[0092] The user interface 265 is used to receive a user input signal, and then send the received user input signal to the controller 250. The user input signal may be a remote control signal received by an infrared receiver, and may receive various user control signals through a network communication module.
[0093] In some embodiments, the user inputs a user command through the control device 100 or the mobile terminal 300 , the user input interface is based on the user input, and the display device 200 responds to the user input through the controller 250 .
[0094] In some embodiments, the user may input a user command through a graphical user interface (GUI) displayed on the display 275, and the user input interface receives the user input command through the graphical user interface (GUI). Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through a sensor.
[0095] In some embodiments, the "user interface" is a medium interface for interaction and information exchange between an application or operating system and a user, which realizes the conversion between the internal form of information and the form acceptable to the user. The commonly used form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed in a graphical manner. It can be an interface element such as an icon, window, control, etc. displayed on the display screen of an electronic device, where the control can include icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, and other visual interface elements.
[0096] The memory 260 includes storing various software modules for driving the display device 200. For example, the various software modules stored in the first memory include at least one of a basic module, a detection module, a communication module, a display control module, a browser module, and various service modules.
[0097] The basic module is a bottom-level software module used for signal communication between various hardware in the display device 200 and sending processing and control signals to the upper-level modules. The detection module is a management module used to collect various information from various sensors or user input interfaces, and perform digital-to-analog conversion and analysis management.
[0098] For example, the speech recognition module includes a speech analysis module and a speech instruction database module. The display control module is a module for controlling the display to display image content, and can be used to play multimedia image content and UI interface information. The communication module is a module for controlling and communicating data with external devices. The browser module is a module for executing data communication between browsing servers. The service module is a module for providing various services and various applications. At the same time, the memory 260 is also used to store and receive external data and user data, images of various items in various user interfaces, and visual effects of focus objects.
[0099] Figure 3 Schematically shows a configuration block diagram of the control device 100 according to an exemplary embodiment. Figure 3 As shown, the control device 100 includes a controller 110, a communication interface 130, a user input / output interface, a memory, and a power supply.
[0100] The control device 100 is configured to control the display device 200, and can receive the user's input operation instructions, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, playing the role of an interactive intermediary between the user and the display device 200. For example, the user operates the channel increase and decrease keys on the control device 100, and the display device 200 responds to the channel increase and decrease operations.
[0101] In some embodiments, the control device 100 may be a smart device, for example, the control device 100 may be installed with various applications for controlling the display device 200 according to user needs.
[0102] In some embodiments, Figure 1 As shown, the mobile terminal 300 or other smart electronic device can play a similar function to the control device 100 after installing the application for controlling the display device 200. For example, the user can install the application to realize the function of the physical button of the control device 100 through various function keys or virtual buttons of the graphical user interface provided on the mobile terminal 300 or other smart electronic device.
[0103] The controller 110 includes a processor 112, a RAM 113, a ROM 114, a communication interface 130, and a communication bus. The controller is used to control the operation and operation of the control device 100, as well as the communication and cooperation between the internal components and the external and internal data processing functions.
[0104] The communication interface 130, under the control of the controller 110, realizes the communication of control signals and data signals with the display device 200. For example, the received user input signal is sent to the display device 200. The communication interface 130 may include at least one of other near field communication modules such as a WiFi chip 131, a Bluetooth module 132, and an NFC module 133.
[0105] The user input / output interface 140 includes at least one of other input interfaces such as a microphone 141, a touch panel 142, a sensor 143, and a button 144. For example, the user can input user commands through voice, touch, gesture, pressing, and other actions. The input interface converts the received analog signal into a digital signal, and the digital signal into a corresponding command signal, and sends it to the display device 200.
[0106] The output interface includes an interface for sending received user commands to the display device 200. In some embodiments, it can be an infrared interface or a radio frequency interface. For example, in the case of an infrared signal interface, the user input command needs to be converted into an infrared control signal according to an infrared control protocol and sent to the display device 200 via an infrared sending module. Another example is in the case of a radio frequency signal interface, the user input command needs to be converted into a digital signal, which is then modulated according to a radio frequency control signal modulation protocol and sent to the display device 200 via a radio frequency sending terminal.
[0107] In some embodiments, the control device 100 includes at least one of a communication interface 130 and an input / output interface 140. The control device 100 is configured with a communication interface 130, such as a WiFi, Bluetooth, NFC or other module, which can encode the user input command through the WiFi protocol, Bluetooth protocol, or NFC protocol and send it to the display device 200.
[0108] The memory 190 is used to store various operating programs, data and applications for driving and controlling the control device 200 under the control of the controller. The memory 190 can store various control signal instructions input by the user.
[0109] The power supply 180 is used to provide operating power support for each component of the control device 100 under the control of the controller, and can be a battery and related control circuits.
[0110] In some embodiments, the system may include a kernel, a command parser (shell), a file system, and an application. The kernel, shell, and file system together form the basic operating system structure, which allows users to manage files, run programs, and use the system. After power-on, the kernel starts, activates the kernel space, abstracts hardware, initializes hardware parameters, etc., runs and maintains virtual memory, schedulers, signals, and inter-process communication (IPC). After the kernel starts, the shell and user applications are loaded. After startup, the application is compiled into machine code to form a process.
[0111] See also Figure 4 In some embodiments, the system is divided into four layers, from top to bottom, namely, the application layer (Applications) layer (referred to as "application layer"), the application framework layer (Application Framework) layer (referred to as "framework layer"), the Android runtime (Android runtime) and system library layer (referred to as "system runtime library layer"), and the kernel layer.
[0112] In some embodiments, at least one application is running in the application layer, and these applications may be window programs, system settings programs, clock programs, camera applications, etc. provided by the operating system; or they may be applications developed by third-party developers, such as hi-view programs, karaoke programs, magic mirror programs, etc. In specific implementation, the application packages in the application layer are not limited to the above examples, and may actually include other application packages, which are not limited in the embodiments of the present application.
[0113] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications in the application layer. The application framework layer includes some predefined functions. The application framework layer is equivalent to a processing center that determines the actions that applications in the application layer take. Applications can access system resources and obtain system services during execution through the API interface.
[0114] like Figure 4 As shown, in the embodiment of the present application, the application framework layer includes managers, content providers, etc., wherein the manager includes at least one of the following modules: an activity manager (ActivityManager) is used to interact with all activities running in the system; a location manager (Location Manager) is used to provide system services or applications with access to system location services; a package manager (Package Manager) is used to retrieve various information related to the application package currently installed on the device; a notification manager (NotificationManager) is used to control the display and clearing of notification messages; a window manager (Window Manager) is used to manage icons, windows, toolbars, wallpapers, and desktop components on the user interface.
[0115] In some embodiments, the activity manager is used to manage the life cycle of each application and the usual navigation back function, such as controlling the exit of the application (including switching the user interface currently displayed in the display window to the system desktop), opening, and backing (including switching the user interface currently displayed in the display window to the parent user interface of the currently displayed user interface), etc.
[0116] In some embodiments, the window manager is used to manage all window programs, such as obtaining the size of the display screen, determining whether there is a status bar, locking the screen, capturing the screen, controlling display window changes (for example, shrinking the display window, shaking the display, distorting the display, etc.), etc.
[0117] In some embodiments, the system runtime layer provides support for the upper layer, namely the framework layer. When the framework layer is used, the Android operating system will run the C / C++ library contained in the system runtime layer to implement the functions to be implemented by the framework layer.
[0118] In some embodiments, the kernel layer is a layer between hardware and software. Figure 4As shown, the kernel layer includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, touch sensor, pressure sensor, etc.), etc.
[0119] In some embodiments, the core layer further includes a power driver module for performing power management.
[0120] In some embodiments, Figure 4 The software programs and / or modules corresponding to the software architecture in Figure 2 or Figure 3 in the first memory or the second memory shown.
[0121] In some embodiments, taking the magic mirror application (photographing application) as an example, when the remote control receiving device receives the input operation of the remote control, the corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes the input operation into a raw input event (including the value of the input operation, the timestamp of the input operation, and other information). The raw input event is stored in the kernel layer. The application framework layer obtains the raw input event from the kernel layer, identifies the control corresponding to the input event according to the current position of the focus, and the input operation is a confirmation operation, and the control corresponding to the confirmation operation is the control of the magic mirror application icon. The magic mirror application calls the interface of the application framework layer to start the magic mirror application, and then starts the camera driver by calling the kernel layer to realize the capture of static images or videos through the camera.
[0122] In some embodiments, for a display device with a touch function, taking a split-screen operation as an example, the display device receives an input operation (such as a split-screen operation) performed by a user on the display screen, and the kernel layer can generate a corresponding input event according to the input operation, and report the event to the application framework layer. The activity manager of the application framework layer sets the window mode (such as a multi-window mode) and the window position and size corresponding to the input operation. The window management of the application framework layer draws the window according to the settings of the activity manager, and then sends the drawn window data to the display driver of the kernel layer, and the display driver displays the corresponding application interface in different display areas of the display screen.
[0123] In some embodiments, Figure 5 As shown in , the application layer includes at least one application that can display a corresponding icon control in the display, such as: a live TV application icon control, a video on demand application icon control, a media center application icon control, an application center icon control, a game application icon control, etc.
[0124] In order to provide more comprehensive and rich association recommendations, an embodiment of the present application provides an association recommendation method, which can determine the associated entity corresponding to the target entity based on the knowledge graph when it is determined that an association recommendation needs to be made for the target entity based on a query statement (query) input by the user, and output the associated entity.
[0125] In order to clearly illustrate the embodiments of the present application, some explanations of related terms are given below.
[0126] Entity: refers to things that exist objectively and can be distinguished from each other, including specific people, things, organizations, abstract concepts, etc.
[0127] Knowledge graph: It is essentially a semantic network that can represent the semantic relationship between entities. In the knowledge graph, entities are vertices or nodes, and relationships are edges. Knowledge graphs can be constructed in many ways. The focus of the embodiments of this application is not on how to construct a knowledge graph, so this will not be described in detail.
[0128] To clearly illustrate the embodiments of the present application, Figure 6 A network architecture provided in an embodiment of the present application is described.
[0129] See also Figure 6 , Figure 6 A schematic diagram of a network architecture provided for an embodiment of the present application. Figure 6 In the example, the smart device is used to receive input information and output the processing results of the information; the speech recognition service device is an electronic device deployed with a speech recognition service, the semantic service device is an electronic device deployed with a semantic service, and the business service device is an electronic device deployed with a business service. The electronic devices here may include servers, computers, etc. The speech recognition service, semantic service (also called semantic engine) and business service here are web services that can be deployed on electronic devices, wherein the speech recognition service is used to recognize audio as text, the semantic service is used to perform semantic analysis on the text, and the business service is used to provide specific services such as the weather query service of Moji Weather, the music query service of QQ Music, etc. In one embodiment, Figure 6 In the illustrated architecture, there may be multiple business service devices deployed with different business services.
[0130] The following is based on Figure 6 The process of processing the information input into the smart device by the architecture shown is described by way of example. Taking the information input into the smart device as a query statement input by voice as an example, the above process may include the following three stages:
[0131] 1. Speech recognition stage
[0132] After receiving a query statement input by voice, the smart device may upload the audio of the query statement to the voice recognition service device, so that the voice recognition service device recognizes the audio as text through the voice recognition service and returns it to the smart device.
[0133] In one embodiment, before uploading the audio of the query statement to the speech recognition service device, the smart device may perform denoising on the audio of the query statement, and the denoising here may include steps such as removing echoes and environmental noise.
[0134] 2. Semantic understanding stage
[0135] The smart device uploads the text of the query statement recognized by the speech recognition service to the semantic service device, so that the semantic service device performs semantic analysis on the text through the semantic service to obtain the business field, intent, etc. of the text.
[0136] 3. Response phase
[0137] The semantic service device sends a query instruction to the corresponding business service device according to the semantic parsing result of the text of the query statement to obtain the query result given by the business service. The intelligent device can obtain the query result from the semantic service device and output it. As an embodiment, the semantic service device can also send the semantic parsing result of the query statement to the intelligent device, so that the intelligent device can output the feedback statement in the semantic parsing result.
[0138] At this point, the Figure 6 The illustrated architecture provides a description of the process by which information input into a smart device is processed.
[0139] It should be noted that Figure 6 The architecture shown is only an example and is not intended to limit the scope of protection of the present application. In the embodiments of the present application, other architectures may also be used to implement similar functions, which will not be described in detail here.
[0140] The following describes the association recommendation method provided in the embodiment of the present application. In one embodiment, the method can be applied to smart devices such as smart TVs, smart speakers, smart phones, etc. When describing each embodiment below, the association recommendation method is mainly described as an example of a display device in a smart device. The specific implementation of the association recommendation method when applied to other smart devices is similar to that of the display device, and will not be described one by one below.
[0141] Next, from the perspective of display devices, combined with Figure 7 The association recommendation method provided in the embodiment of the present application is described as follows:
[0142] Figure 7 FIG. 4 is an exemplary flowchart of the association recommendation method provided in the embodiment of the present application. Figure 2 The display device and Figure 7 Generally speaking, the process may include the following steps:
[0143] Step S51, sending the received query statement to the service device, so that the service device searches for the associated entity corresponding to the target entity in the established knowledge graph, and the target entity is the entity determined based on the above query statement.
[0144] In one example, the query statement may include: a query statement input by voice, a query statement input by a control device, etc. A user may obtain the required information by inputting a query statement into a smart device, and the query statement may include a variety of contents, for example, a single entity name, such as "actor A", "movie B", etc.; another example, a sentence, such as "who is the leading actor of movie B"; another example, a word without actual meaning, such as "that", "I think", etc. In one embodiment, the query statement is a query statement input through an input interface.
[0145] In one example, the service device in step S51 is at least deployed with a semantic service. As an embodiment, the display device may call a speech recognition service, recognize the query sentence input by speech as text, and then send it to the service device.
[0146] In this step S51, how the service device specifically determines the target entity based on the query statement and how to find the associated entity corresponding to the target entity is described below with examples and will not be elaborated here.
[0147] Step S52: Acquire the above-mentioned associated entity from the service device and output it.
[0148] In one example, the display device outputting the associated entity may include: outputting the associated entity through voice, displaying the associated entity through a display, and other methods. Figures 8A-8G The examples are given below and I will not go into details here.
[0149] So far, the Figure 7 Description of the process shown.
[0150] pass Figure 7 In the process shown, the display device can send the received query statement to the service device to obtain and output the associated entities found by the service device based on the query statement. In this way, a more comprehensive associated recommendation can be achieved for the query statement input to the display device during the interaction between the display device and the user.
[0151] Figures 8A-8G The schematic diagram of the display screen when outputting the associated entity is shown in FIG. Figures 8A-8G An example is given to describe how the display device outputs the associated entity in the above step S52:
[0152] In one example, the service device returns the associated entity in the form of entity information. As an embodiment, the display device outputs the associated entity, which may include: displaying the entity information of the associated entity through a display. The above entity information may include: entity name, entity-related pictures, etc. The entity-related pictures here, for example, when the entity is a person, the entity-related picture may be a person's head portrait, a person's recent photo, etc.; when the entity is a film or TV, the entity-related picture may be a film or TV cover, etc.; when the entity is a game, the entity-related picture may be a game icon, etc.
[0153] Fig. 8A exemplarily shows a schematic diagram of a GUI provided by a display device when outputting associated entities.
[0154] like Fig. 8A As shown, the display device can provide a GUI 600 to the display, wherein the GUI 600 includes an associated entity display area 61 for displaying associated entities, wherein the display area includes items 611-618, which correspond to associated entities 1-8 respectively. Items 611-618 can be specifically displayed as names of associated entities and / or related pictures.
[0155] As an embodiment, the entity information of the associated entity obtained from the service device may include the business field to which the associated entity belongs, where the business field may also be referred to as an entity category, such as people, movies, music, etc. The display device may display the associated entities of different business fields in different areas according to the business field to which the associated entity belongs. As shown in 8B, the associated entity display area is further divided into two areas, where associated entities belonging to people and associated entities belonging to movies are arranged respectively, wherein entities 1-4 all belong to people, and entities 5-8 all belong to movies.
[0156] In one embodiment, the display device may use at least one of the associated entities obtained from the service device as the associated entity to be displayed in focus. Compared with other associated entities, the display device may display more entity information for the associated entity to be displayed in focus, occupy more display area for display, and so on. Figure 8C As shown, entity 1 is the highlighted associated entity. As an embodiment, the first associated entity among the associated entities returned by the service device can be used as the highlighted associated entity.
[0157] In one example, the display device outputting the associated entity may include: outputting the entity information of the associated entity by voice. As an embodiment, the display device may generate text to be output by voice based on a preset text template and the entity information of the associated entity, and output the text by voice. Taking the text template as "Recommend [entity name] for you" and the entity name of the associated entity as "Character A" as an example, the text to be output by voice generated based on the text template and the entity name of the associated entity is "Recommend Character A for you". As another embodiment, the display device may obtain the text to be output by voice from the service device and output it. As an embodiment, when the display device outputs the associated entity by voice, the text corresponding to the voice output may be displayed on the display.
[0158] In one example, the display device outputting the associated entity may include: outputting the associated entity through voice and displaying the associated entity on a display. Figures 8D-8E Provide an example description.
[0159] As an embodiment, the associated entity output by voice may be one of the associated entities displayed on the display. Fig.8D As shown, the GUI 600 provided by the display device to the display also includes a voice text display area 62 for displaying text corresponding to the voice output. Fig.8D In the figure, the text displayed in the voice text display area 62 is the text corresponding to the voice output entity 1, and the entity 1 is an associated entity highlighted in the associated entity display area 61.
[0160] As an embodiment, the associated entities output by voice may be at least two associated entities among the associated entities displayed on the display. Fig. 8E As shown, the text displayed in the voice text display area 62 is the text corresponding to the voice output entities 1-4, and the entities 1-4 are multiple related entities displayed in the related entity display area 61.
[0161] In one example, when the display device obtains the associated entity from the service device, it also obtains the target entity corresponding to the associated entity. As an embodiment, the display device can output the target entity by voice and display the target entity and the associated entity through a display.
[0162] like Figure 8F As shown, the GUI 600 provided by the display device to the display also includes a target entity display area 63 for displaying the target entity. Specifically, the target entity display area 63 can be used to display entity information of the target entity. Figure 8F In the figure, the target entity display area 63 displays entity A as the target entity, the text displayed in the voice text display area 62 is the text corresponding to the voice output entity A, and the associated entity display area 61 displays the associated entities corresponding to entity A.
[0163] In one example, when outputting the associated entity, the display device may also display the text of the query statement received in step S51 through the display. Figure 8G As shown, the GUI 600 provided by the display device to the display also includes a query statement display area 64 for displaying the text of the received query statement. As an embodiment, the text of the query statement can be the text obtained by the display device calling a speech recognition service to recognize the query statement.
[0164] In one example, when the display device obtains the associated entity from the service device, it can also obtain the query result of the query statement. The query result can be obtained by referring to the above-mentioned Figure 6 In one embodiment, the display device may display the query result and the associated entity in different areas on the display, which will not be described in detail here.
[0165] It should be noted that when outputting the associated entity through the above embodiments, each embodiment can be used separately or in combination, and this application does not specifically limit this. Moreover, in actual application, there are many ways to implement the display device outputting the associated entity, and the above embodiments are only examples and are not intended to be limiting.
[0166] The following describes the association recommendation method provided by the embodiment of the present application from the perspective of the service device, mainly describing by example how the service device determines the target entity based on the query statement, and how to find the associated entity corresponding to the target entity in the knowledge graph.
[0167] Fig. 9 exemplarily shows a flow chart of the association recommendation method applied to a service device. Fig. 9 As shown, the process includes the following steps:
[0168] In step S71, the service device receives a query statement from the display device and determines whether the query statement satisfies a preset association recommendation condition; if so, the target entity is determined based on the query statement.
[0169] As an embodiment, after receiving the query statement from the display device, the service device may perform semantic analysis on the query statement to subsequently determine whether the query statement meets the associated recommendation condition. In one embodiment, the service device may perform semantic analysis on the query statement through a deployed semantic service. This application does not limit the specific semantic analysis process.
[0170] In actual application, there are many ways to determine the target entity based on the query statement. In one example, for a query statement that meets the preset association recommendation conditions, if the query statement contains an entity name, the entity corresponding to the entity name contained in the query statement can be determined as the target entity; if the query statement does not contain an entity name, the query statement is used as the current query statement, and the target entity is determined based on the previous query statement of the current query statement. The previous query statement here comes from the same display device as the current query statement, and the process of determining the target entity based on the previous query statement can refer to the above process of determining the target entity based on the current query statement.
[0171] As an embodiment, a query statement received within a preset time before the current query statement and received most recently from the current query statement may be determined as the previous query statement. If there is no previous query statement, a preset default entity may be determined as the target entity.
[0172] To facilitate understanding, the following describes how to determine the target entity based on a query statement by combining how to determine whether the query statement meets the preset association recommendation conditions:
[0173] In one example, when the query statement is a single entity name, it is determined that the preset association recommendation condition is met. The entity name here is, for example, a character name, a movie name, a music name, a game name, a food name, etc. As an embodiment, after determining that the query statement is a single entity name, the entity corresponding to the single entity name can be determined as the target entity.
[0174] In another example, when the information to be obtained by the query statement cannot be found, it is determined that the query statement meets the preset associated recommendation condition. The information to be obtained by the query statement cannot be found here. For example, if the query statement is "Who is the daughter of character A?", if the service device does not find the information of the daughter of character A, it can be determined that the information to be obtained by the query statement cannot be found. As an embodiment, when the information to be obtained by the query statement cannot be found, the service device can determine the entity contained in the query statement as the target entity. When the information to be obtained by the query statement cannot be found, returning relevant information of the query can achieve a better user experience than simply returning the query result.
[0175] In another example, when the query statement does not have clear semantics, it is determined that the preset related recommendation conditions are met. For example, the query statement without clear semantics here may be "that", "I want", etc. As an embodiment, when the query statement does not have clear semantics, the service device may determine the entity corresponding to the entity name contained in the previous query statement of the received query statement as the target entity. Generally speaking, users will input query statements without clear semantics when their needs are unclear or they cannot accurately describe their needs. At this time, related recommendations are made for the query statements previously output by the user, which can help users find the information they need and guide users to make the next query.
[0176] In another example, when the number of semantically identical query statements received from the same display device within a certain period of time reaches a threshold, it is determined that the preset associated recommendation condition is met. As an embodiment, when the semantic similarity of two query statements reaches a threshold, it can be determined that the two query statements are semantically identical. As an embodiment, the service device can determine the entities contained in the semantically identical query statements as target entities. The number of semantically identical query statements reaches the threshold, indicating that the user has input semantically identical query statements to the display device multiple times. Generally speaking, this situation occurs because the query that the user has conducted has not obtained the desired query result. In this case, making an associated recommendation can achieve a better user experience than simply returning the same query result.
[0177] It should be noted that when determining whether a query statement satisfies a preset association recommendation condition through the above embodiments, each embodiment can be used separately, or at least two embodiments can be used in combination. When used in combination, as an embodiment, when a query statement does not satisfy all the association recommendation conditions in the embodiments used in combination, it can be determined that it does not satisfy the association recommendation condition. The above embodiments are only examples, and other implementation methods that are easy to think of in actual applications are not described in detail one by one.
[0178] Step S72: according to the preset association recommendation rules, search for the associated entity corresponding to the target entity in the established knowledge graph.
[0179] This step S72 is performed when it is determined in the above step S71 that the query statement satisfies the associated recommendation condition and the target entity has been determined based on the query statement.
[0180] In one example, the association recommendation rules in step S72 include: association recommendation rules corresponding to the business field to which the target entity belongs. As an embodiment, a correspondence between business fields and association recommendation rules is set in the service device. Before searching for the associated entity corresponding to the target entity according to the association recommendation rules, the service device may determine the business field to which the target entity belongs, and search for the association recommendation rules corresponding to the business field in the correspondence between the business field and the association recommendation rules. As an embodiment, the business field to which the target entity belongs may be determined in a variety of ways, for example, determining the business field of the target entity according to the attribute value of the business field attribute of the target entity, determining the business field of the target entity according to the label of the target entity, and so on.
[0181] In one embodiment, the association recommendation rules corresponding to the business field can be determined based on the analysis of a large number of query statements input by users. For example, a large number of adjacent query statements input by users can be obtained to analyze the associations between entities in the user's query. As an embodiment, the association recommendation rules can be appropriately adjusted at regular intervals based on the query statements input by users within the certain period of time.
[0182] The specific method of searching for the associated entities corresponding to the target entity in the knowledge graph according to the associated recommendation rules is described in the following example and will not be elaborated here.
[0183] In an example, the business field to which the target entity belongs may correspond to one association recommendation rule, or may correspond to at least two association recommendation rules.
[0184] When the business field to which the target entity belongs corresponds to an associated recommendation rule, as an embodiment, the service device may search for associated entities corresponding to the target entity in the knowledge graph according to the associated recommendation rule.
[0185] When the business field to which the target entity belongs corresponds to at least two association recommendation rules, as an embodiment, the service device can search for the associated entities corresponding to the target entity in the knowledge graph according to the at least two association recommendation rules. As an embodiment, the associated entities returned by the service device to the display device have a certain order, and the same associated entities found according to the at least two association recommendation rules can be placed at the front of the associated entities when sorting.
[0186] When the business field to which the target entity belongs corresponds to at least two association recommendation rules, as another embodiment, the service device may search for the associated entity corresponding to the target entity according to one of the at least two association recommendation rules, and when the found associated entity does not meet the preset condition, further search according to other association recommendation rules in the at least two association recommendation rules. The preset condition here may include: the number of found associated entities is less than a threshold, etc.
[0187] So far, the Fig. 9 Description of the process shown.
[0188] pass Fig. 9 The process shown in the figure describes the association recommendation method provided by the embodiment of the present application from the perspective of the service device. Fig. 9 The process shown can recommend target entities in different business fields according to different association recommendation rules.
[0189] In one example, the service device can be executed by multiple modules. Fig. 9 As an embodiment, the service device may include a receiving module and an associated recommendation module. The receiving module is used to receive a query statement from the display device; the associated recommendation module is used to determine whether the query statement meets the preset associated recommendation condition; if so, the target entity is determined according to the query statement, and the associated entity corresponding to the target entity is searched in the knowledge graph according to the preset associated recommendation rule.
[0190] Below Fig. 9 In the process shown, an example is given to describe how to find the associated entities corresponding to the target entity in the knowledge graph according to the associated recommendation rules:
[0191] In one example, the business field may include at least one of people, movies, music, games, and food. The following is an example description of the association recommendation rules corresponding to each business field:
[0192] As an embodiment, the associated recommendation rules corresponding to characters may include: recommending character entities with specified character relationships with the target entity, where the specified character relationships may include: spouse, children, parents, teammates, mentors, etc.; recommending characters with the same profession as the target entity, where the same profession may include: doctors, film and television actors, singers, athletes, etc. For some professions with multiple sub-classifications, different sub-classifications may be determined as different professions. For example, for athletes, they have multiple sub-classifications divided according to different sports, such as: basketball players, football players, table tennis players, etc., and different sub-classifications may be regarded as different professions.
[0193] As an embodiment, the associated recommendation rules corresponding to movies and TV shows may include: recommending movies and TV shows that belong to the same movie and TV show type as the target entity; recommending the starring actor of the target entity; recommending the director of the target entity; recommending movies and TV shows with the same starring actor as the target entity; recommending other movies and TV shows directed by the director of the target entity; and so on.
[0194] As an embodiment, the associated recommendation rules corresponding to music may include: recommending music of the same musical style as the target entity. When recommending, music with a high similarity to the target entity name may be given priority. Here, the music styles may include: Chinese style, pop, classical, lyrical, etc.; recommending music with the same singer as the original singer of the target entity; recommending music with the same lyricist as the target entity; recommending music with the same composer as the target entity; recommending the target entity sung by non-original singers; and so on.
[0195] As an example, the associated recommendation rules corresponding to games may include: recommending games of the same game type as the target entity; recommending games of the same theme as the target entity. The above game types may include: first-person shooting, puzzle, strategy, role-playing, etc., and the above themes may include: war, strategy, fashion, etc.
[0196] As an example, the associated recommendation rules corresponding to food may include: recommending food of the same cuisine as the target entity; recommending food of the same flavor as the target entity. The above-mentioned cuisine may include the eight traditional Chinese cuisines, and may also include other cuisines such as Beijing cuisine and Northeastern cuisine. The above-mentioned flavors may include: one or a combination of sour, sweet, bitter, spicy, salty, and fresh.
[0197] The target entity in the association recommendation rule in the above embodiments is an entity determined according to the query statement.
[0198] In one example, searching for associated entities corresponding to a target entity in a knowledge graph according to an association recommendation rule may include: determining the associated entities corresponding to the target entity in the knowledge graph based on the business field to which the target entity belongs, the association relationship between the target entity and other entities, and / or the attributes of the target entity.
[0199] As an embodiment, based on the business field to which the target entity belongs, an entity having a specified association relationship with the target entity can be searched in the knowledge graph, and the found entity can be determined as the associated entity corresponding to the target entity; or based on the business field to which the target entity belongs, an entity having the same specified attribute value as the target entity can be searched in the knowledge graph, and the found entity can be determined as the associated entity corresponding to the target entity.
[0200] The above-mentioned designated relationship and designated attribute value can be determined according to the association recommendation rules corresponding to the business field to which the target entity belongs. For example, if the business field to which the target entity belongs is people, the designated relationship can be determined as a designated person relationship according to the association recommendation rules corresponding to people, and the entity whose relationship with the target entity is a designated person relationship can be searched in the knowledge graph, and the found entity can be determined as an associated entity of the target entity; the designated attribute value can also be determined as the "professional attribute value" of the target entity according to the association recommendation rules corresponding to people, and the entity with the designated attribute value can be searched in the knowledge graph, and the found entity can be determined as an associated entity of the target entity.
[0201] In one embodiment, the knowledge graph may be a knowledge graph built based on tools such as Neo4j, TigerGraph, OrientDB, etc. The following takes the knowledge graph built based on Neo4j as an example to describe how to find the associated entity corresponding to the target entity in the knowledge graph:
[0202] In one example, for a knowledge graph built based on Neo4j, a specified entity can be searched in the knowledge graph through a rule expression relationship chain. The rule expression relationship chain can search for a specified entity by limiting the attributes of the entity, the relationship between entities, etc. As an embodiment, the service device can generate a rule expression relationship chain according to the association recommendation rule to search for the associated entity corresponding to the target entity in the knowledge graph.
[0203] When generating a rule expression relationship chain according to the association recommendation rule, as an embodiment, the service device can determine the rule expression relationship chain template corresponding to the association recommendation rule corresponding to the business field to which the target entity belongs based on the correspondence between the preset association recommendation rule and the rule expression relationship chain template, and the rule expression relationship chain template includes a part where keywords need to be entered; the service device can obtain the specified attribute value of the target entity as a keyword, input it into the determined rule expression relationship chain template, and generate a rule expression relationship chain.
[0204] As an embodiment, by expressing the relationship chain template through rules, the number and order of the found related entities can also be limited.
[0205] To facilitate understanding of the above content, the following is a description with specific examples:
[0206] For example, the target entity is sweet and sour pork, the business field to which the target entity belongs is food, and the associated recommendation rule corresponding to food is: recommend food that belongs to the same cuisine as the target entity. The service device searches for the rule expression relationship chain template corresponding to "recommend food that belongs to the same cuisine as the target entity".
[0207] Assume that the rule expression relationship chain template found is as follows:
[0208] "MATCH (n)-[r:relate]-(m)-[t:relate]-(s:'美食') WHERE id(n) = ENTITY AND r.name = '菜系' AND m.name = '[菜系属性值]' AND t.name = '菜系' AND n.name = '[名称属性值]' AND s.describeNum > 50 RETURN s ORDER BY s.describeNum LIMIT 10"。
[0209] This rule expression relationship chain is used to find entities whose business domain is food and whose cuisine is [cuisine attribute value]. Among them, [cuisine attribute value] and [name attribute value] are the parts where keywords need to be input.
[0210] First, briefly describe the meaning of some parts in this rule expression relationship chain template:
[0211] "(n)-[r:relate]-(m)-[t:relate]-(s:'美食')" means that there is a relationship r between entity n and entity m, and there is a relationship t between entity m and entity s;
[0212] "r.name = '菜系'" means that the name of relationship r is cuisine, "t.name = '菜系'" means that the name of relationship t is cuisine, "n.name = '[名称属性值]'" means that the name of entity n is [name attribute value], and "m.name = '[菜系属性值]'" means that the name of m is [cuisine attribute value];
[0213] "RETURN s" means that the output entity is the entity represented by s in this rule expression relationship chain template; "ORDER BY s.describeNum" means sorting the output entities according to the describeNum attribute; "LIMIT 10" means limiting the number of output entities to 10.
[0214] According to the above rule expression relationship chain template, the service device can obtain the attribute values of the "cuisine" attribute and the "name" attribute of the target entity Sweet and Sour Pork Tenderloin as keywords, and input this keyword into the rule expression relationship chain template to generate a rule expression relationship chain.
[0215] Taking the attribute value of the "cuisine" attribute of Sweet and Sour Pork Tenderloin as "Zhejiang cuisine" as an example, the generated rule expression relationship chain is as follows:
[0216] "MATCH (n)-[r:relate]-(m)-[t:relate]-(s:'美食') WHERE id(n) = ENTITY AND r.name = '菜系' AND m.name = '浙菜' AND t.name = '菜系' AND n.name = '糖醋里脊' AND s.describeNum > 50 RETURN s ORDER BY s.describeNum LIMIT 10".
[0217] So far, the description of how to find the associated entities corresponding to the target entity in the knowledge graph according to the associated recommendation rules in the Fig. 9 shown process is completed. It should be noted that the above embodiments are only examples, and there may be other associated recommendation rules and other ways to find the associated entities corresponding to the target entity in the knowledge graph in actual applications, which will not be described one by one here.
[0218] As described in the above embodiments, the display device can send the received query statement to the service device, so that the service device determines the target entity that needs to be associated and recommended according to the query statement, and finds the associated entity corresponding to the target entity in the knowledge graph. The display device obtains the associated entity and outputs it. Thus, in the interaction process between the display device and the user, relatively rich and comprehensive associated recommendations can be made for the query statement input by the user, improving the user experience.
[0219] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions recorded in the foregoing embodiments, or perform equivalent replacements on some or all of the technical features; and these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.
[0220] For the sake of convenience of explanation, the above description has been made in combination with specific implementation manners. However, the above exemplary discussion is not intended to be exhaustive or to limit the implementation manners to the specific forms disclosed above. According to the above teachings, various modifications and variations can be obtained. The selection and description of the above implementation manners are for better explaining the principles and actual applications, so that those skilled in the art can better use the implementation manners and various different implementation manners suitable for specific use considerations.
Claims
1. A smart device, It is characterized in that include: Input interfaces and controllers; The controller is configured to: Sending the query statement input through the input interface to the service device, so that the service device determines the business domain to which the target entity belongs, and searches for the association recommendation rule corresponding to the business domain to which the target entity belongs in the correspondence relationship between the business domain and the association recommendation rule; According to the correspondence between the preset association recommendation rules and the rule expression relationship chain template, determine the rule expression relationship chain template corresponding to the association recommendation rule corresponding to the business field to which the target entity belongs; input the obtained designated attribute value of the target entity as a keyword into the rule expression relationship chain template to generate a rule expression relationship chain; wherein the designated attribute value is determined according to the business field to which the target entity belongs; According to the rule expression relationship chain, searching for the associated entity corresponding to the target entity in the knowledge graph, wherein the knowledge graph is used to represent the semantic relationship between entities, and the target entity is the entity determined according to the query statement; The associated entity is obtained from the service device and outputted.
2. The smart device according to claim 1, It is characterized in that The smart device is a display device; The controller is configured to output the associated entity by voice, and / or output the associated entity to a display so as to display the associated entity by the display.
3. A service device, It is characterized in that include: A receiving module, used for receiving a current query statement from a smart device; An association recommendation module, used to determine the business field to which the target entity belongs, and to search for an association recommendation rule corresponding to the business field to which the target entity belongs in the correspondence between the business field and the association recommendation rule; According to the correspondence between the preset association recommendation rules and the rule expression relationship chain template, determine the rule expression relationship chain template corresponding to the association recommendation rule corresponding to the business field to which the target entity belongs; input the obtained designated attribute value of the target entity as a keyword into the rule expression relationship chain template to generate a rule expression relationship chain; wherein the designated attribute value is determined according to the business field to which the target entity belongs; According to the rule expression relationship chain, the associated entity corresponding to the target entity is searched in the knowledge graph, the knowledge graph is used to represent the semantic relationship between entities, and the target entity is the entity determined according to the query statement.
4. The service device according to claim 3, It is characterized in that The business areas include at least one of characters, film and television, music, games and food.
5. The service device according to claim 3, It is characterized in that The association recommendation module is specifically used for: When the current query statement satisfies the preset association recommendation condition, if the current query statement contains an entity name, an entity corresponding to the entity name is determined as a target entity; If the current query statement does not include an entity name, the entity corresponding to the entity name in the previous query statement received is determined as the target entity.
6. A method for association recommendation, It is characterized in that Applied to smart devices, including: Sending the query statement input through the input interface to the service device, so that the service device determines the business field to which the target entity belongs, and searches for the association recommendation rule corresponding to the business field to which the target entity belongs in the correspondence between the business field and the association recommendation rule; determining the rule expression relationship chain template corresponding to the association recommendation rule corresponding to the business field to which the target entity belongs according to the correspondence between the preset association recommendation rule and the rule expression relationship chain template; inputting the obtained designated attribute value of the target entity as a keyword into the rule expression relationship chain template to generate a rule expression relationship chain; wherein the designated attribute value is determined according to the business field to which the target entity belongs; According to the rule expression relationship chain, the associated entity corresponding to the target entity is searched in the knowledge graph, the knowledge graph is used to represent the semantic relationship between entities, and the target entity is the entity determined according to the query statement.
7. A method for association recommendation, It is characterized in that Applied to service equipment, including: Receive the current query statement from the smart device; Determine the business domain to which the target entity belongs, and search for the association recommendation rule corresponding to the business domain to which the target entity belongs in the correspondence between the business domain and the association recommendation rule; determine the rule expression relationship chain template corresponding to the association recommendation rule corresponding to the business domain to which the target entity belongs based on the correspondence between the preset association recommendation rule and the rule expression relationship chain template; input the obtained specified attribute value of the target entity as a keyword into the rule expression relationship chain template to generate a rule expression relationship chain; wherein the specified attribute value is determined according to the business domain to which the target entity belongs; According to the rule expression relationship chain, the associated entity corresponding to the target entity is searched in the knowledge graph, the knowledge graph is used to represent the semantic relationship between entities, and the target entity is the entity determined according to the query statement.
