Device and method for automatically identifying PC application scene and recommending corresponding AI tool

Abstract

The invention discloses a device and method for automatically identifying a PC application scene and recommending a corresponding AI tool, and the method comprises the steps: capturing a current screen of a PC, and transmitting the current screen to an AI expansion screen device connected with the PC; using a multi-mode AI large model to identify and obtain the content of the screenshot, and determining the current application scene of the PC; automatically recommending a corresponding AI tool according to the application scene, and displaying a function button of the AI tool; and in response to the operation on the function button, executing corresponding AI processing, and displaying a processing result on a touch screen of the AI extended screen equipment. According to the method and the device, the most suitable AI tool can be automatically analyzed and activated according to the real-time change of the PC screen content, manual operation of a user is not needed, the working efficiency is improved, and the user experience is improved.

Description

Technical Field

[0001] The present invention relates to the field of AI intelligent assistant technology, and specifically to a device and method for automatically identifying PC application scenarios and recommending corresponding AI tools. Background Art

[0002] AI-powered assistants have significantly improved office efficiency. For example, Siri, Google Assistant, and Cortana can recognize user voice commands and execute tasks. Some AI image recognition and processing software can identify and edit images, providing enhancements, style transfer, and other features.

[0003] However, existing AI assistants are based on user-initiated commands to activate their functions and can only handle certain specific tasks. They are unable to automatically recommend corresponding AI tools based on the content on the current PC screen. Their efficiency and user experience need to be further improved. Summary of the Invention

[0004] In response to the above-mentioned defects, the technical problem to be solved by the present invention is to provide a device and method for automatically identifying PC application scenarios and recommending corresponding AI tools, so as to solve the problem that the existing technology starts the AI ​​function based on the user's active instructions and cannot automatically recommend the corresponding AI tool based on the content on the current PC screen.

[0005] To this end, the first aspect of the present application provides a method for automatically identifying PC application scenarios and recommending corresponding AI tools, comprising the following steps:

[0006] Capture the current PC screen and send the screenshot to the AI ​​expansion screen device connected to the PC;

[0007] The AI ​​extended screen device uses a multimodal AI large model to identify the content of the screenshot;

[0008] Determine the current application scenario of the PC based on the content of the screenshot, wherein the application scenario includes a document scenario, a picture scenario, a translation scenario, and a chat scenario;

[0009] Automatically recommend corresponding AI tools based on application scenarios and display the function buttons of AI tools on the touch screen of the AI ​​expansion screen device;

[0010] In response to the operation of the function button, the corresponding AI processing is performed and the processing results are displayed on the touch screen of the AI ​​expansion screen device.

[0011] Based on the above technical solutions, this application can automatically analyze and activate the most suitable AI tool according to the real-time changes of the PC screen content, without the need for manual operation by the user, thereby improving work efficiency and enhancing the user experience.

[0012] In the above technical solution, preferably, the application scenario is determined to be a document scenario based on the content of the screenshot, and the function button includes at least one of the following tools: automatic summary, text continuation, text proofreading and text polishing, and the corresponding function button is activated and presented according to the length and content of the document.

[0013] In the above technical solution, preferably, the application scenario is determined to be a picture scene based on the content of the screenshot being a picture or an image, and the function button of the AI ​​tool includes at least one of the following tools: picture restoration, style conversion and object detection, and the corresponding function button is activated and presented according to the elements in the picture or image.

[0014] In the above technical solution, preferably, based on the fact that the content of the screenshot is text and the language of the text is different from the system default language, it is determined that the application scenario is a translation scenario, and the function button of the AI ​​tool includes at least one of the following tools: full-text translation, word-marking translation, and paragraph translation.

[0015] In the above technical solution, preferably, the application scenario is determined to be a chat scenario based on the content of the screenshot being the chat content, and the function button of the AI ​​tool includes at least one of the following tools: reply suggestions, sentiment analysis, tone optimization and automatic reply.

[0016] In the above technical solution, preferably, the chat content and the conversation context are analyzed in real time, and corresponding function buttons are activated and presented according to the conversation context.

[0017] In the above technical solution, preferably, the current screen of the PC is captured automatically at a scheduled time or manually by using a shortcut key, and in response to the operation of capturing the current screen of the PC, the obtained screenshot is sent to the AI ​​extended screen device.

[0018] A second aspect of the present application provides a device that automatically identifies PC application scenarios and recommends corresponding AI tools, connected to an AI server, on which a multimodal AI large model is provided. The device interacts with the multimodal AI large model via an API, and is connected to a PC as an extended screen, including:

[0019] The screen capture module is used to capture the current PC screen and send the screenshot to the AI ​​server to identify the content of the screenshot:

[0020] A scene recognition module is used to determine the current application scene of the PC based on the content of the cloud screenshot, wherein the application scene includes a document scene, a picture scene, a translation scene, and a chat scene;

[0021] Tool recommendation module, used to automatically recommend corresponding AI tools based on application scenarios;

[0022] An operation response module, configured to execute corresponding AI processing in response to an operation on a function button of the AI ​​tool;

[0023] Touch screen, used to display the function buttons of AI tools and AI processing results.

[0024] In the above technical solution, preferably, a microphone is also included, and a pickup button is provided on the display interface of the AI ​​tool on the touch screen. In response to the operation of the pickup button, the microphone captures the user's voice, converts it into text display or generates voice instructions, and the operation response module performs corresponding processing according to the voice instructions.

[0025] In the above technical solution, preferably, the screen capture module captures the current screen of the PC automatically by timing or manually by using shortcut keys.

[0026] As can be seen from the above technical solution, the device and method provided by this application, which automatically identifies PC application scenarios and recommends corresponding AI tools, solves the problem that existing AI smart assistants are based on user-initiated instructions to activate functions, and the efficiency and user experience need to be further improved. Compared with the existing technology, the present invention has the following beneficial effects:

[0027] The AI ​​extended screen device is connected to a PC, automatically or manually capturing the current screen of the PC at a scheduled time, using a large multimodal AI model to identify the content of the screenshot, and determining the current application scenario of the PC based on the content of the screenshot. It automatically recommends corresponding AI tools based on the application scenario. This automated response greatly reduces user intervention, improves work efficiency, and can provide a smoother, more natural and efficient user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] To more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces and describes the drawings required for use in the embodiments of the present invention or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present invention, and those skilled in the art can derive other drawings based on these drawings without inventive effort.

[0029] Figure 1 A flowchart of a method for automatically identifying PC application scenarios and recommending corresponding AI tools provided by the present invention;

[0030] Figure 2 This is a software architecture diagram of a device provided by the present invention that automatically identifies PC application scenarios and recommends corresponding AI tools;

[0031] Figure 3This is a hardware architecture diagram of a device provided by the present invention that automatically identifies PC application scenarios and recommends corresponding AI tools;

[0032] Figure 4 This is a diagram of the device interface in the present invention;

[0033] Figure 5 Schematic diagram of the application scenario of the present invention. DETAILED DESCRIPTION

[0034] The following will clearly and completely describe the technical solutions of the embodiments of the present invention in conjunction with the accompanying drawings of the embodiments of the present invention. Obviously, the embodiments described below are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts shall fall within the scope of protection of the present invention.

[0035] In order to more clearly explain and illustrate the technical solution and implementation of the present invention, several preferred specific embodiments for implementing the technical solution of the present invention are introduced below.

[0036] It should be noted that the directional words such as "inside, outside", "front, back" and "left, right" in this article are expressed based on the product usage status. Obviously, the use of the corresponding directional words does not constitute a limitation on the scope of protection of this scheme.

[0037] like Figure 1 As shown, the present application provides a method for automatically identifying PC application scenarios and recommending corresponding AI tools, including the following steps:

[0038] Step 110: Capture the current screen of the PC and send the obtained screenshot to the AI ​​expansion screen device connected to the PC.

[0039] In this embodiment, the current screen of the PC can be captured automatically by timing or manually by using shortcut keys. In response to the operation of capturing the current screen of the PC, the obtained screenshot is sent to the AI ​​extended screen device.

[0040] For example, automatically perform a screen scraping operation every 5 or 10 seconds.

[0041] Alternatively, a custom screenshot shortcut key (such as Ctrl+Q) is set. When the user manually presses the screen capture shortcut key, the screen capture operation is performed and the obtained screenshot is sent to the AI ​​extended screen device.

[0042] Users can flexibly configure two screen capture modes: automatic timing or manual shortcut keys according to application scenarios.

[0043] In step 120, the AI ​​extended screen device uses a multimodal AI large model to identify the content of the screenshot, and the identified content of the screenshot includes: text, pictures, web pages, charts, codes, etc.

[0044] The AI ​​expansion screen device connects to an AI server, which hosts a multimodal AI model that provides image recognition services, LLM services, and a knowledge base. The AI ​​expansion screen device interacts with the multimodal AI model through an API to identify the content of the captured screenshot, perform AI processing, and return the results.

[0045] Regarding text and image recognition, the following methods can be used:

[0046] (1) Use OCR to try to recognize the content of the screenshot. If the text information can be successfully extracted, it means the content is text; if it cannot be extracted or the recognition fails, it is likely an image.

[0047] (2) Analyze the pixel features of the screen content. Text usually has regular arrangement and clear edges, while pictures may contain complex textures and irregular patterns.

[0048] Step 130 , determining the current application scenario of the PC based on the content of the screenshot, where the application scenarios include document scenario, image scenario, translation scenario, and chat scenario.

[0049] For example: based on the content of the screenshot being a document, the current application scenario of the PC is determined to be a document scenario; based on the content of the screenshot being a picture or image, the current application scenario of the PC is determined to be a picture scenario; based on the content of the screenshot being text, and the language of the text being different from the system default language, the current application scenario of the PC is determined to be a translation scenario; based on the content of the screenshot being chat content, the current application scenario of the PC is determined to be a chat scenario.

[0050] Step 140 automatically recommends corresponding AI tools based on the application scenario and displays the function buttons of the AI ​​tools on the touch screen of the AI ​​expansion screen device. This automatically provides users with the most suitable AI auxiliary tools for the current application scenario, improving work efficiency and user experience.

[0051] For example, in document scenarios, function buttons could include automatic summarization, text continuation, proofreading, and text polishing. For image scenarios, function buttons could include image restoration, style conversion, and object detection. For translation scenarios, function buttons could include full-text translation, word-marking translation, and paragraph translation. For chat scenarios, function buttons could include reply suggestions, sentiment analysis, tone optimization, and automatic replies.

[0052] In step 150, in response to the operation of the function button, the corresponding AI processing is performed and the processing results are displayed on the touch screen of the AI ​​expansion screen device. The user can refer to the AI ​​processing results displayed on the touch screen to work and study.

[0053] In this application, the AI ​​expansion screen device 100 is also equipped with a microphone and a speaker for voice interaction. Accordingly, a pickup button can be set on the display interface of the AI ​​tool on the touch screen. In response to the operation of the pickup button, the microphone captures the user's voice and converts it into text display or generates voice instructions, and performs corresponding processing according to the voice instructions.

[0054] Based on the above method, the present application also provides a device 100 that automatically identifies PC application scenarios and recommends corresponding AI tools, namely, an AI extended screen device 100.

[0055] like Figure 2 、 Figure 3 As shown, the AI ​​expansion screen device 100 uses the Android system and is connected to a computer (PC) 200 via USB / Type-C and to an AI server 300 via the network. Computer (PC) 200 is the user's work computer, and AI server 300 is equipped with a multimodal AI large model that can provide AI services such as image recognition services, LLM services, and knowledge base services. The AI ​​expansion screen device 100 interacts with the multimodal AI large model through an API to identify the content of the screenshot, perform AI processing, and display the AI ​​processing results, providing AI assistance functions for the user.

[0056] The AI ​​expansion screen device 100 includes a screen capture module 10 , a scene recognition module 20 , an AI tool recommendation module 30 , an operation response module 40 and a touch screen 50 .

[0057] The screen capture module 10 is used to capture the current screen of the PC and send the obtained screenshot to the AI ​​server 300 through the communication module 60 to identify the content of the screenshot.

[0058] The scene recognition module 20 is used to determine the current application scene of the PC according to the content of the screenshot. The application scenes include document scene, picture scene, translation scene and chat scene.

[0059] The AI ​​tool recommendation module 30 is used to automatically recommend corresponding AI tools according to application scenarios.

[0060] The operation response module 40 is used to execute corresponding AI processing in response to the operation of the function button of the AI ​​tool.

[0061] The touch screen 50 is used to display the function buttons of the AI ​​tool and the AI ​​processing results.

[0062] In terms of specific hardware implementation, the AI ​​expansion screen device 100 includes a processor 101, a docking station 102, and a touch screen 50. Obviously, in order to ensure the normal operation of the AI ​​expansion screen device 100, it should also include some conventional necessary components such as memory DDR and power supply, which will not be repeated here.

[0063] The processor 101 is used to receive and process requests from the screen capture module 10 , the scene recognition module 20 , the tool recommendation module 40 and the operation response module 40 , and perform corresponding operations.

[0064] The expansion dock 102 is connected to the PC computer 200 via USB / Type-C to realize data transmission between the AI ​​expansion screen device 100 and the PC computer 200.

[0065] The touch screen 103 is used to display the PC screen image, the AI ​​tool interface and its function buttons and AI processing results.

[0066] Since the AI ​​expansion screen device 100 uses the Android system, the operating system on the PC side is mostly Windows or MacOS, and the two operating systems are different. In order to realize screenshots and data transmission between different operating systems, this application adopts the following technical solutions.

[0067] The PC side is equipped with a screen virtual driver, a first USB network setting module, a first screen projection setting module, a first screen projection interaction module, a first text transmission module and an SDK that can be called by the above modules, such as video encoding, data transmission, etc.

[0068] In addition to the screen capture module 10, scene recognition module 20, AI tool recommendation module 30, operation response module 40 and touch screen 50 mentioned above, the AI ​​expansion screen device is also provided with a second USB network setting module, a second screen projection interaction module, a second text transmission module and an SDK that can be called by the above modules, such as video decoding, data transmission, etc.

[0069] First, use the first and second USB network configuration modules to set up the USB to Ethereum function, enabling a wired connection between the PC and the AI ​​expansion screen device. Compared to wireless connections, this improves real-time performance, reduces the workload on the AI ​​expansion screen's processor, and allows applications to run smoothly.

[0070] Secondly, the PC uses a screen virtualization driver to transform the current PC screen into a virtual screen in real time. The AI ​​extended screen device can capture the virtual screen at any time for screenshots. The virtual screen can directly capture screen content without transmitting it over the network, thus reducing latency and making it suitable for real-time application scenarios.

[0071] After receiving the screenshot command (either automatic or manual), the PC executes the screenshot operation, then processes the screenshot using the PC's video encoding and data transmission SDK and sends it to the AI ​​expansion screen device. The screen capture module 10 on the AI ​​expansion screen device receives the screenshot using the data transmission SDK and restores it using the video decoding SDK.

[0072] Subsequent work is handled by the scene recognition module 20, the AI ​​tool recommendation module 30, and the operation response module 40, which will not be repeated here.

[0073] To improve the user experience, the current screen of the PC can be projected to the AI ​​expansion screen device in real time through the first and second projection interaction modules, and displayed on the touch screen of the AI ​​expansion screen device. Figure 4 、 Figure 5 As shown, the touch screen display interface can have two windows: one window displays the projected content (the current screen on the PC), and the other window displays the recommended AI tool interface. At the same time, corresponding function buttons are displayed on the touch screen based on the recommended AI tools. In response to the user's operation of the corresponding function button, the corresponding AI processing is executed, and the processing results are displayed on the AI ​​tool interface.

[0074] Since the present application solution also has a first text transmission module on the PC side and a second text transmission module on the AI ​​expansion screen device side, the processing results displayed on the AI ​​tool interface can be copied and pasted to the PC side, or the text on the PC side can be copied and pasted to the AI ​​tool interface for knowledge quizzes.

[0075] In this application, both the PC and the AI ​​expansion screen device are configured with OTA to achieve automatic updates.

[0076] The present application will be further described in detail below with reference to specific application scenario examples.

[0077] Example 1, document scenario.

[0078] The user is currently using office software on a PC for word processing or reading, such as using Word to edit text, using PDF to read files, or browsing articles on a web page.

[0079] First, a screenshot is taken manually or automatically and uploaded to the AI ​​server. OCR technology is then used to identify the text content on the screenshot and convert it into machine-readable text, while determining that the PC's current application scenario is a document scenario. Next, NLP technology is used to analyze the structure, theme, sentiment, and other aspects of the text content, and to identify the document type (long article, short report, email, etc.). Finally, based on the document scenario and document type (such as long text, technical documentation, reports, etc.), appropriate AI tools, such as AI text generation and processing tools, are recommended, and the corresponding function buttons for the AI ​​tools, such as automatic summarization, text continuation, and paragraph reorganization, are displayed on the touch screen. Users can select the relevant function button on the touch screen, and AI processing is performed through the multimodal AI large model on the AI ​​server, with the processing results displayed on the touch screen.

[0080] Example 2, picture scene.

[0081] The user is currently browsing pictures on the PC.

[0082] First, a screenshot is taken manually or automatically and uploaded to the AI ​​server. Then, using image recognition and processing technologies (such as CNN, image segmentation, and feature extraction), objects, text, and scenes are identified, and the current application scenario of the PC is determined to be a picture scene. Finally, a suitable AI tool is recommended, such as an AI intelligent image processing tool, and the corresponding function button for the AI ​​tool is displayed on the touch screen, such as image restoration, style conversion, and object detection. The user can select the relevant function button on the touch screen, and AI processing is performed through the multimodal AI large model on the AI ​​server, and the processing results are displayed on the touch screen. The processing results also allow the user to perform further operations, such as re-restoring the image.

[0083] Example 3, translation scenario.

[0084] The user is currently reading a foreign language document or browsing a foreign language web page on the PC.

[0085] First, a screenshot is taken manually or automatically and uploaded to the AI ​​server; then, NLP technology is used to automatically detect the language of the text. If the language of the text is different from the system default language, the current application scenario of the PC is determined to be a translation scenario; the AI ​​translation tool is automatically enabled, and the function buttons corresponding to the AI ​​tool are displayed on the touch screen, such as full-text translation, word translation, and paragraph translation; the user can select the relevant function button on the touch screen to perform AI processing, and the foreign language text is translated into the target language through the multimodal AI large model on the AI ​​server and displayed on the touch screen.

[0086] Example 4, chat scenario.

[0087] The user is currently using instant messaging tools on the PC to communicate.

[0088] First, a screenshot is automatically taken and uploaded to an AI server. Image recognition and OCR technologies are then used to identify the text in the screenshot and convert it into machine-readable text. Based on the interface layout (message list, input box, send button, etc.), the PC's current application scenario is determined to be a chat scenario. Sentiment analysis models (such as BERT) are used to assess the sentiment of the chat content, identifying positive and negative emotions. Finally, based on the sentiment analysis results and the conversation context, appropriate AI tools are recommended, such as reply suggestions, sentiment analysis, tone optimization, and automatic replies. Users can select the relevant function button on the touch screen to execute AI processing, and the processing results are displayed on the touch screen.

[0089] For example: If the user chooses reply suggestion, the reply suggestion will be automatically generated based on the sentiment analysis results and the conversation context. If the tone optimization is selected, the tone of the user input text will be optimized based on the sentiment analysis results and the conversation context. If the automatic reply is selected, the reply text will be automatically generated based on the sentiment analysis results and the conversation context, and the other party will be replied directly.

[0090] Reply suggestions allow users to edit them.

[0091] In this chat scenario, you can also use a microphone.

[0092] Specifically, after determining that the current application scenario of the PC is a chat scenario, the sound of the microphone is collected in real time and converted into text through voice recognition technology, and then the above-mentioned emotional evaluation and AI tool recommendation are performed based on the text.

[0093] In the above scheme, manual shortcut key screenshots and automatic timed screenshots can be configured according to the application scenario and actual needs of the user.

[0094] Based on the description of the above specific embodiments, the pet acupuncture teaching system, method, and computer program product provided by the present invention have the following advantages over the prior art:

[0095] First, automated intelligent response: Based on real-time changes in PC screen content, the system automatically analyzes and activates the most appropriate AI tool, eliminating the need for manual user intervention. This automated response significantly reduces user intervention and improves work efficiency.

[0096] Second, multimodal content processing: Simultaneously processing multiple types of content, such as text, images, video, and voice. By combining multiple technologies such as computer vision, natural language processing, and speech recognition, it can flexibly respond to different application scenarios.

[0097] Third, real-time performance: The system can analyze and provide feedback immediately as the screen content changes, achieving high real-time performance. Users do not need to wait for processing results; they can immediately see the analysis results and corresponding tool recommendations.

[0098] Fourth, it improves user experience: By reducing manual operations and providing real-time intelligent recommendations, it can provide a smoother, more natural, and more efficient user experience. Users can focus more on core tasks, while the system provides assistance through intelligent tools.

[0099] Finally, it should be noted that the terms "comprise," "include," or any other variations thereof, as used herein, are intended to encompass non-exclusive inclusion, such that a process, method, article, or apparatus comprising a list of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus. In the absence of further limitations, an element defined by the phrase "comprising a..." does not preclude the presence of additional identical elements in the process, method, article, or apparatus comprising the element.

[0100] The present invention is not limited to the above-mentioned optimal implementation mode. Anyone should be aware that any structural changes made under the inspiration of the present invention, and any technical solutions that are the same or similar to the present invention, fall within the scope of protection of the present invention.

Claims

1. A method for automatically identifying PC application scenarios and recommending corresponding AI tools, characterized in that: The following steps are involved: Capture the current PC screen and send the screenshot to the AI ​​expansion screen device connected to the PC; The AI ​​extended screen device uses a multimodal AI large model to identify the content of the screenshot; Determine the current application scenario of the PC based on the content of the screenshot, wherein the application scenario includes a document scenario, a picture scenario, a translation scenario, and a chat scenario; Automatically recommend corresponding AI tools based on application scenarios and display the function buttons of AI tools on the touch screen of the AI ​​expansion screen device; In response to the operation of the function button, the corresponding AI processing is performed and the processing results are displayed on the touch screen of the AI ​​expansion screen device.

2. The method according to claim 1, characterized in that The application scenario is determined to be a document scenario based on the content of the screenshot, and the function button includes at least one of the following tools: automatic summary, text continuation, text proofreading and text polishing, and the corresponding function button is activated and presented according to the length and content of the document.

3. The method according to claim 1, characterized in that According to the content of the screenshot being a picture or image, the application scenario is determined to be a picture scene, and the function buttons of the AI ​​tool include at least one of the following tools: picture restoration, style conversion, and object detection, and the corresponding function buttons are activated and presented according to the elements in the picture or image.

4. The method according to claim 1, wherein Based on the fact that the content of the screenshot is text and the language of the text is different from the system default language, it is determined that the application scenario is a translation scenario, and the function button of the AI ​​tool includes at least one of the following tools: full-text translation, word-marking translation, and paragraph translation.

5. The method according to claim 1, wherein According to the content of the screenshot, the application scenario is determined to be a chat scenario, and the function button of the AI ​​tool includes at least one of the following tools: reply suggestion, sentiment analysis, tone optimization and automatic reply.

6. The method according to claim 5, characterized in that Analyze chat content and conversation context in real time, and activate corresponding function buttons based on the conversation context.

7. The method according to claim 1, characterized in that The current screen of the PC is captured automatically at a scheduled time or manually with a shortcut key. In response to the operation of capturing the current screen of the PC, the obtained screenshot is sent to the AI ​​extended screen device.

8. A device that automatically identifies PC application scenarios and recommends corresponding AI tools, connected to an AI server, which is equipped with a multimodal AI large model. The device interacts with the multimodal AI large model through an API, characterized in that: The device is connected to the PC as an extended screen, including: The screen capture module is used to capture the current PC screen and send the screenshot to the AI ​​server to identify the content of the screenshot: A scene recognition module is used to determine the current application scene of the PC based on the content of the cloud screenshot, wherein the application scene includes a document scene, a picture scene, a translation scene, and a chat scene; Tool recommendation module, used to automatically recommend corresponding AI tools based on application scenarios; An operation response module, configured to execute corresponding AI processing in response to an operation on a function button of the AI ​​tool; Touch screen, used to display the function buttons of AI tools and AI processing results.

9. The device according to claim 8, characterized in that Also includes: A microphone is provided on the display interface of the AI ​​tool on the touch screen. A pickup button is provided. In response to the operation of the pickup button, the microphone captures the user's voice, converts it into text display or generates voice instructions, and the operation response module performs corresponding processing according to the voice instructions.

10. The device according to claim 8, characterized in that The screen capture module captures the current screen of the PC automatically by timing or manually by using shortcut keys.

Images