221 results about "Screen capture" patented technology

The disclosed techniques provide improved methods of operating system (OS) search. Users are enabled to search for documents, emails, presentations, content they entered into a web form, meetings they participated in, and other interactions they had with their computing device. To accomplish this, screenshots are periodically captured and indexed. Machine learning models are used to infer embeddings for visual elements of the screenshots and / or text extracted from the screenshots. A full text index of a relational database may also be populated with text extracted from the screenshots. The embeddings and full text index may then be used to retrieve screenshots in response to a user history query. For example, screenshots of embeddings within a defined distance of an embedding of the user history query may be selected. Query results from different embedding indices and relational databases may be ordered by applying different weights to different kinds of search scores.

A system and method includes connecting an interface device to a port of a vehicle to be in communication with an electrical system of the vehicle for monitoring the vehicle, and running a selected one of multiple available calibration and / or repair programs via the interface device to generate a calibration / repair data file of the vehicle, where the data / log file is generated in one of a plurality of possible native file formats. A report generation tool acquires screen captures and / or screen recordings to document the data / information displayed during the steps of a calibration / repair procedure. An evaluation tool extracts calibration / repair data from the data / log file, where the evaluation tool is configured to extract calibration / repair diagnostic data from data / log files in each of the plurality of possible native file formats, and outputs the calibration / repair diagnostic data to a database in a common format from which detailed calibration / repair diagnostic reports are generated.

The invention discloses a vision enhancement robust digital dark watermarking method based on deep learning, a storage medium and equipment, and belongs to the technical field of digital image processing and information security. According to the method, a visual enhancement module comprising a self-adaptive watermark region adjustment module and a frequency enhancement module is constructed, and a multi-region local loss training mechanism and a screen shooting simulation module are combined, so that the visual quality of a watermark image is improved, and meanwhile, the robustness of the watermark image for resisting physical attacks such as screen shooting is enhanced. The specific processing flow comprises the following steps: acquiring an original image and watermark information; embedding the watermark information into the image by using an encoder, wherein an embedded region is optimized by a self-adaptive region guide matrix generated based on the image edge and gray information; in the model training process, a noise layer simulating screen shooting physical distortion is introduced, and the area weight is dynamically adjusted according to residual error distribution in the later stage of training so as to focus and optimize the image quality; watermark information is extracted from an image which may suffer from an attack by using a decoder.

The invention discloses an automatic filling method and system based on YOLO and RPA, and the method comprises the steps: collecting a form interface image through screen capture, inputting the image into a YOLO model for processing, and recognizing form elements to generate bounding box information; reading data from an external data source, matching a corresponding relationship between the data and fields according to a preset mapping rule, verifying a data format, and obtaining a data set passing verification; using RPA to simulate user operation, inputting data passing verification into a form field, and formatting to obtain a filled form interface; checking fields required to be filled and data formats, and determining the validity of the form; simulating and clicking a submission button to complete form operation, and recording a submission result; and monitoring potential errors in the whole process, performing classified processing, recording detailed log information, and obtaining an optimized filling record. According to the method, the automation degree and accuracy of form processing are remarkably improved, the manual operation burden is reduced, the business process efficiency is optimized, and the method is suitable for complex form filling scenes.

To provide an information processing device which acquires a screenshot posted by a user, so as to offer complementary information for complementing a content of the screenshot to viewers of the screenshot.SOLUTION: An information processing device includes an acquisition section, a generation section, and a provision section. The acquisition section acquires a screenshot posted by a user. The generation section generates complementary information for complementing a content of the screenshot on the basis of information on the screenshot and attribute information on viewers of the screenshot. The provision section provides the complementary information together with the screenshot to the viewers.SELECTED DRAWING: Figure 1

A graph-forming process generates a graph having nodes that represent a plurality of previously captured screenshots. The graph-forming process relies on a plurality of machine-trained models to identify edges between pairs of the nodes. The edges represent relationships among the screenshots. The graph-forming process then trains a graph neural network (GNN) based on the graph. The training produces a plurality of target embeddings associated with respective nodes in the graph. A retrieval process retrieves a previously captured screenshot using the plurality of target embeddings. The retrieval process involves adding a new node to the graph that represents the query and using the GNN to produce a query embedding associated with the new node. The retrieval process then finds at least one target embedding that matches the query embedding and retrieves a screenshot associated with the matching target embedding.

Effective Retrieval-Augmented Generation (RAG) pipelines face significant challenges when processing domain-specific technical documents that have diverse content types like text, figures, equations, and tables. To address this challenge, a context-oriented RAG system can be implemented for various domain-specific applications. The RAG system can include a lightweight, two-stage architecture to facilitate contextual understanding: a content analysis and enrichment pipeline for structured metadata extraction and a query processing pipeline for context-aware retrieval. In some cases, tabular data is processed using a dual-stream approach: semantically via text and visually via screenshots. The embedding vectors and the metadata can be stored in a visual data management system. The RAG system, utilizing the visual data management system, can answer questions and precisely retrieve technical information in a way that can preserve structural relationships and semantic connections across different modalities.

The invention discloses a data sharing method and related equipment, for a sender, sender equipment can provide a system-level file encryption control sharing function without depending on the fact that the sender equipment must install a certain application, and the sender can select a file to be shared from a system through the sender equipment and set an authority control strategy. Sending to a receiver device in one or more different ways; for the receiver, the receiver equipment can provide a data management and control function, the receiver can receive and open the shared file through the receiver equipment, and the system can dynamically adjust the permissions of different functions of the application access system based on the permission control strategy set in the file. For example, a receiving party can be controlled to be incapable of performing operations such as copying, screen capturing and printing on the file, and an attacker cannot perform the operations on the file even if attacking an application for opening the file. In this way, the scene support degree, safety, eco-friendliness and the like are all improved, and the user experience is better.

Detection of a malicious application or website by a transaction processing application includes inputting a transactional request having a transactional data record and a screenshot; sending the input data record and input screenshot to a backend controller; requesting to a prompt selector, a string comprising a feature-extraction prompt; sending the input screenshot and the received prompt string to a Large Vision Model, LVM; receiving a string having risk classification features from said LVM; verifying the received string by a format parser; if the received string fails the verification, requesting by the backend controller, a string having a feature-extraction prompt which explicitly mentions format parsing compatibility, and repeating the preceding steps; sending the received string to a risk classification model for providing a risk classification; sending the risk classification to the backend controller; determining if the application or website is determined as malicious, and accepting or rejecting the transactional request accordingly.

Autonomous generation includes generating, with a large language model (LLM), an action list for performing an extraction task from at least one website. Generating the action list may include for each action in the action list performing operations. The operations include capturing current webpage data including a screenshot of a current webpage and a set of interactable widgets, obtaining, using an LLM processing the current webpage data, a next action attribute set, adding the next action attribute set, and performing the next action. Autonomous generation also includes traversing the action list to filter out at least one superfluous action, generating, after filtering, a set of machine executable instructions from the action list, and storing the set of machine executable instructions associated with a task identifier. Autonomous generation also includes executing the set of machine executable instructions to extract a data element from the at least one website.

A method features receiving a data stream (DS) having video and audio data; detecting a specific position within the DS classified by a predefined criterion (PC) and received by user's clients matching the PC; connecting the receiver not matching the PC with a client-server system matching the PC; receiving the DS by the client-server system and forwarding it to the receiver; extracting the video data and the audio data from the DS stream; creating a screenshot out of the video data and an associated timestamp; feeding the screenshot to an AI-system trained to detect whether it belongs to a predefined category; generating audio data corresponding with the screenshot and analyzing it for detecting whether it belongs to the predefined category; and if both the screenshot and the audio data generated / analyzed belong to the predefined category, then deciding that the associated timestamp for the screenshot defines the specific position.

The invention discloses an APP cross-version automatic testing method based on a semantic relationship and causal difference, and relates to the field of vehicle-mounted human-computer interfaces, and the method comprises the steps: S1, connecting a tested device with a testing environment, and obtaining an interface structure description and a screenshot of a tested application through an interface collection module; s2, constructing a semantic business card for each interactive element in the interface; the semantic business card comprises a control category, a resource identifier, an accessible description, an order in a page, information of the page and an adjacent text feature, and the semantic business card is used for cross-version, cross-theme and cross-resolution element identification after fusion; s3, constructing an element relation graph based on the interface structure description; the relation graph comprises a hierarchical father-son relation and a causal relation triggered by clicking; the causal relationship is established by comparing interface element sets before and after each operation and identifying newly appearing elements and disappearing elements.

An imaging program that causes an imaging device comprising a display, a camera, an input unit, and a computation unit to execute: a function for displaying, on the display, a list of one or a plurality of pieces of tableware that are stored in a tableware database and receiving selection of the one or plurality of pieces of tableware that are to be used from the list of one or a plurality of pieces of tableware; a function for determining, according to the selected one or plurality of pieces of tableware and on the basis of an arrangement table, one or a plurality of candidates for the optimal arrangement of the selected one or plurality of pieces of tableware and showing the determined one or plurality of candidates on the display; a function for receiving a selection from among the one or plurality of candidates and generating a guide for the selected candidate; and a function for activating the camera and displaying the guide within an image capturing screen captured by the camera, the image capturing screen being displayed on the display.

Generation and use of screenshots of interactive displays are provided. A screenshot is received. The screenshot comprises an area of an interactive display. An interactive object is identified within the area of the interactive display. The interactive object corresponds to a function. A simulated interactive object corresponding to the interactive object is generated. The simulated interactive object corresponds to the function. A composite screenshot comprising the screenshot and the simulated interactive object is rendered for display, on a display.

Techniques for visual deep learning for inline phishing detection are disclosed. In some embodiments, a system / process / computer program product for visual deep learning for inline phishing detection includes extracting a logo from a screenshot of a web page; detecting phishing based on a match to at least one of a plurality of reference logos using a visual deep learning model and that a domain associated with the web page is not associated with an entity that matches the logo extracted from the web page; and performing a remedial action in response to determining that the web page is associated with phishing.

The application provides a vehicle vision module test system, wherein the control module can send a first test signal to the simulation module; the simulation module generates a test scene; the control module can send a first capture signal to the vision module; the vision module can capture a first image upon receiving the first capture signal; the control module can send a first display signal to the screen module; the screen module can display the first image upon receiving the first display signal from the control module; the control module can send a screen capture signal to the screen module; the screen module captures the first image in real time upon receiving the screen capture signal from the control module; the analysis module acquires the first image and compares it with a pre-stored reference first image; if the two images match, it is determined that the at least one vision module passes the scene test. The system not only completely eliminates manual testing, but also flexibly simulates test scenes, and is faster and more accurate in testing.

An information processing apparatus of the present invention is configured to include a control unit that: performs a process of storing an image displayed on a screen in response to a screen capture operation; implementing processing for judging whether one or more screen capture operations are summarized or not; and displaying a notification corresponding to the screenshot operation in response to determining that the summarizing operation has ended.

The embodiment of the invention discloses a screen capturing method and device, and the method can comprise the steps that the method can be applied to electronic equipment, and the electronic equipment comprises a display screen; the display screen displays a first interface, the first interface comprises target content displayed in a full screen and one or more suspension controls, and the target content is desktop content or content of a target application; receiving a screen capture operation of a user for the first interface; if it is monitored that the control shielding function of the electronic equipment is in an activated state, generating a first file in response to the screen capture operation; the first file comprises one or more image frames for performing screen capture on the first interface, and the one or more suspension controls are not displayed in at least one image frame in the one or more image frames. By adopting the embodiment of the invention, the convenience and experience of the user during screen capture can be improved.

The invention discloses a nuclear power monitoring printing method, system and equipment based on a virtual printer, and relates to the technical field of data processing.The method comprises the steps that dynamic change information in a nuclear power monitoring interface is captured in real time based on the real-time screen capture and event-driven technology, and multi-stage processing is conducted on the dynamic change information in combination with an annular buffer architecture, so that the dynamic change information is obtained; obtaining nuclear power monitoring display page information in a preset template format; calling nuclear power monitoring display page information to be printed, and performing static and dynamic file format generation and encryption processing; classifying and storing the target printing files according to a preset rule, and generating and storing index information; performing authority authentication on the access user and displaying the index information after the authority authentication is passed; and retrieving the corresponding target printing file according to the selection of the access user on the index information, and allowing the target printing file to be used after decryption. Dynamic information of the monitoring interface can be captured in real time, diversified output is supported, data safety is ensured, and operation is easy and convenient.

To provide a device and method for monitoring illegal distribution of copyrighted works without being directly involved in uploading and downloading on a torrent network and acquiring evidence capable of identifying a period of illegal distribution of copyrighted works through the torrent network.SOLUTION: A method includes: a step S201 in which a processor checks information on a peer distributing a torrent file designated as copyrighted work to be monitored and whether a current status of the peer is a Seeder or a Leecher; and a step S205 in which if the peer is checked to be the Seeder, the processor acquires a captured image of a monitoring screen of the peer distributing the torrent file as evidence to prove a period of illegal distribution of the copyrighted work and stores it in a capture server 160.SELECTED DRAWING: Figure 4

The invention discloses a method for completing drawing of a certain theme and saving works by two persons. The method comprises the following steps of: setting a boundary and a size according to a theme, and initializing a first user exclusive drawing area and a second user exclusive drawing area; a first user draws in the exclusive area through a graph drawing assembly, real-time coordinate data is stored as a structured object according to a time sequence, and after completion, a first picture is generated through screen capture and uploaded to a far-end server to be encrypted and stored. And after confirming that the storage is successful, the server synchronizes the drawing completion state of the first user to the second user through a network communication protocol containing an error detection and retransmission mechanism. And after the second user receives the state, obtaining the first picture from the server, performing zooming, translation, rotation and resolution adaptation processing, performing supplementary drawing on the adapted picture, and after completion, performing screen capture to generate a second picture and uploading the second picture to the server. And after both the two pictures finish drawing, carrying out layer fusion and overall adaptation processing on the two pictures, and finally generating a collaborative work.

The invention relates to the technical field of information security, in particular to a watermark management method, device and equipment. The watermark management method comprises the following steps: generating a watermark identifier according to identity information of a user; generating a target watermark in a target page through the watermark identifier; and when it is identified that the target watermark in the target page is tampered, executing a watermark protection operation. According to the embodiment of the invention, the watermark identifier is generated through the user information, and the reliability of the watermark identifier is improved by applying a random offset anti-screenshot mechanism, a time-based periodic water printing new method and the like. And meanwhile, by monitoring the watermark document object model, the function of automatic recovery after the watermark is removed is realized, the defect that the static watermark is easy to delete is overcome, and the security guarantee of the watermark is enhanced.

A method includes obtaining, by a processor, an image captured in response to an input from a user, the image comprising a screenshot or a photo. The method also includes processing, by the processor, the image using an intent-based image understanding model and an optical character recognition model to extract information from the image. The method further includes recommending, by the processor, at least one automatic action to be taken based on the extracted information. In addition, the method includes, in response to a validation by the user of the at least one automatic action, performing, by the processor, the at least one automatic action.

Embodiments of the present application provide a screenshot processing method, device and medium. The method specifically includes: after obtaining a screenshot according to a screenshot instruction, receiving a secondary screenshot instruction; in response to the secondary screenshot instruction, determining and displaying a secondary screenshot frame according to a user operation; and removing content corresponding to the secondary screenshot frame from the screenshot. Embodiments of the present application can reduce the operation cost and difficulty coefficient of screenshot processing, thereby improving the screenshot processing efficiency.

The present application discloses a remote control method, apparatus, device, and medium. The method applicable to a controlled device includes: creating a first screen capture task based on a GDI mode and a second screen capture task based on a DirectX mode; calling, in a target screen capture frequency, the first screen capture task and the second screen capture task to simultaneously perform screen capture; determining whether a first image is same as a second image, where the second image is an image of a previous frame of the first image obtained by calling the second screen capture task to perform screen capture; performing, if the first image is different from the second image, target processing on an image obtained by calling the first screen capture task to perform screen capture; and reducing, if the first image is the same as the second image, the target screen capture frequency.

The embodiment of the present application provides a kind of multi-window screen capture method and related equipment, the method comprises: in response to the screen capture operation of display interface including multiple windows, determine the window corresponding to screen capture operation;First screen capture control is displayed based on the window corresponding to screen capture operation;In response to the trigger operation of user to first screen capture control, the window corresponding to screen capture operation is saved as first screen capture image;The screen capture image of display interface is saved;In response to the viewing operation of user to first screen capture image, second screen capture control is displayed;In response to the trigger operation of user to the previous sub-screen capture control of second screen capture control, the window corresponding to the triggered sub-screen capture control is saved as second screen capture image according to the saved display interface image.The embodiment of the present application saves display interface image when user completes the screen capture operation of single window, and it is convenient for user to screen capture other windows.

A management node local to a customer site of a private communications network stores a model. The model is a compact version of a visual language model remote from the customer site. A first screen shot of a dashboard of telemetry data measured from the private communications network is accessed. A prompt is formulated comprising the first screen shot and information to adapt the model to the private communications network via few shot learning. The prompt is submitted to the model. An output is received from the model comprising textual information about anomalies or trends depicted in the first screen shot. The output is checked against data from a statistical model of the telemetry data, the statistical model being independent of the model. In response to the check being successful, an action is triggered to manage the private communications network according to the output.

The embodiment of the invention provides an interface consistency detection method and device, electronic equipment, a readable storage medium and a chip, and the interface consistency detection method comprises the steps: obtaining a data collection path corresponding to a target user interface in response to a detection instruction for the target user interface; acquiring a screenshot image of the target user interface through the first acquisition path; extracting bottom metadata corresponding to the target user interface through the second collection path; generating page character modeling data based on the recognition result of the screen capture image and the bottom metadata; obtaining a preset specification standard parameter; comparing the attribute parameter with a preset specification standard parameter to generate a deviation parameter; acquiring a preset judgment condition; and determining the consistency of the target user interface and an interface corresponding to the preset specification standard parameter according to whether the deviation parameter meets a preset judgment condition or not. By means of the scheme, the efficiency and accuracy of user interface specification verification are improved.

A technique is described for improved issue reporting by a receiving device such as a set-top boxes for satellite and cable television services. In an example embodiment, the receiving device generates an issue report based on internal operational logs, captured screens and / or video of a visual output, and a recording of the user's voice that includes a description of the issue they are experiencing. This issue report can be generated as an object file that can then be transmitted, via a communications network, to an issue reporting platform for processing, for example, by a technical support representative or an automated troubleshooting system.

The invention provides a rolling screen capture method, electronic equipment and a computer readable storage medium. The electronic equipment can obtain the positions of a plurality of view controls on a page during each time of screen capture, and according to the positions of the plurality of view controls during two adjacent times of screen capture, the scrolling distance of the plurality of view controls between the two adjacent times of screen capture is determined; and determining the scrolling distance of the long page between the two adjacent screenshots according to the scrolling distances of the plurality of view controls. Afterwards, the electronic device can determine a repeated area according to the scrolling distance of the long page between the two adjacent screenshots. And finally, the electronic equipment can splice the images after the cutting of the repeated areas to obtain a long screenshot. It can be seen that the scrolling distances of the view controls can be determined without doubt, and the electronic device can accurately recognize the repeated areas on the two adjacent screenshot pictures on the basis of the scrolling distances of the view controls no matter whether dynamic elements exist on the page or not. The success rate of rolling screen capture can be improved.