125 results about "Remote assistance" patented technology

Disclosed are methods, systems, and computer-readable medium to perform operations including: receiving a plurality of three-dimensional (3D) models of a plurality of assembly parts of a physical object; displaying, on a display device and over a live video of the plurality of assembly parts, an augmented reality (AR) overlay including the plurality 3D models; providing the plurality 3D models to a remote device for display on the remote device; receiving, from the remote device, data indicative of instructions for assembling the plurality of assembly parts into the physical object; and modifying, based on the received data, the AR overlay displayed on the display device to provide the instructions for assembling the plurality of assembly parts into the physical object.

The embodiment of the invention relates to a method and device for travel service, equipment and a storage medium. The method proposed herein includes: determining a parking scene of an autonomous vehicle in response to the autonomous vehicle triggering parking during an autonomous vehicle service target journey; in response to the fact that a target condition corresponding to the parking scene is met, sending a prompt to a user associated with the target travel; and generating a first remote assistance request associated with the autonomous vehicle in response to the fact that the feedback of the user for the reminder is not received in the target duration, the target duration being related to the parking position of the autonomous vehicle. In this way, the service reliability of the autonomous vehicle can be improved.

The invention belongs to the technical field of equipment early warning, and particularly relates to a multi-source information fusion real-time monitoring and data analysis method and system, and the method comprises the steps: achieving the automatic recognition and data collection, remote assistance and support, and intelligent path planning and navigation functions in the inspection process of a chemical device, so as to standardize the inspection process; the inspection efficiency and the result accuracy are improved; establishing a chemical device image recognition model, collecting and preprocessing chemical device image data, performing model training by using a convolutional neural network deep learning model, and deploying the model to actual equipment; an abnormal feature extraction algorithm is developed, the operation state of the equipment is monitored in real time in combination with an intelligent early warning and processing system, early warning is quickly given out, and corresponding processing measures are taken; by adopting the anomaly detection and classification technology, an anomaly detection algorithm is realized, an efficient alarm information transmission mechanism and an intelligent alarm information processing system are developed, and an alarm information feedback and closed-loop management mechanism is established, so that the accuracy and timeliness of anomaly detection are improved.

Examples related to facilitating the training, assessment, and dispatching of technicians to a customer location for at least the purpose of servicing or repairing machines, devices, or systems present at the customer location are presented. The technician can be selected for dispatch to the customer location by review of database information, including training information for the technician, among other things. While at the customer location, the technician can be provided with training information delivered via a training module, where such training material content can comprise written materials, photos, video, virtual assistance, remote assistance, games, or the like. The technician can generate videos or other collateral while at the customer location, which can be included for use in a library of training materials for subsequent use, or for other purposes. Various systems and processes for facilitating the selection, management and deployment of training materials for technicians are also provided herein.

The present application provides a remote-assisted business processing method, system, electronic device and storage medium, which can be applied to the big data field or the financial field. The core system identifies that the target customer type of the target customer belongs to a special type based on the basic information of the session establishment message sent by the mobile banking according to the business processing requirements, and sends the target session establishment message to the mobile banking; the mobile banking authenticates the target customer based on the encrypted target identity information and establishes a session with the core system; the core system combines multiple target businesses determined based on historical business processing records and business processing information to obtain a business processing combination; the core system determines the target special type of the target customer from the special types based on the target customer feature information, and sends a prompt type and prompt information to the mobile banking according to the target special type and the target business processing combination; the mobile banking guides the target customer to perform business processing based on the prompt type and prompt information.

A remote assistance system according to the present disclosure comprises a memory storing a database and one or more processors. The database manages, for each of a plurality of operators, feature values of a plurality of feature items regarding a last assistance scene. The one or more processors are configured to execute the following first to third processes. The first process is, when a new assistance request is received from s vehicle, specifying one or more index items from the plurality of feature items. The second process is specifying, from the plurality of operators, one or more candidate operators whose the last assistance scene is similar to a current assistance scene based on the feature values of the one or more index items. The third process is selecting an operator to process the new assistance request from the one or more candidate operators.

1. The name of the design product: wireless field camera. 2. The use of the design product: used for installing in the center of the operating shadowless lamp, recording the operation process, remote assistance and teaching demonstration. 3. The design points of the design product: in shape. 4. The picture or photo that can best show the design points: perspective view 1.

Example systems and methods enable an autonomous vehicle to request assistance from a remote operator in certain predetermined situations. One example method includes determining a representation of an environment of an autonomous vehicle based on sensor data of the environment. Based on the representation, the method may also include identifying a situation from a predetermined set of situations for which the autonomous vehicle will request remote assistance. The method may further include sending a request for assistance to a remote assistor, the request including the representation of the environment and the identified situation. The method may additionally include receiving a response from the remote assistor indicating an autonomous operation. The method may also include causing the autonomous vehicle to perform the autonomous operation.

A remote assistance apparatus records, in an assistance content recording unit, assistance contents for remote assistance for an autonomous driving vehicle in response to the autonomous driving vehicle stopping as a result of an occurrence of a traveling abnormality, and then resumes autonomous traveling as a result of remote assistance for the autonomous driving vehicle being provided by an operator. The assistance contents include an assistance location and operator instruction contents for remote assistance instructed by the operator. The remote assistance apparatus detects an autonomous driving vehicle that is expected to pass through a predetermined assistance location included in predetermined assistance contents recorded in the assistance content recording unit. The remote assistance apparatus determines an assistance method of the remote assistance for the autonomous driving vehicle that is detected by the assisted vehicle detecting unit, based on the predetermined assistance contents that are recorded in the assistance content recording unit.

According to embodiments of this disclosure, a method, apparatus, device, and computer-readable storage medium for remote assistance are provided. The method includes: determining a first accessibility attribute of a target area based on perception data of an autonomous vehicle; determining that the first accessibility attribute differs from a second accessibility attribute indicated by map data; in response to determining that the autonomous vehicle is in a stranded state associated with the target area, sending an assistance request to a remote device, the assistance request indicating the extent of the target area; and in response to receiving an indication message from the remote device that passage through the target area is permitted, generating an escape route for traversing the target area. This significantly improves the vehicle's autonomous adaptability in complex road conditions and reduces the risk of vehicle entrapment and traffic disruption.

1. The name of the product of this design: mixed reality glasses. 2. Purpose of the product of this appearance design: It is used for mixed reality devices and can be connected to computing terminals such as smart phones, tablets, and computers to achieve functions such as human-computer interaction, face recognition, object recognition, remote assistance, video viewing, and game entertainment. 3. The design key point of this appearance design product lies in the shape. 4. The picture or photo that best illustrates the design points: Stereoscopic diagram 1.

A remote assistance device includes an obtainer, a display, a control information generator, and a display controller. The obtainer receives image information from a target vehicle that is remotely operated. The image information includes an image produced by capturing a surround view of the target vehicle. The display shows the image derived by the obtainer, to a remote driver. The control information generator cyclically produces control information including a controlled variable which is created by an operation input from the remote driver to control a given operation of the target vehicle. The control information generator transmits the control information to the target vehicle. The display controller works to control an operation of the display to overlay an auxiliary image on the image on the display. The auxiliary image includes at least a measure of the controlled variable provided when the image was captured in the target vehicle and is used for assisting the remote driver in remotely maneuvering the target vehicle.

The present disclosure provides a method for remote assistance and device. 1. A method for remote assistance, the method comprising:determining a state of a machine deployed at a working site;adjusting a digital twin of the machine to be in the same state as the machine deployed at the working site;rendering the digital twin at a remote site using a remote rendering device to enable a remote person at the remote site to perform an operation on the digital twin; andmapping an effect of the operation rendered as visual assistance information onto the machine at the working site using a local rendering device deployed at the working site.

An improved decentralized, blockchain-driven network for artificial intelligence (AI)-enabled skills exchange between Intelligent Personal Assistants (IPAs) in a network is disclosed that is configured to perform computational tasks or services (also referred to herein as “skills”) in an optimally-efficient fashion. In some embodiments, this may comprise a first IPA paying an agreed cost to a second IPA to perform a particular skill in a more optimally-efficient fashion. In some embodiments, a skills registry is published, comprising benchmark analyses and costs for the skills offered by the various nodes on the skills exchange network. In other embodiments, a transaction ledger is maintained that provides a record of all transactions performed across the network in a tamper-proof and auditable fashion, e.g., via the use of blockchain technology. Over time, the AI-enabled nodes in the system may learn to scale, replicate, and transact with each other in an optimized—and fully autonomous—fashion.

A system and method is provided that enables voice recognition for legacy operating systems of a computing device. An exemplary method includes receiving speech-based instructions from a user of mobile device that indicate a request for executing a task. The speech-based instructions are then analyzed by an intelligent personal assistant running on the mobile device to determine an intent of the user. If the intent of the user identifies a specialized client software module installed on the mobile, the software module will generate a command object that includes parameters relating to the execution of the task. The command object is then transmitted by the first computing device to a personal computer with a legacy operating system where the command object causes a software agent installed on the personal computer to execute the task based on the parameters included in the command object.

A remote assistance workstation 12 includes a communication module 54, a user interface (UI) module 52, and a controller 56 coupled to a portable device 14, the portable device including augmented reality (AR) glasses 36 worn by a first responder to perform actions using objects in a scene. The UI module 52 renders a remote assistant graphical user interface (GUI) 100, the GUI including (i) a first pane 96 for displaying a live video stream of a remote assistance request and (ii) a second pane 98 for displaying a 2D representation of an object in the scene, which can be moved within the scene via remote assistant input. The GUI 100 renders a corresponding 3D virtual content item within the first pane relative to a reference point. The controller 56 outputs a remote assistance signal to the portable device 14 to display a 3D virtual content item 38 on the AR glasses in a live view of the scene, appearing at a location determined by the remote assistant input of moving the 2D representation within the second pane 98 to assist the first responder in the scene.

The invention discloses a visual remote auxiliary device for computer teaching, and belongs to the field of remote auxiliary devices.The visual remote auxiliary device comprises a supporting plate, a middle plate is fixedly connected to the middle position of one side face of the supporting plate, two parallel supporting legs are fixedly connected to one side of the bottom end face of the middle plate, and a top plate is fixedly connected to the upper portion of the middle plate; a bottom plate is arranged below the middle plate, a keyboard and a mouse are arranged on one side of the top end face of the middle plate, and a displayer is arranged on the top end face of the top plate. A lifting driving assembly is arranged above the bottom plate, a host is arranged on the top end face of the bottom plate, a rectangular groove is formed in the top end of the side face of the supporting plate, an adjustable camera shooting mechanism is arranged in the rectangular groove, a side shielding assembly is arranged below the rectangular groove, and two parallel air supply assemblies are embedded in the portion, below the top plate, of the side face of the supporting plate. According to the invention, through the arranged lifting driving assembly, the placement height of the host can be adaptively adjusted according to the model of the host, so that the leg extension space of a user is increased.

Improved intelligent personal assistant (IPA) software agents are disclosed that are configured to interact with various people, service providers, files, and / or smart devices. More particularly, this disclosure relates to an improved Natural Language Processing (NLP) Intent Determination Service (IDS) that is able to determine the likely best action to take in response to generic user commands and queries. The improved NLP IDS disclosed is said to be ‘search-based’ because, rather than attempt to parse incoming user commands and queries up front, the incoming user commands and queries are searched against a pre-generated database of exemplary user commands (e.g., having associated action or parsing identifiers) to determine the most relevant search result(s). The associated system actions and known grammar / parsing rules of the most relevant search result(s) may then be used to process the incoming user command or query—without having to actually parse the incoming user command or query from scratch.

A radio frequency connection between a far field voice detection device and a further device is used to determine a first angular direction from the far field voice detection device to the further device. The determined first angular direction is then used to emphasize, during a noise processing of a plurality of sounds received via use of a plurality of microphones of the far field voice detection device, a first one of the plurality of sounds relative to a remainder of the plurality of sounds.

To provide a remote support system or the like capable of restricting an error from occurring in a remote support.SOLUTION: A processor of a remote support system receives through a wireless communication line, an image data set to be transmitted from an autonomous travel device for each transmission period in response to photographing of an environment and also a recognition data set to be transmitted from the autonomous travel device for each transmission period by a data capacity smaller than that of the image data set while including at least position information related to a target recognized in the environment. When a reception delay level of the image data set is out of a permission range with respect to this reception period, the processor allows an image data set received in this reception period to be replaced with a processed data set which is generated from the image data set received in the reception period before the preceding period by processing to allow a target image expressing the target to appear at a position predicted in correlation with the recognition data set which is received in this reception period, and then, displays the processed data set in a remote operator.SELECTED DRAWING: Figure 5

The present disclosure relates to a remote assistance method, a remote assistance system, and a computer-readable recording medium. Provided is a remote assistance technology capable of causing a vehicle to act at a timing desired by a remote operator while excluding the influence of deviation of the assistance timing caused by, for example, communication delay. According to the remote assistance method of the present disclosure, first, a position relationship of the vehicle and an object at a future time point further ahead than a current time point, which is predicted on the basis of a path plan for autonomous travel created by the vehicle and information on the object existing in the surroundings of the vehicle, is spatially displayed on a display device. Next, an assistance content input from the operator is transmitted to the vehicle. Then, after the vehicle receives the assistance content, confirmation of the position relationship of the vehicle and the object displayed on the display device at the time when the assistance content is input is accepted, and remote assistance corresponding to the assistance content is executed in the vehicle.

The present invention relates to a vehicle communication system with an alternative periodic connection mode. A communication system for a vehicle includes a controller adapted to selectively execute an alternative periodic connection mode for communication between a user of the vehicle and a remote assistance unit. The vehicle is not connected to a wireless plan. The controller has a processor and a tangible non-transitory memory with instructions recorded thereon. The alternative periodic connection mode is activated based in part on at least one automatic trigger and / or a request from the user. The controller is adapted to assign a different identifier to the vehicle during execution of the alternative periodic connection mode. The different identifier is defined by a plurality of parameters including a connection time interval, an internet protocol address range, and a host port. The internet protocol address range and host port can be dynamically configured to remain disengaged unless permission is given to the system.

1. Name of the product in this design: Large-screen grid service terminal. 2. Purpose of this design: It is intended to be used as a grid-based service terminal for handling business, such as electricity-related services. It features functions such as information display, printing, ID card recognition, bank card reading, QR code scanning, remote assistance for business processing, and voice prompts. 3. The key design feature of this product is its shape. 4. The image or photograph that best illustrates the design's key points: a 3D model.

The invention relates to the technical field of coal mine operation and maintenance, and discloses a multi-system remote collaborative management system and method for a fully mechanized coal mining face of a coal mine, and the method comprises a management process of a coal mining system host located at a coal mine side: uniformly managing the host name, host IP and online and offline states of each system through a remote assistance host; a coal mine system maintenance process at an energy group side: maintaining basic information of a fully mechanized coal mining face of each coal mine through a remote operation and maintenance center; and an expert remote operation and maintenance process located at the Internet side: a remote operation and maintenance center is deployed, and a remote expert seat is provided for remote system troubleshooting and daily system operation and maintenance after the coal mining system breaks down. Through a coal mine-energy group-remote operation and maintenance center three-level remote assistance mode, complex faults and problems in actual fully mechanized coal mining face system operation can be better solved, meanwhile, production data isolation can be effectively achieved, data safety is guaranteed, and compared with hardware resource management, cost can be greatly saved.

Example embodiments relate to techniques for enabling one or more systems of a vehicle (e.g., an autonomous vehicle) to request remote assistance to help the vehicle navigate in an environment. A computing device may be configured to receive a request for assistance from a vehicle to classify an object and to initiate display of a graphical user interface at a display device. The graphical user interface may be configured to visually represent the object and may comprise one or more graphical user interface elements to enable input to be provided for classifying the object. The computing device may also be configured to generate a response that includes a classification of the object based on detecting a selection of at least one of the one or more graphical user interface elements. Further, the computing device may be configured to transmit the response to the vehicle.

The invention provides an interaction method, electronic equipment and a computer readable storage medium. According to the method, the user behavior of the assistant in the remote assistance scene is analyzed, the target position of the assistant for indicating the assisted person to operate in the shot picture is determined, and the target position is shared to the client of the assisted person, so that the client of the assisted person marks the target position in the shot picture. Through the method, the assisted person can quickly lock the target position indicated by the assistant to operate, and the remote assistance efficiency is improved.

A remote operator terminal for a remote operator to perform remote assistance for a vehicle is disclosed. The remote operator terminal includes a display device and processing circuitry configured to generate a remote assistance screen in response to remote assistance requests assigned to the remote operator. The remote assistance screen includes monitoring images showing an assistance situation of a target vehicle. The processing circuitry is further configured to set a display priority for each of the remote assistance requests, to select, as a preferential monitoring image, a monitoring image corresponding to a remote assistance request having a highest display priority among the monitoring images, and to display the monitoring images on the remote assistance screen so that the preferential monitoring image has higher noticeability than other monitoring images have.

This invention provides a method, system, and storage medium for displaying a panoramic view of a vehicle. The method includes: an AR user terminal entering a working mode after connecting to the network; acquiring multiple images of the vehicle's surrounding environment using cameras to obtain a panoramic image; and obtaining a panoramic image corresponding to the user's current viewpoint based on the AR user terminal's real-time coordinates and pose data; simultaneously detecting obstacles around the target vehicle and generating corresponding instruction animations and prompts based on the obstacles; and then further fusing the panoramic image and instruction animations and presenting them to the AR user terminal. The AR user terminal used in this invention can perceive the location of obstacles, quickly assess their impact, and generate corresponding instruction animations and prompts, allowing users to perceive the direction of risk and make appropriate driving decisions; it can also remotely assist the driver in the target vehicle, improving driving safety; and it can also provide a three-dimensional interactive experience.

The invention relates to a remote assistance method and device, computer equipment, a storage medium and a computer program product. The method is applied to an automatic driving vehicle, and comprises the following steps: after an operation of requesting remote assistance is received, sending a remote assistance request and a first call request to a vehicle remote control center; wherein the remote assistance request is used for requesting the vehicle remote control center to establish a remote assistance link with the autonomous vehicle, and the first call request is used for requesting the vehicle remote control center to establish a first call link with the autonomous vehicle. By adopting the method, the vehicle can get out of trouble in time when the remote assistance link is abnormal.