71 results about "Remote assistance" patented technology

The invention belongs to the technical field of equipment early warning, and particularly relates to a multi-source information fusion real-time monitoring and data analysis method and system, and the method comprises the steps: achieving the automatic recognition and data collection, remote assistance and support, and intelligent path planning and navigation functions in the inspection process of a chemical device, so as to standardize the inspection process; the inspection efficiency and the result accuracy are improved; establishing a chemical device image recognition model, collecting and preprocessing chemical device image data, performing model training by using a convolutional neural network deep learning model, and deploying the model to actual equipment; an abnormal feature extraction algorithm is developed, the operation state of the equipment is monitored in real time in combination with an intelligent early warning and processing system, early warning is quickly given out, and corresponding processing measures are taken; by adopting the anomaly detection and classification technology, an anomaly detection algorithm is realized, an efficient alarm information transmission mechanism and an intelligent alarm information processing system are developed, and an alarm information feedback and closed-loop management mechanism is established, so that the accuracy and timeliness of anomaly detection are improved.

Examples related to facilitating the training, assessment, and dispatching of technicians to a customer location for at least the purpose of servicing or repairing machines, devices, or systems present at the customer location are presented. The technician can be selected for dispatch to the customer location by review of database information, including training information for the technician, among other things. While at the customer location, the technician can be provided with training information delivered via a training module, where such training material content can comprise written materials, photos, video, virtual assistance, remote assistance, games, or the like. The technician can generate videos or other collateral while at the customer location, which can be included for use in a library of training materials for subsequent use, or for other purposes. Various systems and processes for facilitating the selection, management and deployment of training materials for technicians are also provided herein.

1. The name of the design product: wireless field camera. 2. The use of the design product: used for installing in the center of the operating shadowless lamp, recording the operation process, remote assistance and teaching demonstration. 3. The design points of the design product: in shape. 4. The picture or photo that can best show the design points: perspective view 1.

A remote assistance apparatus records, in an assistance content recording unit, assistance contents for remote assistance for an autonomous driving vehicle in response to the autonomous driving vehicle stopping as a result of an occurrence of a traveling abnormality, and then resumes autonomous traveling as a result of remote assistance for the autonomous driving vehicle being provided by an operator. The assistance contents include an assistance location and operator instruction contents for remote assistance instructed by the operator. The remote assistance apparatus detects an autonomous driving vehicle that is expected to pass through a predetermined assistance location included in predetermined assistance contents recorded in the assistance content recording unit. The remote assistance apparatus determines an assistance method of the remote assistance for the autonomous driving vehicle that is detected by the assisted vehicle detecting unit, based on the predetermined assistance contents that are recorded in the assistance content recording unit.

According to embodiments of this disclosure, a method, apparatus, device, and computer-readable storage medium for remote assistance are provided. The method includes: determining a first accessibility attribute of a target area based on perception data of an autonomous vehicle; determining that the first accessibility attribute differs from a second accessibility attribute indicated by map data; in response to determining that the autonomous vehicle is in a stranded state associated with the target area, sending an assistance request to a remote device, the assistance request indicating the extent of the target area; and in response to receiving an indication message from the remote device that passage through the target area is permitted, generating an escape route for traversing the target area. This significantly improves the vehicle's autonomous adaptability in complex road conditions and reduces the risk of vehicle entrapment and traffic disruption.

A remote assistance device includes an obtainer, a display, a control information generator, and a display controller. The obtainer receives image information from a target vehicle that is remotely operated. The image information includes an image produced by capturing a surround view of the target vehicle. The display shows the image derived by the obtainer, to a remote driver. The control information generator cyclically produces control information including a controlled variable which is created by an operation input from the remote driver to control a given operation of the target vehicle. The control information generator transmits the control information to the target vehicle. The display controller works to control an operation of the display to overlay an auxiliary image on the image on the display. The auxiliary image includes at least a measure of the controlled variable provided when the image was captured in the target vehicle and is used for assisting the remote driver in remotely maneuvering the target vehicle.

A remote assistance workstation 12 includes a communication module 54, a user interface (UI) module 52, and a controller 56 coupled to a portable device 14, the portable device including augmented reality (AR) glasses 36 worn by a first responder to perform actions using objects in a scene. The UI module 52 renders a remote assistant graphical user interface (GUI) 100, the GUI including (i) a first pane 96 for displaying a live video stream of a remote assistance request and (ii) a second pane 98 for displaying a 2D representation of an object in the scene, which can be moved within the scene via remote assistant input. The GUI 100 renders a corresponding 3D virtual content item within the first pane relative to a reference point. The controller 56 outputs a remote assistance signal to the portable device 14 to display a 3D virtual content item 38 on the AR glasses in a live view of the scene, appearing at a location determined by the remote assistant input of moving the 2D representation within the second pane 98 to assist the first responder in the scene.

The present disclosure relates to a remote assistance method, a remote assistance system, and a computer-readable recording medium. Provided is a remote assistance technology capable of causing a vehicle to act at a timing desired by a remote operator while excluding the influence of deviation of the assistance timing caused by, for example, communication delay. According to the remote assistance method of the present disclosure, first, a position relationship of the vehicle and an object at a future time point further ahead than a current time point, which is predicted on the basis of a path plan for autonomous travel created by the vehicle and information on the object existing in the surroundings of the vehicle, is spatially displayed on a display device. Next, an assistance content input from the operator is transmitted to the vehicle. Then, after the vehicle receives the assistance content, confirmation of the position relationship of the vehicle and the object displayed on the display device at the time when the assistance content is input is accepted, and remote assistance corresponding to the assistance content is executed in the vehicle.

The present invention relates to a vehicle communication system with an alternative periodic connection mode. A communication system for a vehicle includes a controller adapted to selectively execute an alternative periodic connection mode for communication between a user of the vehicle and a remote assistance unit. The vehicle is not connected to a wireless plan. The controller has a processor and a tangible non-transitory memory with instructions recorded thereon. The alternative periodic connection mode is activated based in part on at least one automatic trigger and / or a request from the user. The controller is adapted to assign a different identifier to the vehicle during execution of the alternative periodic connection mode. The different identifier is defined by a plurality of parameters including a connection time interval, an internet protocol address range, and a host port. The internet protocol address range and host port can be dynamically configured to remain disengaged unless permission is given to the system.

1. Name of the product in this design: Large-screen grid service terminal. 2. Purpose of this design: It is intended to be used as a grid-based service terminal for handling business, such as electricity-related services. It features functions such as information display, printing, ID card recognition, bank card reading, QR code scanning, remote assistance for business processing, and voice prompts. 3. The key design feature of this product is its shape. 4. The image or photograph that best illustrates the design's key points: a 3D model.

Example embodiments relate to techniques for enabling one or more systems of a vehicle (e.g., an autonomous vehicle) to request remote assistance to help the vehicle navigate in an environment. A computing device may be configured to receive a request for assistance from a vehicle to classify an object and to initiate display of a graphical user interface at a display device. The graphical user interface may be configured to visually represent the object and may comprise one or more graphical user interface elements to enable input to be provided for classifying the object. The computing device may also be configured to generate a response that includes a classification of the object based on detecting a selection of at least one of the one or more graphical user interface elements. Further, the computing device may be configured to transmit the response to the vehicle.

A remote operator terminal for a remote operator to perform remote assistance for a vehicle is disclosed. The remote operator terminal includes a display device and processing circuitry configured to generate a remote assistance screen in response to remote assistance requests assigned to the remote operator. The remote assistance screen includes monitoring images showing an assistance situation of a target vehicle. The processing circuitry is further configured to set a display priority for each of the remote assistance requests, to select, as a preferential monitoring image, a monitoring image corresponding to a remote assistance request having a highest display priority among the monitoring images, and to display the monitoring images on the remote assistance screen so that the preferential monitoring image has higher noticeability than other monitoring images have.

This invention provides a method, system, and storage medium for displaying a panoramic view of a vehicle. The method includes: an AR user terminal entering a working mode after connecting to the network; acquiring multiple images of the vehicle's surrounding environment using cameras to obtain a panoramic image; and obtaining a panoramic image corresponding to the user's current viewpoint based on the AR user terminal's real-time coordinates and pose data; simultaneously detecting obstacles around the target vehicle and generating corresponding instruction animations and prompts based on the obstacles; and then further fusing the panoramic image and instruction animations and presenting them to the AR user terminal. The AR user terminal used in this invention can perceive the location of obstacles, quickly assess their impact, and generate corresponding instruction animations and prompts, allowing users to perceive the direction of risk and make appropriate driving decisions; it can also remotely assist the driver in the target vehicle, improving driving safety; and it can also provide a three-dimensional interactive experience.

To reduce a load on a remote supporter who performs a remote support.SOLUTION: A remote support system includes one or a plurality of processors. The one or the plurality of processors acquire a plurality of tasks which are obtained by dividing the tasks according to the contents of a remote support to be requested from an automatic operation vehicle and also whose execution sequence is fixed. The one or the plurality of processors execute display processing for a remote support terminal to be operated by a remote supporter to display one or a plurality of videos required for executing the tasks, so as to allow the remote supporter to execute the plurality of tasks in the execution sequence.SELECTED DRAWING: Figure 2

The invention relates to the technical field of intelligent glasses, and discloses a video call assistance method and system based on intelligent glasses, and the system comprises the steps: enabling the intelligent glasses to collect the information of an environment in real time, and uploading the information to a cloud platform; the cloud platform performs scene recognition on the received environment information, judges whether the environment is in a complex environment, and triggers a remote assistance request if the environment is in the complex environment; screening the registered volunteers, and scheduling the volunteers to access the assistance task; the volunteer terminal accesses a video stream of the intelligent glasses, and provides navigation or obstacle prompt for a user through a voice instruction or audio feedback; the evaluation module records and analyzes interaction data in real time in the assistance process to generate volunteer service scores; and generating a volunteer score based on the volunteer service score, and counting the volunteer score into a volunteer incentive system. According to the application, intelligent environment identification is realized, volunteer matching optimization is realized, and an interactive behavior quantitative evaluation and service incentive mechanism is assisted.

According to embodiments of the present disclosure, methods and apparatuses for remote assistance are provided. The method includes presenting an assistance interface associated with an autonomous vehicle; and presenting, in the assistance interface, a multi-path video stream corresponding to a plurality of viewing perspectives of the autonomous vehicle based on video data received from the autonomous vehicle, wherein the multi-path video stream includes a first video stream corresponding to a forward viewing perspective and a second video stream corresponding to a rearward viewing perspective, the first video stream and the second video stream are generated based on a video stitching model associated with the autonomous vehicle, the video stitching model is constructed based on a plurality of images captured by a plurality of cameras deployed on the autonomous vehicle. In this way, embodiments of the present disclosure can improve the reliability of remote assistance, thereby improving the driving safety of the autonomous vehicle.

A remote assistance method and apparatus, and a device and a storage medium. The method comprises: in response to an autonomous vehicle (101) being in a stuck state, determining a parking attribute of a target vehicle associated with the stuck state (202), wherein the parking attribute indicates whether the target vehicle is a temporarily parked vehicle (204); in response to the parking attribute of the target vehicle meeting a first condition, determining a lane state of an adjacent lane of the autonomous vehicle (208), wherein the lane state indicates a traffic direction and / or a traffic state of the adjacent lane; and in response to the lane state meeting a second condition (210), triggering the sending of an assistance request associated with the stuck state to a remote device (206).

Example embodiments relate to gradually adjusting a vehicle sensor perspective using remote assistance. A computing device may receive a request for assistance from a vehicle operating in an environment. The request indicates that the vehicle is stopped at a location with a sensor perspective of the environment that is at least partially occluded. Responsive to receiving the request for assistance, the computing device may display a graphical user interface (GUI) that represents a current state of the vehicle and includes a selectable option configured to enable the vehicle to gradually move forward a predefined distance. The computing device may detect a selection of the selectable option and transmit instructions that enable the vehicle to gradually move forward the predefined distance. The vehicle can then gradually move forward the predefined distance while also monitoring for one or more changes in the environment responsive to receiving the instructions.

The invention relates to the technical field of communication, and discloses a remote assistance method and device, electronic equipment and a storage medium. The method is executed by a first device, and comprises the following steps: receiving a change event sent by a second device; based on the change event, updating the current DOM mirror image tree to obtain an updated DOM mirror image tree, the DOM mirror image tree being a mirror image body of the DOM tree of the second device; an interaction event triggered by a user in the updated DOM mirror image tree is captured, a first event object is generated, and the first event object comprises an event type, an identifier of an acted DOM node and event parameters; and after serializing the first event object, sending the serialized first event object to the second equipment, so as to trigger the serialized first event object on the corresponding DOM node in the DOM tree. According to the embodiment of the invention, the invasiveness of remote assistance can be reduced, and the privacy protection intensity for the assisted party can be improved.

Augmented reality rendering method for remote assistance of a user in performing a task in a work environment, the assistance being provided via electronic means by an expert, said electronics means comprising a user device associated with the user and an expert device associated with the expert, the user and expert devices being configured for communicating with each other, the method comprising obtaining user scene information comprising image data of the work environment, displaying the user scene information on the expert device, obtaining expert scene information comprising image data of an object controllable by the expert for showing how to perform the task, creating a model of the controllable object based on the obtained expert scene information, generating an augmented reality scene by including the created model of the controllable object in the image data of the work environment, displaying the augmented reality scene on the expert and user devices.

The present technology pertains to an information processing device, an information processing method, and a moving object that make it possible to stably perform remote assistance with respect to the moving object. This information processing device is provided with an image processing unit that generates a first assistance video to be used for remote assistance with respect to a moving body on the basis of surrounding state information indicating the surrounding state of the moving body. The present technology can be applied, for example, to a system that implements remote operation of a vehicle.

This application discloses a remote assistance method and system for a mobile terminal, a storage medium, and a computer device. The method includes: a first mobile terminal responding to a remote assistance trigger operation in a remote assistance application; the first mobile terminal sending a remote assistance request carrying a second mobile terminal identifier to a server to accurately establish a connection with the second mobile terminal; the remote assistance application in the first mobile terminal activating the screen recording function of the first terminal, recording the screen information requiring assistance and sending it to the second mobile terminal through the server; the second mobile terminal generating an assistance operation instruction based on the recorded screen information and sending it to the first mobile terminal through the server; and the first mobile terminal performing the corresponding remote assistance operation according to the assistance operation instruction. This enables the second mobile terminal to remotely operate the first mobile terminal, and the remote assistance operation process can be displayed on the first mobile terminal, providing convenience for the user of the first mobile terminal.

The embodiment of the invention provides a remote assistance method and system and a storage medium. The remote assistance method and system are applied to a system comprising first electronic equipment, second electronic equipment and third electronic equipment. The method comprises the steps that first electronic equipment obtains a layout file of third electronic equipment from the third electronic equipment through second connection; in response to the first operation, the first electronic equipment sends a layout file to the second electronic equipment through the first connection; the first electronic equipment displays a first control interface of the third electronic equipment based on the layout file; the second electronic equipment displays a second control interface of the third electronic equipment based on the layout file; and in response to a second operation received in the second control interface, the second electronic equipment sends cooperation information to the first electronic equipment through the first connection. And the first electronic equipment controls the third electronic equipment based on the control instruction. Therefore, the difficulty of using the third electronic equipment by old people is reduced, and the use experience of the old people on the electronic equipment is improved.

Embodiments of the present disclosure provide a method, device, equipment and storage medium for remote assistance. The method comprises: in response to the autonomous vehicle being in a stranded state, determining a parking attribute of a target vehicle associated with the stranded state, the parking attribute indicating whether the target vehicle is a temporary parking vehicle; in response to the parking attribute of the target vehicle satisfying a first condition, determining a lane state of a neighboring lane of the autonomous vehicle, the lane state indicating a traffic direction and / or a traffic state of the neighboring lane; and in response to the lane state satisfying a second condition, triggering sending of an assistance request associated with the stranded state to a remote device.

A medical system includes a coordination system for coordinating remote assistance for a robotic manipulation system while the robotic manipulation system is in one of multiple operational states. The coordination system includes an environment awareness engine that processes image data of the robotic manipulation system in an operating environment to determine a system-external context by detecting at least one procedure-progression indicator, and determining an estimate of an actual operational state from the multiple operational states based on the at least one procedure-progression indicator. The coordination system further includes a support agent that receives a support request from the medical system, evaluates the system-external context to identify a support person to respond to the support request by identifying the support person to respond to the support request according to the estimate of the actual operational state, and automatically contacts the support person to respond to the support request.

An improved decentralized, blockchain-driven network for artificial intelligence (AI)-enabled skills exchange between Intelligent Personal Assistants (IPAs) in a network is disclosed that is configured to perform computational tasks or services (also referred to herein as “skills”) in an optimally-efficient fashion. In some embodiments, this may comprise a first IPA paying an agreed cost to a second IPA to perform a particular skill in a more optimally-efficient fashion. In some embodiments, a skills registry is published, comprising benchmark analyses and costs for the skills offered by the various nodes on the skills exchange network. In other embodiments, a transaction ledger is maintained that provides a record of all transactions performed across the network in a tamper-proof and auditable fashion, e.g., via the use of blockchain technology. Over time, the AI-enabled nodes in the system may learn to scale, replicate, and transact with each other in an optimized—and fully autonomous—fashion.

A coordination system for coordinating remote assistance of a medical system involves a support agent executed by a computer processor. The support agent is configured to receive a first support request submitted by a user of the medical system, and identify a support person to respond to the first support request from a multitude of support persons by applying a support person identification logic to a system-internal context. The system-internal context is obtained from a system awareness engine configured to detect information about the medical system. The support agent is further configured to facilitate contact of the support person.

Systems and techniques are provided for streamlining a proposal for a remote assistance system of an autonomous vehicle (AV) based on contextual similarities in remote assistance sessions that are associated with a set of AVs. An example process includes receiving a request for remote assistance from an AV in a scene and identifying a context associated with the AV. The context includes at least one of contextual factor(s) of the scene, AV characteristics, and task(s) associated with the request. The example process includes comparing the context associated with the AV with one or more contexts associated with one or more sessions associated with a set of AVs, determining a similarity between the context associated with the AV and the one or more contexts associated with the one or more sessions, and determining one or more proposals for the request based on the similarity.

Disclosed are methods and systems for automatically developing skills for intelligent personal assistants from visual content found on the internet. The disclosed system comprises components that crawl the web to discover and download images and videos, preprocess and analyze the content using computer vision and machine learning algorithms, classify and qualify the objects detected in the content, and create or enhance skills based on the analyzed data. The skills are then stored in a database and can be invoked by users via various client devices. The methods and systems simplify user interactions with web resources by automating the skill development process, enabling more efficient and personalized use of intelligent personal assistants.