Remote collaboration method, device, equipment and medium

Abstract

The present application discloses a remote collaboration method, apparatus, device, and medium, which belongs to the technical field of remote collaboration. In the present application, the screen capture specifications of the remote collaboration device are adjusted by matching the real-time collaboration screen in the current remote collaboration process with the typical interaction scenes and atypical interaction scenes of the collaboration project. Compared with the fixed screen capture specifications in conventional means, in the remote collaboration process, the real-time interaction screen of the remote assistance is captured using the screen capture specifications that match the interaction scenes of the collaboration project, thereby appropriately reducing the data transmission volume of the real-time interaction screen, thereby improving the network transmission efficiency in the remote collaboration process.

Description

Technical Field

[0001] The present application relates to the technical field of remote collaboration, and in particular to a remote collaboration method, a remote collaboration apparatus, a remote collaboration device, and a computer-readable storage medium. Background Art

[0002] Currently, a growing number of industries are leveraging technologies to enable remote collaboration scenarios where users in different locations can participate, collaborate, and interact with each other. However, remote collaboration typically requires data transmission over a network. Network latency and bandwidth limitations can lead to reduced real-time performance and image quality, which can affect real-time communication and collaboration between participants. Summary of the Invention

[0003] The main purpose of this application is to provide a remote collaboration method, a remote collaboration apparatus, a remote collaboration device and a computer-readable storage medium, aiming to improve the network transmission efficiency during the remote collaboration process.

[0004] To achieve the above objectives, the present application provides a remote collaboration method, the method comprising:

[0005] Initiate remote collaboration based on a remote collaboration device, and obtain a real-time collaboration screen during the current remote collaboration process through the remote collaboration device;

[0006] Obtaining a current remote collaboration project, and determining typical interaction scenarios and atypical interaction scenarios of the collaboration project;

[0007] According to the matching results of the real-time collaboration screen and the typical interaction scenarios and atypical interaction scenarios of the collaboration project, the screen acquisition specifications of the remote collaboration device are adjusted.

[0008] Exemplarily, the step of obtaining the current remote collaboration project includes:

[0009] Determine the current collaboration project of the current remote collaboration according to the collaboration information of the current remote collaboration;

[0010] Alternatively, identifying the real-time collaboration screen to obtain a current collaboration project of the current remote collaboration;

[0011] Alternatively, the collaboration item of the current remote collaboration is determined based on the first collaboration item to be selected for the current remote collaboration determined by the collaboration information of the current remote collaboration and the second collaboration item to be determined for the current remote collaboration obtained by identifying the real-time collaboration screen.

[0012] Exemplarily, the step of determining typical interaction scenarios and atypical interaction scenarios of the collaborative project includes:

[0013] Obtaining project information of the collaborative project;

[0014] The typical interaction scenarios and atypical interaction scenarios of the project information are matched by a preset scenario matching model.

[0015] Exemplarily, the step of adjusting the screen capture specifications of the remote collaboration device according to the matching results between the real-time collaboration screen and the typical interaction scenarios and atypical interaction scenarios of the collaboration project includes:

[0016] Obtaining the real-time image acquisition specification, acquisition specification upper limit, and acquisition specification lower limit of the remote collaboration device;

[0017] If the real-time collaboration screen is a typical interaction scene of the collaboration project, then during the period when the real-time collaboration screen is a typical interaction scene of the collaboration project, increasing the screen acquisition specification of the remote collaboration device until the real-time screen acquisition specification of the remote collaboration device reaches the acquisition specification upper limit;

[0018] If the real-time collaboration screen is an atypical interaction scenario of the collaboration project, then during the period when the real-time collaboration screen is an atypical interaction scenario of the collaboration project, the screen acquisition specification of the remote collaboration device is reduced until the real-time screen acquisition specification of the remote collaboration device reaches the acquisition specification lower limit.

[0019] Exemplarily, the step of improving the screen capture specification of the remote collaboration device during the period when the real-time collaboration screen is a typical interaction scene of the collaboration project includes:

[0020] During a period when the real-time collaboration screen is a typical interaction scene of the collaboration project, identifying typical scene elements of the typical interaction scene of the collaboration project in the real-time collaboration screen;

[0021] Obtaining preset element weights, element quantity, and element unit scores of typical scene elements in the real-time collaboration screen;

[0022] Determining a scene score for taking the real-time collaboration screen as a typical interaction scene of the collaboration project according to the preset element weights, the number of elements, and the element unit scores;

[0023] Based on the scenario score, the screen capture specification of the remote collaboration device is improved.

[0024] Exemplarily, the step of improving the screen capture specification of the remote collaboration device based on the scene score includes:

[0025] Obtaining preset screen capture specifications of the remote collaboration device and preset scene scoring intervals for each preset screen capture specification, wherein the higher the preset screen capture specification, the larger the preset scene scoring interval;

[0026] The screen capture specification of the remote collaboration device is increased to the preset screen capture specification corresponding to the preset scene score interval in which the scene score is located.

[0027] Exemplarily, the method further includes:

[0028] When switching between a typical interaction scene and an atypical interaction scene, determining a screen jitter rate of the real-time collaboration scene according to the screen content of the real-time collaboration scene in the real-time collaboration scene of the target interaction scene after the interaction scene is switched;

[0029] If the screen jitter rate is less than the preset jitter rate threshold within the preset time period, at the end of the preset time period, the remote collaboration device will switch from the screen acquisition specification before switching the interaction scene to the screen acquisition specification of the target interaction scene.

[0030] The present application also provides a remote collaboration device, comprising:

[0031] A screen acquisition module is used to start remote collaboration based on a remote collaboration device and acquire a real-time collaboration screen during the current remote collaboration process through the remote collaboration device;

[0032] A scenario determination module is used to obtain a current remote collaboration project and determine typical interaction scenarios and atypical interaction scenarios of the collaboration project;

[0033] The specification adjustment module is used to adjust the screen acquisition specifications of the remote collaboration device according to the matching results of the real-time collaboration screen and the typical interaction scenarios and atypical interaction scenarios of the collaboration project.

[0034] The present application also provides a remote collaboration device, which includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program implements the steps of the remote collaboration method described above when executed by the processor.

[0035] The present application also provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the steps of the remote collaboration method described above are implemented.

[0036] The embodiments of the present application propose a remote collaboration method, a remote collaboration apparatus, a remote collaboration device, and a computer-readable storage medium. Remote collaboration is started based on a remote collaboration device, and a real-time collaboration screen in the current remote collaboration process is obtained through the remote collaboration device; a collaboration project of the current remote collaboration is obtained, and typical interaction scenarios and atypical interaction scenarios of the collaboration project are determined; and according to the matching results between the real-time collaboration screen and the typical interaction scenarios and atypical interaction scenarios of the collaboration project, the screen acquisition specifications of the remote collaboration device are adjusted.

[0037] At present, when transmitting data of remote assistance screens through the network, there are a series of solutions to the problems of network delays and bandwidth limitations that lead to reduced real-time performance and deterioration of image quality. However, in this application, attention is paid to a new perspective. Considering that fixed screen acquisition specifications are often used to achieve screen acquisition in remote collaboration, in order to ensure the picture quality of typical interactive scenes in the remote collaboration process, it is necessary to adopt higher screen acquisition specifications, and in the entire remote collaboration process, this higher screen acquisition specification is used as the only screen acquisition specification. In the current atypical interactive scene of remote collaboration, due to the use of the higher screen acquisition specification corresponding to the only typical interactive scene, the data transmission volume of the atypical interactive scene with lower picture quality requirements is also large, which in turn leads to the problems of reduced real-time performance and deterioration of image quality in the above-mentioned remote assistance process.

[0038] Therefore, in this application, a remote collaboration device used to start remote collaboration is used to obtain the real-time collaboration screen in the current remote collaboration process, and the typical interaction scenarios and atypical interaction scenarios of the current remote collaboration collaboration project are determined. Then, based on the matching results between the real-time collaboration screen and the typical interaction scenarios and atypical interaction scenarios of the collaboration project, the screen acquisition specifications of the remote collaboration device are adjusted.

[0039] Therefore, by matching the real-time collaborative screen in the current remote collaboration process with the typical interaction scenarios and atypical interaction scenarios of the collaborative project, the screen acquisition specifications of the remote collaboration device are adjusted. Compared with the fixed screen acquisition specifications in conventional means, during the remote collaboration process, the real-time interactive screen of the remote assistance is acquired using screen acquisition specifications that match the interaction scenarios of the collaborative project, thereby appropriately reducing the data transmission volume of the real-time interactive screen, and thereby improving the network transmission efficiency during the remote collaboration process. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] Figure 1 It is a structural diagram of the operating equipment of the hardware operating environment involved in the embodiment of the present application;

[0041] Figure 2This is a flowchart of an embodiment of a remote collaboration method according to an embodiment of the present application;

[0042] Figure 3 This is a schematic diagram of a remote collaboration device involved in an embodiment of the present application.

[0043] The realization of the objectives, functional features and advantages of this application will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0044] It should be understood that the specific embodiments described herein are only used to explain the present application and are not intended to limit the present application.

[0045] Reference Figure 1 , Figure 1 This is a schematic diagram of the operating equipment structure of the hardware operating environment involved in the embodiment of the present application.

[0046] like Figure 1 As shown, the operating device may include: a processor 1001, such as a central processing unit (CPU), a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Among them, the communication bus 1002 is used to realize the connection and communication between these components. The user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard), and the user interface 1003 may optionally include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a wireless fidelity (WIreless-FIdelity, WI-FI) interface). The memory 1005 may be a high-speed random access memory (Random Access Memory, RAM) memory, or a stable non-volatile memory (Non-Volatile Memory, NVM), such as a disk memory. The memory 1005 may optionally be a storage device independent of the aforementioned processor 1001.

[0047] Those skilled in the art will understand that Figure 1 The structure shown in the figure does not constitute a limitation on the operating device, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0048] like Figure 1 As shown, the memory 1005 as a storage medium may include an operating system, a network communication module, a user interface module and a computer program.

[0049] exist Figure 1In the running device shown, the network interface 1004 is mainly used for data communication with other devices; the user interface 1003 is mainly used for data interaction with the user; the processor 1001 and the memory 1005 in the running device of the present application can be set in the running device, and the running device calls the computer program stored in the memory 1005 through the processor 1001 and performs the following operations:

[0050] Initiate remote collaboration based on a remote collaboration device, and obtain a real-time collaboration screen during the current remote collaboration process through the remote collaboration device;

[0051] Obtaining a current remote collaboration project, and determining typical interaction scenarios and atypical interaction scenarios of the collaboration project;

[0052] According to the matching results of the real-time collaboration screen and the typical interaction scenarios and atypical interaction scenarios of the collaboration project, the screen acquisition specifications of the remote collaboration device are adjusted.

[0053] In one embodiment, the processor 1001 may call a computer program stored in the memory 1005 and further perform the following operations:

[0054] The step of obtaining the current remote collaboration project includes:

[0055] Determine the current collaboration project of the current remote collaboration according to the collaboration information of the current remote collaboration;

[0056] Alternatively, identifying the real-time collaboration screen to obtain a current collaboration project of the current remote collaboration;

[0057] Alternatively, the collaboration item of the current remote collaboration is determined based on the first collaboration item to be selected for the current remote collaboration determined by the collaboration information of the current remote collaboration and the second collaboration item to be determined for the current remote collaboration obtained by identifying the real-time collaboration screen.

[0058] In one embodiment, the processor 1001 may call a computer program stored in the memory 1005 and further perform the following operations:

[0059] The step of determining the typical interaction scenarios and atypical interaction scenarios of the collaborative project includes:

[0060] Obtaining project information of the collaborative project;

[0061] The typical interaction scenarios and atypical interaction scenarios of the project information are matched by a preset scenario matching model.

[0062] In one embodiment, the processor 1001 may call a computer program stored in the memory 1005 and further perform the following operations:

[0063] The step of adjusting the screen acquisition specifications of the remote collaboration device according to the matching results between the real-time collaboration screen and the typical interaction scenarios and atypical interaction scenarios of the collaboration project includes:

[0064] Obtaining the real-time image acquisition specification, acquisition specification upper limit, and acquisition specification lower limit of the remote collaboration device;

[0065] If the real-time collaboration screen is a typical interaction scene of the collaboration project, then during the period when the real-time collaboration screen is a typical interaction scene of the collaboration project, increasing the screen acquisition specification of the remote collaboration device until the real-time screen acquisition specification of the remote collaboration device reaches the acquisition specification upper limit;

[0066] If the real-time collaboration screen is an atypical interaction scenario of the collaboration project, then during the period when the real-time collaboration screen is an atypical interaction scenario of the collaboration project, the screen acquisition specification of the remote collaboration device is reduced until the real-time screen acquisition specification of the remote collaboration device reaches the acquisition specification lower limit.

[0067] In one embodiment, the processor 1001 may call a computer program stored in the memory 1005 and further perform the following operations:

[0068] The step of improving the screen acquisition specification of the remote collaboration device during the period when the real-time collaboration screen is a typical interaction scene of the collaboration project includes:

[0069] During a period when the real-time collaboration screen is a typical interaction scene of the collaboration project, identifying typical scene elements of the typical interaction scene of the collaboration project in the real-time collaboration screen;

[0070] Obtaining preset element weights, element quantity, and element unit scores of typical scene elements in the real-time collaboration screen;

[0071] Determining a scene score for taking the real-time collaboration screen as a typical interaction scene of the collaboration project according to the preset element weights, the number of elements, and the element unit scores;

[0072] Based on the scenario score, the screen capture specification of the remote collaboration device is improved.

[0073] In one embodiment, the processor 1001 may call a computer program stored in the memory 1005 and further perform the following operations:

[0074] The step of improving the screen capture specification of the remote collaboration device based on the scene score includes:

[0075] Obtaining preset screen capture specifications of the remote collaboration device and preset scene scoring intervals for each preset screen capture specification, wherein the higher the preset screen capture specification, the larger the preset scene scoring interval;

[0076] The screen capture specification of the remote collaboration device is increased to the preset screen capture specification corresponding to the preset scene score interval in which the scene score is located.

[0077] In one embodiment, the processor 1001 may call a computer program stored in the memory 1005 and further perform the following operations:

[0078] The method further comprises:

[0079] When switching between a typical interaction scene and an atypical interaction scene, determining a screen jitter rate of the real-time collaboration scene according to the screen content of the real-time collaboration scene in the real-time collaboration scene of the target interaction scene after the interaction scene is switched;

[0080] If the screen jitter rate is less than the preset jitter rate threshold within the preset time period, at the end of the preset time period, the remote collaboration device will switch from the screen acquisition specification before switching the interaction scene to the screen acquisition specification of the target interaction scene.

[0081] The present application embodiment provides a remote collaboration method, referring to Figure 2 In one embodiment of the remote collaboration method, the method includes:

[0082] Step S10: starting remote collaboration based on the remote collaboration device, and obtaining a real-time collaboration screen during the current remote collaboration process through the remote collaboration device;

[0083] In this application, a remote collaboration device is a device that has at least image acquisition and remote communication functions, and can be a smart mobile device such as a mobile phone or a computer. Preferably, the remote assistance device is an AR (virtual reality) device. In one embodiment, remote collaboration is enabled by wearing an AR device and obtaining a real-time collaboration image during the current remote collaboration process through the camera on the AR device, thereby overlaying the digital information on the real-time scene image in the real world, thereby achieving remote assistance.

[0084] Step S20: obtaining a current remote collaboration project, and determining typical interaction scenarios and atypical interaction scenarios of the collaboration project;

[0085] Current remote collaboration projects include power inspection, cargo acceptance, vehicle maintenance, medical guidance, training and teaching, online house viewing, etc. In the current remote collaboration projects, there are typical interaction scenarios of the collaboration projects, such as the scene of inspection in the power inspection collaboration project. It can be simply considered that the scenarios other than the typical interaction scenarios are atypical interaction scenarios. Of course, both the typical interaction scenarios and atypical interaction scenarios in a collaboration project can be set. For example, users are allowed to trigger the start and end times of typical interaction scenarios through software or buttons to determine the typical interaction scenarios in the remote collaboration process. Similarly, atypical interaction scenarios in the remote collaboration process can be determined.

[0086] Exemplarily, the step of obtaining the current remote collaboration project includes:

[0087] Determine the current collaboration project of the current remote collaboration according to the collaboration information of the current remote collaboration;

[0088] Alternatively, identifying the real-time collaboration screen to obtain a current collaboration project of the current remote collaboration;

[0089] Alternatively, the collaboration item of the current remote collaboration is determined based on the first collaboration item to be selected for the current remote collaboration determined by the collaboration information of the current remote collaboration and the second collaboration item to be determined for the current remote collaboration obtained by identifying the real-time collaboration screen.

[0090] When obtaining the current collaboration project for remote collaboration, the current collaboration project for remote collaboration is determined based on collaboration information for the current collaboration, such as the name of the current collaboration project, the model and specifications of the remote collaboration equipment, the project implementation location, the categories of the collaboration personnel on both sides, and a brief description of the project. Alternatively, a real-time collaboration screen is identified, and the current collaboration project for remote collaboration is determined based on scene features within the real-time collaboration screen. Alternatively, the collaboration project for remote collaboration is determined by combining a first collaboration candidate for remote collaboration determined based on the collaboration information for remote collaboration and a second collaboration candidate for remote collaboration obtained by identifying the real-time collaboration screen. For example, the first collaboration candidate identified as power inspection, cargo acceptance, and vehicle maintenance, with respective credibility of 50%, 30%, and 80%, respectively, and the second collaboration candidate identified as power inspection, training and teaching, and vehicle maintenance, with respective credibility of 10%, 70%, and 30%, respectively. The collaboration project with the highest sum of the two credibility levels is then selected as the final collaboration project for remote collaboration, and the collaboration project for remote collaboration is determined to be vehicle maintenance.

[0091] Exemplarily, the step of determining typical interaction scenarios and atypical interaction scenarios of the collaborative project includes:

[0092] Obtaining project information of the collaborative project;

[0093] The typical interaction scenarios and atypical interaction scenarios of the project information are matched by a preset scenario matching model.

[0094] When determining the typical interaction scenarios and atypical interaction scenarios of a collaborative project, a preset scenario matching model is used to match the typical interaction scenarios and atypical interaction scenarios of the project information of the collaborative project. For example, when the current remote collaborative project is vehicle maintenance, its project information includes the name of the collaborative project "vehicle maintenance" and a description of the vehicle maintenance project. The project information of the collaborative project may be a subset of the collaborative information of the current remote collaboration. In addition, the preset scenario matching model can obtain the corresponding typical interaction scenarios and atypical interaction scenarios based on the project information. For example, based on the name of the collaborative project "vehicle maintenance", typical maintenance scene pictures and videos of vehicle maintenance are selected to obtain typical interaction scenarios of vehicle maintenance.

[0095] Step S30 : adjusting the screen capture specifications of the remote collaboration device according to the matching results of the real-time collaboration screen and the typical interaction scenarios and atypical interaction scenarios of the collaboration project.

[0096] Finally, based on the matching results between the real-time collaboration screen and the typical and atypical interaction scenarios of the collaboration project, the screen acquisition specifications of the remote collaboration device are adjusted.

[0097] In one embodiment, a collaborative project currently being remotely collaborated is obtained, and a general, common scenario, including typical and atypical interaction scenarios, within the collaborative project is determined. The AR device identifies the real-time collaborative image in the current scenario. If the real-time collaborative image is identified as a general, common scenario, the AR device's acquisition specifications are automatically lowered to reduce the amount of data to be transmitted. If the real-time collaborative image is identified as a typical interaction scenario, the AR device's acquisition specifications are automatically increased to ensure image quality and collaboration quality.

[0098] In addition, dynamic adaptive adjustments can be made: data transmission parameters and strategies can be adjusted dynamically based on network conditions to accommodate varying network delays and bandwidth limitations. For example, the image compression ratio, resolution, or frame rate of AR device image acquisition can be automatically adjusted based on network quality.

[0099] Exemplarily, the step of adjusting the screen capture specifications of the remote collaboration device according to the matching results between the real-time collaboration screen and the typical interaction scenarios and atypical interaction scenarios of the collaboration project includes:

[0100] Obtaining the real-time image acquisition specification, acquisition specification upper limit, and acquisition specification lower limit of the remote collaboration device;

[0101] If the real-time collaboration screen is a typical interaction scene of the collaboration project, then during the period when the real-time collaboration screen is a typical interaction scene of the collaboration project, increasing the screen acquisition specification of the remote collaboration device until the real-time screen acquisition specification of the remote collaboration device reaches the acquisition specification upper limit;

[0102] If the real-time collaboration screen is an atypical interaction scenario of the collaboration project, then during the period when the real-time collaboration screen is an atypical interaction scenario of the collaboration project, the screen acquisition specification of the remote collaboration device is reduced until the real-time screen acquisition specification of the remote collaboration device reaches the acquisition specification lower limit.

[0103] When adjusting the screen acquisition specifications of the remote collaboration device according to the matching results between the real-time collaboration screen and the typical interaction scenarios and atypical interaction scenarios of the collaboration project, the real-time screen acquisition specifications, the upper limit of the acquisition specifications, and the lower limit of the acquisition specifications of the remote collaboration device are obtained. For example, the real-time screen acquisition specifications of the remote collaboration device include (8K, 120FPS), (8K, 60FPS), (8K, 30FPS), (8K, 24FPS), (4K, 120FPS), (4K, 60FPS), (4K, 30FPS), and (4K, 24FPS). The upper limit of the acquisition specification is (8K, 120FPS) with the largest data volume, and the lower limit of the acquisition specification is (4K, 24FPS) with the smallest data volume.

[0104] If the real-time collaboration screen is a typical interactive scenario of the collaboration project, then during the period when the real-time collaboration screen is a typical interactive scenario of the collaboration project, the screen acquisition specifications of the remote collaboration device are increased until the real-time screen acquisition specifications of the remote collaboration device reach the acquisition specification upper limit; or, during the period when the real-time collaboration screen is a typical interactive scenario of the collaboration project, the acquisition specifications are increased one by one according to the preset period, that is, the real-time screen acquisition specification is increased by one every preset period, so as to reduce screen freezes caused by large-scale sudden changes in the screen acquisition specifications.

[0105] If the real-time collaboration screen is an atypical interaction scenario of the collaboration project, then during the period when the real-time collaboration screen is an atypical interaction scenario of the collaboration project, the screen acquisition specification of the remote collaboration device is reduced until the real-time screen acquisition specification of the remote collaboration device reaches the lower limit of the acquisition specification; or, similarly, during the period when the real-time collaboration screen is an atypical interaction scenario of the collaboration project, the acquisition specifications are reduced one by one according to the preset period, that is, the real-time screen acquisition specification is reduced by one every preset period, so as to reduce screen freezes caused by large-scale mutations in the screen acquisition specifications.

[0106] Exemplarily, the step of improving the screen capture specification of the remote collaboration device during the period when the real-time collaboration screen is a typical interaction scene of the collaboration project includes:

[0107] During a period when the real-time collaboration screen is a typical interaction scene of the collaboration project, identifying typical scene elements of the typical interaction scene of the collaboration project in the real-time collaboration screen;

[0108] Obtaining preset element weights, element quantity, and element unit scores of typical scene elements in the real-time collaboration screen;

[0109] Determining a scene score for taking the real-time collaboration screen as a typical interaction scene of the collaboration project according to the preset element weights, the number of elements, and the element unit scores;

[0110] Based on the scenario score, the screen capture specification of the remote collaboration device is improved.

[0111] When the screen acquisition specification of the remote collaboration device is improved during a period when the real-time collaboration screen is a typical interactive scenario of the collaboration project, the screen acquisition specification of the remote collaboration device may also be improved based on the scenario score.

[0112] During the period when the real-time collaboration screen is a typical interactive scene of the collaboration project, typical scene elements of the typical interactive scene of the collaboration project in the real-time collaboration screen are identified. For example, when the collaboration project is vehicle maintenance, the typical interactive scene of vehicle maintenance includes routine maintenance such as changing engine oil, air filter, brake pads, etc., regularly checking the wear of tires to ensure proper tire pressure and replacing tires as needed, regularly checking the status of brake pads, brake discs and brake fluid to ensure the reliability and performance of the brake system, and regularly checking the status of engine oil, coolant, belts and other related components to ensure the engine is in good condition. Engine maintenance for normal operation and extended service life, regular inspection of the vehicle's electrical system, including batteries, lights, wiring, etc., to ensure the normal operation of the electrical system, electrical system inspection, regular inspection and maintenance of the vehicle's air conditioning and heating systems to maintain a comfortable driving environment, environmental control system maintenance, etc., in which typical interactive scenarios of routine maintenance such as changing engine oil, air filters, brake pads, etc., its typical scene elements include car body, engine oil bottle, air filter, brake pads, landing gear, etc., among which the typical scene elements can be identified according to the existing recognition model. In this embodiment, the model and method for realizing the identification of typical scene elements are not limited.

[0113] During the period of routine maintenance of a vehicle inspection on the real-time collaboration screen, the preset element weight of the vehicle body is 1, the number of elements is 1, and the element unit score is 1. The preset element weight of the oil bottle is 2, the number of elements may be 5, and the element unit score is 0.5. The preset element weight of the air filter is 0.5, the number of elements is 1, and the element unit score is 1. The preset element weight of the brake pad is 2, the number of elements may be 4, and the element unit score is 1.5. The preset element weight of the landing gear is 0.1, the number of elements is 1, and the element unit score is 0.1. Therefore, the scene score at this time is determined to be 1*1*1+2*5*0.5+0.5*1*1+2*4*1.5+0.1*1*0.1=1+5+0.5+12+0.01=18.51. Then, the image acquisition specifications of the remote collaboration device are improved based on the scene score. For example, the higher the scene score, the larger the step value of the increased acquisition specifications, and the more acquisition specifications that can be improved.

[0114] Exemplarily, the step of improving the screen capture specification of the remote collaboration device based on the scene score includes:

[0115] Obtaining preset screen capture specifications of the remote collaboration device and preset scene scoring intervals for each preset screen capture specification, wherein the higher the preset screen capture specification, the larger the preset scene scoring interval;

[0116] The screen capture specification of the remote collaboration device is increased to the preset screen capture specification corresponding to the preset scene score interval in which the scene score is located.

[0117] When improving the screen capture specifications of the remote collaboration device based on the scene score, the preset screen capture specifications of the remote collaboration device and the preset scene score intervals of each preset screen capture specification can also be obtained. For example, the preset screen capture specifications include (8K, 120FPS), (8K, 60FPS), (8K, 30FPS), (8K, 24FPS), (4K, 120FPS), (4K, 60FPS), (4K, 30FPS), (4K, 24FPS), and the respective preset scene score intervals are (100, 500), (85, 100), (80, 85), (50, 80), (40, 50), (20, 40), (10, 20), and (0, 10). Among them, the higher the preset screen capture specification, the larger the value of the corresponding preset scene score interval.

[0118] Then, the screen capture specifications of the remote collaboration device are increased to the preset screen capture specifications corresponding to the preset scene score interval where the scene score is located. For example, for the interactive scene with the above-mentioned scene score of 18.51, its current capture specifications are (4K, 24FPS). Then, its capture specifications can be increased from the current capture specifications to the (4K, 30FPS) capture specifications corresponding to the (10, 20) interval where the scene score of 18.51 is located.

[0119] Exemplarily, the method further includes:

[0120] When switching between a typical interaction scene and an atypical interaction scene, determining a screen jitter rate of the real-time collaboration scene according to the screen content of the real-time collaboration scene in the real-time collaboration scene of the target interaction scene after the interaction scene is switched;

[0121] If the screen jitter rate is less than the preset jitter rate threshold within the preset time period, at the end of the preset time period, the remote collaboration device will switch from the screen acquisition specification before switching the interaction scene to the screen acquisition specification of the target interaction scene.

[0122] When switching between typical interaction scenes and atypical interaction scenes, since the screen capture specifications between typical interaction scenes and atypical interaction scenes are different, it is possible that the captured screen may become stuck or discontinuous. Therefore, in the real-time collaborative screen of the target interaction scene after switching the interaction scene, the screen jitter rate of the real-time collaborative screen is determined according to the screen content of the real-time collaborative screen, wherein the screen jitter rate is the repetition rate between image pixels of adjacent frames. If the screen jitter rate is less than the preset jitter rate threshold within the preset time length, it means that the screen capture specification after switching the interaction scene will not cause the captured screen to become stuck or discontinuous. Therefore, at the end of the preset time length, the remote collaboration device is switched from the screen capture specification before switching the interaction scene to the screen capture specification of the target interaction scene, and the screen in the target interaction scene is captured with the screen capture specification of the target interaction scene.

[0123] Reference Figure 3 In addition, an embodiment of the present application further provides a remote collaboration device, the remote collaboration device comprising:

[0124] The screen acquisition module M1 is used to start remote collaboration based on the remote collaboration device and obtain the real-time collaboration screen of the current remote collaboration process through the remote collaboration device;

[0125] A scenario determination module M2 is used to obtain a current remote collaboration project and determine typical interaction scenarios and atypical interaction scenarios of the collaboration project;

[0126] The specification adjustment module M3 is configured to adjust the screen acquisition specifications of the remote collaboration device according to the matching results between the real-time collaboration screen and the typical interaction scenarios and atypical interaction scenarios of the collaboration project.

[0127] Exemplarily, the scene determination module is further configured to:

[0128] Determine the current collaboration project of the current remote collaboration according to the collaboration information of the current remote collaboration;

[0129] Alternatively, identifying the real-time collaboration screen to obtain a current collaboration project of the current remote collaboration;

[0130] Alternatively, the collaboration item of the current remote collaboration is determined based on the first collaboration item to be selected for the current remote collaboration determined by the collaboration information of the current remote collaboration and the second collaboration item to be determined for the current remote collaboration obtained by identifying the real-time collaboration screen.

[0131] Exemplarily, the scene determination module is further configured to:

[0132] Obtaining project information of the collaborative project;

[0133] The typical interaction scenarios and atypical interaction scenarios of the project information are matched by a preset scenario matching model.

[0134] Exemplarily, the specification adjustment module is further configured to:

[0135] Obtaining the real-time image acquisition specification, acquisition specification upper limit, and acquisition specification lower limit of the remote collaboration device;

[0136] If the real-time collaboration screen is a typical interaction scene of the collaboration project, then during the period when the real-time collaboration screen is a typical interaction scene of the collaboration project, increasing the screen acquisition specification of the remote collaboration device until the real-time screen acquisition specification of the remote collaboration device reaches the acquisition specification upper limit;

[0137] If the real-time collaboration screen is an atypical interaction scenario of the collaboration project, then during the period when the real-time collaboration screen is an atypical interaction scenario of the collaboration project, the screen acquisition specification of the remote collaboration device is reduced until the real-time screen acquisition specification of the remote collaboration device reaches the acquisition specification lower limit.

[0138] Exemplarily, the specification adjustment module is further configured to:

[0139] During a period when the real-time collaboration screen is a typical interaction scene of the collaboration project, identifying typical scene elements of the typical interaction scene of the collaboration project in the real-time collaboration screen;

[0140] Obtaining preset element weights, element quantity, and element unit scores of typical scene elements in the real-time collaboration screen;

[0141] Determining a scene score for taking the real-time collaboration screen as a typical interaction scene of the collaboration project according to the preset element weights, the number of elements, and the element unit scores;

[0142] Based on the scenario score, the screen capture specification of the remote collaboration device is improved.

[0143] Exemplarily, the specification adjustment module is further configured to:

[0144] Obtaining preset screen capture specifications of the remote collaboration device and preset scene scoring intervals for each preset screen capture specification, wherein the higher the preset screen capture specification, the larger the preset scene scoring interval;

[0145] The screen capture specification of the remote collaboration device is increased to the preset screen capture specification corresponding to the preset scene score interval in which the scene score is located.

[0146] Exemplarily, the remote collaboration device further includes a switching module, configured to:

[0147] When switching between a typical interaction scene and an atypical interaction scene, determining a screen jitter rate of the real-time collaboration scene according to the screen content of the real-time collaboration scene in the real-time collaboration scene of the target interaction scene after the interaction scene is switched;

[0148] If the screen jitter rate is less than the preset jitter rate threshold within the preset time period, at the end of the preset time period, the remote collaboration device will switch from the screen acquisition specification before switching the interaction scene to the screen acquisition specification of the target interaction scene.

[0149] The remote collaboration device provided in this application utilizes the remote collaboration method described in the aforementioned embodiments, aiming to improve network transmission efficiency during remote collaboration. Compared to conventional technologies, the beneficial effects of the remote collaboration device provided in the embodiments of this application are the same as those of the remote collaboration method described in the aforementioned embodiments. Other technical features of the remote collaboration device are the same as those disclosed in the aforementioned embodiments and are not further detailed here.

[0150] In addition, an embodiment of the present application also provides a remote collaboration device, which includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program implements the steps of the remote collaboration method described above when executed by the processor.

[0151] In addition, an embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the remote collaboration method described above are implemented.

[0152] It should be noted that, in this document, the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or system comprising a series of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or system. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or system comprising the element.

[0153] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus the necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to conventional technology can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as described above, and includes a number of instructions for enabling a terminal device (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods described in each embodiment of the present application.

[0154] The above are only preferred embodiments of the present application and do not limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A remote collaboration method, characterized in that: The method comprises: Initiate remote collaboration based on a remote collaboration device, and obtain a real-time collaboration screen during the current remote collaboration process through the remote collaboration device; Obtaining a current remote collaborative project, and determining typical interaction scenarios and atypical interaction scenarios for the collaborative project; wherein a typical interaction scenario is a scenario when performing remote collaborative work in the remote collaborative project, and an atypical interaction scenario is a scenario other than a typical interaction scenario; Adjusting the screen capture specifications of the remote collaboration device according to the matching results between the real-time collaboration screen and the typical interaction scenarios and atypical interaction scenarios of the collaboration project; The step of adjusting the screen acquisition specifications of the remote collaboration device according to the matching results between the real-time collaboration screen and the typical interaction scenarios and atypical interaction scenarios of the collaboration project includes: Obtaining the real-time image acquisition specification, acquisition specification upper limit, and acquisition specification lower limit of the remote collaboration device; If the real-time collaboration screen is a typical interaction scene of the collaboration project, then during the period when the real-time collaboration screen is a typical interaction scene of the collaboration project, increasing the screen acquisition specification of the remote collaboration device until the real-time screen acquisition specification of the remote collaboration device reaches the acquisition specification upper limit; If the real-time collaboration screen is an atypical interaction scenario of the collaboration project, then during the period when the real-time collaboration screen is an atypical interaction scenario of the collaboration project, reducing the screen acquisition specification of the remote collaboration device until the real-time screen acquisition specification of the remote collaboration device reaches the acquisition specification lower limit; The step of improving the screen acquisition specification of the remote collaboration device during the period when the real-time collaboration screen is a typical interaction scene of the collaboration project includes: During a period when the real-time collaboration screen is a typical interaction scene of the collaboration project, identifying typical scene elements of the typical interaction scene of the collaboration project in the real-time collaboration screen; Obtaining preset element weights, element quantity, and element unit scores of typical scene elements in the real-time collaboration screen; Determining a scene score for taking the real-time collaboration screen as a typical interaction scene of the collaboration project according to the preset element weights, the number of elements, and the element unit scores; Based on the scenario score, the screen capture specification of the remote collaboration device is improved.

2. The remote collaboration method according to claim 1, wherein: The step of obtaining the current remote collaboration project includes: Determine the current collaboration project of the current remote collaboration according to the collaboration information of the current remote collaboration; Alternatively, identifying the real-time collaboration screen to obtain a current collaboration project of the current remote collaboration; Alternatively, the collaboration item of the current remote collaboration is determined based on the first collaboration item to be selected for the current remote collaboration determined by the collaboration information of the current remote collaboration and the second collaboration item to be determined for the current remote collaboration obtained by identifying the real-time collaboration screen.

3. The remote collaboration method according to claim 1, wherein: The step of determining the typical interaction scenarios and atypical interaction scenarios of the collaborative project includes: Obtaining project information of the collaborative project; The typical interaction scenarios and atypical interaction scenarios of the project information are matched by a preset scenario matching model.

4. The remote collaboration method according to claim 1, wherein: The step of improving the screen capture specification of the remote collaboration device based on the scene score includes: Obtaining preset screen capture specifications of the remote collaboration device and preset scene scoring intervals for each preset screen capture specification, wherein the higher the preset screen capture specification, the larger the preset scene scoring interval; The screen capture specification of the remote collaboration device is increased to the preset screen capture specification corresponding to the preset scene score interval in which the scene score is located.

5. The remote collaboration method according to claim 1, wherein: The method further comprises: When switching between a typical interaction scene and an atypical interaction scene, determining a screen jitter rate of the real-time collaboration scene according to the screen content of the real-time collaboration scene in the real-time collaboration scene of the target interaction scene after the interaction scene is switched; If the screen jitter rate is less than the preset jitter rate threshold within the preset time period, at the end of the preset time period, the remote collaboration device will switch from the screen acquisition specification before switching the interaction scene to the screen acquisition specification of the target interaction scene.

6. A remote collaboration device, characterized in that: The remote collaboration device includes: A screen acquisition module is used to start remote collaboration based on a remote collaboration device and acquire a real-time collaboration screen during the current remote collaboration process through the remote collaboration device; A scenario determination module is used to obtain a current remote collaborative project and determine typical interaction scenarios and atypical interaction scenarios for the collaborative project; wherein a typical interaction scenario is a scenario when performing remote collaborative work in the remote collaborative project, and an atypical interaction scenario is a scenario other than a typical interaction scenario; a specification adjustment module, configured to adjust the screen acquisition specifications of the remote collaboration device according to a matching result between the real-time collaboration screen and the typical interaction scenarios and atypical interaction scenarios of the collaboration project; The step of adjusting the screen acquisition specification of the remote collaboration device according to the matching result between the real-time collaboration screen and the typical interaction scenario and the atypical interaction scenario of the collaboration project includes: obtaining the real-time screen acquisition specification, the upper limit of the acquisition specification and the lower limit of the acquisition specification of the remote collaboration device; if the real-time collaboration screen is a typical interaction scenario of the collaboration project, then during the period when the real-time collaboration screen is a typical interaction scenario of the collaboration project, increasing the screen acquisition specification of the remote collaboration device until the real-time screen acquisition specification of the remote collaboration device reaches the upper limit of the acquisition specification; if the real-time collaboration screen is an atypical interaction scenario of the collaboration project, then during the period when the real-time collaboration screen is an atypical interaction scenario of the collaboration project, reducing the screen acquisition specification of the remote collaboration device. format, until the real-time screen acquisition specification of the remote collaboration device reaches the lower limit of the acquisition specification; the step of improving the screen acquisition specification of the remote collaboration device during the time period when the real-time collaboration screen is a typical interaction scene of the collaboration project includes: identifying the typical scene elements of the typical interaction scene of the collaboration project in the real-time collaboration screen during the time period when the real-time collaboration screen is a typical interaction scene of the collaboration project; obtaining the preset element weight, element quantity, and element unit score of the typical scene elements in the real-time collaboration screen; determining the scene score of the real-time collaboration screen as the typical interaction scene of the collaboration project according to the preset element weight, the element quantity, and the element unit score; and improving the screen acquisition specification of the remote collaboration device based on the scene score.

7. A remote collaboration device, characterized in that: The remote collaboration device includes: a memory, a processor, and a computer program stored in the memory and executable on the processor. When the computer program is executed by the processor, the steps of the remote collaboration method according to any one of claims 1 to 5 are implemented.

8. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, which, when executed by a processor, implements the steps of the remote collaboration method according to any one of claims 1 to 5.

Images