Picture display method, device and system and vehicle production training method and device

Abstract

The embodiment of the invention provides a picture display method, device and system and a vehicle production training method and device.The picture display method is applied to a virtual reality display device and comprises the steps that a virtual scene picture corresponding to a target entity scene is displayed; adjusting the position of a virtual object in the virtual scene picture based on the position information of the entity object in the target entity scene; based on preset operation flow information of the entity object and the current state of the entity object, displaying operation information of a to-be-executed operation for the virtual object in the virtual scene picture; according to the method, the actual operation efficiency of the entity object can be improved, and the production and assembly efficiency can be improved in the production and assembly scene of the vehicle.

Description

Technical Field

[0001] The embodiments of this specification relate to the field of computer technology, and particularly to a method for displaying a screen; at the same time, it also relates to a production training method for vehicles, a screen display device, a production training device for vehicles, a computing device, and a computer-readable storage medium. Background Art

[0002] With the improvement of people's living standards, vehicles are more and more widely used, and the requirements for the production and assembly efficiency of vehicles are also getting higher and higher.

[0003] Before the staff carry out production and assembly on vehicles, it is necessary to arrange training masters to train the staff. However, the current training efficiency is low, which will affect the production and assembly efficiency of vehicles. Summary of the Invention

[0004] In view of this, the embodiments of this specification provide a method for displaying a screen. One or more embodiments of this specification also relate to a production training method for vehicles, a screen display device, a production training device for vehicles, a computing device, a computer-readable storage medium, and a computer program, which can improve the actual operation efficiency of entity objects and can improve the production and assembly efficiency in the production and assembly scenario of vehicles.

[0005] According to one aspect of the embodiments of this specification, a method for displaying a screen is provided, which is applied to a virtual reality display device, and the method includes:

[0006] Display a virtual scene screen corresponding to the target entity scene;

[0007] Adjust the position of the virtual object in the virtual scene screen based on the position information of the entity object in the target entity scene;

[0008] Based on the preset operation flow information of the entity object and the current state of the entity object, display the operation information of the operation to be executed for the virtual object in the virtual scene screen.

[0009] According to another aspect of the embodiments of this specification, a production training method for vehicles is provided, which is applied to a virtual reality display device, and the method includes:

[0010] Display a virtual scene screen corresponding to the training scene of the vehicle production process;

[0011] Adjust the positions of the virtual tool and the virtual vehicle component in the virtual scene screen based on the position information of the entity tool and the entity vehicle component in the training scene;

[0012] Based on the preset operation flow information of the entity tool and the current state of the entity tool, operation information of an operation to be executed is displayed for the virtual tool in the virtual scene screen.

[0013] According to another aspect of the embodiments of the present specification, a screen display device is provided, and the screen display device includes:

[0014] A first display module, configured to display a virtual scene screen corresponding to a target entity scene;

[0015] An adjustment module, configured to adjust the position of a virtual object in the virtual scene screen based on the position information of an entity object in the target entity scene;

[0016] A second display module, configured to display operation information of an operation to be executed for the virtual object in the virtual scene screen based on the preset operation flow information of the entity object and the current state of the entity object.

[0017] According to another aspect of the embodiments of the present specification, a production training device for a vehicle is provided, and the production training device for the vehicle includes:

[0018] A first display module, configured to display a virtual scene screen corresponding to a training scene of a vehicle production process;

[0019] An adjustment module, configured to adjust the positions of a virtual tool and a virtual vehicle component in the virtual scene screen based on the position information of an entity tool and an entity vehicle component in the training scene;

[0020] A second display module, configured to display operation information of an operation to be executed for the virtual tool in the virtual scene screen based on the preset operation flow information of the entity tool and the current state of the entity tool.

[0021] According to yet another aspect of the embodiments of the present specification, a computing device is provided, including: a memory and a processor;

[0022] The memory is used to store computer-executable instructions, and the processor is used to execute the computer-executable instructions. When the computer-executable instructions are executed by the processor, the steps of the above method are implemented.

[0023] According to yet another aspect of the embodiments of the present specification, a screen display system is provided, and the screen display system includes a virtual reality display device, an entity object, and an information acquisition unit corresponding to the entity object;

[0024] Among them, the virtual reality display device includes the above-mentioned screen display device, the production training device of the vehicle or the computing device; the information acquisition unit is used to detect the position information and motion information of the entity object, and the information acquisition unit is communicatively connected to the virtual reality display device.

[0025] According to another aspect of the embodiments of the present specification, there is provided a computer-readable storage medium storing computer-executable instructions, which when executed by a processor implement the steps of the above method.

[0026] According to yet another aspect of the embodiments of the present specification, there is provided a computer program, wherein when the computer program is executed on a computer, the computer is made to execute the steps of the above method.

[0027] In one embodiment of the present specification, a virtual object can be displayed in the virtual scene screen corresponding to the target entity scene by using a virtual reality display device, and the position of the virtual object is adjusted based on the position information of the entity object so that the position of the virtual object corresponds to that of the entity object. Furthermore, based on the preset operation flow information of the entity object and the current state of the entity object, operation information of the operation to be executed is displayed for the virtual object, and the user can execute the operation to be executed on the entity object according to the operation information. In this way, the user can directly use the guidance of the virtual reality display device to train the operation of the entity object, without the need for a training master to manually train the operation of the entity object, which can improve the user's mastery efficiency of the operation process of the entity object, shorten the training duration, and thus improve the actual operation efficiency of the entity object. Description of the Drawings

[0028] Figure 1 is a schematic structural diagram of a screen display system provided by an embodiment of the present specification;

[0029] Figure 2 is a flowchart of a screen display method provided by an embodiment of the present specification;

[0030] Figure 3 is a flowchart of a production training method for a vehicle provided by an embodiment of the present specification;

[0031] Figure 4 is a flowchart of a screen display method provided by an embodiment of the present specification;

[0032] Figure 5 is a schematic diagram of a function selection page provided by an embodiment of the present specification;

[0033] Figure 6 is a schematic diagram of a parameter setting page provided by an embodiment of the present specification;

[0034] Figure 7 It is a schematic diagram of a position adjustment interface provided by an embodiment of this specification;

[0035] Figure 8 It is a schematic structural diagram of a screen display device provided by an embodiment of this specification;

[0036] Figure 9 It is a schematic structural diagram of a production training device for a vehicle provided by an embodiment of this specification;

[0037] Figure 10 It is a block diagram of the structure of a computing device provided by an embodiment of this specification. Detailed implementation manners

[0038] In the following description, many specific details are set forth in order to provide a thorough understanding of this specification. However, this specification can be implemented in many other ways different from those described herein, and those skilled in the art can make similar extensions without departing from the connotation of this specification. Therefore, this specification is not limited by the specific implementations disclosed below.

[0039] The terms used in one or more embodiments of this specification are only for the purpose of describing specific embodiments, and are not intended to limit one or more embodiments of this specification. The singular forms "a", "the", and "said" used in one or more embodiments of this specification and the appended claims are also intended to include the plural forms, unless the context clearly indicates otherwise. It should also be understood that the term "and / or" used in one or more embodiments of this specification refers to and includes any or all possible combinations of one or more of the associated listed items. The term "at least one" in one or more embodiments of this specification refers to "one or more", and "a plurality" refers to "two or more". The term "comprising" is an open-ended description and should be understood as "including but not limited to", and other content may also be included on the basis of the described content.

[0040] It should be understood that although the terms "first", "second", etc. may be used in one or more embodiments of this specification to describe various information, this information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of one or more embodiments of this specification, "first" can also be referred to as "second", and similarly, "second" can also be referred to as "first". Depending on the context, the word "if" as used herein can be interpreted as "when" or "while" or "in response to determining".

[0041] With the development of science and technology, the requirements for the completion efficiency of various things in people's work and life are getting higher and higher. For example, in the vehicle production and assembly scenario, many parts of the vehicle body need to be sealed, but the mastery rate of employees' sealing skills is relatively low. During the training of sealing skills, a real vehicle scenario and a training site need to be set up, and this training takes a long time (such as usually 6 months). Moreover, during the training process, there will also be waste of glue colloid (such as it may consume 16 kilograms of materials and generate 16 kilograms of hazardous waste), resulting in low economy and environmental friendliness of the training. Therefore, the current training efficiency of employees' skills in the vehicle production and assembly scenario is low, which will in turn affect the vehicle production and assembly efficiency.

[0042] In this specification, a method for displaying a screen is provided, which can improve the mastery efficiency of the operation process of an entity object by a user, shorten the training duration, and improve the actual operation efficiency of the entity object. This specification also relates to a production training method for a vehicle, a screen display device, a production training device for a vehicle, a computing device, and a computer-readable storage medium, which will be described in detail one by one in the following embodiments. This method for displaying a screen can be applied to a virtual reality display device, and the screen display device, the production training device for a vehicle, and the computing device can all be a virtual reality display device.

[0043] Figure 1 It is a schematic structural diagram of a screen display system provided by an embodiment of this specification. As Figure 1 shown, the screen display system 10 may include: a virtual reality (VR) display device 101, an entity object 102, and an information collection unit corresponding to the entity object 102 (not shown in the figure). The VR display device 101 may be a head-mounted device. The VR display device 101 may include a high-performance graphics processor to perform high-speed processing on the image to be displayed and ensure the requirements of the image display frame rate. The entity object 102 and its corresponding information collection unit may be objects in a target entity scenario, and for different target entity scenarios, the entity object 102 and its corresponding information collection unit may be different.

[0044] The information collection unit corresponding to the entity object 102 can detect the position information and motion information of the entity object 102. In one implementation, the information collection unit can include sensors installed on the entity object 102, such as a locator, a pressure sensor, a displacement sensor, and an angle sensor, etc. In another implementation, the information collection unit can also be located outside the entity object; for example, the information collection unit can include a ranging unit and an image collection unit, etc., or can also include a positioning unit provided at each work station. The information collection unit can be communicatively connected to the VR display device 101 to send the detected information to the VR display device 101. The VR display device 101 can display a corresponding picture based on the received information.

[0045] Exemplarily, the VR display device 101 can display a corresponding virtual scene picture for the target entity scene. For example, for the entity object 102 in the target entity scene, a corresponding virtual object can be displayed in the virtual scene picture, and operation guidance can also be provided for the user in the virtual scene picture. The user can wear the VR display device 101 to view the virtual object and perform actual operations on the entity object 102 based on the guidance information. The VR display device 101 also adjusts the picture accordingly based on the information detection of the entity object, which can ensure that the user can view the effects brought by their actual operations. In this way, without the participation of a training master, the user can obtain operation guidance and can bring a real operation experience to the user, which can improve the user's efficiency in mastering the operation method of the entity object.

[0046] Figure 1 Taking the training scene of the vehicle production process as the target entity scene as an example. The entity object 102 in this scene can include a vehicle part 1021 and a physical tool 1022. For example, the vehicle part 1021 is a vehicle rear cover, and the physical tool 1022 is a glue gun. The user can wear the VR display device 101 on the head and hold the glue gun 1022 to operate on the vehicle part 1021 to practice the glue application operation. Figure 1 The action of the user holding the glue gun 1022 is not shown in the figure. Such as Figure 1 As shown, a support frame Z can also be provided in the target entity scene to support the vehicle part 1021.

[0047] Optionally, the glue gun 1022 in this scene can be modified to some extent compared with the glue gun in traditional training. For example, a control sensor can be installed on the glue gun 1022 to detect the pressing operation of the user on the glue outlet button of the glue gun. Another example is that a locator can be installed on the glue gun 1022 to detect the position and angle of the glue gun. Another example is that the glue gun 1022 can not eject glue, such as it can not be connected to the glue water pipeline.

[0048] Optionally, positioners may be respectively installed at multiple positions of the vehicle component 1021 to detect the position of the vehicle component 1021. The vehicle component 1021 may also be other components such as a vehicle front cover, a vehicle frame, or a vehicle door. The entity tool 1022 may also be a wrench, a screwdriver, a painting tool, a welding tool, etc. Correspondingly, the target entity scenario may be a vehicle repair scenario, a painting scenario, etc., which are not limited in the embodiments of this specification.

[0049] Figure 2 is a flowchart of a method for displaying a screen provided by an embodiment of this specification. This method may be applied to Figure 1 the VR display device 101 in the screen display system shown in. As Figure 2 shown, the method for displaying a screen includes the following steps:

[0050] Step 202, display a virtual scene screen corresponding to the target entity scenario.

[0051] In the embodiments of this specification, a target application program may be installed in the VR display device. The target application program may assist the user in operating entity objects in the entity scenario. Other application programs may also be installed in the VR display device in addition to the target shadow program. The VR display device may run the target application program to display a virtual scene screen corresponding to the target entity scenario. Optionally, the VR display device may display virtual scene screens corresponding to multiple entity scenarios, and the target entity scenario may be any one of the multiple entity scenarios. For example, the target entity scenario may be an assembly production scenario or a repair scenario of a vehicle, may also be an assembly production scenario or a repair scenario of an electronic device, may also be a production scenario of a handicraft, or other entity scenarios.

[0052] A virtual object may be displayed in the virtual scene screen, and the virtual object may correspond to an entity object in the target entity scenario. For example, in the assembly scenario of a vehicle, the entity objects include vehicle components and assembly tools, and virtual vehicle components and virtual assembly tools may also be correspondingly displayed in the virtual scene screen.

[0053] Optionally, an object not corresponding to the target entity scenario may also be displayed in the virtual scene screen. For example, the virtual object may be displayed in a custom virtual environment (including the background screen of the virtual object) in the virtual scene screen, and the virtual environment may be different from the actual environment of the target entity scenario. For example, the target entity scenario is located in an independent room, while the virtual environment in the virtual scene screen may be a workshop environment, a square environment, a wilderness environment, etc.

[0054] Step 204, adjust the position of the virtual object in the virtual scene screen based on the position information of the entity object in the target entity scenario.

[0055] In the embodiments of this specification, a user can use a VR display device in a target entity scenario and then operate on an entity object. The VR display device can obtain the position information of the entity object in the target entity scenario, for example, by using an information collection unit corresponding to the entity object to obtain such position information. For the information collection unit, please refer to the relevant introduction about Figure 1 above, and the embodiments of this specification will not elaborate on it.

[0056] The VR display device can adjust the position of the virtual object corresponding to the entity object in the virtual scene screen based on the obtained position information of the entity object, so as to align the position of the entity object with the position of the virtual object. Exemplarily, the VR display device can automatically adjust the position of the virtual object based on this position information; or it can also display relevant information to the user based on this position information, and then adjust the position of the virtual object based on the user's operation.

[0057] Step 206: Based on the preset operation flow information of the entity object and the current state of the entity object, display the operation information of the operation to be executed for the virtual object in the virtual scene screen.

[0058] In the embodiments of this specification, for each entity scenario, the preset operation flow information of the entity object therein can be stored, and the preset operation flow information can indicate the operation process that should be executed for the entity object. After determining the target entity scenario, the VR display device can determine the preset operation flow information of the entity object corresponding to the target entity scenario.

[0059] The VR display device can determine the current state of the entity object based on the information detected by the information collection unit corresponding to the entity object. Then, based on this current state and the preset operation flow information, it can be determined which step of the operation process that should be executed the entity object is currently in, and further determine the next operation to be executed for the entity object (that is, the operation to be executed). After that, the operation information of this operation to be executed can be displayed for the virtual scene corresponding to this entity scenario in the virtual scene screen.

[0060] This operation information can be displayed in text, or it can also be displayed in the form of pictures or videos. Exemplarily, this operation information can be displayed in the form of a 3D animation so that the user can more intuitively obtain this operation information. Optionally, the VR display device can also emit voice information to assist in guiding the user's operation.

[0061] Optionally, the VR display device can determine the operations performed by the user on the physical object and present the corresponding operation effects for the virtual object in the virtual scene screen. The VR display device can determine the operations performed by the user on the physical object based on the information collected by the information collection unit corresponding to the physical object; and then present the operation effects brought by the operations in the virtual scene screen. By way of example, the VR display device can present the corresponding gluing effects in the virtual scene screen based on the user's gluing operation on the vehicle parts, such as the free fall effect and stacking effect of the glue.

[0062] In summary, in the screen display method provided in the embodiments of this specification, a virtual reality display device can be used to display a virtual object in the virtual scene screen corresponding to the target physical scene, and adjust the position of the virtual object based on the position information of the physical object so that the position of the virtual object corresponds to that of the physical object. Furthermore, based on the preset operation flow information of the physical object and the current state of the physical object, the operation information of the operation to be performed can be displayed for the virtual object, and the user can perform the operation to be performed on the physical object according to the operation information. In this way, the user can directly use the guidance of the virtual reality display device to train the operations on the physical object, without the need for a training master to manually train the operations on the physical object, which can improve the user's mastery efficiency of the operation process of the physical object, shorten the training duration, and thus improve the actual operation efficiency of the physical object.

[0063] In this specification, the above screen display method can be applied to the training scenario of vehicle production processes, that is, the target physical scene is the training scenario of vehicle production processes. Correspondingly, in this scenario, the above screen display method can be a production training method for vehicles. Figure 3 is a flowchart of a production training method for vehicles provided in an embodiment of this specification. This method can be applied to Figure 1 the VR display device 101 in the screen display system shown in. As Figure 3 shown, this method includes:

[0064] Step 302, display the virtual scene screen corresponding to the training scenario of vehicle production processes.

[0065] The training scenario of vehicle production processes can include physical tools and physical vehicle parts, such as the physical tool 1022 and physical vehicle part 1021 included in Figure 1 . By way of example, the physical tool includes a glue gun, and the physical vehicle part includes the front cover and / or rear cover of the vehicle. Step 302 can refer to the above step 202 and the relevant introduction about Figure 1 , and the embodiments of this specification will not repeat the content introduced above here.

[0066] Step 304. Based on the position information of the physical tool and the physical vehicle component in the training scenario, adjust the positions of the virtual tool and the virtual vehicle component in the virtual scene screen.

[0067] Both the physical tool and the physical vehicle component may have corresponding information acquisition units. For example, a locator may be set on the physical tool to detect the position of the physical tool, and a locator may also be set on the physical vehicle component to detect the position of the physical vehicle component. Step 304 may refer to the above-mentioned Step 204 and the relevant introduction about Figure 1 which will not be elaborated here in this embodiment of the present specification for the content already introduced above.

[0068] Step 306. Based on the preset operation flow information of the physical tool and the current state of the physical tool, display the operation information of the operation to be performed for the virtual tool in the virtual scene screen.

[0069] Step 306 may refer to the above-mentioned Step 206 and the relevant introduction about Figure 1 which will not be elaborated here in this embodiment of the present specification for the content already introduced above. Exemplarily, the physical tool is a glue gun, and the preset operation flow information of the glue gun may reflect the glue application process. The operation to be performed may be a glue application action. The virtual reality display device may, based on the preset glue application process and the current state of the glue gun, display the information of the next glue application action for the virtual glue gun in the virtual scene screen. For example, the next glue application action is to move the glue gun uniformly to the right along the gap of the vehicle component, or it may also be to stay at the current position for 2 seconds, or it may also be to stop glue application at the current position.

[0070] In summary, in the vehicle production training method provided in this embodiment of the present specification, a virtual reality display device can be used to display a virtual tool and a virtual vehicle component in a virtual scene screen corresponding to a training scenario of a vehicle production process, and make the position of the virtual tool correspond to that of the physical tool, and make the position of the virtual vehicle component correspond to that of the physical vehicle component. Furthermore, based on the preset operation flow information of the physical tool and the current state of the physical tool, the operation information of the operation to be performed can be displayed for the virtual tool, and the user can operate the physical tool according to this operation information. In this way, the user can directly use the guidance of the virtual reality display device to train the operation of the physical tool, and there is no need for a training master to manually train the operation of the physical tool, which can improve the user's mastery efficiency of the operation process of the physical tool, shorten the training duration, and thus improve the actual operation efficiency of the physical tool.

[0071] Figure 4 is a flowchart of a method for displaying a screen provided in an embodiment of the present specification, and this method can be applied to Figure 4The VR display device 101 in the displayed screen display system will be taken as an example of a vehicle production scenario to introduce the screen display method in detail below. As Figure 4 shown, the screen display method includes the following steps:

[0072] Step 402: Display a function selection page, which includes a training function option, an assessment function option, and a learning function option.

[0073] After the VR display device starts and runs the target application program, it can display the function selection page, which can be the main page of the target application program. Figure 5 It is a schematic diagram of a function selection page provided by an embodiment of this specification. As Figure 5 shown, the function selection page can include multiple function options, such as a training function option, an assessment function option, and a learning function option. These three function options respectively correspond to Figure 5 the training mode, assessment mode, and learning mode shown in

[0074] Optionally, please continue to refer to Figure 5 , the function selection page is displayed in the form of a three-dimensional scene, and the function options are displayed in a form floating in the three-dimensional scene. Optionally, in addition to these three function options, the function selection page can also include other function options, which are not limited in the embodiments of this specification.

[0075] The user can select the functions in the function selection page. For example, the VR display device can be equipped with an information input component (such as a control handle). The user can use this information input component to select the function options in the function selection page. For example, control icons can be displayed in the function selection page. When the user moves the information input component, the icon can be moved accordingly. When the icon is moved to the position of a certain function option, the function option can be selected. When the user selects a certain function option, it triggers the VR display device to turn on the corresponding function, and then displays the page corresponding to the function.

[0076] In the embodiments of this specification, when the user selects the training function option, the VR display device can execute the following steps 404 to step 418. When the user selects the assessment function option, the VR display device can execute the following steps 420 to step 422. When the user selects the learning function option, the VR display device can execute the following step 424.

[0077] Step 404: In response to the selection operation of the training function option, obtain the target parameters of the entity object in the target entity scene.

[0078] In the case where the user selects the training function option, the VR display device needs to execute the training process. The VR display device can first determine the target entity scenario for the training, that is, determine which specific skill the training is for. The VR display device can display a parameter setting page, through which the user can input target parameters for the VR display device to determine the target entity scenario for the training and the entity objects therein.

[0079] Exemplarily, information about multiple alternative scenarios can be displayed on the parameter setting page, and the user can select the corresponding scenario based on the skill they need to train. Each alternative scenario can also include multiple entity object types, and the user can select the required object type after selecting the scenario. In this way, the VR display device can determine the target parameters that can reflect the target entity scenario and the entity objects therein based on the user's selection. Optionally, a parameter input box can be displayed on the parameter setting page, and the user can also directly input the target parameters of the target entity scenario and the entity objects in the parameter input box.

[0080] In the glue application training scenario of vehicle parts, the target parameters input by the user on the parameter setting page can include: the vehicle type, vehicle part type, and glue gun type for the training. The vehicle part type is used to determine the glue application position, and the glue gun type is used to determine the glue application tool. Optionally, the target parameters in the glue application training can also include the glue model.

[0081] The input of the vehicle type can correspond to the selection of the vehicle model, the input of the vehicle part type can correspond to the selection of the vehicle part, and the input of the glue gun type can correspond to the selection of the glue gun model. For example, the user can first select the vehicle model, and then select the vehicle part based on the selected vehicle model. Figure 6 is a schematic diagram of a parameter setting page provided by an embodiment of this specification, and Figure 6 shows the selection situation of the vehicle part. As Figure 6 shown, a display area for part selection can be displayed on the parameter setting page. Multiple vehicle schematic diagrams corresponding to the parts can be displayed in this display area, such as the vehicle schematic diagram corresponding to the front hood and the vehicle schematic diagram corresponding to the front door. The user can select each vehicle schematic diagram displayed in this display area to achieve the selection of the vehicle part.

[0082] In the embodiments of this specification, separate training can be carried out for the processing of different parts in the vehicle. For example, different parts can correspond to different target entity scenarios.

[0083] Step 406: Display the virtual scene picture corresponding to the target parameters; wherein, the virtual scene picture includes virtual objects corresponding to the entity objects.

[0084] After determining the target parameters, the VR display device can determine the target entity scenario and entity object to be trained based on the target parameters, and then can display the virtual scene picture corresponding to the target entity scenario, and the virtual object corresponding to the entity object can be displayed in the virtual scene picture. By way of example, in the virtual scene picture corresponding to the target entity scenario of applying glue to the vehicle hood, a vehicle hood model and a glue gun model can be displayed. The vehicle hood model is a virtual vehicle component, and the glue gun model is also a virtual tool. Step 406 can refer to the relevant introduction in Step 202, and the content introduced above will not be repeated here.

[0085] Step 408: Obtain the preset operation flow information of the entity object corresponding to the target parameter.

[0086] In the embodiments of this specification, for each target entity scenario, the preset operation flow information of the entity object in the scenario can be stored. The preset operation flow information is the information of the standard operation process for operating the entity object. By way of example, the preset operation flow information can indicate how the user should operate the tool for each position on the vehicle component. If the tool is a glue gun, the preset operation flow information can indicate, for each position on the vehicle component, the gesture of the user holding the glue gun, the angle of the glue gun, the duration of the glue gun staying, and the force with which the user presses the glue outlet button on the glue gun, etc.

[0087] The preset operation flow information can be obtained by analyzing the reference operation process, and the reference operation process can be obtained based on the alternative operation processes of experienced personnel for the entity object in the target entity scenario. By way of example, the reference parameters corresponding to each step in the reference operation process can be obtained by analyzing the parameters of this step in multiple alternative operation processes (such as taking the average). Optionally, the preset operation flow information can also be directly input by experienced personnel.

[0088] Step 408 can refer to the relevant introduction in Step 206, and the content introduced above will not be repeated here.

[0089] Step 410: Obtain the position information of the entity object through the information collection unit corresponding to the entity object.

[0090] Regarding this information collection unit, reference can be made to Figure 1 and Figure 2For the relevant introduction in , the content introduced above will not be repeated here. Each entity object in the target entity scenario can correspond to an information collection unit. For example, in the glue application training scenario for vehicle parts, a locator can be installed on the glue gun, and locators can also be installed at multiple positions on the vehicle parts respectively. The locator on the glue gun can detect the position information of the glue gun and send the position information of the glue gun to the VR display device. The locator on the vehicle parts can detect the position information of the vehicle parts and send the position information of the vehicle parts to the VR display device. In this way, the VR display device can obtain the position of the entity object.

[0091] Step 412: Based on the position information of the entity object in the target entity scenario, adjust the position of the virtual object in the virtual scene screen so that the position of the entity object is aligned with the position of the virtual object.

[0092] Before the user formally uses the VR display device to operate on the entity object, the initial setup steps need to be completed. The initial setup steps include aligning the position of the entity object with the position of the virtual object.

[0093] In an alternative implementation, the VR display device can display a reference point reflecting the position of the entity object in the virtual scene screen based on the position information of the entity object in the target entity scenario. Then, the auxiliary point reflecting the position of the virtual object in the virtual scene screen can be adjusted until the auxiliary point coincides with the reference point, thus achieving the alignment of the position of the entity object with the position of the virtual object. If the entity object includes multiple objects (such as a glue gun and vehicle parts), the positions of the multiple virtual objects can be adjusted separately.

[0094] For example, the VR display device can display the auxiliary point and the reference point in the position adjustment interface. Figure 7 is a schematic diagram of a position adjustment interface provided by an embodiment of this specification. As Figure 7 shown, adjustment buttons in all directions can be displayed around the auxiliary point F in this position adjustment interface. The X direction represents the left - right direction, the Y direction represents the front - back direction, and the Z direction represents the up - down direction. The button "X-" is used to adjust the auxiliary point to the left, the button "X+" is used to adjust the auxiliary point to the right, the button "Y-" is used to adjust the auxiliary point backward, the button "Y+" is used to adjust the auxiliary point forward, the button "Z-" is used to adjust the auxiliary point downward, and the button "Z+" is used to adjust the auxiliary point upward. The user can click on each button to adjust the position of the auxiliary point F until the auxiliary point coincides with the reference point.

[0095] Optionally, the VR display device can also directly adjust the position of the virtual object so that the auxiliary point reflecting the position of the virtual object coincides with the reference point.

[0096] In another alternative implementation, the VR display device may not display the auxiliary point and directly adjust the position of the virtual object to coincide with the position of the physical object.

[0097] Optionally, in this initial setting step, the parameters on which the training process depends can also be set. By way of example, the parameters may include the trajectory to be followed for gluing, and may also include the parameters on which the use of the tool depends, the set parameters of the training process. For example, for the use of a glue gun, the maximum angle and the minimum angle of the glue gun can be set, and the pressure value can also be set for the button of the glue gun. The training duration can be set for the training process.

[0098] Please continue to refer to Figure 7 , the maximum angle set for the use of the glue gun can be +20 degrees, and the minimum angle can be -20 degrees. The maximum angle can refer to the angle at which the glue gun tilts in the first direction, and the minimum angle can refer to the angle at which the glue gun tilts in the opposite direction of the first direction. The setting of this angle can limit the range of use angles of the glue gun. The pressure value set for the button of the glue gun can be 3 units of pressure (such as 3 Newtons). The setting of this pressure value can limit the triggering of the button of the glue gun. When the detected pressure value reaches 3 units of pressure, it is confirmed that the pressing operation on this button is detected. The training duration set for the training process can be 2000 seconds. This training duration is used to limit that the training process needs to end within 2000 seconds.

[0099] Optionally, step 406 and step 408 can also be executed after step 412, and step 408 can also be executed before step 406. The embodiments of this specification do not limit the execution order of step 406, step 408, and step 410.

[0100] Step 414, determine the current state of the physical object through the information acquisition unit corresponding to the physical object.

[0101] The information acquisition unit corresponding to the physical object can acquire the position information and motion information of the physical object. The information acquisition unit can send the acquired position information and motion information of the physical object to the VR display device. The VR display device can determine the current state of the physical object based on this position information and motion information. The current state of the physical object can also represent the operation performed by the user on the physical object.

[0102] The position information and motion information of the physical object can be directly used to represent the current state of the physical object, and the VR display device can determine other information representing the current state based on this position information and motion information without the need. By way of example, for a glue gun, its current state can be the state of the glue gun applying glue to the target position on the vehicle component. This current state can also indicate the angle of the glue gun with respect to this position and the motion direction of the glue gun.

[0103] Step 416: Based on the current state of the entity object and the preset operation flow information, display the operation information of the to-be-executed operation for the virtual object in the virtual scene screen.

[0104] The VR display device can determine the next operation step corresponding to the current state in the operation process reflected by the preset operation process information based on the current state of the entity object, and this next operation step is also the to-be-executed step for the entity object. Correspondingly, the VR display device can display the operation information of the to-be-executed step for the virtual object corresponding to the entity object in the virtual scene screen. In this way, the user can directly view the operation information in the virtual scene screen, and then can perform corresponding operations on the entity object based on this operation information. Step 416 can refer to the relevant introductions in Step 206 and Step 306, and the embodiments of this specification will not repeat the content introduced above.

[0105] Step 418: Present the corresponding operation effect for the virtual object in the virtual scene screen based on the operation performed on the entity object.

[0106] In the embodiments of this specification, after entering the training mode, the VR display device can continuously obtain the information collected by the information collection unit corresponding to the entity object, and determine the operation performed by the user on the entity object based on this information, and then present the corresponding operation effect for the virtual object corresponding to the entity object in the virtual scene screen. In this way, the corresponding operation effect can be displayed for the entire operation process of the user. For example, if the user uses a physical glue gun to apply glue to the upper edge of a vehicle part, the VR display device can display the glue application effect on the upper edge of the virtual vehicle part in the virtual scene screen. This can enable the user to intuitively see the operation results brought by each step, and the user can operate on the entity object to obtain the real tactile feedback brought by the entity object, which can improve the user's learning acceptance.

[0107] In the embodiments of this specification, when the target entity scene includes an entity tool and an entity part to be processed, the entity tool may not actually process the entity part to be processed. For example, the tool is a glue gun and the part to be processed is a vehicle part. When the user views the operation effect through the VR display device, the physical glue gun may not actually dispense glue, but only display the glue application effect corresponding to each glue application step in the virtual scene screen. In this way, it is possible to avoid waste of materials (such as glue), and avoid contamination of the vehicle parts by the glue application training. When performing the next glue application training, it is not necessary to clean the vehicle parts and the actual scene and can directly perform the training again. In this way, in the same time as the related art, the method provided by the embodiments of this specification can perform more skill exercises, and can reduce the time-consuming of skill training.

[0108] The VR display device may have a one-key cleaning option. The user can trigger this option to clear the current operation effect in the virtual scene screen, so that the virtual scene screen presents the situation when it was initially untrained.

[0109] Step 420: In response to the selection operation of the assessment function option, record the target operation process performed on the entity object.

[0110] Please continue to refer to Figure 5 , the user can select the assessment mode on the function selection page of the VR display device. Correspondingly, the VR display device can detect the selection operation of the assessment function option. The VR display device can, in response to this selection operation, determine the operation performed by the user on the entity object through the information collection unit, and further determine the target operation process performed by the user on the entity object. The method for determining this operation can refer to the relevant introduction of determining the current state of the entity object in Steps 206 and 414 above, and can also refer to the relevant introduction of determining the operation performed on the entity object in Step 418.

[0111] Optionally, in response to the selection operation of the assessment function option, the VR display device also executes Steps 410 and 412, and then records the target operation process performed on the entity object. During the recording of the target operation process, the VR display device can also execute Step 418 to present the operation effects corresponding to each step in the target operation process, so that the user can also view the operation situation in real time during the assessment process.

[0112] Step 422: Compare the target operation process with the reference operation process for the entity object to obtain the assessment result for the target operation process.

[0113] Regarding the reference operation process, reference can be made to the relevant introduction in Step 408, and the embodiments of this specification will not be elaborated here. The assessment result for the target operation process may include the scoring result for this target operation process. The assessment result may also include information on incorrect actions in the target operation process.

[0114] The VR display device can record the entire operation process of the user. In this case, the VR display device can compare each step performed by the user on the entity object with the corresponding step in the reference operation process (such as comparing the gesture of the user holding the glue gun) to determine whether this step is correct. For incorrect steps, error points can be marked.

[0115] Optionally, the VR display device can also record multiple points for the physical object. For example, multiple detection points are preset on a vehicle component. When the user uses a physical tool to process the vehicle component to the detection point, the VR display device compares the user's operation with the operation corresponding to the detection point in the reference operation process to determine whether the user's operation at the detection point is correct. For incorrect steps, error points can be marked.

[0116] The VR display device can save the assessment results of the target operation process in the database for subsequent retrieval and viewing by the user.

[0117] Step 424, in response to the selection operation of the learning function option, display the learning material information of the target physical scene; wherein, the learning material information includes at least one of text, pictures, and videos.

[0118] Please continue to refer to Figure 5 , the user can select the learning mode on the function selection page of the VR display device, and correspondingly, the VR display device detects the selection operation of the learning function option. In the learning mode, the user can learn knowledge in the virtual scene. For example, the VR display device displays the learning material information for the user to watch and learn. The learning material information includes at least one of text, pictures, and videos, and the learning material information can be presented in a three-dimensional form.

[0119] By using the training method provided in the embodiments of this specification, a virtual environment training system without a real vehicle site can be constructed. Using this method for training can improve the training efficiency of users, shorten the training time, save materials, and avoid generating hazardous waste. For example, the training effect can be increased by 30% compared with the related technology, the training time can be reduced from 6 months to 1 month, and about 16 kg of material consumption and hazardous waste can be saved.

[0120] In summary, in the screen display method provided in the embodiments of this specification, a virtual object can be displayed in the virtual scene screen corresponding to the target physical scene by using a virtual reality display device, and the position of the virtual object can be adjusted based on the position information of the physical object so that the position of the virtual object corresponds to that of the physical object. Furthermore, based on the preset operation flow information of the physical object and the current state of the physical object, operation information of the operation to be executed can be displayed for the virtual object, and the user can execute the operation to be executed on the physical object according to the operation information. In this way, the user can directly use the guidance of the virtual reality display device to train the operation of the physical object, and there is no need for a training master to manually train the operation of the physical object, which can improve the user's mastery efficiency of the operation process of the physical object, shorten the training duration, and thus improve the actual operation efficiency of the physical object.

[0121] Corresponding to the above method embodiments, this specification also provides an embodiment of a screen display device, which may belong to a virtual reality display device. Figure 8 It is a schematic structural diagram of a screen display device provided by an embodiment of this specification. As Figure 8 shown, the screen display device includes:

[0122] A first display module 801, configured to display a virtual scene screen corresponding to a target entity scene;

[0123] An adjustment module 802, configured to adjust the position of a virtual object in the virtual scene screen based on the position information of an entity object in the target entity scene;

[0124] A second display module 803, configured to display operation information of an operation to be executed for a virtual object in the virtual scene screen based on the preset operation flow information of the entity object and the current state of the entity object.

[0125] Optionally, the second display module 803 is configured to:

[0126] Display a three-dimensional animation corresponding to the operation to be executed for the virtual object in the virtual scene screen.

[0127] Optionally, the adjustment module 802 is configured to:

[0128] Based on the position information of the entity object in the target entity scene, display a reference point reflecting the position of the entity object in the virtual scene screen;

[0129] Adjust an auxiliary point reflecting the position of the virtual object in the virtual scene screen until the auxiliary point coincides with the reference point.

[0130] Optionally, the first display module 801 is configured to:

[0131] Obtain parameters of the entity object in the target entity scene;

[0132] Display a virtual scene screen corresponding to the parameters; wherein, the virtual scene screen includes a virtual object corresponding to the entity object;

[0133] Before displaying the operation information of the operation to be executed for the virtual object in the virtual scene screen based on the preset operation flow information of the entity object and the current state of the entity object, the method further includes:

[0134] Obtain the preset operation flow information of the entity object corresponding to the parameters.

[0135] Optionally, the screen display device further includes:

[0136] An acquisition module, configured to obtain the position information and motion information of an entity object through an information acquisition unit corresponding to the entity object before displaying, in a virtual scene screen, operation information of an operation to be performed for a virtual object based on preset operation flow information of the entity object and the current state of the entity object; wherein the position information and motion information are used to characterize the current state of the entity object.

[0137] Optionally, the screen display device further includes:

[0138] A presentation module, configured to present a corresponding operation effect for the virtual object in the virtual scene screen based on the operation performed on the entity object after displaying, in the virtual scene screen, operation information of an operation to be performed for the virtual object.

[0139] Optionally, the screen display device further includes:

[0140] A recording module, configured to record the target operation process performed on the entity object;

[0141] A comparison module, configured to compare the target operation process with a reference operation process for the entity object to obtain an assessment result for the target operation process.

[0142] Optionally, the assessment result includes information on incorrect actions existing in the target operation process.

[0143] Optionally, the screen display device further includes:

[0144] A third display module, configured to display learning material information of a target entity scene in response to a learning instruction for the target entity scene; wherein the learning material information includes at least one of text, pictures, and videos.

[0145] And Figure 2 Corresponding to the method embodiment shown, this specification also provides an embodiment of a production training device for a vehicle, and the production training device may belong to a virtual reality display device. Figure 9 FIG. is a schematic structural diagram of a production training device for a vehicle provided by an embodiment of this specification. As Figure 9 shown, the production training device for the vehicle includes:

[0146] A first display module 901, configured to display a virtual scene screen corresponding to a training scene of a vehicle production process;

[0147] An adjustment module 902, configured to adjust the positions of virtual tools and virtual vehicle components in the virtual scene screen based on the position information of the physical tools and physical vehicle components in the training scene;

[0148] The second display module 903 is configured to display operation information of an operation to be executed for a virtual tool in a virtual scene screen based on preset operation flow information of the physical tool and the current state of the physical tool.

[0149] Optionally, the physical tool includes a glue gun, and the physical vehicle components include the front cover and / or the rear cover of the vehicle.

[0150] In summary, in the screen display device provided in the embodiments of the present specification, a virtual reality display device can be used to display a virtual object in a virtual scene screen corresponding to a target physical scene, and the position of the virtual object can be adjusted based on the position information of the physical object so that the position of the virtual object corresponds to that of the physical object. Furthermore, operation information of an operation to be executed can be displayed for the virtual object based on the preset operation flow information of the physical object and the current state of the physical object, and the user can perform the operation to be executed on the physical object according to the operation information. In this way, the user can directly use the guidance of the virtual reality display device to train the operation of the physical object, and there is no need for a training master to manually train the operation of the physical object, which can improve the user's mastery efficiency of the operation process of the physical object, shorten the training duration, and thus improve the actual operation efficiency of the physical object.

[0151] Each embodiment in this specification is described in a progressive manner. For the same or similar parts among the embodiments, reference can be made to each other. Each embodiment focuses on the differences from other embodiments. In particular, for the screen display device, since it is basically similar to the embodiment of the screen display method, the description is relatively simple, and reference can be made to the relevant part of the embodiment of the screen display method for the relevant content.

[0152] Figure 10 It is a structural block diagram of a computing device provided in an embodiment of the present specification. The components of the computing device 500 include, but are not limited to, a memory 510 and a processor 520. The processor 520 is connected to the memory 510 through a bus 530, and the database 550 is used to store data.

[0153] The computing device 500 also includes an access device 540, which enables the computing device 500 to communicate via one or more networks 560. Examples of such networks include the Public Switched Telephone Network (PSTN), Local Area Network (LAN), Wide Area Network (WAN), Personal Area Network (PAN), or a combination of communication networks such as the Internet. The access device 540 may include one or more of any type of wired or wireless network interfaces (e.g., network interface controller (NIC)), such as an IEEE 802.11 Wireless Local Area Network (WLAN) wireless interface, Worldwide Interoperability for Microwave Access (Wi-MAX) interface, Ethernet interface, Universal Serial Bus (USB) interface, cellular network interface, Bluetooth interface, Near Field Communication (NFC).

[0154] In one embodiment of the present specification, the above components of the computing device 500 and Figure 10 other components not shown therein may also be connected to each other, for example, via a bus. It should be understood that Figure 10 the block diagram of the computing device shown is for illustrative purposes only and is not a limitation on the scope of the present specification. Those skilled in the art may add or replace other components as needed.

[0155] The computing device 500 may be any type of stationary or mobile computing device, including mobile computers or mobile computing devices (e.g., tablet computers, personal digital assistants, laptop computers, notebook computers, netbooks, etc.), mobile phones (e.g., smartphones), wearable computing devices (e.g., smartwatches, smart glasses, etc.) or other types of mobile devices, or stationary computing devices such as desktop computers or personal computers (PCs). The computing device 500 may also be a mobile or stationary server.

[0156] Wherein, the processor 520 is used to execute the following computer-executable instructions, which when executed by the processor implement the above Figures 2 to 4 any of the shown methods.

[0157] Each embodiment in this specification is described in a progressive manner. For the same or similar parts among the embodiments, reference can be made to each other. Each embodiment focuses on the differences from other embodiments. In particular, for the embodiment of the computing device, since it is basically similar to the embodiment of the screen display method, the description is relatively simple. For the relevant parts, reference can be made to the partial description of the embodiment of the screen display method.

[0158] An embodiment of this specification also provides a computer-readable storage medium, which stores computer instructions. When the computer instructions are executed by a processor, the steps of the above-mentioned screen display method are implemented. The computer instructions include computer program code, and the computer program code can be in the form of source code, object code, executable file or some intermediate forms, etc. The computer-readable storage medium can include: any entity or device capable of carrying the computer program code, recording medium, USB flash drive, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electrical carrier signal, telecommunication signal, and software distribution medium, etc. It should be noted that the content included in the computer-readable storage medium can be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, the computer-readable storage medium does not include electrical carrier signals and telecommunication signals.

[0159] Each embodiment in this specification is described in a progressive manner. For the same or similar parts among the embodiments, reference can be made to each other. Each embodiment focuses on the differences from other embodiments. In particular, for the embodiment of the computer-readable storage medium, since it is basically similar to the embodiment of the screen display method, the description is relatively simple. For the relevant parts, reference can be made to the partial description of the embodiment of the screen display method.

[0160] An embodiment of this specification also provides a computer program. When the computer program is executed on a computer, the computer is made to execute the steps of the above-mentioned screen display method.

[0161] Each embodiment in this specification is described in a progressive manner. For the same or similar parts among the embodiments, reference can be made to each other. Each embodiment focuses on the differences from other embodiments. In particular, for the embodiment of the computer program, since it is basically similar to the embodiment of the screen display method, the description is relatively simple. For the relevant parts, reference can be made to the partial description of the embodiment of the screen display method.

[0162] The above description is of specific embodiments of this specification. Other embodiments are within the scope of the appended claims. In some cases, the acts or steps recited in the claims may be performed in a different order than in the embodiments and still achieve the desired result. Additionally, the processes depicted in the figures do not necessarily require the particular order or sequential order shown to achieve the desired result. In certain embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0163] It should be noted that the above description is of specific embodiments of this specification. Other embodiments are within the scope of the appended claims. In some cases, the acts or steps recited in the claims may be performed in a different order than in the embodiments and still achieve the desired result. Additionally, the processes depicted in the figures do not necessarily require the particular order or sequential order shown to achieve the desired result. In certain embodiments, multitasking and parallel processing are also possible or may be advantageous. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the acts and modules involved are not necessarily essential to the embodiments of this specification.

[0164] In the above embodiments, the descriptions of the various embodiments have their own emphases. For parts not detailed in a certain embodiment, reference may be made to the relevant descriptions of other embodiments.

[0165] The preferred embodiments of this specification disclosed above are only used to help explain this specification. The alternative embodiments do not exhaust all the details and do not limit the invention to the specific embodiments described. Obviously, based on the content of the embodiments of this specification, many modifications and variations can be made. This specification selects and specifically describes these embodiments to better explain the principles and practical applications of the embodiments of this specification, so that those skilled in the relevant technical fields can well understand and utilize this specification.

Claims

1. A method for displaying a screen, characterized in that, Applied to a virtual reality display device, the method includes: Displaying a virtual scene image corresponding to a target entity scene; Adjusting the position of a virtual object in the virtual scene image based on the position information of an entity object in the target entity scene; Displaying operation information of an operation to be executed for the virtual object in the virtual scene image based on the preset operation flow information of the entity object and the current state of the entity object.

2. The method according to claim 1, wherein The displaying operation information of the operation to be executed for the virtual object in the virtual scene image includes: Displaying a three-dimensional animation corresponding to the operation to be executed for the virtual object in the virtual scene image.

3. The method according to claim 1, wherein The adjusting the position of the virtual object in the virtual scene image based on the position information of the entity object in the target entity scene includes: Displaying a reference point reflecting the position of the entity object in the virtual scene image based on the position information of the entity object in the target entity scene; Adjusting an auxiliary point reflecting the position of the virtual object in the virtual scene image until the auxiliary point coincides with the reference point.

4. The method according to claim 1, wherein The displaying a virtual scene image corresponding to a target entity scene includes: Obtaining parameters of an entity object in a target entity scene; Displaying a virtual scene image corresponding to the parameters; wherein, the virtual scene image includes a virtual object corresponding to the entity object; Before displaying operation information of an operation to be executed for the virtual object in the virtual scene image based on the preset operation flow information of the entity object and the current state of the entity object, the method further includes: Obtaining the preset operation flow information of the entity object corresponding to the parameters.

5. The method according to claim 1, characterized in that, Before displaying operation information of an operation to be executed for the virtual object in the virtual scene image based on the preset operation flow information of the entity object and the current state of the entity object, the method further includes: Obtaining the position information and motion information of the entity object through an information acquisition unit corresponding to the entity object; wherein, the position information and the motion information are used to characterize the current state of the entity object.

6. The method according to any one of claims 1 to 5, characterized in that After displaying operation information of an operation to be executed for the virtual object in the virtual scene image, the method further includes: Presenting a corresponding operation effect for the virtual object in the virtual scene image based on the operation performed on the entity object.

7. The method according to any one of claims 1 to 5, characterized in that The method further includes: Recording a target operation process performed on the entity object; Comparing the target operation process with a reference operation process for the entity object to obtain an assessment result for the target operation process.

8. The method according to claim 7, wherein The assessment result includes information on incorrect actions in the target operation process.

9. The method according to any one of claims 1 to 5, characterized in that, The method further includes: Responding to a learning instruction for a target entity scene, and displaying learning material information of the target entity scene; wherein, the learning material information includes at least one of text, pictures, and videos.

10. A production training method for a vehicle, characterized in that, Applied to a virtual reality display device, the method includes: Displaying a virtual scene image corresponding to a training scene of a vehicle production process; Adjust the positions of the virtual tool and the virtual vehicle component in the virtual scene picture based on the position information of the physical tool and the physical vehicle component in the training scene; Based on the preset operation flow information of the physical tool and the current state of the physical tool, display the operation information of the operation to be performed for the virtual tool in the virtual scene picture.

11. The method according to claim 10, wherein The physical tool includes a glue gun, and the physical vehicle component includes the front cover and / or the rear cover of the vehicle.

12. A screen display device, characterized in that, The picture display device includes: A first display module for displaying the virtual scene picture corresponding to the target physical scene; An adjustment module for adjusting the positions of the virtual objects in the virtual scene picture based on the position information of the physical objects in the target physical scene; A second display module for displaying the operation information of the operation to be performed for the virtual object in the virtual scene picture based on the preset operation flow information of the physical object and the current state of the physical object.

13. A production training device for a vehicle, characterized in that, The vehicle production training device includes: A first display module for displaying the virtual scene picture corresponding to the training scene of the vehicle production process; An adjustment module for adjusting the positions of the virtual tool and the virtual vehicle component in the virtual scene picture based on the position information of the physical tool and the physical vehicle component in the training scene; A second display module for displaying the operation information of the operation to be performed for the virtual tool in the virtual scene picture based on the preset operation flow information of the physical tool and the current state of the physical tool.

14. A computing device, characterized in that, Includes: A memory and a processor; The memory is used to store computer-executable instructions, and the processor is used to execute the computer-executable instructions. When the computer-executable instructions are executed by the processor, the method described in any one of claims 1 to 11 is implemented.

15. A screen display system, characterized in that, The picture display system includes a virtual reality display device, a physical object, and an information acquisition unit corresponding to the physical object; Wherein, the virtual reality display device includes the picture display device described in claim 12, the vehicle production training device described in claim 13, or the computing device described in claim 14; the information acquisition unit is used to detect the position information and movement information of the physical object, and the information acquisition unit is communicatively connected to the virtual reality display device.

16. A computer-readable storage medium, characterized in that, Stores computer-executable instructions, and when the computer-executable instructions are executed by a processor, the method described in any one of claims 1 to 11 is implemented.

Images