Device information display method and apparatus based on digital twins, and electronic device

Abstract

A device information display method and apparatus based on digital twins, and an electronic device, which relate to the technical field of digital twins. The interactivity of a logistics scene can be improved, improving a user interaction experience. The device information display method based on digital twins comprises: in a display interface, displaying a logistics device scene generated on the basis of digital twin technology; on the basis of a view angle mode displayed by the logistics device scene, determining a trigger area of the display interface; when a trigger operation for the trigger area is received, updating a scene picture of the logistics device scene according to the trigger operation.

Description

Device information display method, device and electronic equipment based on digital twin Technical Field

[0001] The present application relates to the field of digital twin technology, and in particular to a device information display method, apparatus, and electronic device based on digital twins. Background Art

[0002] In the logistics sector, monitoring logistics equipment is essential to ensure efficient and timely logistics processes. Logistics equipment monitoring platforms display information based on user needs after users log in. These displays typically use tables or simple charts, which offer limited interactivity and struggle to meet user needs.

[0003] Summary of the Invention

[0004] The present application provides a device information display method, apparatus and electronic device based on digital twins, which can increase the interactive mode when viewing logistics equipment, improve the interactivity of users when monitoring logistics equipment, and improve the intuitiveness of logistics information display.

[0005] In the first aspect, the present application provides a device information display method based on digital twins, including: displaying a logistics equipment scene generated based on digital twin technology in a display interface; determining a trigger area of ​​the display interface according to a viewing angle mode displayed by the logistics equipment scene; and when a trigger operation for the trigger area is received, updating the scene screen of the logistics equipment scene according to the trigger operation.

[0006] In the device information display method based on digital twins of the present application, on the one hand, users can view the logistics equipment scene on the display interface of the mobile terminal, and the data display is more intuitive and comprehensive. Moreover, compared with the method of displaying tables and charts in related technologies, the logistics equipment scene of this solution is generated based on digital twin technology, which is close to the real logistics scene, can improve the authenticity of information display, and facilitate users to quickly understand the situation of logistics equipment. On the other hand, when displaying the logistics equipment scene, a variety of viewing modes are provided, which can improve the user's visual experience when viewing logistics equipment. In addition, users can control the update of the scene screen of the logistics equipment scene by triggering operations, which can increase the interactive mode, improve the interactivity under the logistics scene, and improve the user experience.

[0007] In a possible implementation of the present application, updating the scene screen of the logistics equipment scene according to the trigger operation includes: controlling the logistics equipment scene to move, rotate, enlarge or reduce in the display interface according to the type of the trigger operation.

[0008] In a possible implementation of the present application, the display interface includes a perspective switching control, and the method further includes: when a touch operation on the perspective switching control is received, switching the perspective mode to a third-person perspective or a first-person perspective.

[0009] In a possible implementation of the present application, determining the trigger area of ​​the display interface includes: when the perspective mode is a first-person perspective, displaying a first virtual joystick and a second virtual joystick in the display interface, and the first virtual joystick and the second virtual joystick are the trigger areas corresponding to the first-person perspective.

[0010] In a possible implementation of the present application, when a trigger operation for the trigger area is received, the scene screen of the logistics equipment scene is updated according to the trigger operation, including: when a first trigger operation for the first virtual joystick is received, the viewing angle position of the logistics equipment scene is determined according to the displacement of the first trigger operation; when a second trigger operation for the second virtual joystick is received, the viewing angle direction of the logistics equipment scene is determined according to the displacement of the second trigger operation; and the scene screen of the logistics equipment scene at the viewing angle position and the viewing angle direction is displayed.

[0011] In a possible implementation of the present application, the method further includes: acquiring device information of the logistics equipment included in the scene picture, and displaying the device information in the scene picture.

[0012] In a possible implementation of the present application, after updating the scene screen of the logistics equipment scene according to the trigger operation, it also includes: when receiving a touch operation on the logistics equipment in the scene screen, displaying a first interface and displaying the device information of the logistics equipment in the first interface.

[0013] In a possible implementation of the present application, the display interface also includes a preset perspective control, and the method further includes: when a touch operation on the preset perspective control is received, displaying a scene image of the logistics equipment scene at a preset angle, wherein the preset angle is the angle corresponding to the preset perspective control.

[0014] In the second aspect, the present application provides a device information display device based on digital twins, including: a display module for displaying a logistics equipment scene generated based on digital twin technology in a display interface; a trigger module for determining a trigger area of ​​the display interface according to a viewing angle mode displayed by the logistics equipment scene; and a display update module for updating the scene screen of the logistics equipment scene according to the trigger operation when a trigger operation for the trigger area is received.

[0015] In a possible implementation of the present application, the display update module is specifically used to control the logistics equipment scene to move, rotate, enlarge or reduce in the display interface according to the type of the trigger operation.

[0016] In a possible implementation of the present application, the display interface includes a perspective switching control, and the device also includes a perspective switching module, which is used to switch the perspective mode to a third-person perspective or a first-person perspective when a touch operation on the perspective switching control is received.

[0017] In a possible implementation of the present application, the trigger module is specifically used to display a first virtual joystick and a second virtual joystick in the display interface when the perspective mode is a first-person perspective, and the first virtual joystick and the second virtual joystick are trigger areas corresponding to the first-person perspective.

[0018] In a possible embodiment of the present application, the display update module specifically includes: a position determination module, which is used to determine the viewing position of the logistics equipment scene according to the displacement of the first trigger operation when a first trigger operation is received for the first virtual joystick; a direction determination module, which is used to determine the viewing direction of the logistics equipment scene according to the displacement of the second trigger operation when a second trigger operation is received for the second virtual joystick; and a display range determination module, which is used to display the scene picture of the logistics equipment scene at the viewing position and the viewing direction.

[0019] In a possible implementation of the present application, the apparatus further includes a device display module configured to obtain device information of the logistics equipment included in the scene image and display the device information in the scene image.

[0020] In a possible implementation of the present application, the device further includes an interface display module for displaying a first interface upon receiving a touch operation on the logistics equipment in the scene screen, and displaying device information of the logistics equipment in the first interface.

[0021] In a possible embodiment of the present application, the display interface also includes a preset perspective control, and the device also includes a perspective display module, which is used to display the scene image of the logistics equipment scene at a preset angle when a touch operation on the preset perspective control is received, wherein the preset angle is the angle corresponding to the preset perspective control.

[0022] In a third aspect, the present application provides an electronic device comprising a memory and one or more processors. The memory stores one or more computer programs, each of which includes instructions that, when executed by the processor, enable the electronic device to perform the device information display method based on digital twins as described in the first aspect.

[0023] In a fourth aspect, the present application provides a computer-readable medium storing instructions. When the instructions are executed on an electronic device, the electronic device executes the device information display method based on digital twins as in the first aspect.

[0024] In a fifth aspect, the present application provides a computer program product, which, when running on an electronic device, enables the electronic device to execute the device information display method based on digital twins as described in the first aspect.

[0025] It can be understood that the beneficial effects that can be achieved by the above-mentioned digital twin-based device information display device, electronic device, computer-readable medium, and computer program product can refer to the beneficial effects in the first aspect and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] FIG1 is a schematic diagram of a process of displaying device information based on digital twins according to an embodiment of the present application;

[0027] FIG2 is a first schematic diagram of a display interface of a device information display method based on digital twins provided in an embodiment of the present application;

[0028] FIG3 is a second schematic diagram of a display interface of a device information display method based on digital twins provided in an embodiment of the present application;

[0029] FIG4 is a third display interface diagram of the device information display method based on digital twins provided in an embodiment of the present application;

[0030] FIG5 is a fourth display interface diagram of the device information display method based on digital twins provided in an embodiment of the present application;

[0031] FIG6 is a fifth display interface diagram of the device information display method based on digital twins provided in an embodiment of the present application;

[0032] FIG7 is a block diagram of a device information display apparatus based on digital twins provided in an embodiment of the present application;

[0033] FIG8 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0034] To facilitate a clear description of the technical solutions of the embodiments of this application, terms such as "first" and "second" are used in the embodiments of this application to distinguish between identical or similar items with substantially the same functions and effects. For example, the terms "first chip" and "second chip" are used solely to distinguish between different chips and do not limit their order of precedence. Those skilled in the art will understand that terms such as "first" and "second" do not limit the quantity or execution order, and do not necessarily imply differences. It should be noted that in the embodiments of this application, terms such as "exemplary" or "for example" are used to indicate examples, illustrations, or explanations. Any embodiment or design described in this application as "exemplary" or "for example" should not be construed as being preferred or advantageous over other embodiments or designs. Rather, the use of terms such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner. In the embodiments of this application, "at least one" refers to one or more, and "more" refers to two or more.

[0035] It should be noted that the “at…” in the embodiments of the present application can be the instant when a certain situation occurs, or it can be a period of time after the occurrence of a certain situation. The embodiments of the present application do not make specific limitations on this.

[0036] The implementation of this embodiment will be described in detail below with reference to the accompanying drawings.

[0037] The device information display method based on digital twins provided in the embodiment of the present application can be applied to mobile terminals, such as mobile phones, tablet computers, laptops, wearable devices, virtual reality / augmented reality devices, etc. This embodiment does not specifically limit the specific form of expression of the mobile terminal.

[0038] Figure 1 shows a flow chart of the device information display method based on digital twins. As shown in Figure 1, the method includes:

[0039] Step 101: Display the logistics equipment scene generated based on digital twin technology in the display interface.

[0040] Step 102: Determine a trigger area of ​​the display interface according to the viewing angle mode of the logistics equipment scene display.

[0041] Step 103: When a trigger operation for a trigger area is received, the scene screen of the logistics equipment scene is updated according to the trigger operation.

[0042] By adopting the embodiment shown in FIG1 above, users can view the logistics equipment scene on the display interface of the mobile terminal, and the data display is more intuitive and comprehensive. Moreover, compared with the method of displaying tables and charts in related technologies, the logistics equipment scene of this solution is generated based on digital twin technology, which is close to the real logistics scene, can improve the authenticity of information display, and facilitate users to quickly understand the situation of logistics equipment. When displaying the logistics equipment scene, this embodiment provides a variety of viewing modes, which can improve the user's visual experience when viewing logistics equipment. In addition, users can control the display of logistics equipment scenes through trigger operations, which can increase the interactive mode and improve the user experience.

[0043] Specifically, in step 101, digital twin technology can be used to transform a real logistics scene into a virtual logistics equipment scene. Digital twin technology is a virtual reality method that maps real entities into a virtual space. The real logistics scene may include logistics equipment such as stackers, shuttles, and conveyor lines. By photographing or scanning the real logistics scene, images and point cloud data of various entities in the real logistics scene, such as the factory area, floors, walls, and various logistics equipment, can be obtained. Three-dimensional modeling is performed on this collected data to generate a 3D virtual model of each entity. This model is then mapped to the real entity using digital twin technology to generate a logistics equipment scene that closely resembles the real logistics scene.

[0044] The generated virtual logistics equipment scene can be saved on a server, and the mobile terminal can retrieve it from the server when the user needs to view it. Alternatively, the mobile terminal can save the logistics equipment scene locally and display it on the display interface of a designated application when the user logs in to the application. The user can view the logistics equipment scene and the logistics equipment included in the display interface through the display interface. As shown in Figure 2, display interface 201 is the user interface displayed by the mobile terminal, which displays the logistics equipment scene.

[0045] In step 102, the perspective mode and its corresponding trigger area can be set in advance. Exemplarily, the perspective modes for displaying the logistics equipment scene can include multiple ones, which can provide users with richer interaction methods and increase the interactivity of the logistics scene. Exemplarily, the perspective modes can specifically include first-person perspective and third-person perspective. Among them, the third-person perspective can be used as the main perspective, and the logistics equipment scene can be displayed according to the main perspective first. For example, the logistics equipment scene in Figure 2 is displayed according to the third-person perspective. Displaying the logistics equipment scene through multiple perspective modes can meet the interactive needs of different users for logistics equipment monitoring. Displaying through the third-person perspective can improve the simulation of information display and provide users with an immersive experience. When displayed through the third-person perspective, the overall situation of the logistics equipment scene can be quickly and comprehensively understood, thereby improving the efficiency of information display.

[0046] In an exemplary embodiment, the display interface may also include a perspective switching control. As shown in Figure 3, display interface 201 may include a perspective switching control 301. When the mobile terminal receives a touch operation on perspective switching control 301, it may switch the current perspective mode. After the perspective mode is switched, the logistics equipment scene displayed in display interface 201 is displayed according to the switched perspective mode. For example, when the mobile terminal receives a touch operation on the perspective switching control, the display switches from a third-person perspective to a first-person perspective.

[0047] In this embodiment, the touch operation used to trigger the perspective switching control 301 may include various touch gestures, click gestures, etc. For example, the touch operation of the perspective switching control 301 may be a click operation, a double-click operation, a long press operation, etc. This embodiment does not make any special limitations on this.

[0048] The trigger area for the first-person perspective may be different from the trigger area for the third-person perspective. Specifically, the trigger area corresponding to the third-person perspective may be the area where the logistics equipment scene is displayed in the display interface. As shown in Figure 4, area 401 in the display interface 201 can be used as the trigger area for the third-person perspective. When the perspective mode is the first-person perspective, the mobile terminal can add controls to the display interface, and use the position of the added controls in the display interface as the trigger area for the first-person perspective, thereby distinguishing the trigger areas of different perspectives, improving the accuracy of interactive control, and reducing the problem of misoperation. Among them, the added controls can be one or more virtual joysticks. As shown in Figure 5, the virtual joystick 501 in the display interface 201 can be used as the trigger area for the first-person perspective.

[0049] For example, when the viewing mode is the first-person perspective, the mobile terminal may display two virtual joysticks on the display interface, namely the first virtual joystick and the second virtual joystick. Then, the first virtual joystick and the second virtual joystick are trigger areas in the first-person perspective.

[0050] In step 103, when the mobile terminal receives a trigger operation for the trigger area, it controls the display interface to update the scene image of the logistics equipment scene in response to the trigger operation. Specifically, updating the logistics equipment scene image may include moving, rotating, zooming in, zooming out, switching, etc. The scene image refers to the area where the logistics equipment scene is displayed. The scene image may include the entire logistics equipment scene or a portion thereof. For example, the scene image may include a factory building or its walls.

[0051] Exemplarily, the trigger operation of the trigger area refers to the user's gesture operation, which may include multiple types, such as the trigger operation may be sliding, clicking, long pressing, merging or spreading two fingers, etc. A method of updating the logistics equipment scene can be determined in advance for each trigger operation, and the scene screen of the logistics equipment scene is controlled to move or rotate, zoom in or out according to the type of trigger operation. For example, when the mobile terminal receives a sliding operation of the trigger area, the scene screen in the display interface will be moved, and when it receives a two-finger spreading operation, the scene screen in the display interface will be zoomed in. In this embodiment, the mobile terminal can interact with the logistics equipment scene in multiple ways to meet the different needs of users; and it can enrich the interaction methods of the logistics equipment scene and improve the user's interactive experience.

[0052] When a logistics equipment scene includes logistics equipment in the scene screen displayed, the mobile terminal can obtain the equipment information of the logistics equipment and then display the equipment information of the logistics equipment in the scene screen. In this embodiment, the user can not only view the logistics equipment scene through the display interface, but also view the information of the logistics equipment in the logistics equipment scene, which can more efficiently display information and facilitate user viewing.

[0053] In an exemplary embodiment, when switching to a first-person perspective display, the display interface includes a first virtual joystick and a second virtual joystick. The user can operate the first virtual joystick or the second virtual joystick. Specifically, the first virtual joystick can be used to control the viewing angle position of the logistics equipment scene display, and the second virtual joystick can be used to control the viewing angle direction of the logistics equipment scene display. When the mobile terminal receives a first trigger operation for the first virtual joystick, the viewing angle position of the logistics equipment scene is determined based on the displacement of the first trigger operation; when the second trigger operation for the second virtual joystick is received, the viewing angle direction of the logistics equipment scene is determined based on the displacement of the second trigger operation; then, the mobile terminal can update the logistics equipment scene in the display interface to the scene image at the viewing angle position and viewing angle direction.

[0054] The scene image can be a portion of a logistics equipment scene. The mobile terminal can determine the range of the logistics equipment scene to be displayed based on the viewing angle position and viewing angle direction, and then display the portion of the scene within this range as the scene image. The first trigger operation or the second trigger operation performed by the user on the virtual joystick refers to a touch operation on the virtual joystick. When the user performs the trigger operation, the mobile terminal can obtain the displacement of the user's finger on the virtual joystick and then, by mapping this displacement to the virtual space, obtain the viewing angle position or viewing angle direction for the logistics equipment scene.

[0055] Among them, the viewing position refers to the orientation in the logistics equipment scene, and the viewing orientation refers to the direction currently displayed by the logistics equipment scene, which is relative to the position and direction in the actual logistics scene.

[0056] Through the virtual joystick, users can view different positions and angles of the logistics equipment scene. As the user triggers the virtual joystick, the scene image can be updated in real time, which can simulate the user's experience in the real scene, improve the simulation and efficiency of information display, and meet the user's comprehensive monitoring needs for logistics processes.

[0057] Whether in first-person or third-person perspective, users can control the scene according to the corresponding trigger operation, so that the scene changes to the desired viewing range, thereby comprehensively monitoring the logistics equipment scene. Users can experience the interaction in different perspective modes, enriching the interactive methods of logistics scenes.

[0058] When the user is adjusting the scene screen, the viewing angle changes continuously with the user's triggering operation. In order to be able to adjust to the user's required viewing angle more quickly, the mobile terminal can add a preset viewing angle control in the display interface, and each preset viewing angle control can correspond to an angle commonly used by the user. In this embodiment, the display interface may also include one or more preset viewing angle controls. For example, a viewing angle control corresponding to the left viewing angle, a viewing angle control corresponding to the front viewing angle, and so on. When the mobile terminal receives a user's touch operation on the preset viewing angle control, it can display the scene screen of the logistics equipment scene at a preset angle. Among them, the preset angle is the angle corresponding to the preset viewing angle control. The user can quickly adjust the logistics equipment scene to the preset angle through the preset viewing angle control, which can improve operational efficiency.

[0059] As shown in Figure 6, the mobile terminal can add display controls 601 and controls 602 in the display interface 201. Among them, the preset angle corresponding to control 601 can be a normal viewing angle, and the preset angle corresponding to control 602 is 45 degrees. It can be understood that the mobile terminal can also add other preset viewing angle controls to achieve more angle adjustments. The logistics equipment scene can be displayed at a normal viewing angle initially. After the user adjusts the angle of the logistics equipment scene, the user can click control 601 to restore the display angle of the logistics equipment scene to the normal viewing angle, thereby achieving the effect of resetting the logistics scene.

[0060] In an exemplary embodiment, the mobile terminal may also add one or more controls corresponding to preset positions in the display interface. When the user operates these controls, the logistics equipment scene may be controlled to display the scene image at the corresponding preset position, so as to facilitate quick adjustment to the position required by the user and improve operational efficiency.

[0061] As the scene image in the display interface is updated, the logistics equipment included in the scene image can also be updated accordingly. The mobile terminal can update the device information of the logistics equipment included in the currently displayed scene image in real time. The device information may include information such as the device name, device type, device function, and usage instructions.

[0062] In an exemplary embodiment, when the mobile terminal receives a touch operation on a logistics device in a scene screen, it can display a first interface, and display the device information of the logistics device in the first interface. Among them, the touch operation on the logistics device can be a click operation, a long press operation, a hard press operation, a tapping operation, etc. For example, the user can click on the logistics device A displayed on the screen. When the mobile terminal receives the click operation on the logistics device A, it displays the first interface and displays the device information of the logistics device A in the first interface. In this embodiment, the interactive operation makes it more convenient for users to view device information and browse detailed information, which can improve the efficiency of information display.

[0063] The mobile terminal may also display historical data, statistical data and other information of the logistics equipment in the first interface, but the present embodiment is not limited thereto.

[0064] It is understood that when displaying device information in the scene screen, partial information about the logistics equipment may be displayed. When the mobile terminal receives a user touch operation on the logistics equipment, the full information of the logistics equipment may be displayed on the first interface. Partial information may include the device name and device type of the logistics equipment, while full information may include the device function and operating instructions of the logistics equipment.

[0065] Furthermore, this embodiment also provides a device information display apparatus based on digital twins, which can be used to execute the above-mentioned device information display method based on digital twins. The device information display apparatus based on digital twins can be applied to a mobile terminal.

[0066] As shown in Figure 7, the digital twin-based equipment information display device 70 may specifically include: a display module 71, which is used to display the logistics equipment scene generated based on digital twin technology in the display interface; a trigger module 72, which is used to determine the trigger area of ​​the display interface according to the viewing angle mode of the logistics equipment scene display; and a display update module 73, which is used to update the scene screen of the logistics equipment scene according to the trigger operation when receiving a trigger operation for the trigger area.

[0067] In a possible implementation, the display update module 73 is specifically used to control the movement, rotation, enlargement or reduction of the logistics equipment scene in the display interface according to the type of triggering operation.

[0068] In a possible implementation, the display interface includes a perspective switching control, and the device 70 further includes a perspective switching module for switching the perspective mode to a third-person perspective or a first-person perspective when a touch operation on the perspective switching control is received.

[0069] In a possible implementation, the trigger module 72 is specifically used to display the first virtual joystick and the second virtual joystick in the display interface when the perspective mode is the first-person perspective, and the first virtual joystick and the second virtual joystick are trigger areas corresponding to the first-person perspective.

[0070] In one possible embodiment, the display update module 73 specifically includes: a position determination module, which is used to determine the viewing position of the logistics equipment scene according to the displacement of the first trigger operation when a first trigger operation is received for the first virtual joystick; a direction determination module, which is used to determine the viewing direction of the logistics equipment scene according to the displacement of the second trigger operation when a second trigger operation is received for the second virtual joystick; and a display range determination module, which is used to display the scene picture of the logistics equipment scene at the viewing position and viewing direction.

[0071] In a possible implementation, the device 70 further includes an equipment display module for acquiring equipment information of logistics equipment included in the scene image and displaying the equipment information in the scene image.

[0072] In a possible implementation, the device 70 further includes an interface display module for displaying a first interface upon receiving a touch operation on the logistics equipment in the scene image, and displaying device information of the logistics equipment in the first interface.

[0073] In a possible embodiment, the display interface also includes a preset perspective control, and the device 70 also includes a perspective display module for displaying a scene image of the logistics equipment scene at a preset angle when a touch operation on the preset perspective control is received, wherein the preset angle is the angle corresponding to the preset perspective control.

[0074] The specific details of each module or unit in the above-mentioned digital twin-based device information display device have been described in detail in the corresponding digital twin-based device information display method, so they will not be repeated here.

[0075] The present application also provides an electronic device. FIG8 shows a schematic diagram of the structure of an electronic device suitable for implementing the present disclosure. The electronic device 800 shown in FIG8 is only an example and should not limit the functions and scope of use of the present disclosure.

[0076] As shown in Figure 8, electronic device 800 includes a central processing unit (CPU) 801, which can perform various appropriate actions and processes according to the program stored in a read-only memory (ROM) 802 or the program loaded from a storage unit 808 into a random access memory (RAM) 803. In RAM 803, various programs and data required for system operation are also stored. CPU 801, ROM 802 and RAM 803 are connected to each other via a bus 804. Input / output (I / O) interface 805 is also connected to bus 804.

[0077] The following components are connected to the I / O interface 805: an input section 806 including a keyboard, a mouse, and the like; an output section 807 including devices such as a cathode ray tube (CRT), a liquid crystal display (LCD), and a speaker; a storage section 808 including a hard disk; and a communication section 809 including a network interface card such as a LAN card or a modem. The communication section 809 performs communication processing via a network such as the Internet. A drive 810 is also connected to the I / O interface 805 as needed. A removable medium 811, such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, is installed in the drive 810 as needed, so that computer programs read therefrom can be installed into the storage section 808 as needed.

[0078] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 809, and / or installed from the removable medium 811. When the computer program is executed by the central processing unit (CPU) 801, the above-mentioned functions defined in the embodiments of the present application are performed.

[0079] It should be noted that the computer-readable medium described in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or component, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to, an electrical connection having one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, device, or component. In the present disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries computer-readable program code. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport a program for use by or in conjunction with an instruction execution system, apparatus, or device. Program code embodied on a computer-readable medium may be transmitted using any suitable medium, including but not limited to wireless, wireline, optical fiber cable, RF, or any suitable combination thereof.

[0080] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, program segment, or a part of code, and the above-mentioned module, program segment, or a part of code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in an order different from that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flowchart, and the combination of boxes in the block diagram or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0081] The units involved in the embodiments described in this disclosure may be implemented in software or hardware, and the units described may also be provided in a processor. In some cases, the names of these units do not constitute limitations on the units themselves.

[0082] As another aspect, the present application further provides a computer-readable medium, which may be included in the electronic device described in the above embodiments, or may exist independently without being incorporated into the electronic device. The computer-readable medium carries one or more programs, each of which includes instructions that, when executed by an electronic device, cause the electronic device to implement the methods described in the above embodiments.

[0083] It should be noted that, although several modules or units of the device for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiment of the application, the features and functions of two or more modules or units described above can be concretized in one module or unit. On the contrary, the features and functions of one module or unit described above can be further divided into multiple modules or units to be concretized.

[0084] The above content is only a specific embodiment of this application, but the scope of protection of this application is not limited to this. Any changes or replacements within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. A device information display method based on digital twins, characterized in that: include: Display the logistics equipment scene generated based on digital twin technology in the display interface; Determining a trigger area of ​​the display interface according to a viewing angle mode of the logistics equipment scene display; When a trigger operation for the trigger area is received, the scene screen of the logistics equipment scene is updated according to the trigger operation.

2. The device information display method based on digital twin according to claim 1 is characterized in that: The updating of the scene picture of the logistics equipment scene according to the trigger operation includes: According to the type of the trigger operation, the logistics equipment scene is controlled to move, rotate, enlarge or reduce in the display interface.

3. The device information display method based on digital twin according to claim 1 is characterized in that: The display interface includes a view switching control, and the method further includes: When a touch operation on the perspective switching control is received, the perspective mode is switched to a third-person perspective or a first-person perspective.

4. The device information display method based on digital twin according to claim 1 is characterized in that: The determining the triggering area of ​​the display interface includes: When the perspective mode is the first-person perspective, a first virtual joystick and a second virtual joystick are displayed in the display interface, and the first virtual joystick and the second virtual joystick are trigger areas corresponding to the first-person perspective.

5. The device information display method based on digital twin according to claim 4 is characterized in that: When a trigger operation for the trigger area is received, updating the scene picture of the logistics equipment scene according to the trigger operation includes: When a first trigger operation on the first virtual joystick is received, determining a viewing angle position of the logistics equipment scene according to a displacement of the first trigger operation; When a second trigger operation on the second virtual joystick is received, determining a viewing direction of the logistics equipment scene according to a displacement of the second trigger operation; Display the scene picture of the logistics equipment scene at the viewing position and the viewing direction.

6. The device information display method based on digital twin according to claim 5 is characterized in that: Also includes: Acquire the equipment information of the logistics equipment included in the scene picture, and display the equipment information in the scene picture.

7. The device information display method based on digital twin according to claim 1 is characterized in that: After the scene picture of the logistics equipment scene is updated according to the trigger operation, it also includes: When a touch operation on the logistics equipment in the scene screen is received, a first interface is displayed, and device information of the logistics equipment is displayed in the first interface.

8. The device information display method based on digital twin according to claim 1 is characterized in that: The display interface also includes a preset viewing angle control, and the method further includes: When a touch operation on the preset viewing angle control is received, a scene image of the logistics equipment scene at a preset angle is displayed, wherein the preset angle is an angle corresponding to the preset viewing angle control.

9. A device information display device based on digital twins, characterized in that: include: A display module is used to display the logistics equipment scene generated based on the digital twin technology in the display interface; A trigger module, used to determine a trigger area of ​​the display interface according to a viewing angle mode displayed by the logistics equipment scene; The display update module is used to update the scene screen of the logistics equipment scene according to the trigger operation when a trigger operation for the trigger area is received.

10. An electronic device, characterized in that: It includes a processor and a memory, in which one or more computer programs are stored. The one or more computer programs include instructions. When the instructions are executed by the electronic device, the electronic device executes the device information display method based on digital twins as described in any one of claims 1 to 8.

Images