Financial warehouse mixed reality inspection method and device based on data infrastructure

Abstract

The invention provides a financial warehouse mixed reality inspection method and device based on data infrastructure, and the method comprises the steps: constructing a financial virtual warehouse according to the warehouse environment parameters of an entity warehouse, a plurality of cargo regions in the entity warehouse, and financial entity cargoes in the cargo regions; the financial virtual warehouse comprises virtual areas corresponding to a plurality of cargo areas, and electronic information of financial entity cargoes in the cargo areas is correspondingly stored in the virtual areas; obtaining a second position corresponding to the financial virtual warehouse according to the first position of the head-mounted display device worn by the user in the physical warehouse; if the second position is located in a preset target virtual area, transmitting target electronic information of the target cargo in the field of view of the head-mounted display device to the head-mounted display device; and transmitting the information detection result uploaded by the head-mounted display device to the data infrastructure so as to display the information detection result on the data infrastructure. The convenience of warehouse goods inspection can be enhanced, and the inspection efficiency is improved.

Description

Technical Field

[0001] The present application relates to the technical field of warehouse cargo inspection, and specifically to a mixed reality inspection method and device for financial warehouses based on data infrastructure. Background Art

[0002] Regular warehouse cargo inspection is an important part of warehouse cargo management. The existing warehouse cargo inspection method is to use handheld terminal devices to scan codes to obtain electronic information of the goods, and then compare it with the paper information attached to the goods to determine whether the information matches, so as to complete the inspection of warehouse goods. However, the efficiency of handheld terminal devices scanning codes to obtain electronic information is very low, and it also relies on handheld use, which is less convenient. Therefore, the existing inspection method has the defects of low efficiency and poor convenience. Summary of the invention

[0003] The purpose of this application is to overcome the shortcomings and deficiencies in the prior art and to provide a mixed reality inspection method and device for financial warehouses based on data infrastructure, which can enhance the convenience of warehouse cargo inspection and improve inspection efficiency.

[0004] A first aspect of an embodiment of the present application provides a financial warehouse mixed reality inspection method based on data infrastructure, including:

[0005] A financial virtual warehouse is constructed according to warehouse environment parameters of a physical warehouse, a plurality of cargo areas in the physical warehouse, and financial physical cargo in the cargo areas; the financial virtual warehouse includes a plurality of virtual areas corresponding to the cargo areas, and the virtual areas store electronic information of the financial physical cargo in the cargo areas;

[0006] According to the first position of the head mounted display device worn by the user at the physical warehouse, obtaining a second position corresponding to the financial virtual warehouse;

[0007] If the second position is located in a preset target virtual area, transmitting the target electronic information of the target goods in the field of view of the head mounted display device to the head mounted display device;

[0008] The information detection result uploaded by the head mounted display device is transmitted to the data infrastructure for display on the data infrastructure.

[0009] A second aspect of an embodiment of the present application provides a financial warehouse mixed reality inspection device based on data infrastructure, including:

[0010] A financial virtual warehouse construction module is used to construct a financial virtual warehouse according to warehouse environment parameters of the physical warehouse, a plurality of cargo areas in the physical warehouse and financial physical cargo in the cargo areas; the financial virtual warehouse includes a plurality of virtual areas corresponding to the cargo areas, and the virtual areas store electronic information of the financial physical cargo in the cargo areas;

[0011] A second position acquisition module, configured to obtain a second position corresponding to the financial virtual warehouse according to a first position of a head mounted display device worn by a user at the physical warehouse;

[0012] a target electronic information acquisition module, configured to transmit the target electronic information of the target goods in the field of view of the head mounted display device to the head mounted display device if the second position is located in a preset target virtual area;

[0013] The information detection result transmission module is used to transmit the information detection result uploaded by the head mounted display device to the data infrastructure for display on the data infrastructure.

[0014] A third aspect of an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the method described above are implemented.

[0015] A fourth aspect of an embodiment of the present application provides a computer device, including a memory, a processor, and a computer program stored in the memory and executable by the processor, wherein the processor implements the steps of the method described above when executing the computer program.

[0016] Compared with the related art, the present application obtains the second position of the user in the financial virtual warehouse based on the first position of the head-mounted display device worn by the user in the physical warehouse. When the second position is located in the preset target virtual area, the target electronic information of the target goods under the field of view of the head-mounted display device is displayed, and the information detection results uploaded by the head-mounted display device are transmitted to the data infrastructure to be displayed on the data infrastructure. Therefore, during the inspection process, the user only needs to wear the head-mounted display device on the head, and the target electronic information of the target goods under the field of view can be obtained from the target virtual area conveniently and efficiently according to the position information, freeing the user's hands, and there is no need for the user to frequently pick up and put down the handheld terminal device used to scan the code to obtain the electronic information of the goods during the inspection process, which improves the convenience and efficiency of warehouse goods inspection, and customers can also view the information detection results of financial physical goods from the data infrastructure, which improves the convenience of customers viewing the storage information and detection results of financial physical goods.

[0017] In order to more clearly understand the present application, the specific implementation of the present application will be described below with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 This is a flowchart of a mixed reality inspection method for financial warehouses based on data infrastructure according to an embodiment of the present application.

[0019] Figure 2 A warehouse schematic diagram of a mixed reality inspection method for financial warehouses based on data infrastructure according to an embodiment of the present application.

[0020] Figure 3 A schematic diagram of the display of first electronic information of a financial warehouse mixed reality inspection method based on data infrastructure according to an embodiment of the present application.

[0021] Figure 4 A schematic diagram of the display of second electronic information of a financial warehouse mixed reality inspection method based on data infrastructure according to an embodiment of the present application.

[0022] Figure 5 This is a schematic diagram of displaying target electronic information of a financial warehouse mixed reality inspection method based on data infrastructure according to an embodiment of the present application.

[0023] Figure 6 A schematic diagram of obtaining the field of view direction of a mixed reality inspection method for financial warehouses based on data infrastructure according to an embodiment of the present application.

[0024] Figure 7 A schematic diagram of navigation identification of a mixed reality inspection method for financial warehouses based on data infrastructure according to an embodiment of the present application.

[0025] Figure 8 This is a schematic diagram of the module connections of a financial warehouse mixed reality inspection device based on data infrastructure according to an embodiment of the present application.

[0026] 100. Financial warehouse mixed reality inspection device based on data infrastructure; 101. Financial virtual warehouse construction module; 102. Second position acquisition module; 103. Target electronic information acquisition module; 104. Information detection result transmission module. DETAILED DESCRIPTION

[0027] In order to make the objectives, technical solutions and advantages of the present application more clear, the embodiments of the present application will be further described in detail below with reference to the accompanying drawings.

[0028] It should be clear that the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the embodiments of the present application.

[0029] When the following description relates to the accompanying drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. In the description of the present application, it should be understood that the terms "first", "second", "third", etc. are only used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence, nor can they be understood as indicating or implying relative importance. For those of ordinary skill in the art, the specific meanings of the above terms in the present application can be understood according to the specific circumstances. The singular forms of "a", "said" and "the" used in the present application and the appended claims are also intended to include the majority form, unless the context clearly indicates other meanings. The words "if" / "if" used herein can be interpreted as "at the time of" or "when" or "in response to determination".

[0030] In addition, in the description of this application, unless otherwise specified, "plurality" means two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the associated objects are in an "or" relationship.

[0031] See also Figure 1 and Figure 2 , a financial warehouse mixed reality inspection method based on data infrastructure according to an embodiment of the present application includes:

[0032] S1: Construct a financial virtual warehouse according to the warehouse environment parameters of the physical warehouse, a number of cargo areas in the physical warehouse and the financial physical cargo in the cargo areas; the financial virtual warehouse includes a number of virtual areas corresponding to the cargo areas, and the virtual areas store electronic information of the financial physical cargo in the cargo areas.

[0033] The warehouse environment parameters of the physical warehouse are spatial parameters that can represent the shape of the warehouse, such as the length, width, height, etc. of the warehouse. The cargo area refers to the storage area where users classify financial physical goods. The cargo area can be placed with multiple cargo racks, and the financial physical goods are stored on the ground or cargo racks in the cargo area. Different signs can be used to distinguish different cargo areas, such as different ground colors, different shelf colors, different area numbers, etc.

[0034] The financial virtual warehouse can be constructed by taking a corner point of the warehouse as the origin and constructing a coordinate system according to parameters such as the length, width, and height of the warehouse, and then entering the coordinate information of the cargo area, cargo racks on the cargo area, and financial physical cargo into the financial virtual warehouse.

[0035] The physical warehouse of this embodiment is a warehouse for storing financial pledged goods, so the goods area can be divided according to the type of goods or according to different pledge attributes.

[0036] S2: According to the first position of the head mounted display device worn by the user at the physical warehouse, a second position corresponding to the financial virtual warehouse is obtained.

[0037] Among them, the physical warehouse is equipped with multiple positioning devices. According to the signals of the interaction between each positioning device and the head-mounted display device, it can be obtained that the head-mounted display device is located at the first position of the physical warehouse, thereby converting it to the second position of the corresponding financial virtual warehouse.

[0038] Head-mounted display devices refer to mixed reality electronic devices that are worn on the head and can perform data interaction and image display, such as MR (Mixed Reality) devices.

[0039] S3: If the second position is located in a preset target virtual area, the target electronic information of the target goods under the field of view of the head-mounted display device is transmitted to the head-mounted display device.

[0040] The preset target virtual area is set according to the user's operation instructions, wherein the operation instructions can be issued by a head-mounted display device or by a host device with interactive functions such as a desktop computer, tablet computer, laptop computer, smart phone, etc.

[0041] Among them, if the target virtual area is a virtual area in a financial virtual warehouse with an electronic fence, such as the target asset area corresponding to the goods that have been financially pledged, only when the user enters the target asset area, that is, the second position in the financial virtual warehouse is located within the electronic fence and in the target virtual area, the head-mounted display device can obtain the target electronic information of the target goods under the field of view, that is, the target electronic information of the goods that have been financially pledged; when the user's position is not the target asset area, that is, the second position in the financial virtual warehouse is located outside the electronic fence and is not in the target virtual area, the head-mounted display device cannot obtain the electronic information of the goods under the field of view.

[0042] The target electronic information refers to the detailed information of the target goods, including but not limited to the name, specification, quantity, category, brand, warehousing time, validity period, unit, shelf number and goods number of the goods.

[0043] Among them, the head-mounted display device can be an electronic device that requires user authentication and login before it can be used for warehouse cargo inspection. After the user successfully authenticates and logs in, the user information will be displayed, including name, mobile phone number, account information, etc., and the head-mounted display device after the user authenticates and logs in can normally display the target electronic information. If the head-mounted display device has not been authenticated and logged in, the head-mounted display device will not display the target electronic information.

[0044] S4: Transmitting the information detection result uploaded by the head mounted display device to the data infrastructure for display on the data infrastructure.

[0045] Among them, data infrastructure refers to a digital platform for managing and displaying electronic information of physical goods in physical warehouses after inspection, such as the Global Data Source Center. The Global Data Source Center is established based on the global data source system, with the transformation of item information into data assets as the core, providing data aggregation, processing, circulation, application, operation, and security guarantee. The national data infrastructure serves the digitalization of industries, digital industrialization, and regional digital governance. The Global Data Source Center adheres to the principles of "co-construction and sharing, real safety, openness and convenience", and is led by the government, co-built and shared by regulatory departments, and jointly participated by social organizations. It includes rules and standards, public technologies, center management systems, public service platforms, operation teams, and standardized operation venues.

[0046] Compared with the related art, the present application obtains the second position of the user in the financial virtual warehouse based on the first position of the head-mounted display device worn by the user in the physical warehouse. When the second position is located in the preset target virtual area, the target electronic information of the target goods under the field of view of the head-mounted display device is displayed, and the information detection results uploaded by the head-mounted display device are transmitted to the data infrastructure to be displayed on the data infrastructure. Therefore, during the inspection process, the user only needs to wear the head-mounted display device on the head, and the target electronic information of the target goods under the field of view can be obtained from the target virtual area conveniently and efficiently according to the position information, freeing the user's hands, and there is no need for the user to frequently pick up and put down the handheld terminal device used to scan the code to obtain the electronic information of the goods during the inspection process, which improves the convenience and efficiency of warehouse goods inspection, and customers can also view the information detection results of financial physical goods from the data infrastructure, which improves the convenience of customers viewing the storage information and detection results of financial physical goods.

[0047] See also Figure 3 In a feasible embodiment, S3: if the second position is located in a preset target virtual area, the step of transmitting the target electronic information of the target goods under the field of view of the head mounted display device to the head mounted display device comprises:

[0048] S31: If the second position is located in the target virtual area, obtain first electronic information of a plurality of goods in the field of view of the head mounted display device.

[0049] The first electronic information is brief information of the goods, including the name, quantity and other information briefly representing the goods, and may also include operation options for performing cargo inspection operations based on the first electronic information.

[0050] S32: Displaying a plurality of the first electronic information on the head mounted display device.

[0051] The multiple first electronic information displayed by the head-mounted display device can be displayed in a list form, and when displaying the multiple first electronic information, the serial number corresponding to each first electronic information can be displayed to facilitate the user to distinguish the first electronic information corresponding to different goods.

[0052] S33: According to the selected first electronic information, the corresponding second electronic information is obtained; the cargo information content of the second electronic information is more than that of the first electronic information.

[0053] The second electronic information includes but is not limited to the name, specification, quantity, category, brand, shelf number, product number and other information of the goods.

[0054] Wherein, S33: according to the selected first electronic information, obtaining the corresponding second electronic information includes:

[0055] S331: Obtaining the user's interactive operations corresponding to a plurality of the first electronic information in the field of view of the head mounted display device.

[0056] Among them, the user's interactive operations corresponding to several of the first electronic information refer to the operation gestures of the user selecting the first electronic information under the field of view of the head-mounted display device, wherein the operation gestures include but are not limited to: clenching a fist, moving the palm or fingers, etc.

[0057] S332: According to the preset correspondence relationship between the first electronic information and the second electronic information, obtain the second electronic information corresponding to the first electronic information selected by the interactive operation.

[0058] Among them, the correspondence between the first electronic information and the second electronic information means that the second electronic information of the same goods can be obtained based on the first electronic information. Specifically, a jump link from the first electronic information to the second electronic information can be directly established to obtain the second electronic information corresponding to the selected first electronic information.

[0059] S34: Determine the second electronic information as the target electronic information of the target goods and input it to the head mounted display device.

[0060] See also Figure 4 After determining the second electronic information as the target electronic information of the target goods, the head-mounted display device displays the target electronic information, including the name of the goods, the quantity of the goods, the category, the warehousing time, the validity period, the goods unit, etc. Among them, when the validity period is lower than the preset validity period threshold, the head-mounted display device will also display a warning reminder of the validity period.

[0061] In this embodiment, the head mounted display device can display the first electronic information of several goods, and can also display the second electronic information of the selected target goods, so that the user can select the target electronic information to be displayed from the first electronic information of several goods.

[0062] In a feasible embodiment, the step S3: if the second position is located in a preset target virtual area, transmitting the target electronic information of the target goods under the field of view of the head mounted display device to the head mounted display device includes:

[0063] S301: If the second position is located in the target virtual area, identify the cargo identification code of the target cargo in the field of view of the head mounted display device, obtain corresponding target electronic information and input it to the head mounted display device.

[0064] See also Figure 5 The cargo identification code may be a barcode or a QR code affixed to the cargo. The cargo identification code is associated with the electronic information of the cargo, so that the head-mounted display device can obtain the corresponding electronic information according to the cargo identification code under the field of view.

[0065] When the head mounted display device displays the target electronic information, it can also display an option box for judging whether the information is correct, so that the user can compare the target electronic information with the cargo information on the target cargo, and then register the information check of the target cargo through the option box. The cargo information can be the content information recorded on the sticker attached to the target cargo.

[0066] In this embodiment, the head-mounted display device can obtain the target electronic information of the target goods through the goods identification code under the field of view to perform information comparison and inspection, thereby improving the efficiency of warehouse goods inspection.

[0067] In a feasible embodiment, after the step of obtaining the second position corresponding to the financial virtual warehouse according to the head mounted display device worn by the user at the first position of the physical warehouse, S2 includes:

[0068] S21: Obtain the field of view direction of the head mounted display device.

[0069] The physical warehouse is provided with a plurality of positioning devices, and the positioning devices are used to send out positioning signals; the head mounted display device is provided with a signal reflector along the field of view direction, and the signal reflector is used to reflect the received positioning signal.

[0070] Step S21 includes:

[0071] S211: Acquire a positioning signal reflected by a signal reflector of the head mounted display device through the positioning device to obtain a reflected signal.

[0072] S212: Determine the field of view direction of the head mounted display device according to the signal angle of the reflected signal.

[0073] See also Figure 6 , the positioning device is A, and its coordinates are (X, ya, Z). The positioning device A continuously emits electromagnetic waves, and the signal reflector is C which reflects the electromagnetic wave signal into a reflection signal. According to the reflection signal received by the positioning device A, the propagation speed of the electromagnetic wave signal, and the time from the positioning device A sending the electromagnetic wave signal to the receiving of the reflection signal corresponding to the electromagnetic wave signal, the coordinates and orientation of the signal reflector C of the head-mounted display device, that is, the coordinates and field of view direction of the second position of the head-mounted display device, can be obtained.

[0074] Specifically, Figure 6 As shown, based on trigonometric functions, the coordinates and orientation of the signal reflector C can be obtained: draw a line segment CB so that CB⊥AB, the angle between line segment AC and line segment AB is β (β≤90°), and AB∥y-axis. Draw a line segment CD so that CD⊥AD, AD∥z-axis, the angle between line segment AC and line segment AD is θ (θ<90°), and CD∥z-axis. Draw a line segment CE so that CE⊥BE, CE⊥DE, BE⊥DE, CE∥x-axis, ED∥y-axis, and BE∥z-axis. The angle between line segment AC and line segment BC is α, α=90°-β. Based on the above relationship, the coordinates (x 1 ,y 1 , z 1 )for:

[0075] x 1 =XL(CE)=X-L0*sinθ*cosα;

[0076] y 1 =y a -L(ED)=y a -L0*sinθ*sinα;

[0077] z 1 =ZL(AD)=Z-L0*cosθ.

[0078] Wherein, vector CD is the direction of the signal reflector C.

[0079] S22: Generate a navigation mark according to the preset target virtual area, the second position and the field of view direction.

[0080] The navigation mark is an electronic mark used to be displayed on a head-mounted display device, and the navigation mark may include text and / or a direction mark indicating the navigation direction.

[0081] Step S22 includes:

[0082] S221: Generate a navigation route according to the target virtual area and the second location.

[0083] Among them, according to the preset movable path of the financial virtual warehouse, a navigation route from the second position to the target virtual area is generated, and according to the positions of the shelves and financial physical goods in the cargo area, a navigation route from the second position to the target virtual area is generated to avoid the shelves and financial physical goods.

[0084] S222: Acquire the second location and the navigation route, and acquire a corresponding route direction.

[0085] Among them, during the user's movement, the first position of the user and the head-mounted display device worn by the user in the physical warehouse will also change. Therefore, the second position of the user and the head-mounted display device worn by the user in the financial virtual warehouse will also change. When the second position is located at a different position on the navigation route, the corresponding route direction will also change. For example, when the second position is located at a turning point of the intersection of the navigation route, the route direction will change from the previous left or right.

[0086] S223: If the field of view direction is the same as the route direction, determine the route direction as the navigation identifier.

[0087] The route direction is determined as a navigation mark, and when the field of view direction is the same as the route direction, the user can be guided to move along the route direction, so as to reach the target virtual area along the navigation route.

[0088] S23: Displaying the navigation mark on the head mounted display device to guide the user to reach the target virtual area.

[0089] See also Figure 7 The navigation mark adopts an arrow to indicate the navigation direction. Specifically, the navigation mark can adopt a static path arrow or a dynamic path arrow.

[0090] See also Figure 8 The second embodiment of the present application provides a financial warehouse mixed reality inspection device based on data infrastructure, including:

[0091] A financial virtual warehouse construction module is used to construct a financial virtual warehouse according to warehouse environment parameters of the physical warehouse, a plurality of cargo areas in the physical warehouse and financial physical cargo in the cargo areas; the financial virtual warehouse includes a plurality of virtual areas corresponding to the cargo areas, and the virtual areas store electronic information of the financial physical cargo in the cargo areas;

[0092] A second position acquisition module, configured to obtain a second position corresponding to the financial virtual warehouse according to a first position of a head mounted display device worn by a user at the physical warehouse;

[0093] a target electronic information acquisition module, configured to transmit the target electronic information of the target goods in the field of view of the head mounted display device to the head mounted display device if the second position is located in a preset target virtual area;

[0094] The information detection result transmission module is used to transmit the information detection result uploaded by the head mounted display device to the data infrastructure for display on the data infrastructure.

[0095] It should be noted that the mixed reality inspection device for financial warehouses based on data infrastructure provided in the second embodiment of the present application only uses the division of the above-mentioned functional modules as an example when executing the mixed reality inspection method for financial warehouses based on data infrastructure. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the mixed reality inspection device for financial warehouses based on data infrastructure provided in the second embodiment of the present application and the mixed reality inspection method for financial warehouses based on data infrastructure provided in the first embodiment of the present application belong to the same concept. The implementation process thereof is detailed in the method embodiment and will not be repeated here.

[0096] A third aspect of an embodiment of the present application provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, it implements the steps of the financial warehouse mixed reality inspection method based on data infrastructure as described above.

[0097] A fourth aspect of an embodiment of the present application provides a computer device, comprising a storage device, a processor, and a computer program stored in the storage device and executable by the processor, wherein the processor implements the steps of the financial warehouse mixed reality inspection method based on data infrastructure as described above when executing the computer program.

[0098] The device embodiments described above are merely illustrative, wherein the components described as separate parts may or may not be physically separated, and the parts displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the present application. Ordinary technicians in this field can understand and implement it without creative work.

[0099] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that include computer-usable program code.

[0100] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing device to work in a specific way, so that the instructions stored in the computer-readable memory produce a product including an instruction device, which implements the function selected in the process. Figure 1 A process or multiple processes and / or boxes Figure 1 function selected in a box or multiple boxes.

[0101] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process in the computer or other programmable device. Figure 1 A process or multiple processes and / or boxes Figure 1 steps for the function selected in a box or multiple boxes.

[0102] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0103] The memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0104] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0105] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0106] The above are only embodiments of the present application and are not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.

Claims

1. A mixed reality inspection method for financial warehouses based on data infrastructure, characterized in that: include: A financial virtual warehouse is constructed according to warehouse environment parameters of a physical warehouse, a plurality of cargo areas in the physical warehouse, and financial physical cargo in the cargo areas; the financial virtual warehouse includes a plurality of virtual areas corresponding to the cargo areas, and the virtual areas store electronic information of the financial physical cargo in the cargo areas; According to the first position of the head mounted display device worn by the user at the physical warehouse, obtaining a second position corresponding to the financial virtual warehouse; If the second position is located in a preset target virtual area, transmitting the target electronic information of the target goods in the field of view of the head mounted display device to the head mounted display device; The information detection result uploaded by the head mounted display device is transmitted to the data infrastructure for display on the data infrastructure.

2. The financial warehouse mixed reality inspection method based on data infrastructure according to claim 1 is characterized in that: If the second position is located in a preset target virtual area, the step of transmitting target electronic information of the target goods under the field of view of the head mounted display device to the head mounted display device comprises: If the second position is located in the target virtual area, obtaining first electronic information of a plurality of goods in the field of view of the head mounted display device; Displaying a plurality of the first electronic information on the head mounted display device; According to the selected first electronic information, the corresponding second electronic information is obtained; the cargo information content of the second electronic information is more than that of the first electronic information; The second electronic information is determined as target electronic information of the target goods and is input to the head mounted display device.

3. The financial warehouse mixed reality inspection method based on data infrastructure according to claim 2 is characterized in that: The step of acquiring the corresponding second electronic information according to the selected first electronic information includes: Acquire a plurality of interactive operations of the user corresponding to the first electronic information in the field of view of the head mounted display device; According to the preset correspondence relationship between the first electronic information and the second electronic information, the second electronic information corresponding to the first electronic information selected by the interactive operation is obtained.

4. The financial warehouse mixed reality inspection method based on data infrastructure according to claim 1 is characterized in that: If the second position is located in a preset target virtual area, the step of transmitting the target electronic information of the target goods under the field of view of the head mounted display device to the head mounted display device comprises: If the second position is located in the target virtual area, the cargo identification code of the target cargo under the field of view of the head mounted display device is identified, and the corresponding target electronic information is obtained and inputted into the head mounted display device.

5. The mixed reality inspection method for financial warehouses based on data infrastructure according to claim 1 is characterized in that: After the step of obtaining the second position corresponding to the financial virtual warehouse according to the head mounted display device worn by the user at the first position of the physical warehouse, the method includes: Obtaining a field of view direction of the head mounted display device; Generate a navigation mark according to the preset target virtual area, the second position and the field of view direction; The navigation mark is displayed on the head mounted display device to guide the user to reach the target virtual area.

6. The financial warehouse mixed reality inspection method based on data infrastructure according to claim 5 is characterized in that: The step of generating a navigation mark according to the preset target virtual area, the second position and the field of view direction of the head mounted display device includes: generating a navigation route according to the target virtual area and the second location; Acquire the second location and the navigation route, and acquire the corresponding route direction; If the field of view direction is the same as the route direction, the route direction is determined as the navigation identifier.

7. The mixed reality inspection method for financial warehouses based on data infrastructure according to claim 5 is characterized in that: The physical warehouse is provided with a plurality of positioning devices, and the positioning devices are used to send positioning signals; the head mounted display device is provided with a signal reflector along the field of view direction, and the signal reflector is used to reflect the received positioning signal; The step of obtaining the field of view direction of the head mounted display device comprises: Acquiring a positioning signal reflected by a signal reflector of the head mounted display device through the positioning device to obtain a reflected signal; The field of view direction of the head mounted display device is determined according to the signal angle of the reflected signal.

8. A mixed reality inspection device for financial warehouses based on data infrastructure, characterized in that: include: A financial virtual warehouse construction module is used to construct a financial virtual warehouse according to warehouse environment parameters of the physical warehouse, a plurality of cargo areas in the physical warehouse and financial physical cargo in the cargo areas; the financial virtual warehouse includes a plurality of virtual areas corresponding to the cargo areas, and the virtual areas store electronic information of the financial physical cargo in the cargo areas; A second position acquisition module, configured to obtain a second position corresponding to the financial virtual warehouse according to a first position of a head mounted display device worn by a user at the physical warehouse; a target electronic information acquisition module, configured to transmit the target electronic information of the target goods in the field of view of the head mounted display device to the head mounted display device if the second position is located in a preset target virtual area; The information detection result transmission module is used to transmit the information detection result uploaded by the head mounted display device to the data infrastructure for display on the data infrastructure.

9. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the mixed reality inspection method for financial warehouses based on data infrastructure as described in any one of claims 1 to 7 are implemented.

10. A computer device, characterized in that: It includes a storage, a processor, and a computer program stored in the storage and executable by the processor. When the processor executes the computer program, it implements the steps of the financial warehouse mixed reality inspection method based on data infrastructure as described in any one of claims 1 to 7.

Images