Image splicing method and system for VR exhibition hall guide system
By using feature matching and overlay technology in the VR exhibition hall guide system, the feature matching area and overlapping area of the image are determined, which solves the problem of poor results in traditional stitching methods, and achieves more efficient image stitching effect and better user experience.
Patent Information
- Application Number
- CN202410913694.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-09
- Publication Date
- 2025-05-06
AI Technical Summary
The traditional image stitching method is poor in the VR exhibition hall guide system, affecting the user's immersion experience.
By obtaining the scene image and exhibit image to be stitched, using feature matching and overlay technology, the feature matching area and overlapping area of the image are determined, and image stitching is carried out.
Improve the accuracy and effect of image stitching and enhance the user's immersive experience.
Smart Images
Figure CN119942036A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of communications, and in particular to an image stitching method and system for a VR exhibition hall guide system. Background Art
[0002] With the rapid development of virtual reality (VR) technology, more and more application scenarios have begun to integrate this technology to enhance user experience. Especially in cultural exhibition venues such as exhibition halls and museums, the introduction of VR technology can not only break through the limitations of physical space, but also provide audiences with an immersive interactive experience, thereby greatly enhancing the viewing effect and educational significance of exhibits.
[0003] In the VR exhibition hall guide system, image stitching technology is one of the key technologies to realize the virtual reality scene. Image stitching technology can stitch multiple overlapping images into a panoramic image, thus providing users with a continuous and complete visual experience. However, the traditional image stitching method mainly relies on the matching of feature points of the scene image, resulting in poor stitching effect and affecting the user's immersive experience. Summary of the invention
[0004] In order to solve at least one technical problem in the prior art, the present disclosure provides an image stitching method and system for a VR exhibition hall guide system to improve the image stitching effect.
[0005] According to a first aspect of the present disclosure, there is provided an image stitching method for a VR exhibition hall guide system, comprising:
[0006] Acquire a first scene image and a second scene image to be spliced, wherein the first scene image and the second scene image are pre-shot scene images of the exhibition hall with partial overlap;
[0007] Acquire a plurality of first exhibit images matching the first scene image and a plurality of second exhibit images matching the second scene image from a set of exhibit images of the exhibition hall taken in advance;
[0008] superimposing the first exhibit image onto the first scene image, and superimposing the second exhibit image onto the second scene image;
[0009] Based on the same first exhibit image and second exhibit image, determining a feature matching area of the first scene image and the second scene image, and determining an overlapping area of the first exhibit image and the second exhibit image according to the feature matching area;
[0010] Based on the overlapping area, the first scene image and the second scene image are spliced.
[0011] Optionally, the acquiring the first scene image and the second scene image to be stitched includes:
[0012] Two partially overlapping exhibition hall scene images are acquired from a pre-stored exhibition hall scene image set as a first scene image and a second scene image respectively.
[0013] Optionally, acquiring a plurality of first exhibit images matching the first scene image and a plurality of second exhibit images matching the second scene image from a set of exhibit images of the exhibition hall shot in advance includes:
[0014] Calculating the matching degree between the exhibit area in the first scene image and each exhibit image in the exhibit image set, and taking the exhibit image with the maximum matching degree and a matching degree greater than a preset matching threshold as the first exhibit image;
[0015] The matching degree between the exhibit area in the second scene image and each exhibit image in the exhibit image set is calculated, and the exhibit image with the maximum matching degree and a matching degree greater than a preset matching threshold is used as the second exhibit image.
[0016] Optionally, superimposing the first exhibit image on the first scene image, and superimposing the second exhibit image on the second scene image, includes:
[0017] Determining a corresponding position of the first exhibit image in the first scene image, and superimposing the first exhibit image on the corresponding position of the first scene image;
[0018] Determine the corresponding position of the second exhibit image in the second scene image, and superimpose the second exhibit image on the corresponding position of the second scene image.
[0019] Optionally, the determining a feature matching area of the first scene image and the second scene image based on the same first exhibit image and the second exhibit image, and determining an overlapping area of the first exhibit image and the second exhibit image according to the feature matching area includes:
[0020] According to each of the first exhibit image and each of the second exhibit image, taking each identical first exhibit image and second exhibit image as a target exhibit image;
[0021] Using the area of each target exhibit image in the first scene image and the corresponding second scene image as a feature matching area;
[0022] An overlapping area between the first exhibit image and the second exhibit image is determined according to the feature matching area.
[0023] Optionally, the step of stitching the first scene image and the second scene image based on the overlapping area includes:
[0024] cutting off the overlapping area of the first scene image;
[0025] The second scene image is combined with the first scene image after the overlapping area is cut off.
[0026] According to a second aspect of the present disclosure, there is provided an image stitching system, comprising:
[0027] A first image acquisition module is used to acquire a first scene image and a second scene image to be spliced, wherein the first scene image and the second scene image are pre-shot scene images of the exhibition hall with partial overlap;
[0028] A second image acquisition module, configured to acquire a plurality of first exhibit images matching the first scene image and a plurality of second exhibit images matching the second scene image from a set of exhibit images of the exhibition hall taken in advance;
[0029] An image superposition module, used for superimposing the first exhibit image on the first scene image, and superimposing the second exhibit image on the second scene image;
[0030] an area determination module, configured to determine a feature matching area of the first scene image and the second scene image based on the same first exhibit image and the second exhibit image, and determine an overlapping area of the first exhibit image and the second exhibit image according to the feature matching area;
[0031] An image stitching module is used to stitch the first scene image and the second scene image based on the overlapping area.
[0032] According to a third aspect of the present disclosure, there is provided an electronic device, including:
[0033] Processor; and
[0034] Memory for storing programs,
[0035] The program includes instructions, which, when executed by the processor, cause the processor to perform any of the methods described above.
[0036] According to a fourth aspect of the present disclosure, a non-transitory computer-readable storage medium storing computer instructions is provided, wherein the computer instructions are used to enable a computer to execute any one of the methods described above.
[0037] According to a fifth aspect of the present disclosure, a computer program product is provided, comprising a computer program, wherein when the computer program is executed by a processor of a computer, the computer is used to enable the computer to perform any of the methods described above.
[0038] One or more technical solutions provided in the embodiments of the present application are to obtain a first scene image and a second scene image that are partially overlapped; obtain a number of first exhibit images that match the first scene image and a number of second exhibit images that match the second scene image; superimpose the first exhibit image on the first scene image, and superimpose the second exhibit image on the second scene image; determine the feature matching area of the first scene image and the second scene image based on the same first exhibit image and second exhibit image, and determine the overlapping area of the first exhibit image and the second exhibit image based on the feature matching area; splice the first scene image and the second scene image based on the overlapping area. The same first exhibit image and second exhibit image can be used to obtain a more accurate feature matching area of the first scene image and the second scene image, accurately determine the overlapping area, and splice images based on the accurate overlapping area, which can improve the image splicing effect. BRIEF DESCRIPTION OF THE DRAWINGS
[0039] The accompanying drawings illustrate exemplary embodiments of the present disclosure and together with the description serve to explain the principles of the present disclosure. These drawings are included to provide a further understanding of the present disclosure and are incorporated in and constitute a part of this specification.
[0040] Figure 1 A flowchart of an image stitching method for a VR exhibition hall guide system according to an exemplary embodiment of the present disclosure is shown;
[0041] Figure 2 The sub-process of an image stitching method for a VR exhibition hall guide system according to an exemplary embodiment of the present disclosure is shown. Figure 1 ;
[0042] Figure 3 The sub-process of an image stitching method for a VR exhibition hall guide system according to an exemplary embodiment of the present disclosure is shown. Figure 2 ;
[0043] Figure 4 The sub-process of an image stitching method for a VR exhibition hall guide system according to an exemplary embodiment of the present disclosure is shown. Figure 3 ;
[0044] Figure 5 The sub-process of an image stitching method for a VR exhibition hall guide system according to an exemplary embodiment of the present disclosure is shown. Figure 4 ;
[0045] Figure 6 A schematic block diagram of an image stitching system for a VR exhibition hall tour guide system according to an exemplary embodiment of the present disclosure is shown;
[0046] Figure 7 A structural block diagram of an exemplary electronic device that can be used to implement the embodiments of the present disclosure is shown. DETAILED DESCRIPTION
[0047] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments described herein, which are instead provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.
[0048] It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.
[0049] The term "including" and its variations used in this document are open inclusions, that is, "including but not limited to". The term "based on" means "based at least in part on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one other embodiment"; the term "some embodiments" means "at least some embodiments". Relevant definitions of other terms will be given in the description below. It should be noted that the concepts of "first", "second", etc. mentioned in this disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.
[0050] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".
[0051] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.
[0052] The image stitching method of the embodiment of the present disclosure is used for a VR exhibition hall guide system. The VR exhibition hall guide system is used to display the scene of the exhibition hall and the exhibits displayed in the scene. The image stitching method is mainly used to stitch the scene images of the actual exhibition hall taken before building the VR exhibition hall. It should be understood that the image stitching method of the embodiment of the present disclosure can also be used in other applicable scenarios.
[0053] Aspects of the present disclosure are described below with reference to the accompanying drawings.
[0054] See also Figure 1 , an image stitching method for a VR exhibition hall guide system, comprising:
[0055] S101, obtaining a first scene image and a second scene image to be spliced, where the first scene image and the second scene image are pre-shot scene images of an exhibition hall that partially overlap.
[0056] In this step, two partially overlapping exhibition hall scene images may be acquired from a pre-stored exhibition hall scene image set and used as a first scene image and a second scene image, respectively.
[0057] Before executing this step, the user can take a large number of exhibition hall scene images at various locations in the exhibition hall, and store all the exhibition hall scene images as exhibition hall scene image sets in the corresponding storage modules, so that this step can read the exhibition hall scene image set from the storage module, and obtain the first scene image and the second scene image to be spliced from the exhibition hall scene image set.
[0058] In the exhibition hall scene image set, it can be marked in advance whether there is overlap between the corresponding scene images. For example, the images can be taken in a positional order in a way that there are overlapping areas between the two images, so that the two scene images adjacent in time sequence have partial overlap. In this way, each two scene images adjacent in time sequence can be used as the first scene image and the second scene image respectively. Of course, other methods can be used to mark whether there is overlap between scene images.
[0059] S102 , acquiring a plurality of first exhibit images matching the first scene image and a plurality of second exhibit images matching the second scene image from a set of exhibit images of the exhibition hall shot in advance.
[0060] In this step, a plurality of first exhibit images matching the first scene image and a plurality of second exhibit images matching the second scene image are obtained from the pre-stored exhibit image set. For example, if there are four products in the first scene image, four first exhibit images matching the four exhibits can be obtained; the first first exhibit image matches the first exhibit in the first scene image, the second exhibit image matches the second exhibit in the first scene image, and so on.
[0061] Before executing the method of the embodiment of the present disclosure, the user can take a large number of exhibit images of the exhibition hall, and store all the exhibit images as an exhibit image set in the storage module. It should be understood that the exhibit images taken separately are clearer than the product part in the scene image.
[0062] As an implementation of step S102, see Figure 2 , the method of acquiring a plurality of first exhibit images matching the first scene image and a plurality of second exhibit images matching the second scene image from a set of exhibit images of the exhibition hall taken in advance includes:
[0063] S201, calculating the matching degree between the exhibit area in the first scene image and each exhibit image in the exhibit image set, and taking the exhibit image with the maximum matching degree and a matching degree greater than a preset matching threshold as the first exhibit image.
[0064] In this step, the existing exhibit recognition model can be used in advance to identify the various exhibits in the first scene image, and obtain the various exhibit areas in the first scene image. The similarity between the exhibit area and each exhibit image is used as the matching degree to determine the exhibit image with the maximum matching degree and a matching degree greater than a preset matching threshold as the first exhibit image, and the first exhibit image corresponds to the corresponding exhibit area in the first scene image.
[0065] S202, calculating the matching degree between the exhibit area in the second scene image and each exhibit image in the exhibit image set, and taking the exhibit image with the maximum matching degree and a matching degree greater than a preset matching threshold as the second exhibit image.
[0066] In this step, the existing exhibit recognition model can be used in advance to identify each exhibit in the second scene image, obtain each exhibit area in the second scene image, and use the similarity between the exhibit area and each exhibit image as the matching degree to determine the exhibit image with the maximum matching degree and a matching degree greater than a preset matching threshold as the second exhibit image, which corresponds to the corresponding exhibit area in the second scene image.
[0067] S103, superimposing the first exhibit image on the first scene image, and superimposing the second exhibit image on the second scene image.
[0068] In this step, the first exhibit image is superimposed on the corresponding position of the first scene image, and the corresponding position is the position of the exhibit area corresponding to the first scene image, and the second exhibit image is superimposed on the corresponding position of the second scene image, and the corresponding position is the position of the exhibit area corresponding to the second scene image, so that the first exhibit image at the first scene image and the second exhibit image at the second scene image are clearer. When viewing, the user mainly pays attention to the exhibits in terms of details. Therefore, the scene image based on this splicing can partially clarify the exhibits, and the exhibits have higher clarity while ensuring that the capacity of the spliced scene image is small. At the same time, the matching accuracy can be higher in the subsequent matching process. For example, when the spliced image is to be spliced with another image again, the spliced image can more easily and accurately obtain a matching exhibit image.
[0069] As an implementation of step S103, see Figure 3 , superimposing the first exhibit image onto the first scene image, and superimposing the second exhibit image onto the second scene image, including:
[0070] S301, determining a corresponding position of a first exhibit image in a first scene image, and superimposing the first exhibit image on the corresponding position of the first scene image.
[0071] S302: Determine a corresponding position of the second exhibit image in the second scene image, and superimpose the second exhibit image on the corresponding position of the second scene image.
[0072] When matching the first exhibit image and the second exhibit image, the corresponding position of the first exhibit image in the first scene image and the corresponding position of the second exhibit image in the second scene image may be recorded, and steps S301 and S302 may directly read the corresponding positions.
[0073] S104, based on the same first exhibit image and second exhibit image, determining a feature matching area of the first scene image and the second scene image, and determining an overlapping area of the first exhibit image and the second exhibit image according to the feature matching area.
[0074] As an implementation of step S104, see Figure 4 , based on the same first exhibit image and second exhibit image, determining a feature matching area of the first scene image and the second scene image, and determining an overlapping area of the first exhibit image and the second exhibit image according to the feature matching area, including:
[0075] S401 : determining identical images from among the first exhibit image and the second exhibit image as target exhibit images.
[0076] S402: Using the area of each target exhibit image in the first scene image and the corresponding second scene image as a feature matching area.
[0077] S403: determining an overlapping area between the first exhibit image and the second exhibit image according to the feature matching area.
[0078] The region of the target exhibit image in the first scene image and the corresponding second scene image is used as the feature matching region, and an accurate overlapping region can be obtained according to the feature matching region.
[0079] S105: splicing the first scene image and the second scene image based on the overlapping area.
[0080] As an implementation of step S105, see Figure 5 , based on the overlapping area, stitching the first scene image and the second scene image, including:
[0081] S501: Cut off the overlapping area of the first scene image.
[0082] S502: Merge the second scene image with the first scene image after the overlapping area is cut off.
[0083] The same first exhibit image and second exhibit image can be used to obtain more accurate feature matching areas of the first scene image and the second scene image, accurately determine the overlapping area, and stitch images based on the accurate overlapping area, which can improve the image stitching effect.
[0084] See also Figure 6 , an image stitching system, comprising:
[0085] The first image acquisition module 601 is used to acquire a first scene image and a second scene image to be spliced, where the first scene image and the second scene image are pre-shot scene images of the exhibition hall that partially overlap;
[0086] The second image acquisition module 602 is used to acquire a plurality of first exhibit images matching the first scene image and a plurality of second exhibit images matching the second scene image from a set of exhibit images of the exhibition hall taken in advance;
[0087] An image superimposing module 603, used to superimpose the first exhibit image on the first scene image, and to superimpose the second exhibit image on the second scene image;
[0088] The region determination module 604 is used to determine the feature matching region of the first scene image and the second scene image based on the same first exhibit image and the second exhibit image, and determine the overlapping region of the first exhibit image and the second exhibit image according to the feature matching region;
[0089] The image stitching module 605 is used to stitch the first scene image and the second scene image based on the overlapping area.
[0090] In one embodiment, the first image acquisition module 601 is used to acquire the first scene image and the second scene image to be spliced, specifically to:
[0091] Two partially overlapping exhibition hall scene images are acquired from a pre-stored exhibition hall scene image set as a first scene image and a second scene image respectively.
[0092] In one embodiment, the second image acquisition module 602 is used to acquire a plurality of first exhibit images matching the first scene image and a plurality of second exhibit images matching the second scene image from a set of exhibit images of the exhibition hall taken in advance, including:
[0093] Calculating the matching degree between the exhibit area in the first scene image and each exhibit image in the exhibit image set, and taking the exhibit image with the maximum matching degree and a matching degree greater than a preset matching threshold as the first exhibit image;
[0094] The matching degree between the exhibit area in the second scene image and each exhibit image in the exhibit image set is calculated, and the exhibit image with the maximum matching degree and a matching degree greater than a preset matching threshold is used as the second exhibit image.
[0095] In one embodiment, the image superimposing module 603 is used to superimpose the first exhibit image on the first scene image, and to superimpose the second exhibit image on the second scene image, specifically to:
[0096] Determine a corresponding position of the first exhibit image in the first scene image, and superimpose the first exhibit image on the corresponding position of the first scene image;
[0097] The corresponding position of the second exhibit image in the second scene image is determined, and the second exhibit image is superimposed on the corresponding position of the second scene image.
[0098] In one embodiment, the region determination module 604 is used to determine the feature matching region of the first scene image and the second scene image based on the same first exhibit image and the second exhibit image, and when determining the overlapping region of the first exhibit image and the second exhibit image according to the feature matching region, specifically:
[0099] According to each first exhibit image and each second exhibit image, taking each identical first exhibit image and second exhibit image as a target exhibit image;
[0100] Taking the area of each target exhibit image in the first scene image and the corresponding second scene image as the feature matching area;
[0101] An overlapping area between the first exhibit image and the second exhibit image is determined according to the feature matching area.
[0102] In one embodiment, the image stitching module 605 is used to stitch the first scene image and the second scene image based on the overlapping area, specifically to:
[0103] cutting off the overlapping area of the first scene image;
[0104] The second scene image is merged with the first scene image after the overlapping area is cut off.
[0105] The exemplary embodiment of the present disclosure also provides an electronic device, comprising: at least one processor; and a memory connected to the at least one processor in communication. The memory stores a computer program that can be executed by the at least one processor, and the computer program is used to cause the electronic device to perform the method according to the embodiment of the present disclosure when executed by the at least one processor.
[0106] The exemplary embodiments of the present disclosure also provide a non-transitory computer-readable storage medium storing a computer program, wherein the computer program, when executed by a processor of a computer, is used to cause the computer to perform the method according to the embodiments of the present disclosure.
[0107] The exemplary embodiments of the present disclosure further provide a computer program product, including a computer program, wherein when the computer program is executed by a processor of a computer, the computer is used to enable the computer to perform the method according to the embodiments of the present disclosure.
[0108] The structural block diagram of the electronic device 800 that can be used as the server or client of the present disclosure will now be described, which is an example of a hardware device that can be applied to various aspects of the present disclosure. The electronic device is intended to represent various forms of digital electronic computer equipment, such as laptop computers, desktop computers, workbenches, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices and other similar computing devices. The components shown herein, their connections and relationships, and their functions are only examples, and are not intended to limit the implementation of the present disclosure described and / or required herein.
[0109] The electronic device 800 includes a computing unit 801, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 802 or a computer program loaded from a storage unit 808 into a random access memory (RAM) 803. In the RAM 803, various programs and data required for the operation of the device can also be stored. The computing unit 801, the ROM 802, and the RAM 803 are connected to each other via a bus 804. An input / output (I / O) interface 805 is also connected to the bus 804.
[0110] A plurality of components in the electronic device 800 are connected to the I / O interface 805, including: an input unit 806, an output unit 807, a storage unit 808, and a communication unit 809. The input unit 806 may be any type of device capable of inputting information to the electronic device 800, and the input unit 806 may receive input digital or character information, and generate key signal inputs related to user settings and / or function control of the electronic device. The output unit 807 may be any type of device capable of presenting information, and may include, but is not limited to, a display, a speaker, a video / audio output terminal, a vibrator, and / or a printer. The storage unit 808 may include, but is not limited to, a disk, an optical disk. The communication unit 809 allows the electronic device 800 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks, and may include, but is not limited to, a modem, a network card, an infrared communication device, a wireless communication transceiver, and / or a chipset, such as a Bluetooth™ device, a WiFi device, a WiMax device, a cellular communication device, and / or the like.
[0111] The computing unit 801 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the computing unit 801 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The computing unit 801 performs the various methods and processes described above. For example, in some embodiments, the method of the embodiment of the present disclosure may be implemented as a computer software program, which is tangibly included in a machine-readable medium, such as a storage unit 808. In some embodiments, part or all of the computer program may be loaded and / or installed on the electronic device 800 via the ROM 802 and / or the communication unit 809. In some embodiments, the computing unit 801 may be configured to perform the method of the embodiment of the present disclosure in any other appropriate manner (e.g., by means of firmware).
[0112] The program code for implementing the method of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that the program code, when executed by the processor or controller, enables the functions / operations specified in the flow chart and / or block diagram to be implemented. The program code may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.
[0113] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
[0114] As used in this disclosure, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, apparatus, and / or device (e.g., disk, optical disk, memory, programmable logic device) for providing machine instructions and / or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The term "machine-readable signal" refers to any signal for providing machine instructions and / or data to a programmable processor.
[0115] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).
[0116] The systems and techniques described herein may be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), and the Internet.
[0117] A computer system may include clients and servers. Clients and servers are generally remote from each other and usually interact through a communication network. The relationship of client and server is generated by computer programs running on respective computers and having a client-server relationship to each other.
Claims
1. An image stitching method for a VR exhibition hall guide system, characterized in that: include: Acquire a first scene image and a second scene image to be spliced, wherein the first scene image and the second scene image are pre-shot scene images of the exhibition hall with partial overlap; Acquire a plurality of first exhibit images matching the first scene image and a plurality of second exhibit images matching the second scene image from a set of exhibit images of the exhibition hall taken in advance; superimposing the first exhibit image onto the first scene image, and superimposing the second exhibit image onto the second scene image; Based on the same first exhibit image and second exhibit image, determining a feature matching area of the first scene image and the second scene image, and determining an overlapping area of the first exhibit image and the second exhibit image according to the feature matching area; Based on the overlapping area, the first scene image and the second scene image are spliced.
2. The method according to claim 1, characterized in that The step of acquiring the first scene image and the second scene image to be spliced comprises: Two partially overlapping exhibition hall scene images are acquired from a pre-stored exhibition hall scene image set as a first scene image and a second scene image respectively.
3. The method according to claim 1, characterized in that The acquiring, from a set of pre-photographed exhibit images of the exhibition hall, a plurality of first exhibit images matching the first scene image and a plurality of second exhibit images matching the second scene image, comprises: Calculating the matching degree between the exhibit area in the first scene image and each exhibit image in the exhibit image set, and taking the exhibit image with the maximum matching degree and a matching degree greater than a preset matching threshold as the first exhibit image; The matching degree between the exhibit area in the second scene image and each exhibit image in the exhibit image set is calculated, and the exhibit image with the maximum matching degree and a matching degree greater than a preset matching threshold is used as the second exhibit image.
4. The method according to claim 1, characterized in that The step of superimposing the first exhibit image onto the first scene image, and superimposing the second exhibit image onto the second scene image, comprises: Determining a corresponding position of the first exhibit image in the first scene image, and superimposing the first exhibit image on the corresponding position of the first scene image; Determine the corresponding position of the second exhibit image in the second scene image, and superimpose the second exhibit image on the corresponding position of the second scene image.
5. The method according to claim 1, characterized in that The determining of the feature matching area of the first scene image and the second scene image based on the same first exhibit image and the second exhibit image, and determining the overlapping area of the first exhibit image and the second exhibit image according to the feature matching area includes: According to each of the first exhibit image and each of the second exhibit image, taking each identical first exhibit image and second exhibit image as a target exhibit image; Using the area of each target exhibit image in the first scene image and the corresponding second scene image as a feature matching area; An overlapping area between the first exhibit image and the second exhibit image is determined according to the feature matching area.
6. The method according to claim 1, characterized in that The step of stitching the first scene image and the second scene image based on the overlapping area includes: cutting off the overlapping area of the first scene image; The second scene image is combined with the first scene image after the overlapping area is cut off.
7. An image stitching system, characterized in that: include: A first image acquisition module is used to acquire a first scene image and a second scene image to be spliced, wherein the first scene image and the second scene image are pre-shot scene images of the exhibition hall with partial overlap; A second image acquisition module, configured to acquire a plurality of first exhibit images matching the first scene image and a plurality of second exhibit images matching the second scene image from a set of exhibit images of the exhibition hall taken in advance; An image superposition module, used for superimposing the first exhibit image on the first scene image, and superimposing the second exhibit image on the second scene image; an area determination module, configured to determine a feature matching area of the first scene image and the second scene image based on the same first exhibit image and the second exhibit image, and determine an overlapping area of the first exhibit image and the second exhibit image according to the feature matching area; An image stitching module is used to stitch the first scene image and the second scene image based on the overlapping area.
8. An electronic device, characterized in that: include: processor; as well as Memory for storing programs, The program includes instructions, which, when executed by the processor, cause the processor to perform the method according to any one of claims 1 to 6.
9. A non-transitory computer-readable storage medium storing computer instructions, characterized in that: The computer instructions are used to make a computer execute the method according to any one of claims 1-6.
10. A computer program product, characterized in that The method comprises a computer program, wherein when the computer program is executed by a processor of a computer, the computer is used to cause the computer to perform the method according to any one of claims 1 to 6.