Intraoral scanning method, system, electronic device, and medium

Abstract

The embodiments of the present disclosure relate to an intraoral scanning method, system, electronic device and medium, the method including: responding to a scanning request for an intraoral cavity including a scanning rod, obtaining a positioning mode of the scanning rod, scanning the intraoral cavity to obtain target scanning data, and processing according to the positioning mode of the scanning rod and the target scanning data to determine positioning information of the scanning rod. According to the above technical solution, the positioning information of the scanning rod can be obtained based on the scanning result, and the positioning requirement of the scanning rod in the intraoral scanning scene can be further satisfied.

Description

[Technical field]

[0001] This disclosure claims priority to a Chinese patent application bearing application number 202210477085.7 and entitled "Intraoral Scanning Processing Method, System, Electronic Device and Medium," filed with the China National Intellectual Property Office on May 2, 2022, the entire contents of which are incorporated herein by reference.

[0002] The present disclosure relates to the technical field of intraoral scanning, and in particular to intraoral scanning methods, systems, electronic devices and media. [Background technology]

[0003] Typically, for restoration of missing teeth, the implant position is determined by scanning with a scanning rod.

[0004] In the related art, due to the limited scanning range of intraoral scanning, a solution of multi-data stitching is commonly used when scanning intraoral data, which causes accumulated errors, and ultimately the scanner cannot obtain intraoral scanning data and determine the accurate position of the scanning rod, causing the accuracy of scanning and implantation to be relatively low. Summary of the Invention [Problem to be solved by the invention]

[0005] The technical problem that the present disclosure aims to solve is to solve the problem that in the past, when scanning intraoral data, the solution of multi-data stitching is commonly used, which generates accumulated errors, and finally the scanner cannot obtain intraoral scanning data and determine the accurate position of the scanning rod, causing the accuracy of scanning and implantation to be relatively low. [Means for solving the problem]

[0006] To solve the above technical problems, embodiments of the present disclosure provide an intraoral scanning method, system, electronic device, and medium.

[0007] In a first aspect, acquiring a positioning mode of the scanning rod in response to a scan request for an intraoral cavity including the scanning rod; scanning the intraoral cavity to obtain target scan data; and processing the scanning rod based on the positioning mode and the target scan data to determine positioning information for the scanning rod.

[0008] In a second aspect, a scanner adapted to respond to a scan request for an intraoral cavity including a scanning rod, to obtain a positioning mode of the scanning rod, and to scan the intraoral cavity to obtain target scan data; An intraoral scanning processing system is further provided, the system including: a processing module adapted to process based on the scanning rod positioning mode and the target scan data and determine scanning rod positioning information.

[0009] In a third aspect, A processor; a memory adapted to store processor executable instructions; The processor, There is further provided an electronic device configured to read the executable instructions from the memory and execute the instructions to implement an intraoral scanning processing method according to an embodiment of the present disclosure.

[0010] In a fourth aspect, there is further provided a computer storage medium having a program stored thereon, the program being capable of implementing some or all of the steps of each embodiment of the intraoral scanning processing method according to the first aspect of the present disclosure when executed. Effect of the Invention

[0011] The above technical solutions according to the embodiments of the present disclosure have the following advantages over the prior art:

[0012] In the intraoral scanning method, system, electronic device and medium according to the embodiment of the present disclosure, in response to a scanning request for an oral cavity including a scanning rod, obtain a positioning mode of the scanning rod, scan the oral cavity to obtain target scanning data, and process according to the positioning mode of the scanning rod and the target scanning data to determine the positioning information of the scanning rod. According to the above technical solution, the positioning information of the scanning rod is obtained based on the scanning result, so as to further meet the positioning requirement of the scanning rod in the scene of intraoral scanning.

[0013] However, the above general description and the following detailed description are merely exemplary and explanatory and are not intended to limit the present disclosure. [Brief description of the drawings]

[0014] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the disclosure.

[0015] In order to more clearly describe the technical solutions in the embodiments or prior art of the present disclosure, the drawings used in the description of the embodiments or prior art will be briefly described below. It is obvious that those skilled in the art can obtain other drawings based on these drawings without creative labor. [Figure 1] FIG. 1 illustrates an application scenario of intraoral scanning processing according to an embodiment of the present disclosure. [Diagram 2] 1 is a flow chart of an intraoral scanning method according to an embodiment of the present disclosure. [Diagram 3] 13 is a flow chart of another intraoral scanning method according to an embodiment of the present disclosure. [Figure 4] FIG. 1 is a block diagram of an intraoral scanning system according to an embodiment of the present disclosure. [Diagram 5] FIG. 1 is a configuration diagram of an electronic device according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0016] In order to make the objectives, technical solutions and advantages of the embodiments of the present disclosure more clear, the technical solutions in the embodiments of the present disclosure will be described below clearly and comprehensively, and it is to be understood that the described embodiments are only some embodiments of the present disclosure, and not all embodiments. Any other embodiments obtained by a person skilled in the art based on the embodiments of the present disclosure without creative labor are all included in the claims of the present disclosure.

[0017] In response to the above problems, the present disclosure provides an intraoral scanning method applicable to an application environment as shown in Fig. 1. Fig. 1 illustrates an application scene of intraoral scanning according to an embodiment of the present disclosure, in which the application environment includes attaching a plurality of intraoral scanning rods to a target oral cavity, the intraoral scanning rods including scanning rod parts 11 and auxiliary parts 12 connected to the scanning rod parts 11, and the scanning rod parts 11 and / or auxiliary parts 12 are provided with auxiliary features. Here, the shape features of the auxiliary parts 12 themselves may be the auxiliary features, and the scanning rod parts 11 are fitted to an implant body attached to the target oral cavity, and the scanning rod parts 11 are fitted to the implant body so that the intraoral scanning rod is attached to the target oral cavity.

[0018] Here, the auxiliary parts 12 of any two of the multiple intraoral scanning rods are compatible with each other, so that when any two intraoral scanning rods 10 are adjacently attached to the oral cavity, the auxiliary feature points of the two auxiliary parts are continuously distributed, and the true coordinate points of the auxiliary feature points can be obtained in advance, for example, by a single-lens photography measuring system, a three-dimensional coordinate meter, etc., and theoretically, the three-dimensional coordinate points corresponding to the image obtained by scanning have a one-to-one correspondence with the true coordinate points of the auxiliary feature points obtained in advance.

[0019] In the embodiments of the present disclosure, the intraoral scanner, also referred to as a digital impression scanner, refers to the use of a small probe-type optical scanning head to directly capture the three-dimensional shape and color texture information of hard and soft tissue surfaces such as teeth, gums, and mucosa inside the patient's oral cavity.

[0020] As an example of one scenario, multiple intraoral scanning rods are attached to a target oral cavity, the intraoral scanning rods include a scanning rod part connected to an implant body and an auxiliary part connected to the scanning rod, and the intraoral scanning rods are provided with target features, and the target features are continuously distributed on the scanning rods and / or the auxiliary parts, but not distributed on one side of the scanning rods and / or the auxiliary parts.

[0021] Specifically, the intraoral scanner scans the target intraoral cavity, acquires multiple frames of images, and the images are transferred to the data processing module for data processing. Acquire a plurality of frames of images, and acquire initial three-dimensional data of the target oral cavity based on the plurality of frames of images, the initial three-dimensional data including an initial set of points of the target oral cavity in the same coordinate system, and three-dimensional coordinate measurements of the target features; Obtain a preset model of the intraoral scanning rod, the preset model including a 3D coordinate true value of the target feature in the same coordinate system and a real point set (the 3D coordinate true value of each point) of the intraoral scanning rod; stitching the initial point set of the target oral cavity and the real point set of the intraoral scanning rod according to the correspondence relationship between the three-dimensional coordinate measurement value of the target feature and the true value; Positioning information of the intraoral scanning rod is determined based on the real point set of the stitched intraoral scanning rod, and the positioning information of the intraoral scanning rod is positioning information of the implant body, and a method is performed to design the tooth body based on the positioning information so that the designed and manufactured tooth body can be fitted to the implant body.

[0022] Specifically, by responding to a scanning request for the oral cavity including the scanning rod, the positioning mode of the scanning rod is obtained, the oral cavity is scanned to obtain target scanning data, and the positioning information of the scanning rod is determined by processing according to the positioning mode of the scanning rod and the target scanning data. According to the above technical solution, the positioning information of the scanning rod is obtained according to the scanning result, so as to further meet the positioning requirement of the scanning rod in the scene of intraoral scanning.

[0023] Specifically, Fig. 2 is a flow chart of an intraoral scanning method according to an embodiment of the present disclosure that can be executed by an intraoral scanning device, which can be implemented using software and / or hardware, and may be generally integrated into electronic devices. As shown in Fig. 2, the method includes the following steps 101 to 103.

[0024] In step 101, in response to a scan request for an intraoral cavity that includes a scanning rod, a positioning mode for the scanning rod is obtained.

[0025] Here, the oral cavity refers to the oral cavity that needs to perform dental implant treatment, and the intraoral cavity needs to be scanned to determine the intraoral implant position, and the intraoral scanning rod is connected via the auxiliary feature body and then performs intraoral scanning.

[0026] In embodiments of the present disclosure, the scanning rod and / or auxiliary feature body may include auxiliary feature points (e.g., circular, rectangular, checkerboard, etc.), and the auxiliary feature body may have a variety of shapes (e.g., spherical, rectangular, cuboid, pyramidal, etc.).

[0027] Here, the scanner can select different scanning modes, such as normal scanning mode, scanning rod positioning mode, etc., based on application scenarios, and the subsequent scanning data processing forms are different in different scanning modes.

[0028] In an embodiment of the present disclosure, when a user triggers a scan start button provided on the scanner, a scan request for an oral cavity including a scanning rod is received, and parameters of the scan request are further obtained, and a corresponding scan mode may be determined based on different scan request scenes, for example, 1 indicates a normal scan scene and 0 indicates a scan rod positioning scan scene.

[0029] In the embodiment of the present disclosure, after the user triggers the scan start button provided on the scanner, the user may directly obtain the scan mode by triggering the scan mode selection button provided on the scanner.

[0030] Specifically, after the scanning rod is connected to the oral cavity, a positioning mode of the scanning rod is obtained in response to a scanning request for the oral cavity including the scanning rod.

[0031] In step 102, the intraoral cavity is scanned to obtain target scan data.

[0032] Here, the target scan data may include a structured light image and / or a texture image.

[0033] In the embodiments of the present disclosure, there are various forms of scanning the oral cavity to obtain target scan data, and in some embodiments, a projector of a scanner is controlled to project a structured light pattern into the oral cavity, image collection is performed, a first camera is controlled to obtain a structured light image, an illumination element is controlled to project illumination light into the oral cavity, image collection is performed, and a second camera is controlled to obtain a texture image, and the structured light image and the texture image are the target scan data.

[0034] In another embodiment, the structured light image and the texture image are directly captured by a camera. The above two forms are merely examples of scanning the oral cavity to obtain target scan data, and the embodiments of the present disclosure do not limit the specific manner of scanning the oral cavity to obtain target scan data.

[0035] In embodiments of the present disclosure, after responding to a scan request for an intraoral cavity that includes a scanning rod, the intraoral cavity may be scanned to obtain target scan data.

[0036] In step 103, the positioning information of the scanning rod is determined by processing according to the positioning mode of the scanning rod and the target scanning data.

[0037] Here, different scanning modes have different types of subsequent processing. When in the scanning rod positioning mode, the target scanning data needs to be processed to determine the scanning rod positioning information.

[0038] In one embodiment of the present disclosure, when in a scanning rod positioning mode, information of auxiliary feature points in a texture image is extracted, 3D reconstruction is performed based on the information of the auxiliary feature points, 3D data of the auxiliary feature points is obtained, a 3D model of the scanning rod is determined based on the 3D data of the auxiliary feature points, and positioning information of the scanning rod is determined based on the 3D model of the scanning rod.

[0039] In another embodiment of the present disclosure, texture mapping is performed on the 3D model and color information based on the pixel coordinates of the structured light image, the pixel coordinates of the texture image, and the internal and external parameters of the camera, and information of auxiliary feature points in the texture image is extracted, 3D reconstruction is performed based on the information of the auxiliary feature points, 3D data of the auxiliary feature points is obtained, a 3D model of the scanning rod is determined based on the 3D data of the auxiliary feature points, and positioning information of the scanning rod is determined based on the 3D model of the scanning rod.

[0040] Here, an auxiliary feature point can uniquely identify one feature, that is, auxiliary feature points are provided on the scanning rod, and each auxiliary feature point can uniquely identify a position feature corresponding to the scanning rod. For example, target feature a and target feature b are provided at positions 1 and 2 on the scanning rod, respectively, and target feature a can uniquely identify the position feature at position 1 on the scanning rod, and target feature b can uniquely identify the position feature at position 2 on the scanning rod.

[0041] In addition, any feature that can uniquely identify the corresponding position feature on the scanning rod, such as a different shape, color, two-dimensional code, etc. on the scanning rod, can be the auxiliary feature. In addition, the auxiliary feature may be the shape feature of the auxiliary part 12 itself.

[0042] Specifically, after the target scanning data is obtained, the positioning information of the scanning rod can be determined by processing according to the positioning mode of the scanning rod and the target scanning data.

[0043] In the intraoral scanning processing mode according to the embodiment of the present disclosure, in response to a scanning request for an oral cavity including a scanning rod, a positioning mode of the scanning rod is obtained, the oral cavity is scanned to obtain target scanning data, and the positioning information of the scanning rod is determined by processing according to the positioning mode of the scanning rod and the target scanning data. According to the above technical solution, the positioning information of the scanning rod is obtained according to the scanning result, so as to further meet the positioning requirement of the scanning rod in the intraoral scanning scene.

[0044] Based on the above description of the embodiment, the intraoral scanning processing mode in a specific situation will be described in detail below with reference to FIG.

[0045] Specifically, Fig. 3 is a flow chart of another intraoral scanning method according to an embodiment of the present disclosure, which further optimizes the intraoral scanning method based on the above embodiment. As shown in Fig. 3, the method includes the following steps 201 to 204:

[0046] In step 201, in response to a scan request for an intraoral cavity including a scanning rod, parameters of the scan request are obtained, a scene of the scan request is determined based on the parameters of the scan request, and a positioning mode of the scanning rod is obtained based on the scene of the scan request.

[0047] Specifically, when a scanning request for the oral cavity is received, the scanning request is analyzed and parameters of the scanning request are obtained, and it should be understood that the parameters of the scanning request uniquely identify one scanning request scene, such as a normal scanning scene or a scanning rod positioning scene, so that different scanning rod positioning modes, such as a normal scanning mode or a scanning rod positioning mode, can be obtained based on different scanning request scenes.

[0048] In step 202, a projector of the scanner is controlled to project a structured light pattern onto the oral cavity, image collection is performed, a first camera is controlled to acquire a structured light image, an illumination element is controlled to project illumination light onto the oral cavity, image collection is performed, and a second camera is controlled to acquire a texture image, and the structured light image and the texture image are the target scan data.

[0049] In step 203, if in the scanning rod positioning mode, information of auxiliary feature points in the texture image is extracted, 3D reconstruction is performed based on the information of the auxiliary feature points, 3D data of the auxiliary feature points is obtained, a 3D model of the scanning rod is determined based on the 3D data of the auxiliary feature points, and positioning information of the scanning rod is determined based on the 3D model of the scanning rod.

[0050] Specifically, the projector of the scanner is controlled to project a structured light pattern onto the oral cavity, image collection is performed using a first camera, a structured light image and a texture image are collected, and then 3D reconstruction is performed to obtain an array of the structured light image and an array of the texture image, 3D data including the teeth, gums, and scanning rod is calculated based on the array of the structured light image, and 3D data of the auxiliary feature points is reconstructed using the array of the texture image. Since the reconstructed structured light image and the texture image are acquired at the same time, it is considered that the 3D data and the 3D data of the auxiliary feature points have a one-to-one correspondence in the same coordinate system.

[0051] Specifically, when the collected 3D data of the auxiliary feature points is successfully stitched with the true coordinate points of the preset auxiliary feature points, the designed scanning rod data can be transferred to the auxiliary feature point coordinate system through the position transformation matrix, and the 3D model of the scanning rod acquired in real time can be replaced.

[0052] In step 204, a scanning mode switching request is received to obtain a normal scanning mode. If in the normal scanning mode, a 3D reconstruction is performed based on the structured light image in the target scanning data, a 3D model of the scanning rod is obtained, and texture mapping is performed on the 3D model of the scanning rod and the texture image in the target scanning data.

[0053] Specifically, when the scanning mode is switched to the normal scanning mode, 3D reconstruction can be performed based on the structured light image, a 3D model of the scanning rod can be obtained, and texture mapping can be performed on the 3D model of the scanning rod and the texture image in the target scanning data.

[0054] In an intraoral scanning process according to an embodiment of the present disclosure, the method includes: responding to a scan request for an intraoral cavity including a scanning rod, obtaining parameters of the scan request, determining a scene of the scan request based on the parameters of the scan request, obtaining a positioning mode of the scanning rod based on the scene of the scan request, controlling a projector of the scanner to project a structured light pattern into the intraoral cavity, performing image collection, controlling a first camera to obtain a structured light image, controlling an illumination element to project illumination light into the intraoral cavity, performing image collection, controlling a second camera to obtain a texture image, using the structured light image and the texture image as target scan data, and obtaining a positioning mode of the scanning rod. If in, extract information of auxiliary feature points in the texture image, perform 3D reconstruction according to the information of the auxiliary feature points, obtain 3D data of the auxiliary feature points, determine a 3D model of the scanning rod according to the 3D data of the auxiliary feature points, determine positioning information of the scanning rod according to the 3D model of the scanning rod, receive a scanning mode switching request to obtain a normal scanning mode, if in the normal scanning mode, perform 3D reconstruction according to the structured light image in the target scanning data, obtain a 3D model of the scanning rod, and perform texture mapping on the 3D model of the scanning rod and the texture image in the target scanning data, thereby determining different scanning modes according to the scanning request, and performing different processing on the scanning data according to the different scanning modes, meeting the processing needs of intraoral scanning data in different scenes, and further improving the processing efficiency and accuracy of the implant by intraoral scanning.

[0055] 4 is a block diagram of an intraoral scanning and processing system according to an embodiment of the present disclosure, which can be implemented in software and / or hardware and may be integrated into a typical electronic device. As shown in FIG. 4, the system includes a scanner 100 and a processing module 200.

[0056] Scanner 100 is used to respond to a scan request for an intraoral cavity that includes a scan rod, acquire a positioning mode of the scan rod, and scan the intraoral cavity to acquire target scan data.

[0057] The processing module 200 is used to process and determine the positioning information of the scanning rod based on the positioning mode of the scanning rod and the target scan data.

[0058] Optionally, the scanner 100 specifically: Obtaining parameters of a scan request based on the scan request; determining a scene for the scan request based on parameters of the scan request; It is used to obtain a positioning mode of the scan rod based on the scene of the scan request.

[0059] Optionally, the scanner 100 includes a projector 110 , a first camera 120 , an illumination element 130 , and a second camera 140 .

[0060] The projector 110 projects a structured light pattern into the oral cavity, and the first camera 120 performs image capture to obtain a structured light image as the target scan data.

[0061] The lighting element 130 projects illumination light into the oral cavity, and the second camera 140 captures images to obtain texture images as the target scan data.

[0062] Here, the first camera 120 and the second camera 140 may be one camera or two different cameras, and a plurality of first cameras 120 or a plurality of second cameras 140 may be provided.

[0063] Optionally, the processing module specifically: Extracting information of auxiliary feature points in the texture image when in a scanning rod positioning mode; Performing 3D reconstruction based on the information of the auxiliary feature points to obtain 3D data of the auxiliary feature points; A three-dimensional model of the scanning rod is determined based on the three-dimensional data of the auxiliary feature points, and is used to determine positioning information of the scanning rod based on the three-dimensional model of the scanning rod.

[0064] Optionally, the scanner 100 further comprises: Receive a scanning mode switch request and obtain a normal scanning mode; The processing module 200 further comprises: When in the normal scanning mode, it is used to perform 3D reconstruction based on the structured light image in the target scan data, obtain a 3D model of the scanning rod, and perform texture mapping between the 3D model of the scanning rod and the texture image in the target scan data.

[0065] The intraoral scanning system according to the embodiments of the present disclosure can perform the intraoral scanning method according to any embodiment of the present disclosure and has corresponding functional modules and beneficial effects for performing the method.

[0066] An embodiment of the present disclosure further provides a computer storage medium having a program stored therein, which, when executed, can realize some or all of the steps in each embodiment of the intraoral scanning processing method according to the embodiment as shown in Figures 2 to 3.

[0067] In an embodiment of the present disclosure, as shown in FIG. A processor; A memory used to store executable instructions for a processor, The processor, The device is configured to read executable instructions from the memory and execute the instructions to implement an intraoral scanning processing method according to an embodiment of the present disclosure.

[0068] Specifically, as shown in FIG. 5, a configuration diagram of an electronic device 400 for implementing the embodiment of the present disclosure is shown below. The electronic device 400 in the embodiment of the present disclosure may include, but is not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), and in-vehicle terminals (e.g., in-vehicle navigation terminals), and fixed terminals such as digital TVs and desktop computers. The electronic device shown in FIG. 5 is merely an example and does not limit the functions and scope of use of the embodiment of the present disclosure.

[0069] 5, the electronic device 400 may include a processing unit (e.g., a central processing unit, a graphics processor, etc.) 401 that can perform various suitable operations and processes based on programs stored in a read-only memory (ROM) 402 or programs loaded from a storage device 408 into a random access memory (RAM) 403. In the RAM 403, various programs and data necessary for the operation of the electronic device 500 are further stored. The processing unit 401, the ROM 402, and the RAM 403 are interconnected via a bus 404. An input / output (I / O) interface 405 is also connected to the bus 404.

[0070] In general, the I / O interface 405 may be connected to input devices 406 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc., output devices 407 including, for example, a liquid crystal display (LCD), speaker, oscillator, etc., storage devices 408 including, for example, a magnetic tape, hard disk, etc., and communication devices 409. The communication devices 409 allow the electronic device 500 to communicate wirelessly or via wires with other devices to exchange data. Although FIG. 5 illustrates the electronic device 500 with various devices, it should be understood that it is not required to implement or include all of the illustrated devices. Alternatively, more or fewer devices may be implemented or included.

[0071] In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts may be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product including a computer program carried on a non-transitory computer readable medium, the computer program including program code for performing the method illustrated in the flowchart. In such an embodiment, the computer program may be downloaded and installed from a network by the communication device 409, or installed from the storage device 408, or installed from the ROM 402. When the computer program is executed by the processing device 401, it performs the above-mentioned functions limited to the intraoral scanning processing method of the embodiment of the present disclosure.

[0072] In addition, the computer-readable medium of the present disclosure may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above. The computer-readable storage medium may be, for example, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of the computer-readable storage medium may include, but are not limited to, an electrical connection having one or more conductors, a portable computer magnetic disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), optical fiber, a portable compact magnetic disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, the computer-readable storage medium may be any tangible medium that contains or stores a program, which may be used by or in combination with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier, the data signal carrying computer-readable program code. Such a propagated data signal may take a variety of forms, including, but not limited to, an electromagnetic signal, an optical signal, or any suitable combination of the above. A computer-readable signal medium may be any computer-readable medium other than a computer-readable storage medium, the computer-readable signal medium may be used to transmit, propagate, or transmit a program used by or in connection with an instruction execution system, apparatus, or device. The program code contained in the computer-readable medium may be transmitted by any suitable medium, including, but not limited to, conductive wire, fiber optic cable, RF (radio frequency), or the like, or any combination of the above.

[0073] In some embodiments, the clients and servers may communicate using any now known or later developed network protocol, such as, for example, HyperText Transfer Protocol (HTTP), and may be connected to each other (e.g., a communications network) in communication with digital data in any form or medium. Examples of communications networks include a local area network ("LAN"), a wide area network ("WAN"), the Internet (e.g., the Internet), and end-to-end networks (e.g., an ad hoc end-to-end network), and any now known or later developed network.

[0074] The computer-readable medium may be included in the electronic device, or may be separate from and not located in the electronic device.

[0075] The computer-readable medium carries one or more programs, and when the one or more programs are executed by the electronic device, the electronic device receives user information and displays a trigger operation during the playback process of a video, obtains at least two target information related to the video, displays a first target information of the at least two target information in an information display area of ​​the playback page of the video, the size of which is smaller than the size of the playback page, receives a first switching trigger operation from the user, and switches the first target information displayed in the information display area to a second target information of the at least two target information.

[0076] Computer program code for carrying out the operations of the present disclosure may be written in one or more programming languages ​​or combinations thereof, including, but not limited to, the above programming languages, object-oriented programming languages ​​such as Java, Smalltalk, C++, and even conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may run entirely on the user's computer, partially on the user's computer, as a single independent software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. When a remote computer is involved, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0077] The flowcharts and block diagrams in the drawings illustrate possible system architectures, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowcharts or block diagrams may represent a module, program section or part of code, which includes one or more executable instructions for implementing a specified logical function. It should be noted that in some alternative implementations, the functions noted in the blocks may occur in a different order than the order noted in the drawings. For example, two blocks shown in succession may actually be executed essentially in parallel or in the reverse order, depending on the functionality involved. It should be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented in a dedicated system of hardware that performs a given function or operation, or may be implemented in a combination of dedicated hardware and computer instructions.

[0078] The units described in the embodiments of the present disclosure may be implemented in the form of software or hardware, and the names of the units do not necessarily limit the units themselves in some cases.

[0079] The functions described herein above may be performed, at least in part, by one or more hardware logic devices. For example, without limitation, exemplary types of hardware logic components that may be utilized include field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), etc.

[0080] In the context of the present disclosure, a machine-readable medium may be a tangible medium that can contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of machine-readable storage media include an electrical connection by one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0081] According to one or more embodiments of the present disclosure, the present disclosure provides a method for producing a liquid crystal display comprising: A processor; a memory adapted to store executable instructions of the processor, The processor reads the executable instructions from the memory and executes the instructions to provide electronic equipment that can be used to implement any one of the intraoral scanning processing methods according to the present disclosure.

[0082] According to one or more embodiments of the present disclosure, the present disclosure provides a computer-readable storage medium having stored thereon a computer program used to perform any one of the intraoral scanning processing methods according to the present disclosure.

[0083] In this specification, the use of related terms such as "first" and "second" is merely intended to distinguish one entity or operation from another entity or operation, and does not necessarily require or imply that any such actual relationship or sequence exists between these entities or operations. Furthermore, the technical terms "comprise", "have", or any other variations thereof, by covering the non-exclusive "comprise", mean that a process, method, article, or device that includes a set of elements not only includes those elements, but also further includes other elements not expressly listed, or further includes elements that are specific to such process, method, article, or device. Unless further limited, an element defined by the phrase "comprises a ..." does not exclude the presence of other identical elements in the process, method, article, or device that includes the element.

[0084] The above contents are merely embodiments of the present disclosure, and are intended for those skilled in the art to understand or realize the present disclosure. A number of modifications of these embodiments can be easily realized by those skilled in the art, and the general principles defined herein can be realized in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure is not limited to these embodiments shown herein, but should be accorded the widest scope consistent with the principles and novel features disclosed herein. [Industrial Applicability]

[0085] The intraoral scanning processing method disclosed herein can obtain scanning rod positioning information based on the scanning result, and can meet the positioning requirements of the scanning rod when performing intraoral scanning, and has extremely high industrial applicability.

Claims

1. 1. A method of intraoral scanning comprising: acquiring a positioning mode of the scanning rod in response to a scan request for an intraoral cavity including the scanning rod; scanning the intraoral cavity to obtain target scan data; and processing the scanning rod positioning mode and the target scan data to determine scanning rod positioning information.

2. The step of acquiring a positioning mode of the scanning rod in response to a scan request for an intraoral cavity including a scanning rod includes: obtaining a parameter of a scanning request based on the scanning request; determining a scene for the scan request based on parameters of the scan request; and obtaining a positioning mode of the scanning rod based on a scene of the scan request.

3. The step of scanning the intraoral cavity to obtain target scan data comprises: controlling a projector of a scanner to project a structured light pattern into the intraoral cavity and controlling a first camera to perform image acquisition and capture a structured light image; controlling a lighting element to project illumination light into the oral cavity and controlling a second camera to perform image acquisition and capture texture images; 2. The method of claim 1, further comprising the step of: selecting the structured light image and the texture image as the target scan data.

4. The step of processing based on the positioning mode of the scanning rod and the target scan data to determine positioning information of the scanning rod includes: extracting information of auxiliary feature points in the texture image when in the scanning rod positioning mode; performing 3D reconstruction based on information of the auxiliary feature points to obtain 3D data of the auxiliary feature points; The intraoral scanning method according to claim 3, further comprising the steps of: determining a three-dimensional model of a scanning rod based on the three-dimensional data of the auxiliary feature points; and determining positioning information of the scanning rod based on the three-dimensional model of the scanning rod.

5. receiving a scanning mode switching request and acquiring a normal scanning mode; The intraoral scanning method of claim 1, further comprising the steps of: when in the normal scanning mode, performing 3D reconstruction based on a structured light image in the target scan data, obtaining a 3D model of a scanning rod, and performing texture mapping on the 3D model of the scanning rod and a texture image in the target scan data.

6. 1. An intraoral scanning system comprising: a scanner adapted to respond to a scan request for an intraoral cavity including a scanning rod, to obtain a positioning mode of the scanning rod, and to scan the intraoral cavity to obtain target scan data; a processing module adapted to process based on the positioning mode of the scanning rod and the target scan data and determine positioning information of the scanning rod.

7. the scanner includes a camera and an illumination element; The intraoral scanning system of claim 6, wherein the illumination element projects illumination light into the oral cavity, and the camera collects images to obtain texture images as the target scan data.

8. Specifically, the processing module includes: Extracting information of auxiliary feature points in the texture image when in a scanning rod positioning mode; Performing a three-dimensional reconstruction based on the information of the auxiliary feature points to obtain three-dimensional data of the auxiliary feature points; The intraoral scanning processing system of claim 7, which is used to determine a three-dimensional model of a scanning rod based on the three-dimensional data of the auxiliary feature points, and to determine positioning information of the scanning rod based on the three-dimensional model of the scanning rod.

9. An electronic device, A processor; a memory adapted to store executable instructions for said processor; The electronic device is characterized in that the processor is used to read the executable instructions from the memory and execute the instructions to realize the intraoral scanning processing method described in any one of claims 1 to 5.

10. A computer-readable storage medium storing a computer program for executing the intraoral scanning method according to any one of claims 1 to 5.

Images