A full-real-scene electronic shopping mall transaction terminal
Through the design of a full-life electronic shopping mall trading terminal, the weighing and processing process of the product is displayed in real time, which solves the problem of lack of weight and quality differences in online shopping, and achieves transparency and consistency of commodity trading.
Patent Information
- Application Number
- CN202411057189.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-02
- Publication Date
- 2024-11-05
- Estimated Expiration
- 2044-08-02
AI Technical Summary
During online shopping, users cannot view the weighing and processing process of products in real time, resulting in the problem of lack of weight and quality differences.
Design a full-life electronic shopping mall trading terminal, including weighing module, display panel, image acquisition module and central processing module, through image acquisition and analysis, display the weighing and processing process of the product in real time, and upload the image to the cloud server and Buyer account binding.
It realizes openness and transparency of the product weighing and processing process, avoids fraud by merchants during the weighing process, and eliminates product quality differences, ensuring that the products received by buyers are consistent with online display.
Smart Images

Figure CN118569959B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of computer technology, in particular to a full-real-scene electronic shopping mall transaction terminal. Background Art
[0002] With the development of technology, more and more users have started to shop online, and users have gradually begun to buy fresh products online.
[0003] The inventor found in the research that after online users place an order online, the online process of the goods (such as the weighing process, cleaning process, and processing process) is completely invisible to the users. This has two disadvantages. First, there will be a shortage of weight, because most sellers will not re-weigh, so merchants will falsify the weighing process of the goods. Second, inferior goods are passed off as good ones. For example, when buying fresh food online through live broadcast, the quality of the fresh food you see is very good, but when the buyer actually receives the goods, he finds that it is completely different from what he saw during the live broadcast. Summary of the invention
[0004] In order to solve the above-mentioned problems in the prior art, the present invention provides a full-real-scene electronic shopping mall transaction terminal.
[0005] In a first aspect, the present application provides a full-real-scene electronic shopping mall transaction terminal, comprising:
[0006] A weighing module is used to weigh the commodity and determine the price of the commodity based on the unit price of the commodity;
[0007] A display panel connected to the weighing module, used to display the weight information, unit price and price of the commodity;
[0008] A label printing module, connected to the weighing module, for generating a graphic code; wherein the weight information, unit price and price of the commodity are obtained by scanning the graphic code;
[0009] An image acquisition module, used to acquire an image set corresponding to the product;
[0010] a central processing module connected to the image acquisition module, and configured to extract a first image set, a second image set, and a third image based on the image set acquired by the image acquisition module; wherein the first image set is an image set of the commodity in a commodity weighing stage, the second image set is an image set of the commodity in a commodity processing stage, and the third image is an image of the commodity corresponding to the display panel in the commodity weighing stage;
[0011] The central processing module is also used to upload the first image set, the second image and the third image to the cloud server, so that the cloud server binds the first image set, the second image set and the third image to the buyer account corresponding to the product.
[0012] In an optional implementation of the first aspect, the image acquisition module includes a zoom lens camera; the central processing module is connected to the zoom lens camera;
[0013] The central processing module further includes an image analysis unit, which is used to perform the following steps, including:
[0014] Step 1: Obtain an image set collected by the zoom lens camera and determine a target image; wherein the target image is an image of the commodity when it is placed on the weighing module for weighing;
[0015] Step 2: performing a quality score on the target image, and when the quality score of the target image is lower than a first preset threshold, adjusting the focal length of the zoom lens camera; wherein the quality score is used to determine whether the target image is clear;
[0016] After adjusting the focal length of the zoom lens camera, steps 1 and 2 are repeated until the quality score of the latest determined target image is not less than the first preset threshold, and then the first image set and the third image are extracted.
[0017] In an optional implementation of the first aspect, the performing quality scoring on the target image includes:
[0018] Converting the brightness value of the target image into logarithmic brightness, and performing a local nonlinear operation based on the logarithmic brightness of the target image to obtain the image intensity of the target image;
[0019] Performing wavelet transformation on the image intensity of the target image to obtain four wavelet parameters;
[0020] Based on the four wavelet parameters, four features corresponding to the target image are calculated;
[0021] Based on the four features corresponding to the target image, a regression algorithm is used for fitting to generate a quality score of the target image.
[0022] In an optional implementation of the first aspect, a formula for obtaining the image intensity of the target image is:
[0023] ;
[0024] in, The coordinates of the target image are represented by Image intensity; The coordinates of the target image are represented by The logarithmic brightness of ; and Respectively represent the height and width of the target image; represents a constant; and All represent local operation functions;
[0025] ;
[0026] ;
[0027] in, , which is a Gaussian weighting function; and Represents the offset in the horizontal and vertical directions, that is, the farther the pixel is from the center, the smaller the corresponding weight; , indicating the local operation range; and Indicates an intermediate quantity;
[0028] The formula for performing wavelet transformation on the image intensity of the target image includes:
[0029] ;
[0030] in, Represents the logarithmic brightness of the target image Perform wavelet transformation; represents four wavelet parameters;
[0031] The calculation formulas for the four features corresponding to the target image are:
[0032] ;
[0033] ;
[0034] ;
[0035] ;
[0036] in, Represents the four features corresponding to the target image.
[0037] In an optional implementation of the first aspect, the image acquisition module includes a camera and a three-degree-of-freedom motion device; the central processing module is connected to the three-degree-of-freedom motion device;
[0038] The central processing module further includes a motion detection unit; the motion detection unit is used to perform the following steps, including:
[0039] Acquire the image set collected by the camera and determine the target image; wherein the target image is the image of the commodity when it is placed on the weighing module for weighing;
[0040] Determine the image to be matched based on the reference image set; wherein the reference image set is N consecutive target images; and the image to be matched is a cropped image;
[0041] Performing feature point pairing on each frame of image acquired after the pair of images to be matched;
[0042] Based on the feature point pairing result, adjusting the three-degree-of-freedom motion device to adjust the shooting angle of the camera through the three-degree-of-freedom motion device;
[0043] The second image set is extracted from the photo set taken by the camera after adjustment based on the three-degree-of-freedom motion device.
[0044] In an optional implementation of the first aspect, the motion detection unit is further configured to perform the following steps, including:
[0045] In response to the presence of a fourth image for feature point pairing, the number of detected paired feature points is lower than a second preset threshold, identifying a human body in the fourth image;
[0046] Based on the identified position of the human body, the three-degree-of-freedom motion device is adjusted to adjust the shooting angle of the camera through the three-degree-of-freedom motion device until the number of paired feature points detected in the captured image is not less than the second preset threshold.
[0047] In an optional implementation of the first aspect, the motion detection unit is further configured to perform the following steps, including:
[0048] identifying a position of the display panel from the first image set;
[0049] Based on the position of the display panel, adjusting the shooting angle of the camera so that the camera is aligned with the display panel;
[0050] The third image captured by the adjusted camera is obtained, and the third image is uploaded to the cloud server.
[0051] In an optional implementation of the first aspect, the formula for pairing feature points of each frame of image subsequently acquired based on the image to be matched includes:
[0052] ;
[0053] in, represents the feature points on the image to be matched, Represents a feature point on any frame image after the image pair to be matched; represents an angle, corresponding to the rotation angle of the three-degree-of-freedom motion device on the Z axis; represents a first translation distance, corresponding to the rotation angle of the three-degree-of-freedom motion device on the X-axis; represents the second translation distance, corresponding to the rotation angle of the three-degree-of-freedom motion device on the Y axis.
[0054] In an optional implementation of the first aspect, the weighing module further specifically includes:
[0055] Weighing table, used to weigh the goods;
[0056] An input panel, used to receive a commodity code input by a staff member; wherein the commodity code corresponds to the unit price of the commodity;
[0057] The processor is respectively connected to the label printing module, the weighing platform and the input panel, and is used to obtain the weight information detected by the weighing platform and determine the price of the product according to the product code input by the staff.
[0058] In an optional implementation of the first aspect, the input panel is further used to receive the account ID input by the staff;
[0059] Wherein, the graphic code also includes the account ID of the staff member.
[0060] The beneficial effects of the present invention include:
[0061] First, since the first image set is the image of the product when it is placed on the weighing module for weighing, and the third image is the image corresponding to the display panel when the product is in the weighing stage, the buyer can view the weighing process through the first image set, and compare the weight, unit price and total price of the product when weighing based on the third image and the scanned graphic code to see if they are false, thereby making the weighing process completely open and transparent, and preventing merchants from falsifying during the weighing process.
[0062] Second, since the second image set is an image set of the goods in the processing stage, the second image set allows buyers to see the processing process of the goods they purchased, such as the fruit cutting process, the packaging process, the meat processing process, etc. By recording the processing process of the goods, it is convenient for buyers to determine whether the goods have been swapped, thereby eliminating the situation where there is a quality difference between the goods ordered during online shopping such as live broadcasts and the goods actually received. BRIEF DESCRIPTION OF THE DRAWINGS
[0063] Figure 1 A module block diagram of a full-real-scene electronic shopping mall transaction terminal provided by an embodiment of the present invention;
[0064] Figure 2 The present invention provides a schematic diagram of the structure of a full-real-scene electronic shopping mall transaction terminal.
[0065] Reference numerals:
[0066] 100- full-real-scene electronic shopping mall transaction terminal; 10- weighing module; 101- weighing platform; 102- input panel; 20- display panel; 30- label printing module; 40- image acquisition module; 50- central processing module. DETAILED DESCRIPTION
[0067] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present application.
[0068] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, wholes, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or combinations thereof.
[0069] It should also be understood that the term “and / or” used in the specification and appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes these combinations.
[0070] As used in this specification and the appended claims, the term "if" may be interpreted as "when" or "uponce" or "in response to determining" or "in response to detecting" depending on the context.
[0071] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.
[0072] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.
[0073] The inventor found in the research that after online users place an order online, the online process of the goods (such as weighing process, cleaning process, processing process) is completely invisible to users. This has two disadvantages. First, there will be a situation of short weight, because most sellers will not re-weigh, so merchants will falsify the weighing process of the goods. Second, inferior goods are passed off as good ones. For example, when buying fresh food online through live broadcast, the quality of the fresh food seen is very good, but when the buyer actually receives the goods, he finds that it is completely different from what he saw in the live broadcast.
[0074] In view of the above problems, the present application proposes the following embodiments to solve the above technical problems.
[0075] See also Figure 1 as well as Figure 2 The present application embodiment provides a full-real-scene electronic shopping mall transaction terminal 100, including:
[0076] The weighing module 10 is used to weigh the commodity and determine the price of the commodity based on the unit price of the commodity.
[0077] The display panel 20 is connected to the weighing module 10 and is used to display the weight information, unit price and price of the commodity.
[0078] The label printing module 30 is connected to the weighing module 10 and is used to generate a graphic code; wherein the weight information, unit price and price of the commodity are obtained by scanning the graphic code.
[0079] The image acquisition module 40 is used to acquire an image set corresponding to the product.
[0080] The central processing module 50 is connected to the image acquisition module 40, and is used to extract the first image set, the second image set and the third image based on the image set acquired by the image acquisition module 40; wherein the first image set is an image set of the commodity in the commodity weighing stage, the second image set is an image set of the commodity in the commodity processing stage, and the third image is an image corresponding to the display panel 20 when the commodity is in the commodity weighing stage.
[0081] The central processing module 50 is also used to upload the first image set, the second image set and the third image to the cloud server, so that the cloud server binds the first image set, the second image set and the third image to the buyer account corresponding to the product.
[0082] It should be noted that the central processing module 50 may be a central processing unit (CPU), and the central processing module 50 may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.
[0083] The following is a description of the use process of the full-real-scene electronic shopping mall transaction terminal 100 provided in the embodiment of the present application:
[0084] First, the merchant (i.e., the staff) places the goods on the weighing module 10 for weighing. The weighing module 10 can weigh the goods and determine the price of the goods based on the unit price of the goods. After determining the price of the goods, the display panel 20 displays the weight information, unit price and price of the goods, and generates a graphic code through the label printing module 30. Subsequently, the buyer can obtain the weight information, unit price and price corresponding to the goods by scanning the graphic code. The staff can stick the graphic code on the goods or on the corresponding packaging of the goods. During this period, the image acquisition module 40 can capture the whole weighing process, and the central processing module 50 can extract the first image set, the second image set and the third image from the image collected by the image acquisition module 40. Among them, the first image set is the image set of the goods in the goods weighing stage, the second image set is the image set of the goods in the goods processing stage, and the third image is the image corresponding to the display panel 20 when the goods are in the goods weighing stage. Finally, the first image set, the second image set and the third image are uploaded to the cloud server, so that the cloud server binds the first image set, the second image set and the third image to the buyer's account. The buyer can directly view them through the shopping software.
[0085] It can be seen that the full-real-scene electronic shopping mall transaction terminal 100 provided in the embodiment of the present application has the following beneficial effects:
[0086] First, since the first image set is an image of the product when it is placed on the weighing module 10 for weighing, and the third image is an image corresponding to the display panel 20 when the product is in the weighing stage, the buyer can view the weighing process through the first image set, and compare the weight, unit price and total price of the product when weighing based on the third image and the scanned graphic code to see if they are false, thereby making the weighing process completely open and transparent, and preventing merchants from falsifying during the weighing process.
[0087] Second, since the second image set is an image set of the goods in the processing stage, the second image set allows buyers to see the processing process of the goods they purchased, such as the fruit cutting process, the packaging process, the meat processing process, etc. By recording the processing process of the goods, it is convenient for buyers to determine whether the goods have been swapped, thereby eliminating the situation where there is a quality difference between the goods ordered during online shopping such as live broadcasts and the goods actually received.
[0088] Optionally, the image acquisition module 40 includes a zoom lens camera; the central processing module 50 is connected to the zoom lens camera.
[0089] The central processing module 50 further includes an image analysis unit (specifically, the image analysis unit is connected to the zoom lens camera), and the image analysis unit is used to perform the following steps, including:
[0090] Step 1: Obtain an image set collected by a zoom lens camera and determine a target image; wherein the target image is an image of the commodity when it is placed on a weighing module for weighing.
[0091] Step 2: Perform a quality score on the target image. When the quality score of the target image is lower than a first preset threshold, adjust the focal length of the zoom lens camera; wherein the quality score is used to determine whether the target image is clear.
[0092] After adjusting the focal length of the zoom lens camera, repeating step one and step two until the quality score of the latest determined target image is not less than the first preset threshold, the first image set and the third image.
[0093] It should be noted that, due to the uncertain positional relationship between the goods and the image acquisition module 40 (for example, the goods may differ in size and the placement of the goods by the staff members may also differ), the focal length of the image acquisition module 40 may also be incorrect. The image acquired at an incorrect focal length may be blurry and noisy, and therefore, it is necessary to perform a quality assessment on the image in order to change the focal length of the zoom lens of the image acquisition module 40 through a focal length control unit, thereby achieving a focal length that can achieve higher image quality shooting.
[0094] For example, when the focal length is inaccurate, the captured image will be unclear, which will result in the inability to effectively supervise the weighing process and make it impossible for users to accurately identify it. Therefore, it is necessary to ensure that the first image set and the third image uploaded to the cloud server meet a certain clarity and reduce noise.
[0095] Optionally, perform a quality score on the target image, including:
[0096] The brightness value of the target image is converted into logarithmic brightness, and the image intensity of the target image is obtained by performing a local nonlinear operation based on the logarithmic brightness of the target image;
[0097] Perform wavelet transformation on the image intensity of the target image to obtain four wavelet parameters;
[0098] Based on the four wavelet parameters, four features corresponding to the target image are calculated;
[0099] Based on the four features corresponding to the target image, a regression algorithm is used to fit and generate a quality score of the target image.
[0100] The above regression algorithm may specifically adopt the ELM algorithm, through which a quality score of 0 to 1 may be given. The first preset threshold corresponding to the above embodiment may also be set, such as 0.7, 0.6, etc.
[0101] Optionally, the formula for obtaining the image intensity of the target image is:
[0102] ;
[0103] in, The coordinates of the target image are Image intensity; The coordinates of the target image are The logarithmic brightness of ; and Respectively represent the height and width of the target image; Represents a constant (e.g. it can be 1); and All represent local operation functions;
[0104] ;
[0105] ;
[0106] in, , which is a Gaussian weighting function; and Represents the offset in the horizontal and vertical directions, that is, the farther the pixel is from the center, the smaller the corresponding weight; , indicating the local operation range; and Indicates an intermediate quantity;
[0107] The formula for performing wavelet transformation on the image intensity of the target image includes:
[0108] ;
[0109] in, Represents the logarithmic brightness of the target image Perform wavelet transformation; represents four wavelet parameters;
[0110] The calculation formulas for the four features corresponding to the target image are:
[0111] ;
[0112] ;
[0113] ;
[0114] ;
[0115] in, Represents the four features corresponding to the target image.
[0116] It has been verified that the process of detecting images and adjusting the focal length in the above manner can meet the needs of products of various sizes and dimensions, has good applicability and high accuracy.
[0117] Optionally, the image acquisition module 40 includes a camera and a three-degree-of-freedom motion device; the central processing module 50 is connected to the three-degree-of-freedom motion device.
[0118] It should be noted that the three-degree-of-freedom motion device supports three-degree-of-freedom rotation, namely rotation around the X-axis (can be tilted forward or backward), rotation around the Y-axis (can be tilted left or right), and rotation around the Z-axis (can be rotated clockwise or counterclockwise). The three-degree-of-freedom motion device can be used to adjust the shooting angle of the camera.
[0119] The central processing module 50 also includes a motion detection unit (the motion detection unit may be connected to a three-degree-of-freedom motion device); the motion detection unit is used to perform the following steps, including: acquiring an image set captured by a camera and determining a target image; wherein the target image is an image of the commodity when it is placed on a weighing module for weighing; determining an image to be matched based on a reference image set; wherein the reference image set is a continuous N target images; the image to be matched is a cropped image; performing feature point pairing on each frame of image subsequently acquired based on the image to be matched; adjusting the three-degree-of-freedom motion device based on the feature point pairing result so as to adjust the shooting angle of the camera through the three-degree-of-freedom motion device; extracting a second image set from the photo set taken by the camera after the adjustment based on the three-degree-of-freedom motion device.
[0120] It should be noted that determining the image to be matched based on the reference image set can specifically be based on six consecutive target images, determining a cropping size, and then cropping any target image based on the cropping size to obtain the image to be matched.
[0121] For example, the average value of the pixel distances between the horizontal axis and the vertical axis after the product is framed in each image may be taken as the cropping size.
[0122] It should be noted that, after the above-mentioned matching of image pairs, feature points are matched for each frame of image obtained; based on the feature point matching results, the three-degree-of-freedom motion device is adjusted to adjust the camera's shooting angle through the three-degree-of-freedom motion device; after the three-degree-of-freedom motion device is adjusted, the photos taken by the camera are uploaded to the cloud server, so that the user can obtain the image of the product by adjusting the angle even during the operation, to ensure that the staff will not switch or falsify the product. This process can also be understood as, when the user washes, labels, etc. on the product, the three-degree-of-freedom motion device can be controlled to adjust the camera's shooting angle to obtain the most complete image of the product. In this way, the supervision of online products is further improved.
[0123] That is, the full-real-scene electronic shopping mall transaction terminal provided in the embodiment of the present application includes at least two stages of commodities, namely, the commodity weighing stage and the commodity processing stage. In the commodity weighing stage, the commodities are basically placed still, while in the commodity processing stage, the camera tracking angle can be adjusted through the above-mentioned three-degree-of-freedom motion device to obtain the most complete image of the commodity and track the commodity processing process.
[0124] Optionally, the motion detection unit is also used to perform the following steps, including: in response to the presence of a fourth image for feature point pairing, when the number of detected paired feature points is lower than a second preset threshold, identifying a human body in the fourth image; based on the position of the identified human body, adjusting the three-degree-of-freedom motion device to adjust the shooting angle of the camera through the three-degree-of-freedom motion device until the number of detected paired feature points in the captured image is not lower than the second preset threshold.
[0125] That is, here, the number of detected paired feature points can be used to determine whether the worker is in the process of operating the product (i.e., the product processing stage); when the number of paired feature points is lower than the second preset threshold (the second preset threshold can also be set according to actual needs), the product is considered to be blocked, and the worker is in the process of processing the product. The human body in the image can be identified by the YOLOv9 model, and the three-degree-of-freedom motion device can be adjusted according to the position of the identified human body, so as to adjust the shooting angle of the camera through the three-degree-of-freedom motion device, and then take a complete image of the product as possible.
[0126] In addition, YOLOv9 can detect human bodies in images at preset intervals instead of all image frames to reduce the processing pressure of the central processing module.
[0127] In addition, the image set in the commodity processing stage can also be extracted at preset intervals to reduce the processing pressure of the central processing module.
[0128] Optionally, the motion detection unit is also used to perform the following steps, including: identifying the position of the display panel from the first image set; adjusting the shooting angle of the camera based on the position of the display panel so that the camera is aimed at the display panel; obtaining a third image captured by the adjusted camera, and uploading the third image to the cloud server.
[0129] It should be noted that, in order to avoid not being able to clearly view the content on the display panel in the first image set, the position of the display panel can be identified from the first image set; based on the position of the display panel, the shooting angle of the camera is adjusted so that the camera is aimed at the display panel; and the third image captured by the adjusted camera is obtained. The third image allows the buyer to clearly view the weight information, unit price and price of the product, and the weight information, unit price and price of the product can be obtained by scanning the graphic code, and then the two can be compared to avoid product fraud.
[0130] Optionally, the formula for pairing feature points of each frame of image acquired after the image pair to be matched includes:
[0131] ;
[0132] in, represents the feature points on the image to be matched, Represents the feature points on any frame image after the image pair to be matched; Indicates the angle, corresponding to the rotation angle of the three-degree-of-freedom motion device on the Z axis; represents the first translation distance, corresponding to the rotation angle of the three-degree-of-freedom motion device on the X axis; Represents the second translation distance, corresponding to the rotation angle of the three-degree-of-freedom motion device on the Y axis.
[0133] Optionally, the weighing module 10 further specifically includes:
[0134] A weighing platform 101 is used to weigh the goods;
[0135] The input panel 102 is used to receive the commodity code input by the staff; wherein the commodity code corresponds to the unit price of the commodity;
[0136] The processor is respectively connected to the label printing module, the weighing platform and the input panel, and is used to obtain the weight information detected by the weighing platform and determine the price of the product according to the product code input by the staff.
[0137] Optionally, the input panel 102 is also used to receive an account ID input by a staff member; wherein the graphic code also includes the account ID of the staff member.
[0138] It should be noted that the staff member’s account ID is also set in the graphic code, which can be used for tracing and accountability.
[0139] The technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.
[0140] An embodiment of the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in the above-mentioned method embodiments can be implemented.
[0141] An embodiment of the present application provides a computer program product. When the computer program product runs on a mobile terminal, the mobile terminal can implement the steps in the above-mentioned method embodiments when executing the computer program product.
[0142] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, which can be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium can at least include: any entity or device that can carry the computer program code to the camera / electronic device, recording medium, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, RandomAccess Memory), electric carrier signal, telecommunication signal and software distribution medium. For example, a USB flash drive, a mobile hard disk, a magnetic disk or an optical disk. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electric carrier signals and telecommunication signals.
[0143] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.
[0144] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.
[0145] In the embodiments provided in the present application, it should be understood that the disclosed devices / network equipment and methods can be implemented in other ways. For example, the device / network equipment embodiments described above are merely schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0146] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0147] The embodiments described above are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.
Claims
1. A full-real-scene electronic shopping mall transaction terminal, characterized in that: include: A weighing module is used to weigh the commodity and determine the price of the commodity based on the unit price of the commodity; A display panel connected to the weighing module, used to display the weight information, unit price and price of the commodity; A label printing module, connected to the weighing module, for generating a graphic code; wherein the weight information, unit price and price of the commodity are obtained by scanning the graphic code; An image acquisition module, used to acquire an image set corresponding to the product; a central processing module connected to the image acquisition module, and configured to extract a first image set, a second image set, and a third image based on the image set acquired by the image acquisition module; wherein the first image set is an image set of the commodity in a commodity weighing stage, the second image set is an image set of the commodity in a commodity processing stage, and the third image is an image of the commodity corresponding to the display panel in the commodity weighing stage; The central processing module is further used to upload the first image set, the second image set and the third image to the cloud server, so that the cloud server binds the first image set, the second image set and the third image to the buyer account corresponding to the product; Wherein, the image acquisition module includes a zoom lens camera; the central processing module is connected to the zoom lens camera; the central processing module also includes an image analysis unit, and the image analysis unit is used to perform the following steps, including: step 1, obtaining the image set collected by the zoom lens camera and determining the target image; wherein, the target image is an image of the commodity when it is placed on the weighing module for weighing; step 2, performing a quality score on the target image, and when the quality score of the target image is lower than a first preset threshold, adjusting the focal length of the zoom lens camera; wherein, the quality score is used to determine whether the target image is clear; after adjusting the focal length of the zoom lens camera, repeating steps 1 and 2 until the quality score of the latest determined target image is not less than the first preset threshold, extracting the first image set and the third image; The quality scoring of the target image includes: converting the brightness value of the target image into logarithmic brightness, performing local nonlinear operation based on the logarithmic brightness of the target image to obtain the image intensity of the target image; performing wavelet transformation on the image intensity of the target image to obtain four wavelet parameters; calculating four features corresponding to the target image based on the four wavelet parameters; and fitting based on the four features corresponding to the target image using a regression algorithm to generate a quality score of the target image; The formula for obtaining the image intensity of the target image is: ; in, The coordinates of the target image are represented by Image intensity; The coordinates of the target image are represented by The logarithmic brightness of ; and Respectively represent the height and width of the target image; represents a constant; and All represent local operation functions; ; ; in, , which is a Gaussian weighting function; and Represents the offset in the horizontal and vertical directions, that is, the farther the pixel is from the center, the smaller the corresponding weight; , indicating the local operation range; and Indicates an intermediate quantity; The formula for performing wavelet transformation on the image intensity of the target image includes: ; in, Represents the logarithmic brightness of the target image Perform wavelet transformation; represents four wavelet parameters; The calculation formulas for the four features corresponding to the target image are: ; ; ; ; in, Represents the four features corresponding to the target image.
2. The full-real-scene electronic shopping mall transaction terminal according to claim 1, characterized in that: The image acquisition module includes a camera and a three-degree-of-freedom motion device; the central processing module is connected to the three-degree-of-freedom motion device; The central processing module further includes a motion detection unit; the motion detection unit is used to perform the following steps, including: Acquire the image set collected by the camera and determine the target image; wherein the target image is the image of the commodity when it is placed on the weighing module for weighing; Determine the image to be matched based on the reference image set; wherein the reference image set is N consecutive target images; and the image to be matched is a cropped image; Performing feature point pairing on each frame of image acquired after the pair of images to be matched; Based on the feature point pairing result, adjusting the three-degree-of-freedom motion device to adjust the shooting angle of the camera through the three-degree-of-freedom motion device; The second image set is extracted from the photo set taken by the camera after adjustment based on the three-degree-of-freedom motion device.
3. The full-real-scene electronic shopping mall transaction terminal according to claim 2, characterized in that: The motion detection unit is further configured to perform the following steps, including: In response to the presence of a fourth image for feature point pairing, the number of detected paired feature points is lower than a second preset threshold, identifying a human body in the fourth image; Based on the identified position of the human body, the three-degree-of-freedom motion device is adjusted to adjust the shooting angle of the camera through the three-degree-of-freedom motion device until the number of paired feature points detected in the captured image is not less than the second preset threshold.
4. The full-real-scene electronic shopping mall transaction terminal according to claim 2, characterized in that: The motion detection unit is further configured to perform the following steps, including: identifying a position of the display panel from the first image set; Based on the position of the display panel, adjusting the shooting angle of the camera so that the camera is aligned with the display panel; The third image captured by the adjusted camera is obtained, and the third image is uploaded to the cloud server.
5. The full-real-scene electronic shopping mall transaction terminal according to claim 2, characterized in that: The formula for pairing feature points of each frame of image acquired after the pair of images to be matched includes: ; in, represents the feature points on the image to be matched, Represents a feature point on any frame image after the image pair to be matched; represents an angle, corresponding to the rotation angle of the three-degree-of-freedom motion device on the Z axis; represents a first translation distance, corresponding to the rotation angle of the three-degree-of-freedom motion device on the X-axis; represents the second translation distance, corresponding to the rotation angle of the three-degree-of-freedom motion device on the Y axis.
6. The full-real-scene electronic shopping mall transaction terminal according to claim 1, characterized in that: The weighing module further specifically comprises: Weighing table, used to weigh the goods; An input panel, used to receive a product code input by a staff member; wherein the product code corresponds to the unit price of the product; The processor is respectively connected to the label printing module, the weighing platform and the input panel, and is used to obtain the weight information detected by the weighing platform and determine the price of the product according to the product code input by the staff.
7. The full-real-scene electronic shopping mall transaction terminal according to claim 6, characterized in that: The input panel is also used to receive the account ID input by the staff; Wherein, the graphic code also includes the account ID of the staff member.
