Methods, equipment, and computer storage media for processing product information
By acquiring product image information and applying information processing strategies, the problem of blind and elderly people having difficulty reading text when shopping in supermarkets has been solved, achieving the effect of quickly obtaining product information.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-08-03
- Publication Date
- 2026-04-03
AI Technical Summary
Blind and elderly people often have difficulty reading the text on product packaging when shopping in supermarkets, leading to a poor shopping experience.
By acquiring product image information and processing it using preset working modes and information processing strategies (such as information broadcasting and information magnification), the product information is ensured to allow users to quickly understand the product information.
It enables blind and elderly people to quickly and directly obtain product information, improving the shopping experience and the practicality of the method.
Smart Images

Figure CN117474615B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of data processing technology, and in particular to a method, apparatus and computer storage medium for processing commodity information. Background Technology
[0002] Currently, there are approximately 17 million visually impaired people and a large number of people with cognitive impairments in China. In this era of rapid technological advancement, they should also enjoy the conveniences brought about by technological progress on an equal footing.
[0003] In online applications, internet products can assist visually impaired and / or elderly individuals. However, this assistance shouldn't be limited to online scenarios; technology should also be used to provide these users with convenient offline experiences. For example, when visually impaired and / or elderly people shop in supermarkets, the small print on product packaging can be difficult to read and understand, making it hard for them to read key information such as ingredient lists, expiration dates, and production dates. This can negatively impact their shopping experience. Summary of the Invention
[0004] This application provides a method, device, and computer storage medium for processing product information, which can help blind people and / or the elderly obtain product information and help ensure the shopping experience of blind people and / or the elderly.
[0005] In a first aspect, embodiments of this application provide a method for processing product information, applied to a processing device, the method comprising:
[0006] When the processing device is in a preset working mode, it acquires image information of the product to be identified in response to the scanning behavior of the product to be identified;
[0007] Based on the image information, determine the first product information corresponding to the product to be identified;
[0008] Determine an information processing strategy corresponding to the preset working mode, wherein the information processing strategy includes at least one of the following: information broadcasting, information amplification;
[0009] Based on the information processing strategy, the first product information is processed accordingly.
[0010] Secondly, embodiments of this application provide a product information processing apparatus, the apparatus comprising:
[0011] The first acquisition module is used to acquire image information of the product to be identified in response to the scanning behavior of the product to be identified when the processing device is in a preset working mode;
[0012] The first determining module is used to determine, based on the image information, first product information corresponding to the product to be identified;
[0013] The first determining module is used to determine an information processing strategy corresponding to the preset working mode, wherein the information processing strategy includes at least one of the following: information broadcasting, information amplification;
[0014] The first processing module is used to perform corresponding processing operations on the first product information based on the information processing strategy.
[0015] Thirdly, embodiments of this application provide an electronic device, including: a memory and a processor; wherein the memory is used to store one or more computer instructions, wherein when the one or more computer instructions are executed by the processor, the product information processing method described in the first aspect is implemented.
[0016] Fourthly, embodiments of the present invention provide a computer storage medium for storing a computer program, which, when executed by a computer, implements the product information processing method described in the first aspect above.
[0017] Fifthly, embodiments of the present invention provide a computer program product, comprising: a computer program, which, when executed by a processor of an electronic device, causes the processor to execute the product information processing method described in the first aspect above.
[0018] Sixthly, embodiments of this application provide an information processing method, including:
[0019] In response to the identification operation of the object to be identified, the associated information of the object to be identified is determined;
[0020] Determine the current information processing strategy for analyzing and processing the associated information, wherein the information processing strategy includes at least one of the following: information broadcasting, information amplification;
[0021] The associated information is processed based on the aforementioned information processing strategy so that users can access the associated information.
[0022] Seventhly, embodiments of this application provide an information processing apparatus, including:
[0023] The second determining module is used to determine the association information of the object to be identified in response to the identification operation of the object to be identified;
[0024] The second determining module is used to determine the current information processing strategy for analyzing and processing the associated information, wherein the information processing strategy includes at least one of the following: information broadcasting, information amplification;
[0025] The second processing module is used to process the associated information based on the information processing strategy so that the user can obtain the associated information.
[0026] Eighthly, embodiments of this application provide an electronic device, including: a memory and a processor; wherein the memory is used to store one or more computer instructions, wherein when the one or more computer instructions are executed by the processor, the product information processing method described in the sixth aspect above is implemented.
[0027] Ninthly, embodiments of the present invention provide a computer storage medium for storing a computer program that, when executed by a computer, implements the product information processing method described in the sixth aspect above.
[0028] In a tenth aspect, embodiments of the present invention provide a computer program product, comprising: a computer program that, when executed by a processor of an electronic device, causes the processor to execute the product information processing method described in the sixth aspect above.
[0029] The product information processing method, device, and computer storage medium provided in this application embodiment, in response to the scanning behavior of the product to be identified, acquire image information of the product to be identified; determine first product information corresponding to the product to be identified based on the image information; then determine an information processing strategy corresponding to a preset working mode; and perform corresponding processing operations on the first product information based on the information processing strategy. This effectively realizes the identification and processing of product information under different preset working modes, so that any type of user, especially blind or elderly people, can quickly and directly obtain and understand product information. This not only helps to ensure the user's shopping experience, but also effectively improves the practicality of the method, which is conducive to market promotion and application. Attached Figure Description
[0030] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0031] Figure 1 A schematic diagram illustrating the principle of a product information processing method provided in this application embodiment;
[0032] Figure 2 A flowchart illustrating a method for processing product information provided in an embodiment of this application;
[0033] Figure 3A flowchart illustrating another method for processing product information provided in this application embodiment;
[0034] Figure 4 A flowchart illustrating the corresponding processing operations on the first product information based on the information processing strategy provided in this application embodiment. Figure 1 ;
[0035] Figure 5 A flowchart illustrating the corresponding processing operations on the first product information based on the information processing strategy provided in this application embodiment. Figure 2 ;
[0036] Figure 6 A flowchart illustrating the corresponding processing operations on the first product information based on the information processing strategy provided in this application embodiment. Figure 3 ;
[0037] Figure 7 A schematic diagram illustrating the principle of a product information processing method provided in an application embodiment of this application;
[0038] Figure 8 A flowchart illustrating an information processing method provided in an embodiment of this application;
[0039] Figure 9 This is a schematic diagram of the structure of a product information processing device provided in an embodiment of this application;
[0040] Figure 10 for Figure 9 A schematic diagram of the electronic device corresponding to the product information processing device shown;
[0041] Figure 11 This is a schematic diagram of the structure of an information processing device provided in an embodiment of this application;
[0042] Figure 12 for Figure 11 The diagram shows the structure of the electronic device corresponding to the information processing device shown. Detailed Implementation
[0043] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.
[0044] The terminology used in the embodiments of this application is for the purpose of describing particular embodiments only and is not intended to limit the application. The singular forms “a,” “said,” and “the” used in the embodiments of this application and the appended claims are also intended to include the plural forms, unless the context clearly indicates otherwise. “Multiple” generally includes at least two, but does not exclude the inclusion of at least one.
[0045] It should be understood that the term "and / or" used in this article is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Additionally, the character " / " in this article generally indicates that the preceding and following related objects have an "or" relationship.
[0046] Depending on the context, the words “if” or “suppose” as used here can be interpreted as “when” or “in response to determination” or “in response to detection.” Similarly, depending on the context, the phrases “if determination” or “if detection (of the stated condition or event)” can be interpreted as “when determination” or “in response to determination” or “when detection (of the stated condition or event)” or “in response to detection (of the stated condition or event).”
[0047] It should also be noted that the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a product or system comprising a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a product or system. Without further limitation, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the product or system that includes said element.
[0048] Furthermore, the timing of the steps in the following method embodiments is merely an example and not a strict limitation.
[0049] Terminology definition:
[0050] Information accessibility refers to using information technology to bridge differences in physical function, environment, etc., so that anyone (whether able-bodied or disabled, young or old) can access, interact with, and use information equally, conveniently, and safely.
[0051] Image understanding: including but not limited to image content understanding, OCR text extraction, and product barcode information matching, which are comprehensive information processing methods based on images.
[0052] Optical character recognition (OCR) is the process by which electronic devices (such as scanners or digital cameras) examine characters printed on paper and then translate those shapes into computer text using character recognition methods.
[0053] Text-to-Speech (TTS) is a technology that converts text into speech. It works by using computer programs to convert text information into corresponding sound signals.
[0054] Barcode: A barcode is a graphic identifier that uses multiple black bars and spaces of varying widths arranged according to certain encoding rules to express a set of information.
[0055] To facilitate understanding of the specific implementation and effects of the technical solution provided in this embodiment, the relevant technologies are described below:
[0056] According to the latest census data, my country's population aged 60 and above has exceeded 260 million, making population aging not just a trend, but a reality. In addition, China has 17 million visually impaired people and a large number of people with cognitive impairments. In this technological age, they should also equally enjoy the conveniences brought by technological progress.
[0057] In 2020, the Ministry of Industry and Information Technology issued the "Special Action Plan for Age-Friendly and Barrier-Free Modification of Internet Applications," aiming to provide a better internet application experience for the elderly. Currently, in online application scenarios, internet products can assist visually impaired and / or elderly people with disabilities. However, the scenarios for assisting visually impaired and / or elderly people with disabilities should not be limited to online application scenarios. Technological means should also be used to provide these users with convenient offline life experiences.
[0058] For example, when blind people and / or elderly people shop in supermarkets, the text on the product packaging is too small, making it difficult for them to read and understand key information such as the ingredient list, shelf life, and production date. This can cause some inconvenience for blind people and / or elderly people, reducing their shopping experience.
[0059] To address the aforementioned technical problems, this embodiment provides a method, apparatus, and computer storage medium for processing product information, wherein, with reference to the appendix... Figure 1 As shown, the main body executing the product information processing method is the product information processing device. This product information processing device can be any computing device with a certain product information processing capability. Specifically, the product information processing device can be a mobile phone, a smart wearable device, a tablet computer, a set application, etc.
[0060] Furthermore, the basic structure of a product information processing device may include at least one processor. The number of processors depends on the configuration and type of the product information processing device. The product information processing device may also include memory, which can be volatile, such as Random Access Memory (RAM), or non-volatile, such as Read-Only Memory (ROM), flash memory, etc., or both types may be included simultaneously. The memory typically stores an operating system (OS), one or more application programs, and may also store program data. In addition to the processing unit and memory, the product information processing device also includes some basic configurations, such as a network interface card (NIC) chip, an I / O bus, a display component, and some peripheral devices. Optionally, some peripheral devices may include, for example, a keyboard, a mouse, a stylus, a printer, etc. Other peripheral devices are well known in the art and will not be described in detail here.
[0061] In the embodiments of this application, the product information processing device may have different preset working modes. For example, when a first type of user with vision greater than or equal to a preset threshold uses the product information processing device, the product information processing device may work in the first mode; when a second type of user with vision less than a preset threshold (which may be 0.1, 0.05, or 0.15, etc.) uses the product information processing device, the product processing device may work in the second mode.
[0062] When the product information processing device is in different preset working modes, it may have different information processing strategies. For example, when the product information processing device is working in the first mode, it may have a first information processing strategy, which may include at least one of the following: information broadcasting and information amplification. When the product information processing device is working in the second mode, it may have a second information processing strategy, which may include information broadcasting.
[0063] Specifically, regardless of the preset operating mode of the product information processing device, when there is a scanning action of a product to be identified, image information of the product to be identified can be obtained based on the scanning action. The number of images to be identified can be one or more, therefore, the number of products to be identified included in the obtained image information can also be one or more. After obtaining the image information, first product information corresponding to the product to be identified can be determined based on the image information. This first product information can include at least one of the following: product name, product category, product freshness, product brand, etc.
[0064] Since different preset working modes can correspond to different information processing strategies, after obtaining the first product information, the information processing strategy corresponding to the preset working mode can be determined. Then, the information processing strategy can be used to perform corresponding processing operations on the first product information. For example, the first product information can be broadcast, and / or the first product information can be magnified, etc., so that any type of user using the product information processing device can accurately understand the relevant information of the product.
[0065] The technical solution provided in this embodiment acquires image information of the product to be identified; determines the first product information corresponding to the product to be identified based on the image information; then determines the information processing strategy corresponding to the preset working mode; and performs corresponding processing operations on the first product information based on the information processing strategy. This effectively realizes the identification and processing of product information under different preset working modes, so that any type of user, especially blind or elderly people, can quickly and directly obtain and understand product information. This not only helps to ensure the user's shopping experience.
[0066] The following detailed description of some embodiments of the present invention is provided in conjunction with the accompanying drawings. Where there is no conflict between the embodiments, the following embodiments and features can be combined with each other. Furthermore, the timing of the steps in the following method embodiments is merely an example and not a strict limitation.
[0067] Figure 2 A flowchart illustrating a product information processing method provided in this application embodiment; see attached document. Figure 2 As shown, this embodiment provides a method for processing product information. The executing entity of this method can be a product information processing device, meaning the method can be applied to such a device. The product information processing device can be implemented as software or a combination of software and hardware. Specifically, when the device is implemented as hardware, it can be various electronic devices with product information processing capabilities, including but not limited to tablet computers, personal computers (PCs), servers, etc. When the device is implemented as software, it can be installed in the aforementioned electronic devices. Specifically, based on the aforementioned product information processing device, the product information processing method in this embodiment can include the following steps:
[0068] Step S201: When the processing device is in a preset working mode, it acquires image information of the product to be identified in response to the scanning behavior of the product to be identified.
[0069] Step S202: Based on the image information, determine the first product information corresponding to the product to be identified.
[0070] Step S203: Determine the information processing strategy corresponding to the preset working mode. The information processing strategy includes at least one of the following: information broadcasting, information amplification.
[0071] Step S204: Perform corresponding processing operations on the first product information based on the information processing strategy.
[0072] The following is a detailed explanation of each of the above steps:
[0073] Step S201: When the processing device is in a preset working mode, it acquires image information of the product to be identified in response to the scanning behavior of the product to be identified.
[0074] The product information processing device can have different preset working modes. For example, the product information processing device can work in a working mode suitable for blind people, or in a working mode suitable for the elderly. Alternatively, when a first type of user with vision greater than or equal to a preset threshold uses the product information processing device, the product information processing device can work in the first mode; when a second type of user with vision less than a preset threshold uses the product information processing device, the product information processing device can work in the second mode.
[0075] Regardless of the preset working mode of the product information processing device, product information processing operations can be performed. Specifically, when a user has offline identification or processing needs for a product to be identified, the product information processing device can scan the product. At this time, the product information processing device is equipped with a detection module for scanning or capturing images. The detection module can then scan or capture images of the product. In response to the scanning or capturing of the product, the product information processing device can obtain image information of the product. The number of products to be identified can be one or more, meaning that the obtained image information can include one or more products to be identified.
[0076] Furthermore, since goods in shopping malls or supermarkets are often displayed with their front packaging facing outwards, the obtained image information can be a front view or a frontal view of the product to be identified. It is understood that the obtained image information can be not only a frontal view of the product to be identified, but also a rear view, side view, top view, etc., and those skilled in the art can perform appropriate scanning operations based on the user's specific scanning behavior of the product to be identified.
[0077] Step S202: Based on the image information, determine the first product information corresponding to the product to be identified.
[0078] Since image information can include some information about the product to be identified, such as product name and product category, in order to enable users to quickly and directly understand the product information of the product to be identified, the image information can be analyzed and processed after it is acquired, so as to determine the first product information corresponding to the product to be identified.
[0079] In some instances, image processing operations can be implemented using a pre-trained machine learning model. In this case, determining the first product information corresponding to the product to be identified based on the image information may include: obtaining a pre-trained machine learning model, inputting the image information into the machine learning model, and obtaining the first product information output by the machine learning model. The first product information may include at least one of the following: product name, product category, product freshness, product brand, etc.
[0080] In other instances, image processing operations can be performed not only through pre-trained machine learning models, but also based on image recognition algorithms and optical character recognition algorithms. In this case, determining the first product information corresponding to the product to be identified based on image information may include: analyzing and processing the image information using image recognition algorithms and optical character recognition algorithms to obtain the first product information corresponding to the product to be identified.
[0081] In some other instances, when the image information includes multiple products and the obtained first product information corresponds to one product, determining the first product information corresponding to the product to be identified based on the image information may include: determining multiple products to be identified scanned by the processing device based on the image information; identifying a target product among the multiple products to be identified; and determining the first product information of the target product.
[0082] Specifically, after acquiring image information, the image information can be processed for recognition to identify multiple products scanned by the processing device. These multiple products may belong to the same or different product categories. To ensure stable processing of the product information, a target product can be identified from among the multiple products. In some instances, identifying a target product may include: acquiring a user's selection action for any of the products; and identifying a target product based on the selection action. Alternatively, in other instances, identifying a target product may include: acquiring the proportion information of each product in the image; and identifying the product with the largest proportion as the target product. In some special instances, when two or more products have the largest and identical proportions, any product with the largest proportion can be identified as the target product.
[0083] In other instances, to ensure the quality and efficiency of image information processing, when the image information includes multiple products and the number of first product information items obtained is also multiple, two target products can be selected from the multiple products for analysis and processing. In this case, determining the first product information corresponding to the product to be identified based on the image information may include: determining the multiple products to be identified scanned by the processing device based on the image information; determining two target identification products among the multiple products to be identified; and then determining the first product information corresponding to each of the two target identification products, thereby effectively ensuring the accuracy and reliability of determining the first product information.
[0084] Step S203: Determine the information processing strategy corresponding to the preset working mode. The information processing strategy includes at least one of the following: information broadcasting, information amplification.
[0085] Since different preset working modes can correspond to different information processing strategies for analyzing and processing the first product information, in order to ensure the stability and reliability of product information processing operations, after obtaining the graphic information of the product to be identified, the information processing strategy corresponding to the preset working mode can be determined. In some instances, determining the information processing strategy corresponding to the preset working mode may include: obtaining the mapping relationship between the pre-configured preset working mode and the information processing strategy, and the information processing strategy corresponding to the preset working mode can be determined based on the mapping relationship.
[0086] For example, since users in the first mode may be able to see some information, but may not be able to see it clearly, when the product information processing device is operating in the first mode, a first information processing strategy can be determined based on the first mode. The first information processing strategy may include at least one of the following: information broadcasting, information amplification; since users in the second mode can hardly see the information or can not see the information at all, when the product information processing device is operating in the second mode, a second information processing strategy can be determined based on the second mode. The second information processing strategy may include information broadcasting.
[0087] It should be noted that the execution order between steps S203 and S202 in this embodiment is not limited to the order specified by the above sequence numbers. Those skilled in the art can flexibly adjust the execution order of steps S203 and S202 according to specific application scenarios or application requirements. For example, step S203 can be executed before step S202, or steps S203 and S202 can be executed simultaneously.
[0088] Step S204: Perform corresponding processing operations on the first product information based on the information processing strategy.
[0089] After acquiring the first product information and the information processing strategy, in order to enable users to quickly and directly understand the product information, corresponding processing operations can be performed on the first product information based on the information processing strategy. In some instances, when the user is an elderly person or someone with poor eyesight, the product information processing device operates in a first mode, and can then perform information broadcasting and / or information amplification operations on the first product information based on the first information processing strategy. Specifically, when the user pre-configures the product processing strategy as information broadcasting, the first product information can be broadcast; when the user pre-configures the product processing strategy as information amplification, the first product information can be amplified. Alternatively, when the product information processing device operates in the first mode, strategy selection information can be generated. In response to the execution of the strategy selection information, at least one processing strategy can be selected to process the first product information. For example, when the user performs a selection operation on control A, the product processing strategy can be determined to be information amplification; when the user performs a selection operation on control B, the product processing strategy can be determined to be information broadcasting; when the user performs a selection operation on control C, the product processing strategy can be determined to include information amplification and information broadcasting.
[0090] Similarly, when the user is blind, the product information processing device operates in the second mode, and can then broadcast the first product information based on the second information processing strategy, so that any type of user using the product information processing device can quickly and accurately learn about the relevant product information.
[0091] In some other instances, the method in this embodiment can not only identify and process product information, but also simultaneously perform product recommendation operations. In this case, processing the first product information based on the information processing strategy may include: obtaining the historical purchase information of the product to be identified; determining the recommendation level of the product to be identified based on the first product information and the historical purchase information; and performing corresponding processing operations on the first product information and the recommendation level based on the information processing strategy.
[0092] After obtaining the first product information, the historical purchase information of the product to be identified can be obtained. Specifically, obtaining the historical purchase information of the product to be identified may include the following steps: determining the product name and brand of the product to be identified through the first product information, and then obtaining the historical purchase information of the product to be identified based on the product name and brand. The historical purchase information may include: historical purchase volume within a preset historical time period, historical purchase reviews, product reviews within a preset historical time period, and product-related promotional information (including: positive promotional information, negative news, etc.).
[0093] Since historical purchase information can indirectly reflect the quality or reputation of a product, after obtaining the first product information and historical purchase information, the first product information and historical purchase information can be analyzed and processed to determine the recommendation level of the product to be identified. In some instances, the recommendation level can be expressed as any of the following: recommendation value (including: 80 points, 85 points, 90 points, 95 points, etc.), recommendation level (including: first recommendation level, second recommendation level, third recommendation level, etc.), recommendation text (including: recommended to buy, not recommended to buy, etc.). The specific method of determining the recommendation level is similar to the implementation method of determining the first product information in the above embodiment. For details, please refer to the above description and will not be repeated here.
[0094] After obtaining the initial product information and recommendation rating, corresponding processing operations can be performed on the initial product information and recommendation rating based on the information processing strategy. Specifically, when the user is an elderly person or someone with poor eyesight, the product information processing device operates in the first mode, and can then simultaneously broadcast and / or amplify the initial product information and recommendation rating based on the first information processing strategy. Alternatively, when the user is blind, the product information processing device operates in the second mode, and can then simultaneously broadcast the initial product information and recommendation rating based on the second information processing strategy. This allows any type of user using the product information processing device to accurately understand the relevant product information and the product recommendation information, which helps improve the user's shopping experience.
[0095] The product information processing method provided in this embodiment responds to the scanning behavior of the product to be identified by acquiring image information of the product to be identified; determining first product information corresponding to the product to be identified based on the image information; then determining an information processing strategy corresponding to a preset working mode; and performing corresponding processing operations on the first product information based on the information processing strategy. This effectively realizes the identification and processing of product information under different preset working modes, so that any type of user, especially blind or elderly people, can quickly and directly obtain and understand product information. This not only helps to ensure the user's shopping experience, but also effectively improves the practicality of the method, which is conducive to market promotion and application.
[0096] Figure 3 A flowchart illustrating another product information processing method provided in this application embodiment; based on the above embodiment, refer to the appendix. Figure 3 As shown, this embodiment can realize the recognition operation of the preset working mode of the product information processing device. Specifically, before acquiring the image information of the product to be recognized, the method in this embodiment may include:
[0097] Step S301: Detect whether the processing device is associated with preset software used to implement reading and listening operations.
[0098] Step S302: When the processing device is not associated with preset software for implementing reading and listening operations, it is determined that the processing device is in a working mode suitable for the first type of user.
[0099] Step S303: When the processing device is associated with preset software for implementing reading and listening operations, it is determined that the processing device is in a working mode suitable for the second type of user.
[0100] To enable the recognition of preset working modes, users of the product information processing device can be divided into two categories: Category 1 users and Category 2 users. Category 1 users have visual acuity greater than or equal to a preset threshold, while Category 2 users have visual acuity less than the preset threshold. In practical applications, for Category 2 users, since their visual acuity is less than the preset threshold, the product information processing device is often associated with preset software for reading and listening operations to ensure stable processing of product information. This allows Category 2 users to read and listen to relevant text through the preset software. When Category 1 users use the product information processing device, the device is usually not associated with preset software for reading and listening operations.
[0101] As can be seen from the above, when different users use the product information processing device, the product information processing device will have different associated software. Therefore, the preset working mode can be identified by detecting whether the processing device is associated with the preset software used to realize the reading and listening operation. Specifically, when the product information processing device is running, the software information associated with the product information processing device can be obtained. If the software information includes the preset software used to realize the reading and listening operation, it can be determined that the processing device has been associated with the preset software used to realize the reading and listening operation; if the software information does not include the preset software used to realize the reading and listening operation, it can be determined that the processing device has not been associated with the preset software used to realize the reading and listening operation.
[0102] When the processing device is not associated with preset software for implementing reading and listening operations, it indicates that the user of the processing device is a first-type user, such as an elderly person or a person with visual impairment. Therefore, the preset working mode can be determined to be a working mode suitable for the first-type user. When the processing device is associated with preset software for implementing reading and listening operations, it indicates that the user of the processing device is a second-type user, such as a blind person. Therefore, the preset working mode can be determined to be a working mode suitable for the second-type user.
[0103] Correspondingly, since different preset working modes correspond to different information processing strategies, after obtaining the preset working mode, determining the information processing strategy corresponding to the preset working mode may include: when the preset working mode is a working mode suitable for the first type of user, the information processing strategy includes at least one of the following: information broadcasting, information amplification; when the preset working mode is a working mode suitable for the second type of user, the information processing strategy includes information broadcasting; thereby effectively realizing that the commodity processing device can perform different information processing operations based on different preset working modes, ensuring the stability and reliability of commodity information processing.
[0104] In this embodiment, by detecting whether the processing device is associated with preset software for implementing reading and listening operations, if the processing device is not associated with preset software for implementing reading and listening operations, it is determined that the processing device is in a working mode suitable for the first type of user; if the processing device is associated with preset software for implementing reading and listening operations, it is determined that the processing device is in a working mode suitable for the second type of user. This effectively realizes the identification operation of preset working modes, and then the corresponding information processing strategy can be applied based on the identified preset working mode, so as to perform stable processing operations on the first commodity information based on the determined information processing strategy, further improving the practicality of the method.
[0105] Figure 4 A flowchart illustrating the corresponding processing operations on the first commodity information based on the information processing strategy provided in this application embodiment. Figure 1Based on the above embodiments, refer to the appendix. Figure 4 As shown, this embodiment provides an implementation method for performing corresponding processing operations on the first product information. Specifically, the corresponding processing operations on the first product information based on the information processing strategy in this embodiment may include:
[0106] Step S401: Identify whether the image information includes a product barcode.
[0107] Step S402: If the image information does not include a product barcode, then generate a prompt message to indicate that the image information does not include a product barcode.
[0108] Step S403: Perform corresponding processing operations on the prompt information and the first product information based on the information processing strategy.
[0109] Since the products to be identified are often those that users may need to buy or are interested in, and these products are often equipped with barcodes, such as QR codes or barcodes, the barcodes can contain detailed information about the products to be identified, such as: production date, ingredients, manufacturer, price, discounts, dimensions, specifications, weight, and shelf life.
[0110] Since image information may include product barcodes, and product barcodes can contain more detailed information about the product to be identified, in order to ensure and improve the user's shopping experience, when obtaining image information of the product to be identified, it is possible to identify whether the image information includes a product barcode. Specifically, after obtaining the image information, it can be analyzed and processed to identify whether the image information includes a product barcode. In some instances, identifying whether the image information includes a product barcode may include: obtaining a pre-trained machine learning model, inputting the image information into the machine learning model, and obtaining the recognition result of whether the image information includes a product barcode.
[0111] In other instances, barcode recognition can be achieved not only through pre-trained machine learning models but also through preset optical character recognition algorithms. In this case, determining whether an image contains a barcode can involve: using a preset optical character recognition algorithm to recognize the image information, obtaining the object to be recognized, and then analyzing and matching the object with a preset standard barcode. If an object matches the standard barcode, the image is determined to contain a barcode; otherwise, it is determined that the image does not contain a barcode.
[0112] Specifically, when the image information does not include a product barcode, the user cannot obtain detailed information about the product to be identified. Therefore, in order to enable the user to understand the current processing status of the product information analysis, a prompt message can be generated to indicate that the image information does not include a product barcode. After obtaining the prompt message and the first product information, corresponding processing operations can be performed on the prompt message and the first product information based on the information processing strategy. For example, the prompt message and the first product information can be synchronously broadcast, magnified, etc., based on the information processing strategy.
[0113] It should be noted that, regarding the prompt information, the prompt information can not only be used to indicate that the image information does not include the product barcode, but also to prompt the user whether the image shooting operation needs to be repeated. In this case, after performing the corresponding processing operation on the prompt information, the method in this embodiment may further include: generating a rescan request based on the prompt information; in response to the user's input permission operation, new image information of the product to be identified can be obtained based on the rescan request. The new image information is different from the previous image information. Then, the new image information can be analyzed and identified based on the processing steps of the above embodiment to obtain other product information of the product to be identified that is different from the first product information.
[0114] In some other instances, the method in this embodiment may also include:
[0115] Step S404: When the image information includes a product barcode, the second product information of the product to be identified is obtained based on the product barcode.
[0116] Step S405: Perform corresponding processing operations on the first product information and the second product information based on the information processing strategy.
[0117] When an image contains a product barcode, since the barcode contains detailed information about the product to be identified, the barcode can be analyzed to provide users with this information. This analysis yields second product information, which differs from the first product information. The first product information can include information such as the product name, brand, and category, obtained through image analysis. The second product information can include information such as the manufacturer, ingredients, production date, and shelf life, obtained through barcode analysis.
[0118] After obtaining the second and first product information, corresponding processing operations can be performed on the second and first product information based on the information processing strategy. For example, the second and first product information can be synchronously broadcast or amplified based on the information processing strategy, thereby effectively ensuring detailed analysis of the product information.
[0119] In this embodiment, by identifying whether the image information includes a product barcode, if the image information does not include a product barcode, a prompt message is generated to indicate that the image information does not include a product barcode. Then, based on the information processing strategy, corresponding processing operations are performed on the prompt message and the first product information. If the image information includes a product barcode, the second product information of the product to be identified is obtained based on the product barcode. Then, based on the information processing strategy, corresponding processing operations are performed on the first product information and the second product information. This effectively realizes that different product information processing operations can be performed based on different application scenarios. This not only ensures that users can obtain as much product information as possible, allowing users to obtain more comprehensive and direct information about the product to be identified, but also ensures the stability and reliability of product information processing, further improving the practicality of the method.
[0120] Figure 5 A flowchart illustrating the corresponding processing operations on the first commodity information based on the information processing strategy provided in this application embodiment. Figure 2 Based on the above embodiments, refer to the appendix. Figure 5 As shown, when the image information includes two or more products to be identified, the method in this embodiment can also perform product comparison operations and synchronously process the first product information and comparison information corresponding to each of the two or more products to be identified. At this time, the corresponding processing operations on the first product information based on the information processing strategy may include:
[0121] Step S501: Identify the first product and the second product included in the products to be identified, wherein the first product and the second product are different, and the product category of the first product is the same as that of the second product.
[0122] Step S502: Based on the first product information corresponding to the first product and the second product respectively, generate comparison information between the first product and the second product.
[0123] Step S503: Perform corresponding processing operations on the first product information and the comparison information based on the information processing strategy.
[0124] Specifically, when a user scans a product to be identified offline, the number of products scanned can be one or more. Specifically, when the product information processing device performs a close-range (e.g., a distance of less than or equal to 15cm) scan on a single product to be identified, the number of products included in the image information can be one. When the product information processing device performs a medium-range (e.g., a distance of greater than 15cm and less than or equal to 50cm) scan on some products to be identified, the number of products included in the image information can be multiple.
[0125] When there is only one product to be identified, the corresponding processing operation can be performed according to the product information processing strategy in the above embodiment. When there are multiple products to be identified, that is, when the image information includes multiple products, the first product and the second product included in the product to be identified can be identified based on the image information. It should be noted that in order to realize the product comparison operation and ensure the effectiveness of the product comparison, it is not necessary to perform the product comparison operation when the image information includes multiple products of any type. The product comparison operation will only be performed when the image information includes different products of the same type. At this time, for the first product and the second product obtained by identification, the following conditions must be met: the first product and the second product are different, and the product category of the first product is the same as that of the second product.
[0126] For example, when a user scans a product in the condiment section, the resulting image may include soy sauce from brand A and soy sauce from brand B. Brand A can be considered the first product, and brand B can be considered the second product. In this case, brand A and brand B have the same product type (soy sauce), but the first and second products are different. Based on these first and second products, a product comparison operation can be performed. Similarly, when a user scans a product in the food section, the resulting image may include milk from brand A and milk from brand B. Brand A's milk is the first product, and brand B's milk is the second product. Based on these first and second products, a product comparison operation can be performed. When the image includes instant noodles and bottled water, since the two products are different categories, no product comparison operation is needed.
[0127] After identifying the first and second products among the products to be identified, the information corresponding to each of the first and second products can be analyzed and processed to generate comparison information between the first and second products. In some instances, the comparison information can be obtained through a pre-trained machine learning model. In this case, generating comparison information between the first and second products based on their respective information can include: acquiring a pre-trained machine learning model, inputting the information corresponding to each of the first and second products into the machine learning model, and obtaining the comparison information output by the machine learning model. This comparison information can include differences between the first and second products, such as price differences, rating differences, quality differences, volume differences, etc.
[0128] In other instances, the comparison information can be obtained not only through a pre-trained machine learning model, but also by comparing the information of the first product and the second product respectively. Those skilled in the art can choose to determine the specific implementation method of the comparison information according to the specific application scenario or application requirements, which will not be elaborated here.
[0129] After obtaining the first product information and the comparison information, corresponding processing operations can be performed on the first product information and the comparison information based on the information processing strategy. Specifically, when the user is an elderly person or a person with poor vision, the product information processing device operates in the first mode, and can then perform information broadcasting and / or information amplification operations on the first product information and the comparison information simultaneously based on the first information processing strategy; or, when the user is blind, the product information processing device operates in the second mode, and can then perform information broadcasting operations on the first product information and the comparison information simultaneously based on the second information processing strategy.
[0130] In this embodiment, by identifying the first and second products included in the products to be identified, and then generating comparison information between the first and second products based on the first product information corresponding to the first and second products respectively, and performing corresponding processing operations on the first product information and comparison information based on the information processing strategy, it is possible to effectively enable any type of user to accurately understand the relevant information of the products and understand the comparison information of the products, which is conducive to improving the user's shopping experience.
[0131] Figure 6 A flowchart illustrating the corresponding processing operations on the first commodity information based on the information processing strategy provided in this application embodiment. Figure 3 Based on the above embodiments, refer to the appendix. Figure 6As shown, when the image information includes a product to be identified, the method in this embodiment can also perform a product comparison operation by combining historically scanned products. Specifically, the currently scanned product to be identified can be compared with historically scanned related products. At this time, the corresponding processing operation on the first product information based on the information processing strategy can include:
[0132] Step S601: Obtain historical products scanned by the processing device.
[0133] Step S602: When there are associated historical products in the historical products that correspond to the product to be identified, product comparison information is generated based on the historical product information of the associated historical products and the first product information of the product to be identified.
[0134] Step S603: Perform corresponding processing operations on the first product information and product comparison information based on the information processing strategy.
[0135] When there is only one item to be identified, meaning the image information includes only one item, the processing can proceed according to the item information processing strategy described in the above embodiments. Furthermore, the currently scanned item to be identified can be compared with previously scanned items. Specifically, to enable item comparison, previously scanned items can be retrieved. These previously scanned items can be multiple. In some instances, the scanned items can be stored in a preset area or database of the processing device. Accessing the preset area or database allows retrieval of previously scanned items. It's important to note that previously scanned items can refer to items scanned within a preset historical time period, such as 30 minutes, 20 minutes, or 10 minutes. This allows retrieval of all previously scanned items within the preset 30, 20, or 10-minute timeframes.
[0136] After obtaining the historical products, the historical products can be analyzed and matched with the product to be identified to detect whether there are any related historical products in the historical products that correspond to the product to be identified. In some instances, related historical products can be identified by a pre-trained machine learning model. In this case, detecting whether there are related historical products in the historical products that correspond to the product to be identified may include: obtaining a pre-trained machine learning model, inputting the historical products and the product to be identified into the machine learning model, obtaining the detection result output by the machine learning model, and using the detection result to identify whether there are any related historical products in the historical products that correspond to the product to be identified.
[0137] In other instances, associated historical products can be obtained not only through machine learning models but also through information matching algorithms. In this case, detecting whether there are associated historical products corresponding to the product to be identified can include: obtaining the product category of the product to be identified, determining alternative product categories for each historical product, and determining that if a target product category matching the product category exists among multiple alternative product categories, then it is determined that there are associated historical products corresponding to the product to be identified. If no target product category matching the product category exists among multiple alternative product categories, then it is determined that there are no associated historical products corresponding to the product to be identified.
[0138] If there are no associated historical products in the historical products that correspond to the product to be identified, then there is no need to perform a product comparison operation. If there are associated historical products in the historical products that correspond to the product to be identified, then a product comparison operation can be performed. Specifically, product comparison information can be generated based on the historical product information of the associated historical products and the first product information of the product to be identified. The specific generation method of the product comparison information is similar to the specific determination method of the comparison information in the above embodiments. For details, please refer to the above description, which will not be repeated here.
[0139] After obtaining the first product information and the product comparison information, corresponding processing operations can be performed on the first product information and the product comparison information based on the information processing strategy. Specifically, when the user is an elderly person or a person with poor vision, the product information processing device operates in the first mode, and can then perform information broadcasting and / or information amplification operations on the first product information and the product comparison information simultaneously based on the first information processing strategy; or, when the user is blind, the product information processing device operates in the second mode, and can then perform information broadcasting operations on the first product information and the product comparison information simultaneously based on the second information processing strategy.
[0140] In this embodiment, by acquiring historical products scanned by the processing device, when there are associated historical products corresponding to the product to be identified, product comparison information is generated based on the historical product information of the associated historical products and the first product information of the product to be identified. Then, based on the information processing strategy, corresponding processing operations are performed on the first product information and the product comparison information, thereby effectively enabling any type of user to accurately understand the relevant information of the current product and understand the comparison information between the current product and historical products, further improving the user's shopping experience.
[0141] For specific applications, please refer to the appendix. Figure 7As shown, taking people with disabilities, including the blind and the elderly, as users, this application embodiment provides a convenient method for processing product information. This method ensures an accessible shopping experience for the blind and the elderly in offline scenarios. Specifically, the executing entity of this product information processing method can be a product information processing device, which may include an input module, a core module, and an output module. Based on the aforementioned product information processing device, the method may include the following steps:
[0142] Step 1: Scan the product using the input module in the processing device to obtain a product image;
[0143] When a user uses the processing device, the device can be equipped with a function entry for scanning goods. Based on this function entry, the user can use voice control to launch the application in the processing device for scanning goods. When the processing device is facing a certain goods and remains facing the goods for 3 seconds or a preset time (5 seconds, 4 seconds, or 6 seconds, etc.), the product can be scanned automatically. Alternatively, the product can be scanned based on the user's voice control command, thereby obtaining a product image.
[0144] Alternatively, when a user uses the processing device, the device can be configured with a function entry point for performing product scanning operations. Based on this function entry point, the user can manually operate the processing device to launch the application within the device for scanning products. For example, when the user clicks on control A in the processing device, the application for scanning products can be launched; when the user clicks on control B in the application, the product can be scanned, thereby obtaining a product image.
[0145] Step 2: Use the core module in the processing device to perform comprehensive information processing on the image information to obtain product information.
[0146] The core module may include an image recognition submodule for image recognition operations, an optical character recognition (OCR) submodule for character recognition operations, and a matching submodule for matching product barcode information. After acquiring image information, the image recognition submodule, OCR submodule, and matching submodule can be used to perform comprehensive processing operations on the image information to obtain the product information included in the image information. The product information may include key information on the product packaging, including but not limited to: product name, ingredient list, production date, shelf life, and product freshness.
[0147] Step 3: Output the product information using the output module in the processing device.
[0148] The output module may include at least one of the following: an information amplification module for implementing information amplification operation, and an information broadcasting module for implementing information broadcasting operation; after obtaining product information, the output module can be used to output the product information. Specifically, the information amplification module can be used to amplify the product information, and / or the information broadcasting module can be used to broadcast the product information.
[0149] In other instances, this application embodiment can also implement product comparison operations and product recommendation operations, etc. In this case, the method may include:
[0150] Step 11: Use the core module in the processing device to obtain the first and second products included in the image information, wherein the first and second products belong to the same type, and the first and second products are different products.
[0151] Step 12: Use the core module in the processing device to determine the first commodity information of the first commodity and the second commodity information of the second commodity.
[0152] Step 13: The core module in the processing device compares the first product information and the second product information to obtain product comparison information.
[0153] Step 14: Output the product comparison information based on the output module in the processing device.
[0154] In other instances, after determining the first product information of the first product and the second product information of the second product, the method in this embodiment may further include:
[0155] Step 21: The core module in the processing device obtains the first historical purchase data of the first product based on the first product information, and obtains the second historical purchase data of the second product based on the second product information;
[0156] Step 22: The core module in the processing device determines the first recommendation level of the first product based on the first historical purchase data, and determines the second recommendation level of the second product based on the second historical purchase data.
[0157] Step 23: Output the first recommendation level and the second recommendation level based on the output module in the processing device, so that the user can perform product recommendation operation based on the output first recommendation level and the second recommendation level.
[0158] The technical solution provided in this application embodiment realizes a comprehensive processing method based on image recognition, OCR text extraction, and product barcode information matching to obtain key information on product packaging, and outputs it through TTS and other output means, such as voice broadcasting. This not only helps users conveniently obtain offline product information and improves the barrier-free experience in offline shopping scenarios, but also avoids dependence on volunteer manpower, solving the defects of related technologies due to insufficient Chinese volunteers and the inability to provide services during specific periods. It can quickly provide a convenient way for users with disabilities to obtain offline product information and provide consumers with key information extraction and broadcasting services in offline shopping scenarios. It is simple and efficient, further improving the practicality of the method and facilitating market promotion and application.
[0159] Figure 8 A flowchart illustrating an information processing method provided in this application embodiment; see attached document. Figure 8 As shown, this embodiment provides an information processing method, wherein the executing entity of the method can be an information processing device, meaning the information processing method can be applied to an information processing device. The information processing device can be implemented as software, or a combination of software and hardware. Specifically, when the information processing device is implemented as hardware, it can be various electronic devices with information processing operations, including but not limited to tablet computers, personal computers (PCs), servers, etc. When the information processing device is implemented as software, it can be installed in the aforementioned electronic devices. Specifically, based on the above-described information processing device, the product information processing method in this embodiment may include the following steps:
[0160] Step S801: In response to the recognition operation of the object to be recognized, determine the associated information of the object to be recognized.
[0161] The objects to be identified vary depending on the application scenario. For example, in offline shopping, the object to be identified could be the product to be purchased; in a library, it could be the book to be browsed; and in museums, art exhibitions, and collections, it could be the displayed items, paintings, and collectibles. In other words, the main difference between this embodiment and the methods described above is that the methods in the above embodiments target products, while the methods in this embodiment are not limited to products and can refer to any other object besides products that can be scanned and identified to obtain relevant information.
[0162] When a user has a need to identify an object, the user can perform an identification operation on the object. In some instances, the identification operation may include at least one of the following: image acquisition of the object, scanning of a preset graphic code on the object, scanning of the object, etc. After obtaining the identification operation, the associated information of the object can be determined based on the identification operation. In some instances, the associated information of the object may include at least one of the following: image information, product name, product category, product freshness, product brand, etc.
[0163] Step S802: Determine the current information processing strategy for analyzing and processing related information, wherein the information processing strategy includes at least one of the following: information broadcasting, information amplification.
[0164] Since different application scenarios may require different information processing strategies, to ensure stable information processing operations, after acquiring the relevant information, the current information processing strategy for analyzing and processing that information can be determined. In some instances, the information processing strategy may include an information broadcasting strategy, enabling voice broadcasting of the relevant information; or, the information processing strategy may include an information amplification strategy, enabling amplification of the relevant information. In other instances, the information processing strategy may include both an information broadcasting strategy and an information amplification strategy, meaning that it can not only broadcast the relevant information but also amplify it, thus effectively enabling different processing operations on the relevant information in different application scenarios.
[0165] Furthermore, the method for determining the information processing strategy in this embodiment is similar to the specific method for determining the information processing strategy in step S203 of the above embodiment. For details, please refer to the above description, and it will not be repeated here.
[0166] Step S803: Process the associated information based on the information processing strategy so that the user can obtain the associated information.
[0167] The specific implementation method, implementation principle and implementation effect of the above steps in this embodiment are similar to the specific implementation method, implementation principle and implementation effect determination method of step S303 in the above embodiment. For details, please refer to the above description, and it will not be repeated here.
[0168] Figure 9 A schematic diagram of a product information processing device provided in this application embodiment; see attached drawing. Figure 9 As shown, this embodiment provides a product information processing device, which is used to perform the above-described... Figure 2The method for processing product information shown may specifically include:
[0169] The first acquisition module 11 is used to acquire image information of the product to be identified in response to the scanning behavior of the product to be identified when the processing device is in a preset working mode.
[0170] The first determining module 12 is used to determine the first product information corresponding to the product to be identified based on the image information;
[0171] The first determining module 12 described above is used to determine an information processing strategy corresponding to a preset working mode. The information processing strategy includes at least one of the following: information broadcasting and information amplification.
[0172] The first processing module 13 is used to perform corresponding processing operations on the first commodity information based on the information processing strategy.
[0173] In some instances, before acquiring the image information of the product to be identified, the first processing module 13 in this embodiment performs the following: detecting whether the processing device is associated with preset software for implementing reading and listening operations; if the processing device is not associated with preset software for implementing reading and listening operations, then determining that the preset working mode is a working mode suitable for the first type of user; if the processing device is associated with preset software for implementing reading and listening operations, then determining that the preset working mode is a working mode suitable for the second type of user; wherein, the first type of user is a user whose vision is greater than or equal to a preset threshold, and the second type of user is a user whose vision is less than a preset threshold.
[0174] In some instances, when the first processing module 13 determines the information processing strategy corresponding to the preset working mode, the first processing module 13 is used to perform the following: when the preset working mode is a working mode applicable to a first type of user, the information processing strategy is determined to include at least one of the following: information broadcasting, information amplification; when the preset working mode is a working mode applicable to a second type of user, the information processing strategy is determined to include information broadcasting.
[0175] In some instances, when the first processing module 13 performs corresponding processing operations on the first product information based on the information processing strategy, the first processing module 13 is used to perform: identifying whether the image information includes a product barcode; if the image information does not include a product barcode, generating a prompt message to indicate that the image information does not include a product barcode; and performing corresponding processing operations on the prompt message and the first product information based on the information processing strategy.
[0176] In some instances, the first processing module 13 in this embodiment is used to perform the following: when the image information includes a product barcode, obtain the second product information of the product to be identified based on the product barcode; and perform corresponding processing operations on the first product information and the second product information based on the information processing strategy.
[0177] In some instances, when the first processing module 13 performs corresponding processing operations on the first product information based on the information processing strategy, the first processing module 13 is used to perform: obtaining the historical purchase information of the product to be identified; determining the recommendation level of the product to be identified based on the first product information and the historical purchase information; and performing corresponding processing operations on the first product information and the recommendation level based on the information processing strategy.
[0178] In some instances, when the first processing module 13 performs corresponding processing operations on the first commodity information based on the information processing strategy, the first processing module 13 is used to perform: identifying the first commodity and the second commodity included in the commodities to be identified, wherein the first commodity and the second commodity are different, and the commodity category of the first commodity is the same as that of the second commodity; generating comparison information between the first commodity and the second commodity based on the first commodity information corresponding to the first commodity and the second commodity respectively; and performing corresponding processing operations on the first commodity information and the comparison information based on the information processing strategy.
[0179] In some instances, when the first processing module 13 performs corresponding processing operations on the first commodity information based on the information processing strategy, the first processing module 13 is used to perform: acquiring historical commodities that have been scanned by the processing device; if there are associated historical commodities in the historical commodities that correspond to the commodity to be identified, generating commodity comparison information based on the historical commodity information of the associated historical commodities and the first commodity information of the commodity to be identified; and performing corresponding processing operations on the first commodity information and the commodity comparison information based on the information processing strategy.
[0180] In some instances, when the first determining module 12 determines the first product information corresponding to the product to be identified based on image information, the first determining module 12 is used to perform: determining multiple products to be identified scanned by the processing device based on image information; determining a target product to be identified among the multiple products to be identified; and determining the first product information of the target product to be identified.
[0181] Figure 9 The device shown can perform Figures 1-7 For the methods shown in the embodiments, the parts not described in detail in this embodiment can be referred to the following: Figures 1-7 The relevant descriptions of the illustrated embodiments are provided below. For the execution process and technical effects of this technical solution, please refer to [link / reference]. Figures 1-7 The descriptions in the illustrated embodiments will not be repeated here.
[0182] In one possible design, Figure 9 The structure of the product information processing device shown can be implemented as an electronic device, which can be various devices such as mobile phones, tablets, and servers. Figure 10 As shown, the electronic device may include a first processor 21 and a first memory 22. The first memory 22 is used to store data executed by the corresponding electronic device. Figures 1-7 In the illustrated embodiment, the program for processing product information includes a first processor 21 configured to execute a program stored in a first memory 22.
[0183] The program includes one or more computer instructions, wherein when executed by the first processor 21, the one or more computer instructions can perform the following steps:
[0184] When the processing device is in a preset working mode, it acquires image information of the product to be identified in response to the scanning behavior of the product to be identified;
[0185] Based on image information, determine the first product information corresponding to the product to be identified;
[0186] Determine the information processing strategy corresponding to the preset working mode. The information processing strategy includes at least one of the following: information broadcasting, information amplification.
[0187] Based on the information processing strategy, corresponding processing operations are performed on the first product information.
[0188] Furthermore, the first processor 21 is also used to perform the aforementioned Figures 1-7 All or part of the steps in the illustrated embodiments.
[0189] The structure of the electronic device may also include a first communication interface 23 for communication between the electronic device and other devices or communication networks.
[0190] In addition, embodiments of the present invention provide a computer storage medium for storing computer software instructions used by an electronic device, which includes instructions for executing the above-described... Figures 1-7 The procedure involved in the product information processing method in the illustrated embodiment.
[0191] Furthermore, this embodiment discloses a computer program product comprising: a computer program that, when executed by a processor of an electronic device, causes the processor to perform the aforementioned... Figures 1-7 The method shown in the embodiment is a method for processing product information.
[0192] Figure 11 This is a schematic diagram of the structure of an information processing device provided in an embodiment of this application; see attached drawing. Figure 11 As shown, this embodiment provides an information processing device for performing the above-described... Figure 8 The information processing method shown herein, specifically, the processing device may include:
[0193] The second determining module 31 is used to determine the association information of the object to be identified in response to the identification operation of the object to be identified;
[0194] The second determining module 31 is used to determine the current information processing strategy for analyzing and processing the associated information, wherein the information processing strategy includes at least one of the following: information broadcasting, information amplification;
[0195] The second processing module 32 is used to process the associated information based on the information processing strategy so that the user can obtain the associated information.
[0196] Figure 11 The device shown can perform Figures 7-8 For the methods shown in the embodiments, the parts not described in detail in this embodiment can be referred to the following: Figures 7-8 The relevant descriptions of the illustrated embodiments are provided below. For the execution process and technical effects of this technical solution, please refer to [link / reference]. Figures 7-8 The descriptions in the illustrated embodiments will not be repeated here.
[0197] In one possible design, Figure 11 The structure of the information processing device shown can be implemented as an electronic device, which can be various devices such as mobile phones, tablets, and servers. Figure 12 As shown, the electronic device may include a second processor 41 and a second memory 42. The second memory 42 is used to store data executed by the corresponding electronic device. Figures 7-8 In the information processing method program provided in the illustrated embodiment, the second processor 41 is configured to execute the program stored in the second memory 42.
[0198] The program includes one or more computer instructions, wherein the one or more computer instructions, when executed by the second processor 41, can perform the following steps:
[0199] In response to the identification operation of the object to be identified, the associated information of the object to be identified is determined;
[0200] Determine the current information processing strategy for analyzing and processing the associated information, wherein the information processing strategy includes at least one of the following: information broadcasting, information amplification;
[0201] The associated information is processed based on the aforementioned information processing strategy so that users can access the associated information.
[0202] Furthermore, the second processor 41 is also used to perform the aforementioned Figures 7-8 All or part of the steps in the illustrated embodiments.
[0203] The structure of the electronic device may also include a second communication interface 43 for communication between the electronic device and other devices or communication networks.
[0204] In addition, embodiments of the present invention provide a computer storage medium for storing computer software instructions used by an electronic device, which includes instructions for executing the above-described... Figures 7-8 The procedure involved in the information processing method in the illustrated embodiment.
[0205] Furthermore, this embodiment discloses a computer program product comprising: a computer program that, when executed by a processor of an electronic device, causes the processor to perform the aforementioned... Figures 7-8 The information processing method in the illustrated embodiment.
[0206] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.
[0207] Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of a necessary general-purpose hardware platform, or by a combination of hardware and software. Based on this understanding, the above technical solutions, in essence or the part that contributes to the prior art, can be embodied in the form of a computer product. This application can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
[0208] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable device to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable device, generate instructions for implementing the flowchart... Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.
[0209] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.
[0210] These computer program instructions may also be loaded onto a computer or other programmable device to cause a series of operational steps to be performed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable device for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.
[0211] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.
[0212] Memory may include non-persistent storage in computer-readable media, such as random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM. Memory is an example of computer-readable media.
[0213] Computer-readable media includes both permanent and non-permanent, removable and non-removable media that can store information using any method or technology. Information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, CD-ROM, digital versatile optical disc (DVD) or other optical storage, magnetic tape, magnetic magnetic disk storage or other magnetic storage devices, or any other non-transferable medium that can be used to store information accessible by a computing device. As defined herein, computer-readable media does not include transient computer-readable media, such as modulated data signals and carrier waves.
[0214] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.
Claims
1. A method for processing product information, characterized in that, Applied to a processing device, the method includes: When the processing device is in a preset working mode, it acquires image information of the product to be identified in response to the scanning behavior of the product to be identified; Based on the image information, determine the first product information corresponding to the product to be identified; Determine an information processing strategy corresponding to the preset working mode, wherein the information processing strategy includes at least one of the following: information broadcasting, information amplification; Based on the information processing strategy, perform corresponding processing operations on the first product information; Before acquiring the image information of the product to be identified, the method further includes: Detect whether the processing device is associated with preset software used to implement reading and listening operations; When the processing device is not associated with preset software for implementing reading and listening operations, the preset working mode is determined to be a working mode suitable for the first type of user; When the processing device is associated with preset software for implementing reading and listening operations, the preset working mode is determined to be a working mode suitable for the second type of user. The first type of user refers to users whose visual acuity is greater than or equal to a preset threshold, and the second type of user refers to users whose visual acuity is less than a preset threshold.
2. The method according to claim 1, characterized in that, Determining the information processing strategy corresponding to the preset working mode includes: When the preset working mode is a working mode suitable for the first type of user, the information processing strategy is determined to include at least one of the following: information broadcasting, information amplification; When the preset working mode is a working mode suitable for the second type of user, the information processing strategy is determined to include information broadcasting.
3. The method according to claim 1, characterized in that, Based on the information processing strategy, corresponding processing operations are performed on the first product information, including: Identify whether the image information includes a product barcode; If the image information does not include a product barcode, a prompt message is generated to indicate that the image information does not include a product barcode. Based on the information processing strategy, corresponding processing operations are performed on the prompt information and the first product information.
4. The method according to claim 3, characterized in that, The method further includes: When the image information includes a product barcode, the second product information of the product to be identified is obtained based on the product barcode; Based on the information processing strategy, corresponding processing operations are performed on the first product information and the second product information.
5. The method according to claim 1, characterized in that, Based on the information processing strategy, corresponding processing operations are performed on the first product information, including: Obtain the historical purchase information of the product to be identified; Based on the first product information and the historical purchase information, the recommendation level of the product to be identified is determined; Based on the information processing strategy, corresponding processing operations are performed on the first product information and the recommendation level.
6. The method according to claim 1, characterized in that, Based on the information processing strategy, corresponding processing operations are performed on the first product information, including: Identify a first product and a second product among the products to be identified, wherein the first product and the second product are different, and the product category of the first product is the same as that of the second product; Based on the first product information corresponding to the first product and the second product respectively, comparison information between the first product and the second product is generated; Based on the information processing strategy, corresponding processing operations are performed on the first product information and the comparison information.
7. The method according to claim 1, characterized in that, Based on the information processing strategy, corresponding processing operations are performed on the first product information, including: Obtain historical products scanned by the processing device; If there are associated historical products in the historical products that correspond to the product to be identified, then product comparison information is generated based on the historical product information of the associated historical products and the first product information of the product to be identified; Based on the information processing strategy, corresponding processing operations are performed on the first product information and the product comparison information.
8. The method according to any one of claims 1-7, characterized in that, Based on the image information, determine the first product information corresponding to the product to be identified, including: Based on the image information, the processing device determines multiple items to be identified. Identify a target product from a pool of products to be identified; Determine the first product information of the target identified product.
9. An information processing method, characterized in that, include: In response to the identification operation of the object to be identified, the associated information of the object to be identified is determined; Determine the current information processing strategy for analyzing and processing the associated information, wherein the information processing strategy includes at least one of the following: information broadcasting, information amplification; The associated information is processed based on the aforementioned information processing strategy so that users can access the associated information. The information processing strategy corresponds to the preset working mode of the processing device. Before determining the associated information of the object to be identified, the method further includes: Detect whether the processing device is associated with preset software used to implement reading and listening operations; When the processing device is not associated with preset software for implementing reading and listening operations, the preset working mode is determined to be a working mode suitable for the first type of user; When the processing device is associated with preset software for implementing reading and listening operations, the preset working mode is determined to be a working mode suitable for the second type of user. The first type of user refers to users whose visual acuity is greater than or equal to a preset threshold, and the second type of user refers to users whose visual acuity is less than a preset threshold.
10. An electronic device, characterized in that, include: A memory and a processor; wherein the memory is used to store one or more computer instructions, wherein the one or more computer instructions, when executed by the processor, implement the method as described in any one of claims 1-9.
11. A computer storage medium, characterized in that, Used to store a computer program that, when executed by a computer, implements the method as described in any one of claims 1-9.
Citation Information
Patent Citations
Startup interface display method and device, mobile terminal, and storage medium
CN114077369A
Interactive information acquisition method and device, electronic equipment and storage medium
CN116301311A