Wine information management method, intelligent wine cabinet and system

Abstract

The embodiment of the present application discloses a wine information management method, a smart wine cabinet and a system, which belong to the field of information processing technology. In the embodiment of the present application, the wine label image of the wine to be stored is collected by the camera of the wine information management device set on the smart wine cabinet, and then the collected wine label image is identified to obtain the wine information of the wine to be stored. This method of obtaining wine information is more universal. In addition, the smart wine cabinet can also display multiple storage location information in the wine storage area to the user for the user to choose, and store the storage location information selected by the user in correspondence with the wine information of the wine to be stored. This can facilitate the user to manage the wine inventory of the smart wine cabinet in the future, and can also facilitate the user to find the wine information and storage location information of specific wines; in addition, since the user can directly operate on the smart wine cabinet to realize the management of wine when storing and accessing wine, the convenience of user operation is improved.

Description

Technical Field

[0001] The present application relates to the field of information processing technology, and in particular to a wine information management method, an intelligent wine cabinet and a system. Background Art

[0002] With the improvement of living standards, more and more people begin to collect various types of wines. When the number and types of wines increase, people usually choose to use smart wine cabinets to store various types of wines.

[0003] At present, when storing various types of wine through smart wine cabinets, smart wine cabinets mainly use radio frequency identification RFID technology to identify the wine information of various types of wine stored, and then store the identified wine information. This identification method requires that the wine is equipped with an RFID tag. However, since not all wines contain RFID tags, this identification method is relatively simple and not universal. In addition, a large number of wines will cause the electronic tags to be blocked after placement. In this case, it is difficult to find a specific wine. Based on this, there is an urgent need for a convenient and fast wine information management method to achieve the management of various types of wine. Summary of the invention

[0004] The embodiment of the present application provides a wine information management method, a smart wine cabinet and a system, which can manage wine information more conveniently. The technical solution is as follows:

[0005] On the one hand, a wine information management method is provided, which is applied to a wine information management device of a smart wine cabinet, wherein the wine information management device includes a camera, and the wine information management device is arranged on a cabinet of the smart wine cabinet, and the cabinet includes a wine storage area, and the method includes:

[0006] The camera collects a wine label image of a first wine product, where the first wine product is the wine product to be stored in the wine product storage area;

[0007] Recognize the wine label image of the first wine product, and display the wine product information obtained by the recognition;

[0008] When receiving a confirmation operation of the user on the identified wine information, using the identified wine information as the wine information of the first wine;

[0009] Displaying information of multiple storage locations in the wine storage area;

[0010] When a user selection operation for the first storage location information among the plurality of storage location information is received, the first storage location information and the wine information of the first wine are stored correspondingly.

[0011] Optionally, the identifying the wine label image of the first wine includes:

[0012] Extracting image features of the wine label image of the first wine product through an AI (Artificial Intelligence) model, and determining a wine identification of the first wine product according to the image features of the wine label image of the first wine product;

[0013] Acquire the wine information corresponding to the wine identification of the first wine from the mapping relationship between the wine identification and the wine information;

[0014] The obtained wine information is used as the identified wine information.

[0015] Optionally, the identifying the wine label image of the first wine includes:

[0016] Recognize the text information contained in the wine label image of the first wine product by using an OCR (Optical Character Recognition) algorithm;

[0017] Based on the preset wine information database, the wine information is extracted from the recognized text information.

[0018] Optionally, the wine storage area includes a plurality of sub-areas, each sub-area includes one or more shelves, each shelf includes a plurality of storage locations, and the display of the plurality of storage location information in the wine storage area includes:

[0019] Displaying a location information display mode in the wine location information page, wherein the location information display mode includes an accurate mode and a general mode;

[0020] When a confirmation operation of the user for the precise mode is received, the location information of each storage location on the shelf in each sub-area of ​​the wine storage area and the wine occupancy information of each storage location are displayed in the wine location information page;

[0021] When receiving a confirmation operation of the user for the general mode, displaying the location information of the shelves in each sub-area of ​​the wine storage area and the wine occupancy information in the wine location information page;

[0022] The wine occupancy information is used to indicate the occupancy status of the corresponding storage location or shelf.

[0023] Optionally, the first storage location information is location information of an unoccupied storage location on a shelf in a sub-area within the wine storage area, or the first storage location information is location information of a shelf in a sub-area within the wine storage area that is not fully occupied.

[0024] Optionally, the method further comprises:

[0025] When receiving a selection operation of a stock option by the user, displaying a wine stock list, wherein the wine stock list includes a plurality of wine stock items, and each wine stock item includes a wine identification;

[0026] When a selection operation of the user on the first wine inventory item is received, wine information of the wine identified by the wine identifier included in the first wine inventory item is displayed.

[0027] Optionally, the method further comprises:

[0028] When displaying the wine inventory list, displaying a search bar;

[0029] Receiving wine search information input by the user in the search bar;

[0030] According to the wine search information, acquiring target wine information matching the wine search information and storage location information corresponding to the target wine information from the correspondence relationship between the stored wine information and the storage location information;

[0031] The target wine information and the corresponding storage location information are displayed.

[0032] On the other hand, a wine information management device is provided, the device comprising:

[0033] A collection module, used for collecting a wine label image of a first wine product through the camera, wherein the first wine product is the wine product to be stored in the wine storage area;

[0034] An identification module, used to identify the wine label image of the first wine and display the wine information obtained by identification;

[0035] a confirmation module, configured to, upon receiving a confirmation operation of the user on the identified wine information, use the identified wine information as the wine information of the first wine;

[0036] A display module, used to display information of multiple storage locations in the wine storage area;

[0037] The storage module is used to store the first storage location information and the wine information of the first wine in correspondence with each other when receiving a user's selection operation on the first storage location information among the multiple storage location information.

[0038] Optionally, the identification module is used to:

[0039] Extracting image features of the wine label image of the first wine product through the AI ​​model, and determining the wine identification of the first wine product according to the image features of the wine label image of the first wine product;

[0040] Acquire the wine information corresponding to the wine identification of the first wine from the mapping relationship between the wine identification and the wine information;

[0041] The obtained wine information is used as the identified wine information.

[0042] Optionally, the identification module is further used for:

[0043] Recognize text information contained in the wine label image of the first wine product by using an OCR algorithm;

[0044] Based on the preset wine information database, the wine information is extracted from the recognized text information.

[0045] Optionally, the wine storage area includes a plurality of sub-areas, each sub-area includes one or more shelves, each shelf includes a plurality of storage positions, and the display module is used to:

[0046] Displaying a location information display mode in the wine location information page, wherein the location information display mode includes an accurate mode and a general mode;

[0047] When a confirmation operation of the user for the precise mode is received, the location information of each storage location on the shelf in each sub-area of ​​the wine storage area and the wine occupancy information of each storage location are displayed in the wine location information page;

[0048] When receiving a confirmation operation of the user for the general mode, displaying the location information of the shelves in each sub-area of ​​the wine storage area and the wine occupancy information in the wine location information page;

[0049] The wine occupancy information is used to indicate the occupancy status of the corresponding storage location or shelf.

[0050] Optionally, the first storage location information is location information of an unoccupied storage location on a shelf in a sub-area within the wine storage area, or the first storage location information is location information of a shelf in a sub-area within the wine storage area that is not fully occupied.

[0051] Optionally, the device further comprises:

[0052] A display module, configured to display a wine inventory list when receiving a selection operation of a stock option by a user, wherein the wine inventory list includes a plurality of wine inventory items, and each wine inventory item includes a wine identification;

[0053] The display module is configured to display the wine information of the wine identified by the wine identifier included in the first wine inventory item when receiving a selection operation of the user on the first wine inventory item.

[0054] Optionally, the device further comprises: a receiving module and an acquiring module;

[0055] A display module, configured to display a search bar when displaying the wine inventory list;

[0056] A receiving module, used for receiving wine search information input by a user in the search bar;

[0057] an acquisition module, configured to acquire, according to the wine search information, target wine information matching the wine search information and storage location information corresponding to the target wine information from the correspondence between the stored wine information and storage location information;

[0058] The display module is used to display the target wine information and the corresponding storage location information.

[0059] On the other hand, a smart wine cabinet is provided, the smart wine cabinet comprising a wine information management device and a cabinet body, the wine information management device comprising a processor, a display and a camera, the cabinet body comprising a wine storage area;

[0060] The camera is used to capture a wine label image of a first wine product, where the first wine product is the wine product to be stored in the wine product storage area;

[0061] The processor is used to recognize the wine label image of the first wine;

[0062] The display is used to display the identified wine information;

[0063] The processor is configured to use the identified wine information as the wine information of the first wine when the display receives a confirmation operation of the user on the identified wine information;

[0064] The display is also used to display information of multiple storage locations in the wine storage area;

[0065] The processor is further configured to store the first storage location information and the wine information of the first wine in correspondence with each other when the display receives the first storage location information from the user among the plurality of storage location information.

[0066] Optionally, the processor is configured to:

[0067] Extracting image features of the wine label image of the first wine product through the AI ​​model, and determining the wine identification of the first wine product according to the image features of the wine label image of the first wine product;

[0068] Acquire the wine information corresponding to the wine identification of the first wine from the mapping relationship between the wine identification and the wine information;

[0069] The obtained wine information is used as the identified wine information.

[0070] Optionally, the processor is configured to:

[0071] Recognize text information contained in the wine label image of the first wine product by using an OCR algorithm;

[0072] Based on the preset wine information database, the wine information is extracted from the recognized text information.

[0073] Optionally, the wine storage area includes a plurality of sub-areas, each sub-area includes one or more shelves, each shelf includes a plurality of storage positions, and the display is used for:

[0074] Displaying a location information display mode in the wine location information page, wherein the location information display mode includes an accurate mode and a general mode;

[0075] When a confirmation operation of the user for the precise mode is received, the location information of each storage location on the shelf in each sub-area of ​​the wine storage area and the wine occupancy information of each storage location are displayed in the wine location information page;

[0076] When receiving a confirmation operation of the user for the general mode, displaying the location information of the shelves in each sub-area of ​​the wine storage area and the wine occupancy information in the wine location information page;

[0077] The wine occupancy information is used to indicate the occupancy status of the corresponding storage location or shelf.

[0078] Optionally, the first storage location information is location information of an unoccupied storage location on a shelf in a sub-area within the wine storage area, or the first storage location information is location information of a shelf in a sub-area within the wine storage area that is not fully occupied.

[0079] Optionally, the processor is configured to:

[0080] When receiving a selection operation of a stock option by the user, displaying a wine stock list, wherein the wine stock list includes a plurality of wine stock items, and each wine stock item includes a wine identification;

[0081] When a selection operation of the user on the first wine inventory item is received, wine information of the wine identified by the wine identifier included in the first wine inventory item is displayed.

[0082] Optionally, the processor is further configured to:

[0083] When displaying the wine inventory list, displaying a search bar;

[0084] Receiving wine search information input by the user in the search bar;

[0085] According to the wine search information, acquiring target wine information matching the wine search information and storage location information corresponding to the target wine information from the correspondence relationship between the stored wine information and the storage location information;

[0086] The target wine information and the corresponding storage location information are displayed.

[0087] On the other hand, a wine information management system is provided, the system comprising a smart wine cabinet, a mobile terminal and a server;

[0088] The smart wine cabinet is used to upload the stored wine information and the corresponding storage location information to the server;

[0089] The server is used to store the wine information and the corresponding storage location information sent by the smart wine cabinet, and obtain the terminal identification corresponding to the wine cabinet identification of the smart wine cabinet according to the stored mapping relationship between the terminal identification and the wine cabinet identification, and send the information uploaded by the smart wine cabinet to the mobile terminal identified by the obtained terminal identification;

[0090] The mobile terminal is used to receive the information sent by the server and display the received information.

[0091] On the other hand, a computer-readable storage medium is provided, wherein a computer program is stored in the storage medium, and when the computer program is executed by a computer, the steps of the above-mentioned wine information management method are implemented.

[0092] On the other hand, a computer program product containing instructions is provided, which, when executed on a computer, enables the computer to execute the steps of the above-mentioned wine information management method.

[0093] The beneficial effects brought by the technical solution provided by the embodiment of the present application include at least:

[0094] In the embodiment of the present application, the camera of the wine information management device set on the cabinet of the smart wine cabinet can collect the wine label image of the wine to be stored, and then identify the collected wine label image of the wine to be stored to obtain the wine information of the wine to be stored. Compared with identifying wine information through RFID technology, the method of obtaining wine information in the present application is more universal. In addition, the smart wine cabinet can also display multiple storage location information in the wine storage area to the user for the user to choose, and then store the storage location information selected by the user in correspondence with the wine information of the wine to be stored. This can facilitate the user to manage the wine inventory of the smart wine cabinet in the future, and can also facilitate the user to find the wine information and storage location information of specific wines; in addition, since the user can directly operate on the smart wine cabinet to realize the management of wine when storing and retrieving wine, it is more intuitive and improves the convenience of user operation. BRIEF DESCRIPTION OF THE DRAWINGS

[0095] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0096] Figure 1 This is a system architecture diagram involved in a wine information management method provided in an embodiment of the present application;

[0097] Figure 2 It is a structural schematic diagram of a smart wine cabinet provided in an embodiment of the present application;

[0098] Figure 3 is a flow chart of a wine information management method provided in an embodiment of the present application;

[0099] Figure 4 It is a schematic diagram of a wine scanning page provided in an embodiment of the present application;

[0100] Figure 5 is a schematic diagram of a wine location information page in a precise mode provided in an embodiment of the present application;

[0101] Figure 6 is a schematic diagram of a wine location information page in a general mode provided in an embodiment of the present application;

[0102] Figure 7 is a schematic diagram of an inventory management page provided in an embodiment of the present application;

[0103] Figure 8 is a schematic diagram of a notes page provided in an embodiment of the present application;

[0104] Fig. 9 is a schematic diagram of a wine information management device provided in an embodiment of the present application;

[0105] Fig.10 It is a structural diagram of a terminal provided in an embodiment of the present application. DETAILED DESCRIPTION

[0106] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below with reference to the accompanying drawings.

[0107] Before explaining the embodiments of the present application in detail, the system architecture involved in the embodiments of the present application is first introduced.

[0108] Figure 1 1 is a system architecture diagram of a wine information management method provided in an embodiment of the present application. Figure 1 As shown, the system includes a smart wine cabinet 101, a mobile terminal 102, and a server 103. The smart wine cabinet 101 and the mobile terminal 102 can communicate with the server 103 via a wireless network.

[0109] Among them, the smart wine cabinet 101 is used to collect the wine label image of the wine to be stored and obtain the wine information corresponding to the wine label image, display the obtained wine information of the wine to be stored to the user, and then receive the user's confirmation operation on the wine information of the wine to be stored, after receiving the user's confirmation operation on the wine information of the wine to be stored, display multiple storage location information in the wine storage area to the user, and then receive the user's selection operation on the storage location information, after receiving the user's selection operation on the storage location information, upload the wine information of the wine to be stored and the corresponding storage location information to the server 103.

[0110] The server 103 is used to receive the wine information and corresponding storage location information and the wine cabinet identification of the smart wine cabinet 101 sent by the smart wine cabinet 101, and store the received wine information and corresponding storage location information. In addition, the server 103 can also store the mapping relationship between the user account and the wine cabinet identification. The user can use his own user account to log in to the smart wine cabinet APP (Application) from different mobile terminals 102. In this way, the server can obtain the user account corresponding to the wine cabinet identification of the smart wine cabinet 101, and send the information uploaded by the smart wine cabinet to the mobile terminal 102 logged in by the obtained user account.

[0111] The mobile terminal 102 is used to receive and display the wine information and corresponding storage location information uploaded by the smart wine cabinet 101 and sent by the server 103. In addition, the mobile terminal 102 can also edit the acquired wine information and corresponding storage location information, and then upload the edited wine information and corresponding storage location information to the server 103. Correspondingly, the server 103 can send the edited wine information and corresponding storage location information to the smart wine cabinet 101 according to the mapping relationship between the user account and the wine cabinet identifier. In other words, the smart wine cabinet 101 and the mobile terminal 102 logged in by the user account can share the wine information and the corresponding storage location information through the server 103.

[0112] Optionally, in another possible implementation, after receiving the wine information and corresponding storage location information sent by the smart wine cabinet 101, the server 103 can send a change message to the mobile terminal 102 logged in by the user account according to the mapping relationship between the user account and the wine cabinet identifier, and the change message includes the wine identifier and the change type included in the edited wine information in the smart wine cabinet 101, and the change type is used to indicate whether the editing operation of the wine information is to add, change or delete. Among them, if the editing operation of the wine information is to add or change, after receiving the change message sent by the server 103, the mobile terminal 102 can obtain the wine information and corresponding storage location information of the wine from the server 103 according to the wine identifier carried in the change message.

[0113] Optionally, when the server 103 receives the wine information and corresponding storage location information edited by the mobile terminal 102 logged in by the user account, it can also send a change message to the smart wine cabinet 101 according to the mapping relationship between the user account and the wine cabinet identifier. After receiving the change message sent by the server 103, the smart wine cabinet 101 can obtain the wine information and corresponding storage location information of the wine from the server 103 according to the wine identifier carried in the change message.

[0114] It should be noted that the mobile terminal 102 may be a mobile communication device such as a mobile phone, a laptop computer, a tablet computer, etc. The server 103 may be a single server, a server cluster, or a cloud platform, which is not limited in the present embodiment.

[0115] The structural diagram of the smart wine cabinet 101 is shown in FIG. Figure 2 As shown, the smart wine cabinet 101 may include a wine information management device 201 and a cabinet body 202. The wine information management device 201 may be arranged on the cabinet body 202, for example, in the center of the cabinet door of the smart wine cabinet.

[0116] The wine information management device 201 may include a camera, a processor and a display. The camera is used to collect wine label images of the wines to be stored, and display the collected wine label images to the user through the display, and then receive the user's confirmation operation on the collected wine label images.

[0117] The processor is used to identify the wine label image of the wine to be stored collected by the camera, and display the identified wine information to the user through the display, and then receive the user's confirmation operation on the identified wine information. After receiving the user's confirmation operation on the identified wine information, the identified wine information is used as the wine information of the wine to be stored. The processor is also used to store the storage location information and the wine information of the wine to be stored in correspondence after the user selects the storage location information of the wine to be stored.

[0118] The display is used to display the wine label image captured by the camera, the wine information recognized by the processor, and the multiple storage location information in the wine storage area.

[0119] The cabinet 202 includes a wine storage area, which can be divided into multiple sub-areas, each of which can include one or more shelves, and each shelf can include multiple storage positions. For example, the wine storage area can include 3 sub-areas, and the 3 sub-areas can be called area A, area B, and area C. Among them, area A and area B can have 4 shelves, each shelf can hold 13 bottles of wine, that is, there can be 13 storage positions, and area C can have 5 shelves, among which in the shelves of area C, each shelf C1 to C4 can hold 13 bottles of wine, and C5 can hold 36 bottles of wine. Of course, the wine storage area can also have other division methods, and the embodiments of the present application are not limited to this.

[0120] Next, the wine information management method provided in the embodiment of the present application is introduced.

[0121] Figure 3 This is a wine information management method provided by the embodiment of the present application, which can be applied to Figure 2 In the wine information management device of the smart wine cabinet shown in FIG. Figure 3 As shown, the method comprises the following steps:

[0122] Step 301: Capture a wine label image of a first wine product through a camera, where the first wine product is the wine product to be stored in a wine storage area.

[0123] In the implementation of this application, any wine to be stored in the wine storage area is taken as an example, and for the convenience of explanation, it is referred to as the first wine. Since the wine information management device of the smart wine cabinet includes a camera, the wine label image of the first wine can be collected by the camera.

[0124] It should be noted that the wine information management device also includes a display, which can display a main page, and the main page can include a scan option, a setting menu option, and an inventory option. Among them, clicking the scan option can enter the scan wine page, clicking the setting menu option can enter the setting menu page, and clicking the inventory option can enter the inventory management page. Based on this, when collecting the wine label image of the first wine, the user can click the scan option displayed in the main page. When the wine information management device receives the user's selection operation for the scan option, it jumps to the scan wine page, and then scans the wine label of the first wine to obtain the wine label image of the first wine.

[0125] Among them, Figure 4 As shown, the wine scanning page may include a collection frame, a shooting button, a confirmation button, and a retake button. After entering the wine scanning page, the user can aim the wine label of the first wine at the camera, and then observe in the collection frame whether the wine label of the first wine is located in the collection frame. If the wine label of the first wine is located in the collection frame, after the wine information management device receives the user's selection operation for the shooting button, the wine label of the first wine is collected and the collected wine label image is displayed. If the user thinks that there is no problem with the displayed wine label image, the confirmation button can be clicked. After the wine information management device receives the user's confirmation operation, the displayed wine label image can be used as the wine label image of the first wine; if the user is not satisfied with the displayed wine label image, the retake button can be clicked. After the wine information management device receives the user's selection operation for the retake button, the image of the wine label of the first wine can be collected again until the wine label image that the user is satisfied with is obtained.

[0126] Optionally, after the wine information management device jumps to the wine scanning page according to the user's selection operation for the scanning option, if the wine information management device is not connected to the Internet or the camera is not turned on, the wine information management device can also display a prompt message on the wine scanning page to guide the user to enter the setting menu for setting.

[0127] For example, if the wine information management device is not connected to the network, a pop-up window will be displayed in the wine scanning page, and "The current network is not available, please click to check network settings" will be displayed in the pop-up window. When the wine information management device receives the user's selection operation for the pop-up window, it will jump to the setting menu page to set up the network. When the wine information management device is connected to the network, the main page will be redisplayed, and then the user will click the scan option in the main page to scan the wine label of the first wine.

[0128] Step 302: Identify the wine label image of the first wine and display the identified wine information.

[0129] It should be noted that the wine label image of a wine product may usually contain some image features or text information, and these image features or text information are used to indicate the wine information of the wine product. Among them, the wine information of the wine product mainly includes the wine name, wine logo, winery, production year, wine type, origin and other information of the wine product, wherein the wine type may include liquor, beer, wine, etc., and may also include white wine, red wine, sparkling wine, etc., which is not limited in this embodiment of the present application. If the wine product is wine, the wine information may also include the type of grapes used to brew the wine. Among them, the wine labels corresponding to wines with different wine logos are different, and the wine information of wines with the same wine logo is the same.

[0130] In an embodiment of the present application, after collecting the wine label image of the first wine, the wine information management device can extract the image features of the wine label image of the first wine through an AI model, and determine the wine identification of the first wine based on the image features of the wine label image of the first wine; obtain the wine information corresponding to the wine identification of the first wine from the mapping relationship between the wine identification and the wine information; and use the obtained wine information as the identified wine information.

[0131] Among them, the AI ​​model is a model pre-trained by a large number of wine label images of different wines. Based on this, after the wine label image of the first wine is collected, the wine label image of the first wine can be input into the AI ​​model. After the AI ​​model receives the wine label image of the first wine, it can process the wine label image of the first wine to extract the image features of the wine label image of the first wine. After extracting the image features of the wine label image of the first wine, the wine label of the first wine is output according to the image features of the wine label image of the first wine. Afterwards, the wine information management device can obtain the wine information containing the wine label from the pre-stored wine information according to the wine label of the first wine output by the AI ​​model.

[0132] Optionally, after collecting the wine label image of the first wine, the wine information management device may also identify text information contained in the wine label image of the first wine through an OCR algorithm; and extract wine information from the identified text information based on a preset wine information database.

[0133] Exemplarily, the preset wine information database contains keywords in various wine information, for example, keywords such as wine name, winery, production year, wine type, and origin of various wines. As can be seen from the above introduction, the wine label image of the first wine contains text information, and the text information contains the wine information of the first wine, but the text information may also contain other information. Based on this, after obtaining the text information recognized by the OCR algorithm, the wine information management device can search for keywords contained in the preset wine information database from the recognized text information, and then use the found keywords as wine information.

[0134] Optionally, after acquiring the wine label image of the first wine, the wine information management device may also send the wine label image of the first wine to a third-party wine recognition service, and the third-party wine recognition service recognizes the wine label image of the first wine. After recognizing the wine label image of the first wine, the third-party wine recognition service feeds back the recognized wine information to the wine information management device, and accordingly, the wine information management device receives the wine information fed back by the third-party wine recognition service.

[0135] Step 303: When a confirmation operation of the user on the identified wine information is received, the identified wine information is used as the wine information of the first wine.

[0136] After identifying the wine information, the wine information management device can display the identified wine information on the display, and the user can confirm the wine information displayed on the display. When the wine information management device receives the user's confirmation operation for the displayed wine information, it uses the displayed wine information as the wine information of the first wine. If the user believes that the identified wine information is incorrect, for example, the production year of the wine contained in the identified wine information is incorrect, the user can correct the currently displayed wine information by clicking the edit button displayed by the wine information management device. Afterwards, when the wine information management device receives the user's confirmation operation for the modified wine information, it uses the user's modified wine information as the wine information of the first wine.

[0137] Optionally, in another possible implementation, the wine scanning page may also include a manual input button, such as Figure 4As shown, when the wine information management device receives the user's selection operation for the manual input button, it can jump to the manual wine information input page, and the user can enter the wine information of the first wine in this page. It should be noted that the manual wine information input page displays input boxes corresponding to wine information such as wine name, winery, production year, wine type, origin, grape type, etc. The user only needs to enter the corresponding wine information in each input box. After entering the wine information, the user can click the confirmation button. When the wine information management device receives the user's confirmation operation, it can use the wine information entered by the user as the wine information of the first wine.

[0138] Step 304: Displaying information of multiple storage locations in the wine storage area.

[0139] In an embodiment of the present application, after obtaining the wine information of the first wine, the display of the wine information management device automatically switches to the wine location information page, which can display multiple storage location information of the wine storage area for the user to select the first storage location information for storing the first wine.

[0140] It should be noted that the wine storage area may include multiple sub-areas, each of which includes one or more shelves, and each shelf includes multiple storage positions. Based on this, the multiple storage position information of the wine storage area can be the position information of the shelves included in each of the multiple sub-areas in the wine storage area and the wine occupancy information, or it can be the position information of each storage position in each shelf included in each of the multiple sub-areas in the wine storage area and the wine occupancy information, wherein the wine occupancy information is used to indicate the occupancy of the corresponding storage position or shelf. Based on this, the wine information management device can display these two types of storage position information through different position information display modes.

[0141] Exemplarily, the wine location information page displays a location information display mode, which includes an accurate mode and a general mode. When a user confirms the accurate mode, the wine location information page displays the location information of each storage location on the shelf in each sub-area of ​​the wine storage area and the wine occupancy information of each storage location; when a user confirms the general mode, the wine location information page displays the location information of the shelf in each sub-area of ​​the wine storage area and the wine occupancy information.

[0142] In the precise mode, the wine location information page displays information about each storage location on a shelf in a sub-area of ​​the wine storage area, and may also display a set of up and down scroll buttons for switching shelves. Figure 5As shown, taking shelf A1 as an example, the position information of each storage position on shelf A1 can be represented by a circle and a digital number in the circle, wherein the digital number is the position number of the position. In addition, the position information of each storage position can also be set to different colors to indicate the wine occupancy information of each storage position. For example, when the position information of the storage position is black, it means that the storage position is not occupied, and the black color is the wine occupancy information corresponding to the storage position; when the position information of the storage position is gray, it means that the storage position is occupied, and the gray color is the wine occupancy information corresponding to the storage position. Of course, the position information of each storage position can also be represented by other graphics, and the wine occupancy information of each storage position can also be represented by text. For example, the position information of each storage position can also be represented by writing unoccupied or occupied in the corresponding storage position information to indicate the occupancy of the position, and unoccupied or occupied is the wine occupancy information corresponding to the storage position. The embodiments of the present application are not limited to this.

[0143] For example, in the general mode, the wine location information page displays the information of the shelves in each sub-area of ​​the wine storage area. The location information of each shelf in each sub-area can be represented by a horizontal line and a corresponding location number, such as A1, A2, etc. In addition, there can be a number corresponding to the location number of each shelf to indicate the occupancy of the wine on the shelf. Figure 6 As shown in the figure, the number 6 after shelf A1 indicates that 6 bottles of wine have been placed on the shelf, and the number 6 is the wine occupancy information corresponding to the shelf. If no wine is placed on the shelf, the number 0 can be used after the position number of the shelf to indicate the wine occupancy of the shelf, and the number 0 is the wine occupancy information corresponding to the shelf. Of course, there can be other ways of representation, which are not limited in the present embodiment. In addition, Figure 6 As shown, the wine location information page in the general mode may also display a shelf setting option and a quantity setting option. The shelf setting option is used to set the shelf where the first wine is to be stored, and the quantity setting option is used to set the quantity of the first wine to be stored. In addition, in a possible implementation, the shelf setting option may include up and down scroll buttons, and the user may select a shelf by using the up and down scroll buttons. At the same time, as the shelves in the shelf setting option are switched, the page correspondingly displays the information of each shelf in the area where the shelf is located. For example, Figure 6 As shown in the figure, when the shelf setting option is switched to shelf A1, the information of each shelf in area A where A1 is located is displayed in the area on one side.

[0144] Step 305: When a selection operation of the user on the first storage location information is received, the first storage location information and the wine information of the first wine are stored correspondingly.

[0145] When the wine information management device displays multiple storage location information in the wine storage area, the user can select a storage location information from them. When the wine information management device receives the user's selection operation on a certain storage location information, the storage location information can be used as the first storage location information, and then the first storage location information and the wine information of the first wine are stored correspondingly.

[0146] For example, if the user chooses to display multiple storage location information in the precise mode, the user can switch different shelves through the scroll button included in the wine location information page to view the storage location information on each shelf, and then select an unoccupied storage location from them. After the wine information management device receives the user's selection operation for a certain storage location information, the storage location information selected by the user can be set to orange for the user to confirm. After the wine information management device receives the user's confirmation operation, the location information can be used as the first storage location information, and the first storage location information and the wine information of the first wine can be stored in correspondence.

[0147] Optionally, the precise mode also supports the operation of replacing the wine information corresponding to the storage location information. For example, the first storage location information on the first shelf in the wine storage area in the precise mode is already occupied by other wines, but the user wants to place the first wine in the storage location. In this case, the user can click on the storage location information. When the wine information management device receives the user's selection operation on the storage location information, the storage location information is used as the first storage location information, and the wine information corresponding to the first storage location information is replaced with the wine information of the first wine.

[0148] Optionally, if the user chooses to display multiple storage location information in the general mode, as described in the aforementioned step 304, the user can select a shelf that is not fully occupied through the shelf setting option included in the wine location information page, and select the number of first wines to be placed on the selected shelf through the quantity setting option. After the wine information management device receives the location information of a shelf selected by the user and the set number of wines, the location information of the shelf selected by the user can be used as the first storage location information, and the first storage location information, the wine information of the first wine, and the number of wines are stored accordingly.

[0149] Optionally, the user can also place multiple bottles of wine with the same wine label at one time. It should be noted that the wine information corresponding to the multiple bottles of wine with the same wine label is the same. Based on this, in the precise mode, the user can select multiple storage location information on the same shelf to store the multiple bottles of wine, or select multiple storage location information on different shelves to store the multiple bottles of wine. In the general mode, the user can choose to place multiple bottles of wine with the same wine label on one shelf through the aforementioned shelf setting options and quantity setting options, or can choose to place the multiple bottles of wine on different shelves. This embodiment of the present application will not be described in detail.

[0150] In addition, it is worth noting that if the first storage location information is the location information of a shelf in the wine storage area, the location information can be represented by the location number of the shelf, and if it is the location information of a specific storage location on a shelf, the location information can be represented by the location number of the storage location and the location number of the shelf to which the storage location belongs. Among them, the location numbers of different shelves in different sub-areas of the wine storage area are different, and the location numbers of different storage locations in different shelves may be the same or different.

[0151] Optionally, the wine information management device can also provide the user with an inventory management function. As can be seen from the above description, the main page displayed by the wine information management device includes an inventory option. Based on this, the user can click on the inventory option. When the wine information management device receives the user's selection operation on the inventory option, it can display a wine inventory list, which includes multiple wine inventory items, each of which includes a wine identification; when the user's selection operation on the first wine inventory item is received, the wine information of the wine identified by the wine identification included in the first wine inventory item is displayed.

[0152] For example, when the wine product information management device receives the user's selection operation on the inventory option, it can jump to the inventory management page. Figure 7 As shown, the inventory management page may display a wine inventory list. The wine inventory list includes multiple wine inventory items, and each wine inventory item includes a wine identification. It should be noted that the wine identification may include the name of the wine. The user may click on any wine inventory item in the wine inventory list. When the wine information management device receives a selection operation of a wine inventory item that the user is interested in, the wine information including the wine identification included in the wine inventory item may be obtained and the wine information may be displayed.

[0153] Alternatively, if Figure 7As shown, the inventory management page also includes two buttons for list mode and matrix mode. It should be noted that when the wine information management device stores the storage location information and the wine information of the wine correspondingly, it can also store the wine label image of the wine correspondingly. In this case, after the wine information management device receives the user's selection operation for the list mode, it can display the wine information such as the wine label image corresponding to each wine, the wine name, and the quantity of the wine stored in the smart wine cabinet in a list. The user can slide up and down in this page to view the wine information of each wine.

[0154] Optionally, after the wine information management device receives the user's selection operation for the matrix mode, it can display a default wine location information page, for example, the default wine location information page is a wine location information page in the general mode. In this page, the wine label images of the wines placed on the shelves in each sub-area in the wine storage area, as well as up and down scroll buttons, can be displayed. The user can click the up and down scroll buttons to switch shelves to find the shelf they want to view, and for any shelf, the user can browse the wines stored on the shelf by sliding the multiple wine label images on the shelf. If the user wants to view the wine information of a certain wine on the shelf, he can click on the wine label image of the wine on the shelf. After the wine information management device receives the user's selection operation on the wine label image of the wine, it can display part of the wine information of the wine at the bottom of the page, including the wine name, winery, production year, etc. of the wine. Afterwards, when the wine information management device receives the user's selection operation on the displayed part of the wine information, it can jump to the wine information page, which displays all the wine information of the wine. It should be noted that each page contains a return button. In this case, if the user wants to view the wine location information page in the precise mode, the user can click the return button contained in each page in turn to return to the main page. From the above introduction, it can be seen that the main page includes a setting menu option. Based on this, the user can click on the setting menu option. When the wine information management device receives the user's selection operation on the setting menu option, the setting menu page can be displayed. In the setting menu page, the wine location information page that is displayed by default when displayed in the matrix mode can be set to be displayed in the precise mode. After the setting is completed, the main page is redisplayed. The user clicks on the inventory page option. When the wine information management device receives the user's selection operation for the inventory option, it enters the inventory management page. At this time, when the wine information management device receives the user's selection operation for the matrix mode, it displays the wine location information page in the precise mode. The page can display the storage location information of each shelf in each sub-area in the wine storage area and the up and down scroll buttons. The user can click the up and down scroll buttons to switch shelves to find the storage location information they want to view. Afterwards, when the wine information management device receives the user's selection operation for a certain occupied storage location information on a certain shelf, it displays the wine identification corresponding to the storage location information. Afterwards, when the wine information management device receives the user's selection operation for the displayed wine identification, it displays the wine information of the wine identified by the wine identification.

[0155] Optionally, a search bar may also be displayed in the inventory management page, in which the user may enter wine search information; after receiving the wine search information input by the user, the wine information management device may obtain target wine information matching the wine search information and the storage location information corresponding to the target wine information from the correspondence between the stored wine information and the storage location information based on the wine search information input by the user, and then display the target wine information and the corresponding storage location information.

[0156] Exemplarily, the wine search information may be information such as the name of the wine or the origin of the wine. When the wine information management device receives the wine search information input by the user, it can search for the target wine information and the corresponding storage location information that match the wine search information input by the user from the correspondence between the stored wine information and the storage location information according to the wine search information input by the user. Among them, the target wine found according to the wine search information input by the user may be one or more. The wine information management device displays the wine identifications of all the target wines found for the user to view. Among them, when the wine information management device displays the wine identifications of all the target wines, it can display the wine identifications of each target wine in the order of the time when the target wine is placed in the smart wine cabinet. The user can click on the wine identification of the target wine that he wants to view. When the wine information management device receives the user's selection operation for the wine identification of a target wine, it can jump to the wine information page, which displays the wine information of the target wine.

[0157] It should be noted that a notes option is also displayed in the wine information page. After receiving the user's selection operation for the notes option, the wine information management device jumps to display the notes page, which displays the name of the target wine and the storage location information of the target wine. It is worth noting that the number of wines corresponding to the target wine may be one bottle or more bottles. Therefore, the storage location information corresponding to the target wine may also be one or more. Each storage location information corresponds to a drop-down arrow button. Clicking the drop-down arrow button can display the user's notes recorded on the target wine stored in the storage location information and a display location option. After receiving the user's selection operation for the display location option, the wine information management device can jump to the wine location information page to display the storage location information of the target wine.

[0158] For example, Figure 8As shown, the notes page displays the wine name AAAA of the target wine, and two storage location information corresponding to the target wine. The two storage location information are the storage location information of the second shelf with position number 3 and position number 4 in the A area in the wine storage area, and both storage location information correspond to a drop-down arrow button. When the wine information management device receives the user's selection operation for the drop-down arrow button corresponding to the storage location information with position number 4, it displays the user's note information recorded on the target wine stored on the storage location information and a display location button. When the wine information management device receives the user's selection operation for the display location button, it can jump to the wine location information page, and the user can view the storage location information of the target wine stored in the wine storage area on the wine location information page. It should be noted that if the user chooses to store the target wine in the precise mode when storing the target wine, the specific storage location information of the target wine on the corresponding shelf is highlighted in the wine location information page, and the user can intuitively see the storage location information of the target wine. Among them, the wine location information page also includes a trash can option. If the user wants to take the target wine, the storage location information of the target wine can be dragged to the trash can option. When the wine information management device receives the user's dragging operation, the wine occupancy information of the storage location of the target wine can be changed to unoccupied. Optionally, in another possible implementation, the user can also first click the trash can option included in the wine location information page. After the wine information management device receives the user's selection operation, an "X" mark will be displayed in the storage location information of the target wine highlighted in the wine location information page. When the wine information management device receives the user's click operation on the "X" mark displayed in the storage location information of a certain target wine, a confirmation message will be displayed to remind the user whether to delete the wine occupancy information of the storage location. If the user confirms that he wants to delete the wine occupancy information of the storage location, he can click the confirmation button. After the wine information management device receives the user's confirmation operation, the wine occupancy information of the storage location of the target wine can be changed to unoccupied.

[0159] If the user chooses to store the target wine in the general mode, the wine location information page will display the sub-areas in the wine storage area, where the location information of the shelf where the target wine is stored in each sub-area is highlighted, and the number of target wines stored on each shelf where the target wine is stored is displayed after the location number for the user to view. The wine location information page also displays a quantity setting option, and if the user wants to take the target wine on the shelf, the user can change the number of wines on the shelf in the quantity setting option.

[0160] Optionally, after the wine information management device stores the wine information and storage location information of the wine correspondingly, it can also send the wine information and storage location information of all wines and the wine cabinet identification of the smart wine cabinet to the server, and the server stores the mapping relationship between the user account and the wine cabinet identification of the smart wine cabinet, wherein the user can use his own user account to log in to the smart wine cabinet APP on different mobile terminals. Based on this, the server can search for the user account corresponding to the wine cabinet identification according to the wine cabinet identification uploaded by the wine information management device, and then send the wine information and storage location information of the wine to the mobile terminal logged in by the corresponding user account, and the mobile terminal receives the information sent by the server and displays the received information.

[0161] When the mobile terminal displays the received information, the user can edit the wine information and storage location information displayed on the mobile terminal. After receiving the user's confirmation operation on the edited wine information and storage location information, the mobile terminal can upload the edited wine information and the corresponding storage location information to the server. The server sends the information uploaded by the mobile terminal logged in by the user account to the corresponding smart wine cabinet based on the mapping relationship between the stored user account and the wine cabinet identifier of the smart wine cabinet.

[0162] Optionally, after the user logs in to the smart wine cabinet APP using his or her own user account on the mobile terminal, the mobile terminal can also collect the wine label image of the wine to be stored, and identify the wine label image of the wine to be stored to obtain the wine information of the wine to be stored, and can also select the storage location information of the wine to be stored, and upload the wine information and storage location information of the wine to be stored to the server. The server sends the information uploaded by the mobile terminal logged in by the user account to the corresponding smart wine cabinet based on the mapping relationship between the stored user account and the wine cabinet identifier of the smart wine cabinet, thereby realizing information sharing between the mobile terminal logged in by the user account and the smart wine cabinet.

[0163] Optionally, after receiving the edited wine information and corresponding storage location information uploaded by the wine information management device, the server may also send a change message to the mobile terminal based on the mapping relationship between the stored user account and the wine cabinet identifier of the smart wine cabinet. The change message includes the wine identifier and the change type included in the wine information edited by the wine information management device. The change type is used to indicate whether the editing operation on the wine information is to add, change or delete. If the editing operation on the wine information is to add or change, the mobile terminal logged in by the user account may obtain the wine information and corresponding storage location information of the wine from the server based on the wine identifier carried in the change message after receiving the change message.

[0164] Optionally, after receiving the edited wine information and corresponding storage location information uploaded by the mobile terminal logged in by the user account, the server may also send a change message to the wine information management device based on the mapping relationship between the stored user account and the wine cabinet identifier of the smart wine cabinet. The wine information management device obtains the wine information and corresponding storage location information of the wine from the server based on the wine identifier carried in the change message.

[0165] In the embodiment of the present application, the camera of the wine information management device set on the cabinet of the smart wine cabinet can collect the wine label image of the wine to be stored, and then identify the collected wine label image of the wine to be stored to obtain the wine information of the wine to be stored. Compared with identifying wine information through RFID technology, the method of obtaining wine information in the present application is more universal. In addition, the smart wine cabinet can also display multiple storage location information in the wine storage area to the user for the user to choose, and then store the storage location information selected by the user in correspondence with the wine information of the wine to be stored. This can facilitate the user to manage the wine inventory of the smart wine cabinet in the future, and can also facilitate the user to find the wine information and storage location information of specific wines; in addition, since the user can directly operate on the smart wine cabinet to realize the management of wine when storing and retrieving wine, it is more intuitive and improves the convenience of user operation.

[0166] Secondly, the wine information management device of the smart wine cabinet uses an AI model or OCR algorithm to identify the wine label image of the stored wine to obtain the wine information, so that the wine information obtained is more accurate.

[0167] In addition, the wine information management device of the smart wine cabinet provides two different modes for users to choose when displaying the wine storage area and checking the wine inventory. Users can choose the corresponding mode according to their own needs to store wine and check wine inventory. This is more user-friendly and more in line with user needs.

[0168] Next, the wine information management device provided in the embodiment of the present application is introduced.

[0169] See also Fig. 9 The embodiment of the present application provides a wine information management device 900, which includes: a collection module 901, an identification module 902, a confirmation module 903, a display module 904, a storage module 905, a receiving module 906, and an acquisition module 907.

[0170] The acquisition module 901 is used to acquire a wine label image of a first wine product through a camera, where the first wine product is the wine product to be stored in the wine storage area;

[0171] The recognition module 902 is used to recognize the wine label image of the first wine and display the wine information obtained by the recognition;

[0172] A confirmation module 903 is used to use the identified wine information as the wine information of the first wine when receiving a confirmation operation of the user on the identified wine information;

[0173] Display module 904, used to display multiple storage location information in the wine storage area;

[0174] The storage module 905 is used to store the first storage location information and the wine information of the first wine in correspondence with each other when receiving a user's selection operation on the first storage location information among the multiple storage location information.

[0175] Optionally, the identification module 902 is further configured to:

[0176] Extracting image features of the wine label image of the first wine product through the AI ​​model, and determining the wine identification of the first wine product according to the image features of the wine label image of the first wine product;

[0177] Obtaining the wine information corresponding to the wine identification of the first wine from the mapping relationship between the wine identification and the wine information;

[0178] The obtained wine information is used as the identified wine information.

[0179] Optionally, the identification module 902 is further configured to:

[0180] Recognize text information contained in the wine label image of the first wine product by using an OCR algorithm;

[0181] Based on the preset wine information database, the wine information is extracted from the recognized text information.

[0182] Optionally, the wine storage area includes a plurality of sub-areas, each sub-area includes one or more shelves, each shelf includes a plurality of storage positions, and the display module 904 is used to:

[0183] The location information display mode is displayed in the wine location information page, and the location information display mode includes precise mode and general mode;

[0184] When receiving the user's confirmation operation for the precise mode, the location information of each storage location on the shelf in each sub-area of ​​the wine storage area and the wine occupancy information of each storage location are displayed in the wine location information page;

[0185] When receiving the user's confirmation operation for the general mode, the position information of the shelves in each sub-area of ​​the wine storage area and the wine occupancy information are displayed in the wine position information page;

[0186] The wine occupancy information is used to indicate the occupancy status of the corresponding storage location or shelf.

[0187] Optionally, the first storage location information is location information of an unoccupied storage location on a shelf in a sub-area within the wine storage area, or the first storage location information is location information of a shelf in a sub-area within the wine storage area that is not fully occupied.

[0188] Optionally, the display module 904 is further used for:

[0189] When receiving a selection operation of a stock option by the user, displaying a wine stock list, the wine stock list includes a plurality of wine stock items, each of which includes a wine identification;

[0190] When a selection operation of the user on the first wine inventory item is received, wine information of the wine identified by the wine identifier included in the first wine inventory item is displayed.

[0191] Optionally, the device 900 further includes: a receiving module 906 and an acquiring module 907;

[0192] Display module 904, for displaying a search bar when displaying the wine inventory list;

[0193] The receiving module 906 is used to receive the wine search information input by the user in the search bar;

[0194] The acquisition module 907 is used to acquire, according to the wine search information, target wine information matching the wine search information and storage location information corresponding to the target wine information from the correspondence relationship between the stored wine information and the storage location information;

[0195] The display module 904 is used to display the target wine information and the corresponding storage location information.

[0196] In summary, in the embodiment of the present application, the camera of the wine information management device set on the cabinet of the smart wine cabinet can collect the wine label image of the wine to be stored, and then identify the collected wine label image of the wine to be stored to obtain the wine information of the wine to be stored. Compared with identifying wine information through RFID technology, the method of obtaining wine information in the present application is more universal. In addition, the smart wine cabinet can also display multiple storage location information in the wine storage area to the user for the user to choose, and then store the storage location information selected by the user in correspondence with the wine information of the wine to be stored. This can facilitate the user to manage the wine inventory of the smart wine cabinet in the future, and can also facilitate the user to find the wine information and storage location information of specific wines; in addition, since the user can directly operate on the smart wine cabinet to realize the management of wine when accessing wine, it is more intuitive and improves the convenience of user operation.

[0197] It should be noted that the wine information management device provided in the above embodiment only uses the division of the above functional modules as an example to illustrate when managing wine information. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. In addition, the wine information management device provided in the above embodiment and the wine information management method embodiment belong to the same concept. The specific implementation process is detailed in the method embodiment and will not be repeated here.

[0198] Fig.10 1 is a block diagram of a terminal 1000 according to an exemplary embodiment. The wine information management device in the above embodiment can be implemented by the terminal 1000. The terminal 1000 can be a smart phone, a tablet computer, a laptop computer, a desktop computer, etc.

[0199] Typically, the terminal 1000 includes a processor 1001 and a memory 1002 .

[0200] The processor 1001 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 1001 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). The processor 1001 may also include a main processor and a coprocessor. The main processor is a processor for processing data in the awake state, also known as a CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in the standby state. In some embodiments, the processor 1001 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 1001 may also include an AI (Artificial Intelligence) processor, which is used to process computing operations related to machine learning.

[0201] The memory 1002 may include one or more computer-readable storage media, which may be non-transitory. The memory 1002 may also include a high-speed random access memory and a non-volatile memory, such as one or more disk storage devices and flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 1002 is used to store at least one instruction, wherein the at least one instruction is used to be executed by the processor 1001 to implement the wine information management method provided in the method embodiment of the present application.

[0202] In some embodiments, the terminal 1000 may also optionally include: a peripheral device interface 1003 and at least one peripheral device. The processor 1001, the memory 1002 and the peripheral device interface 1003 may be connected via a bus or a signal line. Each peripheral device may be connected to the peripheral device interface 1003 via a bus, a signal line or a circuit board. Specifically, the peripheral device includes: at least one of a radio frequency circuit 1004, a display screen 1005, a camera assembly 1006, an audio circuit 1007, a positioning assembly 1008 and a power supply 1009.

[0203] The peripheral device interface 1003 may be used to connect at least one peripheral device related to I / O (Input / Output) to the processor 1001 and the memory 1002. In some embodiments, the processor 1001, the memory 1002, and the peripheral device interface 1003 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 1001, the memory 1002, and the peripheral device interface 1003 may be implemented on a separate chip or circuit board, which is not limited in this embodiment.

[0204] The radio frequency circuit 1004 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The radio frequency circuit 1004 communicates with the communication network and other communication devices through electromagnetic signals. The radio frequency circuit 1004 converts the electrical signal into an electromagnetic signal for transmission, or converts the received electromagnetic signal into an electrical signal. Optionally, the radio frequency circuit 1004 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, etc. The radio frequency circuit 1004 can communicate with other terminals through at least one wireless communication protocol. The wireless communication protocol includes but is not limited to: the World Wide Web, a metropolitan area network, an intranet, various generations of mobile communication networks (2G, 3G, 4G and 5G), a wireless local area network and / or a WiFi (Wireless Fidelity) network. In some embodiments, the radio frequency circuit 1004 may also include circuits related to NFC (Near Field Communication), which is not limited in this application.

[0205] The display screen 1005 is used to display a UI (User Interface). The UI may include graphics, text, icons, videos, and any combination thereof. When the display screen 1005 is a touch display screen, the display screen 1005 also has the ability to collect touch signals on the surface or above the surface of the display screen 1005. The touch signal can be input to the processor 1001 as a control signal for processing. At this time, the display screen 1005 can also be used to provide virtual buttons and / or virtual keyboards, also known as soft buttons and / or soft keyboards. In some embodiments, the display screen 1005 can be one, and the front panel of the terminal 1000 is set; in other embodiments, the display screen 1005 can be at least two, which are respectively set on different surfaces of the terminal 1000 or are folded; in some embodiments, the display screen 1005 can be a flexible display screen, which is set on the curved surface or folded surface of the terminal 1000. Even, the display screen 1005 can also be set to a non-rectangular irregular shape, that is, a special-shaped screen. The display screen 1005 can be made of materials such as LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode, organic light-emitting diode). It should be noted that, in the embodiment of the present application, when the terminal 1000 is a horizontal screen terminal, the aspect ratio of the display screen of the terminal 500 is greater than 1, for example, the aspect ratio of the display screen of the terminal 1000 may be 16:9 or 4:3. When the terminal 1000 is a vertical screen terminal, the aspect ratio of the display screen of the terminal 1000 is less than 1, for example, the aspect ratio of the display screen of the terminal 1000 may be 9:18 or 3:4, etc.

[0206] The camera assembly 1006 is used to capture images or videos. Optionally, the camera assembly 1006 includes a front camera and a rear camera. Typically, the front camera is arranged on the front panel of the terminal, and the rear camera is arranged on the back of the terminal. In some embodiments, there are at least two rear cameras, which are any one of a main camera, a depth of field camera, a wide-angle camera, and a telephoto camera, so as to realize the fusion of the main camera and the depth of field camera to realize the background blur function, the fusion of the main camera and the wide-angle camera to realize the panoramic shooting and VR (Virtual Reality) shooting function or other fusion shooting functions. In some embodiments, the camera assembly 1006 may also include a flash. The flash can be a monochrome temperature flash or a dual-color temperature flash. A dual-color temperature flash refers to a combination of a warm light flash and a cold light flash, which can be used for light compensation at different color temperatures.

[0207] The audio circuit 1007 may include a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, and convert the sound waves into electrical signals and input them into the processor 1001 for processing, or input them into the radio frequency circuit 1004 to achieve voice communication. For the purpose of stereo acquisition or noise reduction, there may be multiple microphones, which are respectively arranged at different parts of the terminal 1000. The microphone may also be an array microphone or an omnidirectional acquisition microphone. The speaker is used to convert the electrical signal from the processor 1001 or the radio frequency circuit 1004 into sound waves. The speaker may be a traditional film speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can not only convert the electrical signal into sound waves audible to humans, but also convert the electrical signal into sound waves inaudible to humans for purposes such as ranging. In some embodiments, the audio circuit 1007 may also include a headphone jack.

[0208] The positioning component 1008 is used to locate the current geographical location of the terminal 1000 to implement navigation or LBS (Location Based Service). The positioning component 1008 can be a positioning component based on the GPS (Global Positioning System), Beidou system or Galileo system.

[0209] The power supply 1009 is used to power various components in the terminal 1000. The power supply 1009 can be an alternating current, a direct current, a disposable battery, or a rechargeable battery. When the power supply 1009 includes a rechargeable battery, the rechargeable battery can be a wired rechargeable battery or a wireless rechargeable battery. A wired rechargeable battery is a battery charged through a wired line, and a wireless rechargeable battery is a battery charged through a wireless coil. The rechargeable battery can also be used to support fast charging technology.

[0210] In some embodiments, the terminal 1000 also includes one or more sensors, such as a pressure sensor, a fingerprint sensor, an optical sensor, and a proximity sensor.

[0211] That is, the embodiment of the present application not only provides a terminal, including a processor and a memory for storing processor executable instructions, wherein the processor is configured to execute Figure 3 The wine information management method shown in the embodiment of the present application also provides a computer-readable storage medium, which stores a computer program, and when the computer program is executed by the processor, it can achieve Figure 3 The wine information management method shown.

[0212] The present application also provides a computer program product including instructions, which, when executed on a computer, enables the computer to execute the above Figure 3 The illustrated embodiment provides a method for managing wine information.

[0213] The above description is not intended to limit the embodiments of the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the embodiments of the present application should be included in the protection scope of the embodiments of the present application.

Claims

1. A wine information management method, characterized in that: In a wine information management device applied to a smart wine cabinet, the wine information management device includes a camera, and the wine information management device is arranged on a cabinet of the smart wine cabinet, the cabinet includes a wine storage area, the wine storage area includes a plurality of sub-areas, each sub-area includes one or more shelves, and each shelf includes a plurality of storage positions; the method includes: The camera collects a wine label image of a first wine product, where the first wine product is the wine product to be stored in the wine product storage area; Recognize the wine label image of the first wine product, and display the wine product information obtained by the recognition; When receiving a confirmation operation of the user on the identified wine information, using the identified wine information as the wine information of the first wine; Displaying information of multiple storage locations in the wine storage area; When a user selects a first storage location information among the plurality of storage location information, the first storage location information and the wine product information of the first wine are stored correspondingly, the first storage location information being location information of an unoccupied storage location on a shelf in a sub-area within the wine product storage area, or the first storage location information being location information of a shelf that is not fully occupied in a sub-area within the wine product storage area; Wherein, the display of multiple storage location information in the wine storage area includes: Displaying a location information display mode, wherein the location information display mode includes a precise mode and a general mode; When receiving a confirmation operation of the user for the precise mode, the position information of each storage position on the shelf in each sub-area of ​​the wine storage area, the wine occupancy information of each storage position, and a group of up and down scroll buttons are displayed, and the up and down scroll buttons are used to switch shelves; When the user's confirmation operation for the general mode is received, the position information of the shelves in each sub-area of ​​the wine storage area, the wine occupancy information of the shelves, the shelf setting options and the quantity setting options are displayed, the shelf setting options are used to set the shelf to store the first wine, the shelf setting options include a group of up and down scroll buttons, the up and down scroll buttons are used to select the shelf, and the quantity setting options are used to set the quantity of the first wine to be stored; wherein the wine occupancy information is used to indicate the corresponding storage position or shelf occupancy status.

2. The method according to claim 1, characterized in that The identifying the wine label image of the first wine product includes: Extracting image features of the wine label image of the first wine product through an artificial intelligence (AI) model, and determining a wine identification of the first wine product according to the image features of the wine label image of the first wine product; Acquire the wine information corresponding to the wine identification of the first wine from the mapping relationship between the wine identification and the wine information; The obtained wine information is used as the identified wine information.

3. The method according to claim 1, characterized in that The identifying the wine label image of the first wine product includes: Recognize text information contained in the wine label image of the first wine product by using an optical character recognition (OCR) algorithm; Based on the preset wine information database, the wine information is extracted from the recognized text information.

4. The method according to claim 1, characterized in that: The method further comprises: When receiving a selection operation of a stock option by the user, displaying a wine stock list, wherein the wine stock list includes a plurality of wine stock items, and each wine stock item includes a wine identification; When a selection operation of the user on the first wine inventory item is received, wine information of the wine identified by the wine identifier included in the first wine inventory item is displayed.

5. The method according to claim 4, characterized in that The method further comprises: When displaying the wine inventory list, displaying a search bar; Receiving wine search information input by the user in the search bar; According to the wine search information, acquiring target wine information matching the wine search information and storage location information corresponding to the target wine information from the correspondence relationship between the stored wine information and the storage location information; The target wine information and the corresponding storage location information are displayed.

6. A smart wine cabinet, characterized in that: The smart wine cabinet includes a wine information management device and a cabinet body, the wine information management device includes a processor, a display and a camera, the cabinet body includes a wine storage area, the wine storage area includes a plurality of sub-areas, each sub-area includes one or more shelves, and each shelf includes a plurality of storage positions; The camera is used to capture a wine label image of a first wine product, where the first wine product is the wine product to be stored in the wine product storage area; The processor is used to recognize the wine label image of the first wine; The display is used to display the identified wine information; The processor is configured to use the identified wine information as the wine information of the first wine when the display receives a confirmation operation of the user on the identified wine information; The display is also used to display a position information display mode, which includes a precise mode and a general mode; when a user confirms the precise mode, the display displays the position information of each storage position on the shelf in each sub-area of ​​the wine storage area, the wine occupancy information of each storage position, and a group of up and down scrolling buttons for switching shelves; when a user confirms the general mode, the display displays the position information of the shelf in each sub-area of ​​the wine storage area, the wine occupancy information of the shelf, shelf setting options and quantity setting options, the shelf setting options are used to set the shelf where the first wine is to be stored, the shelf setting options include a group of up and down scrolling buttons, the up and down scrolling buttons are used to select a shelf, and the quantity setting options are used to set the quantity of the first wine to be stored; wherein the wine occupancy information is used to indicate the occupancy of the corresponding storage position or shelf; The processor is also used to store the first storage location information and the wine information of the first wine in correspondence when the display receives the first storage location information selected by the user, the first storage location information being the location information of an unoccupied storage location on a shelf in a sub-area within the wine storage area, or the first storage location information being the location information of a shelf that is not fully occupied in a sub-area within the wine storage area.

7. The smart wine cabinet according to claim 6, characterized in that: The processor is used to: Extracting image features of the wine label image of the first wine product through an artificial intelligence (AI) model, and determining a wine identification of the first wine product according to the image features of the wine label image of the first wine product; Acquire the wine information corresponding to the wine identification of the first wine from the mapping relationship between the wine identification and the wine information; The obtained wine information is used as the identified wine information.

8. A wine information management system, characterized in that: The system includes a smart wine cabinet, a mobile terminal and a server; The smart wine cabinet is used to upload the stored wine information and the corresponding storage location information to the server; wherein the smart wine cabinet comprises a wine information management device and a cabinet body, the wine information management device is arranged on the cabinet body, the wine information management device comprises a camera, the cabinet body comprises a wine storage area, the wine storage area comprises a plurality of sub-areas, each sub-area comprises one or more shelves, each shelf comprises a plurality of storage locations, and the wine information management device is used to execute the wine information management method according to any one of claims 1 to 5; The server is used to store the wine information and the corresponding storage location information sent by the smart wine cabinet, and obtain the terminal identification corresponding to the wine cabinet identification of the smart wine cabinet according to the stored mapping relationship between the terminal identification and the wine cabinet identification, and send the information uploaded by the smart wine cabinet to the mobile terminal identified by the obtained terminal identification; The mobile terminal is used to receive the information sent by the server and display the received information.

Images