Information processing method, device, system, and computer-readable storage medium

By generating location subfiles, the area locations of specific objects in the image are automatically determined, which solves the problem of low efficiency of manual annotation images, and achieves improved efficiency and savings in image annotation and labor and time cost.

CN111737509BActive Publication Date: 2024-12-03BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD +1
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN201910311639.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2019-04-17
Publication Date
2024-12-03
Estimated Expiration
2039-04-17

AI Technical Summary

Technical Problem

The prior art requires a lot of labor and time costs by manually labeling images, resulting in inefficient image labeling.

Method used

By acquiring multiple images and position files, corresponding position sub-files are generated based on image identification and position files, the area position information of specific objects in the image is automatically determined, and image labeling efficiency is improved.

Benefits of technology

It achieves labor and time savings, improves image annotation efficiency, and provides machine learning with training data for automatic detection and identification of specific objects on the shelf.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN111737509B_ABST
    Figure CN111737509B_ABST
Patent Text Reader

Abstract

The present disclosure provides an information processing method, comprising: acquiring multiple images about a holding space, wherein each of the multiple images has an image identifier, the holding space includes multiple areas, the areas can be used to hold specific objects, and the image identifier represents the area where the specific object in the image is located; acquiring a position file, wherein the position file includes position information of the multiple areas; and generating multiple position sub-files corresponding to the multiple images respectively based on the multiple image identifiers and the position file, wherein each position sub-file includes the position information of the area where the specific object in the corresponding image is located.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, and more specifically, to an information processing method, an information processing device, an information processing system, and a computer-readable storage medium. Background Art

[0002] In physical stores where goods are sold, store clerks usually need to periodically count and patrol the goods on the shelves to ensure that there are enough salable goods on the shelves, and that the goods are neatly and properly placed, so as to improve the customer's shopping experience and sales. With the development of artificial intelligence technology and image recognition technology, solutions such as using cameras to shoot shelves and using object detection to identify goods on shelves, thereby completing inventory of goods on shelves and patrolling shelves are becoming more and more important. Usually, multiple images of shelves can be collected by cameras, and the images can be manually annotated at a later stage to generate a corresponding annotation file for each image, which includes the location information of the target object to be identified in the image. Manual annotation requires a lot of manpower and time costs. Therefore, how to improve the efficiency of image annotation to save manpower and time costs has become a problem that needs to be solved urgently.

[0003] In the process of realizing the concept of the present disclosure, the inventors found that there are at least the following problems in the prior art: the prior art requires a lot of manpower and time costs by manually annotating images. Summary of the invention

[0004] In view of this, the present disclosure provides an optimized information processing method and information processing system.

[0005] One aspect of the present disclosure provides an information processing method, comprising: acquiring multiple images of a holding space, wherein each of the multiple images has an image identifier, the holding space includes multiple areas, the areas can be used to hold specific objects, the image identifier represents the area where the specific object in the image is located, acquiring a position file, wherein the position file includes position information of the multiple areas, and generating multiple position sub-files corresponding to the multiple images respectively based on the multiple image identifiers and the position file, wherein each position sub-file includes the position information of the area where the specific object in the corresponding image is located.

[0006] According to an embodiment of the present disclosure, the above-mentioned generation of multiple position sub-files corresponding to the multiple images respectively based on the multiple image identifiers and the position file includes: determining the area where a specific object in the image to which the image identifier belongs is located based on the image identifier, determining the position information of the area where the specific object is located from the position file, and generating a position sub-file corresponding to the image based on the position information of the area where the specific object is located.

[0007] According to an embodiment of the present disclosure, the above-mentioned accommodation space includes: a plurality of sub-accommodation spaces, each of which includes a plurality of areas. The obtaining of the position file includes: obtaining the position information of the plurality of areas in each sub-accommodation space, and generating the position file based on the position information of the plurality of areas in each sub-accommodation space.

[0008] According to an embodiment of the present disclosure, the acquiring of location information of multiple areas of each sub-accommodating space includes: acquiring location information of a specific area in the sub-accommodating space, and determining location information of other areas in the corresponding sub-accommodating space based on the location information of the specific area.

[0009] According to an embodiment of the present disclosure, the multiple images of the above-mentioned accommodation space are obtained from different viewing angles through multiple cameras, and the image identification of each image includes corresponding camera information.

[0010] According to an embodiment of the present disclosure, the above-mentioned location file includes: a plurality of location files, each location file includes the camera information. The obtaining of the location file includes: obtaining a corresponding location file from the plurality of location files based on the camera information in the image identifier.

[0011] Another aspect of the present disclosure provides an information processing device, including: a first acquisition module, a second acquisition module, and a generation module. The first acquisition module acquires multiple images of a storage space, wherein each of the multiple images has an image identifier, the storage space includes multiple areas, the areas can be used to accommodate specific objects, and the image identifier represents the area where the specific object in the image is located, the second acquisition module acquires a position file, wherein the position file includes position information of the multiple areas, and the generation module generates multiple position sub-files corresponding to the multiple images respectively based on the multiple image identifiers and the position file, wherein each position sub-file includes the position information of the area where the specific object in the corresponding image is located.

[0012] According to an embodiment of the present disclosure, the above-mentioned generation of multiple position sub-files corresponding to the multiple images respectively based on the multiple image identifiers and the position file includes: determining the area where a specific object in the image to which the image identifier belongs is located based on the image identifier, determining the position information of the area where the specific object is located from the position file, and generating a position sub-file corresponding to the image based on the position information of the area where the specific object is located.

[0013] According to an embodiment of the present disclosure, the above-mentioned accommodation space includes: a plurality of sub-accommodation spaces, each of which includes a plurality of areas. The obtaining of the position file includes: obtaining the position information of the plurality of areas in each sub-accommodation space, and generating the position file based on the position information of the plurality of areas in each sub-accommodation space.

[0014] According to an embodiment of the present disclosure, the acquiring of location information of multiple areas of each sub-accommodating space includes: acquiring location information of a specific area in the sub-accommodating space, and determining location information of other areas in the corresponding sub-accommodating space based on the location information of the specific area.

[0015] According to an embodiment of the present disclosure, the multiple images of the above-mentioned accommodation space are obtained from different viewing angles through multiple cameras, and the image identification of each image includes corresponding camera information.

[0016] According to an embodiment of the present disclosure, the above-mentioned location file includes: a plurality of location files, each location file includes the camera information. The obtaining of the location file includes: obtaining a corresponding location file from the plurality of location files based on the camera information in the image identifier.

[0017] Another aspect of the present disclosure provides a computer-readable storage medium storing computer-executable instructions, which are used to implement the above method when executed.

[0018] Another aspect of the present disclosure provides a computer program, which includes computer executable instructions, and the instructions are used to implement the method described above when executed.

[0019] According to the embodiments of the present disclosure, the problem that the existing method of manually annotating images requires a lot of manpower and time costs can be at least partially solved, and thus the efficiency of image annotation can be improved to save manpower and time costs. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The above and other objects, features and advantages of the present disclosure will become more apparent through the following description of the embodiments of the present disclosure with reference to the accompanying drawings, in which:

[0021] Figure 1 The system architecture of the information processing method and processing system according to the embodiments of the present disclosure is schematically shown;

[0022] Figure 2 The application scenarios of the information processing method and the processing system according to the embodiments of the present disclosure are schematically shown;

[0023] Figure 3 The flowchart of the information processing method according to the embodiment of the present disclosure is schematically shown;

[0024] Figure 4 A schematic diagram schematically illustrates a plurality of images according to an embodiment of the present disclosure;

[0025] Figure 5 A schematic diagram schematically shows a location file according to an embodiment of the present disclosure;

[0026] Figure 6 A schematic diagram of generating a location subfile according to an embodiment of the present disclosure is schematically shown;

[0027] Figure 7 A schematic diagram of a receiving space according to an embodiment of the present disclosure is schematically shown;

[0028] Figure 8 A block diagram schematically shows an information processing device according to an embodiment of the present disclosure; and

[0029] Fig. 9 The block diagram schematically shows a computer system suitable for information processing according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0030] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. However, it should be understood that these descriptions are exemplary only and are not intended to limit the scope of the present disclosure. In the following detailed description, for ease of explanation, many specific details are set forth to provide a comprehensive understanding of the embodiments of the present disclosure. However, it is apparent that one or more embodiments may also be implemented without these specific details. In addition, in the following description, descriptions of known structures and technologies are omitted to avoid unnecessary confusion of the concepts of the present disclosure.

[0031] The terms used herein are only for describing specific embodiments and are not intended to limit the present disclosure. The terms "comprise", "include", etc. used herein indicate the existence of the features, steps, operations and / or components, but do not exclude the existence or addition of one or more other features, steps, operations or components.

[0032] All terms (including technical and scientific terms) used herein have the meanings commonly understood by those skilled in the art, unless otherwise defined. It should be noted that the terms used herein should be interpreted as having a meaning consistent with the context of this specification, and should not be interpreted in an idealized or overly rigid manner.

[0033] In the case of using expressions such as "at least one of A, B, and C, etc.", it should generally be interpreted in accordance with the meaning of the expression generally understood by those skilled in the art (for example, "a system having at least one of A, B, and C" should include but is not limited to a system having A alone, B alone, C alone, A and B, A and C, B and C, and / or A, B, C, etc.). In the case of using expressions such as "at least one of A, B, or C, etc.", it should generally be interpreted in accordance with the meaning of the expression generally understood by those skilled in the art (for example, "a system having at least one of A, B, or C" should include but is not limited to a system having A alone, B alone, C alone, A and B, A and C, B and C, and / or A, B, C, etc.).

[0034] An embodiment of the present disclosure provides an information processing method, comprising: acquiring multiple images about a holding space, wherein each of the multiple images has an image identifier, the holding space includes multiple areas, the areas can be used to hold specific objects, the image identifier represents the area where the specific object in the image is located, acquiring a location file, wherein the location file includes location information of the multiple areas, and generating multiple location sub-files corresponding to the multiple images respectively based on the multiple image identifiers and the location file, wherein each location sub-file includes the location information of the area where the specific object in the corresponding image is located.

[0035] Figure 1 The system architecture of the information processing method and the information processing system according to the embodiment of the present disclosure is schematically shown. It should be noted that: Figure 1 What is shown is merely an example of a system architecture to which the embodiments of the present disclosure can be applied, in order to help those skilled in the art understand the technical content of the present disclosure, but it does not mean that the embodiments of the present disclosure cannot be used in other devices, systems, environments or scenarios.

[0036] like Figure 1 As shown, the system architecture 100 according to this embodiment may include terminal devices 101, 102, 103, a network 104 and a server 105. The network 104 is used to provide a medium for communication links between the terminal devices 101, 102, 103 and the server 105. The network 104 may include various connection types, such as wired, wireless communication links or optical fiber cables, etc.

[0037] Users can use terminal devices 101, 102, 103 to interact with server 105 through network 104 to receive or send messages, etc. Various communication client applications can be installed on terminal devices 101, 102, 103, such as shopping applications, web browser applications, search applications, instant messaging tools, email clients, social platform software, etc. (only examples).

[0038] The terminal devices 101 , 102 , and 103 may be various electronic devices having a display screen and supporting web browsing, including but not limited to smart phones, tablet computers, laptop computers, and desktop computers.

[0039] The server 105 may be a server that provides various services, such as a background management server (only an example) that provides support for websites browsed by users using the terminal devices 101, 102, and 103. The background management server may analyze and process the received data such as user requests, and feed back the processing results (such as web pages, information, or data obtained or generated according to user requests) to the terminal device.

[0040] It should be noted that the information processing method provided in the embodiment of the present disclosure can generally be executed by the server 105. Accordingly, the information processing device provided in the embodiment of the present disclosure can generally be set in the server 105. The information processing method provided in the embodiment of the present disclosure can also be executed by a server or server cluster that is different from the server 105 and can communicate with the terminal devices 101, 102, 103 and / or the server 105. Accordingly, the information processing device provided in the embodiment of the present disclosure can also be set in a server or server cluster that is different from the server 105 and can communicate with the terminal devices 101, 102, 103 and / or the server 105.

[0041] For example, the multiple images and position files about the accommodation space obtained by the embodiment of the present disclosure can be stored in the terminal devices 101, 102, and 103, and the multiple images and position files about the accommodation space are sent to the server 105 through the terminal devices 101, 102, and 103. The server 105 can generate multiple position sub-files corresponding to the multiple images based on the multiple image identifiers and the position files, or the terminal devices 101, 102, and 103 can also directly generate multiple position sub-files corresponding to the multiple images based on the multiple image identifiers and the position files. In addition, the multiple images and position files about the accommodation space can also be directly stored in the server 105, and the server 105 directly generates multiple position sub-files corresponding to the multiple images based on the multiple image identifiers and the position files.

[0042] It should be understood that Figure 1 The number of terminal devices, networks and servers in the embodiment is only for illustration. Any number of terminal devices, networks and servers may be provided according to implementation requirements.

[0043] Figure 2 The application scenarios of the information processing method and information processing system according to the embodiments of the present disclosure are schematically shown. It should be noted that: Figure 2The examples shown are merely scenarios in which the embodiments of the present disclosure can be applied, to help those skilled in the art understand the technical content of the present disclosure, but do not mean that the embodiments of the present disclosure cannot be used in other devices, systems, environments or scenarios.

[0044] like Figure 2 As shown, the application scenario 200 may include multiple images 211 , 212 , and 213 , for example.

[0045] According to an embodiment of the present disclosure, the multiple images 211, 212, and 213 may be images of a shelf captured by a camera, where the shelf is used to place items. The shelf includes multiple areas for placing items. Figure 2 The figure schematically shows that the shelf has three areas for placing items, which are a first area A, a second area B, and a third area C.

[0046] According to an embodiment of the present disclosure, each image includes a specific object, for example, the specific object in image 211 is located in the first area A, the specific object in image 212 is located in the second area B, and the specific object in image 213 is located in the third area C.

[0047] Each image has an image identifier, which may be the file name of the image. For example, the image identifier of image 211 is Fig.a, the image identifier of image 212 is Fig.b, and the image identifier of image 213 is Fig.c.

[0048] In the disclosed embodiment, the image identifier can, for example, represent the region where a specific object in the image is located. For example, Fig.a can represent that a specific object in image 211 is located in a first region A, Fig.b can represent that a specific object in image 212 is located in a second region B, and Fig.c can represent that a specific object in image 213 is located in a third region C.

[0049] For example, the acquisition method of multiple images 211, 212, and 213 is consistent, that is, the position of the shelf in different images is consistent. Therefore, the position information of each area of ​​the shelf in different images is consistent. For example, the position information of the first area A in multiple images 211, 212, and 213 is [(a1, a2), (a3, a4)], wherein (a1, a2) is, for example, the upper left corner position coordinate of the first area A, and (a3, a4) is, for example, the lower right corner position coordinate of the first area A. Similarly, the position information of the second area B is, for example, [(b1, b2), (b3, b4)], and the position information of the third area C is, for example, [(c1, c2), (c3, c4)].

[0050] In the embodiment of the present disclosure, the location information of multiple regions is combined into a location file 220, that is, the location file 220 includes the location information of each region. A location subfile corresponding to each image can be automatically generated based on each image and the location file 220, and the location subfile includes the regional location information of the region where the specific object in each image is located. For example, a location subfile 231 of image 211 is automatically generated based on the location file 220, and the location subfile 231 includes the location information [(a1, a2), (a3, a4)] of the first region A where the specific object in image 211 is located. Similarly, the embodiment of the present disclosure can automatically generate a location subfile 232 corresponding to image 212, and automatically generate a location subfile 233 corresponding to image 213.

[0051] The disclosed embodiments can realize automatic generation of image location subfiles, improve the efficiency of image annotation, and save manpower and time costs. In addition, the annotated images can be used as a training set for machine learning, for example, a training set for a deep learning target detection model, and the trained model can be used to automatically detect and identify specific object information on the shelf.

[0052] Figure 3 The flowchart of the information processing method according to the embodiment of the present disclosure is schematically shown.

[0053] Figure 4 A schematic diagram schematically shows multiple images according to an embodiment of the present disclosure.

[0054] like Figure 3 As shown, the method includes operations S310 to S330.

[0055] In operation S310, a plurality of images about the accommodation space are acquired, wherein each of the plurality of images has an image identifier, the accommodation space includes a plurality of regions, the regions can be used to accommodate specific objects, and the image identifier represents the region where the specific object in the image is located.

[0056] According to an embodiment of the present disclosure, the storage space is used to place items, for example, and the storage space can be a shelf for placing items. The storage space includes multiple areas, each of which can be used to place items.

[0057] like Figure 4 As shown, for example, multiple images 410, 420, and 430 of the accommodation space are obtained. Each image has an image identifier, which can be the file name of the corresponding image. For example, the image identifier of image 410 is Fig_1, the image identifier of image 420 is Fig_2, and the image identifier of image 430 is Fig_3.

[0058] In the embodiment of the present disclosure, for example, the accommodation space includes 6 areas (such as Figure 4 As shown, the accommodation space includes 3 areas above and 3 areas below) as an example. In each image, a specific object (for example, a specific object Figure 4 For example, the large volume cylinder in the image is placed in different areas, and the areas where the specific objects in different images are located have certain rules. For example, the specific object in image 410 can be located in all areas. Based on image 410, starting from the specific object located in the left area, the specific objects located in the even-numbered positions are removed each time. For example, the specific object located in the even-numbered position 2 is removed for the first time (the upper and lower areas are consistent), and image 420 is obtained. Other interfering objects (for example, Figure 4 Secondly, based on image 420, the specific object located at the even number 2 position is removed for the second time (the region where the interfering object in image 420 is located is not within the range of the position odd and even number calculation), and image 430 is obtained. In this way, multiple images with specific objects in different regions can be obtained.

[0059] In the disclosed embodiment, the image identifier can represent the area where the specific object in the corresponding image is located. For example, the image identifier Fig_1 of image 410 can represent that the specific object in image 410 is located in all areas, the image identifier Fig_2 of image 420 can represent that the specific object in image 420 is located in the left and right areas, and the image identifier Fig_3 of image 430 can represent that the specific object in image 430 is located in the left area.

[0060] Alternatively, multiple images are arranged in a certain order in the folder where the images are stored according to the image identification, for example, the images are arranged in the folder according to the image identification order of Fig_1, Fig_2, Fig_3, and the regularity of the areas where the specific objects in the multiple images are located corresponds to the arrangement order of the images in the folder, and the area where the specific objects in each image are located can also be known based on the arrangement of the images in the folder. That is, when the images are arranged in the folder according to the image identification order of Fig_1, Fig_2, Fig_3, based on the arrangement, it can be known that the area where the specific object in image 410 is located is all areas, the area where the specific object in image 420 is located is the left and right areas, and the area where the specific object in image 430 is located is the left area.

[0061] It can be understood that the rules of the areas where specific objects are located in different images in the above examples are only illustrative examples made to facilitate understanding of the present disclosure. Those skilled in the art can set the rules of the areas where specific objects are located according to actual application scenarios, as long as the area where the specific object is located in the corresponding image can be determined based on image identification.

[0062] In operation S320, a location file is acquired, wherein the location file includes location information of a plurality of areas.

[0063] According to an embodiment of the present disclosure, the position file includes, for example, position information of all regions of the accommodation space in the image. The acquisition method of the multiple images 410, 420, 430 is, for example, consistent, so as to ensure that the position information of the same region in the accommodation space is consistent in different images.

[0064] Figure 5 A schematic diagram of a location file according to an embodiment of the present disclosure is schematically shown.

[0065] like Figure 5 As shown, the position file 510 includes, for example, the position information of all areas in the image, the position information of the upper area of ​​the accommodating space is [(a1, a2), (a3, a4)], [(b1, b2), (b3, b4)], [(c1, a2), (c3, c4)] from left to right; the position information of the lower area of ​​the accommodating space is [(d1, d2), (d3, d4)], [(e1, e2), (e3, e4)], [(f1, f2), (f3, f4)] from left to right.

[0066] In operation S330, a plurality of position subfiles respectively corresponding to the plurality of images are generated based on the plurality of image identifiers and the position files, wherein each position subfile includes position information of an area where a specific object in the corresponding image is located.

[0067] According to the embodiment of the present disclosure, since the image identifier can characterize the area where a specific object is located in the image, a location sub-file corresponding to each image can be automatically generated based on the image identifier and the location file.

[0068] Figure 6 A schematic diagram of generating a location subfile according to an embodiment of the present disclosure is schematically shown.

[0069] First, based on the image identifier, a region where a specific object in the image to which the image identifier belongs is located is determined.

[0070] like Figures 4 to 6 As shown, for example, the image identifier represents the area where the specific object in the image is located. Taking image 410 as an example, according to image identifier Fig_1, it is determined that the specific object in image 410 to which image identifier Fig_1 belongs is located in all areas (for example, the specific object is located in the upper 3 areas and the lower 3 areas in the accommodation space).

[0071] Secondly, the location information of the area where the specific object is located is determined from the location file. For example, the location file 510 includes the location information of all areas. After the area where the specific object is located in the image 410 is determined, the location information of the area where the specific object is located is determined from the location file 510.

[0072] Finally, a position subfile corresponding to the image is generated based on the position information of the area where the specific object is located. For example, a position subfile 610 corresponding to the image 410 is obtained according to the position file 510. The position subfile 610, for example, includes the position information of the area where the specific object is located in the image 410. For example, the specific object in the image 410 is in all areas of the accommodation space, and the position subfile 610 corresponding to the image 410 is automatically generated based on the position file 510, and the position subfile 610, for example, includes the following position information: [(a1, a2), (a3, a4)], [(b1, b2), (b3, b4)], [(c1, a2), (c3, c4)], [(d1, d2), (d3, d4)], [(e1, e2), (e3, e4)], [(f1, f2), (f3, f4)].

[0073] Similarly, the image identifier Fig_2 of the image 420 indicates that the specific object in the image 420 is located in the left and right regions. At this time, the position subfile 620 corresponding to the image 420 is automatically generated according to the position file 510. The position subfile 620 includes, for example, the position information of the region where the specific object in the image 420 is located. Similarly, the position subfile 630 of the image 430 is automatically generated according to the position file 510. The specific process is not repeated here.

[0074] The disclosed embodiment automatically generates a position sub-file corresponding to each image based on image identifications of multiple images and a position file including position information of multiple regions. The position sub-file includes position information of the region where a specific object is located in the corresponding image, thereby automatically generating the position sub-file of the image, improving the efficiency of image annotation, and saving manpower and time costs.

[0075] The specific method of obtaining the location file is described below.

[0076] Figure 7 A schematic diagram of a receiving space according to an embodiment of the present disclosure is schematically shown.

[0077] like Figure 7 As shown, the accommodation space includes a plurality of sub-accommodation spaces, each of which includes a plurality of regions. For example, the accommodation space includes sub-accommodation spaces 710 and 720, and the sub-accommodation space 710 includes a plurality of regions 711, 712, and 713. The sub-accommodation space 720 includes a plurality of regions 721, 722, and 723.

[0078] The acquiring of the location file includes: acquiring location information of a plurality of regions in each sub-accommodating space, and generating the location file based on the location information of the plurality of regions in each sub-accommodating space.

[0079] According to the embodiment of the present disclosure, in the process of acquiring an image through a camera, due to the camera viewing angle factor, the positions of different sub-accommodation spaces in the image are deformed (not just the distance difference). Therefore, in order to ensure the accuracy of the regional position information in the acquired position file, the position information of multiple sub-accommodation spaces is acquired respectively, and the position information combination of the multiple sub-accommodation spaces is the position file.

[0080] Herein, obtaining the location information of multiple areas in a sub-accommodating space is taken as an example.

[0081] First, the position information of a specific area in the sub-accommodation space is obtained.

[0082] According to an embodiment of the present disclosure, the specific area in the sub-accommodation space is, for example, one of the multiple areas in the sub-accommodation space. Taking the sub-accommodation space 710 as an example, the specific area may be, for example, area 711, wherein the position information of area 711 is, for example, [(a1, a2), (a3, a4)]. Wherein, a1 is, for example, the x-axis coordinate of the upper left corner of area 711, a2 is, for example, the y-axis coordinate of the upper left corner of area 711, a3 is, for example, the x-axis coordinate of the lower right corner of area 711, and a4 is, for example, the y-axis coordinate of the lower right corner of area 711.

[0083] Secondly, based on the position information of the specific area, the position information of other areas in the corresponding sub-accommodating space is determined.

[0084] For example, based on the location information of a specific area, the location information of other areas in the sub-accommodation space is automatically generated. For example, based on the location information of area 711 [(a1, a2), (a3, a4)], the location information of area 712 [(a1+m, a2), (a3+m, a4)] is automatically generated, wherein each of the multiple areas 711, 712, and 713 has the same size, for example, and m is, for example, the length of each area in the x direction. Similarly, the location information of area 713 [(a1+2*m, a2), (a3+2*m, a4)] is automatically generated.

[0085] Similarly, for example, by acquiring the position information of a specific area (for example, the specific area is area 721 ) of the sub-accommodating space 720 , the position information of areas 722 and 723 are automatically generated according to the position information of area 721 .

[0086] Of course, within the scope of the accuracy of the location information of each area in the location file meeting the accuracy requirements, the location file can also be obtained without separately obtaining the location information of the sub-accommodation spaces. For example, the location information of a specific area in the accommodation space can be obtained, and the location information of other areas in the accommodation space can be automatically obtained through the location information of the specific area. For example, a specific area in the accommodation space is area 711, and the position information of area 711 is [(a1, a2), (a3, a4)], and the position information of area 712 is automatically generated based on the position information of area 711 [(a1+m, a2), (a3+m, a4)], the position information of area 713 is [(a1+2*m, a2), (a3+2*m, a4)], the position information of area 721 is [(a1, a2+n), (a3, a4+n)], the position information of area 722 is [(a1+m, a2+n), (a3+m, a4+n)], and the position information of area 723 is [(a1+2*m, a2+n), (a3+2*m, a4+n)]. Wherein, n is, for example, the width of each area in the y direction.

[0087] According to an embodiment of the present disclosure, multiple images of the accommodation space are obtained from different viewing angles through multiple cameras, and the image identifier of each image includes corresponding camera information.

[0088] That is, by acquiring multiple images from different viewing angles using multiple cameras, a rich set of image samples can be acquired. The image identifier of each image can also include information about the camera that acquired the image.

[0089] The location file includes, for example, multiple location files, each of which includes camera information. That is, each location file includes multiple area location information in an image acquired by the same camera based on the same viewing angle. Therefore, each location file includes corresponding camera information so that the corresponding location file can be acquired from multiple location files based on the camera information in the image identifier. That is, when the sub-location files of multiple images are automatically generated based on the location file, the camera corresponding to the location file is consistent with the camera that acquires the multiple images. For example, the multiple images are acquired by a camera, and the location file is the multiple area location information in the image acquired by the camera.

[0090] Figure 8 The block diagram schematically shows an information processing device according to an embodiment of the present disclosure.

[0091] like Figure 8 As shown, the information processing device 800 includes a first acquisition module 810 , a second acquisition module 820 and a generation module 830 .

[0092] The first acquisition module 810 may be used to acquire multiple images of the accommodation space, wherein each of the multiple images has an image identifier, the accommodation space includes multiple areas, the areas can be used to accommodate specific objects, and the image identifier represents the area where the specific object in the image is located. According to an embodiment of the present disclosure, the first acquisition module 810 may, for example, execute the above reference Figure 3 The operation S310 described above will not be described in detail here.

[0093] The second acquisition module 820 may be used to acquire a location file, wherein the location file includes location information of multiple areas. According to an embodiment of the present disclosure, the second acquisition module 820 may, for example, execute the above reference Figure 3 The operation S320 described above will not be described in detail here.

[0094] The generation module 830 may be used to generate a plurality of position sub-files corresponding to the plurality of images based on the plurality of image identifiers and the position files, wherein each position sub-file includes the position information of the region where the specific object in the corresponding image is located. Figure 3 The operation S330 described above will not be described in detail here.

[0095] According to an embodiment of the present disclosure, the above-mentioned generation of multiple position sub-files corresponding to multiple images respectively based on multiple image identifiers and position files includes: determining the area where a specific object in the image to which the image identifier belongs is located based on the image identifier, determining the position information of the area where the specific object is located from the position file, and generating a position sub-file corresponding to the image based on the position information of the area where the specific object is located.

[0096] According to an embodiment of the present disclosure, the above-mentioned accommodation space includes: a plurality of sub-accommodation spaces, each of which includes a plurality of areas. Obtaining a location file includes: obtaining location information of the plurality of areas in each sub-accommodation space, and generating a location file based on the location information of the plurality of areas in each sub-accommodation space.

[0097] According to an embodiment of the present disclosure, the acquiring of location information of multiple areas of each sub-accommodating space includes: acquiring location information of a specific area in the sub-accommodating space, and determining location information of other areas in the corresponding sub-accommodating space based on the location information of the specific area.

[0098] According to an embodiment of the present disclosure, the multiple images of the above-mentioned accommodation space are obtained from different viewing angles through multiple cameras, and the image identification of each image includes corresponding camera information.

[0099] According to an embodiment of the present disclosure, the above-mentioned location file includes: a plurality of location files, each location file includes camera information. Acquiring the location file includes: acquiring a corresponding location file from the plurality of location files based on the camera information in the image identifier.

[0100] According to the embodiments of the present invention, any one or more of the modules, submodules, units, and subunits, or at least part of the functions of any one of them can be implemented in one module. According to the embodiments of the present invention, any one or more of the modules, submodules, units, and subunits can be split into multiple modules for implementation. According to the embodiments of the present invention, any one or more of the modules, submodules, units, and subunits can be at least partially implemented as hardware circuits, such as field programmable gate arrays (FPGAs), programmable logic arrays (PLAs), systems on chips, systems on substrates, systems on packages, application specific integrated circuits (ASICs), or can be implemented by hardware or firmware in any other reasonable way of integrating or packaging the circuit, or implemented in any one of the three implementation methods of software, hardware, and firmware, or in any appropriate combination of any of them. Alternatively, according to the embodiments of the present invention, one or more of the modules, submodules, units, and subunits can be at least partially implemented as computer program modules, and when the computer program modules are run, the corresponding functions can be performed.

[0101] For example, any multiple of the first acquisition module 810, the second acquisition module 820, and the generation module 830 can be combined in one module for implementation, or any one of the modules can be split into multiple modules. Alternatively, at least part of the functions of one or more of these modules can be combined with at least part of the functions of other modules and implemented in one module. According to an embodiment of the present disclosure, at least one of the first acquisition module 810, the second acquisition module 820, and the generation module 830 can be at least partially implemented as a hardware circuit, such as a field programmable gate array (FPGA), a programmable logic array (PLA), a system on a chip, a system on a substrate, a system on a package, an application-specific integrated circuit (ASIC), or can be implemented by hardware or firmware such as any other reasonable way of integrating or packaging the circuit, or implemented in any one of the three implementation methods of software, hardware, and firmware, or in any appropriate combination of any of them. Alternatively, at least one of the first acquisition module 810, the second acquisition module 820, and the generation module 830 can be at least partially implemented as a computer program module, and when the computer program module is run, the corresponding function can be performed.

[0102] Fig. 9 The block diagram schematically shows a computer system suitable for information processing according to an embodiment of the present disclosure. Fig. 9The computer system shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0103] like Fig. 9 As shown, the computer system 900 according to the embodiment of the present disclosure includes a processor 901, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 902 or the program loaded from the storage part 908 to the random access memory (RAM) 903. The processor 901 may include, for example, a general-purpose microprocessor (such as a CPU), an instruction set processor and / or a related chipset and / or a special-purpose microprocessor (for example, an application-specific integrated circuit (ASIC)), etc. The processor 901 may also include an onboard memory for caching purposes. The processor 901 may include a single processing unit or multiple processing units for performing different actions of the method flow according to the embodiment of the present disclosure.

[0104] In RAM 903, various programs and data required for the operation of system 900 are stored. Processor 901, ROM 902 and RAM 903 are connected to each other through bus 904. Processor 901 performs various operations of the method flow according to the embodiment of the present disclosure by executing the program in ROM 902 and / or RAM 903. It should be noted that the program can also be stored in one or more memories other than ROM 902 and RAM 903. Processor 901 can also perform various operations of the method flow according to the embodiment of the present disclosure by executing the program stored in the one or more memories.

[0105] According to an embodiment of the present disclosure, the system 900 may further include an input / output (I / O) interface 905, which is also connected to the bus 904. The system 900 may further include one or more of the following components connected to the I / O interface 905: an input section 906 including a keyboard, a mouse, etc.; an output section 907 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 908 including a hard disk, etc.; and a communication section 909 including a network interface card such as a LAN card, a modem, etc. The communication section 909 performs communication processing via a network such as the Internet. A drive 910 is also connected to the I / O interface 905 as needed. A removable medium 911, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 910 as needed, so that a computer program read therefrom is installed into the storage section 908 as needed.

[0106] According to an embodiment of the present disclosure, the method flow according to an embodiment of the present disclosure can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable storage medium, and the computer program contains a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 909, and / or installed from the removable medium 911. When the computer program is executed by the processor 901, the above-mentioned functions defined in the system of the embodiment of the present disclosure are executed. According to an embodiment of the present disclosure, the system, equipment, device, module, unit, etc. described above can be implemented by a computer program module.

[0107] The present disclosure also provides a computer-readable storage medium, which may be included in the device / apparatus / system described in the above embodiments; or may exist independently without being assembled into the device / apparatus / system. The above computer-readable storage medium carries one or more programs, and when the above one or more programs are executed, the method according to the embodiment of the present disclosure is implemented.

[0108] According to an embodiment of the present disclosure, a computer-readable storage medium may be a non-volatile computer-readable storage medium, such as, but not limited to, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in conjunction with an instruction execution system, apparatus, or device.

[0109] For example, according to an embodiment of the present disclosure, the computer-readable storage medium may include the ROM 902 and / or the RAM 903 described above and / or one or more memories other than the ROM 902 and the RAM 903 .

[0110] The flow charts and block diagrams in the accompanying drawings illustrate the possible architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flow chart or block diagram can represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flow chart, and the combination of the boxes in the block diagram or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0111] It will be appreciated by those skilled in the art that the features described in the various embodiments and / or claims of the present disclosure may be combined and / or combined in a variety of ways, even if such combinations and / or combinations are not explicitly described in the present disclosure. In particular, the features described in the various embodiments and / or claims of the present disclosure may be combined and / or combined in a variety of ways without departing from the spirit and teachings of the present disclosure. All of these combinations and / or combinations fall within the scope of the present disclosure.

[0112] The embodiments of the present disclosure are described above. However, these embodiments are only for illustrative purposes and are not intended to limit the scope of the present disclosure. Although the embodiments are described above separately, this does not mean that the measures in the various embodiments cannot be used in combination to advantage. The scope of the present disclosure is defined by the attached claims and their equivalents. Without departing from the scope of the present disclosure, those skilled in the art may make a variety of substitutions and modifications, which should all fall within the scope of the present disclosure.

Claims

1. An information processing method, comprising: Acquire multiple images of the accommodation space from different viewing angles through multiple cameras, wherein each of the multiple images has an image identifier, the accommodation space includes multiple sub-accommodation spaces, each sub-accommodation space includes multiple areas, and the areas can be used to accommodate specific objects. The image identifier represents the area where the specific object in the image is located, and the image identifier of each image includes corresponding camera information; Acquire a position file based on the position information of the multiple areas in each sub-accommodating space, wherein each of the position files includes the position information of the multiple areas in an image acquired by the same camera based on the same viewing angle; and A plurality of position sub-files respectively corresponding to the plurality of images are generated based on the plurality of image identifiers and the position file, wherein each of the position sub-files includes position information of an area where a specific object in the corresponding image is located.

2. The method according to claim 1, wherein: The generating a plurality of position sub-files respectively corresponding to the plurality of images based on the plurality of image identifiers and the position file comprises: Determine, based on the image identifier, a region where a specific object in the image to which the image identifier belongs is located; Determine the location information of the area where the specific object is located from the location file; A position subfile corresponding to the image is generated based on the position information of the area where the specific object is located.

3. The method according to claim 1, wherein: The obtaining of location information of multiple areas of each sub-accommodating space includes: Acquire location information of a specific area in the sub-accommodation space; The position information of other areas in the corresponding sub-accommodating space is determined based on the position information of the specific area.

4. The method according to claim 1, wherein: The location file includes: a plurality of location files, each location file including the camera information; The obtaining of the location file includes: obtaining a corresponding location file from the plurality of location files based on the camera information in the image identifier.

5. An information processing device, comprising: A first acquisition module acquires multiple images of the accommodation space from different viewing angles through multiple cameras, wherein each of the multiple images has an image identifier, the accommodation space includes multiple sub-accommodation spaces, each sub-accommodation space includes multiple areas, and the areas can be used to accommodate specific objects. The image identifier represents the area where the specific object in the image is located, and the image identifier of each image includes corresponding camera information; A second acquisition module, acquiring a location file based on the location information of the multiple areas in each sub-accommodation space, wherein each of the location files includes the location information of the multiple areas in an image acquired by the same camera based on the same viewing angle; and A generating module generates a plurality of position sub-files corresponding to the plurality of images respectively based on the plurality of image identifiers and the position file, wherein each of the position sub-files includes position information of an area where a specific object in the corresponding image is located.

6. The device according to claim 5, wherein: The generating a plurality of position sub-files respectively corresponding to the plurality of images based on the plurality of image identifiers and the position file comprises: Determine, based on the image identifier, a region where a specific object in the image to which the image identifier belongs is located; Determine the location information of the area where the specific object is located from the location file; A position subfile corresponding to the image is generated based on the position information of the area where the specific object is located.

7. The device according to claim 5, wherein: The obtaining of location information of multiple areas of each sub-accommodating space includes: Acquire location information of a specific area in the sub-accommodation space; The position information of other areas in the corresponding sub-accommodating space is determined based on the position information of the specific area.

8. The device according to claim 5, wherein: The location file includes: a plurality of location files, each location file including the camera information; The obtaining of the location file includes: obtaining a corresponding location file from the plurality of location files based on the camera information in the image identifier.

9. An information processing system comprising: one or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors execute the method according to any one of claims 1 to 4.

10. A computer-readable storage medium having executable instructions stored thereon, which, when executed by a processor, causes the processor to execute the method according to any one of claims 1 to 4.