Distance and height determination method and device based on multiple sensors

[0080]Specific embodiments of the present invention will be described in detail below, and it should be noted that the embodiments described here are only for illustration, not for limiting the present invention. In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention. It will be apparent, however, to one of ordinary skill in the art that these specific details need not be employed to practice the present invention. In other instances, well-known circuits, materials or methods have not been described in detail in order to avoid obscuring the present invention.

[0081] Throughout this specification, reference to "one embodiment," "an embodiment," "an example," or "example" means that a particular feature, structure, or characteristic described in connection with the embodiment or example is included in the present invention. In at least one embodiment. Thus, appearances of the phrases "in one embodiment," "in an embodiment," "an example," or "example" in various places throughout this specification are not necessarily all referring to the same embodiment or example. Furthermore, particular features, structures or characteristics may be combined in any suitable combination and/or subcombination in one or more embodiments or examples.

[0082] It will be understood that when an element is referred to as being "coupled" or "connected" to another element, it can be directly coupled or connected to the other element or intervening elements may be present. In contrast, when an element is referred to as being "directly coupled to" or "directly connected to" another element, there are no intervening elements present.

[0083] Additionally, as used herein, the term "and/or" includes any and all combinations of one or more of the associated listed items.

[0084] It will be understood that nouns to which a term corresponds in the singular may include one or more items unless the relevant context clearly dictates otherwise. As used herein, terms such as "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C" Each of the phrases "a" and "at least one of A, B, or C" may include all possible combinations of items recited with the corresponding one of the plurality of phrases. As used herein, terms such as "first" and "second" or "first" and "second" can be used to simply distinguish a corresponding component from another component, and not in other respects (eg, importance) or sequence) to limit the components.

[0085] As used herein, the term "module" may include a unit implemented in hardware, software, or firmware, and may be interchangeable with other terms (eg, "logic," "logic block," "section," or "circuit") to use. A module may be a single integrated component adapted to perform one or more functions or be the smallest unit or part of the single integrated component. For example, according to an embodiment, a module may be implemented in the form of an Application Specific Integrated Circuit (ASIC).

[0086] It should be understood that the various embodiments of the present disclosure and the terms used therein are not intended to limit the technical features set forth herein to specific embodiments, but include various changes, equivalents or replacements for corresponding embodiments . Unless otherwise expressly defined herein, all terms are to be given their broadest possible interpretations, including the implied meanings in the specification as well as the meanings understood by those skilled in the art and/or defined in dictionaries, treatises, and the like.

[0087] Additionally, those of ordinary skill in the art will appreciate that the drawings provided herein are for illustrative purposes and are not necessarily drawn to scale. For the description of the figures, like reference numerals may be used to designate like or related elements. Hereinafter, the present disclosure will be described by way of example with reference to the accompanying drawings.

[0088] In order to solve the problems described in the background technology section, an embodiment of the present disclosure provides a multi-sensor-based distance and height determination method and device for determining whether a subject is taking drugs based on a pupil image, the method includes : Utilize the first sensor, the second sensor and the third sensor located on the security inspection device to respectively measure the first distance, the second distance and the third distance from the measured object to it, and measure the first height of the measured object , the second height and the third height; using the first determination unit to respectively determine the size relationship between each distance in the first distance, the second distance and the third distance and the minimum distance threshold and the maximum distance threshold; Utilize the second determining unit, based on the size relationship between each of the determined first distance, second distance and third distance and the minimum distance threshold and the maximum distance threshold, determine the final distance and the distance between the measured object and the security inspection device The final height of the measured object; and according to the determined final distance and final height, pixel and size conversion is performed on the pupil image of the measured object to determine whether the measured object takes drugs.

[0089] The present disclosure will be described in detail below with reference to the accompanying drawings and specific embodiments.

[0090] figure 1 A system architecture of a method for determining distance and height based on multiple sensors according to an embodiment of the present disclosure is schematically shown. The system architecture 100 is the overall architecture for detecting drug addicts, in which a remote infrared pupil collection device is installed on the security inspection machine, which identifies and detects the pupils of the tested personnel. After obtaining the pupil image of the tested person, the pixel and size conversion is performed on the pupil image based on the height of the tested person and the distance from the tested person to the security inspection device, and then based on the converted pupil image, it is determined whether the tested person is a drug addict.

[0091] Therefore, the method for determining distance and height based on multi-sensors and the device thereof provided by the present application are very important for confirming whether a person under test takes drugs.

[0092] figure 2 An example arrangement of a plurality of sensors according to an embodiment of the disclosure is schematically shown.

[0093] like figure 2 As shown, the first sensor is arranged at a height of a meter from the ground, the second sensor is arranged at a height of b meters from the ground, and the third sensor is arranged at a height of c meters from the ground.

[0094] There are also two reference points set on the ground, namely the near point A and the far point B. Wherein, the close point A is the shortest distance between the measured person and the sensor under the detection capability of the sensor, and the far point B is the furthest distance between the measured person and the sensor under the detection capability of the sensor.

[0095] In this article, connect the proximity point A to the security check device ( figure 2 The distance between point o in ) is set as the minimum distance threshold, and the distance between point B and the security inspection device ( figure 2 The distance of point o in ) is set as the maximum distance threshold to be used in the processing described below.

[0096] In an exemplary embodiment, the first sensor, the second sensor, and the third sensor may be the same sensor, or may be different sensors.

[0097] In case the first sensor, the second sensor and the third sensor are the same sensor, for example, when the detection capability of the sensor is 300cm to 400cm, the minimum distance threshold is 280cm, and the maximum distance threshold is 420cm.

[0098] Since the flow of people usually passes through the security inspection machine continuously during the security inspection, it may occur that multiple tested persons pass through the security inspection device in close proximity.

[0099] In view of this situation, for the purpose of making the measured results more accurate, a predetermined distance between the measured persons is also set in this application.

[0100] Preferably, the predetermined distance between the measured persons may be set to 20cm.

[0101] image 3 A flow chart of a method for determining distance and height based on multiple sensors according to an embodiment of the present disclosure is schematically shown.

[0102] like image 3 As shown, the method includes the following operations.

[0103] At operation S301, using the first sensor, the second sensor, and the third sensor located on the security inspection device, respectively measure the first distance, the second distance, and the third distance from the object to be measured, and measure the first distance of the object to be measured. One height, second height and third height.

[0104] In operation S303, a relationship between each of the first distance, the second distance and the third distance and the minimum distance threshold and the maximum distance threshold is respectively determined by using the first determination unit.

[0105] The first determination unit may be configured to be set on the security inspection device.

[0106] Alternatively, the first determining unit may be configured to reside in another processing device that is wired or wirelessly connected to the security inspection device.

[0107] In operation S305, using the second determination unit, based on the determined relationship between each of the first distance, the second distance and the third distance and the minimum distance threshold and the maximum distance threshold, determine the distance between the measured object and the security inspection device The final distance and the final height of the subject being measured.

[0108] In this paper, the final distance and final height of the measured object from the security inspection device can be defined as the optimal distance and height determined for the measured person based on the distances and heights measured by the first sensor, the second sensor and the third sensor. distance and height.

[0109] The second determination unit may be configured to be disposed in the security inspection device.

[0110] Alternatively, the second determination unit may be configured to be disposed in another processing device that is wired or wirelessly connected to the security inspection device.

[0111] This application considers unfavorable factors such as sensor failure, personnel overlap, and intentional occlusion, and makes a judgment based on the measurement results of multiple sensors (that is, the first sensor, the second sensor, and the third sensor) to determine the The closest distance and height between the real distance from the security inspection device and the real height of the measured object (that is, the final distance and final height in this paper). The relationship between the distance values ​​measured by the first sensor, the second sensor, and the third sensor and the minimum distance threshold and the maximum distance threshold will be described below, and the final distance and final height will be determined in conjunction with the predetermined distance between the measured persons.

[0112] Figure 4 An example flow chart of the first case of determining the final distance and the final height according to an embodiment of the present disclosure is schematically shown.

[0113] like Figure 4 As shown, the method includes the following operations.

[0114] At operation S401, it is determined whether the first distance is smaller than a minimum distance threshold.

[0115] At operation S403, it is determined whether the second distance is smaller than a minimum distance threshold.

[0116] At operation S405, it is determined whether the third distance is smaller than a minimum distance threshold.

[0117] At operation S407, it is determined whether the first distance is greater than a maximum distance threshold.

[0118] At operation S409, it is determined whether the second distance is greater than a maximum distance threshold.

[0119] At operation S411, it is determined whether the third distance is greater than a maximum distance threshold.

[0120] When it is determined in operations S403 and S405 that both the second distance and the third distance are smaller than the minimum distance threshold, regardless of the relationship of the first distance to the minimum distance threshold and the maximum distance threshold, the process proceeds to operation S413.

[0121] In operation S413, the first distance is determined as the final distance of the measured object from the security inspection device, and accordingly, the first height is determined as the final height of the measured object.

[0122] In order to make the figure clear, Figure 4Only partially shows the case where the second distance and the third distance are both smaller than the minimum distance threshold (at this time, regardless of the relationship between the first distance and the minimum distance threshold or the maximum distance threshold, the result is the same), for other situation, please refer to Figure 5 to Figure 12 and related descriptions.

[0123] Figure 5 An example flowchart of the second case of determining the final distance and the final height according to an embodiment of the present disclosure is schematically shown.

[0124] like Figure 5 As shown, the method includes the following operations.

[0125] At operation S501, the execution is similar to Figure 4 Operations in operations S403, S405, S409, and S411.

[0126] In operation S503, it is determined that the second distance is less than the minimum distance threshold, and the third distance is greater than or equal to the minimum distance threshold and less than or equal to the maximum distance threshold.

[0127] In operations S505 and S507, perform the Figure 4 In operations S404 and S407, a relationship between the first distance and the minimum distance threshold and the maximum distance threshold is determined.

[0128] When it is determined in operation S505 that the first distance is less than the minimum distance threshold, or when it is determined in operation S507 that the first distance is greater than the maximum distance threshold, the process proceeds to operation S509.

[0129] In operation S509, the third distance is determined as the final distance, and the third height is determined as the final height.

[0130] When it is determined through operations S505 and S507 that the first distance is greater than or equal to the minimum distance threshold and less than or equal to the maximum distance threshold ("No" in operation S507), the process proceeds to operation S511.

[0131] In operation S511, it is determined whether an absolute value of a difference between the second distance and the third distance is smaller than a predetermined distance between people to be measured.

[0132] When the determination result in operation S511 is "Yes", the process proceeds to operation S513.

[0133] In operation S513, the second distance is determined as the final distance, and the second height is determined as the final height.

[0134] When the determination result in operation S511 is "No", the process proceeds to operation S515.

[0135] In operation S515, the smaller distance (for example, the third distance) among the second distance and the third distance is determined as the final distance, and the height corresponding to the smaller distance (for example, the third height) is determined as final height.

[0136] Image 6 An example flowchart of the third case of determining the final distance and the final height according to an embodiment of the present disclosure is schematically shown.

[0137] like Image 6 As shown, the method includes the following operations.

[0138] At operation S601, the execution is similar to Figure 4 Operations in operations S403, S405, S409, and S411.

[0139] At operation S603, it is determined that the second distance is less than the minimum distance threshold, and the third distance is greater than the maximum distance threshold.

[0140] At operation S605, the execution is similar to Figure 4 The operation in operation S401.

[0141] When the determination result in operation S605 is "Yes", the process proceeds to operation S609.

[0142] In operation S609, the third distance is determined as the final distance, and the third height is determined as the final height.

[0143] When the determination result in operation S605 is "No", the process proceeds to operation S607.

[0144] In operation S607, the execution is similar to Figure 4 The operation in operation S407.

[0145] When the determination result in operation S607 is "Yes", the smaller distance (for example, the third distance) among the first distance and the third distance is determined as the final distance, and the height corresponding to the smaller distance ( For example, third height) is determined as the final height.

[0146] When the determination result in operation S607 is "No" (ie, the first distance is greater than or equal to the minimum distance threshold and less than or equal to the maximum distance threshold), the process proceeds to operation S613.

[0147] In operation S613, the first distance is determined as the final distance, and the first height is determined as the final height.

[0148] Figure 7 An example flow chart of the fourth case of determining the final distance and the final height according to an embodiment of the present disclosure is schematically shown.

[0149] like Figure 7 As shown, the method includes the following operations.

[0150] At operation S701, the execution is similar to Figure 4 Operations in operations S403, S405, S409, and S411.

[0151] At operation S703, it is determined that the second distance is greater than or equal to the minimum distance threshold and less than or equal to the maximum distance threshold, and the third distance is less than the minimum distance threshold.

[0152] At operations S705 and S707, the execution is similar to Figure 4 Operations in operations S401 and S407.

[0153] When it is determined in operation S705 that the first distance is less than the minimum distance threshold, or when it is determined in operation S707 that the first distance is greater than the maximum distance threshold, the process proceeds to operation S709.

[0154] In operation S709, the second distance is determined as the final distance, and the second height is determined as the final height.

[0155] When the determination result in operation S707 is "No" (ie, the first distance is greater than or equal to the minimum distance threshold and less than or equal to the maximum distance threshold), the process proceeds to operation S711.

[0156] In operation S711, it is determined whether an absolute value of a difference between the first distance and the second distance is smaller than a predetermined distance between people to be measured.

[0157] When the determination result in operation S711 is "Yes", the process proceeds to operation S713.

[0158] In operation S713, the first distance is determined as the final distance of the location, and the first height is determined as the final height.

[0159] When the determination result in operation S711 is "No", the process proceeds to operation S715.

[0160] In operation S715, the smaller distance of the first distance and the second distance is determined as the final distance, and the height corresponding to the smaller distance is determined as the final height.

[0161] Figure 8 An example flow chart of the fifth case of determining the final distance and the final height according to an embodiment of the present disclosure is schematically shown.

[0162] like Figure 8 As shown, the method includes the following operations.

[0163] At operation S801, the execution is similar to Figure 4 Operations in operations S403, S405, S409, and S411.

[0164] In operation S803, it is determined that the second distance is greater than or equal to the minimum distance threshold and less than or equal to the maximum distance threshold, and the third distance is greater than or equal to the minimum distance threshold and less than or equal to the maximum distance threshold.

[0165] At operations S805 and S807, the execution is similar to Figure 4 Operations in operations S401 and S407.

[0166] When it is determined in operation S805 that the first distance is less than the minimum distance threshold, or when it is determined in operation S807 that the first distance is greater than the maximum distance threshold, the process proceeds to operation S809.

[0167] In operation S809, it is determined whether an absolute value of a difference between the second distance and the third distance is smaller than a predetermined distance between people to be measured.

[0168] When the determination result in operation S809 is "Yes", the process proceeds to operation S811.

[0169] In operation S811, the second distance is determined as the final distance, and the second height is determined as the final height.

[0170] When the determination result in operation S809 is "No", the process proceeds to operation S813.

[0171] In operation S813, a smaller distance among the second distance and the third distance is determined as the final distance, and a height corresponding to the smaller distance is determined as the final height.

[0172] When the determination result in operation S807 is "No" (ie, the first distance is greater than or equal to the minimum distance threshold and less than or equal to the maximum distance threshold), the process proceeds to operation S815.

[0173] In operation S815, the absolute value of the difference between the first distance and the second distance, the absolute value of the difference between the second distance and the third distance, and the absolute value of the difference between the first distance and the third distance are determined. The relationship between each value and the predetermined distance between the measured personnel.

[0174] On this basis, eight different cases C1 to C8 can be derived in S815. Each case will be described in detail below.

[0175] In case C1, the absolute value of the difference between the first distance and the second distance, the absolute value of the difference between the second distance and the third distance, and the absolute value of the difference between the first distance and the third distance All less than the predetermined distance between the measured personnel (for the convenience of description, the first distance is represented as Da, the second distance is represented as Db, the third distance is represented as Dc, and the predetermined measured personnel distance is represented as PTPD) , at this time, the first distance is determined as the final distance, and the first height is determined as the final height.

[0176] In case C2, |Da-Db|≥PTPD, |Db-Dc|

[0177] In case C3, |Da-Db|

[0178] In case C4, |Da-Db|

[0179]In case C5, |Da-Db|

[0180] In case C6, |Da-Db|≥PTPD, |Db-Dc|

[0181] In case C7, |Da-Db|≥PTPD, |Db-Dc|≥PTPD, |Da-Dc|

[0182] In case C8, |Da-Db|≥PTPD, |Db-Dc|≥PTPD, |Da-Dc|≥PTPD, the third distance is determined as the final distance, and the third height is determined as the final height.

[0183] Figure 9 Schematically shows an example flow chart of the sixth case of determining the final distance and the final height according to an embodiment of the present disclosure.

[0184] like Figure 9 As shown, the method includes the following operations.

[0185] At operation S901, the execution is similar to Figure 4 Operations in operations S403, S405, S409, and S411.

[0186] At operation S903, it is determined that the second distance is greater than or equal to the minimum distance threshold and less than or equal to the maximum distance threshold, and the third distance is greater than the maximum distance threshold.

[0187] At operations S905 and S907, the execution is similar to Figure 4 Operations in operations S401 and S407.

[0188] When it is determined in operation S905 that the first distance is less than the minimum distance threshold, or when it is determined in operation S907 that the first distance is greater than the maximum distance threshold, the process proceeds to operation S909.

[0189] In operation S909, the second distance is determined as the final distance, and the second height is determined as the final height.

[0190] When the determination result in operation S907 is "No", the process proceeds to operation S911.

[0191] In operation S911, it is determined whether |Da-Db| is smaller than PTPD.

[0192] When less, the process proceeds to operation S913, in which the first distance is determined as the final distance, and the first height is determined as the final height.

[0193] When greater than or equal to, the process proceeds to operation S915 in which the smaller distance of the first distance and the second distance is determined as the final distance, and the height corresponding to the smaller distance is determined as the final height.

[0194] Figure 10 An example flow chart of the seventh case of determining the final distance and the final height according to an embodiment of the present disclosure is schematically shown.

[0195] like Figure 10 As shown, the method includes the following operations.

[0196] At operation S1001, the execution is similar to Figure 4 Operations in operations S403, S405, S409, and S411.

[0197] At operation S1003, it is determined that the second distance is greater than the maximum distance threshold, and the third distance is less than the minimum distance threshold.

[0198] At operation S1005, the execution is similar to Figure 4 The operation in operation S401.

[0199] When the determination result in operation S1005 is "Yes", the process proceeds to operation S1007.

[0200] In operation S1007, the second distance is determined as the final distance, and the second height is determined as the final height.

[0201] At operation S1009, the execution is similar to Figure 4 The operation in operation S407.

[0202] When the determination result in operation S1009 is "Yes", the process proceeds to operation S1011.

[0203] At operation S1011, a smaller distance among the first distance and the second distance is determined as a final distance, and a height corresponding to the smaller distance is determined as a final height.

[0204] When the determination result in operation S1009 is "No", the process proceeds to operation S1013.

[0205] At operation S1013, the first distance is determined as the final distance, and the first height is determined as the final height.

[0206] Figure 11 An example flowchart of an eighth case of determining the final distance and the final height according to an embodiment of the present disclosure is schematically shown.

[0207] like Figure 11 As shown, the method includes the following operations.

[0208] At operation S1101, the execution is similar to Figure 4 Operations in operations S403, S405, S409, and S411.

[0209] At operation S1103, it is determined that the second distance is greater than the maximum distance threshold, and the third distance is greater than or equal to the minimum distance threshold and less than or equal to the maximum distance threshold.

[0210] At operations S1105 and S1107, a method similar to Figure 4 Operations in operations S401 and S407.

[0211] When the determination result in operation S1105 is "Yes", or when the determination result in operation S1107 is "Yes", the process proceeds to operation S1109.

[0212] At operation S1109, the third distance is determined as the final distance, and the third height is determined as the final height.

[0213] When the determination result in operation S1107 is "No", the process proceeds to operation S1111.

[0214] At operation S1111, it is determined whether |Da-Dc| is smaller than PTPD.

[0215] When less, the process proceeds to operation S1113, in which the first distance is determined as the final distance, and the first height is determined as the final height.

[0216] When greater than or equal to, the process proceeds to operation S1115, in which the smaller distance of the first distance and the third distance is determined as the final distance, and the height corresponding to the smaller distance is determined as the final height.

[0217] Figure 12 An exemplary flow chart of a ninth case of determining the final distance and the final height according to an embodiment of the present disclosure is schematically shown.

[0218] like Figure 12 As shown, the method includes the following operations.

[0219] At operation S1201, the execution is similar to Figure 4 Operations in operations S403, S405, S409, and S411.

[0220] At operation S1203, it is determined that both the second distance and the third distance are greater than a maximum distance threshold.

[0221] At operation S1205, the execution is similar to Figure 4 The operation in operation S401.

[0222] When the determination result in operation S1205 is "Yes", the process proceeds to operation S1207.

[0223] At operation S1207, the smaller distance of the second distance and the third distance is determined as the final distance, and the height corresponding to the smaller distance is determined as the final height.

[0224] At operation S1209, the execution is similar to Figure 4 The operation in operation S407.

[0225] When the determination result in operation S1209 is "Yes", the process proceeds to operation S1211.

[0226] At operation S1211, a minimum distance among the first distance, the second distance, and the third distance is determined as a final distance, and a height corresponding to the minimum distance is determined as a final height.

[0227] When the determination result in operation S1209 is "No", the process proceeds to operation S1213.

[0228] At operation S1213, the first distance is determined as the final distance, and the first height is determined as the final height.

[0229] Figure 13 A block diagram schematically shows a multi-sensor-based distance and height determining device for determining whether a subject is taking drugs based on a pupil image according to an embodiment of the present disclosure.

[0230] like Figure 13 As shown, the device 300 for determining distance and height based on multiple sensors may include a security inspection device 1301, a first determination unit 1309, and a second determination unit 1311, wherein the security inspection device 1301 may include a first sensor 1303, a second sensor 1305, and a third sensor Sensor 1307.

[0231] The first sensor, the second sensor and the third sensor located on the security inspection device may be configured to respectively measure the first distance, the second distance and the third distance from the measured object to it, and measure the first height, the first height, and the third distance of the measured object. second height and third height;

[0232] The first determination unit may be configured to determine a relationship between each of the first distance, the second distance and the third distance and a minimum distance threshold and a maximum distance threshold, respectively; and

[0233] The second determination unit may be configured to determine the final distance and distance between the measured object and the security inspection device based on the determined relationship between each of the determined first distance, the second distance and the third distance and the minimum distance threshold and the maximum distance threshold. The final height of the measured object; and performing pixel and size conversion on the pupil image of the measured object according to the determined final distance and final height, so as to determine whether the measured object takes drugs.

[0234] In addition to the above modules 1301 to 1309, the device for determining distance and height based on multiple sensors may further include other modules for correspondingly performing the above various operations.

[0235] For the sake of clarity and brevity, the details of each module and the corresponding operations performed therein are omitted here.

[0236]Functions of a plurality of modules according to an embodiment of the present disclosure may be implemented in one module. A module according to an embodiment of the present disclosure may be implemented by splitting into multiple modules. Modules according to embodiments of the present disclosure may be implemented at least in part as hardware circuits, such as Field Programmable Gate Arrays (FPGAs), Programmable Logic Arrays (PLAs), System-on-Chip, System-on-Substrate, System-on-Package, Application-Specific Integrated circuit (ASIC), or can be implemented by hardware or firmware in any other reasonable way of integrating or packaging the circuit, or in any one of the three implementations of software, hardware and firmware, or in any of them. combination to achieve. Or, a module according to an embodiment of the present disclosure may be at least partially implemented as a computer program module, and when the computer program module is executed, corresponding functions may be performed.

[0237] According to an embodiment of the present disclosure, at least one of the above-mentioned modules may be at least partially implemented as a hardware circuit, such as a field programmable gate array (FPGA), a programmable logic array (PLA), a system on a chip, a system on a substrate, a package system, application-specific integrated circuit (ASIC), or any other reasonable way of integrating or packaging circuits, such as hardware or firmware, or any of the three implementation methods of software, hardware, and firmware, or by Any suitable combination of any of them can be realized. Optionally, at least one of the above-mentioned modules can be at least partially implemented as a computer program module, and when the computer program module is executed, corresponding functions can be performed.

[0238] Figure 14 A block diagram of an electronic device adapted to implement the method for picking goods described above according to an embodiment of the present disclosure is schematically shown. Figure 14 The illustrated electronic device is only an example, and should not impose any limitation on the functions and scope of use of the embodiments of the present disclosure.

[0239] like Figure 8 As shown, an electronic device 1400 according to an embodiment of the present disclosure includes a processor 1401 that can operate according to a program stored in a read only memory (ROM) 1402 or a program loaded from a storage section 1408 into a random access memory (RAM) 1403 Various appropriate actions and processes are performed. Processor 1401 may include, for example, a general-purpose microprocessor (eg, a CPU), an instruction set processor and/or related chipsets, and/or a special-purpose microprocessor (eg, an application-specific integrated circuit (ASIC)), and the like. Processor 1401 may also include on-board memory for caching purposes. The processor 1401 may include a single processing unit or multiple processing units for executing different actions of the method flow according to the embodiments of the present disclosure.

[0240] In the RAM 1403, various programs and data necessary for the operation of the electronic device 1400 are stored. The processor 1401 , ROM 1402 , and RAM 1403 are connected to each other through a bus 1404 . The processor 1401 executes various operations according to the method flow of the embodiment of the present disclosure by executing programs in the ROM 1402 and/or RAM 1403 . It should be noted that the program may also be stored in one or more memories other than the ROM 1402 and the RAM 1403 . The processor 1401 may also perform various operations according to the method flow of the embodiments of the present disclosure by executing programs stored in the one or more memories.

[0241] According to an embodiment of the present disclosure, the electronic device 1400 may further include an input/output (I/O) interface 1405 which is also connected to the bus 1404 . The electronic device 1400 may also include one or more of the following components connected to the I/O interface 1405: an input portion 1406 including a keyboard, a mouse, etc.; including a cathode ray tube (CRT), a liquid crystal display (LCD), etc.; an output section 1407 of a speaker or the like; a storage section 1408 including a hard disk or the like; and a communication section 1409 including a network interface card such as a LAN card, a modem, or the like. The communication section 1409 performs communication processing via a network such as the Internet. A drive 810 is also connected to the I/O interface 1405 as needed. A removable medium 811 such as a magnetic disk, optical disk, magneto-optical disk, semiconductor memory, etc. is mounted on the drive 810 as necessary so that a computer program read therefrom is installed into the storage section 1408 as necessary.

[0242] According to the embodiments of the present disclosure, the method flow according to the embodiments of the present disclosure can be implemented as a computer software program. For example, the embodiments of the present disclosure include a computer program product, which includes a computer program carried on a computer-readable storage medium, where the computer program includes program codes for executing the methods shown in the flowcharts. In such an embodiment, the computer program may be downloaded and installed from a network via communication portion 1409 and/or installed from removable media 811 . When the computer program is executed by the processor 1401, the above-mentioned functions defined in the system of the embodiment of the present disclosure are performed. According to the embodiments of the present disclosure, the above-described systems, devices, devices, modules, units, etc. may be implemented by computer program modules.

[0243] The present disclosure also provides a computer-readable storage medium. The computer-readable storage medium may be included in the device/apparatus/system described in the above embodiments; it may also exist independently without being assembled into the device/system device/system. The above-mentioned computer-readable storage medium carries one or more programs, and when the above-mentioned one or more programs are executed, the method according to the embodiment of the present disclosure is implemented.

[0244] According to an embodiment of the present disclosure, the computer-readable storage medium may be a non-volatile computer-readable storage medium, such as may include but not limited to: portable computer disk, hard disk, random access memory (RAM), read-only memory (ROM) , erasable programmable read-only memory (EPROM or flash memory), portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. For example, according to an embodiment of the present disclosure, a computer-readable storage medium may include one or more memories other than the above-described ROM 1402 and/or RAM 1403 and/or ROM 1402 and RAM 1403 .

[0245] The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in a flowchart or block diagram may represent a module, program segment, or portion of code that includes one or more logical functions for implementing specified executable instructions. It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or they may sometimes be executed in the reverse order, depending upon the functionality involved. It should also be noted that each block in the block diagrams or flowchart illustrations, and combinations of blocks in the block diagrams or flowchart illustrations, can be implemented by a dedicated hardware-based system that performs the specified function or operation, or can be implemented by a A combination of dedicated hardware and computer instructions.

[0246] Those skilled in the art can understand that various combinations and/or combinations can be made in the various embodiments of the present disclosure and/or the features described in the claims, even if such combinations or combinations are not explicitly recorded in the present disclosure. In particular, without departing from the spirit and teaching of the present disclosure, the various embodiments of the present disclosure and/or the features described in the claims can be combined and/or combined in various ways. All such combinations and/or combinations fall within the scope of the present disclosure.

[0247] The embodiments of the present disclosure have been described above. However, these examples are for illustrative purposes only and are not intended to limit the scope of the present disclosure. Although the various embodiments have been described separately above, this does not mean that the measures in the various embodiments cannot be advantageously used in combination. The scope of the present disclosure is defined by the appended claims and their equivalents. Various substitutions and modifications can be made by those skilled in the art without departing from the scope of the present disclosure, and these substitutions and modifications should all fall within the scope of the present disclosure.