Information interaction method, device, system, mobile device and electronic device

Abstract

The present disclosure provides an information interaction method, device, system, mobile device and electronic device. The information interaction method includes: receiving first search information from a first terminal; sending second search information to multiple second terminals according to the first search information, wherein the second terminal is a mobile device provided with an image acquisition device and an image analysis device; receiving third search information sent by at least one of the second terminals according to the second search information, and returning the search result to the first terminal. The information interaction method provided by the present disclosure can expand the information distribution objects, expand the information interaction scope, and improve the efficiency of information interaction.

Description

Background Art

[0002] In the related art, the method of searching for missing persons is usually to perform face recognition on the video taken by the camera installed on the building based on the information such as pictures or time provided by the reporter, and then conduct manual search. This method is severely limited by the deployment density and coverage of the camera, especially at night, due to the influence of lighting, shooting position, and obstructions. Fixed cameras often provide high-quality reference images, which seriously reduces the search efficiency and search success rate. Therefore, this method of searching through fixed cameras often cannot efficiently find missing persons.

[0003] Therefore, a technical solution that can improve search efficiency is needed.

[0004] It should be noted that the information disclosed in the above background technology section is only used to enhance the understanding of the background of the present disclosure, and therefore may include information that does not constitute the prior art known to ordinary technicians in the field. Summary of the invention

[0005] The purpose of the present disclosure is to provide an information interaction method and an information interaction device, which are used to overcome, at least to a certain extent, the problem of low search tool density and limited coverage resulting in unsatisfactory search efficiency due to the limitations and defects of related technologies.

[0006] According to a first aspect of an embodiment of the present disclosure, there is provided an information interaction method, comprising: receiving first search information from a first terminal; sending second search information to multiple second terminals based on the first search information, wherein the second terminals are mobile devices provided with an image acquisition device and an image analysis device; receiving third search information sent by at least one of the second terminals based on the second search information, and returning search results to the first terminal.

[0007] In an exemplary embodiment of the present disclosure, the second terminal is an intelligent transportation tool, and the intelligent transportation tool includes at least a smart car and an unmanned aerial vehicle.

[0008] In an exemplary embodiment of the present disclosure, the smart transportation vehicle is provided with a camera, and the third search information is determined by the smart transportation vehicle based on a matching result between a picture taken by the camera and the second search information, wherein the first search information and the second search information include facial images.

[0009] In an exemplary embodiment of the present disclosure, the first search information includes at least a search object image, a missing time period, a missing location range, and a search object description information; the second search information includes at least a search information identifier, a search object image, a search object description information, and a third search information image matching degree threshold.

[0010] In an exemplary embodiment of the present disclosure, sending second search information to multiple second terminals according to the first search information includes:

[0011] The second terminal for receiving the first search information is determined according to the missing time period and the missing location range.

[0012] In an exemplary embodiment of the present disclosure, sending second search information to multiple second terminals according to the first search information includes:

[0013] The second search information is broadcasted through a roadside unit, or the second search information is broadcasted through a cellular base station, or the second search information is sent through the Internet.

[0014] In an exemplary embodiment of the present disclosure, the second terminal returns the third search information via the Internet.

[0015] According to a second aspect of an embodiment of the present disclosure, a mobile device is provided, including:

[0016] A power device, used to control the movement of the mobile device;

[0017] An image acquisition device, used for acquiring images;

[0018] A communication device, used for receiving search information from a server and sending search results to the server, wherein the search information and the search results both include images;

[0019] A memory, coupled to the image acquisition device, for storing images acquired by the image acquisition device;

[0020] A processor, coupled to the image acquisition device, the communication device and the memory, is used to execute the following method:

[0021] Responding to the search information, acquiring the image to be identified from the image acquisition device and the memory;

[0022] Matching the image to be identified with the image provided by the search information;

[0023] Generating the search result according to the to-be-identified images whose matching degree exceeds a preset threshold;

[0024] Control the communication device to send the search result to the server.

[0025] In an exemplary embodiment of the present disclosure, the search information includes a missing time period, and acquiring the image to be identified from the image acquisition device and the memory in response to the search information includes:

[0026] The image to be identified is acquired from the memory according to the missing time period.

[0027] In an exemplary embodiment of the present disclosure, the search information includes a face image, and matching the image to be identified with the image provided by the search information includes:

[0028] Performing face recognition detection on the image to be recognized, and determining the image to be recognized in which the face is recognized;

[0029] Perform face matching between the image to be identified in which the face is identified and the image provided by the search information.

[0030] According to a third aspect of an embodiment of the present disclosure, there is provided an information interaction device, including:

[0031] An information receiving module, configured to receive first search information from a first terminal;

[0032] an information distribution module, configured to send second search information to a plurality of second terminals according to the first search information, wherein the second terminals are mobile devices provided with an image acquisition device and an image analysis device;

[0033] The information feedback module is configured to receive third search information sent by at least one of the second terminals according to the second search information, and return the search result to the first terminal.

[0034] According to a fourth aspect of the present disclosure, there is provided an information interaction system, comprising:

[0035] The first terminal is used to publish first search information to the server cluster in response to a user request;

[0036] A server cluster communicates with the first terminal through a preset communication method, and is used to execute the information interaction method as described in any one of the above items, and send second search information to multiple second terminals according to the first search information;

[0037] Multiple second terminals, each of which is provided with an image acquisition device and an image analysis device, communicates with the server cluster through a preset communication method, is used to perform target search through the image acquisition device and the image analysis device according to the second search information, and sends the search results to the server cluster through third search information.

[0038] According to a fifth aspect of the present disclosure, there is provided an information interaction device, comprising: a memory; and a processor coupled to the memory, wherein the processor is configured to execute any one of the methods described above based on instructions stored in the memory.

[0039] According to a sixth aspect of the present disclosure, a computer-readable storage medium is provided, on which a program is stored, and when the program is executed by a processor, the information interaction method as described in any one of the above items is implemented.

[0040] The disclosed embodiment sends search instructions to multiple mobile second terminals based on search information from the first terminal, and determines the search results based on the feedback results of the multiple mobile second terminals. This can make up for the shortcomings of low camera density and small coverage in related search schemes, expand the search range, and effectively improve the search efficiency.

[0041] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] The accompanying drawings herein are incorporated into the specification and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the specification are used to explain the principles of the present disclosure. Obviously, the accompanying drawings described below are only some embodiments of the present disclosure, and for ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without creative work.

[0043] Figure 1 Schematic diagram of the information interaction system 100 in the embodiment of the present disclosure.

[0044] Figure 2 is a flowchart of an information interaction method 200 in an exemplary embodiment of the present disclosure.

[0045] Figure 3 It is a schematic diagram of an application scenario in which a smart transportation tool is used as a second terminal to participate in the search in an embodiment of the present disclosure.

[0046] Figure 4 It is a schematic diagram of interaction using RSU for information interaction in an embodiment of the present disclosure.

[0047] Figure 5 This is a schematic diagram of information interaction using RSU to participate in target search in another embodiment of the present disclosure.

[0048] Figure 6 It is a schematic diagram of interaction using a cellular base station for information interaction in an embodiment of the present disclosure.

[0049] Figure 7 It is a schematic diagram of information interaction via the Internet in an embodiment of the present disclosure.

[0050] Figure 8 It is a block diagram of a mobile device provided by the present disclosure for completing a search task.

[0051] Fig. 9is a flowchart of a method executed by a processor of the mobile device 800 in an embodiment of the present disclosure.

[0052] Fig.10 It is a sub-flow diagram of step S92 in one embodiment of the present disclosure.

[0053] Fig.11 It is a block diagram of an information interaction device in an exemplary embodiment of the present disclosure.

[0054] Fig.12 is a block diagram of an electronic device in an exemplary embodiment of the present disclosure. DETAILED DESCRIPTION

[0055] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in a variety of forms and should not be construed as being limited to the examples set forth herein; on the contrary, these embodiments are provided so that the present disclosure will be more comprehensive and complete, and the concepts of the example embodiments are fully conveyed to those skilled in the art. The described features, structures, or characteristics may be combined in one or more embodiments in any suitable manner. In the following description, many specific details are provided to provide a full understanding of the embodiments of the present disclosure. However, those skilled in the art will appreciate that the technical solutions of the present disclosure may be practiced while omitting one or more of the specific details, or other methods, components, devices, steps, etc. may be adopted. In other cases, known technical solutions are not shown or described in detail to avoid obscuring various aspects of the present disclosure.

[0056] In addition, the accompanying drawings are only schematic diagrams of the present disclosure, and the same reference numerals in the drawings represent the same or similar parts, so their repeated description will be omitted. Some of the block diagrams shown in the accompanying drawings are functional entities, which do not necessarily correspond to physically or logically independent entities. These functional entities can be implemented in software form, or implemented in one or more hardware modules or integrated circuits, or implemented in different networks and / or processor devices and / or microcontroller devices.

[0057] The exemplary embodiments of the present disclosure are described in detail below with reference to the accompanying drawings.

[0058] Figure 1 Schematic diagram of the information interaction system 100 in the embodiment of the present disclosure. The information interaction method or information interaction device in the embodiment of the present disclosure can be applied to the information interaction system 100.

[0059] refer to Figure 1 , the information interaction system 100 may include:

[0060] At least one first terminal A, used to publish first search information;

[0061] The server cluster B includes at least one server, which interacts with the first terminal A through a preset communication mode 101, and is used to execute the information interaction method of the following embodiment according to the first search information;

[0062] Multiple second terminals C interact with the server cluster B via a preset communication method 102 to perform target search based on the second search information from the server cluster B and return third search information to the server cluster B.

[0063] like Figure 1 As shown, the first terminal A may be, for example, various electronic devices with a display screen, including but not limited to a smart phone, a tablet computer, a notebook computer, a desktop computer, and the like.

[0064] The first terminal A and the server cluster B may be coupled using a medium of a network providing a communication link, so that the first terminal A can send the first search information to the server cluster B or receive the search result sent by the server cluster B. The network may include various connection types, such as wired, wireless communication links or optical fiber cables, etc.

[0065] The second terminal C can be, for example, a mobile device provided with an image acquisition device and an image analysis device, and the mobile device at least includes intelligent transportation tools, such as intelligent cars and unmanned aerial vehicles. In some embodiments, the second terminal can also be other mobile terminals, such as smart glasses, holographic projection equipment, etc., which are tools for image acquisition. The second terminal C and the server cluster can communicate through a variety of communication methods, so that the second terminal C can receive the second search information sent by the server cluster B, perform target search based on the second search information, and return the third search information for displaying the search results to the server cluster B.

[0066] It should be understood that Figure 1 The number of the first terminal A, the network, the server cluster B and the second terminal C in the example is only illustrative. Any number of terminals, networks and servers may be provided according to implementation requirements.

[0067] The information interaction method provided in the embodiment of the present disclosure may be executed by server cluster B, and accordingly, the information interaction device may be arranged in server cluster B.

[0068] Figure 2 The flowchart of the information interaction method in the exemplary embodiment of the present disclosure is schematically shown. Figure 2 , the information interaction method 200 may include:

[0069] Step S202, receiving first search information from a first terminal;

[0070] Step S204, sending second search information to multiple second terminals according to the first search information, where the second terminals are mobile devices provided with an image acquisition device and an image analysis device;

[0071] Step S206: receiving third search information sent by at least one of the second terminals according to the second search information, and returning the search result to the first terminal.

[0072] The disclosed embodiment sends search instructions to multiple mobile second terminals based on search information from the first terminal, and determines the search results based on the feedback results of the multiple mobile second terminals. This can make up for the shortcomings of low camera density and small coverage in related search schemes, expand the search range, and effectively improve the search efficiency.

[0073] Next, Figure 2 Each step of the illustrated embodiment is described in detail.

[0074] In step S202, first search information is received from a first terminal.

[0075] The information interaction method of the embodiments of the present disclosure can be used to search for a variety of targets, which may include at least humans, other animals (such as pets), intelligent transportation vehicles, buildings, mobile business premises, etc. Intelligent transportation vehicles may include, for example, motor vehicles, non-motor vehicles, various types of electric intelligent transportation vehicles, etc., and the present disclosure does not impose any special restrictions on this.

[0076] In the disclosed embodiment, the first search information may at least include an image of the search object, a missing time period, a missing location range, and description information of the search object.

[0077] The search object image can be a photo, a video or other image information. The source of the search object image includes but is not limited to the one provided by the search requester, the record of the fixed camera of the road test, the search result of the previous search behavior, etc.

[0078] The missing time period can be, for example, the time range when the search target was last monitored, so as to facilitate the determination of the second terminal participating in the search; the missing location range can be, for example, represented by multiple coordinate points, a range surrounded by multiple coordinate points, or a center point + radius, so as to analyze the area where the search target is most likely to appear, so as to facilitate the determination of the second terminal participating in the search. When the search target is a building, the missing time period may not be included.

[0079] When the search object is a human, the search object description information may include, for example, gender, age, height, weight, clothing, other special features, etc.; when the search object is an animal, the search object description information may include, for example, species, shoulder height, fur color, and other special features, etc.; when the search object is an intelligent vehicle, the object description information may include, for example, the type, color, brand model, license plate (if any), and other special features of the intelligent vehicle; when the search object is a building or business premises (such as a mobile vending car), the object description information may include, for example, length, width, height, color, facade decoration features, and other special features, etc. The present disclosure will not be described one by one here, and those skilled in the art may set the details of the first search information according to actual conditions, and the present disclosure is not limited thereto.

[0080] In step S204, second search information is sent to a plurality of second terminals according to the first search information, where the second terminals are mobile devices provided with an image acquisition device and an image analysis device.

[0081] In the system 100, the server cluster B may determine the second terminal participating in the search based on the first search information, and then send the second search information for identifying the search instruction to the second terminal.

[0082] When the search object is a mobile target, the characteristics of the second terminal participating in the search can be determined based on the missing time period and the missing location range in the first search information. The second terminals that appeared in the time period and the missing location range can be determined based on the missing time period and the missing location range, and then the search using these second terminals can be determined, for example, the second search information is sent to all motor vehicles that appeared in the location range during the time period. It can be understood that the search using the second terminal in the embodiment of the present disclosure is not limited to real-time shooting, and the second terminal can also participate in the search by retrieving stored images. In this case, the second search information may include the missing time period, so that the second terminal can determine the range of retrieving stored images.

[0083] In addition, the search location range can be determined according to the missing time period, the missing location range, the action mode of the search object, and the action speed of the search object, and the second search information can be sent to the second terminal currently within the search location range. The action mode (walking or taking an intelligent transportation tool) and the action speed of the search object can be provided by the first terminal through the first search information.

[0084] When the search object is a fixed target, the search position range can be determined according to the missing position range, and the second search information can be sent to the second terminal currently within the search position range. Like the missing position range, the search position range can also be represented by multiple coordinate points, a range surrounded by multiple coordinate points, or a center point + radius. It is understandable that the number of the above-mentioned search position ranges can be multiple.

[0085] The image acquisition device of the second terminal may be, for example, a camera, and the image analysis device may be, for example, a processor. In order to ensure search efficiency, the second terminal involved in the search may be a mobile device whose image acquisition device can acquire images at any time. Searches can be conducted using devices such as smart vehicles and smart glasses that can often acquire images at any time; mobile devices such as smart phones that are often stored and smart watches that are easily covered by clothing cannot acquire images at any time and may be used only to assist searches or not be used for searches.

[0086] In the disclosed embodiment, the second search information at least includes a search information identifier, a search object image, search object description information, a third search information image matching degree threshold and other information.

[0087] The second search information may carry a search information identifier to instruct the second terminal to complete the search task. In addition, the multiple search object images provided by the first search information may be screened, and images that are helpful for the search may be added to the second search information. The criteria for image screening include, but are not limited to, resolution, clarity, the proportion of the search target in the image, the clarity of the search target, the integrity of the search target image, etc. Image screening may be performed using tools that can perform pattern recognition, such as neural network models, but the present disclosure is not limited thereto.

[0088] Information that is helpful for the second terminal to search can be determined based on the search object description information in the first search information, and added to the second search information. The search object description information in the second search information can be the same as or different from the search object description information in the first search information. The search object description information in the second search information can include information such as the outer dimensions and surface features of the search object.

[0089] After receiving the second search information, the second terminal can perform real-time shooting or retrieve stored information through the image acquisition device and the image analysis device to complete the search task and determine multiple search results. For example, the image in the real-time shooting or stored information can be matched with the image provided by the second search information to obtain multiple matching results.

[0090] In order to avoid the second terminal frequently reporting search results and affecting the search judgment efficiency, a third search information image matching threshold can be set, that is, the second terminal is controlled to generate the third search information based on the local image for reporting only when the matching degree between the local image and the image provided by the second search information exceeds the third search information image matching threshold, so as to improve information processing efficiency.

[0091] In the disclosed embodiment, the third search information includes at least the captured image and the matching probability between the image and the image in the second search information, so as to further filter the search results.

[0092] In step S206, third search information sent by at least one of the second terminals according to the second search information is received, and a search result is returned to the first terminal.

[0093] In the disclosed embodiment, a search result screening threshold can be pre-set to improve the efficiency of determining the search result. For example, among the multiple third search information fed back by the multiple second terminals, one or more third search information that is most conducive to determining the search result can be determined based on image clarity greater than a threshold, or matching degree greater than a threshold, or having specific features (such as a face), and the screened third search information is fed back to the first terminal as the search result.

[0094] The third search information may include information such as images with a matching degree exceeding a threshold, image shooting time, image shooting location, and further, may include identifier information of the second terminal that shot the image, so as to make the search results more accurate and facilitate further searches.

[0095] The first terminal can determine whether to continue searching, adjust the first search information, etc. based on the search results to improve the search efficiency. Since the search results come from the mobile second terminal, even if some search results have problems such as unsatisfactory lighting or unsatisfactory shooting angles, as long as the number of second terminals reaches the preset value, the image acquisition success rate and clarity of the same target can be greatly improved, effectively improving the search efficiency and search success rate.

[0096] By using multiple movable second terminals with image acquisition devices and image processing devices to search, the search efficiency can be effectively improved, avoiding the problems of distribution range defects and large environmental impact defects caused by the use of fixed cameras in related technologies.

[0097] In one embodiment of the present disclosure, the second terminal may be, for example, an intelligent transportation vehicle.

[0098] Figure 3 It is a schematic diagram of an application scenario in which a smart transportation tool is used as a second terminal to participate in a search in an embodiment of the present disclosure.

[0099] refer to Figure 3 In some application scenarios, the intelligent transportation tool may be, for example, a motor vehicle C equipped with an image acquisition device and an image processing device, and the types of motor vehicles include but are not limited to private cars, taxis, buses, etc. It is understandable that in other embodiments, the intelligent transportation tool may also be a non-motor vehicle or an aircraft, such as an electric scooter, an automatic balancing vehicle, an electric bicycle, a drone, etc. equipped with an image acquisition device and an image processing device, and the present disclosure does not impose any special restrictions on this.

[0100] When the intelligent transportation tool is an intelligent motor vehicle, the second search information may be sent to the intelligent transportation tool via a fixed device currently located within the search position range.

[0101] exist Figure 3 In the illustrated embodiment, the server cluster B sends the second search information to the plurality of intelligent motor vehicles C via the fixed device D. The method of sending the information may be, for example, broadcasting via the RSU or a cellular base station.

[0102] RSU (Road Side Unit) is a device installed on the roadside in the ETC (Electronic Toll Collection) system. It uses DSRC (Dedicated Short Range Communication) technology to communicate with the On Board Unit (OBU) to achieve vehicle identification and electronic deduction. RSU can be installed on the roadside of highways and parking lots to establish unmanned express dedicated lanes.

[0103] As a fixed device, RSU can exchange information with passing motor vehicles equipped with RSU communication devices. Therefore, in the embodiment of the present disclosure, RSU can be used as a transmission medium, and server cluster B sends the second search information to RSUs within the search range, so as to send the second search information to motor vehicles passing by RSU through RSU, thereby realizing effective information distribution. The way in which RSU sends the second search information is, for example, broadcasting to passing motor vehicles based on the PC5 interface.

[0104] Figure 4 It is a schematic diagram of interaction using RSU for information interaction in an embodiment of the present disclosure.

[0105] refer to Figure 4 , the information interaction process 400 may include:

[0106] Step S41, the first terminal sends first search information to the server cluster;

[0107] Step S42, the server cluster determines a search location range according to the first search information;

[0108] Step S43, the server cluster determines a plurality of target RSUs according to the search location range;

[0109] Step S44, the server cluster sends second search information to multiple target RSUs;

[0110] Step S45, the target RSU broadcasts the second search information to a plurality of passing vehicles;

[0111] Step S46, the motor vehicle collects images according to the second search information and performs image matching;

[0112] Step S47, the motor vehicle generates third search information according to the image whose matching degree is greater than the third search information image matching degree threshold;

[0113] Step S48, the motor vehicle returns the third search information to the server cluster;

[0114] In step S49, the server cluster determines a search result according to the plurality of third search information, and returns the search result to the first terminal.

[0115] exist Figure 4 In the illustrated embodiment, a passing motor vehicle may activate a camera in response to the second search information to take real-time photos, and match the real-time photographed image with the image provided by the second search information to filter out images whose matching degree exceeds a threshold.

[0116] In another embodiment of the present disclosure, if the current search position range cannot be determined, the RSU can be used to call the motor vehicle to participate in the search in another way.

[0117] Figure 5 This is a schematic diagram of information interaction using RSU to participate in target search in another embodiment of the present disclosure.

[0118] refer to Figure 5 , the information interaction process 500 may include:

[0119] Step S51, the first terminal sends first search information to the server cluster;

[0120] Step S52, the server cluster determines the missing time period and the search position range corresponding to the missing time period according to the first search information;

[0121] Step S53, the server cluster calls the stored images corresponding to the missing time period of the RSU or fixed camera or other devices located within the search position range;

[0122] Step S54, the server cluster determines the target motor vehicle that appears within the search position range during the missing time period;

[0123] Step S55, sending second search information including the target motor vehicle identification and the missing time period to multiple RSUs;

[0124] Step S56, the RSU sends a second search message to the target motor vehicle;

[0125] Step S57, the target motor vehicle calls the stored image to participate in the search according to the missing time period;

[0126] Step S58, the target motor vehicle returns the search result to the server cluster.

[0127] In step S59, the server cluster determines a search result according to the plurality of third search information, and returns the search result to the first terminal.

[0128] By calling on motor vehicles to participate in the search when the current search range cannot be determined, the information used to determine the current search range can be increased, effectively improving the search success rate and search efficiency.

[0129] In addition, in other embodiments of the present disclosure, it is also possible to notify all RSUs to send a second search message, thereby mobilizing all motor vehicles to participate in the search. At this time, the second search message can carry missing time period information to facilitate the motor vehicles to search for stored images and perform image matching based on the missing time period information while acquiring real-time images.

[0130] In addition to using the RSU to participate in the search, in another embodiment of the present disclosure, a cellular base station may be used to broadcast the second search information to the second terminal.

[0131] Cellular network, also known as mobile network, is a mobile communication hardware architecture. It is named because the signal coverage of each communication base station that constitutes the network coverage is hexagonal, making the entire network look like a honeycomb. Common cellular network types include GSM network (or pcs-1900), CDMA network, 3G network, FDMA, TDMA, PDC, TACS, AMPS, etc. The cellular network is mainly composed of three parts: mobile station, base station subsystem, and network subsystem. Among them, the mobile station is a network terminal device, such as a mobile phone or some cellular industrial control equipment; the base station subsystem includes mobile base stations (large iron towers), wireless transceiver equipment, dedicated networks (usually optical fibers), digital equipment, etc. The base station subsystem can be regarded as a converter between the wireless network and the wired network.

[0132] In the embodiment of the present disclosure, when the cellular base station is used to broadcast the second search information, the second terminal exists as a mobile station, and the characteristics of the second terminal are as described above, and also have a cellular network communication function. The "cellular base station" in the embodiment of the present disclosure is, for example, any device in the base station subsystem that can broadcast information, such as a mobile base station, a wireless transceiver, a dedicated network, etc., and the present disclosure does not impose any special restrictions on this.

[0133] Figure 6 It is a schematic diagram of interaction using a cellular base station for information interaction in an embodiment of the present disclosure.

[0134] refer to Figure 6 , the information interaction process 600 may include:

[0135] Step S61, the first terminal sends first search information to the server cluster;

[0136] Step S62, the server cluster determines a search location range according to the first search information;

[0137] Step S63, the server cluster determines a plurality of target cellular base stations according to the search location range;

[0138] Step S64, the server cluster sends second search information to multiple target cellular base stations;

[0139] Step S65, the target cellular base station broadcasts the second search information to all second terminals within the propagation range;

[0140] Step S66, the second terminal collects images according to the second search information and performs image matching;

[0141] Step S67, the second terminal generates third search information according to the image whose matching degree is greater than the third search information image matching degree threshold;

[0142] Step S68, the second terminal returns the third search information to the server cluster;

[0143] In step S69, the server cluster determines a search result according to the plurality of third search information, and returns the search result to the first terminal.

[0144] and Figure 4 The difference between the illustrated embodiments is that the cellular base station can send the second search information to all second terminals in the air interface at the same time, greatly expanding the search range. In the disclosed embodiment, even if the second search information is broadcasted by the cellular base station, no human intervention is required. The second terminal that receives the second search information is consistent with the aforementioned embodiment, and both automatically activates the camera or reads the stored image for image matching to return the third search information to the server cluster.

[0145] When using a cellular base station to broadcast the second search information, missing time period information can be added to the second search information to facilitate the second terminal to simultaneously acquire real-time images and read stored images, and determine the degree of match between the real-time images, stored images and the images provided in the second search information, thereby improving information search efficiency.

[0146] exist Figure 4~Figure 6 In the illustrated embodiment, the second terminal returns the third search information to the server cluster via the Internet, for example. In this case, the second terminal has a network communication function.

[0147] The server cluster may add a feedback path in the second search information so that the second terminal can feed back the third search information to the server cluster. In some embodiments, the second terminal may install a dedicated application to feed back the third search information to the server cluster through the dedicated application. If the second terminal has cellular network communication capability, the third search information may also be fed back to a nearby cellular base station by sending a picture or the like, and the nearby cellular base station sends the third search information to the server cluster.

[0148] In one embodiment of the present disclosure, the second search information can also be sent to multiple second terminals via the Internet. For example, the second search information can be encapsulated as application layer data and transmitted to the application layer corresponding to the second terminal via the Internet OTT (Over The Top). The OTT method is a third party other than the operator providing various application services to users via the Internet, and the operator is a simple "transmission pipeline". When the second search information is transmitted using the OTT method, the second terminal can be provided with a program that is directed to match the server cluster, which can be, for example, an application program (APP) or a functional program integrated in the operating system.

[0149] Figure 7 It is a schematic diagram of information interaction via the Internet in an embodiment of the present disclosure.

[0150] refer to Figure 7 , the information interaction process 700 may include:

[0151] Step S71, the first terminal sends first search information to the server cluster;

[0152] Step S72, the server cluster determines second search information according to the first search information;

[0153] Step S73, the server cluster sends second search information to multiple second terminals;

[0154] Step S74, the second terminal collects images according to the second search information and performs image matching;

[0155] Step S75, the second terminal generates third search information according to the image whose matching degree is greater than the third search information image matching degree threshold;

[0156] Step S76, the second terminal returns the third search information to the server cluster via the Internet;

[0157] Step S77: the server cluster determines a search result based on the plurality of third search information, and returns the search result to the first terminal.

[0158] Using the Internet to disseminate information and search for information can effectively improve the efficiency of information dissemination and reduce the cost of information interaction.

[0159] The above embodiment can be used for missing person search based on cars, so that the server sends missing person search instructions to cars on the roadside through the Internet, RSU broadcast, and base station broadcast. The car starts its camera to search according to the missing person search instruction information and feeds back the search results to the server. The vehicles involved in the search are not limited to buses, taxis, private cars, trucks, engineering vehicles, etc. In terms of technical implementation, they can be either manually driven vehicles or autonomous driving vehicles.

[0160] Cars are like pairs of mobile eyes that can quickly identify whether there are target missing persons around them, and the number is very large. Therefore, using cars to search for missing persons is a newer and more effective method than traditional cameras. It greatly makes up for the shortcomings of traditional cameras in terms of density and the inability to obtain effective images at night, significantly improving the speed and success rate of searching for missing persons, and at the same time can curb crime.

[0161] To sum up, using the information interaction method provided by the present invention, a mobile second terminal can be called to participate in the search, thereby avoiding the problem of low search efficiency caused by factors such as distribution position, distribution density, lighting conditions, and shielding conditions, effectively improving the search efficiency and increasing the search success rate.

[0162] Figure 8 It is a block diagram of a mobile device provided by the present disclosure for completing a search task.

[0163] refer to Figure 8 , the mobile device 800 may include:

[0164] A power device 81, used to control the movement of the mobile device 800;

[0165] An image acquisition device 82, used for acquiring images;

[0166] The communication device 83 is used to receive the search information from the server and send the search results to the server, wherein the search information and the search results both include images;

[0167] A memory 84, coupled to the image acquisition device 82, for storing images acquired by the image acquisition device;

[0168] The processor 85 is coupled to the image acquisition device 82, the communication device 83 and the memory 84, and is used to execute the following steps: Fig. 9 The method shown.

[0169] Fig. 9 is a flowchart of a method executed by a processor of the mobile device 800 in an embodiment of the present disclosure.

[0170] refer to Fig. 9 , the method 900 may include:

[0171] Step S91, acquiring an image to be identified from an image acquisition device and a memory in response to the search information;

[0172] Step S92, matching the image to be recognized with the image provided by the search information;

[0173] Step S93, generating search results according to the to-be-recognized images whose matching degree exceeds a preset threshold;

[0174] Step S94, controlling the communication device to send the search result to the server.

[0175] The mobile device 800 can be used in Figure 1 In the information interaction system 100 shown, it operates as a second terminal. In addition, the mobile device 800 can participate in the execution of the method 200 as a second terminal in the method 200 .

[0176] exist Figure 8 and Fig. 9 In the embodiment shown, the mobile device 800 may be, for example, an intelligent transportation tool (motor vehicle, non-motor vehicle, drone, etc.), and the image acquisition device 82 may be, for example, a camera. The communication device 83 and the server may communicate in a manner including but not limited to the Internet, a cellular network, and RSU. For detailed description, please refer to Figure 4~Figure 7 The description of the communication method in the embodiments will not be repeated in this disclosure.

[0177] In an exemplary embodiment of the present disclosure, the search information (i.e., the second search information in method 200) includes at least an image of the search object, and may also include other information, such as a missing time period, a missing location range, other feature information of the search object, an image matching threshold for reporting search results, etc.

[0178] When the search information includes the missing time period, step S91 may include acquiring the image to be identified from the memory according to the missing time period. In the above embodiment, step S91 may acquire the image to be identified only from the image acquisition device in real time for image matching, may acquire the image to be identified only from the memory for image matching, or may acquire the image to be identified from the image acquisition device and the memory at the same time for image matching, and the present disclosure does not impose any special restrictions on this.

[0179] The search object includes but is not limited to people, other animals, vehicles, buildings or mobile business premises, etc. The search object image can be a full-body or partial snapshot of the search object, or a face image such as an ID photo.

[0180] Fig.10 It is a sub-flow diagram of step S92 in one embodiment of the present disclosure.

[0181] refer to Fig.10 In an exemplary embodiment of the present disclosure, when the search information includes a face image, step S92 may include:

[0182] Step S921, performing face recognition detection on the image to be recognized, and determining the image to be recognized in which the face is recognized;

[0183] Step S922: performing face matching between the image to be identified with the face and the image provided by the search information.

[0184] exist Fig.10 In the illustrated embodiment, the processor 85 may first screen out pictures including facial features, and then match these pictures with the facial pictures provided by the search information to screen out pictures that meet a preset matching threshold, and return them to the server as search results. Prioritizing the use of faces for recognition has higher search efficiency and search success rate than full-body or partial captured images. At this time, in order to improve the success rate of facial image capture, the mobile device 800 may preferably be a motor vehicle, including but not limited to private cars, taxis, buses, fire trucks, police cars, engineering vehicles, tourist buses, etc.

[0185] In summary, the mobile device 800 can effectively increase the image acquisition range, and improve the target search efficiency and search success rate.

[0186] Corresponding to the above method embodiments, the present disclosure also provides an information interaction device, which can be used to execute the above method embodiments.

[0187] Fig.11 A block diagram schematically shows an information interaction device in an exemplary embodiment of the present disclosure.

[0188] refer to Fig.11 , the information interaction device 1100 may include:

[0189] The information receiving module 1102 is configured to receive first search information from a first terminal;

[0190] The information distribution module 1104 is configured to send second search information to multiple second terminals according to the first search information, wherein the second terminals are mobile devices equipped with image acquisition devices and image analysis devices.

[0191] The information feedback module 1106 is configured to receive third search information sent by at least one of the second terminals according to the second search information, and return the search result to the first terminal.

[0192] In an exemplary embodiment of the present disclosure, the second terminal is an intelligent transportation tool, and the intelligent transportation tool includes at least a smart car and an unmanned aerial vehicle.

[0193] In an exemplary embodiment of the present disclosure, the smart transportation vehicle is provided with a camera, and the third search information is determined by the smart transportation vehicle based on a matching result between a picture taken by the camera and the second search information, wherein the first search information and the second search information include facial images.

[0194] In an exemplary embodiment of the present disclosure, the first search information includes at least a search object image, a missing time period, a missing location range, and a search object description information; the second search information includes at least a search information identifier, a search object image, a search object description information, and a third search information image matching degree threshold.

[0195] In an exemplary embodiment of the present disclosure, the information distribution module 1104 is configured as:

[0196] The second terminal for receiving the first search information is determined according to the missing time period and the missing location range.

[0197] In an exemplary embodiment of the present disclosure, the information distribution module 1104 is configured as:

[0198] The second search information is broadcasted through a roadside unit, or the second search information is broadcasted through a cellular base station, or the second search information is sent through the Internet.

[0199] In an exemplary embodiment of the present disclosure, the second terminal returns the third search information via the Internet.

[0200] Since the functions of the device 1100 have been described in detail in the corresponding method embodiments, the present disclosure will not elaborate on them here.

[0201] It should be noted that, although several modules or units of the device for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiments of the present disclosure, the features and functions of two or more modules or units described above can be embodied in one module or unit. On the contrary, the features and functions of one module or unit described above can be further divided into multiple modules or units to be embodied.

[0202] In an exemplary embodiment of the present disclosure, an electronic device capable of implementing the above method is also provided.

[0203] It will be appreciated by those skilled in the art that various aspects of the present invention may be implemented as a system, method or program product. Therefore, various aspects of the present invention may be specifically implemented in the following forms, namely: a complete hardware implementation, a complete software implementation (including firmware, microcode, etc.), or a combination of hardware and software, which may be collectively referred to herein as a "circuit", "module" or "system".

[0204] Refer to the following Fig.12 The electronic device 1200 according to this embodiment of the present invention is described. Fig.12 The electronic device 1200 shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0205] like Fig.12 As shown, the electronic device 1200 is in the form of a general computing device. The components of the electronic device 1200 may include but are not limited to: at least one processing unit 1210, at least one storage unit 1220, and a bus 1230 connecting different system components (including the storage unit 1220 and the processing unit 1210).

[0206] The storage unit stores program codes, which can be executed by the processing unit 1210, so that the processing unit 1210 performs the steps according to various exemplary embodiments of the present invention described in the above “Exemplary Method” section of this specification. For example, the processing unit 1210 can perform the following steps: Figure 2 Step S202 shown in: receiving first search information from a first terminal; step S204: sending second search information to multiple second terminals based on the first search information, where the second terminals are mobile devices equipped with image acquisition devices and image analysis devices; step S206: receiving third search information sent by at least one of the second terminals based on the second search information, and returning search results to the first terminal.

[0207] The storage unit 1220 may include a readable medium in the form of a volatile storage unit, such as a random access storage unit (RAM) 12201 and / or a cache storage unit 12202 , and may further include a read-only storage unit (ROM) 12203 .

[0208] The storage unit 1220 may also include a program / utility 12204 having a set (at least one) of program modules 12205, such program modules 12205 including but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment.

[0209] Bus 1230 may represent one or more of several types of bus structures, including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.

[0210] The electronic device 1200 may also communicate with one or more external devices 1000 (e.g., keyboards, pointing devices, Bluetooth devices, etc.), may also communicate with one or more devices that enable a user to interact with the electronic device 1200, and / or may communicate with any device that enables the electronic device 1200 to communicate with one or more other computing devices (e.g., routers, modems, etc.). Such communication may be performed via an input / output (I / O) interface 1250. In addition, the electronic device 1200 may also communicate with one or more networks (e.g., local area networks (LANs), wide area networks (WANs), and / or public networks, such as the Internet) via a network adapter 1260. As shown, the network adapter 1260 communicates with other modules of the electronic device 1200 via a bus 1230. It should be understood that, although not shown in the figure, other hardware and / or software modules may be used in conjunction with the electronic device 1200, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, etc.

[0211] Through the description of the above implementation, it is easy for those skilled in the art to understand that the example implementation described here can be implemented by software, or by software combined with necessary hardware. Therefore, the technical solution according to the implementation of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, and includes a number of instructions to enable a computing device (which can be a personal computer, a server, a terminal device, or a network device, etc.) to execute the method according to the implementation of the present disclosure.

[0212] In an exemplary embodiment of the present disclosure, a computer-readable storage medium is also provided, on which a program product capable of implementing the above method of the present specification is stored. In some possible implementations, various aspects of the present invention can also be implemented in the form of a program product, which includes a program code, and when the program product is run on a terminal device, the program code is used to enable the terminal device to execute the steps according to various exemplary embodiments of the present invention described in the above "Exemplary Method" section of the present specification.

[0213] The program product for implementing the above method according to an embodiment of the present invention can adopt a portable compact disk read-only memory (CD-ROM) and include program code, and can be run on a terminal device, such as a personal computer. However, the program product of the present invention is not limited thereto, and in this document, a readable storage medium can be any tangible medium containing or storing a program, which can be used by or in combination with an instruction execution system, an apparatus or a device.

[0214] The program product may be any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination thereof. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof.

[0215] Computer readable signal media may include data signals propagated in baseband or as part of a carrier wave, in which readable program code is carried. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Readable signal media may also be any readable medium other than a readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0216] The program code embodied on the readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination of the foregoing.

[0217] Program code for performing the operations of the present invention may be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java, C++, etc., and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a separate software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., via the Internet using an Internet service provider).

[0218] In addition, the above-mentioned figures are only schematic illustrations of the processes included in the method according to an exemplary embodiment of the present invention, and are not intended to be limiting. It is easy to understand that the processes shown in the above-mentioned figures do not indicate or limit the time sequence of these processes. In addition, it is also easy to understand that these processes can be performed synchronously or asynchronously, for example, in multiple modules.

[0219] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The specification and examples are to be considered exemplary only, and the true scope and concept of the present disclosure are indicated by the claims.

Claims

1. An information interaction method, characterized in that: include: Receiving first search information from a first terminal; The first search information includes the missing time period, missing location range, movement mode and movement speed of the search object; Determine, according to the missing time period and the missing location range of the search object, a target second terminal that appears within the missing location range during the missing time period, and send second search information including the missing time period and the target second terminal identifier to multiple roadside units, and the multiple roadside units send the second search information to the target second terminal according to the target second terminal identifier; The target second terminal calls the stored image according to the missing time period and performs image matching, and generates third search information according to the image whose matching degree is greater than the third search information image matching degree threshold; the second terminal includes a smart car equipped with an image acquisition device and an image analysis device capable of acquiring images at any time; Determine a search location range according to the missing time period, missing location range, movement mode and movement speed of the search object, determine multiple target roadside units according to the search location range, send second search information to the multiple target roadside units, and the target roadside unit broadcasts the second search information to a passing second terminal equipped with a roadside unit communication device; the second terminal collects images in real time according to the second search information and performs image matching, and generates third search information according to images with a matching degree greater than a third search information image matching degree threshold; Receive third search information sent by multiple second terminals according to the second search information, wherein the third search information includes identifier information of multiple second terminals; and return the search result to the first terminal.

2. The information interaction method according to claim 1, characterized in that: The second terminal is an intelligent transportation tool, and the intelligent transportation tool includes an unmanned aerial vehicle.

3. The information interaction method according to claim 2, characterized in that: The intelligent transportation vehicle is provided with a camera, and the third search information is determined by the intelligent transportation vehicle according to a matching result between a picture taken by the camera and the second search information, wherein the first search information and the second search information include facial images.

4. The information interaction method according to claim 1, characterized in that: The first search information at least includes a search object image and search object description information, and the second search information at least includes a search information identifier, a search object image, search object description information, and a third search information image matching degree threshold.

5. The information interaction method according to any one of claims 1 to 4, characterized in that: The method further comprises: The second search information is broadcasted through a roadside unit, or the second search information is broadcasted through a cellular base station, or the second search information is sent through the Internet.

6. The information interaction method according to claim 5, characterized in that: The second terminal returns the third search information via the Internet.

7. A mobile device, characterized in that: Used to execute the method according to any one of claims 1 to 6, the mobile device comprises: A power device, used to control the movement of the mobile device; An image acquisition device, used for acquiring images; A communication device, used for receiving search information from a server and sending search results to the server, wherein the search information and the search results both include images; A memory, coupled to the image acquisition device, for storing images acquired by the image acquisition device; A processor, coupled to the image acquisition device, the communication device and the memory, is used to execute the following method: Responding to the search information, acquiring the image to be identified from the image acquisition device and the memory; Matching the image to be identified with the image provided by the search information; Generating the search result according to the to-be-identified images whose matching degree exceeds a preset threshold; Control the communication device to send the search result to the server.

8. The mobile device according to claim 7, wherein: The search information includes a missing time period, and acquiring the image to be identified from the image acquisition device and the memory in response to the search information includes: The image to be identified is acquired from the memory according to the missing time period.

9. The mobile device according to claim 7, wherein: The search information includes a face image, and matching the image to be identified with the image provided by the search information includes: Performing face recognition detection on the image to be recognized, and determining the image to be recognized in which the face is recognized; Perform face matching between the image to be identified in which the face is identified and the image provided by the search information.

10. An information interaction device, characterized in that: include: An information receiving module, configured to receive first search information from a first terminal; The first search information includes the missing time period, missing location range, movement mode and movement speed of the search object; An information distribution module is configured to determine a target second terminal that appears within the missing position range during the missing time period according to the missing time period and the missing position range of the search object, and send second search information including the missing time period and the target second terminal identifier to multiple roadside units, and the multiple roadside units send the second search information to the target second terminal according to the target second terminal identifier; The target second terminal calls the stored image and performs image matching according to the missing time period, and generates the third search information according to the image whose matching degree is greater than the third search information image matching degree threshold; the second terminal includes an intelligent car equipped with an image acquisition device and an image analysis device capable of acquiring images at any time; the search location range is determined according to the missing time period, missing location range, action mode and action speed of the search object, and a plurality of target roadside units are determined according to the search location range, and the second search information is sent to the plurality of target roadside units, and the target roadside unit broadcasts the second search information to the passing second terminal equipped with a roadside unit communication device; the second terminal acquires images in real time according to the second search information and performs image matching, and generates the third search information according to the image whose matching degree is greater than the third search information image matching degree threshold; The information feedback module is configured to receive third search information sent by multiple second terminals according to the second search information, wherein the third search information includes identifier information of multiple second terminals; and return the search result to the first terminal.

11. An information interaction system, characterized in that: include: The first terminal is used to publish first search information to the server cluster in response to a user request; A server cluster, communicating with the first terminal through a preset communication method, for executing the information interaction method according to any one of claims 1 to 6, and sending second search information to multiple second terminals according to the first search information; Multiple second terminals, each of which is provided with an image acquisition device and an image analysis device, communicates with the server cluster through a preset communication method, is used to perform target search through the image acquisition device and the image analysis device according to the second search information, and sends the search results to the server cluster through third search information.

12. An electronic device, characterized in that: include: Memory; as well as A processor coupled to the memory, wherein the processor is configured to execute the information interaction method according to any one of claims 1 to 6 based on instructions stored in the memory.

13. A computer-readable storage medium having a program stored thereon, wherein when the program is executed by a processor, the information interaction method according to any one of claims 1 to 6 is implemented.

14. A program product, comprising a program code, characterized in that When the program product is run on a terminal device, the program code is used to enable the terminal device to execute the information interaction method according to any one of claims 1 to 6.

Images