Target searching method and device, equipment, medium and vehicle

Abstract

The invention relates to a target search method and device, equipment, a medium and a vehicle, and the method comprises the steps: obtaining a search instruction of a user and the current position information of the vehicle; acquiring image data information of the user based on the search instruction, and determining gesture indication information of the user according to the image data information; and determining a search range according to the gesture indication information and the current position information of the vehicle, performing search based on the search instruction in the search range, and determining a search result corresponding to the search instruction, so that the search can be performed based on the search instruction of the user and the gesture indication information, the search result is determined, and the search range is determined through the gesture indication information. The search requirement of the user is further defined, the search range is narrowed, the accuracy of the search result is improved, and the user experience is improved.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to the technical field of data processing, and particularly relates to a target searching method, device, equipment, medium and vehicle. BACKGROUND

[0002] At present, when a user needs to search a target object, a common solution is that the user manually inputs a keyword corresponding to the target object, and then an electronic device searches according to the keyword, and further feeds back a search result to the user.

[0003] However, when searching the target object by using the above search method, since the search is only performed by using the keyword, there is a problem that the search range is large and the search result is inaccurate, and thus the user experience is poor. SUMMARY

[0004] In order to solve the above technical problem, the present disclosure provides a target searching method, device, equipment, medium and vehicle.

[0005] A first aspect of the embodiment of the present disclosure provides a target searching method, which comprises:

[0006] obtaining a search instruction of a user and current position information of a vehicle;

[0007] obtaining image data information of the user based on the search instruction, and determining gesture indication information of the user according to the image data information;

[0008] determining a search range according to the gesture indication information and the current position information of the vehicle, searching in the search range based on the search instruction, and determining a search result corresponding to the search instruction.

[0009] A second aspect of the embodiment of the present disclosure provides a target searching device, which comprises:

[0010] an instruction obtaining module, configured to obtain a search instruction of a user and current position information of a vehicle;

[0011] an instruction analyzing module, configured to obtain image data information of the user based on the search instruction, and determine gesture indication information of the user according to the image data information;

[0012] a target searching module, configured to determine a search range according to the gesture indication information and the current position information of the vehicle, search in the search range based on the search instruction, and determine a search result corresponding to the search instruction.

[0013] A third aspect of the embodiment of the present disclosure provides an electronic device, which comprises:

[0014] a memory;

[0015] a processor; and

[0016] A computer program, wherein the computer program is stored in a memory and is configured to be executed by a processor to implement the target search method according to the first aspect.

[0017] A fourth aspect of the embodiments of the present disclosure provides a computer readable storage medium, which stores a computer program, and when the computer program is executed by a processor, the target search method according to the first aspect is implemented.

[0018] A fifth aspect of the embodiments of the present disclosure provides a vehicle, comprising the electronic device according to the third aspect.

[0019] Compared with the prior art, the technical solutions provided by the embodiments of the present disclosure have the following advantages:

[0020] The target search method, device, equipment, medium and vehicle provided by the embodiments of the present disclosure can obtain the search instruction of the user and the current position information of the vehicle, obtain the image data information of the user based on the search instruction after obtaining the search instruction of the user, determine the gesture indication information of the user according to the image data information, determine the search range according to the gesture indication information and the current position information of the vehicle, search in the search range based on the search instruction, and determine the search result corresponding to the search instruction. Therefore, the search can be performed based on the search instruction and the gesture indication information of the user, the search result is determined, the search range is further narrowed by determining the search range based on the gesture indication information, the accuracy of the search result is further improved, and the user experience is further improved. BRIEF DESCRIPTION OF DRAWINGS

[0021] The accompanying drawings, which are incorporated into and form part of the specification, illustrate embodiments consistent with the present disclosure and, together with the specification, serve to explain the principles of the present disclosure.

[0022] In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure or the prior art, the accompanying drawings needed to be used in the embodiments or prior art description will be briefly introduced. Obviously, for those skilled in the art, other drawings can also be obtained from these drawings without creative labor.

[0023] Figure 1 is a flowchart of a target search method provided by the embodiments of the present disclosure;

[0024] Figure 2 is a schematic diagram of a search range provided by the embodiments of the present disclosure;

[0025] Figure 3 is a flowchart of another target search method provided by the embodiments of the present disclosure;

[0026] Figure 4 is a structural schematic diagram of a target search device provided by an embodiment of the present disclosure.

[0027] Figure 5 is a structural schematic diagram of an electronic device provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0028] In order to more clearly understand the above-mentioned purposes, features and advantages of the present disclosure, the solutions of the present disclosure will be further described below. It should be noted that the embodiments of the present disclosure and the features in the embodiments can be combined with each other without conflict.

[0029] In the following description, a large number of specific details are set forth in order to facilitate a thorough understanding of the present disclosure, but the present disclosure can also be implemented in other manners different from those described herein; obviously, the embodiments described in the specification are only a part of the embodiments of the present disclosure, and not all the embodiments.

[0030] It should be understood that each step recorded in the method embodiments of the present disclosure can be executed in different orders and / or in parallel. In addition, the method embodiments can include additional steps and / or omit the execution of the steps shown. The scope of the present disclosure is not limited in this respect.

[0031] It should be noted that, in this document, relational terms such as "first" and "second", and / or the like, are used solely to distinguish one entity or action from another entity or action, without necessarily requiring or implying any actual such relationship or order between or among these entities or actions. Moreover, the terms "comprises", "comprising", or any other variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but can include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without more limitations, an element defined by the phrase "comprising a... " does not exclude the existence of additional identical elements in the process, method, article, or apparatus that includes the element.

[0032] It should be noted that the modification of "one" or "multiple" mentioned in the present disclosure is illustrative rather than limiting, and those skilled in the art should understand that, unless otherwise explicitly indicated in the context, it should be understood as "one or more".

[0033] Generally, when a user needs to search for a target object, the user manually inputs a keyword corresponding to the target object, and then the electronic device searches according to the keyword, and then feeds back the search result to the user. However, when searching for a target object by the above-mentioned search method, since the search is only performed by the keyword, there is a problem that the search range is large and the search result is inaccurate. At the same time, since the input of the keyword needs to be manually performed, the operation is cumbersome, which leads to poor user experience. In view of this problem, the embodiments of the present disclosure provide a target search method, which will be introduced below in combination with specific embodiments.

[0034] Figure 1 A flowchart of a target search method provided by the embodiments of the present disclosure is shown in FIG. 1. The method can be performed by a target search device, which can be implemented in software and / or hardware. The target search device can be configured in an electronic device, such as a server or a terminal or a server cluster. The terminal can specifically include a mobile phone, a computer or a tablet computer, a vehicle-mounted terminal, or any device capable of processing the target search method.

[0035] As shown in FIG. 1, the target search method provided by the embodiments of the present disclosure includes the following steps. Figure 1

[0036] S110, obtaining a search instruction of a user and current position information of a vehicle.

[0037] In the embodiments of the present disclosure, the electronic device can obtain the search instruction of the user in real time.

[0038] In the embodiments of the present disclosure, the search instruction can be an instruction to search for a certain target object, such as an instruction to search for a certain building, an instruction to search for a supermarket or a shopping mall, etc. The target object can be a point of interest (POI) in a geographic information system.

[0039] The search instruction can include at least one of a voice search instruction, a text search instruction, etc., without limitation.

[0040] The current position information of the vehicle can include geographic position coordinates of the vehicle and a driving direction of the vehicle. The driving direction of the vehicle can be obtained by a GPS positioning system in combination with a vehicle gyroscope provided on the vehicle, or can be determined by the GPS positioning system in combination with depth information corresponding to an image collected by the vehicle. The driving direction of the vehicle can also be determined by positioning the vehicle by a UWB card provided on the vehicle in combination with the user's voice, or can be determined by an existing method for determining the driving direction of the vehicle, without limitation.

[0041] ​Specifically, the electronic device can collect the voice of the user in real time through a voice collection device such as a microphone or the like, and / or obtain the text input instruction of the user in real time, and when it is determined that the voice of the user is a search instruction and / or the input text of the user is a text search instruction, obtain the current position information of the vehicle through a preset sensor or a UWB module or the like arranged on the vehicle.

[0042] In some embodiments of the present disclosure, after obtaining the voice of the user, the electronic device can determine whether the voice of the user is a voice search instruction by matching the voice of the user with a preset search instruction, and if the matching is successful, determine that the voice of the user is a voice search instruction, otherwise, vice versa.

[0043] In another embodiment of the present disclosure, after obtaining the voice of the user, the electronic device can determine whether the voice of the user contains a preset wake-up word, and if the preset wake-up word is contained, determine that the voice of the user is an instruction for searching, and further determine the voice of the user as a voice search instruction.

[0044] S120, obtaining image data information of the user based on the search instruction, and determining gesture indication information of the user according to the image data information.

[0045] In an embodiment of the present disclosure, after obtaining the search instruction, the electronic device obtains image data information of the user based on the search instruction, and determines gesture indication information of the user according to the image data information.

[0046] The gesture indication information is search instruction information determined based on the hand image of the user in response to the search instruction of the user.

[0047] In some embodiments of the present disclosure, after obtaining the search instruction of the user, the electronic device can control the image collection device to collect the image of the user, obtain the image of the user, wherein the image of the user includes the hand image of the user, and further determine the gesture indication information of the user according to the image of the user.

[0048] In another embodiment of the present disclosure, after obtaining the search instruction of the user, the electronic device can determine the timestamp of the search instruction, obtain the image of the user or the depth image information of the user corresponding to the timestamp from a preset database based on the timestamp of the search instruction, and further determine the gesture indication information of the user according to the image of the user or the depth image information of the user.

[0049] S130, determining a search range according to the gesture indication information and the current position information of the vehicle, searching in the search range based on the search instruction, and determining the search result corresponding to the search instruction.

[0050] In the embodiments of the present disclosure, after obtaining the gesture indication information of the user, the electronic device determines a search range according to the gesture indication information and the current position information of the vehicle, searches in the search range based on the search instruction, and determines the search result corresponding to the search instruction, wherein the gesture indication information is used to generate search range parameters such as search direction and the like.

[0051] In some embodiments of the present disclosure, after obtaining the gesture indication information of the user, the electronic device can determine the position of the vehicle based on the current position information of the vehicle, and determine the area within the preset angle range corresponding to the search direction of the gesture indication information as the search range, for example, the search direction is 60 degrees east, and the preset angle is 30 degrees. At this time, the range corresponding to the clockwise rotation of 30 degrees and the counterclockwise rotation of 30 degrees of 60 degrees east is determined as the search range.

[0052] In some embodiments of the present disclosure, after obtaining the gesture indication information of the user, the electronic device can determine the position of the vehicle based on the current position information of the vehicle, and determine the area within the preset angle range corresponding to the search direction of the gesture indication information as the search range, for example, the search direction is 60 degrees east, and the preset angle is 30 degrees. At this time, the range corresponding to the clockwise rotation of 30 degrees and the counterclockwise rotation of 30 degrees of 60 degrees east is determined as the search range.

[0053] The search direction can be understood as a direction for determining the search range, for example, the search direction is south, and the search is performed in the range corresponding to the south direction. The direction pointed by the user's hand can be a direction corresponding to the driving direction of the vehicle, for example, the driving direction of the vehicle is the north direction, and the direction pointed by the user's hand is 60 degrees east relative to the driving direction of the vehicle. At this time, the angle relative to the driving direction of the vehicle is determined as the search direction, that is, 60 degrees east is determined as the search direction.

[0054] Further, after determining the search range, the electronic device searches the data in the search range in the preset database based on the search instruction, and determines at least one piece of data matching the search instruction as the search result corresponding to the search instruction.

[0055] The preset database can be a database including map data.

[0056] The specific implementation of searching the data in the search range in the preset database is similar to the existing implementation of searching and determining the search result in the map, and will not be repeated here.

[0057] In the embodiment of the present disclosure, the search instruction of the user and the current position information of the vehicle can be acquired, after the search instruction of the user is acquired, the image data information of the user is acquired based on the search instruction, the gesture indication information of the user is determined according to the image data information, the search range is determined according to the gesture indication information and the current position information of the vehicle, the search is performed in the search range based on the search instruction, and the search result corresponding to the search instruction is determined. Therefore, the search can be performed based on the search instruction and the gesture indication information of the user, the search result is determined, the search range is determined through the gesture indication information, the search demand of the user is further clarified, and the search range is further reduced, thereby improving the accuracy of the search result and improving the user experience.

[0058] On the basis of the above-mentioned embodiment of the present disclosure, the search instruction includes a voice search instruction, the search is performed in the search range based on the search instruction, and the search result corresponding to the search instruction is determined. Specifically, the voice search instruction can be analyzed to determine a first semantic result corresponding to the voice search instruction, and the search is performed in the search range according to the first semantic result to determine the search result corresponding to the search instruction.

[0059] Specifically, after the electronic device acquires the search instruction, the voice search instruction in the search instruction is subjected to text conversion processing to obtain text corresponding to the voice search instruction, and then the text corresponding to the voice search instruction is subjected to semantic analysis to obtain a first semantic result corresponding to the voice search instruction. Then, the first semantic result is matched with objects in the search range to determine a target object having a matching degree greater than a preset matching degree threshold with the first semantic result, and the target object is determined as the search result corresponding to the search instruction.

[0060] In the embodiment of the present disclosure, when the search instruction is a voice search instruction, the first semantic result corresponding to the voice search instruction can be acquired by performing semantic analysis on the voice search instruction, and then the search result corresponding to the search instruction is determined according to the first semantic result. Therefore, the accuracy of the acquired search result is improved, and at the same time, the search is performed by determining the semantic result corresponding to the voice search instruction, without the need for manual input of keywords, thereby reducing the operation complexity and improving the user experience.

[0061] In the embodiment of the present disclosure, after the voice search instruction is analyzed to determine the first semantic result corresponding to the voice search instruction, the target search method can further include: sending an inquiry instruction to the user; receiving a reply voice fed back by the user based on the inquiry instruction; recognizing the reply voice to obtain a second semantic result corresponding to the reply voice, the second semantic result including attribute information of the target object.

[0062] Specifically, the electronic device interacts with the user after obtaining the search instruction of the user, generates an inquiry instruction for a first semantic result corresponding to the voice search instruction of the user, sends the inquiry instruction to the user, so that the user makes a voice reply based on the inquiry instruction, receives the reply voice fed back by the user based on the inquiry instruction, performs semantic recognition on the reply voice to obtain a second semantic result, and determines attribute information of a target object corresponding to the search of the user according to the second semantic result.

[0063] The attribute information corresponding to the target object can include shape, color, height, and the like of the target object.

[0064] For example, the voice search instruction is "What is the building over there?" (with gesture indication information), the first inquiry instruction is "What color is the building?", the reply voice of the user is "yellow", the second inquiry instruction is "What shape is the building?", and the reply voice of the user is "like a shape of instant noodle barrel".

[0065] Further, the search is performed in the search range according to the first semantic result to determine the search result corresponding to the search instruction, which can specifically include: performing the search in the search range according to the first semantic result and the second semantic result to determine the search result corresponding to the search instruction.

[0066] In the embodiments of the present disclosure, after obtaining the search instruction of the user, the inquiry instruction can be sent to the user, the voice search instruction can be further inquired, more detailed information about the search instruction can be obtained, and then the search can be performed according to the more detailed information, thereby improving the accuracy of the target search and further improving the user experience.

[0067] In some embodiments of the present disclosure, when the search is a first search, the search range is determined according to the gesture indication information and the current position information of the vehicle, which can specifically include: determining a center point position of the vehicle based on the current position information of the vehicle, rotating a first straight line along a search direction corresponding to the gesture indication information and passing through the center point position of the vehicle by a preset angle in a clockwise direction and an anticlockwise direction respectively to obtain a sector region; determining a first circle center on the first straight line based on the center point position of the vehicle as a starting point and a first radius, and determining a region where a circle corresponding to the first circle center and the first radius is located as a first search range.

[0068] In the embodiments of the present disclosure, the center point position of the vehicle can be a position where a geometric center point of the vehicle is located, such as a position in the middle of the vehicle.

[0069] The preset angle can be a pre-set angle, which can be set according to the needs of the user and the actual situation, and is not limited herein.

[0070] The first radius can be a radius pre-set for determining the search range, and can be set according to the actual situation and the demand of the user, which is not limited here.

[0071] Specifically, after obtaining the search direction, the electronic device determines whether the search is the first search, and determines the center point position of the vehicle based on the current position information of the vehicle when it is determined that the search is the first search. A first straight line passing through the center point position of the vehicle is rotated by a preset angle in the clockwise direction and the counterclockwise direction, respectively, to obtain a sector region. Then, a position corresponding to the first radius on the first straight line is determined as a first center of a circle with the center point position of the vehicle as the starting point, and a region corresponding to the circle determined by the first center and the first radius is determined as the first search range.

[0072] In the embodiments of the present disclosure, the search direction can be determined according to the finger indication information, and then the search range can be determined in the search direction. The search range is determined by a circle with the search direction as the center, which ensures the search in the search direction specified by the user, reduces the search range, and improves the accuracy of the search result.

[0073] Figure 2 is a schematic diagram of a search range provided by an embodiment of the present disclosure, as Figure 2 shown, the rectangle represents a vehicle, the upward arrow represents the driving direction of the vehicle, point O is the center point position of the vehicle, straight line OC is the first straight line, i.e., the straight line on which the search direction corresponding to the gesture indication information is located, and a is a preset angle. The straight line OC is rotated by a degrees in the clockwise direction and the counterclockwise direction, respectively, to obtain a sector region AOB. The first radius is OP. At this time, the first center of the circle is point P on the straight line OC based on the first radius. Furthermore, the region corresponding to the circle formed by point P as the center and the first radius OP is determined as the first search range.

[0074] In some other embodiments of the present disclosure, when the search is not the first search, the search range is determined according to the gesture indication information and the current position information of the vehicle. Specifically, it can include: determining two intersection points of a circle corresponding to the last search range and two edges of the sector region; determining the second radius based on the first radius and a preset relationship between the first radius and the second radius; determining the second center on the first straight line, and determining the second search range as a region where a circle corresponding to the second center and the second radius is located, and the circle passes through the two intersection points.

[0075] In some embodiments of the present disclosure, the second radius may be a radius obtained by expanding the first radius based on a preset multiple. For example, if the preset multiple is 1.5 and the first radius is 10m, then the radius of the circle corresponding to the second search is 1.5*10m=15m, and the radius of the circle corresponding to the third search is 1.5 times the radius of the circle corresponding to the second search, that is, 22.5m, and so on.

[0076] In other embodiments of the present disclosure, the second radius can be increased by a preset factor based on the first radius. For example, if the first radius is 10m and the corresponding preset factor during the second search is 1.5, then the radius of the circle during the second search is 1.5*10m=15m. If the corresponding preset factor during the third search is 2, then the radius of the circle during the third search is 2*10m=20m, and so on.

[0077] like Figure 2 As shown, the second search is taken as an example for explanation. The first search corresponds to the area corresponding to the circle with point P as the center. The intersection points between the circle with point P as the center and the two lines of the fan-shaped area AOB are points E and F respectively. The area corresponding to the circle passing through points E and F with a radius of EQ and the center on the straight line OC is determined as the second search range, wherein the radius EQ is the radius of the circle corresponding to the second search determined based on the radius determination method in the above embodiment. The determination of the center and radius corresponding to the Nth search is similar to the method for determining the center and radius corresponding to the second search, and the center of the circle corresponding to each search is on the straight line OC, that is, the straight line corresponding to the search direction.

[0078] In the disclosed embodiment, the next search can be conducted based on the previous search to further expand the search direction, thereby ensuring further search in the search direction, providing users with more search results, and improving the diversity of search results.

[0079] In an embodiment of the present disclosure, searching is performed within a search range based on a search instruction to determine a search result corresponding to the search instruction, which may specifically include: determining a target search range within a fan-shaped area based on the search range; searching within the target search range based on a semantic result corresponding to the search instruction to determine at least one search data that matches the semantic result corresponding to the search instruction, and sorting from near to far along the extension direction of the two sides of the fan-shaped area based on the distance between the position corresponding to the at least one search data and the center point position of the vehicle, and obtaining a search result corresponding to the search instruction based on the sorting result.

[0080] Specifically, after determining the search range, the electronic device determines a target search range within the fan-shaped area based on the search range, that is, deletes the search range outside the fan-shaped area, and only searches within the target search range based on the semantic results corresponding to the search instruction to determine at least one search data whose matching degree with the semantic result corresponding to the search instruction is higher than a preset threshold, wherein the semantic result corresponding to the search instruction may include a first semantic result, or may include a first semantic result and a second semantic result. Based on the position information corresponding to the at least one search data, the electronic device determines the distance between the position corresponding to the at least one search data and the center point position of the vehicle, and sorts the distances from near to far along the extension lines of the two sides of the fan-shaped area to obtain a sorting result, and determines the sorting result corresponding to the at least one search data as the search result corresponding to the search instruction. Thus, only the data within the target search range can be searched to determine at least one search data, and the at least one search data can be sorted according to the distance from the center point position of the vehicle, that is, the distance from the user, and the sorted results can be output as search results. Search data that is closer to the user can be displayed to the user first, which is convenient for the user to select, further improving the user experience.

[0081] In an embodiment of the present disclosure, after determining the search results corresponding to the search instruction, the target search method may further include: determining the number of times corresponding to the search, comparing the number with a preset number threshold, and obtaining a first result; and / or; determining the number of search results, comparing the number with a preset number threshold, and obtaining a second result; determining whether to continue the search based on the first result and / or the second result.

[0082] In some embodiments of the present disclosure, when performing a search, the electronic device determines the number of searches corresponding to the search, and stops searching when the number is greater than or equal to a preset threshold number of searches; otherwise, the search continues.

[0083] In other embodiments of the present disclosure, after the electronic device searches and determines the search results, it determines the number of corresponding search results in the search results. When the number is less than or equal to a preset threshold, the search is stopped; otherwise, the search is continued.

[0084] In some other embodiments of the present disclosure, when performing a search, the electronic device determines the corresponding number of searches and the number of corresponding search results in the search results. When the number of searches is greater than or equal to a preset number threshold and the number of search results is less than or equal to a preset number threshold, the search is stopped; otherwise, the search is continued.

[0085] In the embodiment of the present disclosure, whether to continue searching can be determined based on the number of search results and the number of searches, thereby ensuring that the search results are accurate and meet user needs while reducing the waste of resources caused by the search.

[0086] Figure 3 is a flowchart of another target search method provided by an embodiment of the present disclosure, as shown in the figure, the target search method can include the following steps: Figure 3

[0087] S310, acquire a search instruction of a user, the search instruction including a voice search instruction and gesture indication information.

[0088] S320, send an inquiry instruction to the user, and receive a reply voice of the user based on the inquiry instruction.

[0089] S330, identify the voice search instruction and the reply voice to obtain a semantic result, and identify the gesture indication information to obtain a search direction corresponding to the gesture indication information.

[0090] In an embodiment of the present disclosure, the semantic result is determined according to a first semantic result corresponding to the voice search instruction and a second semantic result corresponding to the reply voice.

[0091] In an embodiment of the present disclosure, when the search is a first search, steps S340-S360 are performed, and when the search is a non-first search, steps S370-S390 are performed.

[0092] S340, when the search is a first search, acquire a center point position of a vehicle, rotate a first straight line along the search direction and passing through the center point position of the vehicle by a preset angle in a clockwise direction and an anticlockwise direction respectively to obtain a sector region.

[0093] S350, determine a first circle center on the first straight line based on a first radius with the center point position of the vehicle as a starting point, and determine a region where a circle corresponding to the first circle center and the first radius is located as a first search range.

[0094] S360, search in the first search range based on the semantic result to determine a search result corresponding to the search instruction.

[0095] S370, when the search is a non-first search, determine two intersection points of a circle corresponding to a last search range and two edges of the sector region.

[0096] S380, determine a second radius based on the first radius and a preset relationship between the first radius and the second radius, determine a second circle center on the first straight line, and determine a region where a circle corresponding to the second circle center and the second radius is located as a second search range, the circle passing through the two intersection points.

[0097] S390, search in the second search range based on the semantic result to determine a search result corresponding to the search instruction.

[0098] ​S3010, it is determined whether to continue searching, if yes, continue searching, otherwise stop searching.

[0099] It should be noted that the specific implementation of steps S310-S3010 is similar to the implementation of the relevant steps in the above-mentioned embodiments of the present disclosure, and will not be repeated here.

[0100] In the embodiments of the present disclosure, the search can be performed through the voice search instruction and the gesture indication information, and more detailed voice information related to the search instruction can be obtained through voice interaction with the user, and then the search range is determined according to the search direction corresponding to the gesture indication information, and the search is performed based on the semantic result corresponding to the more detailed voice information obtained after the inquiry, thereby further improving the accuracy of the search result and improving the user experience.

[0101] Figure 4 FIG. 4 is a structural schematic diagram of a target search device provided by an embodiment of the present disclosure. The target search device in the embodiment of the present disclosure can be arranged in an electronic device, which can be a server or a terminal or a server cluster, wherein the terminal can specifically include a mobile phone, a computer or a tablet computer, a vehicle-mounted terminal, or any device capable of processing a target search method, and the like, which is not limited here.

[0102] As shown in FIG. 4, the target search device 400 can include an instruction obtaining module 410, an instruction analysis module 420, and a target search module 430. Figure 4

[0103] The instruction obtaining module 410 can be used to obtain the search instruction of the user and the current position information of the vehicle.

[0104] The instruction analysis module 420 can be used to obtain the image data information of the user based on the search instruction, and determine the gesture indication information of the user according to the image data information.

[0105] The target search module 430 can be used to determine the search range according to the gesture indication information and the current position information of the vehicle, perform the search in the search range based on the search instruction, and determine the search result corresponding to the search instruction.

[0106] ​In the embodiments of the present disclosure, the search instruction of the user and the current position information of the vehicle can be acquired, after the search instruction of the user is acquired, the image data information of the user is acquired based on the search instruction, the gesture indication information of the user is determined according to the image data information, the search range is determined according to the gesture indication information and the current position information of the vehicle, the search is performed in the search range based on the search instruction, and the search result corresponding to the search instruction is determined. Therefore, the search can be performed based on the search instruction and the gesture indication information of the user, the search result is determined, the search range is determined through the gesture indication information, the search demand of the user is further clarified, and the search range is further narrowed, thereby improving the accuracy of the search result and improving the user experience.

[0107] In some embodiments of the present disclosure, the search instruction includes a voice search instruction, and the target search module 430 can be specifically configured to analyze the voice search instruction to determine a first semantic result corresponding to the voice search instruction; search in the search range according to the first semantic result to determine the search result corresponding to the search instruction.

[0108] In some embodiments of the present disclosure, the target search device 400 can further include a user interaction module.

[0109] The user interaction module can be configured to send an inquiry instruction to the user after analyzing the voice search instruction to determine the first semantic result corresponding to the voice search instruction; receive a reply voice fed back by the user based on the inquiry instruction; and identify the reply voice to obtain a second semantic result corresponding to the reply voice, the second semantic result including attribute information of the target object.

[0110] The target search module 430 can be specifically configured to search in the search range according to the first semantic result and the second semantic result to determine the search result corresponding to the search instruction.

[0111] In some embodiments of the present disclosure, the target search module 430 can be specifically configured to, when the search is a first search, determine a center point position of the vehicle based on the current position information of the vehicle, rotate a first straight line along the search direction corresponding to the gesture indication information and passing through the center point position of the vehicle by a preset angle in a clockwise direction and an anticlockwise direction respectively to obtain a sector area, and determine a first circle center on the first straight line based on the center point position of the vehicle as a starting point and a first radius, and determine a first search range in an area where a circle corresponding to the first circle center and the first radius is located.

[0112] In some embodiments of the present disclosure, the target search module 430 can be further configured to, when the search is a non-first search, determine two intersection points of a circle corresponding to a last search range and two edges of the sector region; determine a second radius based on the first radius and a preset relationship between the first radius and the second radius; determine a second circle center on the first straight line, and determine a region where a circle corresponding to the second radius is located as a second search range, the circle corresponding to the second radius passing through the two intersection points.

[0113] In some embodiments of the present disclosure, the target search module 430 can be configured to determine a target search range in the sector region based on the search range; search based on a semantic result corresponding to the search instruction in the target search range, determine at least one piece of search data matching the semantic result corresponding to the search instruction, and sort the at least one piece of search data from near to far along the extension direction of the two edges of the sector region based on the distance between the position corresponding to the at least one piece of search data and the center point position of the vehicle, and obtain the search result corresponding to the search instruction based on the sorting result.

[0114] In some embodiments of the present disclosure, the target search device 400 can further include a search determination module.

[0115] The search determination module can be configured to, after determining the search result corresponding to the search instruction, determine a search frequency, compare the frequency with a preset frequency threshold to obtain a first result; and / or determine a number of search results, compare the number with a preset number threshold to obtain a second result; and determine whether to continue the search based on the first result and / or the second result.

[0116] It should be noted that, Figure 4 The target search device 400 shown can perform each step in the above method embodiments, and achieve each process and effect in the above method embodiments, which will not be repeated here.

[0117] Figure 5 A structural schematic diagram of an electronic device provided by an embodiment of the present disclosure is shown.

[0118] In an embodiment of the present disclosure, Figure 5 The electronic device shown can be a server or a terminal or a server cluster, where the terminal can specifically include a mobile phone, a computer or a tablet computer, a vehicle-mounted terminal, or any device capable of being used for a target search method, without limitation.

[0119] As Figure 5 The electronic device can include a processor 510 and a memory 520 storing computer program instructions.

[0120] In particular, the processor 510 can include a central processing unit (CPU), or an application-specific integrated circuit (ASIC), or can be configured as one or more integrated circuits that implement embodiments of the present application.

[0121] The memory 520 can include mass storage for information or instructions. By way of example, and not limitation, the memory 520 can include a hard disk drive (HDD), a floppy disk drive, flash memory, an optical disc, a magneto-optical disc, magnetic tape, or a Universal Serial Bus (USB) drive or a combination of two or more of these. Storage memory 520, where appropriate, can be removable or non-removable (or fixed) media. Storage memory 520, where appropriate, can be internal or external to the integrated gateway device. In certain embodiments, the storage memory 520 is non-volatile solid-state memory. In certain embodiments, the storage memory 520 includes read-only memory (ROM). Where appropriate, this ROM can be mask-programmed ROM, programmable ROM (PROM), erasable PROM (EPROM), electrically erasable PROM (EEPROM), electrically alterable ROM (EAROM), or flash memory, or a combination of two or more of these. Where appropriate, this ROM can be combined with the CPU, ASIC, one or more integrated circuits, or any other logic device of the integrated gateway device.

[0122] The processor 510 performs the steps of the target search method provided by the embodiments of the present disclosure by reading and executing computer program instructions stored in the memory 520.

[0123] In one example, the electronic device can also include a transceiver 530 and a bus 540. As shown, the processor 510, the memory 520, and the transceiver 530 are connected and communicate with each other through the bus 540. Figure 5

[0124] ​Bus 540 includes a hardware, software, or both. By way of example and not limitation, a bus can include an Accelerated Graphics Port (AGP) or other graphics bus, an Extended Industry Standard Architecture (EISA) bus, a Front Side BUS (FSB), a Hyper Transport (HT) interconnect, an Industry Standard Architecture (ISA) bus, an InfiniBand™ interconnect, a Low Pin Count (LPC) bus, a memory bus, a Micro Channel Architecture (MCA) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a Serial Advanced Technology Attachment (SATA) bus, a Video Electronics Standards Association Local Bus (VLB) bus, or another suitable bus or a combination of two or more of these. Where appropriate, bus 540 can include one or more buses of the same type or buses of different types.

[0125] The embodiment of the present disclosure further provides a computer readable storage medium, which can store a computer program. When the computer program is executed by a processor, the processor implements the target search method provided by the embodiment of the present disclosure.

[0126] The storage medium described above can for example include a memory 520 of computer program instructions, and the above instructions can be executed by the processor 510 of the electronic device to complete the target search method provided by the embodiment of the present disclosure. Alternatively, the storage medium can be a non-transitory computer readable storage medium, for example, the non-transitory computer readable storage medium can be a ROM, a Random Access Memory (RAM), a Compact Disc Read-Only Memory (CD-ROM), a magnetic tape, a floppy disk, and an optical data storage device, etc.

[0127] The embodiment of the present disclosure further provides a vehicle, which includes an electronic device, and each process and effect in the above-mentioned embodiment of the present disclosure can be realized, and details are not described herein.

[0128] It has to be noted that, in the present document, the terms "first", "second", etc. merely serve the purpose of distinguishing between two entities or operations, without necessarily requiring or implying any actual relationship or order between these entities or operations. Moreover, the term "comprising", used in the context of describing a composition, a process, a method, an article, or an apparatus, should not be construed as implying any servitudes or excluding the possession of additional elements or steps. However, the singular forms "a", "an" and "the" include plural references unless the context clearly dictates otherwise.

[0129] The foregoing is merely illustrative of the principles of this disclosure and various modifications can be made by those skilled in the art without departing from the spirit and scope of the disclosure. The above embodiments are illustrative, and not restrictive. The scope of the disclosure should therefore be determined not with reference to the above description but with reference to the claims appended hereto.

Claims

1. A target search method characterized by comprising: The method comprises: acquiring a search instruction of a user and current position information of a vehicle; acquiring image data information of the user based on the search instruction, and determining gesture indication information of the user according to the image data information; determining a search range according to the gesture indication information and the current position information of the vehicle, searching in the search range based on the search instruction, and determining a search result corresponding to the search instruction.

2. The method of claim 1, wherein, The search instruction comprises a voice search instruction, and the searching in the search range based on the search instruction and determining the search result corresponding to the search instruction comprise: analyzing the voice search instruction to determine a first semantic result corresponding to the voice search instruction; searching in the search range according to the first semantic result to determine the search result corresponding to the search instruction.

3. The method of claim 2, wherein, After the analyzing the voice search instruction to determine the first semantic result corresponding to the voice search instruction, the method further comprises: sending an inquiry instruction to the user; receiving a reply voice fed back by the user based on the inquiry instruction; recognizing the reply voice to obtain a second semantic result corresponding to the reply voice, the second semantic result comprising attribute information of a target object; the searching in the search range according to the first semantic result to determine the search result corresponding to the search instruction comprises: searching in the search range according to the first semantic result and the second semantic result to determine the search result corresponding to the search instruction.

4. The method according to any one of claims 1 to 3, characterized in that, When the search is a first search, the determining the search range according to the gesture indication information and the current position information of the vehicle comprises: determining a center point position of the vehicle based on the current position information of the vehicle, rotating a first straight line along a search direction corresponding to the gesture indication information and passing through the center point position of the vehicle by a preset angle in a clockwise direction and an anticlockwise direction respectively to obtain a sector area; taking the center point position of the vehicle as a starting point, determining a first circle center on the first straight line based on a first radius, and determining an area where a circle corresponding to the first circle center and the first radius is located as a first search range.

5. The method of claim 4, wherein, When the search is a non-first search, the determining the search range according to the gesture indication information and the current position information of the vehicle comprises: determining two intersection points of a circle corresponding to a last search range and two edges of the sector area; determining a second radius based on the first radius and a preset relationship between the first radius and the second radius; determining a second circle center on the first straight line, and determining an area where a circle corresponding to the second circle center and the second radius is located as a second search range, the circle passing through the two intersection points.

6. The method of claim 4, wherein, The searching in the search range based on the search instruction and determining the search result corresponding to the search instruction comprise: determining a target search range in the sector area based on the search range; searching, based on the semantic result corresponding to the search instruction, in the target search range, to determine at least one piece of search data matching the semantic result corresponding to the search instruction, and sorting, based on a distance between a position corresponding to the at least one piece of search data and a center point position of the vehicle, from near to far along an extension direction of two edges of the fan-shaped region, the at least one piece of search data, to obtain a search result corresponding to the search instruction.

7. The method of claim 1, wherein, After the search result corresponding to the search instruction is determined, the method further includes: determining a number of times of the search, comparing the number of times with a preset number of times threshold, and obtaining a first result; and / or; determining a number of pieces of the search result, comparing the number of pieces with a preset number of pieces threshold, and obtaining a second result; determining, based on the first result and / or the second result, whether to continue the search.

8. A target search apparatus characterized by comprising: including: an instruction obtaining module configured to obtain a search instruction of a user and current position information of a vehicle; an instruction analyzing module configured to obtain image data information of the user based on the search instruction, and determine gesture indication information of the user according to the image data information; a target searching module configured to determine a search range according to the gesture indication information and the current position information of the vehicle, and search, based on the search instruction, in the search range to determine a search result corresponding to the search instruction.

9. An electronic device, comprising: including: a memory; a processor; and a computer program; wherein the computer program is stored in the memory and configured to be executed by the processor to implement the method in any one of claims 1-7.

10. A computer-readable storage medium having stored thereon a computer program, characterized in that, The computer program is executed by the processor to implement the method in any one of claims 1-7.

11. A vehicle characterized by comprising: The electronic device includes the electronic device in claim 9.

Images