Information acquisition method, device, equipment, vehicle, medium and product

Abstract

The invention discloses an information acquisition method and device, equipment, a vehicle, a medium and a product, and the method comprises the steps: carrying out the photographing of a target object through a camera in response to a first operation, and obtaining a target image; performing image recognition on the target image through the VLM to obtain first information; performing intention analysis on the first information to obtain a target intention; performing information search according to the target intention and the first information to obtain second information; and outputting the second information. In the above process, the user can input the first information to the first electronic device through the camera to obtain the second information, in the whole process, the user only needs to make the target object close to the camera, the operation is simple and convenient, additional operation is not needed, and the information obtaining efficiency is greatly improved.

Description

Technical Field

[0001] This application belongs to the field of computer technology, and in particular relates to an information acquisition method, apparatus, equipment, vehicle, medium and product. Background Technology

[0002] In existing technologies, when users search for information using electronic devices, they first need to input search information into the device (e.g., manually inputting text or using voice input). The electronic device then responds based on the search information. In this process, manually inputting text requires numerous input actions; if voice input is used, inaccurate voice recognition may lead to inaccurate search results. For example, the user's pronunciation might be non-standard, or the same pronunciation might represent two different pieces of information, resulting in inaccurate recognition. In such cases, the user needs to re-enter the information, increasing the user's workload. In other words, regardless of the input method used, the required user operations are cumbersome, consuming a significant amount of time in the search information input stage, resulting in low efficiency in obtaining search results. Summary of the Invention

[0003] This application provides an information acquisition method, apparatus, equipment, vehicle, medium, and product, which can simplify user operations and improve information acquisition efficiency.

[0004] In a first aspect, embodiments of this application provide an information acquisition method applied to a first electronic device, the first electronic device being equipped with a camera, the method comprising:

[0005] In response to the first operation, the camera captures an image of the target object to obtain the target image;

[0006] The target image is subjected to image recognition using a Visual Language Model (VLM) to obtain first information.

[0007] The first information is analyzed to obtain the target intent;

[0008] Based on the stated target intent and the first information, an information search is performed to obtain the second information;

[0009] Output the second piece of information.

[0010] Secondly, embodiments of this application provide an information acquisition device applied to a first electronic device, the first electronic device being equipped with a camera, the device comprising:

[0011] The shooting module is used to capture a target image by means of the camera in response to the first operation.

[0012] The recognition module is used to perform image recognition on the target image using a visual language model (VLM) to obtain first information.

[0013] The analysis module is used to perform intent analysis on the first information to obtain the target intent;

[0014] The search module is used to perform information search based on the target intent and the first information to obtain the second information;

[0015] The output module is used to output the second information.

[0016] Thirdly, embodiments of this application provide an electronic device, including: a processor and a memory storing computer program instructions; the processor executes the computer program instructions to implement the information acquisition method as described in the first aspect.

[0017] Fourthly, embodiments of this application provide a vehicle that includes the electronic equipment described in the third aspect.

[0018] Fifthly, embodiments of this application provide a computer-readable storage medium storing computer program instructions, which, when executed by a processor, implement the information acquisition method as described in the first aspect.

[0019] In a sixth aspect, embodiments of this application provide a computer program product, wherein instructions in the computer program product, when executed by a processor of an electronic device, cause the electronic device to perform the information acquisition method as described in the first aspect.

[0020] In this embodiment, in response to the first operation, the target object is captured by the camera to obtain a target image; image recognition of the target image is performed using VLM to obtain first information; intent analysis is performed on the first information to obtain the target intent; information search is performed based on the target intent and the first information to obtain second information; and the second information is output. During the above process, the user can input the first information into the first electronic device through the camera to obtain the second information. Throughout the process, the user only needs to bring the target object close to the camera, making the operation simple and convenient, requiring no additional operations, and greatly improving the efficiency of information acquisition. Furthermore, due to VLM's cross-modal semantic understanding capabilities, it can accurately parse mixed text and image content. Using VLM for target image recognition can improve the accuracy of image recognition, providing a solid foundation for subsequent processing. Attached Figure Description

[0021] To more clearly illustrate the technical solutions of the embodiments of this application, the accompanying drawings used in the embodiments of this application will be briefly introduced below. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0022] Figure 1 This is a flowchart illustrating the information acquisition method provided in an embodiment of this application;

[0023] Figure 2 This is a schematic diagram of the structure of the information acquisition device provided in the embodiments of this application;

[0024] Figure 3 This is a schematic diagram of the structure of the electronic device provided in the embodiments of this application. Detailed Implementation

[0025] The features and exemplary embodiments of various aspects of this application will be described in detail below. To make the objectives, technical solutions, and advantages of this application clearer, the application will be further described in detail below with reference to the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described herein are only intended to explain this application and not to limit it. For those skilled in the art, this application can be implemented without some of these specific details. The following description of the embodiments is merely to provide a better understanding of this application by illustrating examples.

[0026] It should be noted that, in this document, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising..." does not exclude the presence of additional identical elements in the process, method, article, or apparatus that includes said element.

[0027] In all specific embodiments of this application, when processing data related to user identity or characteristics, such as user information, user behavior data, user historical data, and user location information, user permission or consent is obtained first. Furthermore, the collection, use, and processing of this data comply with relevant laws, regulations, and standards. Additionally, when embodiments of this application require access to sensitive personal information, separate permission or consent from the user is obtained through pop-ups or redirects to confirmation pages. Only after obtaining the user's separate permission or consent is the necessary user-related data required for the proper functioning of these embodiments obtained.

[0028] To address the problems of the prior art, embodiments of this application provide an information acquisition method, apparatus, device, vehicle, medium, and product. The information acquisition method provided in this application embodiment will be described first below.

[0029] Figure 1 A flowchart illustrating an embodiment of the information acquisition method provided in this application is shown. Figure 1 As shown in the embodiment of this application, the information acquisition method is applied to a first electronic device, which is equipped with a camera, and includes the following steps 101-103, wherein:

[0030] Step 101: In response to the first operation, the target object is photographed by the camera to obtain a target image.

[0031] The first operation can be a voice operation, such as "Please navigate me here" or "Please play this music." For example, a user brings the target object close to the camera and says, "Please navigate me here," thus triggering the camera to take a picture of the target object through the first operation (voice operation). Alternatively, the first operation can also be the operation of the target object moving close to the camera. For example, when the first electronic device detects that the target object is within the camera's preset range, it controls the camera to take a picture of the target object. The target object can include a second electronic device, a note, a card, a map, or other medium capable of transmitting information, and is not limited here.

[0032] In one embodiment, the first operation is used to move the target object until at least one of the following is satisfied:

[0033] (1) The distance between the target object and the camera is less than a first preset distance threshold. This limitation ensures that the camera can clearly capture the target object, and avoids the target object from simply falling into the camera's shooting range without needing to be captured, thus preventing false captures.

[0034] (2) The proportion of the target object in the shooting area of ​​the camera is greater than the preset proportion. This limitation can ensure that the camera can clearly capture the target object, and avoid the target object simply falling into the shooting range of the camera without needing to be captured, thus causing false capture.

[0035] (3) The maximum movement distance between the target object and the camera within a preset time period is less than the second preset distance threshold. This limitation ensures that the relative position between the target object and the camera changes little, which facilitates the camera's focusing and ensures that the camera can clearly capture the target object.

[0036] The first preset distance threshold, preset percentage, and second preset distance threshold can all be set according to actual conditions, and are not limited here. The preset duration can be 0.5 seconds or 1 second, and is not limited here.

[0037] When the first electronic device detects that the target object meets at least one of the above conditions, it controls the camera to take a picture of the target object.

[0038] Step 102: Perform image recognition on the target image using VLM to obtain first information.

[0039] Due to the cross-modal semantic understanding capabilities of the Vision-Language Model (VLM), it is possible to accurately parse mixed text and image content. Using VLM for image recognition of target images can improve the accuracy of image recognition and provide a solid foundation for subsequent processing.

[0040] For navigation or music interfaces, VLM supports structured information extraction, such as parsing the destination (e.g., "Lujiazui") from a navigation map; VLM also supports unstructured content understanding, such as recognizing song titles (combining album art and lyrics) and artist names from a music interface.

[0041] Step 103: Perform intent analysis on the first information to obtain the target intent.

[0042] For example, the VLM performs intent analysis on the first information to obtain the target intent. If the first information includes address-related information, the target intent is a navigation intent; if the first information includes audio-related information, the target intent is an audio playback intent. The powerful intent understanding capabilities of the VLM can improve the accuracy of intent analysis, making the target intent more precise.

[0043] For example, if the first information includes place names, store names, shopping mall names, community names, building names, river names, scenic spot names, etc., which are related to addresses, then the target intent is determined to be a navigation intent; if the first information includes audio names, album names, artists, etc., which are related to audio, then the target intent is determined to be an audio playback intent.

[0044] Step 104: Perform an information search based on the target intent and the first information to obtain the second information.

[0045] For example, an application configured on the first electronic device that matches the target intent is launched, and the application performs an information search based on the first information to obtain the second information. For instance, if the target intent is a navigation intent, the navigation application configured on the first electronic device performs navigation based on the destination to obtain the second information, which includes at least one navigation route.

[0046] For example, if the target intent is audio playback, the audio playback application configured on the first electronic device searches for second information based on song title, album name, artist, lyrics, etc. The second information includes at least one audio file.

[0047] For example, if the target intent includes both navigation intent and audio playback intent, the first electronic device will launch the navigation application and the audio playback application, and use the navigation application to navigate according to the destination, and use the audio playback application to search according to song title, album name, artist, etc., so that the second information obtained includes at least one navigation route and at least one audio.

[0048] Step 105: Output the second information.

[0049] If the second information includes a navigation route, the navigation route is displayed on the first electronic device; if the second information includes audio, the audio information of the audio is displayed on the first electronic device, and / or the audio is played.

[0050] The first electronic device can be an in-vehicle device, a computer, a mobile phone, a tablet, etc.

[0051] In this embodiment, in response to the first operation, the target object is captured by the camera to obtain a target image; image recognition is performed on the target image using a VLM to obtain first information; intent analysis is performed on the first information to obtain the target intent; information search is performed based on the target intent and the first information to obtain second information; and the second information is output. In the above process, the user can input the first information into the first electronic device through the camera and obtain the second information. Throughout the process, the user only needs to bring the target object close to the camera, making the operation simple and convenient, requiring no additional operations, and greatly improving the efficiency of information acquisition.

[0052] In one embodiment of this application, the target intent is a navigation intent, and the first information includes the destination; the step of performing an information search based on the target intent and the first information to obtain the second information includes:

[0053] Launch the navigation application configured on the first electronic device;

[0054] The navigation application navigates from the current location of the first electronic device to the destination to obtain the second information, which includes at least one navigation route.

[0055] In this embodiment, if the target intent is navigation, the navigation application configured on the first electronic device is activated, and navigation is performed through the navigation application. For example, the first electronic device inputs the starting and ending positions into the navigation application, which then navigates based on these positions to obtain at least one navigation route. The obtained navigation routes are then displayed on the screen of the first electronic device, or each navigation route is announced; this is not limited to this method.

[0056] In the above process, when the target intent is determined to be a navigation intent, the navigation application configured on the first electronic device is automatically launched, and the navigation application navigates according to the destination in the first information to obtain at least one navigation route. The entire process does not require human intervention, which can simplify user operation and improve navigation efficiency.

[0057] In yet another embodiment of this application, after outputting the second information, the method further includes:

[0058] If the second information includes multiple navigation routes, then in response to the second operation, one navigation route is selected from the multiple navigation routes as the target navigation route;

[0059] Display the target navigation route.

[0060] In this embodiment, if the second information includes multiple navigation routes, the user needs to perform an operation to select a target navigation route. The second operation can be selecting the target navigation route. For example, if multiple navigation routes are displayed on the screen of the first electronic device, the second operation can be clicking on the target navigation route. Alternatively, the second operation can be a voice operation to select the target navigation route, such as the voice command "Select the second route." If multiple navigation routes are output sequentially, the second operation is a voice operation to select the target navigation route, such as the voice command "Select the shortest route."

[0061] After the target navigation route is determined, it is displayed on the screen of the first electronic device for the user to navigate.

[0062] In this embodiment, when the second information includes multiple navigation routes, the user can select the target navigation route through the second operation, which is simple, convenient and quick.

[0063] In another embodiment of this application, the target intent is a navigation intent, and the first information includes the destination and navigation information, wherein the navigation information refers to navigation-related information other than the destination obtained from the target image;

[0064] The step of searching for information based on the target intent and the first information to obtain the second information includes:

[0065] Launch the navigation application configured on the first electronic device;

[0066] The navigation application navigates from the current location of the first electronic device to the destination.

[0067] If multiple navigation routes are obtained, the navigation information is used to filter the multiple navigation routes to obtain second information, which includes the filtered navigation routes.

[0068] In this embodiment, the first information includes the destination and navigation information. The navigation information may include place names, shop names, shopping mall names, community names, building names, river names, scenic spot names, etc., that need to be passed through. The navigation information may also include whether it passes through highway sections, congested road sections, tunnels, overpasses, etc. The navigation information may also include place names, shop names, shopping mall names, community names, building names, river names, scenic spot names, etc., that the existing navigation route passes through, and / or the shape of the existing navigation route.

[0069] If the target intent is navigation, the navigation application configured on the first electronic device is launched, and navigation is performed through the application. For example, the first electronic device inputs the starting and ending positions into the navigation application, which then navigates based on these positions to obtain at least one navigation route. If multiple navigation routes are obtained, they are filtered using navigation information to obtain second information. It should be noted that if there is only one navigation route, the second information is output directly without filtering, and only that single navigation route is included in the second information.

[0070] In this embodiment, when the target intent is determined to be a navigation intent, the navigation application configured on the first electronic device is automatically launched. The navigation application then navigates according to the destination in the first information. If multiple navigation routes are obtained, they are filtered based on the navigation information to obtain the second information. This process requires no human intervention, simplifying user operation and improving navigation efficiency.

[0071] In another embodiment of this application, the target object is the display screen of a second electronic device, on which a first navigation route is displayed;

[0072] The navigation route obtained through the filtering process is the navigation route that has the highest matching degree with the first navigation route among the multiple navigation routes.

[0073] Specifically, the target object is the display screen of the second electronic device, which displays a first navigation route (which is an existing navigation route). The first electronic device takes a picture of the target object through a camera to obtain a target image, which includes the first navigation route. Image recognition is performed on the target image to identify the destination, place names, shop names, shopping mall names, community names, building names, river names, scenic spot names, etc., along with the shape of the existing navigation route.

[0074] This method matches each of the multiple navigation routes with the first navigation route. For example, it matches place names, shop names, shopping mall names, residential area names, building names, river names, and scenic spot names along the two routes. Scores are assigned based on the degree of matching, with higher scores for higher matching. The specific scoring method can be set according to the actual situation; for example, shops along the same route receive 5 points, and residential area names along the same route receive 3 points. Furthermore, the method can calculate the length of the overlapping section between the two routes based on the place names, shop names, shopping mall names, residential area names, building names, river names, and scenic spot names along the two routes. The longer the overlapping section, the higher the score. The method can also calculate the similarity of the shapes of the two routes; higher similarity indicates a higher degree of matching. In this way, navigation routes similar to or identical to the first navigation route can be filtered from multiple navigation routes. This avoids the problem of users having to re-enter the destination and select a navigation route on the first electronic device after navigating on a second electronic device, greatly simplifying user operations, improving information retrieval efficiency, and enhancing the user experience.

[0075] In another embodiment of this application, the target intent is an audio playback intent, and the first information includes an audio identifier;

[0076] The step of searching for information based on the target intent and the first information to obtain the second information includes:

[0077] Launch the audio playback application configured on the first electronic device;

[0078] The audio playback application searches based on the audio identifier to obtain second information, which includes at least one audio file.

[0079] Specifically, the audio identifier may include the audio name, album name, artist, lyrics, etc. If the target intent is audio playback, the audio playback application configured on the first electronic device is launched, and a search is performed through the audio playback application. For example, the first electronic device inputs the audio identifier into the audio playback application, and the audio playback application searches based on the audio identifier to obtain at least one audio file. Then, when outputting the second information, the audio information for each audio file may be displayed on the screen of the first electronic device. The audio information may include the audio name, album name, artist, album cover, etc.

[0080] In this embodiment, when the target intent is determined to be an audio playback intent, the audio playback application configured on the first electronic device is automatically launched. The audio playback application then searches for at least one audio file based on the audio identifier in the first information. This process requires no human intervention, simplifying user operations and improving audio search efficiency.

[0081] In yet another embodiment of this application, after outputting the second information, the method further includes:

[0082] If the second information includes multiple audio files, then in response to the third operation, one audio file is selected from the multiple audio files as the target audio file;

[0083] Play the target audio.

[0084] Specifically, if the second information includes multiple audio files, the user needs to perform an operation to select one audio file for playback. The third operation can be the operation of selecting the target audio file. For example, if the audio information of multiple audio files is displayed on the screen of the first electronic device, the third operation can be the operation of clicking the target audio file. Alternatively, the third operation can be a voice operation that selects the target audio file, such as the voice operation "select the second one".

[0085] After the target audio is determined, the audio information of the target audio is displayed on the screen of the first electronic device for the user to view.

[0086] In this embodiment, when the second information includes multiple audio files, the user can select the target audio file through a third operation, which is simple, convenient and quick.

[0087] Furthermore, the first information also includes the audio playback progress. When playing the target audio, the playback start position of the target audio can be set according to the audio playback progress. For example, if the audio playback progress is at the 1st minute and 12th second of the audio, then the playback start position is the 1st minute and 12th second of the target audio, or the playback start position is the 1st minute and 10th second of the target audio (the playback start position can be moved forward slightly by a certain amount of time, and the amount of time can be set according to the actual situation, which is not limited here), and the target audio is controlled to start playing from the playback start position.

[0088] In a scenario where a user is listening to the song "Orchid Grass" on a second electronic device and wants to continue listening via the car's in-vehicle system, the user can bring the interface of the second electronic device (which displays one or more of the song title, artist, lyrics, and audio playback progress) close to the camera of the first electronic device. The first electronic device's camera will then capture a target image. After processing, the first electronic device will generate multiple versions of the "Orchid Grass" audio. The user can then select one of these versions as the target audio. Once the target audio is selected, the first electronic device will start playing it from its initial position. This allows the user to continue listening to the same song via the in-vehicle system, achieving a seamless transition from the second to the first electronic device. This process is simple for the user and greatly improves the user experience.

[0089] In another embodiment of this application, the first information further includes audio playback progress;

[0090] The output of the second information includes:

[0091] If the second information includes an audio file, then the playback start position of the audio file is set according to the audio playback progress.

[0092] Control the audio to start playing from the playback start position.

[0093] In this embodiment, if the second information contains only one audio, the user does not need to select the target audio through a third operation; the first electronic device will play that single audio as the target audio.

[0094] The first information also includes the audio playback progress. When playing the audio, the playback start position is set according to the audio playback progress. For example, if the audio playback progress is at 1 minute and 12 seconds, then the playback start position is at 1 minute and 12 seconds, or the playback start position is at 1 minute and 10 seconds (the playback start position can be moved forward slightly by a certain amount of time, and the amount of time can be set according to the actual situation, which is not limited here), and the audio is controlled to start playing from the playback start position.

[0095] In a scenario where a user is listening to the song "Orchid Grass" on a second electronic device and wants to continue listening via the car's in-car system, the user can bring the interface of the second electronic device (which displays one or more of the song title, artist, lyrics, and audio playback progress) close to the camera of the first electronic device. The first electronic device's camera will then capture an image of the target song. After processing, the first electronic device will produce the audio of "Orchid Grass" and start playing it from the beginning. This allows the user to continue listening to the same song via the in-car system, achieving a seamless transition in audio playback from the second to the first electronic device. This process is simple for the user and greatly improves the user experience.

[0096] In this embodiment, after image recognition of the target image, the audio playback progress is also obtained. When the second information includes an audio file, the playback start position of the audio is set according to the playback progress. When playing the audio, playback begins from the start position, allowing audio playback to be transferred from one device (i.e., the initial device for audio playback, which can be considered the second electronic device) to another device (i.e., the first electronic device) for continued playback, achieving seamless transition of the same audio playback across different devices. Furthermore, during this process, the user only needs to bring the target object (the display screen of the second electronic device) close to the camera of the first electronic device, without any additional operations, simplifying user operation, improving audio setting efficiency, and greatly enhancing the user experience.

[0097] The information acquisition method provided in this application can be applied to various scenarios, such as a user traveling by car. Specifically, the user writes down their destination on a piece of paper, brings the paper close to the camera of the in-vehicle device (first electronic device), and the camera takes a picture of the paper to obtain a target image. Then, the target image is recognized to obtain the destination. Analyzing the destination, if the target intent is determined to be a navigation intent, the navigation application on the first electronic device is launched to navigate according to the destination, obtaining at least one navigation route and displaying these navigation routes. The user can select one of these navigation routes as the target navigation route. Throughout the process, the user only needs two operations: one is to bring the paper close to the camera of the in-vehicle device, and the other is to select the target navigation route from at least one navigation route. The operation is simple and quick, which can improve the efficiency of obtaining the target navigation route. Moreover, the entire process can be used without voice interaction, so even people who do not speak a specific language can use it.

[0098] Figure 2 A structural diagram of the information acquisition device provided in an embodiment of this application is shown. Figure 2 As shown, the information acquisition device 400 is applied to a first electronic device, which is equipped with a camera. The information acquisition device 400 includes:

[0099] The shooting module 401 is used to capture a target image by means of the camera in response to the first operation.

[0100] The recognition module 402 is used to perform image recognition on the target image through the visual language model (VLM) to obtain first information;

[0101] Analysis module 403 is used to perform intent analysis on the first information to obtain the target intent;

[0102] Search module 404 is used to perform information search based on the target intent and the first information to obtain the second information;

[0103] Output module 405 is used to output the second information.

[0104] In one embodiment of this application, the analysis module 403 is specifically used for:

[0105] If the first information includes information associated with an address, the target intent is determined to be a navigation intent;

[0106] If the first information includes information associated with audio, the target intent is determined to be an audio playback intent.

[0107] In one embodiment of this application, the target intent is a navigation intent, and the first information includes the destination;

[0108] The search module 404 includes:

[0109] The first startup submodule is used to launch the navigation application configured in the first electronic device;

[0110] The first navigation submodule is used to navigate using the navigation application with the current location of the first electronic device as the starting location and the destination as the ending location to obtain the second information, the second information including at least one navigation route.

[0111] In one embodiment of this application, the information acquisition device 400 further includes:

[0112] The first selection module is configured to, in response to a second operation, select one navigation route from the multiple navigation routes as the target navigation route if the second information includes multiple navigation routes;

[0113] The display module is used to display the target navigation route.

[0114] In one embodiment of this application, the target intent is a navigation intent, and the first information includes the destination and navigation information, wherein the navigation information refers to navigation-related information other than the destination obtained from the target image;

[0115] The search module 404 includes:

[0116] The second startup submodule is used to launch the navigation application configured on the first electronic device;

[0117] The second navigation submodule is used to navigate using the navigation application, starting from the current location of the first electronic device and ending at the destination.

[0118] The selection submodule is used to filter multiple navigation routes based on the navigation information if multiple navigation routes are obtained, and obtain second information, the second information including the filtered navigation routes.

[0119] In one embodiment of this application, the target object is the display screen of a second electronic device, and the display screen of the second electronic device displays a first navigation route;

[0120] The navigation route obtained through the filtering process is the navigation route that has the highest matching degree with the first navigation route among the multiple navigation routes.

[0121] In one embodiment of this application, the target intent is an audio playback intent, and the first information includes an audio identifier;

[0122] The search module 404 includes:

[0123] The third startup submodule is used to launch the audio playback application configured on the first electronic device;

[0124] The search submodule is used to search in the audio playback application based on the audio identifier to obtain second information, the second information including at least one audio file.

[0125] In one embodiment of this application, the information acquisition device 400 further includes:

[0126] The second selection module is configured to select one audio from the plurality of audios as the target audio in response to a third operation if the second information includes multiple audios.

[0127] The playback module is used to play the target audio.

[0128] In one embodiment of this application, the first information further includes audio playback progress;

[0129] The output module 405 includes:

[0130] The setting submodule is used to set the playback start position of the audio according to the audio playback progress if the second information includes an audio.

[0131] The playback submodule is used to control the audio to start playing from the playback start position.

[0132] In one embodiment of this application, the first operation is used to move the target object until at least one of the following is satisfied:

[0133] The distance between the target object and the camera is less than a first preset distance threshold;

[0134] The target object occupies a larger proportion of the camera's shooting area than a preset proportion;

[0135] The maximum movement distance between the target object and the camera within a preset time period is less than a second preset distance threshold.

[0136] The information acquisition device 400 provided in this application embodiment can implement the various processes implemented in the aforementioned information acquisition method embodiment and achieve the same technical effect. To avoid repetition, it will not be described again here.

[0137] Figure 3 A schematic diagram of the hardware structure of the electronic device provided in an embodiment of this application is shown.

[0138] The electronic device may include a processor 601 and a memory 602 storing computer program instructions.

[0139] Specifically, the processor 601 may include a central processing unit (CPU), an application-specific integrated circuit (ASIC), or one or more integrated circuits that can be configured to implement the embodiments of this application.

[0140] Memory 602 may include mass storage for data or instructions. For example, and not limitingly, memory 602 may include a hard disk drive (HDD), floppy disk drive, flash memory, optical disk, magneto-optical disk, magnetic tape, or Universal Serial Bus (USB) drive, or a combination of two or more of these. Where appropriate, memory 602 may include removable or non-removable (or fixed) media. Where appropriate, memory 602 may be internal or external to the integrated gateway disaster recovery device. In a particular embodiment, memory 602 is non-volatile solid-state memory.

[0141] Memory may include read-only memory (ROM), random access memory (RAM), disk storage media devices, optical storage media devices, flash memory devices, and electrical, optical, or other physical / tangible memory storage devices. Therefore, typically, memory includes one or more tangible (non-transitory) computer-readable storage media (e.g., memory devices) encoded with software including computer-executable instructions, and when the software is executed (e.g., by one or more processors), it is operable to perform the operations described with reference to the methods according to the first or second aspect of this disclosure.

[0142] The processor 601 implements any of the information auditing methods described in the above embodiments by reading and executing computer program instructions stored in the memory 602.

[0143] In one example, the electronic device may also include a communication interface 603 and a bus 610. For example, Figure 3 As shown, the processor 601, memory 602, and communication interface 603 are connected through bus 610 and complete communication with each other.

[0144] The communication interface 603 is mainly used to realize communication between various modules, devices, units and / or equipment in the embodiments of this application.

[0145] Bus 610 includes hardware, software, or both, that couples components of an information auditing method or verification device together. For example, and not as a limitation, the bus may include an Accelerated Graphics Port (AGP) or other graphics bus, an Enhanced Industry Standard Architecture (EISA) bus, a Front Side Bus (FSB), HyperTransport (HT) interconnect, an Industry Standard Architecture (ISA) bus, an Infinite Bandwidth Interconnect, a Low Pin Count (LPC) bus, a memory bus, a Microchannel Architecture (MCA) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a Serial Advanced Technology Attachment (SATA) bus, a Video Electronics Standards Association Local (VLB) bus, or other suitable buses, or combinations of two or more of these. Where appropriate, bus 610 may include one or more buses. Although specific buses are described and illustrated in embodiments of this application, any suitable bus or interconnect is contemplated herein.

[0146] Furthermore, in conjunction with the information acquisition methods described in the above embodiments, this application embodiment can provide a computer storage medium for implementation. This computer storage medium stores computer program instructions; when these computer program instructions are executed by a processor, they implement any of the information acquisition methods described in the above embodiments.

[0147] This application provides a computer program product in which the instructions are executed by the processor of an electronic device, causing the electronic device to perform any of the information acquisition methods described in the above embodiments.

[0148] This application provides a vehicle that includes the electronic devices described in the above embodiments.

[0149] It should be clarified that this application is not limited to the specific configurations and processes described above and shown in the figures. For the sake of brevity, detailed descriptions of known methods are omitted here. In the above embodiments, several specific steps are described as examples. However, the method process of this application is not limited to the specific steps described. Those skilled in the art can make various changes, modifications, and additions, or change the order of steps, after understanding the spirit of this application.

[0150] The functional blocks shown in the above-described structural diagram can be implemented as hardware, software, firmware, or a combination thereof. When implemented in hardware, they can be, for example, electronic circuits, application-specific integrated circuits (ASICs), appropriate firmware, plug-ins, function cards, etc. When implemented in software, the elements of this application are programs or code segments used to perform the required tasks. Programs or code segments can be stored on a machine-readable medium or transmitted over a transmission medium or communication link via data signals carried on a carrier wave. "Machine-readable medium" can include any medium capable of storing or transmitting information. Examples of machine-readable media include electronic circuits, semiconductor memory devices, ROM, flash memory, erasable ROM (EROM), floppy disks, CD-ROMs, optical disks, hard disks, fiber optic media, radio frequency (RF) links, etc. Code segments can be downloaded via computer networks such as the Internet, intranets, etc.

[0151] It should also be noted that the exemplary embodiments mentioned in this application describe methods or systems based on a series of steps or apparatus. However, this application is not limited to the order of the above steps; that is, the steps can be performed in the order mentioned in the embodiments, or in a different order, or several steps can be performed simultaneously.

[0152] The foregoing flowcharts and / or block diagrams of methods, apparatus (systems) according to embodiments of the present disclosure have described various aspects of the present disclosure. It should be understood that each block in the flowcharts and / or block diagrams, and combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to create a machine such that these instructions, executable via the processor of the computer or other programmable data processing apparatus, enable the implementation of the functions / actions specified in one or more blocks of the flowcharts and / or block diagrams. Such a processor can be, but is not limited to, a general-purpose processor, a special-purpose processor, a special application processor, or a field-programmable logic circuit. It is also understood that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can also be implemented by special-purpose hardware performing the specified functions or actions, or can be implemented by a combination of special-purpose hardware and computer instructions.

[0153] The above description is merely a specific implementation of this application. Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems, modules, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here. It should be understood that the protection scope of this application is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in this application, and these modifications or substitutions should all be covered within the protection scope of this application.

Claims

1. An information acquisition method characterized by comprising: The method is applied to a first electronic device provided with a camera, and comprises the following steps: In response to a first operation, the target object is photographed by the camera to obtain a target image; An image recognition is performed on the target image by a visual language model (VLM) to obtain first information; An intent analysis is performed on the first information to obtain a target intent; An information search is performed according to the target intent and the first information to obtain second information; The second information is output.

2. The information acquisition method according to claim 1, characterized by, The intent analysis on the first information to obtain the target intent comprises: The VLM is used to analyze the intent of the first information to obtain the target intent, wherein if the first information comprises address-related information, the target intent is a navigation intent; If the first information comprises audio-related information, the target intent is an audio playing intent.

3. The information acquisition method according to claim 1, characterized by, The target intent is a navigation intent, and the first information comprises a destination; The information search according to the target intent and the first information to obtain the second information comprises: A navigation application configured on the first electronic device is started; The navigation application is used to perform navigation with a current position of the first electronic device as a starting position and the destination as an ending position to obtain the second information, wherein the second information comprises at least one navigation route.

4. The information acquisition method according to claim 3, characterized by, After the second information is output, the method further comprises: If the second information comprises multiple navigation routes, a target navigation route is selected from the multiple navigation routes in response to a second operation; The target navigation route is displayed.

5. The information acquisition method according to claim 1, characterized by, The target intent is a navigation intent, and the first information comprises a destination and navigation information, wherein the navigation information is information related to navigation obtained from the target image except the destination; The information search according to the target intent and the first information to obtain the second information comprises: A navigation application configured on the first electronic device is started; The navigation application is used to perform navigation with a current position of the first electronic device as a starting position and the destination as an ending position; If multiple navigation routes are obtained by navigation, the multiple navigation routes are filtered according to the navigation information to obtain the second information, wherein the second information comprises the filtered navigation route.

6. The information acquisition method according to claim 5, wherein The target object is a display screen of a second electronic device, and the display screen of the second electronic device displays a first navigation route; The filtered navigation route is a navigation route in the multiple navigation routes that has the highest matching degree with the first navigation route.

7. The information acquisition method according to claim 1, characterized by, The target intent is an audio playing intent, and the first information comprises an audio identifier; The information search according to the target intent and the first information to obtain the second information comprises: An audio playing application configured on the first electronic device is started; The audio playing application is used to search according to the audio identifier to obtain the second information, wherein the second information comprises at least one audio.

8. The information acquisition method according to claim 7, wherein After the second information is output, the method further comprises: If the second information includes multiple audios, in response to a third operation, one audio is selected from the multiple audios as a target audio; The target audio is played.

9. The information acquisition method according to claim 7, wherein The first information further includes an audio playing progress; The outputting of the second information includes: If the second information includes one audio, a playing start position of the audio is set according to the audio playing progress; The audio is controlled to start playing from the playing start position.

10. The information acquisition method of claim 1, wherein the first operation is used to move the target object until at least one of the following conditions is met: A distance between the target object and the camera is less than a first preset distance threshold; A proportion of the target object in a shooting area of the camera is greater than a preset proportion; A maximum moving distance of a relative position between the target object and the camera within a preset time length is less than a second preset distance threshold.

11. An information acquisition apparatus characterized by comprising: The apparatus is applied to a first electronic device, and the first electronic device is provided with a camera, and the apparatus includes: A shooting module configured to shoot a target object by the camera to obtain a target image in response to a first operation; An identification module configured to perform image recognition on the target image by a visual language model (VLM) to obtain first information; An analysis module configured to perform intent analysis on the first information to obtain a target intent; A search module configured to perform information search according to the target intent and the first information to obtain second information; An output module configured to output the second information.

12. An electronic device, comprising: The apparatus includes: A processor and a memory storing computer program instructions; The processor executes the computer program instructions to implement the information acquisition method of any one of claims 1-10.

13. A vehicle characterized by comprising: The vehicle includes the electronic device of claim 12.

14. A computer-readable storage medium, characterized in that, The computer readable storage medium stores computer program instructions, and the computer program instructions are executed by the processor to implement the information acquisition method of any one of claims 1-10.

15. A computer program product, characterised in that, The instructions in the computer program product are executed by the processor of the electronic device, so that the electronic device performs the information acquisition method of any one of claims 1-10. The instructions in the computer program product are executed by the processor of the electronic device, so that the electronic device performs the information acquisition method of any one of claims 1-10.

Images