A parking image display method, system, device, electronic equipment and medium

Abstract

The embodiment of the present specification provides a display method of a parking image, comprising: collecting coordinate information of a user interaction operation on a display screen; determining a parking image of a target view angle to be interacted by the user according to the collected coordinate information, and outputting the parking image of the target view angle to a specified area of the display screen; determining an instruction corresponding to the interaction operation according to the position relationship of the collected coordinate information, and executing the instruction on the parking image of the target view angle; and performing image recognition on an area where the collected coordinate information in the parking image of the target view angle is located, judging whether there is an obstacle, and marking the obstacle in the display screen. In the above process, the picture can be fully covered; by determining the parking image of the target view angle according to the collected coordinate information and executing the corresponding instruction, the accurate display of the picture can be realized, which is convenient for the user to observe the surroundings; and by judging the obstacle based on the coordinate information, the car machine can be assisted to shorten the obstacle recognition time.

Description

TECHNICAL FIELD

[0001] The present specification relates to the field of vehicles, and in particular to a display method, system and device of a parking image, an electronic device and a medium. BACKGROUND

[0002] In recent years, with the development of economy, the number of cars is increasing, and cars have become an essential means of transportation in people's daily life, bringing great convenience to people's production and life. However, due to various factors, various traffic accidents occur frequently. In order to protect the lives and property of drivers and reduce the possibility of traffic accidents, the safety of vehicles needs to be further improved.

[0003] In improving the safety of vehicles, in addition to improving the performance of the vehicle itself, an intelligent auxiliary driving system can also be installed to help drivers obtain traffic environment information and facilitate drivers to understand the road conditions.

[0004] For example, a camera can be installed on the rear side of the vehicle. By outputting the camera image to the vehicle display screen, the driver can be provided with real-time images behind the vehicle, thereby avoiding the problem of excessive visual angle blind area when the driver is reversing and improving the safety of driving.

[0005] However, the above-mentioned image display method still needs to be further optimized to improve the user experience. SUMMARY

[0006] Therefore, one or more embodiments of the present specification provide a display method, device, electronic device and storage medium of a parking image to solve the problems in the related art.

[0007] To achieve the above-mentioned purpose, one or more embodiments of the present specification provide technical solutions as follows:

[0008] According to a first aspect of an embodiment of the present specification, a display method of a parking image is provided, applied to a vehicle, comprising:

[0009] In response to a user's interactive operation on the display screen, coordinate information of the interactive operation on the display screen is collected; wherein the display screen outputs a plurality of parking images of different viewing angles;

[0010] According to the collected coordinate information, the target viewing angle of the parking image that the user wants to interact is determined, and the target viewing angle of the parking image is output to the specified area of the display screen;

[0011] According to the position relationship of the collected coordinate information, the instruction corresponding to the interactive operation is determined, and the instruction is executed on the target viewing angle of the parking image;

[0012] The region where the collected coordinate information in the parking image of the target view angle is located is subjected to image recognition, whether there is an obstacle is judged, and the obstacle is marked in the display screen.

[0013] According to a second aspect of the embodiments of the present specification, a parking image display system applied to a vehicle is provided, comprising:

[0014] a camera for collecting parking images;

[0015] a display screen for user interaction and collecting coordinate information of the interaction on the display screen; and outputting parking images of several different view angles;

[0016] a processor for determining the target view angle of the parking image to be interacted by the user according to the collected coordinate information, and outputting the target view angle of the parking image to the designated area of the display screen; determining the instruction corresponding to the interaction according to the position relationship of the collected coordinate information, and executing the instruction on the target view angle of the parking image; and performing image recognition on the region where the collected coordinate information in the target view angle of the parking image is located, judging whether there is an obstacle, and marking the obstacle in the display screen.

[0017] According to a third aspect of the embodiments of the present specification, a parking image display device applied to a vehicle is provided, comprising:

[0018] a collection module for collecting coordinate information of the interaction on the display screen in response to user interaction with the display screen; wherein the display screen outputs parking images of several different view angles;

[0019] an output module for determining the target view angle of the parking image to be interacted by the user according to the collected coordinate information, and outputting the target view angle of the parking image to the designated area of the display screen;

[0020] an execution module for determining the instruction corresponding to the interaction according to the position relationship of the collected coordinate information, and executing the instruction on the target view angle of the parking image;

[0021] an identification module for performing image recognition on the region where the collected coordinate information in the target view angle of the parking image is located, judging whether there is an obstacle, and marking the obstacle in the display screen.

[0022] According to a fourth aspect of the embodiments of the present specification, an electronic device is provided, comprising a communication interface, a processor, a memory and a bus, the communication interface, the processor and the memory are connected with each other through the bus;

[0023] The memory stores machine readable instructions, and the processor executes the above method by invoking the machine readable instructions.

[0024] According to a fifth aspect of the embodiments of the present specification, a machine readable storage medium is provided, which stores machine readable instructions, and the machine readable instructions, when invoked and executed by a processor, implement the above method.

[0025] The technical solutions provided by the embodiments of the present specification can include the following beneficial effects:

[0026] Through the above technical solutions, by outputting multiple parking images of different perspectives, the all-around coverage of the picture can be realized; by the coordinate information collected, the parking image of the target perspective can be determined, and the corresponding instructions can be executed, so that the accurate display of the picture can be realized, which is convenient for the user to observe the surroundings, and through the obstacle judgment based on the coordinate information, the vehicle can be assisted to shorten the obstacle recognition time. BRIEF DESCRIPTION OF DRAWINGS

[0027] Figure 1 A flowchart of a parking image display method is provided for an exemplary embodiment of the present specification.

[0028] Figure 2 A schematic diagram of a parking image is provided for an exemplary embodiment of the present specification.

[0029] Figure 3 A parking image system of a vehicle is provided for an exemplary embodiment of the present specification.

[0030] Figure 4 A structural schematic diagram of an electronic device in which a parking image display device is provided for an exemplary embodiment of the present specification.

[0031] Figure 5 A block diagram of a parking image display device is provided for an exemplary embodiment of the present specification. DETAILED DESCRIPTION

[0032] The exemplary embodiments will be described in detail herein with reference to the accompanying drawings. The following description relates to the accompanying drawings, in which the same numbers represent the same or similar elements throughout the several drawings. The implementations described in the following exemplary embodiments do not represent all implementations consistent with one or more embodiments of the present specification. Instead, they are merely examples of apparatuses and methods consistent with some aspects of one or more embodiments of the present specification, as detailed in the appended claims.

[0033] It should be noted that the steps of the respective methods are not necessarily performed in the order shown and described in this specification in other embodiments. In some other embodiments, the steps included in the methods thereof can be more or less than described in this specification. Furthermore, a single step described in this specification can be broken down into multiple steps in other embodiments; and multiple steps described in this specification can be combined into a single step in other embodiments.

[0034] Currently, multiple cameras can be mounted on a vehicle to provide images located at different positions of the vehicle body, but when these images are output to the display screen in the vehicle, they are usually operated by the user operating physical buttons or virtual buttons on the screen, and the screen is operated based on instructions corresponding to the functions of these buttons.

[0035] However, when the display screen displays these images, it usually displays fixed images at fixed positions, and the image display is not flexible enough. Moreover, due to the button operation, usually one button corresponds to one function, and due to the limited number of buttons, the functions that can be provided are limited, which is not conducive to providing diversified functions for users, and the operation is not convenient enough.

[0036] Therefore, this specification provides a technical solution that flexibly switches parking images based on collected coordinate information, executes corresponding instructions to achieve accurate display of the images, and identifies obstacles.

[0037] In implementation, coordinate information of an interactive operation on the display screen can be collected in response to a user's interactive operation on the display screen.

[0038] In one example, when the user interacts on the display screen through touch control, coordinate point collection can be performed to collect coordinate information of the user's interactive operation on the display screen.

[0039] The target parking image of the target view angle that the user wants to interact can be determined according to the collected coordinate information, and the target parking image of the target view angle can be output to a specified area of the display screen.

[0040] In one example, the display screen can output parking images of several different view angles. In order to provide more accurate image display to the user, the target parking image of the target view angle that the user wants to interact can be determined based on the user's interactive operation according to the coordinate information corresponding to the interactive operation, and then the target parking image of the target view angle can be output to a specified area of the display screen to provide the user with a better viewing experience.

[0041] The instruction corresponding to the interactive operation can be determined according to the positional relationship of the collected coordinate information, and the instruction can be executed on the target parking image of the target view angle.

[0042] In one example, for a parking image from a determined target viewpoint, the system can also determine the user's interactive operation command based on the positional relationship between the coordinate points in the collected coordinate information, and execute the command on the parking image from the target viewpoint to diversify the image presentation.

[0043] Image recognition can be performed on the area where the collected coordinate information is located in the parking image from the target viewpoint to determine whether there is an obstacle, and the obstacle can be marked on the display screen.

[0044] In one example, for parking images from the target viewpoint, image recognition can be performed on the area where the collected coordinate information is located to determine whether there are obstacles. If there are, the obstacles can be further marked on the display screen.

[0045] By using the above technical solutions, parking images from multiple different perspectives can be output, achieving full-range coverage of the scene. By collecting coordinate information, the parking image from the target perspective can be determined, and corresponding commands can be executed to achieve accurate display of the image, making it easier for users to observe their surroundings. Furthermore, by judging obstacles based on coordinate information, the vehicle system can be assisted in shortening obstacle recognition time.

[0046] The display method of parking images in this manual will be described in detail below with reference to the accompanying drawings.

[0047] Please see Figure 1 , Figure 1 A flowchart illustrating a parking image display method provided as an exemplary embodiment of this specification, applied to a vehicle, includes the following steps:

[0048] Step 101: In response to the user's interactive operation on the display screen, the coordinate information of the interactive operation on the display screen is collected; wherein, the display screen outputs parking images from several different perspectives.

[0049] Step 102: Determine the parking image of the target view that the user wants to interact with based on the collected coordinate information, and output the parking image of the target view to a designated area of ​​the display screen.

[0050] Step 103: Determine the instruction corresponding to the interactive operation based on the positional relationship of the collected coordinate information, and execute the instruction on the parking image from the target viewpoint;

[0051] Step 104: Perform image recognition on the area where the collected coordinate information is located in the parking image from the target viewpoint, determine whether there is an obstacle, and mark the obstacle on the display screen.

[0052] In the embodiment, the coordinate information of the interaction operation on the display screen can be collected in response to the interaction operation of the user on the display screen.

[0053] For example, the vehicle can be provided with a display screen that can be touched by the user, and the display screen outputs parking images output to the display screen by a plurality of cameras provided on the vehicle. The cameras provided at different positions of the vehicle provide parking images of different perspectives, which can provide the user with all-around and dead-angle-free environmental information to assist the driver in judgment.

[0054] In the embodiment, the display screen can be a terminal carrier of an in-vehicle entertainment system, the parking images can be provided by an around view monitor (AVM) of the vehicle, and the steps 102-104 can be processed by the AVM or an auto parking assist (APA) system of the vehicle.

[0055] In an embodiment, the vehicle is provided with four panoramic cameras, which are respectively arranged at the front, rear, left and right of the vehicle.

[0056] The plurality of parking images of different perspectives include a plurality of parking images of different perspectives corresponding to the following three view modes:

[0057] 2D view mode parking images, which correspond to parking images of top view, 2D front view, 2D rear view, 2D left view and 2D right view perspectives;

[0058] Wide-angle view mode parking images, which correspond to parking images of top view, front wide-angle view and rear wide-angle view perspectives;

[0059] 3D view mode parking images, which correspond to parking images of top view, 3D front view, 3D rear view, 3D left view and 3D right view perspectives.

[0060] For example, the vehicle can be provided with at least four panoramic cameras, which are divided into front cameras, rear cameras, left cameras and right cameras according to different positions arranged at the front, rear, left and right of the vehicle.

[0061] After obtaining the surrounding images of the vehicle through the panoramic cameras, image processing can be further performed to obtain parking images in different view modes. For example, 2D view mode panoramic parking images can be obtained through camera joint calibration, distortion removal, projection transformation and weight fusion.

[0062] The image processing method can be selected by the person skilled in the art as needed, and the present specification does not limit the same.

[0063] For example, Figure 2 For example, Figure 2 A schematic diagram of a parking image is provided in an exemplary embodiment of the present specification. In Figure 2 , three view modes are included, including a 2D view mode, a wide-angle view mode and a 3D view mode. In the three view modes, the parking image output on the display screen has a variety of viewing angles for the user to refer to.

[0064] As Figure 2 shown, the parking image of the 2D view mode corresponds to the parking image of the overhead view, 2D front view, 2D rear view, 2D left view and viewing angle; the parking image of the wide-angle view mode corresponds to the parking image of the overhead view, front wide-angle view and rear wide-angle view; the parking image of the 3D view mode corresponds to the parking image of the overhead view, 3D front view, 3D rear view, 3D left view and 3D right view.

[0065] In the present embodiment, the target viewing angle parking image to be interacted by the user can be determined according to the collected coordinate information, and the target viewing angle parking image is output to the designated area of the display screen.

[0066] For example, assuming that the user interacts with the area of the 2D front view parking image on the display screen, since the position touched by the user during interaction can be known according to the coordinate point, the target viewing angle parking image to be interacted by the user in the different viewing angle parking images of the 2D view mode currently output by the display screen can be determined according to the collected coordinate information, and then the determined target viewing angle parking image is output to the designated area of the display screen.

[0067] When the target viewing angle parking image is output to the designated area of the display screen, the designated area can also be the full screen area for the user to view more clearly.

[0068] In an embodiment shown, the parking image corresponding to the position of the last collected coordinate information in the display screen can be determined as the target viewing angle parking image to be interacted by the user, and the display screen output is switched to the target viewing angle parking image.

[0069] Since the user may change his mind during interaction or the user's track during touch has no regularity, etc., the judgment based on all the collected coordinate information during the user's interaction process may lead to inaccurate judgment results, and the user needs to interact again, which brings the user an unpleasant interaction experience.

[0070] In one example, in order to avoid the above problems, the parking image corresponding to the final interaction position of the user can be obtained according to the position of the last collected coordinate information in the display screen, that is, the parking image of the target view angle to be interacted by the user, and then the entire screen output by the display screen is switched to the parking image of the target view angle.

[0071] In the embodiment, the instruction corresponding to the interaction operation can be determined according to the positional relationship of the collected coordinate information, and the instruction is executed on the parking image of the target view angle.

[0072] For example, for the determined parking image of the target view angle, the instruction corresponding to the interaction operation of the user can also be determined according to the positional relationship between the coordinate points in the collected coordinate information, and the instruction is executed on the parking image of the target view angle to diversify the screen presentation.

[0073] It should be noted that the touch operation of the user on the display screen can be divided into pressing and sliding, and the user usually performs a continuous operation when pressing the display screen, and the coordinate points change little, while when sliding, the coordinate points will certainly change, and different sliding operations correspond to different operation trajectories, so that a plurality of interaction operations can be set to provide personalized instructions for the user to achieve diversified presentation of the screen.

[0074] In one embodiment, when the maximum distance between the coordinates in the collected coordinate information is less than a threshold, the interaction operation is determined to be a continuous pressing operation, and the parking image of the target view angle is enlarged and displayed with the coordinate information as the center region based on the zoom-in instruction corresponding to the continuous pressing operation.

[0075] For example, when the positional relationship of the collected coordinate information is that the maximum distance between the coordinates is less than a threshold, it can be determined that the coordinates are collected when the user continuously presses, and the interaction operation is determined to be a continuous pressing operation. Then, the parking image of the target view angle can be enlarged and displayed with the coordinate information as the center region based on the zoom-in instruction corresponding to the continuous pressing operation.

[0076] For example, when the user wants to view a certain object in the 2D left view parking image, the user can continuously press the position of the object in the display screen, and then according to the collected coordinate information, it can be determined that the target view angle of the parking image to be interacted by the user is the 2D left view parking image, and it can be determined that the interaction operation of the user is a continuous pressing operation. The parking image of the target view angle can be enlarged and displayed with the collected coordinate information as the center region based on the corresponding zoom-in instruction, so as to achieve the effect of zooming in on the object, thereby enabling more clear and accurate observation in the display screen.

[0077] In an embodiment shown, the magnification factor is positively correlated with the duration of the continuous pressing operation.

[0078] For example, when collecting coordinate information, the duration of the continuous pressing operation can be determined according to the time when the coordinate information is collected. The longer the duration, the greater the magnification factor, which facilitates the user to observe flexibly.

[0079] In an embodiment shown, when the maximum distance between each coordinate in the collected coordinate information reaches a threshold, the interaction operation is determined to be a moving operation, and the moving trajectory corresponding to the moving operation is identified according to the coordinate information. When the moving trajectory is identified as a straight line, the instruction corresponding to the interaction operation is determined to be a view mode switching instruction, and the parking image of the target view is switched to the parking image of the view corresponding to the target view in other view mode. When the moving trajectory is identified as a circular arc, the instruction corresponding to the interaction operation is determined to be a picture resetting instruction, and the parking image of the target view is restored to the default state.

[0080] In an example, when the positional relationship of the collected coordinate information is that the maximum distance between each coordinate reaches a threshold, it can be determined that these coordinates are collected when the user slides on the display screen, and the interaction operation can be determined to be a moving operation.

[0081] Then, the moving trajectory corresponding to the moving operation can be further identified according to the coordinate information. When the moving trajectory is identified as a straight line, the moving operation can be determined to be a straight line sliding operation, and the corresponding instruction is a view mode switching instruction, which requires switching the parking image of the target view to the parking image of the view corresponding to the target view in other view mode.

[0082] For example, when the user performs a straight line sliding operation on the parking image of the 2D left view, the parking image of the 2D left view can be switched to the parking image of the 3D left view in the 3D view mode. For another example, when the user performs a straight line sliding interaction operation on the parking image of the 3D front view, the parking image of the 3D front view can be switched to the parking image of the front wide-angle view in the wide-angle view mode.

[0083] When the moving trajectory is identified as a circular arc, the moving operation can be determined to be a circular sliding operation, and the corresponding instruction is a picture resetting instruction, which can restore the parking image of the target view to the default state.

[0084] For example, when the user performs a circular sliding operation on the parking image of the 2D left view, the parking image of the 2D left view can be switched to the initial state while displaying the parking images of different views corresponding to all 2D view modes.

[0085] It should be noted that, when the trajectory is recognized, the user's touch trajectory is not necessarily a perfect straight line or a perfect circle, and thus the approximation degree of the trajectory can reach a specified threshold, and the threshold can be determined by the person skilled in the art as needed.

[0086] In addition, the correspondence between the above interaction operation and the instruction is not specified, and the person skilled in the art can change it as needed.

[0087] In this embodiment, the region where the collected coordinate information is located in the parking image of the target view angle can be subjected to image recognition to determine whether there is an obstacle, and the obstacle can be marked in the display screen.

[0088] For example, for the parking image of the target view angle, the region where the collected coordinate information is located can be subjected to image recognition to determine whether there is an obstacle, and if there is an obstacle, the obstacle can be further marked in the display screen.

[0089] In one embodiment, the region where the collected coordinate information is located in the parking image of the target view angle can be subjected to image recognition to determine whether there is an obstacle; if there is an obstacle, the distance between the obstacle and the vehicle based on the radar carried by the vehicle is detected, and the obstacle and the distance between the obstacle and the vehicle are marked in the display screen.

[0090] In one example, when the user views the parking image of the target view angle, the obstacle recognition can be actively performed based on the user's interaction operation, the region where the collected coordinate information is located is subjected to image recognition to determine whether there is an obstacle, if there is an obstacle, the distance between the obstacle and the vehicle based on the radar carried by the vehicle is detected, and the obstacle and the distance between the obstacle and the vehicle are marked in the display screen, thereby achieving a one-stroke two-stroke effect, and the user only needs to operate once to obtain accurate picture display and shorten the obstacle recognition time.

[0091] Through the above technical solutions, by outputting a plurality of parking images of different view angles, the picture can be fully covered; by the collected coordinate information, the parking image of the target view angle can be determined, and the corresponding instruction can be executed, the picture can be accurately displayed, the user can be facilitated to observe the surroundings, and through the obstacle judgment based on the coordinate information, the vehicle can be assisted to shorten the obstacle recognition time.

[0092] Please refer to Figure 3 , Figure 3 A parking image system of a vehicle is provided for an exemplary embodiment of the present specification. As shown in Figure 3 , it comprises:

[0093] The camera 301 is configured to collect a parking image.

[0094] a display screen 302 for user interaction and collecting coordinate information of the interaction on the display screen; and outputting parking images of different perspectives;

[0095] a processor 303 for determining a target perspective parking image to be interacted by the user according to the collected coordinate information, and outputting the target perspective parking image to a designated area of the display screen; determining an instruction corresponding to the interaction according to a positional relationship of the collected coordinate information, and executing the instruction on the target perspective parking image; and performing image recognition on an area of the target perspective parking image where the collected coordinate information is located, judging whether there is an obstacle, and marking the obstacle in the display screen.

[0096] For example, the camera can be an Around View Monitor (AVM) of a vehicle, and the vehicle can be equipped with multiple panoramic cameras to collect parking images of different perspectives. The processor can be a processor of the AVM or a processor of an automatic parking assistance system. The display screen can be a terminal carrier configured by an in-vehicle entertainment system.

[0097] Taking the processor of the AVM as an example, the processor of the AVM can send the parking images collected by the camera to the terminal display screen, and the terminal display screen can output parking images of multiple different perspectives. When the user performs an interaction on the parking images on the terminal display screen, the terminal display screen can collect coordinate information of the interaction on the display screen.

[0098] The processor can determine a target perspective parking image to be interacted by the user according to the coordinate information sent by the terminal display screen, and output the target perspective parking image to a designated area of the display screen; determine an instruction corresponding to the interaction according to a positional relationship of the collected coordinate information, and execute the instruction on the target perspective parking image; and perform image recognition on an area of the target perspective parking image where the collected coordinate information is located, judge whether there is an obstacle, and mark the obstacle in the display screen.

[0099] The implementation process is specifically described in the implementation process of the corresponding steps in the display method of the parking image, and the relevant part is described in the method implementation part, which will not be repeated here.

[0100] By the above technical solution, the all-around coverage of the picture can be realized by outputting the parking images of multiple different perspectives; the target perspective parking image can be determined by the collected coordinate information, and the corresponding instruction can be executed, so that the accurate display of the picture can be realized, the user can observe the surroundings conveniently, and the obstacle judgment based on the coordinate information can assist the car machine to shorten the obstacle identification time.

[0101] In the exemplary embodiments of the present specification, a device capable of implementing the above method is also provided.

[0102] Figure 3 Fig. 1 is a schematic structural diagram of a device provided by an exemplary embodiment. Please refer to Figure 4 At the hardware level, the device includes a processor 402, an internal bus 404, a network interface 406, a memory 408, and a non-volatile memory 410, and of course, other hardware required by the business. One or more embodiments of the present specification can be implemented in a software manner, such as reading the corresponding computer program from the non-volatile memory 410 into the memory 408 by the processor 402 and then running. Of course, in addition to the software implementation, one or more embodiments of the present specification do not exclude other implementation manners, such as logic devices or a combination of software and hardware, and the like, that is, the execution subject of the following processing flow is not limited to each logic unit, but can also be hardware or a logic device.

[0103] Please refer to Figure 5 In a software implementation, a parking image display device 500 is provided, which is applied to a vehicle. As shown in Figure 5 The device 500 includes:

[0104] An acquisition module 501 acquires coordinate information of an interactive operation on the display screen in response to the interactive operation of the user on the display screen, wherein the display screen outputs parking images of several different perspectives;

[0105] An output module 502 determines a target perspective parking image to be interacted by the user according to the collected coordinate information, and outputs the target perspective parking image to a designated area of the display screen;

[0106] An execution module 503 determines an instruction corresponding to the interactive operation according to the positional relationship of the collected coordinate information, and executes the instruction on the target perspective parking image;

[0107] An identification module 504 performs image identification on the area where the collected coordinate information is located in the target perspective parking image, judges whether there is an obstacle, and marks the obstacle in the display screen.

[0108] Optionally, the vehicle is equipped with four panoramic cameras, which are respectively located at the front, rear, left and right of the vehicle.

[0109] The parking images of the plurality of different perspectives include a plurality of different perspective parking images corresponding to the following three view modes respectively:

[0110] 2D view mode parking images corresponding to the overhead view, 2D front view, 2D rear view, 2D left view and 2D right view perspective parking images;

[0111] Wide-angle view mode parking images corresponding to the overhead view, front wide-angle view and rear wide-angle view perspective parking images;

[0112] 3D view mode parking images corresponding to the overhead view, 3D front view, 3D rear view, 3D left view and 3D right view perspective parking images.

[0113] Optionally, the output module 502 further comprises:

[0114] According to the position of the last collected coordinate information in the display screen, the parking image corresponding to the position is the target perspective parking image to be interacted by the user, and the display screen output is switched to the target perspective parking image.

[0115] Optionally, the execution module 503 further comprises:

[0116] When the maximum distance between each coordinate in the collected coordinate information is less than a threshold value, it is determined that the interaction operation is a continuous pressing operation;

[0117] Based on the zoom-in instruction corresponding to the continuous pressing operation, the target perspective parking image is zoomed in and displayed with the coordinate information as the center region.

[0118] Optionally, the zoom-in multiple is positively correlated with the duration of the continuous pressing operation.

[0119] Optionally, the execution module 503 further comprises:

[0120] When the maximum distance between each coordinate in the collected coordinate information reaches a threshold value, it is determined that the interaction operation is a moving operation, and the moving trajectory corresponding to the moving operation is identified according to the coordinate information;

[0121] When the moving trajectory is identified as a straight line, it is determined that the instruction corresponding to the interaction operation is a view mode switching instruction, and the target perspective parking image is switched to the perspective parking image corresponding to the target perspective in other view modes.

[0122] In response to the mobile trajectory being identified as a circular arc, it is determined that the instruction corresponding to the interaction operation is a picture resetting instruction, and the parking image of the target view angle is restored to a default state.

[0123] Optionally, the identification module 504 further comprises:

[0124] image recognition is performed on a region in which the collected coordinate information in the parking image of the target view angle is located, to determine whether there is an obstacle;

[0125] If there is, the distance between the obstacle and the vehicle is detected based on the radar carried by the vehicle, and the obstacle and the distance between the obstacle and the vehicle are marked in the display screen.

[0126] The implementation process of the functions and roles of the modules in the device 500 is specifically described above, and the implementation process of the corresponding steps in the display method of the parking image is specifically described above. For related parts, refer to the part of the method embodiments. Here, it will not be repeated.

[0127] The device embodiments described above are only schematic, and the units described as separate components can or can not be physically separated, and the components displayed as units can or can not be physical modules. That is, they can be located in one place, or distributed on multiple network modules. Some or all of the units or modules can be selected according to actual needs to achieve the purpose of the scheme of the present application. Those skilled in the art can understand and implement it without creative labor.

[0128] The system, device, module or unit illustrated in the above embodiments can be specifically implemented by a computer chip or entity, or by a product with certain functions. A typical implementation device is a computer, and the specific form of the computer can be a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email transceiver device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.

[0129] In a typical configuration, the computer includes one or more processors (CPU), input / output interfaces, network interfaces, and memories.

[0130] The memory can include non-persistent memory in a computer readable medium, random access memory (RAM), and / or non-volatile memory, such as read-only memory (ROM) or flash memory (flash RAM). The memory is an example of a computer readable medium.

[0131] Computer-readable media includes permanent and non-permanent, moveable and non- moveable media that can be implemented by any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disc read-only memory (CD-ROM), digital versatile disks (DVDs) or other optical storage, magnetic cassettes, magnetic disks storage, quantum memory, graphene-based storage media, or other magnetic storage devices, or any other non-transmission medium that can be used to store information accessible to a computing device. According to the definitions herein, computer-readable media does not include transitory computer-readable media, such as modulated data signals and carrier waves.

[0132] It is also to be noted that the terms "comprising", "including", and any other variation thereof are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but can also include other elements not expressly listed or inherent to such process, method, article, or apparatus. An element proceeded by "comprises a... " does not, without more constraints, exclude the existence of additional identical elements in the process, method, article, or apparatus that comprises the element.

[0133] The above description of specific embodiments of the disclosure has been presented for the purpose of illustration. Other embodiments are within the scope of the following claims. In some cases, the actions recited in the claims can be performed in a different order and still achieve desirable results. Additionally, the process depicted in the figures does not necessarily require the particular order shown, or sequential order to achieve the desired results. In certain implementations, multitasking and parallel processing can be advantageous.

[0134] The terminology used in this description is for the purpose of describing particular embodiments only and is not intended to limit the one or more embodiments of the description. As used in this description and the appended claims, the singular forms "a," "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will also be understood that the term "and / or," as used herein, refers to and encompasses any and all possible combinations of one or more of the associated listed items.

[0135] It should be understood that, although the terms first, second, third, etc. can be used herein to describe various information, the information should not be limited to these terms. These terms are only used to differentiate one piece of information from another. For example, a first information can also be termed a second information, and, similarly, a second information can also be termed a first information, without departing from the scope of the one or more embodiments. The word "if' can be interpreted to mean "upon" or "when" or "in response to the determination" depending on the context.

[0136] The foregoing description of the one or more embodiments of the present disclosure is by way of example only, and other embodiments of the present disclosure are within the scope of the present disclosure as delineated by the claims, with equivalents of the claims to be included therein.

Claims

1. A method for displaying parking images, applied to a vehicle, comprising: In response to user interaction with the display screen, the coordinate information of the interaction on the display screen is collected; wherein, the display screen outputs parking images from several different perspectives; The parking image of the target view that the user wants to interact with is determined based on the collected coordinate information, and the parking image of the target view is output to a designated area of ​​the display screen, including: based on the position of the last collected coordinate information on the display screen, the parking image corresponding to the position is the parking image of the target view that the user wants to interact with, and the screen output is switched to the parking image of the target view. The command corresponding to the interactive operation is determined based on the positional relationship of the collected coordinate information, and the command is executed on the parking image from the target perspective. The method involves performing image recognition on the area where the coordinate information collected in the parking image from the target view is located, determining whether an obstacle exists, and marking the obstacle on the display screen. This includes: performing image recognition on the area where the coordinate information collected in the parking image from the target view is located, determining whether an obstacle exists; if an obstacle exists, detecting the distance between the obstacle and the vehicle based on the radar mounted on the vehicle, marking the obstacle and the distance between the obstacle and the vehicle on the display screen.

2. The method according to claim 1, wherein the vehicle is equipped with four panoramic cameras, which are located at the front, rear, left, and right of the vehicle respectively; The parking images from different perspectives include the following three view modes, each corresponding to a different perspective: Parking images in 2D view mode, which correspond to parking images from top view, 2D front view, 2D rear view, 2D left view and 2D right view perspectives. Parking images in wide-angle view mode, which correspond to parking images from top-down view, front wide-angle view and rear wide-angle view perspectives. The parking image in 3D view mode corresponds to the parking image from the perspectives of top view, 3D front view, 3D rear view, 3D left view and 3D right view.

3. The method according to claim 1, wherein determining the instruction corresponding to the interactive operation based on the positional relationship of the acquired coordinate information, and executing the instruction on the parking image from the target viewpoint, comprises: When the maximum distance between the coordinates in the collected coordinate information is less than a threshold, the interactive operation is determined to be a continuous press operation. Based on the magnification command corresponding to the continuous pressing operation, the parking image from the target perspective is magnified and displayed with the coordinate information as the central area.

4. The method according to claim 3, wherein the magnification factor is positively correlated with the duration of the continuous pressing operation.

5. The method according to claim 2, wherein determining the instruction corresponding to the interactive operation based on the positional relationship of the acquired coordinate information, and executing the instruction on the parking image from the target viewpoint, comprises: When the maximum distance between the coordinates in the collected coordinate information reaches a threshold, the interactive operation is determined to be a movement operation, and the movement trajectory corresponding to the movement operation is identified based on the coordinate information. When the movement trajectory is identified as a straight line, the instruction corresponding to the interaction operation is determined to be a view mode switching instruction, and the parking image of the target view is switched to a parking image of the view corresponding to the target view in another view mode. When the movement trajectory is identified as an arc, the instruction corresponding to the interaction operation is determined to be a screen reset instruction, and the parking image from the target perspective is restored to the default state.

6. A parking imaging system for a vehicle, comprising: Camera, used to capture parking images; A display screen is used for user interaction and to collect the coordinate information of the interaction on the display screen. In addition, it outputs parking images from several different perspectives; The processor is configured to determine the parking image of the target view that the user wants to interact with based on the collected coordinate information, and output the parking image of the target view to a designated area of ​​the display screen, including: based on the position of the last collected coordinate information on the display screen, setting the parking image corresponding to the position as the parking image of the target view that the user wants to interact with, and switching the screen output to the parking image of the target view. The system determines the instruction corresponding to the interactive operation based on the positional relationship of the collected coordinate information and executes the instruction on the parking image from the target perspective; and performs image recognition on the area where the collected coordinate information is located in the parking image from the target perspective to determine whether there is an obstacle, and marks the obstacle on the display screen, including: performing image recognition on the area where the collected coordinate information is located in the parking image from the target perspective to determine whether there is an obstacle; if there is, detecting the distance between the obstacle and the vehicle based on the radar mounted on the vehicle, and marking the obstacle and the distance between the obstacle and the vehicle on the display screen.

7. A parking image display device, applied to a vehicle, comprising: The acquisition module, in response to user interaction with the display screen, acquires the coordinate information of the interaction on the display screen; wherein, the display screen outputs parking images from several different perspectives; The output module determines the parking image of the target view that the user wants to interact with based on the collected coordinate information, and outputs the parking image of the target view to a designated area of ​​the display screen, including: based on the position of the last collected coordinate information on the display screen, setting the parking image corresponding to the position as the parking image of the target view that the user wants to interact with, and switching the screen output to the parking image of the target view. The execution module determines the instruction corresponding to the interactive operation based on the positional relationship of the collected coordinate information, and executes the instruction on the parking image from the target perspective; The identification module performs image recognition on the area where the collected coordinate information is located in the parking image from the target perspective, determines whether an obstacle exists, and marks the obstacle on the display screen; including: performing image recognition on the area where the collected coordinate information is located in the parking image from the target perspective, determining whether an obstacle exists; if an obstacle exists, detecting the distance between the obstacle and the vehicle based on the radar mounted on the vehicle, and marking the obstacle and the distance between the obstacle and the vehicle on the display screen.

8. An electronic device, comprising: processor; Memory used to store processor-executable instructions; The processor implements the method as described in any one of claims 1-5 by executing the executable instructions.

9. A machine-readable storage medium having stored thereon machine-readable instructions that, when executed by a processor, implement the steps of the method as claimed in any one of claims 1-5.

Images