Display method, vehicle, electronic equipment and interaction system

By integrating valet parking, roaming parking, summoning and car search functions in the parking and car search interface, the cumbersome problems of parking and car search processes in the existing technology are solved, and the user experience is improved and the smoothness of car use is improved.

CN120085780APending Publication Date: 2025-06-03YINWANG INTELLIGENT TECHNOLOGIES CO LTD

Patent Information

Application Number
CN202311604647.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-11-27
Publication Date
2025-06-03

AI Technical Summary

Technical Problem

The existing technology requires long-term manual parking spaces when parking, and walk to the destination after parking. There are problems such as vehicle damage and cost risks in manual parking, making it difficult to achieve efficient and convenient use or car search.

Method used

Provides a display method to display the parking and car search interface in response to trigger operations. The interface includes function icons such as valet parking, roaming parking, summoning and car search. Users can select the required functions on the same platform to achieve one-click activation of the functions.

Benefits of technology

Improve the user experience. By integrating multiple functions on the same platform, users can realize various functions without switching applications, simplifying the parking and car search process, and improving the smoothness and safety of car use.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120085780A_ABST
    Figure CN120085780A_ABST
Patent Text Reader

Abstract

The invention provides a display method, a vehicle, electronic equipment and an interaction system in the field of vehicles, which can be used for providing one-stop service integrating functions of valet parking, roaming parking, calling or vehicle searching and the like for a user, so that the user can select required functions on the same platform, and the user experience is improved. The method comprises the steps that triggering operation for a parking and vehicle searching interface is responded, for example, the parking and vehicle searching interface is displayed, the parking and vehicle searching interface comprises multiple icons, and the multiple icons comprise at least one icon in a valet parking icon, a roaming parking icon, a calling icon or a vehicle searching icon; the function corresponding to the valet parking icon is used for indicating to start the function of parking the vehicle into the parking space, the roaming parking icon is used for indicating the function of searching the parking space by the vehicle, the calling function is used for indicating the vehicle to drive to a designated place, and the vehicle searching function is used for indicating the function of acquiring the path to the vehicle.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of vehicles, and in particular, to a display method, a vehicle, an electronic device, and an interaction system. Background Art

[0002] Generally, when parking, it takes a long time for manual search for an empty parking space, and after parking, one still needs to walk to the final destination; after parking, one forgets to record the vehicle position, and when using the vehicle next time, it is difficult to find the vehicle or one needs to spend a long time walking to find the vehicle, which is time-consuming and laborious. For valet parking, there are still other risks such as vehicle damage and high costs, and the reservation and key handover operations are complex and energy-consuming. Therefore, realizing efficient and convenient vehicle use or vehicle search has become an urgent problem to be solved. Summary of the Invention

[0003] This application provides a display method, a vehicle, an electronic device, and an interaction system, which can be used to provide users with one-stop services integrating functions such as valet parking, roaming parking, summoning, or vehicle search, enabling users to select the required functions on the same platform and improving the user experience.

[0004] In view of this, in a first aspect, this application provides a display method, including: displaying a parking and vehicle search interface in response to a trigger operation on the parking and vehicle search interface, the parking and vehicle search interface including a plurality of icons, the plurality of icons including at least one of a valet parking icon, a roaming parking icon, a summoning icon, or a vehicle search icon, the function corresponding to the valet parking icon being used to indicate the function of starting the vehicle to park in a parking space, the roaming parking icon being used to indicate the function of the vehicle searching for a parking space, summoning being used to indicate the function of the vehicle driving to a specified location, vehicle search being used to indicate the function of obtaining the path to the vehicle, and parking query being used to indicate the function of querying the position of the vehicle.

[0005] Therefore, in the embodiments of this application, a variety of functions are integrated into the same platform, and users can start each function with one key without switching applications, enabling users to more conveniently start the required functions and improving the user experience.

[0006] In a possible implementation manner, the foregoing method may further include: sending control data to the vehicle in response to an operation on the selected icon in the parking and vehicle search interface, the control data including an instruction for indicating the vehicle to implement the function corresponding to the selected icon; and displaying the path when the vehicle implements the function corresponding to the selected icon.

[0007] Therefore, in the embodiments of the present application, when a user selects a certain icon, control data can be sent to the vehicle to control the vehicle to implement corresponding functions, such as functions that the vehicle needs to execute, such as valet parking, roaming parking, or summon, so as to realize one-key activation of the functions. And when the vehicle executes the corresponding task, the driving path of the vehicle can be displayed in real time, so as to realize the transparency of the process when the vehicle executes various functions, enabling the user to know the vehicle status in real time, improving the user experience, and enhancing the driving safety of the vehicle.

[0008] In a possible implementation manner, the foregoing method may further include displaying information collected by sensors in the vehicle when the vehicle implements the function corresponding to the selected icon. In the embodiments of the present application, the environmental information where the vehicle is located can also be displayed in real time, so that the user can more comprehensively know the environment where the vehicle is located, improving the user experience.

[0009] In a possible implementation manner, if the selected icon includes any one of a valet parking icon, a summon icon, and a vehicle finding icon, the foregoing display of the path when the vehicle implements the function corresponding to the selected icon may include: obtaining information about a first position, which may be the position selected by the user or the default position when the function is activated; subsequently obtaining at least one path according to the information about the first position, and the at least one path includes the path between the first position and the second position of the vehicle; and displaying the at least one path. Therefore, in the embodiments of the present application, a path between the vehicle and a specified position can be generated to facilitate functions such as valet parking, summon, or vehicle finding.

[0010] In a possible implementation manner, if the selected icon is a valet parking icon, at least one available parking space is displayed in the parking and vehicle finding interface, and the at least one available parking space is an unoccupied parking space; the foregoing obtaining of the information about the first position may include: in response to an operation on any one of the at least one available parking spaces, obtaining the position of the selected available parking space to obtain the information about the first position.

[0011] Therefore, in the embodiments of the present application, available parking spaces can be displayed on the display interface, and the user can select the parking space to be parked in, so that the vehicle can be parked in the position required by the user.

[0012] In a possible implementation manner, the foregoing method may further include: obtaining data collected by vehicle sensors and determining at least one available parking space according to the data collected by the sensors.

[0013] Therefore, in the embodiments of the present application, the distribution of available parking spaces can be obtained based on the data collected by vehicle sensors without relying on external data, enabling the automatic valet parking function of the vehicle to adapt to more scenarios, such as garages not included in the map, so that the vehicle can park in the parking space more accurately and improve the parking success rate.

[0014] In a possible implementation manner, the foregoing sending control data to the vehicle may include: obtaining a first path from at least one path; sending control data to the vehicle, where the first path is carried in the control data, and the first path is used to instruct the vehicle to travel along the first path to implement the function corresponding to the selected icon. Therefore, in the implementation manner of this application, the path when the vehicle executes the required function can be selected by the electronic device, for example, it can be selected by the user, so that the user can select an adapted driving path according to the actual scenario, improving the user experience and driving safety.

[0015] In a possible implementation manner, the foregoing method may be applied to an electronic device, and the method may further include: if the positioning of the vehicle coincides with the positioning of the electronic device, sending the image displayed on the electronic device to the vehicle for display on the display screen of the vehicle. Therefore, in the implementation manner of this application, when the vehicle travels into the area of the electronic device, for example, when the user gets in the car, the display interface of the electronic device can be transferred to the vehicle for display, thereby improving the user's visual experience.

[0016] In a possible implementation manner, if the selected icon is a roaming parking icon, the foregoing method may further include: sending a roaming parking instruction to the vehicle, where the roaming parking instruction is used to instruct the vehicle to search for available parking spaces and drive into the available parking spaces; correspondingly, the foregoing displaying the path when the vehicle implements the function corresponding to the selected icon may include: obtaining the positioning information when the vehicle travels to the available parking space and synchronously displaying the positioning information. Therefore, in the implementation manner of this application, when instructing the vehicle to perform roaming parking, the parking space search path of the vehicle can be displayed in real time on the electronic device, making the roaming parking of the vehicle more transparent and improving the user experience.

[0017] In a possible implementation manner, the foregoing method may further include: obtaining recommended information according to the information currently generated by the vehicle, where the recommended information includes information recommended for the vehicle; generating a recommended card according to the recommended information; and displaying the recommended card, where the recommended card includes an entry for the function recommended to be started for the vehicle.

[0018] Therefore, in the implementation manner of this application, recommended information can also be generated, that is, recommendations for functions that need to be started for the actual scenario. For example, in various scenarios, the user's intention can be analyzed to recommend the required functions for the user, improving the user experience.

[0019] In a possible implementation manner, the foregoing obtaining recommended information according to the information currently generated by the vehicle may include: obtaining the information of the historical period of the vehicle, where the historical period is the period corresponding to the current period in the historical time cycle; and obtaining the recommended information by combining the information of the historical period with the information generated in the current period of the vehicle.

[0020] Therefore, in the embodiments of the present application, the historical information of the same period of the user can be combined to make recommendations for the user in the current period, so that the recommended content can better meet the user's needs and improve the user experience.

[0021] In a possible implementation, the foregoing recommended information includes at least one of the following recommended information: exclusive parking space recommendation, charging parking space recommendation, roaming car-finding function recommendation, location recommendation for summoning the vehicle, car-finding function recommendation, or charging pile recommendation. Therefore, when making recommendations for the user, specific parking spaces or functions that may be used can be recommended to improve the user experience.

[0022] In a second aspect, the present application provides a display method applied to a vehicle, including: First, receiving control data from an electronic device, where the control data includes an instruction for instructing the vehicle to perform at least one of the functions of valet parking, roaming parking, or summoning; Subsequently, performing at least one function according to the control data and displaying the path of the vehicle when performing at least one function.

[0023] Therefore, in the embodiments of the present application, entrances for multiple functions can be set on the same platform, enabling users to more conveniently activate the required functions, such as valet parking, roaming parking, or summoning.

[0024] In a possible implementation, the foregoing control data is sent by an electronic device, and the above method may further include: when the positioning of the vehicle coincides with the positioning of the electronic device, receiving and displaying the image displayed on the electronic device. In the embodiments of the present application, when the vehicle travels into the area of the electronic device, for example, when the user gets in the car, the display interface of the electronic device can be transferred to the vehicle for display, thereby improving the user's visual experience.

[0025] In a third aspect, the present application provides an electronic device, which includes a display screen, a memory, and one or more processors. The memory stores the code of the graphical user interface of the application program. The one or more processors are used to execute the code of the graphical user interface (GUI) stored in the memory to display the graphical user interface on the display screen. The graphical user interface includes:

[0026] Displaying a parking and car-finding interface, the parking and car-finding interface includes multiple icons, the parking and car-finding interface includes multiple icons, the multiple icons include at least one of a valet parking icon, a roaming parking icon, a summoning icon, or a car-finding icon. The function corresponding to the valet parking icon is used to indicate the function of starting the vehicle to park in a parking space. The roaming parking icon is used to indicate the function of the vehicle searching for a parking space. Summoning is used to indicate the function of the vehicle driving to a specified location. Car-finding is used to indicate the function of obtaining the path to the vehicle. Parking query is used to indicate the function of querying the location of the vehicle.

[0027] Among them, the effects achieved by the third aspect or any optional implementation manner of the third aspect can refer to the description of the foregoing first aspect or any optional implementation manner of the first aspect, which will not be elaborated below.

[0028] In a possible implementation manner, the foregoing graphical user interface includes: in response to an operation on a selected icon in the parking search interface, displaying a path when implementing the function corresponding to the selected icon.

[0029] In a possible implementation manner, the foregoing graphical user interface further includes: displaying information collected by sensors in the vehicle when implementing the function corresponding to the selected icon.

[0030] In a possible implementation manner, the foregoing graphical user interface includes: if the selected icon is a valet parking icon or a summon icon, displaying a path for the vehicle to travel to a first position; if the selected icon includes a car search icon or a parking query icon, then displaying a path from the first position to the position of the vehicle.

[0031] In a possible implementation manner, the foregoing graphical user interface further includes: if the selected icon is a valet parking icon, at least one available parking space is further displayed in the parking search interface, and at least one available parking space is an unoccupied parking space; in response to an operation on any one of the at least one available parking spaces, displaying a path for the vehicle to park in the selected parking space.

[0032] In a possible implementation manner, the foregoing graphical user interface further includes: if the selected icon is a roaming parking icon, displaying positioning information when the vehicle travels to an available parking space.

[0033] In a possible implementation manner, the foregoing graphical user interface further includes: displaying a recommended card, and the recommended card includes recommended information obtained according to information currently generated by the vehicle, and the recommended information includes functions of the vehicle recommended to be activated.

[0034] In a possible implementation manner, the foregoing recommended information includes at least one of the following recommended information: exclusive parking space recommendation, charging parking space recommendation, roaming car search function recommendation, summon vehicle position recommendation, car search function recommendation, or charging pile recommendation.

[0035] In a fourth aspect, an embodiment of the present application provides a display device, and the display device has a function of implementing the display method in the foregoing first aspect. This function can be implemented by hardware or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the foregoing functions.

[0036] Fifth aspect, an embodiment of the present application provides a display device, which has the function of implementing the display method of the second aspect above. This function can be implemented by hardware or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions.

[0037] Sixth aspect, an embodiment of the present application provides a display device, including: a processor and a memory. Among them, the processor and the memory are interconnected by a line, and the processor calls the program code in the memory to execute the functions related to processing in any of the methods shown in the first aspect above. Optionally, the display device may be a chip.

[0038] Seventh aspect, an embodiment of the present application provides a display device, which may also be referred to as a digital processing chip or a chip. The chip includes a processing unit and a communication interface. The processing unit obtains program instructions through the communication interface, and the program instructions are executed by the processing unit. The processing unit is used to execute the functions related to processing in the second aspect or any optional implementation manner of the second aspect above.

[0039] Eighth aspect, an embodiment of the present application provides a computer-readable storage medium, including instructions, which when running on a computer, cause the computer to execute the methods in any optional implementation manner of the first aspect or the second aspect above.

[0040] Ninth aspect, an embodiment of the present application provides a computer program product containing instructions, which when running on a computer, cause the computer to execute the methods in any optional implementation manner of the first aspect or the second aspect above.

[0041] Tenth aspect, an embodiment of the present application provides a vehicle, which includes the device described in the fifth aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] Figure 1 It is a schematic diagram of the architecture of an interaction system provided by the present application;

[0043] Figure 2 It is a schematic diagram of the structure of a vehicle provided by the present application;

[0044] Figure 3 It is a schematic diagram of the structure of an electronic device provided by the present application;

[0045] Figure 4 It is a schematic diagram of the flow of a display method provided by the present application;

[0046] Figure 5 It is a schematic diagram of the flow of another display method provided by the present application;

[0047] Figure 6A GUI schematic diagram provided for this application;

[0048] Figure 7 Another GUI schematic diagram provided for this application;

[0049] Figure 8 Another GUI schematic diagram provided for this application;

[0050] Figure 9 Another GUI schematic diagram provided for this application;

[0051] Figure 10 Another GUI schematic diagram provided for this application;

[0052] Figure 11 Another GUI schematic diagram provided for this application;

[0053] Figure 12 Another GUI schematic diagram provided for this application;

[0054] Figure 13 Another GUI schematic diagram provided for this application;

[0055] Figure 14 Another GUI schematic diagram provided for this application;

[0056] Figure 15 Another GUI schematic diagram provided for this application;

[0057] Figure 16 Another GUI schematic diagram provided for this application;

[0058] Figure 17 Another GUI schematic diagram provided for this application;

[0059] Figure 18 Another GUI schematic diagram provided for this application;

[0060] Figure 19 Another GUI schematic diagram provided for this application;

[0061] Figure 20 Another GUI schematic diagram provided for this application;

[0062] Figure 21 Another GUI schematic diagram provided for this application;

[0063] Figure 22 Another GUI schematic diagram provided for this application;

[0064] Figure 23 Another GUI schematic diagram provided for this application;

[0065] Figure 24 Another GUI schematic diagram provided for this application;

[0066] Figure 25 Another GUI schematic diagram provided for this application;

[0067] Figure 26 Another GUI schematic diagram provided for this application;

[0068] Figure 27 Another GUI schematic diagram provided for this application;

[0069] Figure 28 Another GUI schematic diagram provided for this application;

[0070] Figure 29 Another GUI schematic diagram provided for this application;

[0071] Figure 30 Another GUI schematic diagram provided for this application;

[0072] Figure 31 Another GUI schematic diagram provided for this application;

[0073] Figure 32 Another GUI schematic diagram provided for this application;

[0074] Figure 33 Another GUI schematic diagram provided for this application;

[0075] Figure 34 Another GUI schematic diagram provided for this application;

[0076] Figure 35 Another GUI schematic diagram provided for this application;

[0077] Figure 36 Another GUI schematic diagram provided for this application;

[0078] Figure 37 Another GUI schematic diagram provided for this application;

[0079] Figure 38 Another GUI schematic diagram provided for this application;

[0080] Figure 39 Another GUI schematic diagram provided for this application;

[0081] Figure 40 Another GUI schematic diagram provided for this application;

[0082] Figure 41 Another GUI schematic diagram provided for this application;

[0083] Figure 42 Another GUI schematic diagram provided for this application;

[0084] Figure 43 Another GUI schematic diagram provided for this application;

[0085] Figure 44 Another GUI schematic diagram provided for this application;

[0086] Figure 45 Another GUI schematic diagram provided for this application;

[0087] Figure 46 Another GUI schematic diagram provided for this application;

[0088] Figure 47 Another GUI schematic diagram provided for this application;

[0089] Figure 48 Another GUI schematic diagram provided for this application;

[0090] Figure 49 Another GUI schematic diagram provided for this application;

[0091] Figure 50 Another GUI schematic diagram provided for this application;

[0092] Figure 51 Another GUI schematic diagram provided for this application;

[0093] Figure 52 Another GUI schematic diagram provided for this application;

[0094] Figure 53 A structural schematic diagram of a display device provided for this application. Detailed implementation manners

[0095] Next, the technical solutions in the embodiments of this application will be described with reference to the accompanying drawings in the embodiments of this application. Obviously, the described embodiments are only some of the embodiments of this application, rather than all the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments in this application without creative efforts shall fall within the protection scope of this application.

[0096] The method provided in this application can be applied to a variety of scenarios of autonomous driving or assisted driving, and can be used to provide function entrances such as automatic parking, roaming parking, car finding by person, person finding by car, or parking query in the visual interface of the user. Therefore, the user does not need to jump and switch among multiple terminals, saving the time and energy of finding, parking, and picking up the car for the user, greatly improving the smooth experience before and after using the car, and improving the user experience.

[0097] That is to say, the method provided by this application can be applied to the intelligent driving scenario of a vehicle, such as autonomous driving or assisted driving, etc. Assisted driving means assisting the user in driving the vehicle, and autonomous driving means using the vehicle to drive automatically.

[0098] Generally, autonomous driving can be divided into multiple levels. Under different autonomous driving levels (L0 - L5), based on the information obtained by artificial intelligence algorithms and multiple sensors, the advanced driving assistance system (ADAS) can achieve different functional levels. The above - mentioned autonomous driving levels (L0 - L5) are based on the grading standards of SAE (Society of Automotive Engineers). Among them, L0 is no automation; L1 is driving assistance; L2 is partial automation; L3 is conditional automation; L4 is highly automated; L5 is fully automated. L1 is a single - function - level automation. The driver cannot keep both hands and feet off the controls and still be responsible for driving safety, but some functions are automated, such as adaptive cruise control, emergency braking assistance, and lane keeping. L2 is partial automation. The driver can not operate the vehicle in some preset environments, that is, both hands and feet leave the controls, but still need to be responsible for driving safety and be ready to take over the vehicle driving right at any time in a short period. L3 is conditional automation. That is, on preset sections such as highways and urban roads with less traffic, the vehicle drives autonomously and bears the responsibility for driving safety. The driver does not have to monitor the road conditions, but still needs to take over the vehicle at certain times. L4 is highly automated. All driving operations are completed by the driverless system, and the driver does not necessarily need to respond to all system requests according to the system's request. L5 is fully automated. All driving operations are completed by the driverless system, and the driver takes over the vehicle when possible. For L1 to L3 levels, the tasks of monitoring road conditions and making responses are jointly completed by the driver and the system, and the driver needs to take over the dynamic driving tasks. L4 and L5 levels can completely transform the driver into the role of a passenger. Currently, the functions that ADAS can achieve mainly include but are not limited to: adaptive cruise control (ACC), automatic emergency braking (AEB), automatic parking (AP), blind spot monitoring (BSM), forward cross - traffic alert / braking (FCTA / B), rear cross - traffic alert / braking (RCTA / B), forward collision warning (FCW), lane departure warning (LDW), lane - keeping assist (LKA), rear collision warning (RCW), traffic sign recognition (TSR), traffic jam assistance (TJA), highway assistance (HWA), etc. It should be understood that: the above - mentioned various functions can have specific modes under different autonomous driving levels (L0 - L5). The higher the autonomous driving level, the more intelligent the corresponding mode is.For example, automatic parking can include APA (Auto Parking Assist), RPA (Remote Parking Assist), and AVP (Auto Valet Parking), etc. For APA, the driver does not need to operate the steering wheel, but still needs to control the accelerator and brake in the vehicle. For RPA, the driver can use an electronic device (such as a mobile phone) to remotely park the vehicle outside the vehicle. For AVP, the vehicle can complete parking without a driver. Of course, the vehicle can also include a driver or passengers. For example, AVP includes manned AVP (with people in the vehicle) and unmanned AVP (without people in the vehicle). Manned AVP can also be divided into L2-L3, and unmanned AVP can be divided into L4. The AVP mentioned in this application can include manned AVP or unmanned AVP. In terms of the corresponding autonomous driving levels, APA is approximately at the L1 level, RPA is approximately at the L2-L3 level, and AVP is approximately at the L4 level.

[0099] The method provided by this application is used to provide an integrated platform for functions such as automatic parking, roaming parking, vehicle finding by person, person finding vehicle, or parking query of a vehicle, so that users can implement the required functions in an electronic device or an in-vehicle electronic device, and it is applicable to the driving scenarios corresponding to the driving levels such as L0-L5. That is, the intelligent driving functions mentioned below in this application can include functions for implementing the aforementioned driving levels such as L0-L5. For example, the intelligent driving functions mentioned in this application can specifically include functions such as APA, AVP, ACC, RPA remote parking, RDA direct in and out, or AEB.

[0100] The system architecture, vehicle structure, and process provided by this application will be introduced below.

[0101] First, this application provides an interaction system, which can specifically include an electronic device and a vehicle. As Figure 1 shown, the electronic device and the vehicle can establish a connection, usually a wireless connection.

[0102] The electronic device can be used to provide a visual function platform that integrates functions such as summoning, parking, and vehicle finding for users. Through the connection established between the electronic device and the vehicle, it controls the vehicle to implement the functions required by users. For example, it can enable users to implement functions such as APA, AVP, RPA, summoning, or vehicle finding by person, and can also query the location of the vehicle, enabling users to find the required vehicle in a timely manner.

[0103] The vehicle can be used to implement functions such as APA, AVP, RPA, or vehicle finding by person under the instruction of the electronic device.

[0104] Therefore, in the interaction system provided by the present application, through the function platform set in the electronic device, which integrates functions such as vehicle summons, parking, and vehicle search, functions such as vehicle summons, parking, and vehicle search can be provided for users, enabling users to efficiently perform operations or searches on the vehicle, achieve one-key remote operation, and improve the user experience.

[0105] Next, the vehicle structure and the electronic device structure provided by the present application will be introduced separately.

[0106] Exemplarily, Figure 2 FIG. is a schematic structural diagram of a vehicle provided by an embodiment of the present application. Figure 2 FIG. is a functional block diagram of a vehicle 200 provided by an embodiment of the present application. The vehicle 100 can be configured in a fully or partially autonomous driving mode, such as specifically used to implement driving functions at the aforementioned autonomous driving levels L0-L5. For example: The vehicle 200 can obtain the surrounding environment information through the perception system 220, and obtain an autonomous driving strategy based on the analysis of the surrounding environment information to achieve fully autonomous driving, or present the analysis result to the user to achieve partially autonomous driving.

[0107] The vehicle 200 may include various subsystems, such as an infotainment system 210, a perception system 220, a decision control system 230, a drive system 240, and a computing platform 250. Optionally, the vehicle 200 may include more or fewer subsystems, and each subsystem may include multiple components. In addition, each subsystem and component of the vehicle 200 can be interconnected by wired or wireless means. The models that need to be verified mentioned below in the present application can include models for implementing various systems or subsystems in the vehicle.

[0108] In some embodiments, the infotainment system 210 may include a communication system 211, an entertainment system 212, and a navigation system 213.

[0109] The communication system 211 may include a wireless communication system 211, which can wirelessly communicate with one or more devices directly or via a communication network. For example, the wireless communication system 211 can use 3G cellular communication, such as CDMA, EVDO, GSM / GPRS, or 4G cellular communication, such as LTE, or 5G cellular communication. The wireless communication system 211 can communicate with a wireless local area network (WLAN) using WiFi. In some embodiments, the wireless communication system 246 can communicate directly with devices using an infrared link, Bluetooth, or ZigBee. The wireless communication system 211 can include one or more dedicated short range communications (DSRC) devices, which can include public and / or private data communication between vehicles and / or roadside stations.

[0110] The entertainment system 212 may include a center console screen, a microphone, and speakers. Users can listen to the radio and play music in the vehicle based on the entertainment system 212; or connect the mobile phone to the vehicle to achieve screen mirroring of the mobile phone on the center console screen. The center console screen can be touch-sensitive, and users can operate it by touching the screen. In some cases, the user's voice signal can be obtained through the microphone, and certain controls of the vehicle 200 can be achieved based on the analysis of the user's voice signal, such as adjusting the temperature inside the vehicle. In other cases, music can be played to the user through the speakers.

[0111] The navigation system 213 may include map services provided by a map provider to provide navigation for the driving route of the vehicle 200. The navigation system 213 can be used in conjunction with the vehicle's global positioning system 221 and inertial measurement unit 222. The map services provided by the map provider can be two-dimensional maps or high-precision maps.

[0112] In addition, in some driving scenarios, the environmental information or navigation information of the vehicle can also be displayed on the center console screen. The center console screen can be one of the display screens mentioned in the following embodiments of the present application.

[0113] The perception system 220 may include several types of sensors that sense information about the environment around the vehicle 200. For example, the perception system 220 may include a Global Positioning System 221 (the Global Positioning System may be a GPS system, a Beidou system, or other positioning systems), an Inertial Measurement Unit (IMU) 222, a Light Detection and Ranging (LiDAR) 223, a millimeter-wave radar 224, an ultrasonic radar 225, and a camera device 226. The perception system 220 may also include sensors that monitor the internal systems of the vehicle 200 (e.g., an in-vehicle air quality monitor, a fuel gauge, an engine oil temperature gauge, etc.). Sensor data from one or more of these sensors can be used to detect objects and their corresponding characteristics (position, shape, orientation, speed, etc.). Such detection and identification are key functions for the safe operation of the vehicle 200.

[0114] The Global Positioning System 221 can be used to determine the geographical location of the vehicle 200.

[0115] The Inertial Measurement Unit 222 is used to sense changes in the position and orientation of the vehicle 200 based on inertial acceleration. In some embodiments, the Inertial Measurement Unit 222 may be a combination of an accelerometer and a gyroscope.

[0116] The Light Detection and Ranging (LiDAR) 223 can use lasers to sense objects in the environment where the vehicle 200 is located. In some embodiments, the LiDAR 223 may include one or more laser sources, a laser scanner, and one or more detectors, as well as other system components.

[0117] The millimeter-wave radar 224 can use radio signals to sense objects within the surrounding environment of the vehicle 200. In some embodiments, in addition to sensing objects, the millimeter-wave radar 224 can also be used to sense the speed and / or forward direction of the objects.

[0118] The ultrasonic radar 225 can use ultrasonic signals to sense objects around the vehicle 200.

[0119] The camera device 226 can be used to capture image information of the surrounding environment of the vehicle 200. The camera device 226 may include a monocular camera, a binocular camera, a structured light camera, and a panoramic camera, etc. The image information obtained by the camera device 226 may include static image information or video stream information.

[0120] The decision-making and control system 230 includes a computing system 231 that analyzes and makes decisions based on the information obtained by the perception system 220. The decision-making and control system 230 also includes a vehicle controller 232 that controls the powertrain system of the vehicle 200, as well as components for controlling the steering system 233, the throttle 234, and the braking system 235 of the vehicle 200.

[0121] The computing system 231 can process and analyze various information acquired by the perception system 220 to identify targets, objects, and / or features in the surrounding environment of the vehicle 200. The targets may include pedestrians or animals, and the objects and / or features may include traffic signals, road boundaries, and obstacles. The computing system 231 can use techniques such as object recognition algorithms, Structure from Motion (SFM) algorithms, video tracking, etc. In some embodiments, the computing system 231 can be used to map the environment, track objects, estimate the speed of objects, and so on. The computing system 231 can analyze the various information acquired and derive a control strategy for the vehicle.

[0122] The vehicle controller 232 can be used to coordinately control the power battery and the engine 241 of the vehicle to improve the power performance of the vehicle 200.

[0123] The steering system 233 can be used to adjust the forward direction of the vehicle 200. For example, in one embodiment, it can be a steering wheel system.

[0124] The throttle 234 is used to control the operating speed of the engine 241 and thus control the speed of the vehicle 200.

[0125] The braking system 235 is used to control the deceleration of the vehicle 200. The braking system 235 can use friction to slow down the rotation speed of the wheels 244. In some embodiments, the braking system 235 can convert the kinetic energy of the wheels 244 into electric current. The braking system 235 can also take other forms to slow down the rotation speed of the wheels 244 and thus control the speed of the vehicle 200.

[0126] In addition, the decision control system 230 may further include an instrument panel ( Figure 2 not shown in the figure), which is usually set near the steering wheel of the vehicle or at a position in the vehicle convenient for the user to observe. The instrument panel can also be a type of display screen mentioned in this application.

[0127] In some possible scenarios, the data displayed on the central control screen and the instrument panel can be combined and displayed on one display screen, or in other words, the central control screen and the instrument panel can be the same display screen or areas divided in the same display screen.

[0128] The drive system 240 includes components that provide power motion for the vehicle 200. In one embodiment, the drive system 240 may include an engine 241, an energy source 242, a transmission system 243, and wheels 244. The engine 241 can be an internal combustion engine, an electric motor, an air compression engine, or other types of engine combinations, such as a hybrid engine composed of a gasoline engine and an electric motor, or a hybrid engine composed of an internal combustion engine and an air compression engine. The engine 241 converts the energy source 242 into mechanical energy.

[0129] Examples of the energy source 242 include gasoline, diesel, other petroleum-based fuels, propane, other compressed gas-based fuels, ethanol, solar panels, batteries, and other power sources. The energy source 242 can also supply energy to other systems of the vehicle 200.

[0130] The powertrain 243 can transmit mechanical power from the engine 241 to the wheels 244. The powertrain 243 can include a transmission, a differential, and drive shafts. In one embodiment, the powertrain 243 can also include other components, such as a clutch. The drive shafts can include one or more shafts that can be coupled to one or more wheels 244.

[0131] Some or all functions of the vehicle 200 are controlled by the computing platform 250. The computing platform 250 can include at least one processor 251 that can execute instructions 253 stored in a non-transitory computer-readable medium such as a memory 252. In some embodiments, the computing platform 250 can also be multiple computing devices that control individual components or subsystems of the vehicle 200 in a distributed manner.

[0132] The processor 251 can be any conventional processor, such as a commercially available CPU. Alternatively, the processor 251 can also include, for example, a graphics processing unit (GPU), a field programmable gate array (FPGA), a system on chip (SOC), a microcontroller unit (MCU), an application-specific integrated circuit (ASIC), or a combination thereof. The processor 251 can be located on a device remote from the vehicle and communicate wirelessly with the vehicle.

[0133] In some embodiments, the memory 252 can contain instructions 253 (e.g., program logic) that can be executed by the processor 251 to perform various functions of the vehicle 200. The memory 252 can also contain additional instructions, including instructions for sending data to, receiving data from, interacting with, and / or controlling one or more of the infotainment system 210, the perception system 220, the decision control system 230, and the drive system 240.

[0134] In addition to instruction 253, the memory 252 may also store data, such as road maps, route information, the position, direction, speed of the vehicle, and other similar vehicle data, as well as other information. Such information may be used by the vehicle 200 and the computing platform 250 during operation of the vehicle 200 in autonomous, semi-autonomous, and / or manual modes.

[0135] The computing platform 250 may control the functions of the vehicle 200 based on inputs received from various subsystems (e.g., the drive system 240, the sensing system 220, and the decision control system 230). For example, the computing platform 250 may utilize inputs from the decision control system 230 to control the steering system 233 to avoid obstacles detected by the sensing system 220. In some embodiments, the computing platform 250 may operate to provide control over many aspects of the vehicle 200 and its subsystems.

[0136] Optionally, one or more of the above components may be separately installed or associated with the vehicle 200. For example, the memory 252 may exist partially or completely separately from the vehicle 200. The above components may be communicatively coupled together in a wired and / or wireless manner.

[0137] Optionally, the above components are just an example. In actual applications, the components in each of the above modules may be added or deleted according to actual needs. Figure 2 It should not be construed as a limitation on the embodiments of the present application.

[0138] An autonomous vehicle traveling on a road, such as the vehicle 200 above, can identify objects within its surrounding environment to determine adjustments to its current speed. The objects may be other vehicles, traffic control devices, or other types of objects. In some examples, each identified object may be considered independently, and based on the respective characteristics of the object, such as its current speed, acceleration, distance from the vehicle, etc., may be used to determine the speed adjustment to be made by the autonomous vehicle.

[0139] Optionally, the vehicle 200 or the perception and computing devices associated with the vehicle 200 (e.g., the computing system 231, the computing platform 250) can predict the behavior of the identified object based on the characteristics of the identified object and the state of the surrounding environment (e.g., traffic, rain, ice on the road, etc.). Optionally, the behavior of each identified object depends on the behavior of the others, so all the identified objects can also be considered together to predict the behavior of a single identified object. The vehicle 200 can adjust its speed based on the predicted behavior of the identified object. In other words, the autonomous vehicle can determine what steady state the vehicle will need to adjust to (e.g., accelerate, decelerate, or stop) based on the predicted behavior of the object. In this process, other factors can also be considered to determine the speed of the vehicle 200, such as the lateral position of the vehicle 200 in the road being traveled, the curvature of the road, the proximity of static and dynamic objects, etc.

[0140] In addition to providing instructions to adjust the speed of the autonomous vehicle, the computing device can also provide instructions to modify the steering angle of the vehicle 200 so that the autonomous vehicle follows a given trajectory and / or maintains a safe lateral and longitudinal distance from the objects near the autonomous vehicle (e.g., a sedan in an adjacent lane on the road).

[0141] The above vehicle 200 can be a sedan, a truck, a motorcycle, a bus, a ship, an airplane, a helicopter, a recreational vehicle, a playground vehicle, construction equipment, a tram, a golf cart, a train, etc., and the embodiments of the present application do not make special limitations.

[0142] The electronic device provided in the present application, which can also be called a terminal, can include a processor and a display screen, etc. The processor can be used to execute the display method provided in the present application, and the display screen can display the data to be displayed under the trigger of the processor, providing a one-key operation interface for the vehicle for the user.

[0143] Specifically, the electronic device can include, but is not limited to: a smart mobile phone, a television, a tablet computer, a bracelet, a head-mounted display device (HMD), an augmented reality (AR) device, a mixed reality (MR) device, a cellular phone, a smart phone, a personal digital assistant (PDA), a tablet computer, an in-vehicle terminal, a laptop computer, a personal computer (PC), etc. Of course, in the following embodiments, no specific form of the electronic device is limited.

[0144] Exemplarily, referring to Figure 3 , taking a specific structure as an example below, the structure of the electronic device provided in the present application will be exemplarily described.

[0145] The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone interface 170D, a sensor module 180, a button 190, a motor 191, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, a motion sensor 180N, etc.

[0146] It can be understood that the structure schematically shown in the embodiments of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than those shown in the figure, or combine certain components, or split certain components, or have different component arrangements. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0147] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units may be independent devices or integrated in one or more processors.

[0148] The controller can generate operation control signals according to the instruction operation code and timing signals to complete the control of instruction fetching and execution.

[0149] A memory can also be set in the processor 110 to store instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can save the instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can directly call it from the said memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0150] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0151] The I2C interface is a two-way synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple groups of I2C buses. The processor 110 can be respectively coupled to the touch sensor 180K, the charger, the flash, the camera 193, etc. through different I2C bus interfaces. For example: the processor 110 can be coupled to the touch sensor 180K through the I2C interface, enabling the processor 110 to communicate with the touch sensor 180K through the I2C bus interface to implement the touch function of the electronic device 100.

[0152] The I2S interface can be used for audio communication. In some embodiments, the processor 110 may include multiple groups of I2S buses. The processor 110 can be coupled to the audio module 170 through the I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 through the I2S interface to implement the function of answering a call through a Bluetooth headset.

[0153] The PCM interface can also be used for audio communication to sample, quantize, and encode analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled through the PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 through the PCM interface to implement the function of answering a call through a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

[0154] The UART interface is a general-purpose serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is typically used to connect the processor 110 and the wireless communication module 160. For example: The processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to implement the Bluetooth function. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 through the UART interface to implement the function of playing music through a Bluetooth headset.

[0155] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), etc. In some embodiments, the processor 110 and the camera 193 communicate through the CSI interface to implement the shooting function of the electronic device 100. The processor 110 and the display screen 194 communicate through the DSI interface to implement the display function of the electronic device 100.

[0156] The GPIO interface can be configured through software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to the camera 193, the display screen 194, the wireless communication module 160, the audio module 170, the sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0157] The USB interface 130 is an interface that complies with the USB standard specification. Specifically, it can be a Mini USB interface, a Micro USB interface, a USB Type-C interface, etc. The USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transfer data between the electronic device 100 and peripheral devices. It can also be used to connect headphones to play audio through the headphones. This interface can also be used to connect other electronic devices, such as AR devices, etc. It should be understood that the USB interface 130 here can also be replaced by other interfaces, such as Type-c or Lighting, etc., which can achieve charging or data transfer. Here, only the USB interface 130 is taken as an example for illustrative purposes.

[0158] It can be understood that the interface connection relationship between the modules schematically shown in the embodiments of the present invention is only for illustrative purposes and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 can also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0159] The charging management module 140 is used to receive a charging input from a charger. Among them, the charger can be a wireless charger or a wired charger. In some embodiments of wired charging, the charging management module 140 can receive the charging input of the wired charger through the USB interface 130. In some embodiments of wireless charging, the charging management module 140 can receive the wireless charging input through the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also supply power to the electronic device through the power management module 141.

[0160] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives the input from the battery 142 and / or the charging management module 140 and supplies power to the processor 110, the internal memory 121, the display screen 194, the camera 193, the wireless communication module 160, etc. The power management module 141 can also be used to monitor parameters such as the battery capacity, the number of battery charge cycles, and the battery health status (leakage, impedance). In some other embodiments, the power management module 141 can also be disposed in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be disposed in the same device.

[0161] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modulation and demodulation processor, and the baseband processor, etc.

[0162] Antenna 1 and Antenna 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization rate of the antennas. For example, Antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0163] The mobile communication module 150 can provide solutions for wireless communications such as 2G / 3G / 4G / 5G applied to the electronic device 100. The mobile communication module 150 can include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves through Antenna 1, and perform processing such as filtering and amplifying on the received electromagnetic waves, and then transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves through Antenna 1 and radiate it out. In some embodiments, at least some functional modules of the mobile communication module 150 can be disposed in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 can be disposed in the same device.

[0164] The modulation and demodulation processor can include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. Subsequently, the demodulator transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, receiver 170B, etc.), or displays an image or video through the display screen 194. In some embodiments, the modulation and demodulation processor can be an independent device. In some other embodiments, the modulation and demodulation processor can be independent of the processor 110 and be disposed in the same device as the mobile communication module 150 or other functional modules.

[0165] The wireless communication module 160 may provide solutions for wireless communications applied to the electronic device 100, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite systems (GNSSs), frequency modulation (FM), near field communication (NFC), ultra wide band (UWB), infrared (IR), etc. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering processing on the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 may also receive the signals to be sent from the processor 110, perform frequency modulation and amplification on them, and convert them into electromagnetic waves through the antenna 2 for radiation.

[0166] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, such that electronic device 100 can communicate with a network and other devices through wireless communication technologies. The wireless communication technologies may include, but are not limited to: 5th-Generation (5G) systems, global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), Bluetooth, the global navigation satellite system (GNSS), wireless fidelity (WiFi), near field communication (NFC), FM (which may also be referred to as frequency modulation broadcasting), Zigbee, radio frequency identification (RFID), and / or infrared (IR) technology, etc. The GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), beidou navigation satellite system (BDS), quasi-zenith satellite system (QZSS), and / or satellite based augmentation systems (SBAS), etc.

[0167] In some embodiments, electronic device 100 may also include a wired communication module ( Figure 1 not shown herein), or, the mobile communication module 150 or the wireless communication module 160 here may be replaced by a wired communication module (Figure 1 (not shown in the figure), the wired communication module enables the electronic device to communicate with other devices through a wired network. The wired network may include, but is not limited to, one or more of the following: optical transport network (OTN), synchronous digital hierarchy (SDH), passive optical network (PON), Ethernet, or flexible Ethernet (FlexE), etc.

[0168] The electronic device 100 realizes the display function through the GPU, the display screen 194, and the application processor, etc. The GPU is a microprocessor for image processing, and is connected to the display screen 194 and the application processor. The GPU is used to execute mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or change display information.

[0169] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel may adopt a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

[0170] The electronic device 100 can realize the shooting function through the ISP, the camera 193, the video codec, the GPU, the display screen 194, and the application processor, etc.

[0171] The ISP is used to process the data fed back by the camera 193. For example, when taking a photo, the shutter is opened, and light passes through the lens and is transmitted to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye. The ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be disposed in the camera 193.

[0172] The camera 193 is used to capture static images or videos. An object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal and then transmits the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB camera, YUV, or other format. In some embodiments, the electronic device 100 may include one or N cameras 193, where N is a positive integer greater than 1.

[0173] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy, etc.

[0174] The video codec is used to compress or decompress digital videos. The electronic device 100 can support one or more video codecs. In this way, the electronic device 100 can play or record videos in multiple encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0175] The NPU is a neural-network (NN) computing processor. By learning from the structure of biological neural networks, such as the transmission pattern between human brain neurons, it can quickly process input information and can also continuously self-learn. Through the NPU, applications such as intelligent recognition of the electronic device 100 can be realized, such as image recognition, face recognition, voice recognition, text understanding, etc.

[0176] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to implement the storage capacity expansion of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement the data storage function. For example, files such as music and videos are saved in the external memory card.

[0177] The internal memory 121 can be used to store computer-executable program codes, and the executable program codes include instructions. The internal memory 121 can include a program storage area and a data storage area. Among them, the program storage area can store the operating system, application programs required for at least one function (such as the sound playback function, the image playback function, etc.). The data storage area can store the data created during the use of the electronic device 100 (such as audio data, phone book, etc.). In addition, the internal memory 121 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121, and / or the instructions stored in the memory provided in the processor.

[0178] The electronic device 100 can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone interface 170D, and the application processor, etc. For example, music playback, recording, etc.

[0179] The audio module 170 is used to convert digital audio information into an analog audio signal for output, and is also used to convert analog audio input into a digital audio signal. The audio module 170 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 170 can be disposed in the processor 110, or part of the functional modules of the audio module 170 can be disposed in the processor 110.

[0180] The speaker 170A, also called the "loudspeaker", is used to convert an audio electrical signal into a sound signal. The electronic device 100 can listen to music or hands-free calls through the speaker 170A.

[0181] The receiver 170B, also called the "earpiece", is used to convert an audio electrical signal into a sound signal. When the electronic device 100 answers a call or a voice message, the voice can be listened to by bringing the receiver 170B close to the human ear.

[0182] The microphone 170C, also known as a "microphone" or "transmitter", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak close to the microphone 170C with their mouth to input the sound signal into the microphone 170C. The electronic device 100 can be provided with at least one microphone 170C. In some other embodiments, the electronic device 100 can be provided with two microphones 170C, which can not only collect sound signals but also implement a noise reduction function. In some other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C, which can collect sound signals, reduce noise, identify the sound source, and implement functions such as directional recording.

[0183] The headphone jack 170D is used to connect a wired headphone. The headphone jack 170D can be a USB jack 130, or a 3.5mm open mobile terminal platform (OMTP) standard jack, or a cellular telecommunications industry association of the USA (CTIA) standard jack.

[0184] The keys 190 include a power-on key, volume keys, etc. The keys 190 can be mechanical keys or touch keys. The electronic device 100 can receive key inputs and generate key signal inputs related to the user settings and function controls of the electronic device 100.

[0185] The motor 191 can generate vibration prompts. The motor 191 can be used for incoming call vibration prompts or touch vibration feedback. For example, touch operations on different applications (such as taking pictures, playing audio, etc.) can correspond to different vibration feedback effects. Touch operations on different areas of the display screen 194 can also correspond to different vibration feedback effects by the motor 191. Different application scenarios (such as time reminders, receiving messages, alarms, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effects can also support customization.

[0186] The SIM card interface 195 is used to connect to a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to achieve contact with and separation from the electronic device 100. The electronic device 100 can support one or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. Multiple cards can be inserted into the same SIM card interface 195 simultaneously. The types of the multiple cards can be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to implement functions such as calls and data communication. In some embodiments, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

[0187] It should be noted that in some actual application scenarios, the electronic device may include more or fewer components than those described above, which can be specifically adjusted according to the actual application scenario, and the present application does not limit this. Figure 3

[0188] Next, the method flow provided by the present application will be introduced in combination with the structures of the vehicle and the electronic device described above.

[0189] For human-driven parking and human car-finding, there are existing in-parking-lot driving / walking car-finding applications and corresponding navigation. However, on the one hand, it strongly depends on third-party parking lot map information (usually scarce). At the same time, during the navigation process, due to inaccurate or delayed mobile phone positioning, the in-parking-lot driving or walking navigation is often inaccurate, and finally the wrong way is taken, resulting in poor practicability. For vehicle position recording, common map navigation applications provide a function to manually record the parking space number, but due to the deep hierarchy and complex operations, users often forget; some car owners support automatic memory and taking photos, but still cannot record the specific vehicle position in the basement. Photos in the basement are not easy to distinguish environmental information.

[0190] In addition, for the existing unmanned parking or summoning functions in the industry, some strongly require within the line-of-sight range, or rely on fixed parking spaces or summoning points and their corresponding routes set in advance on the vehicle side. The usage restrictions are high and inflexible, and it is basically limited to the home environment usage scenario; and it provides a start button and a driving status display, unable to present more vehicle driving statuses to users, resulting in users' distrust and reluctance to use.

[0191] ​For example, in some scenarios where people are looking for parking spaces or their cars, there is a complete map and rich location information, which can display real-time positioning and provide driving or walking navigation. However, the mobile phone positioning is inaccurate and has a delay, resulting in the vehicle / people taking the wrong route; manually recording the parking space number or taking pictures to remember the surrounding environment of the car through the mobile phone is cumbersome. The driving route does not support autonomous driving, and people cannot leave the car.

[0192] Also for example, in a car-finding scenario, the car's position can be recorded and pictures can be taken. Users can view the vehicle's positioning and SD map navigation is supported; some vehicles support recording environmental pictures of the parking space, and the car can be found through the environmental pictures. However, the positions within the parking lot cannot be recorded, and it is impossible to accurately obtain the parking space number information from the taken pictures, and the basement environment is similar, making it impossible to find the car.

[0193] Still for example, in a valet parking and summons solution, valet parking at fixed parking spaces and summons at fixed summons points are supported; the mobile phone only supports the external activation function, informing users of the normal and abnormal states of the current valet parking. However, it does not support changing parking spaces or summons points, there is no car-finding route when valet parking is not available, which limits the user's usage locations and scope and lacks flexibility. It is impossible to view the surrounding environment, and the vehicle's behavior cannot be known, which easily causes users to be nervous.

[0194] Obviously, for parking and vehicle usage scenarios, users still need to use multiple APPs across multiple terminals, which causes a relatively large usage burden on users and does not essentially solve the inconvenient usage experiences such as difficult and time-consuming car-finding.

[0195] Therefore, the present application provides a display method that can cover various parking and car-taking scenarios, can include summons, parking, and car-finding in one, enables the mobile terminal and the vehicle to communicate with each other, and users do not need to switch between multiple terminals, saving time and effort for users in car-finding, parking, and car-taking, greatly improving the smooth experience before and after vehicle usage, and being more worry-free and labor-saving for users. Moreover, it supports precise and intelligent recommendation of corresponding functions based on the user's travel scenarios and habits, enabling one-key activation of functions and improving the user experience.

[0196] Refer to Figure 4 , the flowchart of a display method provided by the present application.

[0197] 41. Trigger the display of the parking and car-finding interface.

[0198] Among them, the method provided by the present application can be deployed in an electronic device, and the parking and car-finding interface can be directly displayed on the main interface of the electronic device's display screen; it can also be deployed in the electronic device in the form of an APP, and the parking and car-finding interface is displayed on the electronic device's display screen after the user triggers and enables the APP.

[0199] For different deployment methods, the triggering operations for displaying the parking and car-finding interface may also be different.

[0200] For example, if the method provided in this application is directly deployed as a system application of an electronic device, such as the parking and car-finding interface can be directly displayed on the main interface of the electronic device, the triggering operation can specifically be turning on the power of the electronic device, or waking up the electronic device, etc.

[0201] Again, for example, if the method provided in this application is an APP deployed on an electronic device, the user can click or touch the entry icon displayed on the desktop to trigger the display of the parking and car-finding interface.

[0202] In addition, for different application scenarios, other triggering methods can also be set, such as triggering by voice or gesture, etc., and this application does not limit this.

[0203] 42. Display the parking and car-finding interface.

[0204] In response to the triggering operation for the parking and car-finding interface, the parking and car-finding interface can be displayed.

[0205] In this parking and car-finding interface, such as Figure 4 it may include, but is not limited to, one or more of the following function entries and corresponding icons: valet parking icon 411, roaming parking icon 412, summon icon 413, car-finding icon 414, or parking query icon 415.

[0206] Among them, the function corresponding to the valet parking icon is used to indicate the function of starting the vehicle to park in the parking space, the roaming parking icon is used to indicate the function of the vehicle searching for any empty parking space and parking in it, summon is used to indicate the function of the vehicle driving to a specified location, car-finding is used to indicate the function of obtaining the path to the vehicle, and parking query is used to indicate the function of querying the location of the vehicle.

[0207] In the implementation manner of this application, functions such as parking, summon, car-finding, or location query can be integrated into one display interface, that is, in one function combination. The user can select the functions to be enabled according to needs, can avoid switching back and forth between different functions to select the required functions, and can achieve one-key activation of functions such as parking, summon, car-finding, or location query for the vehicle, improving the user experience.

[0208] It should be noted that in the embodiments of this application, first, the method flow provided in this application is introduced. For the specific display interface of the electronic device, reference can be made to the relevant display interfaces in the following GUI part, which will not be elaborated here.

[0209] In a possible scenario, when the user selects one of the icons, the method provided by this application may further include: in response to an operation on the selected icon in the parking search interface, instructing the vehicle to implement the function corresponding to the selected icon. For example, a control instruction may be sent to the vehicle to enable the vehicle to implement the function corresponding to the selected icon; and display the path when the vehicle implements the function corresponding to the selected icon. Therefore, in the embodiments of this application, the user can select any icon to achieve one-key activation of the vehicle function, improving the user experience.

[0210] In a possible implementation manner, when the vehicle implements the function corresponding to the selected icon, such as valet parking, roaming parking, or summon, etc., during the process of performing the task, the vehicle can also collect the real-time environment information where the vehicle is located through the sensors set in the vehicle and transmit it to the electronic device. After receiving the real-time environment information, the electronic device can display the real-time environment information on the display interface, so that the user can observe the real-time environment where the vehicle is located through the display screen of the electronic device, timely learn the current state of the vehicle, and improve the user experience.

[0211] In a possible scenario, for functions such as valet parking, summon, vehicle search, or parking query, etc., it is usually necessary to determine the positions at both ends of the path. One end is the positioning position of the vehicle (which can be called the second position for easy distinction), and the other end can be the selected position or the positioning position of the electronic device, etc. (which can be called the first position for easy distinction). One or more paths between the first position and the second position can be generated and displayed on the display screen. Therefore, in the embodiments of this application, the path between the first position and the second position of the vehicle can be displayed on the display interface, enabling the user to intuitively know how to get from the first position to the second position or how to get from the second position to the first position, etc.

[0212] Optionally, in a parking scenario, information about one or more available parking spaces can also be obtained and the one or more available parking spaces can be displayed on a display interface. If the user needs to park the vehicle in one of the available parking spaces, the user can select the parking space on the display interface, and then, in response to an operation on any one of the at least one available parking space, the position of the selected available parking space can be obtained as the aforementioned first position. Subsequently, the path from the vehicle's positioning position to the available parking space can be obtained. Among them, the path can be generated by an electronic device and sent to the vehicle. For example, the electronic device can generate one or more paths. When there is only one path, it can be directly sent to the vehicle. When there are multiple paths, one of the paths can be sent to the vehicle, and specifically, the user can select the vehicle's driving path; it can also be to select one of the paths (which can be called the first path for easy distinction) according to a pre-set rule and send it to the vehicle, such as sending the shortest path, the path with the lowest congestion level, or the path with the highest safety level, etc., which can be determined according to the actual application scenario. In addition, after determining the position of the available parking space, the vehicle can also generate the path from the vehicle's positioning position to the available parking space.

[0213] After the vehicle determines the path to park in the available parking space, it can park in the available parking space based on this path. And during the parking process, real-time correction can be performed according to the data collected by its own sensors, so that the vehicle can successfully park in the parking space.

[0214] Generally, the vehicle can synchronize its real-time positioning to the electronic device, so the electronic device can display the position where the vehicle is located in real time on the display screen, so that the user can know the real-time state of the vehicle.

[0215] In addition, in a possible scenario, the vehicle can collect information about the surrounding environment, and the available parking space, that is, the aforementioned available parking space, can be determined by the vehicle or the electronic device according to the collected environmental information. Therefore, in the embodiments of the present application, the vehicle can implement map memory, so that the situation of the available parking space can be accurately simulated. And when searching for the vehicle's position, the accurate position of the vehicle and the information of the parking space can be determined based on the more accurate map information actually collected, thereby improving the accuracy of the vehicle's intelligent driving.

[0216] Of course, the environmental information of the vehicle can also be collected by other devices and sent to the vehicle or the electronic device. For example, a map can be received from the cloud, or the map of the parking lot and the occupancy status of the parking spaces can be obtained from the connected parking lot management device. The present application does not limit this.

[0217] In a possible scenario, if the location of the electronic device coincides with the location of the vehicle, or the vehicle reaches the location of the electronic device, the image displayed on the display screen of the electronic device can be sent to the vehicle for display in the vehicle. For example, in some scenarios, when the vehicle is valet parking, if the user gets in the car during the parking process, the image displayed on the user's electronic device can be transferred to the display screen of the vehicle for display, so that the user can continue to view the display interface of the electronic device after getting in the car, improving the user experience. Another example, in some scenarios, when the user summons the vehicle, the user can get in the car during the vehicle's driving. After the user gets in the car, the image displayed on the user's electronic device can be transferred to the display screen of the vehicle for display, so that the user can continue to view the display interface of the electronic device after getting in the car, improving the user experience.

[0218] In addition, for the roaming parking function, usually the parking position of the vehicle is to be determined, and specifically, the vehicle can search for available parking spaces by driving. That is, for the roaming parking scenario, after the user triggers the roaming parking function, the electronic device can send a roaming parking instruction to the vehicle to instruct the vehicle to search for available shared parking spaces and drive into the available parking spaces to complete parking. When the vehicle implements the roaming parking function, the vehicle can synchronously send the real-time location information of the vehicle to the electronic device, so the electronic device can synchronously display the real-time location information of the vehicle, enabling the user to know the location of the vehicle in real time. In addition, after the vehicle searches and finds an available parking space, the location information and parking status of the available parking space can also be synchronized to the electronic device side, and the user can view the ID and detailed location information of the parking space on the electronic device side, thus realizing a more transparent roaming parking.

[0219] In addition, in some possible implementation manners, recommendation information can also be obtained. The recommendation information can include information recommended for the vehicle. For example, the recommendation information can include functions recommended to be enabled for the vehicle. Subsequently, the recommendation information can be displayed on the display interface. Specifically, a recommendation card can be generated according to the recommendation information and displayed on the display interface. The recommendation card can include an entry button for the function recommended to be enabled for the vehicle. Therefore, the function recommended to be enabled can also be displayed on the display interface, enabling the user to more quickly obtain the entry of the required function, reducing the interaction steps of selecting functions and destinations, and improving the user experience.

[0220] Optionally, when obtaining the recommended information, the information of the vehicle in the historical period can be combined with the information of the vehicle in the current period to generate the recommended information. Among them, the historical period can include the period corresponding to the current period in the historical time cycle. For example, one day can be used as a cycle, and the period from 10 to 12 o'clock the previous day corresponds to the period from 10 to 12 o'clock on the current day. Therefore, the historical information generated by the user using the vehicle can be combined to infer the functions that the vehicle may currently need, so that the user can more quickly select the required functions and improve the user experience.

[0221] For example, if the current is the user's dining period, the navigation of nearby restaurants can be recommended to the user; if the current power of the vehicle is too low, the location distribution of nearby charging piles can be recommended for the vehicle, and the user can select the charging pile and generate the navigation; if the current user is in the parking lot of the frequently visited area, the commonly used parking spaces or convenient parking spaces can be recommended for the user. Therefore, recommendations can be made for the possible needs of the user, which can improve the user experience.

[0222] For example, when the user selects a certain function in the recommended information, the function can be enabled for the user, so that the user can more quickly select the required function and improve the user experience.

[0223] Specifically, the foregoing recommended content may specifically include, but is not limited to, one or more of the following: exclusive parking space recommendation, charging parking space recommendation, roaming car finding function recommendation, summoned vehicle location recommendation, car finding function recommendation, or charging pile recommendation, etc. The exclusive parking space recommendation is to recommend the dedicated parking space for the vehicle; the charging parking space recommendation is to recommend the parking space available for charging to the user, such as the parking space equipped with a charging pile; the roaming car finding function recommendation is to recommend the user to enable the roaming car finding function; the summoned vehicle location recommendation is to recommend the user to summon the vehicle to this location; the car finding function recommendation is to recommend the user to enable the car finding function; the charging pile recommendation is to recommend the location of the nearby charging pile to the user.

[0224] For example, for the valet parking scenario, specifically, the following can be recommended:

[0225] Exclusive parking space recommendation: When there are fixed parking spaces / exclusive parking spaces in frequently visited areas such as home / company, recommend the user to park in the exclusive parking space.

[0226] Automatic parking space finding: For locations that are infrequently visited, when the user drives into the park / garage and gets off at any position, recommend the roaming automatic parking space finding function. Without setting the destination, click to automatically search for parking spaces in the nearby area.

[0227] Charging parking space recommendation: When the battery level of the vehicle is lower than the set value (such as the remaining range is less than 10%), automatically recommend going to the charging area or charging parking space in the parking lot.

[0228] Quick car pick-up recommendation: In the same park area, if the user has used the summon function or the memory summon point last time, it is recommended to park in the area near the summon point for quick pick-up next time.

[0229] For another example, for the car pick-up or use scenario, specifically, it can recommend:

[0230] When the vehicle is in a non-powered-on state and it is within the user's commuting time period, the user is automatically recommended the car search summon function.

[0231] Drop-off point recommendation: Further, if the user used the valet parking function to park in the parking space last time, the last drop-off point is remembered and default recommended as the summon point for this time.

[0232] Recommend nearby pedestrian entrances and exits based on the location of the electronic device: Further, according to the user's current location, it can automatically adsorb and recommend positions such as the nearest elevator entrance as the summon for this time.

[0233] Common summon point recommendation: In the same park, remember the summon point used by the user last time and actively recommend it in combination with the location information.

[0234] Therefore, in the embodiments of the present application, recommendations can be made for various scenarios of the user, enabling the user to efficiently and conveniently enable the required functions or query the required information, thereby improving the user experience.

[0235] In addition, during valet parking, roaming parking or summoning, when the vehicle is driving along the planned path, there may be abnormal situations such as obstacles in the road, blind spots in the field of vision or complex road conditions. In this case, the vehicle can slow down or stop to avoid according to the actual scenario. At the same time, the vehicle can also send the current state and the captured images to the electronic device, so that the electronic device can synchronously display the driving state of the vehicle, enabling the user to know whether there are obstacles, blind spots or complex road conditions in the vehicle driving path, realizing the transparency of the vehicle when executing functions and improving the user experience.

[0236] In addition, in some scenarios, there may also be abnormal network connection situations such as poor signal or disconnection between the electronic device and the vehicle. In this case, if the vehicle is in a driving state, it can control the vehicle to slow down or stop at this time and synchronously display the abnormal network connection situation on the display screen of the electronic device, so that the user can control the vehicle as soon as possible and improve the driving safety of the vehicle.

[0237] In addition, for the interaction process between the electronic device and the vehicle, such as enabling the valet parking function, summon function, roaming parking function, etc., instructions need to be sent to the vehicle to enable the vehicle to achieve the required functions.

[0238] Refer to Figure 5, A schematic flowchart of another display method provided by this application is described as follows.

[0239] 501. The electronic device responds to an operation on the parking search interface and sends control data to the vehicle.

[0240] Among them, the parking search interface can specifically refer to the relevant description in the foregoing step 401, which will not be elaborated here.

[0241] When the user enables one of the functions that need to interact with the vehicle through the parking search interface, corresponding control data can be generated and sent to the vehicle.

[0242] For example, the user can select the valet parking icon to enable the valet parking function of the vehicle. The electronic device can respond to the trigger operation on the valet parking icon, generate a control instruction for controlling the vehicle to perform valet parking, and carry it in the control data and send it to the vehicle. Among them, after the user selects the valet parking icon, the parking space can be further selected. Therefore, the position information of the parking space can also be carried in the control data. In addition, if the parking path of the vehicle is determined by the electronic device, the parking path of the vehicle can also be carried in the control data.

[0243] Another example is that the user can select the roaming parking icon to enable the roaming parking function. After the electronic device detects the trigger operation for the roaming parking function, it can generate a control instruction for controlling the vehicle to perform roaming parking, and carry it in the control data and send it to the vehicle. In the roaming parking scenario, usually the user does not need to specify a parking space, and the vehicle automatically searches for an available parking space and parks in the available parking space.

[0244] Another example is that the user can select the summon icon to enable the summon function of the vehicle. After the electronic device detects the trigger operation for the summon function, it can generate a control instruction for controlling the vehicle to perform roaming parking, carry it in the control data and send it to the vehicle. In the summon scenario of the vehicle, the specified summon location can also be carried in the control data, so as to summon the vehicle to the summon location.

[0245] Therefore, through the interaction system between the electronic device and the vehicle in this application, the user can enable functions with one key on the electronic device side, improving the user experience.

[0246] 502. The vehicle implements the corresponding function based on the control data and synchronously sends real-time status information to the electronic device.

[0247] After the vehicle receives the control data sent by the electronic device, it can implement the corresponding function and synchronously send real-time status information to the electronic device. The real-time status information can specifically include information generated inside the vehicle during driving or information of the collected environment.

[0248] For example, during vehicle driving, the vehicle can send map information, vehicle position, navigation path, surrounding environment, or driving intention to the electronic device in real time. This enables users to feel more at ease, have full control of the entire process, and perform one-key remote operations.

[0249] For example, in the valet parking scenario, the vehicle can send information such as the vehicle's real-time location, environmental images collected during driving, and parking path to the electronic device. It can also include information such as the vehicle's battery level or speed.

[0250] For another example, in the roaming parking scenario, the vehicle can send information such as the vehicle's real-time location, environmental images collected during driving, and available parking spaces found. When the vehicle finds an available parking space, it can directly park in that available space or send an inquiry message to the electronic device to request instructions on whether to park in that available space. After the user determines that it is okay to park in that available space, the vehicle can then park in that space.

[0251] For yet another example, in the vehicle summon scenario, the vehicle can send information such as the vehicle's real-time location, environmental images collected during driving, and the path to the summon location to the electronic device.

[0252] 503. The electronic device displays the vehicle's driving path and real-time status information.

[0253] During the process of the vehicle executing a function, it can synchronously send real-time status information to the electronic device, and the electronic device can display this real-time status information on the display screen.

[0254] Therefore, in the embodiments of the present application, when the vehicle realizes functions such as valet parking, roaming parking, or summoning, it can send real-time status information to the electronic device, thereby making the process of the vehicle realizing the function fully transparent, achieving one-key startup and remote operation of the vehicle function, and improving the user experience.

[0255] The foregoing introduced the method flow provided by the present application. Next, it will be jointly introduced in combination with the method, electronic device, and GUI provided by the present application.

[0256] It should be noted that for the display interface mentioned in the foregoing method flow, reference can be made to the corresponding display interface in the following GUI. For ease of understanding, the display interface for display on the electronic device will be introduced in more detail below in combination with the GUI.

[0257] First, the electronic device provided in this application may specifically include a mobile terminal, may also include a vehicle-mounted terminal, and may further include a vehicle, etc. Specifically, the electronic device may include one or more display screens, a memory, one or more processors. The one or more processors are used to execute one or more computer programs stored in the memory, that is, the memory stores the code of the graphical user interface of the application program. The one or more processors are used to execute the code of the GUI stored in the memory, and the display screen is used to display the GUI stored in the memory.

[0258] The following introduces the GUI mentioned in this application. The graphical user interface includes:

[0259] Display a parking search interface. The parking search interface includes various icons. The parking search interface includes various icons, and the various icons include at least one of a valet parking icon, a roaming parking icon, a summon icon, a car search icon, or a parking query icon. The function corresponding to the valet parking icon is used to indicate the function of starting the vehicle to park in a parking space. The roaming parking icon is used to indicate the function of the vehicle searching for a parking space. Summon is used to indicate the function of the vehicle driving to a specified location. Car search is used to indicate the function of obtaining the path to the vehicle. Parking query is used to indicate the function of querying the location of the vehicle.

[0260] In the embodiment of this application, at least one of a valet parking icon, a roaming parking icon, a summon icon, a car search icon, or a parking query icon can be displayed in the GUI, so that a platform integrating functions such as valet parking, roaming parking, vehicle summon, car search, or parking query can be realized, enabling users to select the required functions in the same display interface, and realizing the one-key start of each function without switching pages, thereby improving the user experience.

[0261] Exemplarily, the parking search interface can be as Figure 6 shown. In the same display interface, key functions such as valet parking, roaming parking, summon, car search navigation, and parking information viewing are integrated. Among them, as Figure 6 shown, "recommended parking space" or "self-selected parking space" is shown. Selecting it can realize valet parking. Among them, "recommended parking space" means parking the vehicle in the recommended parking space, and "self-selected parking space" means parking the vehicle in the parking space selected by the user; the summon and car search functions can be integrated into the same entrance, such as Figure 6 shown in the "Vehicle Summon - Walk to Search for Car" icon. Selecting this icon can further display the specific selection of vehicle summon or car search navigation.

[0262] For another example, the parking search interface can also be as Figure 7As shown, when the vehicle is parked in a parking space, the icons can be divided into: pick-up, parking, charging, etc., and other icons, such as the locations favorited by the user. When the user selects the pick-up icon, the summon or parking positioning function can be enabled. When the user selects the parking icon, the parking function can be enabled.

[0263] In addition, the current position of the vehicle, as well as information about the vehicle's environment or internal information, such as the parking spaces near the vehicle, the remaining battery power of the vehicle, etc., can also be displayed on the display interface.

[0264] That is to say, in the GUI provided by the present application, entry points for enabling multiple functions are provided on the same display interface. The user can select the required functions on the same interface, that is, through the same platform, functions such as parking map visualization, walking to find the vehicle (across multiple floors on the ground and in the basement), intelligent summon of the vehicle to find the person, one-key valet parking for personal exclusive parking spaces / optional parking spaces in the map, and automatically finding empty parking spaces for parking can be supported simultaneously. The user does not need to switch applications to find the required functions, saving the user time and effort in finding the vehicle, parking, and picking up the vehicle, and greatly improving the experience before and after using the vehicle and the vehicle use efficiency.

[0265] Optionally, the graphical user interface may further include: in response to an operation on the selected icon in the parking search interface, displaying the path when implementing the function corresponding to the selected icon. In the implementation manner of the present application, the user can select any icon displayed on the display interface to trigger the implementation of the required function. When implementing the required function, information generated when implementing the function, such as the path or the vehicle status, can be displayed. Therefore, when implementing the required function for the user, such as parking or summoning, etc., information generated when implementing this function, such as the vehicle driving path, navigation path, or vehicle status, can be displayed in real time, thereby realizing the transparency of the function and improving the user experience.

[0266] For example, taking one scenario as an example, when the vehicle is parking, the data during the parking process can be transmitted to the electronic device, and the electronic device can display this data on the display interface. As Figure 8 shown, the GUI may specifically include the front view image of the vehicle, the distance to the destination, warning prompt information (such as "Please always pay attention to observing the surrounding environment of the vehicle"), vehicle speed, parking path, etc. Thereby making the parking process of the vehicle transparent.

[0267] In addition, in some scenarios, a recommended card can also be displayed. The recommended card may include recommended information obtained based on the information currently generated by the vehicle, and the recommended information includes the functions of the vehicle recommended to be activated. Different recommended cards can be displayed in different regions, time periods, or scenarios, etc.

[0268] Among them, the recommended functions or information may specifically include, but are not limited to: exclusive parking space recommendation, charging parking space recommendation, roaming car finding function recommendation, location recommendation for summoning the vehicle, car finding function recommendation, charging pile recommendation, etc.

[0269] For example, as Figure 9 shown, in (a), when the vehicle is in the parking lot, the recommended card can be a recommendation for the roaming car finding function, and the user can enable the roaming car finding function based on the selection operation of the recommended card; in (b), when the vehicle is near the exclusive parking space, the one-touch parking function for parking the vehicle in the exclusive parking space can be recommended to the user, and the user can enable the function of one-touch parking in the exclusive parking space based on the selection operation of the recommended card; in (c), when the vehicle is parked in the parking space, the current parking information of the vehicle can be displayed in the recommended card, and the user can enable the car finding function by selecting the recommended card, so as to realize one-touch car finding.

[0270] Next, the changes in the GUI when implementing different functions will be introduced respectively.

[0271] 1. Valet parking

[0272] In a possible implementation manner, in response to a trigger operation on the valet parking icon, the information generated when the vehicle performs valet parking can be displayed, such as the parking path of the vehicle driving to the specified position (or called the first position), vehicle status and other information.

[0273] Among them, the entrance of valet parking can be the entrance of the main interface, or the entrance in the recommended card of other pages, etc. The position of the valet parking icon may be different in different scenarios.

[0274] For example, as Figure 10 shown, the user can select the "Self-selected Parking Space" icon, and then the display interface can jump to Figure 11 or Figure 12 the parking space selection interface shown. Among them, the recommended parking spaces can be displayed under the parking space search bar. The specific recommendation rules can include the last parked parking space, the frequently parked parking space, the parking spaces collected by the user, the tagged parking spaces; if there is no personal marked parking space, then the parking spaces near the elevator / staircase are recommended, and finally the charging parking spaces. For example Figure 11 or Figure 12 the "My Charging Space", "Elevator Space No. 1", "Elevator Space", "Space No. 5" or "Space No. 6" shown in etc. Figure 11 And Figure 12 The difference between the parking space display interfaces of Figure 11Among the recommended parking spaces shown, the numbers of the recommended parking spaces can also be carried, for example, the parking space number corresponding to "My Charging Space" is B1-F4-166, the number corresponding to "Elevator No. 1 Parking Space" is B1-F4-408, and so on.

[0275] In addition, for the display of recommended parking spaces, a parking space map with a more suitable scale can be displayed on the display interface. For example, as Figure 13 shown, the full-view maps for all parking spaces, 2m (the length in the actual scenario corresponding to the unit length), 5m, 1m, 20m, and 10m, etc. are respectively shown. Obviously, the larger the length in the actual scenario corresponding to the unit length, the more parking spaces are shown, and the fewer the details of the displayed map. And the smaller the length in the actual scenario corresponding to the unit length, the fewer parking spaces are shown, and the richer the details of the displayed map. Figure 14

[0276] In addition, as Figure 15 shown, the user can also enter a specified parking space in the search box. And on the search interface, recommended parking spaces can also be displayed. For example, the last parked-in parking space, frequently parked-in parking spaces, parking spaces collected by the user, tagged parking spaces can be recommended; if there are no personally marked parking spaces, parking spaces near the elevator / stairs are recommended, and finally charging parking spaces. For example, one can choose to search for "staircase" (i.e., parking spaces near the staircase), "charging pile" (i.e., parking spaces with charging piles installed), "power supply" (i.e., parking spaces with power supplies installed), or "entrance / exit" (i.e., parking spaces near the parking lot entrance / exit), etc., enabling the user to quickly search for parking spaces that meet the requirements.

[0277] After selecting the specified parking space, the path for the vehicle to drive to the specified parking space can be planned. For example, as Figure 16 shown, after determining the specified parking space, the path from the current position of the vehicle to the specified parking space is planned. Optionally, the available status of the intelligent driving function can also be prompted, such as "Valet parking function is ready, please click to start". After the user selects the "Start Parking" button, valet parking can be performed.

[0278] The display interface during the valet parking process can be as Figure 17 shown. The driving path of the vehicle and the real-time environmental images collected can be displayed on the display interface, and the current positioning of the vehicle can be displayed in real time. In addition, the specified parking space can be highlighted. For example, in Figure 15 "Target Parking Space B1-F4-166" can be highlighted.

[0279] In addition, during the execution of valet parking, it can be paused or exited at any time. For example, as Figure 15 shown, a pause button can be set at the bottom of the interface shown. When the user selects the pause button, as Figure 18 ​As shown, it can indicate that the vehicle pauses the valet parking execution, and can display a continue button and an exit button on the display interface. If the user selects the exit button, the valet parking function can be exited and the main interface can be returned. If the user selects the continue button, the valet parking can continue, as Figure 19 shown.

[0280] Optionally, when the vehicle is about to enter the parking space, as Figure 20 shown, at this time, the process of the vehicle parking in the parking space can be highlighted.

[0281] After the vehicle finishes parking, a parking completion prompt can be given on the display interface. As Figure 21 shown, at this time, the information generated during the parking process is also synchronously displayed. For example, the data during the parking process can include: the current gear, the driving speed, the remaining distance; the remaining full-view path, the traveled path; the summary data of the parking completion: the driving distance, the total time, the parking time, the path full-view, the target parking space, the in-vehicle ID, the images (front view, rear view, top view). For example, the driving distance is 400 meters, the total time is 5 minutes and 40 seconds, the parking time in the parking space is 58 seconds, the parking path, the position where the vehicle parks in the parking space, and the front view of the vehicle, etc.

[0282] In addition, in order to increase the user's observable range, the user can also display the electronic device in landscape mode. For example, as Figure 22 shown, when it is detected that the electronic device is in landscape mode, the front view of the vehicle can be enlarged, that is, the image collected by the image sensor set on the vehicle head. Of course, it can also be replaced with the images collected by other sensors of the vehicle.

[0283] In addition, if the parking in the parking space fails, as Figure 23 shown, then available parking spaces can be searched again. For example, the vehicle status can be replaced with "Unable to park in the target parking space, about to search for nearby parking spaces", and a prompt "Will automatically switch to the roaming parking space search mode" can be given. In addition, during the aforementioned valet parking process, if a parking failure occurs, it can also directly switch to the roaming parking space search, or the user can re-specify the parking space, etc.

[0284] Therefore, in the embodiments of the present application, the user can start the valet parking with one key without switching application programs, improving the user experience. And during the vehicle's valet parking execution, the whole process can be made transparent on the display screen of the electronic device, enabling the user to know the vehicle situation in real time, keeping the vehicle under the user's control, and improving the vehicle safety.

[0285] 2. Roaming Parking

[0286] In a possible implementation, when the user selects the roaming parking icon, the vehicle can be controlled to perform roaming parking in response to the trigger operation on the roaming parking icon, and the information during the vehicle's roaming parking is displayed, such as the vehicle's driving path, the images captured by the vehicle in real time, the vehicle speed, the nearby parking spaces, etc.

[0287] For example, as Figure 24 shown, the user can select "Roaming Parking Space" on the main interface to activate the vehicle's roaming parking function.

[0288] Subsequently, in response to the user's trigger operation on roaming parking, the nearby vehicle search mode can be enabled. As Figure 25 shown, it can be displayed on the display interface that the current state of the vehicle is "Searching for nearby parking spaces", and it is prompted that "The roaming parking space search mode has been enabled", and the real-time images captured by the vehicle, the distance of the vehicle's roaming to find a parking space, the vehicle speed, the vehicle's driving path, etc. are synchronously displayed.

[0289] As Figure 26 shown, when the vehicle searches for an available parking space, the state of the vehicle can be replaced with "Parking space found, about to park in the parking space", and it is synchronously prompted that "Please always pay attention to observing the surrounding environment of the vehicle". Subsequently, as Figure 27 shown, the vehicle can park in the parking space, and the state of the vehicle is synchronously displayed as "Parking in the parking space". After the vehicle parks in the parking space, it can be prompted that the parking is completed, as Figure 28 shown.

[0290] In addition, if the parking in the parking space fails, as shown in the foregoing Figure 23 shown, then an available parking space can be searched again. For example, the vehicle state can be replaced with "Unable to park in the target parking space, about to search for nearby parking spaces", and it is prompted that "It will automatically switch to the roaming parking space search mode". In addition, during the foregoing valet parking process, if a parking failure occurs, it can also directly switch to the roaming parking space search, or the user can re-specify the parking space, etc.

[0291] Therefore, in the embodiments of the present application, the user can achieve one-key roaming parking, improving the user experience. And during the vehicle's roaming parking process, the whole process can be made transparent on the electronic device, enabling the user to know the vehicle dynamics in real time.

[0292] 3. Summoning and Vehicle Search

[0293] Among them, summoning means summoning the vehicle to drive to the summoning point, and vehicle search means querying the position of the vehicle and generating a walking path to the vehicle.

[0294] For the convenience of operation, in the embodiments of the present application, the entrances of the summoning function and the vehicle search function can be set on the same interface. Of course, they can also be separately set as different function entrances. For example, exemplarily, as Figure 29As shown, "Vehicle Summon - Walk to Find Vehicle" can be displayed on the main interface to activate the summon and vehicle finding functions.

[0295] When the user selects the summon icon, in response to the user's trigger operation for the summon function, the vehicle can be instructed to drive to the summon location.

[0296] For example, as Figure 30 shown, when the vehicle is parked in a parking space, the location information of the vehicle can be displayed at this time (correspondingly, the display interface of the parking query function can also refer to Figure 27 shown). On the vehicle location display interface, a summon icon can be displayed to activate the summon function.

[0297] After the user selects the summon icon to activate the summon function, in response to the user's trigger operation, a summon point selection interface can be displayed, and this interface can be as Figure 31 shown. The user can select the recommended summon point or enter a summon point.

[0298] After determining the summon point, a path for the vehicle to drive from its positioning location to the summon point can be generated. As Figure 32 shown, after generating the path, the status of the current vehicle can be displayed as "Intelligent Summon Function Ready, Please Click to Start". If the user selects the start summon button, the summon function of the vehicle can be activated.

[0299] Subsequently, the vehicle can drive to the summon point. As Figure 33 、 Figure 34 and Figure 35 shown, the vehicle can synchronize real-time information to the electronic device. For example, when the status is "Parking in the parking space", the real-time position of the vehicle can be synchronously magnified and displayed. When the vehicle status is "On the way to the summon point" or "Arriving at the summon point in 1 minute", the real-time images collected by the vehicle sensors can be displayed.

[0300] After the vehicle successfully drives to the summon point, as Figure 36 shown, the summon completion interface can be displayed.

[0301] In addition, when starting to find the vehicle, a path from the current position of the electronic device to the vehicle position can be planned. For example, the vehicle finding function can be like the vehicle finding entrance shown in the foregoing Figure 32 . After starting to find the vehicle, as Figure 37 shown, a path from the current position to the vehicle location can be displayed, and it can also synchronously prompt "200m away from the vehicle, estimated walking time 5 minutes".

[0302] Therefore, in the embodiments of the present application, the vehicle summoning or vehicle finding function can be implemented in a platform integrating multiple functions, so that the summoning and vehicle finding functions can be provided to users more conveniently. And during the summoning process, the real-time status changes of the vehicle can be displayed to make the vehicle summoning process transparent.

[0303] In addition, when the vehicle realizes functions such as valet parking, roaming parking or summoning, some abnormal situations may occur. For example, low communication signal quality, failed path planning, complex road conditions or the presence of obstacles, etc., may cause the functions implemented by the vehicle to be interrupted or terminated. The display interfaces for some possible abnormal situations will be introduced below.

[0304] 1. Poor signal

[0305] For example, when selecting a valet parking space, as Figure 38 shown, if the network signal of the selected parking space is poor, the poor network signal of this parking space can be marked in the display interface for this parking space.

[0306] For another example, when planning a parking path, if the parking path planning fails, as Figure 39 shown, then "Parking route calculation failed" and "Network exception" etc. can be prompted. Subsequently, recalculation can be performed when the network quality is better or other functions can be selected by the user.

[0307] For still another example, in the valet parking space selection interface, if the position signal of the vehicle is poor, as Figure 40 shown, then "Poor signal at the vehicle's location" can be prominently prompted in the display interface for the vehicle's location. At this time, the user can change the vehicle's positioning method or drive the vehicle to a location with better signal, etc.

[0308] For still another example, as Figure 41 shown, after planning a valet parking path for the vehicle, if the network signal of a certain section is poor, then "Poor network signal in this section" can be prompted in the part of the section with poor network signal in the display interface, and "Poor network signal in the section, please pay attention to observing the vehicle status" can be prompted in the function status prompt bar. After the valet parking starts and when driving to this section, as Figure 42 shown, the vehicle speed can be reduced, for example, reduced to 5 km / h, and the current status of the vehicle is displayed as "Weak current network connection, waking up", and at the same time, "Video has a delay, please pay attention to observing the vehicle status" etc. can also be prompted. In addition, if the vehicle stops driving due to poor network signal, the valet parking function can be exited, as Figure 43 shown, and an alarm for the current status can be given, such as alarming "Temporary parking timeout, valet parking has been exited", and at the same time, "Please go to the location of your vehicle immediately and take over" can also be prompted.

[0309] Therefore, in the embodiments of the present application, for scenarios with poor network signal quality, the state of the vehicle's execution function can be adaptively adjusted or the function can be aborted, thereby improving the driving safety of the vehicle.

[0310] 2. Obstacles

[0311] During the driving process of valet parking, roving parking or summoning of the vehicle, obstacles may appear on the road, affecting the driving of the vehicle. In this case, the images or videos collected by the vehicle can be played in real time on the display interface, thereby realizing the transparency of the vehicle driving.

[0312] For example, as Figure 44 shown, when a pedestrian appears in the driving route of the vehicle, it can slow down to avoid the pedestrian. At this time, the state of the execution function, "Avoiding pedestrians, slow down and pass", can be displayed in real time on the display interface of the electronic device. In addition, when encountering other obstacles, such as vehicles or unknown obstacles, as Figure 45 and Figure 46 shown, the states of the execution function, "Avoiding vehicles, slow down and pass" and "Avoiding obstacles, slow down and pass", etc., can be displayed in real time on the display interface of the electronic device.

[0313] Therefore, in the embodiments of the present application, during the driving process of the vehicle, when there are obstacles in the path, the picture can also be synchronized to the electronic device in real time, enabling the user to know the state of the vehicle in real time and realizing the transparency of the vehicle function.

[0314] 3. Complex road conditions

[0315] For the complex road conditions in the driving path of the vehicle, such as sharp turns, blind spot intersections or complex intersections, etc., the picture can also be synchronized to the electronic device. For example, as Figure 47 , Figure 48 and Figure 49 shown, the states during the execution of the function can be set to "Passing a sharp turn, slow down and pass", "Blind spot intersection, slow down and pass" or "Complex intersection, slow down and pass", etc.

[0316] Therefore, in the embodiments of the present application, for complex road conditions, the road condition picture can also be synchronized to the electronic device, realizing function transparency and improving the user experience.

[0317] In addition, for scenarios such as valet parking, roving parking or summoning of the vehicle, when the vehicle realizes functions such as valet parking, roving parking or summoning, the driving path of the vehicle can also be synchronously displayed on the vehicle's display screen.

[0318] For example, taking the valet parking scenario as an example, the initial display interface of the vehicle's display screen can be as Figure 50As shown, a prompt such as "Please keep a distance from the vehicle" can be given on the display interface. Before parking and driving, as Figure 51 shown, the parking path can be displayed on the vehicle's display screen. During parking and driving, as Figure 52 shown, the navigation path of the vehicle and the current vehicle position can be enlarged and displayed.

[0319] Therefore, in the embodiments of the present application, the navigation path of the vehicle can also be synchronously displayed on the vehicle's display screen. When there are passengers in the vehicle, the experience of the passengers can be improved.

[0320] It should be noted that the prompt information or status information displayed in the foregoing GUI or display interface can also be replaced with text of prompt information or status information with a similar meaning. Only exemplary introductions are given in the drawings of the present application and are not used as limitations.

[0321] The foregoing method flow, electronic device, and GUI provided by the present application have been introduced. Next, further, the device structure provided by the present application will be introduced.

[0322] Referring to Figure 53 , it is a schematic hardware structure diagram of a display device 300 provided by an embodiment of the present application. The display device can be deployed in a vehicle and can be used to execute the foregoing Figure 4 or Figure 5 method steps executed by the electronic device or the vehicle shown, or include the GUI corresponding to the foregoing Figures 6 to 52 corresponding points. The display device can also be referred to as an electronic device.

[0323] Figure 53 As shown in

[0324]

[0325] Figure 53

[0326] shown, the display device 300 may include: a processor 3001, a memory 3002, a communication interface 3003, and a bus 3004. The processor 3001, the memory 3002, and the communication interface 3003 may be connected through the bus 3004.

[0324] The processor 3001 is the control center of the display device 300 and can be a general-purpose central processing unit (CPU) or other general-purpose processors. Among them, the general-purpose processor can be a microprocessor or any conventional processor, etc.

[0325] As an example, the processor 3001 may include one or more CPUs, such as Figure 53 the CPU 0 and CPU 1 shown in

[0326] The memory 3002 can be a read-only memory (ROM) or other types of static storage devices that can store static information and instructions, a random access memory (RAM) or other types of dynamic storage devices that can store information and instructions, or can also be an electrically erasable programmable read-only memory (EEPROM), a magnetic disk storage medium, or other magnetic storage devices, or any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto.

[0327] In a possible implementation, the memory 3002 can exist independently of the processor 3001. The memory 3002 can be connected to the processor 3001 through the bus 3004 and is used to store data, instructions, or program code. When the processor 3001 calls and executes the instructions or program code stored in the memory 3002, it can implement the display method provided by the embodiments of the present application or extract the GUI provided by the embodiments of the present application.

[0328] In another possible implementation, the memory 3002 can also be integrated with the processor 3001.

[0329] The communication interface 3003 is used to connect the display device 300 to other devices through a communication network, and the communication network can be an Ethernet, a radio access network (RAN), a wireless local area network (WLAN), etc. The communication interface 3003 can include a receiving unit for receiving data and a transmitting unit for transmitting data.

[0330] The bus 3004 can be an industry standard architecture (ISA) bus, a peripheral component interconnect (PCI) bus, an extended industry standard architecture (EISA) bus, etc. This bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 53 only a thick line is used to represent it in the figure, but it does not mean that there is only one bus or one type of bus.

[0331] It should be noted that Figure 53The structure shown does not constitute a limitation on the display device 300. Except Figure 53 for the components shown, the display device 300 may include more or fewer components than those shown in the figure, or combine certain components, or have a different component arrangement.

[0332] Optionally, the display device shown in the foregoing Figure 53 is a chip.

[0333] The embodiment of the present application also provides a digital processing chip. Circuits for implementing the foregoing processor 3001 or the functions of the processor 3001 and one or more interfaces are integrated in the digital processing chip. When a memory is integrated in the digital processing chip, the digital processing chip can complete the method steps of any one or more of the foregoing embodiments. When a memory is not integrated in the digital processing chip, it can be connected to an external memory through a communication interface. The digital processing chip implements the actions performed by the display device in the foregoing embodiments according to the program code stored in the external memory.

[0334] Referring to Figure 53 , it is a schematic hardware structure diagram of a display device 300 provided by the embodiment of the present application. The display device can be deployed in a vehicle and can be used to execute the foregoing Figure 4 or Figure 5 method steps performed by an electronic device or a vehicle shown, or includes a GUI corresponding to the foregoing Figures 6 to 52 corresponding points. The display device can also be applied to the foregoing electronic device and can also be applied to the foregoing vehicle.

[0335] Figure 53 The display device 300 shown may include: a processor 3001, a memory 3002, a communication interface 3003, and a bus 3004. The processor 3001, the memory 3002, and the communication interface 3003 can be connected through the bus 3004.

[0336] The processor 3001 is the control center of the display device 300. It can be a general central processing unit (CPU) or other general processors, etc. Among them, the general processor can be a microprocessor or any conventional processor, etc.

[0337] As an example, the processor 3001 may include one or more CPUs, such as Figure 53 the CPU 0 and CPU 1 shown in

[0338] The memory 3002 can be a read-only memory (ROM) or other types of static storage devices that can store static information and instructions, a random access memory (RAM) or other types of dynamic storage devices that can store information and instructions, or can also be an electrically erasable programmable read-only memory (EEPROM), a magnetic disk storage medium, or other magnetic storage devices, or any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto.

[0339] In a possible implementation, the memory 3002 can exist independently of the processor 3001. The memory 3002 can be connected to the processor 3001 through the bus 3004 and is used to store data, instructions, or program code. When the processor 3001 calls and executes the instructions or program code stored in the memory 3002, it can implement the display method provided in the embodiments of the present application or extract the GUI provided in the embodiments of the present application.

[0340] In another possible implementation, the memory 3002 can also be integrated with the processor 3001.

[0341] The communication interface 3003 is used to connect the display device 300 to other devices through a communication network, and the communication network can be an Ethernet, a radio access network (RAN), a wireless local area network (WLAN), etc. The communication interface 3003 can include a receiving unit for receiving data and a transmitting unit for transmitting data.

[0342] The bus 3004 can be an industry standard architecture (ISA) bus, a peripheral component interconnect (PCI) bus, an extended industry standard architecture (EISA) bus, etc. This bus can be divided into an address bus, a data bus, a control bus, etc. For the sake of representation, Figure 53 only a thick line is used to represent it in the figure, but it does not mean that there is only one bus or one type of bus.

[0343] It should be noted that Figure 53The structure shown does not constitute a limitation on the display device 300. Except Figure 53 for the components shown, the display device 300 may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0344] Optionally, the aforementioned Figure 53 display device shown is a chip.

[0345] The embodiment of the present application also provides a digital processing chip. Circuits for implementing the aforementioned processor 3001 or the functions of the processor 3001 and one or more interfaces are integrated in the digital processing chip. When a memory is integrated in the digital processing chip, the digital processing chip can complete the method steps of any one or more of the foregoing embodiments. When a memory is not integrated in the digital processing chip, it can be connected to an external memory through a communication interface. The digital processing chip implements the actions performed by the display device in the foregoing embodiments according to the program code stored in the external memory.

[0346] The embodiment of the present application also provides a computer program product which, when running on a computer, causes the computer to execute the steps in the method described in the foregoing Figures 4 - 5 shown embodiments.

[0347] The display device provided by the embodiment of the present application may be a chip, and the chip includes: a processing unit and a communication unit. The processing unit may be, for example, a processor, and the communication unit may be, for example, an input / output interface, a pin, or a circuit, etc. The processing unit can execute the computer-executable instructions stored in the storage unit to cause the chip to execute the method described in the Figures 4 - 5 foregoing embodiments. Optionally, the storage unit is a storage unit inside the chip, such as a register, a cache, etc. The storage unit may also be a storage unit outside the chip and inside the radio access device, such as a read-only memory (ROM) or other types of static storage devices that can store static information and instructions, a random access memory (RAM), etc.

[0348] Specifically, the foregoing processing unit or processor may be a central processing unit (CPU), a neural-network processing unit (NPU), a graphics processing unit (GPU), a digital signal processor (DSP), an application specific integrated circuit (ASIC), or a field programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor, etc. The processing unit or processor may be used to execute the foregoing Figures 4 - 5 steps of the corresponding method.

[0349] An embodiment of the present application also provides a vehicle, which includes the above Figure 12 or Figure 53 shown device.

[0350] In addition, it should be noted that the device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed to multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. In addition, in the drawings of the device embodiments provided in the present application, the connection relationship between the modules indicates that they have a communication connection, which may be specifically implemented as one or more communication buses or signal lines.

[0351] Through the description of the above embodiments, those skilled in the art can clearly understand that the present application can be implemented by means of software plus necessary general hardware. Of course, it can also be implemented by dedicated hardware including application-specific integrated circuits, dedicated CPUs, dedicated memories, dedicated components, etc. Generally, functions completed by computer programs can be easily implemented by corresponding hardware, and the specific hardware structures for implementing the same function can also be diverse, such as analog circuits, digital circuits, or dedicated circuits, etc. However, for the present application, in more cases, software program implementation is a better implementation manner. Based on such an understanding, the technical solution of the present application, in essence, or the part that makes contributions to the prior art can be embodied in the form of a software product. This computer software product is stored in a readable storage medium, such as a floppy disk, USB flash drive, mobile hard disk, read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disc of a computer, etc., and includes several instructions to enable a computer device (which can be a personal computer, server, or network device, etc.) to execute the methods described in various embodiments of the present application.

[0352] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product.

[0353] The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions described in the embodiments of the present application are generated in whole or in part. The computer can be a general-purpose computer, a dedicated computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website, computer, server, or data center to another website, computer, server, or data center in a wired manner (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or a wireless manner (such as infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that a computer can store, or a data storage device such as a server or data center that includes one or more integrated available media. The available medium can be a magnetic medium (such as a floppy disk, hard disk, magnetic tape), an optical medium (such as a DVD), or a semiconductor medium (such as a solid state disk (SSD)), etc.

[0354] In the description and claims of this application and the above-mentioned drawings, terms such as "first", "second", "third", "fourth", etc. are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged under appropriate circumstances so that the embodiments described herein can be implemented in an order different from that shown or described herein. In addition, the terms "comprising" and "having" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device that comprises a series of steps or units need not be limited to those steps or units clearly listed, but may include other steps or units not clearly listed or inherent to these processes, methods, products or devices.

[0355] Finally, it should be noted that the above is only the specific implementation manner of this application, but the protection scope of this application is not limited thereto. Any person skilled in the art within the technical scope disclosed by this application can easily think of changes or substitutions, which should all be covered within the protection scope of this application.

Claims

1. A display method, characterized in that, it includes: In response to a trigger operation for displaying a parking search interface, the parking search interface is displayed. The parking search interface includes multiple icons, and the multiple icons include at least one of a valet parking icon, a roaming parking icon, a summon icon, or a car search icon. The function corresponding to the valet parking icon is used to indicate the function of starting the vehicle to park in a parking space. The roaming parking icon is used to indicate the function of the vehicle searching for a parking space. The summon is used to indicate the function of the vehicle driving to a designated location. The car search is used to indicate the function of obtaining the path to the vehicle.

2. The method according to claim 1, characterized in that, the method further includes: In response to an operation on the selected icon in the parking search interface, control data is sent to the vehicle, and the control data includes an instruction for indicating the vehicle to implement the function corresponding to the selected icon; Display the path when the vehicle implements the function corresponding to the selected icon.

3. The method according to claim 2, characterized in that, the method further includes: Display the information collected by the sensors in the vehicle when the vehicle implements the function corresponding to the selected icon.

4. The method according to claim 2 or 3, characterized in that, if the selected icon includes any one of the valet parking icon, the summon icon, or the car search icon, the displaying the path when the vehicle implements the function corresponding to the selected icon includes: Obtain the information of the first position; Obtain at least one path according to the information of the first position, and the at least one path includes the path between the first position and the second position of the vehicle; Display the at least one path.

5. The method according to claim 4, characterized in that, if the selected icon is the valet parking icon, at least one available parking space is displayed in the parking search interface, and the at least one available parking space is an unoccupied parking space; The obtaining the information of the first position includes: In response to an operation on any one of the at least one available parking spaces, obtain the position of the selected available parking space to obtain the information of the first position.

6. The method according to claim 5, characterized in that, the method further includes: Obtain the data collected by the vehicle sensors, and determine the at least one available parking space according to the data collected by the sensors.

7. The method according to any one of claims 3-6, characterized in that, the sending the control data to the vehicle includes: Obtain a first path from the at least one path; Send the control data to the vehicle, and the control data carries the first path, and the first path is used to indicate the vehicle to drive according to the first path to implement the function corresponding to the selected icon.

8. The method according to claim 7, characterized in that, applied to an electronic device, the method further includes: If the positioning of the vehicle coincides with the positioning of the electronic device, the image displayed in the electronic device is sent to the vehicle to display the image on the display screen of the vehicle.

9. The method according to any one of claims 2-8, wherein, if the selected icon is the roaming parking icon, the method further includes: sending a roaming parking instruction to the vehicle, the roaming parking instruction being used to instruct the vehicle to search for available parking spaces and drive into the available parking spaces; The displaying the path when the vehicle implements the function corresponding to the selected icon includes: acquiring the positioning information when the vehicle travels to the available parking space and synchronously displaying the positioning information.

10. The method according to any one of claims 1-9, wherein, the method further includes: acquiring recommended information according to the information currently generated by the vehicle, the recommended information including information recommended for the vehicle; generating a recommended card according to the recommended information; displaying the recommended card, and the recommended card includes an entry for the function recommended to start the vehicle.

11. The method according to claim 10, wherein, the acquiring the recommended information according to the information currently generated by the vehicle includes: acquiring the information of the historical period of the vehicle, the historical period being the period corresponding to the current period in the historical time cycle; acquiring the recommended information by combining the information of the historical period with the information generated in the current period of the vehicle.

12. The method according to claim 10 or 11, wherein, the recommended information includes at least one of the following recommended information: exclusive parking space recommendation, charging parking space recommendation, roaming car finding function recommendation, location recommendation for calling the vehicle, car finding function recommendation or charging pile recommendation.

13. A display method, applied to a vehicle, wherein, it includes: receiving control data, the control data including an instruction for instructing the vehicle to perform at least one of the functions of valet parking, roaming parking or calling function; performing the at least one function according to the control data and displaying the path when the vehicle performs the at least one function.

14. The method according to claim 13, wherein, the control data is sent by an electronic device, and the method further includes: when the positioning of the vehicle coincides with the positioning of the electronic device, receiving the image displayed in the electronic device and displaying the image.

15. An electronic device, the electronic device includes a display screen, a memory, one or more processors, and the memory stores the code of the graphical user interface of the application program. The one or more processors are used to execute the code of the graphical user interface (GUI) stored in the memory to display the graphical user interface on the display screen, wherein, the graphical user interface includes: Display a parking search interface, the parking search interface including a variety of icons, the parking search interface including a variety of icons, the variety of icons including at least one of a valet parking icon, a roaming parking icon, a summon icon, or a car-finding icon, the function corresponding to the valet parking icon being used to indicate the function of starting to park the vehicle in a parking space, the roaming parking icon being used to indicate the function of the vehicle searching for a parking space, the summon being used to indicate the function of the vehicle driving to a designated location, the car-finding being used to indicate the function of obtaining the path to the vehicle, and the parking query being used to indicate the function of querying the location of the vehicle.

16. The electronic device according to claim 15, wherein, the graphical user interface includes: In response to an operation on the selected icon in the parking search interface, display the path when implementing the function corresponding to the selected icon.

17. The electronic device according to claim 16, wherein, the graphical user interface further includes: Display the information collected by the sensors in the vehicle when implementing the function corresponding to the selected icon.

18. The electronic device according to claim 15 or 16, wherein, the graphical user interface includes: If the selected icon is the valet parking icon or the summon icon, display the path of the vehicle driving to the first location; If the selected icon includes the car-finding icon or the parking query icon, then display the path from the first location to the location of the vehicle.

19. The electronic device according to claim 18, wherein, the graphical user interface further includes: If the selected icon is the valet parking icon, at least one available parking space is further displayed in the parking search interface, and the at least one available parking space is an unoccupied parking space; In response to an operation on any one of the at least one available parking spaces, display the path of the vehicle parking in the selected parking space.

20. The electronic device according to any one of claims 15-19, wherein, the graphical user interface further includes: If the selected icon is the roaming parking icon, display the positioning information when the vehicle drives to an available parking space.

21. The electronic device according to any one of claims 15-20, wherein, the graphical user interface further includes: Display a recommended card, the recommended card including recommended information obtained according to the information currently generated by the vehicle, and the recommended information including the functions of the vehicle recommended to be activated.

22. The electronic device according to any one of claims 15-20, wherein, the recommended information includes at least one of the following recommended information: Exclusive parking space recommendation, charging parking space recommendation, roaming car-finding function recommendation, summon vehicle location recommendation, car-finding function recommendation, or charging pile recommendation.

23. An electronic device, wherein, comprises a processor, the processor being coupled to a memory, the memory storing a program, and when the program instructions stored in the memory are executed by the processor, the method according to any one of claims 1 to 12 is implemented.

24. A vehicle, It is characterized in that it includes a processor, the processor is coupled to a memory, and the memory stores a program, and when the program instructions stored in the memory are executed by the processor, the method described in any one of claims 13 to 14 is implemented.

25. An interaction system It is characterized in that it includes an electronic device and a vehicle, the electronic device is used to implement the method described in any one of claims 1 to 12, and the vehicle is used to implement the method described in any one of claims 12 to 13.

26. A computer-readable storage medium, including a program, when it is executed by a processing unit, executes the method described in any one of claims 1 to 12 or 13 to 14.

27. A computer program product, including a computer program or instruction It is characterized in that when the computer program or instruction is executed by a processor, the method described in any one of claims 1 to 12 or 13 to 14 is implemented.

Citation Information

Patent Citations

  • Method for controlling vehicle based on user terminal desktop, medium and user terminal

    CN114879883A

  • Display method and electronic equipment

    CN115857772A

  • Travel management method, related device and system

    CN115880892A

  • Automobile control method and device, electronic equipment and storage medium

    CN115903566A

  • Intelligent driving automobile valet parking and remote calling system and method

    CN116198483A

Cited By

  • Display method, vehicle, electronic device, and interaction system

    EP4807510A1

  • Display method, vehicle, electronic device, and interaction system

    WO2025113439A1