Polar Coordinate Contact Interaction Method Based on 2D Map and Rotating Zoom Camera

Abstract

This application belongs to the field of intelligent driving and relates to a polar coordinate contact interaction method based on a two-dimensional map and a rotating zoom camera. The method includes: responding to a touch operation on the two-dimensional navigation interface to obtain a touch path; parsing the touch path to obtain a radial movement amount and an angular movement amount corresponding to the touch path; scaling the two-dimensional map according to the radial movement amount and rotating the field of view ray area according to the angular movement amount; sending the radial movement amount and the angular movement amount to the rotating zoom camera so that the rotating zoom camera adjusts parameters while scaling the two-dimensional map and rotating the field of view ray area, and photographing entities within the photographing range to obtain entity information corresponding to the entities, so as to render the two-dimensional navigation interface and the AR navigation interface according to the entity information. This application simplifies the operation of the navigation interface, ensures driving safety, broadens the vehicle's field of view range, and deepens the interaction with the outside world at the same time.

Description

Technical Field

[0001] This application belongs to the technical field of intelligent driving, and particularly relates to a polar coordinate contact interaction method based on a two-dimensional map and a rotating zoom camera, a polar coordinate contact interaction device based on a two-dimensional map and a rotating zoom camera, a polar coordinate contact interaction system based on a two-dimensional map and a rotating zoom camera, a computer-readable medium, and an electronic device. Background Art

[0002] With the update and iteration of navigation software and the development of AR (Augmented Reality) technology, navigation software can also be used to provide AR navigation, that is, in a virtual reality manner, the navigation information is directly displayed on the screen. The driver can choose to simultaneously display a two-dimensional navigation interface and an AR navigation interface on the display screen to provide intuitive navigation guidance.

[0003] However, the two-dimensional map manipulation mode in existing navigation software is very inconvenient for large screens, easy to block the line of sight, and the rotation angle is limited. In addition, when generating an AR navigation interface, it is necessary to take pictures through a rotating camera on the roof. However, the existing rotating cameras are bulky, the manipulation response speed is slow, and there is no zoom and pitch angle control, and they are not combined with the two-dimensional map and induction recognition, lacking application scenarios. Summary of the Invention

[0004] The purpose of this application is to provide a polar coordinate contact interaction method based on a two-dimensional map and a rotating zoom camera, a polar coordinate contact interaction device based on a two-dimensional map and a rotating zoom camera, a polar coordinate contact interaction system based on a two-dimensional map and a rotating zoom camera, a computer-readable medium, and an electronic device, which can overcome the problems in the related technologies that the ordinary two-dimensional map manipulation mode is inconvenient to operate, easy to block the line of sight, and has a limited rotation angle on large screens, and the vehicle cameras are bulky, the manipulation response speed is slow, and they cannot rotate and zoom and adjust the pitch angle, resulting in the inability to effectively identify entities near the vehicle and the inability to provide accurate navigation services for the driver.

[0005] Other features and advantages of this application will become apparent through the following detailed description, or be learned in part through the practice of this application.

[0006] According to the first aspect of the embodiments of the present application, a polar coordinate contact interaction method based on a two-dimensional map and a rotation-zoom camera is provided. The method includes: responding to a touch operation on a two-dimensional navigation interface, obtaining a touch path, where the two-dimensional navigation interface includes a two-dimensional map and a field-of-view ray area; parsing the touch path to obtain a radial movement amount and an angular movement amount corresponding to the touch path; scaling the two-dimensional map according to the radial movement amount, and rotating the field-of-view ray area according to the angular movement amount; sending the radial movement amount and the angular movement amount to the rotation-zoom camera, so that the rotation-zoom camera adjusts parameters while the two-dimensional map is scaled and the field-of-view ray area is rotated, and captures an entity within the shooting range, obtains entity information corresponding to the entity, and renders the two-dimensional navigation interface and the AR navigation interface according to the entity information.

[0007] According to the second aspect of the embodiments of the present application, a polar coordinate contact interaction device based on a two-dimensional map and a rotation-zoom camera is provided. The device includes: a path acquisition module configured to respond to a touch operation on a two-dimensional navigation interface and obtain a touch path, where the two-dimensional navigation interface includes a two-dimensional map and a field-of-view ray area; a path parsing module configured to parse the touch path to obtain a radial movement amount and an angular movement amount corresponding to the touch path; a processing module configured to scale the two-dimensional map according to the radial movement amount and rotate the field-of-view ray area according to the angular movement amount; a rendering module configured to send the radial movement amount and the angular movement amount to the rotation-zoom camera, so that the rotation-zoom camera adjusts parameters while the two-dimensional map is scaled and the field-of-view ray area is rotated, captures an entity within the shooting range, obtains entity information corresponding to the entity, and renders the two-dimensional navigation interface and the AR navigation interface according to the entity information.

[0008] In some embodiments of the present application, the touch path includes an arc touch path and a linear touch path in the radial direction; based on the above technical solutions, the path parsing module is configured to: when the touch path is the arc touch path, segment the arc touch path into a plurality of touch line segments; decompose each of the touch line segments to obtain a radial component and an angular component corresponding to each of the touch line segments; add the radial components corresponding to each of the touch line segments to obtain the radial movement amount, and add the angular components corresponding to each of the touch line segments to obtain the angular movement amount; and when the touch path is the linear touch path, use the linear touch path as the radial movement amount corresponding to the linear touch path.

[0009] In some embodiments of the present application, the touch path is an arc touch path; based on the above technical solutions, the processing module is configured to: obtain a first moving direction and a second moving direction corresponding to the arc touch path; taking the target vehicle as the origin, rotate the field of view ray region by the same angle along the first moving direction according to the polar angle movement amount, and simultaneously zoom in or out the two-dimensional map according to the polar radius movement amount and the second moving direction.

[0010] In some embodiments of the present application, the touch path is a straight-line touch path; based on the above technical solutions, the processing module is configured to: obtain a third moving direction corresponding to the straight-line touch path; when the third moving direction points to the target vehicle, zoom in the two-dimensional map according to the polar radius movement amount; when the third moving direction is away from the target vehicle, zoom out the two-dimensional map according to the polar radius movement amount.

[0011] In some embodiments of the present application, based on the above technical solutions, the processing module includes: a shooting unit configured to shoot an entity located within the shooting range through the rotation-zoom camera to obtain an entity image; and an identification unit configured to perform image recognition on the entity image to obtain entity information corresponding to the entity image.

[0012] In some embodiments of the present application, based on the above technical solutions, the identification unit is configured to: input the entity image into an image recognition model, extract features of the entity image through the image recognition model to obtain logo information corresponding to the entity; match the logo information with the logo information corresponding to each application program link in the database to obtain a target application program link corresponding to the logo information, and generate the entity information according to the logo information and the target application program link.

[0013] In some embodiments of the present application, a camera pitch angle adjustment control is provided in the two-dimensional navigation interface; based on the above technical solutions, the polar coordinate touch point interaction device based on the two-dimensional map and the rotation-zoom camera is configured to: when shooting an entity within the shooting range, respond to a trigger operation on the camera pitch angle adjustment control to adjust the pitch angle of the rotation-zoom camera.

[0014] In some embodiments of the present application, based on the above technical solutions, the rendering module is configured to: render in the AR navigation interface according to the entity information to form an AR navigation interface including a first identifier; map the entity information in the AR navigation interface to the two-dimensional navigation interface to form a two-dimensional navigation interface including a second identifier; wherein, both the first identifier and the second identifier are identifiers corresponding to the target application program link.

[0015] In some embodiments of the present application, based on the above technical solutions, the polar coordinate contact interaction device based on a two-dimensional map and a rotating zoom camera is further configured to: in response to a trigger operation on the second identifier, activate the target application link, and display an operation interface corresponding to the target application link on the display interface.

[0016] In some embodiments of the present application, based on the above technical solutions, the polar coordinate contact interaction device based on a two-dimensional map and a rotating zoom camera is further configured to: when it is detected that the target vehicle is in a stopped state, in response to an activation operation on the rotating zoom camera, activate the rotating zoom camera, so that the rotating zoom camera sends an alarm message to the navigation terminal when an abnormal event is detected.

[0017] In some embodiments of the present application, based on the above technical solutions, the polar coordinate contact interaction device based on a two-dimensional map and a rotating zoom camera is further configured to: before obtaining a touch path in response to a touch operation on a two-dimensional navigation interface, in response to a trigger operation on a polar coordinate navigation control, switch the navigation mode to a polar coordinate navigation mode, and display a two-dimensional navigation interface with polar coordinate operation identifiers on the display interface.

[0018] According to a third aspect of the embodiments of the present application, there is provided a polar coordinate contact interaction system based on a two-dimensional map and a rotating zoom camera. The system includes: a target vehicle; a rotating zoom camera located on the target vehicle; a navigation terminal connected to the rotating zoom camera, configured to obtain a touch path in response to a touch operation on a two-dimensional navigation interface, where the two-dimensional navigation interface includes a two-dimensional map and a field of view ray area; analyze the touch path to obtain a radial movement amount and an angular movement amount corresponding to the touch path; scale the two-dimensional map according to the radial movement amount, and rotate the field of view ray area according to the angular movement amount; send the radial movement amount and the angular movement amount to the rotating zoom camera, so that the rotating zoom camera adjusts parameters while the two-dimensional map is scaled and the field of view ray area is rotated, and captures an entity within the shooting range to obtain entity information corresponding to the entity, so as to render the two-dimensional navigation interface and the AR navigation interface according to the entity information.

[0019] According to a fourth aspect of the embodiments of the present application, there is provided a computer-readable medium having a computer program stored thereon, where the computer program, when executed by a processor, implements the polar coordinate contact interaction method based on a two-dimensional map and a rotating zoom camera as in the above technical solutions.

[0020] According to a fifth aspect of the embodiments of the present application, there is provided an electronic device, which includes: a processor; and a memory for storing executable instructions of the processor; wherein the processor is configured to execute, by executing the executable instructions, the polar coordinate contact interaction method based on a two-dimensional map and a rotation-zoom camera as in the above technical solutions.

[0021] In the technical solution provided by the embodiments of the present application, a touch path is formed by adopting a polar coordinate operation mode in a two-dimensional navigation interface, and the radial motion amount and the angular motion amount are determined according to the touch path. Then, the two-dimensional map in the two-dimensional navigation interface is zoomed according to the radial motion amount, and the field-of-view ray area in the two-dimensional navigation interface is rotated according to the angular motion amount; at the same time, the radial motion amount and the angular motion amount are sent to the rotation-zoom camera, so that the rotation-zoom camera adjusts parameters while zooming the two-dimensional map and rotating the field-of-view ray area, and captures entities within the shooting range to obtain entity information corresponding to the entities. Then, the two-dimensional navigation interface and the AR navigation interface are rendered according to the entity information. On the one hand, the present application can zoom the two-dimensional navigation interface and rotate the field-of-view ray area by adopting a polar coordinate operation mode, avoiding line-of-sight occlusion and ensuring driving safety; on the other hand, it can control the rotation-zoom camera to adjust shooting parameters by touching the two-dimensional map, capture entities within the shooting range to obtain entity information, and render the two-dimensional navigation interface and the AR navigation interface according to the entity information, increasing the amount of information in the navigation interface, broadening the field-of-view range of the vehicle, and deepening the interaction with the outside world; on the other hand, it can improve the display effect of the navigation product and increase the display efficiency of information.

[0022] It should be understood that the above general description and the following detailed description are only exemplary and explanatory, and cannot limit the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] The accompanying drawings here are incorporated into the specification and form a part of this specification, showing embodiments consistent with the present application, and are used together with the specification to explain the principles of the present application. Obviously, the accompanying drawings in the following description are only some embodiments of the present application, and those of ordinary skill in the art can obtain other drawings without creative efforts based on these drawings.

[0024] Figure 1 Schematically shows an architecture block diagram of a polar coordinate contact interaction system based on a two-dimensional map and a rotation-zoom camera applying the technical solution of the present application.

[0025] Figure 2 Schematically shows a step flow diagram of the polar coordinate contact interaction method based on a two-dimensional map and a rotation-zoom camera in the present application.

[0026] Figure 3 Schematically shows the schematic diagram of the navigation interface with polar coordinate operation identifiers in the present application.

[0027] Figure 4 Schematically shows the schematic diagram of the navigation interface with a field of view ray region in the present application.

[0028] Figure 5 Schematically shows the schematic diagram of the process for obtaining the radial motion amount and the polar angle motion amount in the present application.

[0029] Figure 6 Schematically shows the schematic diagram of the interface for determining the radial motion amount and the polar angle motion amount according to the arc touch path in the present application.

[0030] Figures 7A - 7B Schematically shows the schematic diagram of the entity classification in the present application.

[0031] Figure 8 Schematically shows the structural block diagram of the polar coordinate contact interaction device based on a two-dimensional map and a rotation-zoom camera in the present application.

[0032] Figure 9 Schematically shows the computer system structural block diagram of the electronic device suitable for implementing the embodiments of the present application. Detailed implementation manners

[0033] Now, example embodiments will be described more fully with reference to the accompanying drawings. However, the example embodiments can be implemented in various forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this application will be more complete and comprehensive, and will fully convey the concept of the example embodiments to those skilled in the art.

[0034] In addition, the described features, structures, or characteristics can be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to give a thorough understanding of the embodiments of this application. However, those skilled in the art will realize that the technical solutions of this application can be practiced without one or more of the specific details, or other methods, components, devices, steps, etc. can be adopted. In other cases, well-known methods, devices, implementations, or operations are not shown or described in detail to avoid obscuring aspects of this application.

[0035] The block diagrams shown in the drawings are only functional entities and do not necessarily correspond to physically independent entities. That is, these functional entities can be implemented in software form, or in one or more hardware modules or integrated circuits, or in different networks and / or processor devices and / or microcontroller devices.

[0036] The flowcharts shown in the drawings are merely illustrative and not necessarily include all the content and operations / steps, nor are they necessarily executed in the order described. For example, some operations / steps can be decomposed, while some operations / steps can be combined or partially combined. Therefore, the actual execution order may change according to the actual situation.

[0037] Figure 1 An exemplary system architecture block diagram applying the technical solution of the present application is schematically shown.

[0038] As Figure 1 shown, the system architecture 100 may include a target vehicle 110, a navigation terminal 120, and a rotary zoom camera 130. The target vehicle 110 may be any vehicle traveling on the road surface; the navigation terminal 120 at least includes a display screen and may further include a speaker. For example, it may be various electronic devices such as a smart phone, a tablet computer, a laptop computer, a smart vehicle terminal, etc. A two-dimensional navigation interface and an AR navigation interface generated according to the driving route plan of the target vehicle 110 may be simultaneously displayed on the display interface of the navigation terminal 120; the rotary zoom camera 130 is disposed on the target vehicle 110, which may be located in front of the roof of the target vehicle 110 and is communicatively connected to the navigation terminal 120. The connection method may specifically be a wired communication link such as a USB connection.

[0039] According to the implementation requirements, the system architecture in the embodiments of the present application may have any number of target vehicles 110, navigation terminals 120, and rotary zoom cameras 130. The technical solution provided by the embodiments of the present application is applied to the navigation terminal 120.

[0040] For example, the driver uses the navigation software in the navigation terminal 120 (such as a smart phone) for navigation. The GPS system in the smart phone is turned on, and the GPS system locates the current position of the target vehicle 110. The rotary zoom camera 130 connected to the smart phone can capture the scene including the road surface in front of the vehicle to obtain a road image, so as to display a two-dimensional navigation interface and an AR navigation interface generated according to the real-time location of the target vehicle 110 and the driving path plan on the display interface of the smart phone. As a display method, the two-dimensional navigation interface may be located on the left side of the smart phone display interface, and the AR navigation interface may be located on the right side of the smart phone display interface.

[0041] During driving, the navigation control mode can be switched to the polar coordinate control mode. By responding to the user's touch operations on the two-dimensional navigation interface, the touch path can be obtained. Then, the multi-touch analysis interface can be called to analyze the touch path to obtain the radial movement amount and the angular movement amount. Furthermore, the two-dimensional map in the two-dimensional navigation interface can be zoomed according to the radial movement amount, and the field of view ray area in the two-dimensional navigation interface can be rotated according to the angular movement amount. At the same time, the radial movement amount and the angular movement amount are sent to the pan-tilt-zoom camera, so that the pan-tilt-zoom camera adjusts the parameters while the two-dimensional map is zoomed and the field of view ray area is rotated, and captures the entities within the shooting range to obtain entity images, and calls the recognition unit to recognize the entity images to obtain entity information. After receiving the entity information, the navigation terminal 120 can render the two-dimensional navigation interface and the AR navigation interface according to the entity information.

[0042] In some embodiments of the present application, the image recognition of the entity image is based on a machine learning model for navigation using artificial intelligence technology.

[0043] Artificial Intelligence (AI) is the theory, method, technology, and application system that uses digital computers or machines controlled by digital computers to simulate, extend, and expand human intelligence, perceive the environment, acquire knowledge, and use knowledge to obtain the best results. In other words, artificial intelligence is a comprehensive technology in computer science that attempts to understand the essence of intelligence and produce a new intelligent machine that can react in a way similar to human intelligence. Artificial intelligence also studies the design principles and implementation methods of various intelligent machines to enable the machines to have the functions of perception, reasoning, and decision-making.

[0044] Computer Vision Technology (CV) Computer vision is a science that studies how to enable machines to "see". More specifically, it refers to using cameras and computers to replace human eyes to identify and measure targets, etc., in machine vision, and further perform graphic processing to make the computer process the images into images that are more suitable for human eyes to observe or be transmitted to instruments for detection. As a scientific discipline, computer vision studies related theories and technologies and attempts to establish artificial intelligence systems that can obtain information from images or multi-dimensional data. Computer vision technology usually includes image processing, image recognition, image semantic understanding, image information annotation, OCR, video processing, video semantic understanding, video content / behavior recognition, three-dimensional object reconstruction, 3D technology, virtual reality, augmented reality, simultaneous localization and mapping, and other technologies.

[0045] Machine Learning (ML) is an interdisciplinary subject involving multiple fields, such as probability theory, statistics, approximation theory, convex analysis, algorithm complexity theory, etc. It specifically studies how computers simulate or implement human learning behaviors to acquire new knowledge or skills, and reorganize the existing knowledge structure to continuously improve their own performance. Machine learning is the core of artificial intelligence and the fundamental way to endow computers with intelligence, and its applications cover all fields of artificial intelligence. Machine learning and deep learning usually include technologies such as artificial neural networks, belief networks, reinforcement learning, transfer learning, inductive learning, and rote learning.

[0046] At the same time, the technical solution of this application also relates to an intelligent transportation system.

[0047] The Intelligent Traffic System (ITS), also known as the Intelligent Transportation System, effectively integrates advanced scientific and technological means (information technology, computer technology, data communication technology, sensor technology, electronic control technology, automatic control theory, operations research, artificial intelligence, etc.) into transportation, service control, and vehicle manufacturing, strengthening the connection among vehicles, roads, and users, thereby forming a comprehensive transportation system that ensures safety, improves efficiency, enhances the environment, and saves energy.

[0048] In the related technologies of this application, although existing navigation applications can navigate to the destination, it is difficult to achieve precision. For example, after arriving at a building, one still needs to know the specific location of a certain gate, and when arriving at a dining place, one still has to search for a nearby parking lot. That is to say, this "last mile" still plagues people's daily travel. To improve the convenience of navigation, a 2D navigation interface and an AR navigation interface can be used simultaneously. The AR navigation interface provides vivid navigation services. However, the current 2D navigation interface has a single control mode, which is not conducive to the driver's operation while driving. In addition, the pan-tilt-zoom camera also has problems such as inability to rotate, lift, and focus, resulting in imperfect information on the AR navigation interface and being unable to solve the "last mile" problem.

[0049] In the currently used navigation applications, the control mode is the common touch interaction method, that is, the index finger and thumb press the screen simultaneously. When spreading the fingers, the map is enlarged, and when closing the fingers, the map is reduced. When rotating the two fingers, the map is rotated around the midpoint of the line connecting the two fingers. However, whether it is zooming or rotating, it is very inconvenient for a large screen, easily blocking the line of sight, and the rotation angle is also limited.

[0050] In addition, the cameras used in most navigation products are fixed-angle cameras that only capture scenes within the field of view at a fixed angle. For example, they only capture scenes including the road surface in the driving direction of the vehicle and do not use rotating zoom cameras. Even if some automobile manufacturers install rotating cameras on their vehicles, these rotating cameras still have problems such as large volume, slow control response speed, inability to control zoom and pitch angles, and lack of application scenarios as they are not combined with two-dimensional maps and sensing recognition.

[0051] The following will make a detailed description of the technical solutions such as the polar coordinate contact interaction method based on a two-dimensional map and a rotating zoom camera, the polar coordinate contact interaction device based on a two-dimensional map and a rotating zoom camera, the polar coordinate contact interaction system based on a two-dimensional map and a rotating zoom camera, the computer-readable medium, and the electronic device provided by this application in combination with specific implementation manners.

[0052] Figure 2 Schematically shows the step flow diagram of the polar coordinate contact interaction method based on a two-dimensional map and a rotating zoom camera in an embodiment of this application. The polar coordinate contact interaction method based on a two-dimensional map and a rotating zoom camera can be executed by a navigation terminal, and the navigation terminal can specifically be Figure 1 the navigation terminal 120 in. As Figure 2 shown, the polar coordinate contact interaction method based on a two-dimensional map and a rotating zoom camera in the embodiment of this application mainly includes the following steps S210 to step S240.

[0053] Step S210: In response to a touch operation on the two-dimensional navigation interface, obtain a touch path, where the two-dimensional navigation interface includes a two-dimensional map and a field of view ray area;

[0054] Step S220: Analyze the touch path to obtain a radial movement amount and an angular movement amount corresponding to the touch path;

[0055] Step S230: Zoom the two-dimensional map according to the radial movement amount and rotate the field of view ray area according to the angular movement amount;

[0056] Step S240: Send the radial movement amount and the angular movement amount to the rotating zoom camera, so that the rotating zoom camera adjusts parameters while the two-dimensional map is zoomed and the field of view ray area is rotated, and captures entities within the shooting range to obtain entity information corresponding to the entities, and renders the two-dimensional navigation interface and the AR navigation interface according to the entity information.

[0057] In the navigation method provided by the embodiments of the present application, a touch path is formed by adopting a polar coordinate operation mode on a two-dimensional navigation interface, and the radial motion amount and the polar angle motion amount are determined according to the touch path. Furthermore, the two-dimensional map in the two-dimensional navigation interface is scaled according to the radial motion amount, and the field of view ray area in the two-dimensional navigation interface is rotated according to the polar angle motion amount. At the same time, the radial motion amount and the polar angle motion amount are sent to a pan-tilt-zoom camera, so that the pan-tilt-zoom camera adjusts parameters while the two-dimensional map is scaled and the field of view ray area is rotated, and entities within the shooting range are photographed to obtain entity information corresponding to the entities. Furthermore, the two-dimensional navigation interface and the AR navigation interface are rendered according to the entity information. On the one hand, the present application can scale the two-dimensional navigation interface and rotate the field of view ray area by adopting the polar coordinate operation mode, avoiding blocking the line of sight and ensuring driving safety. On the other hand, the two-dimensional map can be touched to control the pan-tilt-zoom camera to adjust the shooting parameters, entities within the shooting range are photographed to obtain entity information, and the two-dimensional navigation interface and the AR navigation interface are rendered according to the entity information, increasing the information volume of the navigation interface, broadening the field of view of the vehicle, and deepening the interaction with the outside world. On the other hand, the display effect of the navigation product can be improved, and the display efficiency of information can be increased.

[0058] The following details the specific implementation manners of each method step of the polar coordinate contact interaction method based on a two-dimensional map and a pan-tilt-zoom camera.

[0059] In step S210, in response to a touch operation on the two-dimensional navigation interface, a touch path is obtained, where the two-dimensional navigation interface includes a two-dimensional map and a field of view ray area.

[0060] In an embodiment of the present application, when the driver turns on the navigation application installed in the navigation terminal and inputs the destination, the background can determine the driving route plan according to the current position and the destination detected by the GPS navigation system. After the driver selects the driving route plan according to the need and starts navigation, the corresponding two-dimensional navigation interface can be displayed on the display interface of the navigation terminal. At the same time, the driver can choose to synchronously display the AR navigation interface on the display interface. The AR navigation interface displays the environment where the target vehicle is located and the navigation paving formed according to the driving route plan. As a display method, the two-dimensional navigation interface is displayed on the left side of the display interface of the navigation terminal, and the corresponding AR navigation interface is displayed on the right side. Of course, the two-dimensional navigation interface can also be displayed on the right side of the display interface of the navigation terminal, and the corresponding AR navigation interface is displayed on the left side. Further, the two-dimensional navigation interface and the AR navigation interface can be set in an up-and-down arrangement mode. The specific arrangement mode is mainly for the convenience of the driver's operation and can be set by the driver in the navigation application according to actual needs.

[0061] In an embodiment of the present application, a navigation mode switching control is set in the two-dimensional navigation interface, namely a "normal navigation" control and a "polar coordinate navigation" control. Among them, "normal navigation" corresponds to the ordinary two-dimensional control mode, and "polar coordinate navigation" corresponds to the polar coordinate control mode. When the navigation application is enabled, the "normal navigation" mode is adopted by default. When the driver wants to adopt the polar coordinate control mode, the "polar coordinate navigation" control can be triggered. By responding to this trigger operation, the control mode can be switched from the ordinary two-dimensional control mode to the polar coordinate control mode. The polar coordinate means that in a plane, a fixed point O is taken as the pole, a ray Ox is drawn as the polar axis, and then a length unit and the positive direction of the angle (usually the counterclockwise direction) are selected. For any point M in the plane, ρ represents the length of the line segment OM, θ represents the angle from Ox to OM, ρ is called the polar radius of point M, θ is called the polar angle of point M, and the ordered pair (ρ,θ) is called the polar coordinate of point M. The coordinate system established in this way is called the polar coordinate system. Correspondingly, in the polar coordinate control mode, linear touch can be performed along the polar radius direction, and arc touch can also be performed along the polar angle direction. Since both linear touch and arc touch can be achieved by the touch object along one direction, compared with the existing touch interaction methods, the polar coordinate control mode is easy to operate, does not block the line of sight, and can realize the zooming of the map in the two-dimensional navigation interface and the rotation of the visual ray area at any angle. Among them, the touch object can be the finger of the driver or passenger, or a terminal such as a stylus that can interact with the navigation terminal. The embodiments of the present application do not make specific limitations on this.

[0062] Figure 3 The interface schematic diagram of the navigation interface with the polar coordinate operation identifier is shown, as Figure 3 shown, in the two-dimensional navigation interface, the identifier 301 corresponding to the target vehicle, the identifiers 302 and 303 for indicating the linear touch method and the arc touch method are displayed, and there is also a camera pitch angle adjustment control 304 for adjusting the pitch angle of the rotating and zooming camera. Among them, the identifiers 302 and 303 are only used to indicate the specific touch method and do not limit the touch area. In the embodiment of the present application, linear touch can be performed along the polar radius direction within the 360° plane range centered on the target vehicle to realize the zooming of the two-dimensional map. At the same time, arc touch can be performed within the plane range centered on the target vehicle to realize the rotation of the visual ray area in the two-dimensional navigation interface.

[0063] Figure 4 The interface schematic diagram of the navigation interface with the visual ray area is shown, as Figure 4As shown in the figure, in a two-dimensional navigation interface, centered on the target vehicle, there is a triangular ray region S, which is the field of view ray region. This field of view ray region S corresponds to the shooting range of the rotating zoom camera. When the field of view ray region S rotates, the angle of the rotating zoom camera also changes accordingly to obtain images of entities in the area covered by the field of view ray region S. By rotating the field of view ray region to trigger the rotation of the rotating zoom camera and obtain entity images corresponding to the shooting range, the rotation of the two-dimensional map is avoided, thereby avoiding interference with the driver's acquisition of route information from the two-dimensional map and ensuring driving safety.

[0064] In an embodiment of the present application, when zooming in and out of the two-dimensional map and rotating the field of view ray region, the specific zoom amount and rotation angle are determined according to the touch path generated by linear touch or arc touch. At the same time, the touch path is determined by the starting position and ending position of the touch object.

[0065] Since the polar coordinate control mode includes parameters in two dimensions, the touch path can be decomposed into components in the radial direction and components in the polar angle direction. Furthermore, according to the components in the radial direction, the zoom amount for zooming in and out of the two-dimensional map can be determined, and according to the components in the polar angle direction, the rotation angle for rotating the field of view ray region can be determined.

[0066] In step S220, the touch path is parsed to obtain the radial movement amount and polar angle movement amount corresponding to the touch path.

[0067] In an embodiment of the present application, after obtaining the touch path, it can be parsed to obtain the radial movement amount and polar angle movement amount. When parsing, specifically, the multi-touch parsing interface can be called, and the multi-touch parsing unit is used to parse the touch path.

[0068] In an embodiment of the present application, the touch path is divided into a linear touch path and an arc touch path. When the touch path is a linear touch path, the component in the polar angle direction is 0. Therefore, the linear touch path is the radial movement amount corresponding to the touch path. When the touch path is an arc touch path, Figure 5 shows a schematic flow chart for obtaining the radial movement amount and polar angle movement amount, as Figure 5 shown, in step S501, the arc touch path is segmented into multiple touch line segments; in step S502, each touch line segment is decomposed to obtain the radial component and polar angle component corresponding to each touch line segment; in step S503, the radial components corresponding to each touch line segment are added together to obtain the radial movement amount, and the polar angle components corresponding to each touch line segment are added together to obtain the polar angle movement amount.

[0069] Figure 6The schematic diagram of the interface for determining the polar radius movement amount and the polar angle movement amount according to the arc touch path is shown. As Figure 6 shown, the arc touch path is divided into four touch line segments L1, L2, L3, and L4. The target vehicle is the pole. By decomposing the touch line segment L1, the touch line segment L2, the touch line segment L3, and the touch line segment L4 along the polar radius direction and the polar angle direction respectively, the polar radius components ρ i (i = 1, 2, 3, 4) and the polar angle components θ i (i = 1, 2, 3, 4) corresponding to each touch line segment can be obtained. For the convenience of calculation, the positive and negative values of the polar radius components can be marked according to the positional relationship between the polar radius components and the target vehicle. For example, the polar radius components pointing to the target vehicle can be marked as negative values, and the polar radius components away from the vehicle can be marked as positive values. Of course, the polar radius components pointing to the target vehicle can also be marked as positive values, and the polar radius components away from the vehicle can be marked as negative values. Finally, all the polar radius components are added to obtain the polar radius movement amount, and all the polar angle components are added to obtain the polar angle movement amount.

[0070] The calculation formulas for the polar radius movement amount and the polar angle movement amount are shown in Formulas (1) and (2):

[0071] ρ = ρ1 + ρ2 +...... + ρ n (1)

[0072] θ = θ1 + θ2 +...... + θ n (2)

[0073] where n is the number of the divided touch line segments.

[0074] To make the technical solution of the embodiment of the present application clearer, it is described by marking the polar radius components pointing to the target vehicle as negative values and the polar radius components away from the vehicle as positive values. For example, when the polar radius components corresponding to the arc touch path are ρ1 = 2, ρ2 = 1, ρ3 = -1, ρ4 = -3 respectively, and the polar angle components are θ1 = 30°, θ2 = 10°, θ3 = 10°, θ4 = 5° respectively, then the polar radius movement amount ρ = -1 and the polar angle movement amount θ = 55° can be determined. It shows that the movement amount of the arc touch in the polar radius direction is to move 1 unit length towards the target vehicle, and the movement amount in the polar angle direction is to rotate 55° along the movement direction of the touch object. For example, if the touch object touches clockwise, then the visual ray area in the two-dimensional navigation interface rotates 55° clockwise.

[0075] In step S230, the map is scaled according to the polar radius movement amount, and the visual ray area is rotated according to the polar angle movement amount.

[0076] In an embodiment of the present application, when the touch path is an arc touch path, after parsing the arc touch path to obtain the radial motion amount and the polar angle motion amount, the two-dimensional map can be zoomed in or out according to the radial motion amount, and the field of view ray area can be rotated according to the polar angle motion amount. Specifically, first, obtain a first moving direction and a second moving direction corresponding to the arc touch path; where the first moving direction is the moving direction along the polar angle direction, and the second moving direction is the moving direction along the radial direction; then, taking the target vehicle as the origin, rotate the field of view ray area along the first moving direction by the same angle according to the polar angle motion amount, and at the same time zoom in or out the two-dimensional map according to the radial motion amount and the second moving direction. When zooming in or out the two-dimensional map according to the radial motion amount and the second moving direction, if the second moving direction is away from the target vehicle, then zoom in the two-dimensional map according to the radial motion amount, and if the second moving direction is pointing to the target vehicle, then zoom out the two-dimensional map according to the radial motion amount, where the values of zooming in and out are proportional to the distance between the target vehicle and the entity corresponding to the end position of the touch object on the two-dimensional navigation interface. As is well known, the two-dimensional map is drawn by shrinking the real world according to a certain ratio. Then, after determining the distance between the target vehicle and the entity, the values of zooming in and out can be determined according to the distance between the target vehicle and the entity, the shrinking ratio between the two-dimensional map and the real world, and the radial motion amount.

[0077] Continuing with Figure 6 the arc touch path shown as an example, the radial motion amount ρ = -1, the polar angle motion amount θ = 55°, the first moving direction is the clockwise direction, and the second moving direction is pointing to the target vehicle. Then, when processing the two-dimensional navigation interface, on the one hand, zoom out the two-dimensional map, and the zoom-out amount is determined according to the radial motion amount of 1 unit length. On the other hand, rotate the field of view ray area by 55° clockwise with the target vehicle as the origin. The finally presented two-dimensional navigation interface is a map interface in which the original map is zoomed out and the field of view ray area is rotated 55° clockwise with the target vehicle as the center.

[0078] It should be noted that during the arc touch process, there may be movements along both the radial direction and the polar angle direction at the same time. That is to say, when processing the two-dimensional navigation interface according to the touch path obtained by responding to the arc touch operation, there are both zooming in and out of the two-dimensional map and rotation of the field of view ray area with the target vehicle as the origin. However, when the radial motion amount is 0, there is only rotation of the field of view ray area with the target vehicle as the origin.

[0079] In one embodiment of the present application, when the touch path is a straight touch path, it can be determined through analysis that the length of the straight touch path is the radial motion amount. Then, when the two-dimensional map is scaled according to the radial motion amount, the third moving direction corresponding to the straight touch path is first obtained; then the two-dimensional map is scaled according to the relationship between the third moving direction and the target vehicle. Specifically, when the third moving direction points to the target vehicle, the two-dimensional map is reduced according to the radial motion amount; when the third moving direction is away from the target vehicle, the two-dimensional map is enlarged according to the radial motion amount.

[0080] In one embodiment of the present application, while scaling the two-dimensional map and rotating the field of view ray area with the target vehicle as the origin, the polar radial motion amount and the polar angular motion amount can be sent to the rotary zoom camera so that the rotary zoom camera can synchronously obtain the entity image within the corresponding shooting range, and then the corresponding scene can be rendered and displayed in the AR navigation interface according to the entity information corresponding to the entity in the entity image.

[0081] In step S240, the polar radial motion amount and the polar angular motion amount are sent to the rotary zoom camera, so that the rotary zoom camera adjusts parameters while zooming the two-dimensional map and rotating the field of view ray area, and shoots entities within the shooting range to obtain entity information corresponding to the entity, so as to render the two-dimensional navigation interface and AR navigation interface according to the entity information.

[0082] In one embodiment of the present application, since the AR navigation interface and the two-dimensional navigation interface are synchronously corresponding, when the driver uses a touch object such as a finger or a stylus to perform a linear touch or an arc touch in the two-dimensional navigation interface, the screen in the AR navigation interface also changes synchronously and correspondingly, and the screens in the AR navigation interface are all obtained by shooting with a rotating zoom camera. Therefore, it can be considered that the two-dimensional navigation interface is equivalent to a controller. When a linear touch signal or an arc touch signal is received, the rotating zoom camera on the target vehicle can be controlled to adjust the shooting parameters, and the entity within the shooting range determined after adjusting the shooting parameters can be shot to obtain a physical image. Then, the AR navigation interface is rendered according to the physical information corresponding to the physical image, and the information in the AR navigation interface is mapped to the two-dimensional navigation interface.

[0083] In one embodiment of the present application, in response to a touch signal in a two-dimensional navigation interface, when activating a rotary zoom camera to shoot an entity within a shooting range, the rotary zoom camera adjusts parameters accordingly according to the touch trajectory. For example, when the touch trajectory is a straight touch trajectory away from a target vehicle, the two-dimensional map in the two-dimensional navigation interface will be enlarged, and entities such as buildings, billboards, and trademarks corresponding to the straight touch trajectory in the AR navigation interface will also be enlarged. Therefore, the rotary zoom camera needs to adjust the lens direction according to the direction of the straight touch trajectory, increase the focal length, and stretch the lens to shoot the entities within the target range in that direction to obtain corresponding entity images; Accordingly, when the touch trajectory is a straight touch trajectory pointing to the target vehicle, the rotary zoom camera needs to adjust the lens along the direction of the straight touch trajectory, reduce the focal length, and retract the lens to shoot the entity within the target range in that direction; for example, when the touch trajectory is an arc touch trajectory, when there are both radial motion and angular motion, the rotary zoom camera rotates along the arc touch trajectory to shoot, and adjusts the lens focal length according to the radial motion to shoot, so as to obtain the entity image within the shooting range; when only angular motion exists, the rotary zoom camera rotates along the arc touch trajectory to shoot, so as to obtain the entity image within the shooting range. Furthermore, in the process of capturing the physical image, the driver can also perform touch operation on the camera pitch angle adjustment control 304 in the two-dimensional navigation interface according to actual needs to adjust the pitch angle of the rotary zoom camera. For example, if only the lower half of a building is displayed in the AR navigation interface and the upper half is not visible, the camera pitch angle adjustment control 304 can be slid upward to increase the elevation angle of the rotary zoom camera so that the rotary zoom camera can capture the entire building. For another example, if the nearby road surface is not visible in the AR navigation interface, the camera pitch angle adjustment control 304 can be slid downward to increase the depression angle of the rotary zoom camera so that the nearby road surface is included in the physical image.

[0084] In an embodiment of the present application, an identification unit may be integrated in the rotating zoom camera for performing image recognition on the captured physical image to obtain physical information corresponding to the physical image. As another implementation manner, the identification unit may also be configured in the navigation terminal. After the rotating zoom camera captures a physical image, the physical image is sent to the navigation terminal, and the navigation terminal calls the identification unit to perform image recognition on the physical image to obtain the corresponding physical information, and then renders the AR navigation interface and the 2D navigation interface according to the physical information. Among them, the identification unit may specifically be a trained image recognition model, such as a convolutional neural network, a recurrent neural network, etc. for image recognition, which is used to extract features from the physical image to obtain the logo information corresponding to each entity. The entity may specifically be a building, a store, a trademark, a billboard, a road, a pedestrian, etc. The logo information may specifically be information such as appearance, position, and text content.

[0085] In an embodiment of the present application, application program links corresponding to the entity may also be displayed in the 2D navigation interface and the AR navigation interface to improve the display efficiency of information in the navigation interface. Specifically, when the object is an entity such as a building, a store, a trademark, a billboard, etc., the target application program link corresponding to the entity may be obtained according to the logo information. The method for obtaining the target application program link is specifically to match the logo information with the logo information corresponding to each application program link in the database. When there is a target logo information that matches the logo information, the application program link corresponding to the target logo information is used as the target application program link, and then the entity information may be generated according to the logo information and the target application program link. The target application program link may be an official website link or a mini-program link, etc. For example, if the entity is a building of a hospital, after recognizing the appearance, position, and name of the hospital, the official website link or the mini-program link of the hospital is obtained by matching from the database. By clicking on the official website link or the mini-program link, the online platform of the hospital can be entered for operations such as registering, making appointments, and having online consultations.

[0086] In an embodiment of the present application, when rendering the AR navigation interface according to entity information, on the one hand, rendering is performed based on information such as the appearance, position, and text content of the entity, and on the other hand, a first identifier corresponding to the target application program link is displayed in the AR navigation interface. At the same time, the entity information in the AR navigation interface is also mapped to the two-dimensional navigation interface, and a second identifier corresponding to the target application program link is displayed in the two-dimensional navigation interface. Among them, the first identifier and the second identifier may be the same identifier or different identifiers. For example, the first identifier may be an arrow identifier, and the second identifier may be a small circle. The arrow identifier may be a dynamic identifier. As the distance between the target vehicle and the entity gradually decreases or increases, the arrow identifier gradually increases or decreases. At the same time, the small circle in the two-dimensional navigation interface also gradually becomes smaller or larger as the distance increases or decreases. In the embodiment of the present application, the first identifier and the second identifier may also be other types of identifiers, and the embodiments of the present application do not make specific limitations on this.

[0087] In an embodiment of the present application, when zooming the two-dimensional map according to the polar radius movement amount, the second identifier also scales proportionally with the zooming of the two-dimensional map. And when rotating the field of view ray area with the target vehicle as the origin according to the polar angle movement amount, the second identifier corresponding to the entity within the shooting range of the rotation-zooming camera in the two-dimensional navigation interface, that is, the small circle, will be highlighted.

[0088] In an embodiment of the present application, the second identifier in the two-dimensional navigation interface can be set to be continuously in an active state. The driver can perform a trigger operation on the second identifier. When the background responds to the trigger operation, the application program link corresponding to the second identifier can be activated, and corresponding resources can be obtained according to the application program link, and then an operation interface corresponding to the application program link is displayed on the display interface of the navigation terminal. The driver can perform corresponding operations according to actual needs on the operation interface, such as purchase, reservation, queuing, etc.

[0089] In an embodiment of the present application, it is also possible to trigger the rotation-zooming camera to capture the entity corresponding to a certain position on the two-dimensional map by performing a touch operation on the two-dimensional map to obtain a corresponding entity image. Among them, the touch operation on the two-dimensional map may specifically be a double-click operation. Of course, it may also be other types of operations, and the embodiments of the present application do not make specific limitations on this.

[0090] Through touch operations based on polar coordinates on the two-dimensional navigation interface, this application can zoom in and out on the two-dimensional map in the two-dimensional navigation interface, rotate the field-of-view ray area with the target vehicle as the origin, avoiding line of sight obstruction and ensuring driving safety. At the same time, the touch operations on the two-dimensional navigation interface can also control the pan-tilt-zoom camera on the target vehicle to adjust parameters and capture entities within the shooting range to obtain entity images. After obtaining the entity information corresponding to the entity images, they can be rendered onto the AR navigation interface for the driver to view. Further, the entity information in the AR navigation interface can also be mapped onto the two-dimensional navigation interface, and through interactions in the two-dimensional navigation interface, interactions with the outside world can be achieved, improving the information search efficiency and driving experience.

[0091] The polar coordinate touch interaction method based on the two-dimensional map and the pan-tilt-zoom camera in this application can be applied to many application scenarios, such as entertainment, searching for people, shopping, queuing, etc. Next, taking specific application scenarios as examples, the polar coordinate touch interaction method based on the two-dimensional map and the pan-tilt-zoom camera in this application will be specifically described.

[0092] When waiting for a red light, in order to pass the time, the driver can select the polar coordinate navigation mode on the two-dimensional navigation interface and then perform linear touch or arc touch on the two-dimensional navigation interface. In this way, the driver can enjoy the scenery outside through the AR navigation interface. For example, by performing a linear touch in the direction away from the vehicle, the driver can enjoy the distant scenery, and by performing an arc touch, the driver can enjoy the scenery around the vehicle.

[0093] When the driver makes an appointment with a friend to go shopping in a mall and only knows which gate of the community the friend will come out from but doesn't know where the friend will wait, the driver can click on the position corresponding to the community exit in the two-dimensional navigation interface to control the pan-tilt-zoom camera to aim at the exit. At the same time, the driver can also trigger the operation on the camera pitch angle adjustment control to adjust the pitch angle of the pan-tilt-zoom camera to ensure that the pan-tilt-zoom camera can capture a complete portrait. The pan-tilt-zoom camera can continuously capture pedestrians coming out of the community exit in real time or capture pedestrians coming out of the exit at preset time intervals to obtain entity images. Then, the recognition unit is called to recognize the entity images to obtain entity information. Next, the entity information can be sent to the navigation terminal so that the AR navigation interface can be rendered according to the entity information. During the process of recognizing the entity images, face features of the pedestrians can be extracted and compared with the learned face features of the friend. When the two match, it is determined that the target person appears. Subsequently, a voice prompt can be issued through the navigation terminal to tell the driver that the target person has appeared, helping the driver and the friend to meet smoothly.

[0094] When the driver is driving to the destination with friends and encounters situations where they cannot pass smoothly, such as traffic jams, they can perform a triggering operation on the second identifier corresponding to the store in the two-dimensional navigation interface in the vehicle to enter the mini-program of the store to achieve shopping. For example, if a fast food restaurant is found in the two-dimensional navigation interface, the driver can click on the second identifier above the name of the fast food restaurant to enter the mini-program of the fast food restaurant. In the mini-program interface, the driver can select the desired food, then place an order and send the vehicle's location so that the delivery person can deliver the prepared takeout to the vehicle's location in a timely manner.

[0095] When the driver needs to go to the hospital to see a doctor, according to the normal process, they need to park the car first and then enter the hospital to get the appointment number and queue up for treatment. However, if they park the car first and then go to get the number, it will take a long time and the timeliness cannot be guaranteed. Then, the driver can click on the address of the hospital on the two-dimensional navigation interface, control the rotatable and zoomable camera to aim at the hospital building and call the recognition unit to identify it. When it is recognized that the building is the hospital building, the second identifier corresponding to the hospital is displayed on the two-dimensional navigation interface. The driver can click on the second identifier to enter the mini-program of the hospital, get the appointment number, so that there is enough time to park the car and then go for treatment.

[0096] Of course, the application scenarios to which the polar coordinate contact interaction method based on the two-dimensional map and the rotatable and zoomable camera in the embodiments of the present application can be applied include but are not limited to the above application scenarios. It should be noted that the triggering operation on various controls in the two-dimensional navigation interface can specifically be a click operation. Of course, it can also be a triggering operation such as a double click. The embodiments of the present application do not make specific limitations on this.

[0097] In an embodiment of the present application, a list can also be formed according to the classification of the entities corresponding to all the second controls in the two-dimensional navigation interface and displayed on one side of the two-dimensional navigation interface, specifically on the right side or the left side, etc. The user can select the desired classification from this list according to actual needs. After receiving the triggering operation on the target classification, all the entity information corresponding to this classification can be displayed in the two-dimensional navigation interface, such as the remaining parking spaces and charging information of the parking lot, the movies currently showing and ticket prices in the cinema, the set meal prices in each restaurant, etc., for selection. Further, the entity corresponding to the entity information selected by the user can be used as the destination for navigation. Figures 7A - 7B The interface schematic diagram showing the entity classification is as Figure 7A shown. According to the entities corresponding to the second controls displayed in the two-dimensional navigation interface, they can be classified into categories such as parking lots, cinemas, restaurants, massages, amusement parks, etc. The list composed of these categories is displayed on the right side of the two-dimensional navigation interface; after selecting the desired category, such as a parking lot, the distribution of parking lots within 15 Km around the current location of the target vehicle, as well as the names, distances, remaining parking spaces and charging information of each parking lot, are displayed in the two-dimensional navigation interface, asFigure 7B As shown; after selecting the target parking lot, you can click the location corresponding to the target parking lot on the map to set it as the end point for navigation.

[0098] In one embodiment of the present application, when the target vehicle is stopped and the driver is about to leave or has left the vehicle, the rotating zoom camera can be set to work in the navigation terminal to activate the rotating zoom camera to continue working. The rotating zoom camera can collect images around the target vehicle and identify them according to a preset frequency. When an abnormal event is detected, such as a suspicious person other than the driver approaching the vehicle, an alarm message is sent to the navigation terminal to prompt the user to conduct an anti-theft check to ensure the safety of the target vehicle. The alarm message can include an image of the abnormal event, and the user can view the image to determine whether to lift the alarm.

[0099] The polar coordinate touch interaction method based on a two-dimensional map and a rotating zoom camera in the present application forms a touch path by adopting a polar coordinate operation mode in a two-dimensional navigation interface, and determines the polar radial motion amount and the polar angular motion amount according to the touch path, and then scales the two-dimensional map in the two-dimensional navigation interface according to the polar radial motion amount, and rotates the field of view ray area in the two-dimensional navigation interface according to the polar angular motion amount; at the same time, the polar radial motion amount and the polar angular motion amount are sent to the rotating zoom camera, so that the rotating zoom camera adjusts parameters while scaling the two-dimensional map and rotating the field of view ray area, and shoots entities within the shooting range, obtains entity information corresponding to the entity, and then renders the two-dimensional navigation interface and the AR navigation interface according to the entity information. On the one hand, the present application can scale the two-dimensional navigation interface and rotate the field of view area by adopting the polar coordinate operation mode, thereby avoiding obstruction of the line of sight and ensuring driving safety; on the other hand, it can control the rotating zoom camera to adjust the shooting parameters by touching the two-dimensional map, shoot the entities within the shooting range to obtain entity information, and render the two-dimensional navigation interface and AR navigation interface according to the entity information, thereby increasing the amount of information in the navigation interface, broadening the vehicle's field of view, and deepening the interaction with the outside world; on the other hand, it can improve the display effect of the navigation product and increase the display efficiency of information.

[0100] It should be noted that although the steps of the method in the present application are described in a specific order in the drawings, this does not require or imply that the steps must be performed in this specific order, or that all the steps shown must be performed to achieve the desired results. Additionally or alternatively, some steps may be omitted, multiple steps may be combined into one step, and / or one step may be decomposed into multiple steps, etc.

[0101] The following introduces an apparatus embodiment of the present application, which can be used to execute the navigation method in the above-mentioned embodiment of the present application.Figure 8 Schematically shown is a structural block diagram of a polar coordinate contact interaction device provided by an embodiment of the present application based on a two-dimensional map and a rotation-zoom camera. As Figure 8 shown, the polar coordinate contact interaction device 800 based on a two-dimensional map and a rotation-zoom camera includes: a path acquisition module 810, a path parsing module 820, a processing module 830, and a rendering module 840. Specifically:

[0102] The path acquisition module 810 is configured to obtain a touch path in response to a touch operation on a two-dimensional navigation interface, where the two-dimensional navigation interface includes a two-dimensional map and a field of view ray area; the path parsing module 820 is configured to parse the touch path to obtain a radial motion amount and an angular motion amount corresponding to the touch path; the processing module 830 is configured to scale the two-dimensional map according to the radial motion amount and rotate the field of view ray area according to the angular motion amount; the rendering module 840 is configured to send the radial motion amount and the angular motion amount to the rotation-zoom camera, so that the rotation-zoom camera adjusts parameters while scaling the two-dimensional map and rotating the field of view ray area, captures entities within the shooting range, obtains entity information corresponding to the entities, and renders the two-dimensional navigation interface and the AR navigation interface according to the entity information.

[0103] In some embodiments of the present application, the touch path includes an arc touch path and a straight touch path in the radial direction; based on the above technical solution, the path parsing module 820 is configured to: when the touch path is the arc touch path, divide the arc touch path into a plurality of touch line segments; decompose each of the touch line segments to obtain a radial component and an angular component corresponding to each of the touch line segments; add the radial components corresponding to each of the touch line segments to obtain the radial motion amount, and add the angular components corresponding to each of the touch line segments to obtain the angular motion amount; and when the touch path is the straight touch path, use the straight touch path as the radial motion amount corresponding to the straight touch path.

[0104] In some embodiments of the present application, the touch path is an arc touch path; based on the above technical solution, the processing module 830 is configured to: obtain a first moving direction and a second moving direction corresponding to the arc touch path; with the target vehicle as the origin, rotate the field of view ray area along the first moving direction by the same angle according to the angular motion amount, and at the same time, zoom in or out the two-dimensional map according to the radial motion amount and the second moving direction.

[0105] In some embodiments of the present application, the touch path is a straight touch path; based on the above technical solution, the processing module 830 is configured to: obtain a third moving direction corresponding to the straight touch path; when the third moving direction points to the target vehicle, reduce the two-dimensional map according to the polar radius movement amount; when the third moving direction is away from the target vehicle, enlarge the two-dimensional map according to the polar radius movement amount.

[0106] In some embodiments of the present application, based on the above technical solution, the processing module 830 includes: a photographing unit configured to photograph an entity within the photographing range through the rotating zoom camera to obtain an entity image; an identifying unit configured to perform image recognition on the entity image to obtain entity information corresponding to the entity image.

[0107] In some embodiments of the present application, based on the above technical solution, the identifying unit is configured to: input the entity image into an image recognition model, extract features of the entity image through the image recognition model to obtain logo information corresponding to the entity; match the logo information with the logo information corresponding to each application program link in the database to obtain a target application program link corresponding to the logo information, and generate the entity information according to the logo information and the target application program link.

[0108] In some embodiments of the present application, a camera pitch angle adjustment control is provided in the two-dimensional navigation interface; based on the above technical solution, the polar coordinate touch point interaction device 800 based on the two-dimensional map and the rotating zoom camera is configured to: when photographing an entity within the target range, in response to a trigger operation on the camera pitch angle adjustment control, adjust the pitch angle of the rotating zoom camera.

[0109] In some embodiments of the present application, based on the above technical solution, the rendering module 840 is configured to: render in the AR navigation interface according to the entity information to form an AR navigation interface including a first identifier; map the entity information in the AR navigation interface to the two-dimensional navigation interface to form a two-dimensional navigation interface including a second identifier; wherein, the first identifier and the second identifier are identifiers corresponding to the target application program link.

[0110] In some embodiments of the present application, based on the above technical solution, the polar coordinate touch point interaction device 800 based on the two-dimensional map and the rotating zoom camera is further configured to: in response to a trigger operation on the second identifier, activate the target application program link, and display an operation interface corresponding to the target application program link on the display interface.

[0111] In some embodiments of the present application, based on the above technical solutions, the polar coordinate contact interaction device 800 based on a two-dimensional map and a rotating zoom camera is further configured to: when it is detected that the target vehicle is in a stopped state, in response to an activation operation on the rotating zoom camera located in the target vehicle, activate the rotating zoom camera, so that the rotating zoom camera sends an alarm message to the navigation terminal when an abnormal event is detected.

[0112] In some embodiments of the present application, based on the above technical solutions, the polar coordinate contact interaction device 800 based on a two-dimensional map and a rotating zoom camera is further configured to: before obtaining a touch path in response to a touch operation on the two-dimensional navigation interface, in response to a trigger operation on the polar coordinate navigation control, switch the navigation mode to the polar coordinate navigation mode, and display a two-dimensional navigation interface with polar coordinate operation identifiers in the display interface.

[0113] The specific details of the polar coordinate contact interaction device based on a two-dimensional map and a rotating zoom camera provided in each embodiment of the present application have been described in detail in the corresponding method embodiments, and will not be repeated here.

[0114] Figure 9 Schematically shows a block diagram of a computer system of an electronic device for implementing the embodiments of the present application. The electronic device may be a navigation terminal 120 or a rotating zoom camera 130 as shown in Figure 1 the figure.

[0115] It should be noted that Figure 9 the computer system 900 of the electronic device shown is only an example, and should not bring any limitations to the functions and usage scopes of the embodiments of the present application.

[0116] As Figure 9 shown, the computer system 900 includes a central processing unit 901 (Central Processing Unit, CPU), which can perform various appropriate actions and processes according to the program stored in the read-only memory 902 (Read-Only Memory, ROM) or the program loaded from the storage section 908 into the random access memory 903 (Random Access Memory, RAM). In the random access memory 903, various programs and data required for system operation are also stored. The central processing unit 901, the read-only memory 902, and the random access memory 903 are connected to each other through a bus 904. The input / output interface 905 (Input / Output interface, that is, I / O interface) is also connected to the bus 904.

[0117] In some embodiments, the following components are connected to the input / output interface 905: an input section 906 including a keyboard, a mouse, etc.; an output section 907 including, for example, a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 908 including a hard disk, etc.; and a communication section 909 including a network interface card such as a local area network card, a modem, etc. The communication section 909 performs communication processing via a network such as the Internet. A drive 910 is also connected to the input / output interface 905 as needed. A removable medium 911, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 910 as needed so that a computer program read therefrom can be installed into the storage section 908 as needed.

[0118] Specifically, according to the embodiments of the present application, the processes described in each method flowchart can be implemented as computer software programs. For example, the embodiments of the present application include a computer program product that includes a computer program carried on a computer-readable medium, and the computer program includes program codes for performing the methods shown in the flowcharts. In such an embodiment, the computer program can be downloaded and installed from a network via the communication section 909, and / or installed from the removable medium 911. When the computer program is executed by the central processing unit 901, various functions defined in the system of the present application are executed.

[0119] It should be noted that the computer-readable medium shown in the embodiments of the present application can be a computer-readable signal medium, a computer-readable medium, or any combination of the two. The computer-readable medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above. More specific examples of the computer-readable medium can include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, the computer-readable medium can be any tangible medium that contains or stores a program, and this program can be used by or in combination with an instruction execution system, apparatus, or device. In the present application, the computer-readable signal medium can include a data signal propagated in a baseband or as part of a carrier wave, in which computer-readable program code is carried. Such a propagated data signal can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. The computer-readable signal medium can also be any computer-readable medium other than the computer-readable medium, and this computer-readable medium can send, propagate, or transmit a program for use by or in combination with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted by any appropriate medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0120] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagram can represent a module, a program segment, or a part of code, and the above module, program segment, or part of code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks can occur in a different order than that marked in the accompanying drawings. For example, two consecutive blocks shown can actually be executed substantially in parallel, and they can sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram or flowchart, and the combination of blocks in the block diagram or flowchart, can be implemented by a dedicated hardware-based system for performing the specified functions or operations, or can be implemented by a combination of dedicated hardware and computer instructions.

[0121] It should be noted that although several modules or units of the device for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiments of the present application, the features and functions of the two or more modules or units described above can be embodied in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided and embodied by multiple modules or units.

[0122] Through the description of the above embodiments, those skilled in the art can easily understand that the exemplary embodiments described herein can be implemented by software or by a combination of software and necessary hardware. Therefore, the technical solutions according to the embodiments of the present application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (such as a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on the network, including several instructions to enable an electronic device to execute the method according to the embodiments of the present application.

[0123] After considering the specification and practicing the invention disclosed herein, those skilled in the art will readily conceive of other embodiments of the present application. The present application is intended to cover any variations, uses, or adaptations of the present application, which follow the general principles of the present application and include known common knowledge or conventional technical means in the technical field not disclosed in the present application.

[0124] It should be understood that the present application is not limited to the exact structures described above and shown in the drawings, and various modifications and changes can be made without departing from its scope. The scope of the present application is only limited by the appended claims.

Claims

1. A polar coordinate contact interaction method based on a two-dimensional map and a rotating and zooming camera, characterized in that Including: Responding to a touch operation of a touch object on a two-dimensional navigation interface, obtaining a touch path, where the two-dimensional navigation interface includes a two-dimensional map and a field of view ray area; The navigation mode set for the two-dimensional navigation interface is a polar coordinate control mode; Analyzing the touch path to obtain a radial movement amount and an angular movement amount corresponding to the touch path; Zooming in or out on the two-dimensional map according to the radial movement amount, and rotating the field of view ray area according to the angular movement amount; Sending the radial movement amount and the angular movement amount to a pan-tilt-zoom camera, so that the pan-tilt-zoom camera adjusts parameters while zooming in or out on the two-dimensional map and rotating the field of view ray area, and photographing entities within the shooting range to obtain entity information corresponding to the entities, so as to render the two-dimensional navigation interface and the AR navigation interface according to the entity information.

2. The method according to claim 1, wherein The touch path includes an arc touch path and a straight touch path in the radial direction; The analyzing the touch path to obtain a radial movement amount and an angular movement amount corresponding to the touch path includes: When the touch path is the arc touch path, dividing the arc touch path into a plurality of touch line segments; Decomposing each of the touch line segments to obtain a radial component and an angular component corresponding to each of the touch line segments; Adding up the radial components corresponding to each of the touch line segments to obtain the radial movement amount, and adding up the angular components corresponding to each of the touch line segments to obtain the angular movement amount; and When the touch path is the straight touch path, taking the straight touch path as the radial movement amount corresponding to the straight touch path.

3. The method according to claim 1, characterized in that, The touch path is an arc touch path; The zooming in or out on the two-dimensional map according to the radial movement amount, and rotating the field of view ray area according to the angular movement amount includes: Obtaining a first movement direction and a second movement direction corresponding to the arc touch path; Taking the target vehicle as the origin, rotating the field of view ray area by the same angle along the first movement direction according to the angular movement amount, and at the same time magnifying or reducing the two-dimensional map according to the radial movement amount and the second movement direction.

4. The method according to claim 1, characterized in that, The touch path is a straight touch path; The zooming in or out on the two-dimensional map according to the radial movement amount, and rotating the field of view ray area according to the angular movement amount includes: Obtaining a third movement direction corresponding to the straight touch path; When the third movement direction points to the target vehicle, reducing the two-dimensional map according to the radial movement amount; When the third movement direction is away from the target vehicle, magnifying the two-dimensional map according to the radial movement amount.

5. The method according to claim 1, wherein The obtaining the entity information corresponding to the entity includes: Photographing the entities within the shooting range through the pan-tilt-zoom camera to obtain entity images; Performing image recognition on the entity images to obtain entity information corresponding to the entity images.

6. The method according to claim 5, wherein The performing image recognition on the entity images to obtain entity information corresponding to the entity images includes: Input the entity image into an image recognition model, and extract features from the entity image through the image recognition model to obtain logo information corresponding to the entity; Match the logo information with the logo information corresponding to each application program link in the database to obtain a target application program link corresponding to the logo information, and generate the entity information according to the logo information and the target application program link.

7. The method according to claim 5, characterized in that, A camera pitch angle adjustment control is provided in the two-dimensional navigation interface; When photographing an entity within the photographing range, the method further includes: In response to a trigger operation on the camera pitch angle adjustment control, adjust the pitch angle of the rotating zoom camera.

8. The method according to claim 6, wherein The rendering of the two-dimensional navigation interface and the AR navigation interface according to the entity information includes: Render in the AR navigation interface according to the entity information to form an AR navigation interface including a first identifier; Map the entity information in the AR navigation interface to the two-dimensional navigation interface to form a two-dimensional navigation interface including a second identifier; Wherein, both the first identifier and the second identifier are identifiers corresponding to the target application program link.

9. The method according to claim 8, wherein The method further includes: In response to a trigger operation on the second identifier, activate the target application program link, and display an operation interface corresponding to the target application program link on the display interface.

10. The method according to claim 1, characterized in that, The method further includes: When it is monitored that the target vehicle is in a stopped state, in response to an activation operation on the rotating zoom camera, activate the rotating zoom camera so that the rotating zoom camera sends an alarm message to the navigation terminal when an abnormal event is detected.

11. The method according to claim 1, wherein Before obtaining the touch path in response to a touch operation on the two-dimensional navigation interface, the method further includes: In response to a trigger operation on the polar coordinate navigation control, switch the navigation mode to the polar coordinate navigation mode, and display a two-dimensional navigation interface with polar coordinate operation identifiers on the display interface.

12. The polar coordinate contact interaction device based on a two-dimensional map and a rotation-zooming camera is characterized in that, Including: A path acquisition module, configured to obtain a touch path in response to a touch operation of a touch object on a two-dimensional navigation interface, where the two-dimensional navigation interface includes a two-dimensional map and a field of view ray area; the navigation mode set for the two-dimensional navigation interface is a polar coordinate control mode; A path parsing module, configured to parse the touch path to obtain a radial movement amount and an angular movement amount corresponding to the touch path; A processing module, configured to zoom the two-dimensional map according to the radial movement amount, and rotate the field of view ray area according to the angular movement amount; A rendering module, configured to send the radial movement amount and the angular movement amount to the rotating zoom camera, so that the rotating zoom camera adjusts parameters while zooming the two-dimensional map and rotating the field of view ray area, photograph an entity within the photographing range, obtain entity information corresponding to the entity, and render the two-dimensional navigation interface and the AR navigation interface according to the entity information.

13. A polar coordinate contact interaction system based on a two-dimensional map and a rotation-zooming camera, characterized in that, Including: A target vehicle; A rotating zoom camera, located on the target vehicle; A navigation terminal, connected to the rotatable zoom camera, is configured to obtain a touch path in response to a touch operation on a two-dimensional navigation interface, where the two-dimensional navigation interface includes a two-dimensional map and a field of view ray region; Parse the touch path to obtain a radial motion amount and an angular motion amount corresponding to the touch path; Zoom the two-dimensional map according to the radial motion amount and rotate the field of view ray region according to the angular motion amount; Send the radial motion amount and the angular motion amount to the rotatable zoom camera, so that the rotatable zoom camera adjusts parameters while zooming the two-dimensional map and rotating the field of view ray region, and captures an entity within the shooting range to obtain entity information corresponding to the entity, and render the two-dimensional navigation interface and the AR navigation interface according to the entity information.

14. A computer-readable medium having a computer program stored thereon, which when executed by a processor implements the polar coordinate contact interaction method based on a two-dimensional map and a rotatable zoom camera according to any one of claims 1 to 11.

15. An electronic device, characterized in that, Comprising: A processor; And A memory for storing executable instructions of the processor; Wherein, the processor is configured to execute the polar coordinate contact interaction method based on a two-dimensional map and a rotatable zoom camera according to any one of claims 1 to 11 by executing the executable instructions.

16. A computer program product, comprising a computer program carried on a computer-readable medium, characterized in that, The computer program, when executed by a processor, implements the polar coordinate contact interaction method based on a two-dimensional map and a rotatable zoom camera according to any one of claims 1 to 11.

Images