Parking position information providing system and method thereof

Abstract

Disclosed is a vehicle parking position information providing system including a vehicle including a vehicle control device that identifies parking position information of the vehicle, an image capturing device provided in the vehicle, and a position measuring device provided in the vehicle. The vehicle control device acquires image data obtained by capturing at least one exterior of the vehicle from the image capturing device, acquires position data from the position measuring device, acquires a plurality of image frames from the image data, acquires text information included in the plurality of image frames, and acquires parking position information in which the vehicle is parked based on the acquired text information and the acquired position data.

Description

[0001] Cross-reference to related applications

[0002] This application claims priority to Korean Patent Application No. 10-2025-0054141, filed on April 24, 2025, with the Korean Intellectual Property Office, the entire contents of which are incorporated herein by reference. Technical Field

[0003] This disclosure relates to an apparatus for providing vehicle parking location information, a system including the apparatus, and a method thereof, and more specifically, to a technique for providing vehicle parking location information based on text recognition. Background Technology

[0004] Many vehicle users often struggle to recall the exact location of their parked vehicles. This challenge is particularly pronounced in vast parking spaces such as shopping malls, airports, or complex urban parking facilities. Users typically rely on environmental information, including cues such as markers indicating floor numbers or specific location identifiers within the parking area. However, if users don't fully pay attention to these details when parking, they may struggle to remember their vehicle's location upon returning. This lack of awareness can lead to frustration and anxiety, especially when navigating sprawling parking complexes. In larger venues, the sheer scale and complexity of parking layouts can overwhelm even the most attentive users, exacerbating the problem. For example, users may leave a parking lot without a clear mental map of their vehicle's location. Recognizing these difficulties underscores the need for innovative solutions to assist users in navigating parking facilities.

[0005] For example, systems currently used by parking facility service providers separate parking location information from the user's ability to access it instantly. This limitation forces users to use additional equipment to determine their vehicle's location after parking. Therefore, locating vehicles in this way presents considerable inconvenience, especially in dynamic environments where users may be moving around within the parking lot.

[0006] Real-time tracking is more than just a convenience; it's crucial for enhancing the overall parking experience. Users are often frustrated by the inability to immediately access vital information about their vehicle's location. Being able to seamlessly check vehicle location as they move through the parking lot is becoming increasingly important.

[0007] To address these challenges, there is an urgent need for an improved parking location notification system. Such a system should enable users to easily identify the vehicle's location based on their current location, eliminating the need for cumbersome verification processes. Summary of the Invention

[0008] One aspect of this disclosure provides a system and method for providing parking location information, the system directly identifying the parking location information of a vehicle using image information.

[0009] One aspect of this disclosure provides a system and method for providing parking location information, the system identifying vehicle locations and providing notifications so that users can identify parking locations.

[0010] The technical problems to be solved by this disclosure are not limited to those described above, and any other technical problems not mentioned herein will be clearly understood by those skilled in the art from the following description.

[0011] According to one aspect of this disclosure, a vehicle parking location information providing system includes a vehicle, the vehicle including a vehicle control device for identifying the parking location information of the vehicle, an image capture device disposed in the vehicle, and a location measuring device disposed in the vehicle.

[0012] In one embodiment, the vehicle control device acquires image data obtained by capturing at least one exterior of the vehicle from the image capture device, acquires position data from the position measurement device, acquires multiple image frames from the image data, acquires text information included in the multiple image frames, and acquires parking position information of the vehicle based on the acquired text information and the acquired position data.

[0013] In one implementation, the vehicle control unit can send the acquired parking location information to a user device that operates in conjunction with the vehicle control unit.

[0014] In one implementation, the user equipment that operates in conjunction with the vehicle control unit may be a user equipment that operates in conjunction with a user profile stored in the vehicle control unit.

[0015] In one embodiment, the vehicle parking location information providing system also includes a display installed inside the vehicle.

[0016] In one implementation, the vehicle control unit displays a message including the acquired parking location information on a display.

[0017] In one implementation, the message including parking location information also includes a selection button for modifying the parking location information.

[0018] In one implementation, the parking location information includes the floor information where the vehicle is parked and the area information where the vehicle is parked.

[0019] In one embodiment, the vehicle control device obtains valid text information associated with at least one floor or area of ​​the parking lot from the text information, and obtains parking location information based on the valid text information and location data.

[0020] In one implementation, the vehicle control device excludes text information containing arrows from valid text information.

[0021] In one implementation, the vehicle control device acquires the vehicle's driving information and obtains valid text information based on the driving information, or acquires information about the type of parking lot where the vehicle is located and obtains valid text information based on the type information.

[0022] In one implementation, the vehicle control unit acquires text information based on an optical character recognition (OCR) model.

[0023] In one embodiment, the vehicle location information providing system also includes an illumination sensor.

[0024] In one implementation, the vehicle control unit activates the OCR model based on data acquired from the illuminance sensor.

[0025] In one implementation, the vehicle includes a gear selector for changing driving modes.

[0026] In one implementation, the vehicle control device uses a movement activation OCR model based on gear position.

[0027] In one implementation, the vehicle control device reverses the acquired image data when the gear is in parking mode, and acquires multiple image frames while reversing the image data.

[0028] In one implementation, the location data also includes time information.

[0029] In one implementation, the vehicle control unit matches location data with image data using timestamps.

[0030] In one embodiment, the vehicle control device acquires text information included in a predetermined number of consecutive image frames from a plurality of image frames, and determines whether the vehicle's position has changed based on the text information included in the predetermined number of consecutive image frames.

[0031] In one embodiment, the vehicle control device acquires position data corresponding to at least two of the multiple image frames, and determines whether the vehicle's position has changed during the time period based on the position data corresponding to the at least two image frames.

[0032] In one implementation, the vehicle control device obtains parking location information based on a determination result of whether the vehicle location has changed based on text information and a determination result of whether the vehicle location has changed based on location data.

[0033] According to one aspect of this disclosure, a parking position identification method performed by a vehicle control device included in a vehicle includes: acquiring image data obtained by capturing at least one exterior of the vehicle from an image capture device disposed in the vehicle; acquiring a plurality of image frames from the image data; acquiring text information included in the plurality of image frames; acquiring vehicle position data from a position measurement device disposed in the vehicle; and acquiring parking position information of the vehicle based on the acquired text information and position data.

[0034] In one embodiment, the method further includes sending the acquired parking location information to a user device that operates in conjunction with the vehicle control unit.

[0035] In one implementation, the user equipment that operates in conjunction with the vehicle control unit may be a user equipment that operates in conjunction with a user profile stored in the vehicle control unit.

[0036] In one embodiment, the method further includes displaying a message including the acquired parking location information via a display located in the vehicle.

[0037] In one implementation, the message including parking location information also includes a selection button for modifying the parking location information. Attached Figure Description

[0038] The above and other objects, features and advantages of this disclosure will become more apparent from the following detailed description taken in conjunction with the accompanying drawings:

[0039] Figure 1 This is a block diagram schematically illustrating a system for providing parking location information according to an embodiment of the present disclosure;

[0040] Figure 2 This conceptually illustrates a service provided by parking location information according to an embodiment of the present disclosure;

[0041] Figure 3 This is a flowchart schematically illustrating a vehicle parking location identification and notification process according to an embodiment of the present disclosure;

[0042] Figure 4 This is a flowchart conceptually illustrating an operational mechanism for identifying the parking location of a vehicle and providing parking location information according to an embodiment of the present disclosure;

[0043] Figure 5 This is a flowchart illustrating a method for providing parking location information of a vehicle according to an embodiment of the present disclosure;

[0044] Figure 6 This is a flowchart of a parking location identification method according to an embodiment of the present disclosure, which involves operating an identification model while driving;

[0045] Figure 7 This is a flowchart of a parking location identification method based on an embodiment of the present disclosure, which identifies a parking location if the identification model is operated after parking.

[0046] Figure 8 This is a flowchart of a method for identifying parking locations according to an embodiment;

[0047] Figure 9 It is a diagram used to describe the OCR results according to embodiments of the present disclosure;

[0048] Figure 10 This is a flowchart of a method for identifying the parking location of a vehicle according to an embodiment;

[0049] Figure 11 This is a flowchart of a method for identifying the parking location of a vehicle according to an embodiment;

[0050] Figure 12 Examples of interfaces for displaying parking location information on a user device according to embodiments of the present disclosure; and

[0051] Figure 13 A computing system according to an embodiment of the present disclosure is shown. Detailed Implementation

[0052] In the following, some embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. When adding reference numerals to the components in the figures, it should be noted that the same components include the same reference numerals even if shown in another figure. Furthermore, in describing embodiments of the present disclosure, detailed descriptions related to well-known functions or configurations will be omitted if they may unnecessarily obscure the subject matter of the disclosure.

[0053] In describing the elements of embodiments of this disclosure, terms such as first, second, A, B, (a), and (b) may be used herein. These terms are used only to distinguish one element from another, but do not limit the respective elements regardless of their nature, order, or priority. Furthermore, unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this disclosure pertains. It should be understood that unless expressly defined herein, terms used herein should be interpreted as having the meaning consistent with their meaning in the context of this disclosure and related fields, and should not be interpreted in an idealized or overly formal sense.

[0054] In precise positioning technologies, accuracy decreases in environments such as tunnels, multipath environments, and parking lots—areas where GPS sensors are not operating well—because dead reckoning (DR) predictions are used. In particular, altitude values ​​are less accurate and therefore difficult to use for determining floor levels. While pre-built maps or high-precision positioning techniques can be used to determine locations within parking lots, these are both expensive and time-consuming.

[0055] Optical Character Recognition (OCR) is a technology that extracts text from images or scanned documents and converts the text into digital text. OCR can be applied to exporting data or static images in standardized formats, such as document or barcode scans.

[0056] This disclosure relates to an apparatus / method for estimating the position of a vehicle based on image data and location data of the vehicle collected in real time using text recognition technology such as OCR, and providing parking location information so that users can easily locate the vehicle.

[0057] In the following text, reference will be made to Figures 1 to 13 The embodiments of this disclosure are described in detail.

[0058] Figure 1 This is a block diagram schematically illustrating a system for providing parking location information according to an embodiment of the present disclosure.

[0059] Reference Figure 1 The system for providing vehicle parking location information includes at least one of a vehicle control device 100, an image capture device 110, a position measurement device 120, or a user equipment 130.

[0060] The vehicle location information service provided in the vehicle location information provision system can be defined as: a service that provides parking location information, enabling vehicle users to directly identify and easily recognize the location of moving objects (such as vehicles) in environments where the location is difficult to determine, such as parking lots.

[0061] The vehicle control unit 100 includes a management unit located at the vehicle terminal and connected via an in-vehicle network (IVN). The IVN can be implemented via a controller area network (CAN), a media-oriented system transport (MOST) network, a local interconnection network (LIN), Ethernet, and / or FlexRay.

[0062] The vehicle control unit 100 acquires surrounding data for estimating the vehicle's position using multiple auxiliary devices installed on the vehicle (e.g., image capture device 110 or position measurement device 120), and can generate parking position information for the vehicle by processing the surrounding data. The vehicle control unit 100 samples images while playing back or reversing image data acquired from the image capture device 110, and performs text recognition using the sampled images. The vehicle control unit 100 can improve the accuracy of the estimated parking position information by using position data acquired from the position measurement device 120 in conjunction with acquired image data or video data.

[0063] Image capture device 110 refers to a device capable of collecting images of the vehicle's external environment, such as a black box or a camera used for autonomous driving, and transmitting the collected vehicle image data to vehicle control device 100. Figure 1 In this context, the image capture device 110 is represented as a separate device from the vehicle control device 100, but the image capture device 110 can also be implemented as integrated into the vehicle control device 100. The image capture device 110 can be implemented as a driver video recording system (DVRS), a rear-view camera, a front-view camera, etc.

[0064] The position measuring device 120 acquires position data and transmits the acquired position data to the vehicle control device 100. The position data includes various types of data used to identify the vehicle's position, such as precise positioning technology, map matching data, and points of interest (POIs).

[0065] exist Figure 1 In this context, the position measurement device 120 is represented as a separate device from the image capture device 110 and the vehicle control device 100, but it can also be implemented as an integrated device into the image capture device 110 or the vehicle control device 100. The position measurement device used to acquire the position of the vehicle control device can be implemented, for example, a Global Navigation Satellite System (GNSS) such as GPS, an Inertial Measurement Unit (IMU), a Real-Time Positioning System (RLTS), or a Digital Tachometer (DTG).

[0066] The vehicle control device 100 includes a memory 10, a processor 20, and a communication module 30.

[0067] The memory 10 can store software programmed for the processor 20 to perform predetermined operations. Furthermore, the memory 10 can store image data, position data, etc., acquired from the image capture device 110 or the position measurement device 120.

[0068] The memory 10 can be implemented as an embedded multimedia card (eMMC). The memory 10 can store system software, application software (such as navigation map software), and firmware.

[0069] The memory 10 can be implemented using at least one of the following storage media (recording media): flash memory, hard disk, secure digital card (SD card), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), programmable read-only memory (PROM), electrically erasable programmable ROM (EEPROM), erasable programmable ROM (EPROM), register, or removable disk. The memory 10 can store the configuration file of the user equipment 130 that operates in conjunction with the vehicle (or vehicle control unit 100). That is, user equipment operating in conjunction with the vehicle can mean user equipment operating in conjunction with the configuration file.

[0070] Processor 20 controls the overall operation of vehicle control device 100. Processor 20 can control the overall operation of the vehicle terminal and can be implemented using at least one of application-specific integrated circuit (ASIC), digital signal processor (DSP), programmable logic device (PLD), field-programmable gate array (FPGA), central processing unit (CPU), microcontroller, or microprocessor. Processor 20 can be manufactured in a package integrated with memory 10 (i.e., eMMC). Furthermore, processor 20 includes random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), programmable read-only memory (PROM), electrically erasable programmable ROM (EEPROM), erasable programmable ROM (EPROM), and / or registers.

[0071] Processor 20 can process image data and location data acquired from image capture device 110 and position measurement device 120, and can generate parking location information. Processor 20 can extract text included in image data or image data that is part of image data, and recognize the text. Processor 20 can select only valid text from the recognized text. Processor 20 can estimate the parking location of the vehicle by using the selected valid text and location data, and can generate parking location information.

[0072] The processor 20 displays the generated parking location information via a display (not shown). Furthermore, the processor 20 can allow the communication module 30 to send the generated parking location information to the user equipment 130, which operates in conjunction with the vehicle (or vehicle control unit 100).

[0073] The communication module 30 sends and receives data via the IVN. The communication module 30 communicates with auxiliary devices (such as the image capture device 110 and the position measuring device 120) via the IVN.

[0074] The communication module 30 exchanges data (information) with the user equipment 130 via wireless communication. Wireless communication technologies may include wireless LAN (WLAN) (Wi-Fi), wireless broadband (Wibro), LTE, International Mobile Telecommunications (IMT)-2020, Bluetooth, and / or Near Field Communication (NFC).

[0075] The communication module 30 includes an access point (AP) that serves as a bridge between the IVN and the wireless communication network, and a modem for accessing (connecting) the wireless communication network. The IVN can be implemented via a Controller Area Network (CAN), a Media-Oriented System Transport (MOST) network, a Local Interconnect Network (LIN), Ethernet, and / or Flexray.

[0076] Figure 2 This conceptually illustrates a service that provides parking location information according to an embodiment of the present disclosure.

[0077] Reference Figure 2 According to the implementation method, the vehicle control device (e.g.) Figure 1 The vehicle control unit 100 estimates the vehicle's parking position based on the vehicle's location data and image data acquired by the vehicle itself, and provides the parking position to user equipment operating in conjunction with the vehicle. Furthermore, the parking position can be displayed on a monitor installed in the vehicle, allowing the user to immediately identify the parking position through the vehicle they are using. For this purpose, the vehicle control unit can extract text included in the image data and select valid text indicating the parking area or parking level.

[0078] In this way, the vehicle parking location information service can operate in the vehicle embedded environment and improve parking convenience for users by estimating parking location using real-time text recognition information.

[0079] Figure 3 This is a flowchart schematically illustrating a vehicle parking location identification and notification process according to an embodiment of the present disclosure.

[0080] Reference Figure 3Image capture device 110 acquires images of the vehicle (S301) and can send the acquired images to vehicle control device 100 in real time, or send images or portions of images obtained by sampling the images to vehicle control device 100 (S303). Simultaneously, position measurement device 120 acquires vehicle position data and can send the acquired position data to vehicle control device 100 (S305). Vehicle control device 100 can analyze the images acquired from image capture device 110 (S307) and obtain parking position information (S309). Vehicle control device 100 can send the obtained parking position information to user device 130 (S311). User device 130 can provide the parking position information to the user in the form of a notification (S313), and due to this notification, the user can immediately identify the parking position information of the parked vehicle through their user device 130.

[0081] Figure 4 This is a flowchart that conceptually illustrates an operational mechanism for identifying the parking location of a vehicle and providing parking location information according to an embodiment of the present disclosure.

[0082] Reference Figure 4 Optical character recognition (OCR) models or methods used to identify the parking location of a vehicle can be implemented in a manner that operates during driving or after parking. Real-time operation during driving refers to real-time streaming from an image capture device (e.g., [image capture device name]). Figure 1 Image data acquired by the image capture device 110, and controlled by the vehicle control device (e.g., Figure 1 The vehicle control device 100 immediately performs recognition using the streamed image. The method of operating the recognition model after parking refers to reversing the playback of image data acquired from the image capture device and recognizing text from the played image.

[0083] The vehicle control unit acquires vehicle image data in real time and obtains text information within the driving environment using an OCR model that can be used in an embedded environment. The vehicle control unit recognizes the text using the OCR model; if text information is acquired, it selects valid text information from the acquired text, estimates the optimal parking position by fusing vehicle position data and valid text information, and obtains the parking position information. The vehicle control unit then provides the acquired parking position information to the user device.

[0084] Figure 5 This is a flowchart illustrating a method for providing parking location information of a vehicle according to an embodiment of the present disclosure.

[0085] Reference Figure 5 It shows the vehicle control unit (e.g.) Figure 1The vehicle control device 100 executes a method for providing parking position information of the vehicle. In the following description, the operation of the vehicle control device can be understood as being implemented by a processor.

[0086] In S510, the vehicle control unit acquires image data. The vehicle control unit acquires image data from an image capture device (e.g., a black box) installed in the vehicle. The image data can be an image captured by the black box, and can be one of the following: raw image data, sampled image data obtained by sampling the raw image data, or a sampled image. The image data includes image data corresponding to multiple frames.

[0087] In S520, the vehicle control unit identifies text included in the acquired image data based on the acquired image data. The text includes at least one of text or numbers. The operation of identifying text based on image data includes acquiring multiple images (or image frames) corresponding to multiple frames from the image data, extracting the corresponding text included in each of the multiple images or its associated objects, and identifying or classifying the extracted text or objects. In this process, each text or object is determined to correspond to a specific text, thereby acquiring text information.

[0088] A single image contains multiple texts. Therefore, the vehicle control device recognizes multiple texts for each image and acquires the recognized text information. For ease of description, at least one text message acquired from the first image can be referred to as the first text message, and at least one text message acquired from the second image can be referred to as the second text message.

[0089] The vehicle control unit recognizes combinations of text related to images. The vehicle control unit may be one or more pieces of text information included in one or more images, encompassing the concept of text combinations.

[0090] In S530, the vehicle control unit performs a validity determination on the recognized text. The vehicle control unit performs a validity determination on text information acquired from at least one image (or image frame).

[0091] The determination of validity can be applied to the methods of the various embodiments described below, but in addition to those mentioned, various methods for determining the validity of acquired text information can be applied to this disclosure.

[0092] In S540, the vehicle control unit acquires the vehicle's location data. For example, an image capture device, such as a black box, can support location positioning technology. For instance, the image capture device may include a Global Positioning System (GPS) module internally. The vehicle control unit acquires location data from the image capture device or a separate location measurement device. In some cases, the location measurement device can be integrated with the vehicle control unit.

[0093] In this implementation, the location data can be hourly location data. The location data includes multiple location data points acquired as the vehicle moves or real-time location data.

[0094] exist Figure 5 In this context, location data acquisition is described as occurring after S530, but the vehicle control unit acquires location data in real time, so location data is not limited to acquisition at a specific point in time.

[0095] In S550, the vehicle control unit obtains parking location information based on the validity determination result and location data. The vehicle control unit obtains valid text information from multiple text messages through validity determination. Valid text information may include text included in images captured in the area near the vehicle's parking space.

[0096] Parking location information refers to estimated information obtained by estimating the location where a user's vehicle is parked. For example, parking location information includes information about the floor on which the vehicle is estimated to be parked and information about the area where the vehicle is parked.

[0097] Vehicle control devices can improve the accuracy of vehicle parking location information by utilizing location data, as well as OCR and validity determination results.

[0098] The operation of obtaining parking location information based on validity determination results and location data includes: obtaining parking location information based on location data at a specific time point corresponding to valid text information obtained as a validity determination result. By utilizing location data obtained at the time point of capturing an image frame containing valid text information or at a time point adjacent to it, parking location information can be accurately calculated.

[0099] In S560, the vehicle control unit can send the acquired parking location information to user equipment that works in conjunction with the vehicle control unit. The user equipment receives the parking location information and displays a notification message indicating the parking location on a monitor.

[0100] This means that the vehicle control unit directly identifies the vehicle's parking location and notifies the user, allowing the user to identify the parking location through their own device without needing a separate device to find it. Therefore, it improves the user's accessibility to vehicle parking location information.

[0101] Figure 6 This is a flowchart of a parking location identification method according to an embodiment of the present disclosure, which identifies a parking location if the identification model is operated while driving.

[0102] Reference Figure 6 Vehicle control devices (e.g.) Figure 1The vehicle control device 100 activates the recognition model and performs OCR if certain requirements are met during driving. The following describes the case where the vehicle control device activates the recognition model from the point of entry into the parking lot. It is assumed that the vehicle receives vehicle image data in real time from the image capture device during driving. Furthermore, in the following description, the operation of the vehicle control device can be understood as being implemented by a processor.

[0103] In S610, the vehicle control unit activates the OCR model. If entry into a parking lot is detected, the vehicle control unit activates the OCR model. The vehicle control unit identifies entry into the parking lot based on whether precise positioning map matching fails if a destination POI exists, whether the entrance link matches, and / or whether the illuminance sensor data changes.

[0104] For example, an illuminance sensor can be installed inside the vehicle, and the vehicle control unit can activate an OCR model based on data obtained from the illuminance sensor.

[0105] If parking lot entry is detected, the vehicle control unit can trigger an OCR model operation or an OCR operation after the parking lot entry time, or trigger it after the time point when location estimation is required if text-based location estimation is needed. By activating the OCR model under specific conditions, resource utilization in the embedded environment can be minimized.

[0106] However, the vehicle is still moving even before the vehicle control unit activates the OCR model, so the vehicle control unit obtains real-time captured image data from the image capture device.

[0107] In S620, the vehicle control unit performs OCR based on OCR operation or OCR model triggering. The vehicle control unit can store OCR and vehicle location data from the time point of entry into the parking lot (hereinafter referred to as "parking lot entry time point"). The vehicle location data includes at least one of the vehicle's latitude, longitude, or altitude information.

[0108] The vehicle control unit performs OCR at regular intervals from the point of entry. For example, the vehicle control unit performs OCR using the acquired image data at regular intervals such as 300ms, and can store the vehicle's location data (latitude, longitude, and altitude values) for each frame. If the vehicle control unit performs OCR, it samples the image frames at regular intervals and performs OCR on the sampled image frames.

[0109] In S630, the vehicle control device performs a validity determination on the recognized text. In S640, the vehicle control device obtains parking location information based on the validity determination result and location data. Furthermore, vehicle operation can be performed by combining or modifying methods from other embodiments of this disclosure.

[0110] Meanwhile, users are likely to stop using resources after parking (for example, when a user puts the vehicle in the parking position), so methods that implement OCR models from the corresponding time points can be applied to achieve effective resource utilization.

[0111] Figure 7 This is a flowchart of a parking location identification method based on an embodiment of the present disclosure, which identifies a parking location if an operation identification model is used after parking.

[0112] Reference Figure 7 Vehicle control devices (e.g.) Figure 1 The vehicle control device 100 performs OCR on the image data using image data stored after parking. In the following description, the operation of the vehicle control device can be understood as being implemented by a processor.

[0113] In the S710, the vehicle control unit can pre-store the vehicle's position data. If it is difficult to estimate the vehicle's position through precise positioning (i.e., if it is determined that position estimation via an OCR model is necessary), the vehicle control unit can pre-store the vehicle's position data in the form of log information. This is called "position log information." The position data is stored along with time information. The memory can store position data such as latitude, longitude, and altitude, as well as a timestamp.

[0114] If the vehicle control unit detects entry into a parking lot, it can pre-store location data. The vehicle control unit identifies entry into the parking lot based on whether precise positioning map matching fails if a destination POI exists, whether the entrance link matches, and / or whether illumination sensor data changes. In this case, the vehicle is still moving, so the vehicle control unit acquires and stores real-time captured image data from the image capture device.

[0115] In S720, the vehicle control unit identifies that the vehicle is parked. The vehicle according to embodiments of this disclosure includes a gear for changing the driving mode (e.g., driving mode or parking mode). The vehicle control unit identifies the vehicle's parking state or parking mode based on the movement or position of the gear.

[0116] The vehicle control unit recognizes the operation of switching the gear to P (parking mode) and activates the OCR model.

[0117] The vehicle control unit activates the OCR model, and in S730, it reverse-plays the pre-stored image. The vehicle control unit can reverse-play the image data and also the location log information.

[0118] That is, the vehicle control device plays back the acquired image data in reverse when the gear is in parking mode.

[0119] In S740, the vehicle control unit matches timestamps with location log information and reverse-played image data. The vehicle control unit normalizes the timestamps between the image data and location log information, and matches the image data with the location data based on matching criteria. The vehicle control unit matches the location data with image frames of the image data based on the timestamps.

[0120] In S750, the vehicle control unit samples image data and position data. The vehicle control unit samples matched image data and matched position data based on timestamps. While replaying the image data and position data in reverse, the vehicle control unit performs data sampling. The vehicle control unit performs data sampling at regular intervals (or periods) (e.g., 300ms). The vehicle control unit samples the image data and acquires the position data corresponding to each time point that matches the sampled image data.

[0121] Unlike forward playback images played along the timeline, reverse playback scenes played in the opposite direction require sampling. In the case of real-time streaming forward playback images, images are naturally sampled to obtain vehicle position information at the corresponding time points. In the case of reverse playback images, if all images acquired from the image capture device are recognized, the recognition effect may decrease due to repeated recognition of continuous scenes. Therefore, sampling at specific time intervals and matching with the time points of the position information log are required. Image sampling is crucial because there is a time constraint from parking to termination of the embedded board.

[0122] In S760, the vehicle control unit performs OCR using sampled image data and determines the validity of the acquired text information. As a result of the validity determination, the vehicle control unit acquires valid text information and obtains location data corresponding to the time point corresponding to the valid text information from multiple location data corresponding to the sampling time point. The time point corresponding to the valid text information can mean the time point that corresponds to (or matches) the timestamp of the image data including the valid text information. The location data corresponding to the valid text information can be referred to as "valid location data".

[0123] In S770, the vehicle control unit acquires parking location information based on the validity determination result and valid location data. The vehicle control unit then sends the acquired parking location information to the user equipment.

[0124] Figure 8 This is a flowchart of a method for identifying the parking location of a vehicle according to an embodiment.

[0125] Reference Figure 8 Vehicle control devices (e.g.) Figure 1If the vehicle control unit 100 identifies the parking position, it can further utilize the travel distance information. In the following description, the operation of the vehicle control unit can be understood as being implemented by a processor.

[0126] In S810, the vehicle control unit acquires image data obtained from the image capture unit during driving. The vehicle control unit samples the acquired image data and then acquires the image data.

[0127] In S820, the vehicle control unit acquires driving information including at least one of the vehicle speed or driving time while driving. The vehicle control unit acquires driving information simultaneously with image sampling from image data.

[0128] In S830, the vehicle control unit acquires distance information based on driving information. The vehicle control unit acquires information about the distance the vehicle has traveled within a predetermined time.

[0129] In S840, the vehicle control device performs OCR and performs validity determination. If validity determination is performed, the vehicle control device can further utilize distance information. The vehicle control device obtains floor determination information by using the acquired distance information. The vehicle control device performs validity determination based on the floor determination information and the text information obtained through OCR. Furthermore, the validity determination method can be referred to other embodiments described in this disclosure.

[0130] In S850, the vehicle control unit acquires location information corresponding to the valid text information. In S860, the vehicle control unit acquires parking location information based on the location information and the valid text information. The location information corresponding to the valid text information may mean location information that matches the time of capturing an image frame including the corresponding text information.

[0131] In this way, during the process of sampling images from driving images to be input into the recognition model, the vehicle control unit can calculate a distance suitable for floor determination by using information such as vehicle speed and driving time, and can utilize the calculated distance in validity determination.

[0132] Figure 9 It is a diagram used to describe the OCR results according to embodiments of the present disclosure.

[0133] Figure 9 Image (a) shows an image of the interior of the parking lot if a vehicle enters the parking lot. Figure 9 (b) shows the result of performing OCR on the corresponding image in the vehicle control unit.

[0134] The vehicle can detect objects corresponding to the text by using the image in (a) in the form of bounding boxes (bboxes) and polygons.

[0135] The vehicle can calculate the recognition results (i.e., text information) that match the set shape and detected parts, as well as the objects or text detected by using the image of (a).

[0136] Vehicles can recognize text (such as letters), numbers, colors, and special text (arrows), and can express the recognition results.

[0137] To minimize capacity, the recognition results can be stored internally in the vehicle control unit in JSON format.

[0138] The method for determining vehicle validity will be described in detail below. (Refer to...) Figure 10 Vehicle control devices (e.g.) Figure 1 The vehicle control device 100 can select only valid data such as floor information or column information (or area information) after OCR.

[0139] The vehicle control unit acquires predefined character combinations of identification data (e.g.) Figure 5 (Text information). For example, a vehicle control unit may output text containing only numbers, text containing numbers and letters in sequence (e.g., letters or Korean letters), or text containing letters and numbers in sequence.

[0140] The vehicle control unit determines whether the acquired text combination contains text next to an arrow and excludes such text. A floor next to an arrow likely indicates the next floor, so the vehicle control unit performs a classification process to exclude that floor from the valid text.

[0141] The vehicle control unit performs validity checks using regular expressions.

[0142] To identify the format of a numeric expression (i.e., to check if it is a single number, a combination of numbers and letters, and whether it includes arrows), the following regular expression can be applied.

[0143] [Expression 1]

[0144] ^[\p{L}\p{N}]+$

[0145] To determine whether to include text related to parking floors, the vehicle control unit can use the following regular expression.

[0146] [Expression 2]

[0147] ^[BMGFLP intermediate layer]$

[0148] To select only numbers within a specific range (e.g., from -9 to 9 if the number of parking floors is estimated to be less than 10), the vehicle control unit can utilize the following regular expression.

[0149] [Expression 3]

[0150] ^-?[\p{Nd}&&[^0]]$

[0151] As described above, based on detailed logic, only floor information can be effectively selected from the identified data. The expected regular expression is to include all parking lot types.

[0152] According to the implementation method, the vehicle control device can apply weights when selecting information. The vehicle control device can assign weights to meaningful information based on whether the text is detected repeatedly, whether the text is located in a specific location (e.g., a pillar or ceiling sign), and other information identified together. Therefore, weights can be used for validity determination. The validity determination operation includes calculating a weight for each piece of acquired text information, and determining validity based on the weights.

[0153] Figure 10 This is a flowchart of a method for identifying the parking location of a vehicle according to an embodiment.

[0154] According to an implementation, a vehicle control device (e.g.) Figure 1 The vehicle control device 100 can utilize additional information associated with the type of each parking building to improve the accuracy of parking floor and column determination and assist in functionality. For this purpose, the additional information can be pre-built.

[0155] In S1010, the vehicle control unit obtains information about the type of parking lot the vehicle is in. If the vehicle enters a parking lot, the vehicle control unit obtains information about the parking lot type by parsing pre-loaded data, and can use this information when determining the appropriate information.

[0156] In parking lots where the parking lot type is not loaded, the vehicle control unit can upload the identified data to an external server.

[0157] After performing OCR based on image data in S1020, the vehicle control device acquires text information and performs validity determination in S1030.

[0158] In S1040, the vehicle control device obtains floor information and / or pillar information from valid data using information about the parking lot type. The vehicle control device obtains or categorizes floor information and / or pillar information from text information based on a predefined display method depending on the information about the parking lot type. Hereinafter, for the purpose of understanding this disclosure, this is referred to as "pillar information." However, pillar information can be identification information provided by the parking operator for identifying parking areas and can also be referred to as "zone information." If the information used by a vehicle user to identify the vertical position of a vehicle is referred to as "floor information," then the information used by a vehicle user to identify the horizontal position of a vehicle within a floor can be represented as pillar information or zone information.

[0159] In S1050, the vehicle control unit acquires location data corresponding to the text information. The location data corresponding to the text information can be obtained by matching acquired floor information and / or acquired column information with acquired image frames based on timestamps.

[0160] In S1060, the vehicle control device obtains the vehicle's parking position information based on the acquired floor information and / or acquired column information and the vehicle's position data.

[0161] The vehicle control unit can combine or fuse location data with floor information and / or column information. Then, the vehicle control unit obtains parking location information based on the combined data.

[0162] Floor information and / or column information can be effectively used to improve the accuracy of parking location information.

[0163] For example, refer to again Figure 9 The text information can be recognized; the actual floor number can be M1F, but column information such as B2 can also be entered. Figure 9 In the image shown in (a), B2 represents the column information. However, in some cases, depending on the parking type, the second basement level is represented by B2, making it difficult to identify whether the information indicates a parking floor or a parking column based solely on the text information (B2).

[0164] In addition, Figure 9 In diagram (a), the floor number is M1F, indicating a mezzanine. However, if it is unknown whether a mezzanine exists in a particular building, the vehicle control unit may incorrectly identify M1F as 1F. Furthermore, depending on the characteristics of the parking lot, the markings for above-ground and underground floors may differ. For example, if there is a lobby, expressions such as G / M / L can be used. Basements can be represented as -1, B1, 1F, etc.

[0165] To assist in this situation, information about building types can be established in advance and used as a determining factor to identify the data to be adopted and utilized in the information collected in real time.

[0166] A database (DB) for parking lot types can be created as follows.

[0167] Information about parking lot types can be optimized / minimized by adding each piece of information as a DB attribute. If the DB attribute information is determined, the methods for minimizing and storing the information can be utilized as follows.

[0168] The display method for "parking floors" is predefined. Depending on whether there is a mezzanine, the mezzanine can be represented by "M", JUNG (meaning middle in Korean) or "X", and the parking floor can be represented as the first floor, B2 floor, etc.

[0169] For example, if a mezzanine exists, "MB0" is used. It is displayed as "M", and parking levels are displayed in the format "B + number".

[0170] If there is no "mezzanine", then use floor X0. This is the case where parking floors are displayed in the format of "number + 'floor'".

[0171] "Parking bollard" indicates the presence of bollard information. Additionally, display methods such as zone display methods are predefined.

[0172] "X" indicates that there is no column information.

[0173] Types containing only numbers are displayed as "O"; types containing "text + number" are displayed as "A0"; and types containing "number + text" are displayed as "OA".

[0174] The parking lot attribute expression is expected to include all parking lot types.

[0175] If the vehicle control unit enters a parking lot, it parses pre-loaded data to obtain the parking lot type and uses this information for real-time information determination. The vehicle control unit uploads the identified data to the server of a parking lot whose parking lot type is not yet loaded, and then loads new DB attribute information based on the subsequently loaded large dataset. After providing functionality through internal judgment logic, the vehicle control unit can identify the floor / column type based on user feedback used to determine the correctness of the answer.

[0176] Figure 11 This is a flowchart of a method for identifying the parking location of a vehicle according to an embodiment.

[0177] Reference Figure 11 Vehicle control devices (e.g.) Figure 1The vehicle control device 100 selects an image frame for identifying the parking position of the vehicle, and if a corresponding image frame is selected, vehicle position data sampled together can be used. The vehicle control device can extract vehicle position information associated with text (e.g., floor information and / or pillar information) extracted from each image frame, according to the above embodiment.

[0178] In S1110, the vehicle control unit acquires image data from an external image capture device and uses the image data acquired in S1110 to acquire multiple image frames included in the acquired image data. For example, the vehicle control unit acquires multiple image frames sampled at regular intervals.

[0179] In S1120, the vehicle control unit acquires multiple pieces of position data that serve as position data during image data capture. The vehicle control unit samples the vehicle position data acquired while sampling multiple image frames. Each piece of vehicle position data can indicate the vehicle position at each time point in the capture of the multiple image frames.

[0180] In S1130, the vehicle control unit identifies text included in multiple image frames using multiple image frames. The vehicle control unit can extract the text included in the multiple image frames, identify the extracted text, and obtain the text information in a device-recognizable form.

[0181] In S1140, the vehicle control unit extracts valid text information from the acquired text information. The vehicle control unit can extract valid text information from text information acquired from multiple image frames acquired while the vehicle is moving.

[0182] If valid text information is extracted, the vehicle control unit excludes text information (or text information including arrows) from the acquired text information, and can select text information consisting of combinations of numbers only and combinations of letters and numbers.

[0183] Alternatively, valid text information can be associated with floor and / or column information. Valid text information includes at least one valid text message. For example, when a vehicle moves from floor B2 to floor B3, the valid text information acquired could include both B2 and B3. Vehicle control information can categorize the acquired valid text information into floor and / or column information.

[0184] In S1150, the vehicle control device acquires at least one valid location data corresponding to at least one valid text information.

[0185] According to the implementation method, the vehicle control information acquires image frame information from which valid text information is extracted, and acquires position data sampled together when the extracted image frames are sampled.

[0186] If multiple valid text messages exist, the vehicle control information acquires multiple image frame messages and obtains multiple location data samples along with the extracted image frames.

[0187] For example, if first valid text information is obtained in a first image frame acquired at a first time point, and second valid text information is obtained in a second image frame acquired at a second time point, then the vehicle control device obtains first position data at the first time point when the first image frame is sampled, and second position data at the second time point when the second image frame is sampled.

[0188] In S1160, the vehicle control unit determines whether the vehicle's position has changed based on multiple valid text messages. The vehicle control unit determines whether the valid text messages have changed.

[0189] According to the implementation method, the vehicle control device determines whether there is a floor change and / or a column change based on multiple valid text information. Based on the valid text information, the vehicle control device determines whether there is a floor change and whether there is a column change. Alternatively, the vehicle control device may first determine whether there is a column change, and then determine whether there is a floor change. The vehicle control device determines whether there is a change in the vehicle's position based on text information acquired during a specific time period or a specific frame.

[0190] In S1170, the vehicle control unit determines whether there is a change in position based on position data.

[0191] For example, in the case of floors, if the vehicle changes from floor B2 to floor B3, the vehicle control unit determines whether the vehicle's height information (or height value) has changed. And in the case of pillars, if the vehicle changes from pillar A1 to pillar A13, the vehicle control unit determines whether the vehicle's latitude and longitude information have actually changed physically.

[0192] The vehicle control unit determines whether there is a change in location (floor change and / or column change) based on location data during a specific time period or frame.

[0193] For ease of description, the identification of position change in S1160 can be referred to as the first position change identification operation. The identification of position change in S1170 can be referred to as the second position change identification operation.

[0194] In S1180, the vehicle control unit determines the final floor based on the position change recognition result. If the position change recognition result based on the floor information in the valid text information indicates that the floor information has not changed, the vehicle control unit determines whether the position change (e.g., a difference in height value) meets a first threshold based on the position data. If the difference in height value does not meet the first threshold (e.g., 1m) (e.g., if it is less than the first threshold, or less than or equal to the first threshold), the vehicle control unit determines the corresponding floor as the final floor. The accuracy of GPS sensor values ​​may be affected in underground spaces, therefore the first threshold can be used.

[0195] If the floor information in the valid text information changes (i.e., if different floor information is continuously identified according to OCR), the vehicle control unit determines whether the difference in height values ​​meets a second threshold based on the location data. If the difference in height values ​​meets the second threshold (e.g., if it is greater than or equal to the second threshold), the vehicle control unit determines that the floor has actually changed. The second threshold can be greater than the first threshold. Assuming the height difference between parking lots is approximately 3m, considering the range of sensor error values, the second threshold can be set to approximately 1.5m. These parameters can be set differently depending on the design.

[0196] If the same floor information is repeated a specific number of times, the vehicle control unit determines the corresponding floor as the final floor. If, based on the floor information in the valid text information, the floor information of five consecutive frames is consecutively identical, and based on the position data, the height difference of the five frames is less than a first threshold, the vehicle control unit determines the corresponding floor as the final floor.

[0197] For example, suppose we obtain the first frame, the second frame, the third frame, the fourth frame, and the fifth frame from image data, and for each frame in the corresponding frame, we obtain the first text-based location information, the second text-based location information, the third text-based location information, the fourth text-based location information, and the fifth text-based location information from the valid text information as floor information.

[0198] Furthermore, assuming the position data is used as the position data for each of the first, second, third, fourth, and fifth frames, the first position data, second position data, third position data, fourth position data, and fifth position data are obtained.

[0199] If the first to fifth text-based location information obtained are all the same to each other, and the height difference between the first location data and the fifth location data is less than a first threshold, then the floor indicated by the first to fifth text-based location information can be determined as the final floor.

[0200] Specifically, the vehicle control device acquires text information included in a predetermined number of consecutive image frames from multiple image frames, and determines whether the vehicle's position has changed based on the text information included in the predetermined number of consecutive image frames. The vehicle control device acquires position data corresponding to at least two image frames from the multiple image frames, and determines whether the position has changed based on the position data corresponding to the at least two image frames. The vehicle control device obtains parking position information based on the determination result of whether the vehicle's position has changed based on text information and the determination result of whether the vehicle's position has changed based on position data.

[0201] Despite Figure 11 The parking pillars (or parking areas) are not shown in the diagram, but the vehicle control unit determines them using the method described above. If, when the vehicle control unit determines pillar maintenance and pillar changes, the same information as the pillar information is repeated a predetermined number of times (e.g., 5 times), the vehicle control unit determines the corresponding pillar as the final area. If, based on the pillar information in the valid text information, the pillar information in five consecutive frames is consecutively identical to each other, and based on the location data, the difference in latitude and longitude between the five frames is less than a third threshold, the vehicle control unit determines the corresponding pillar as the final area.

[0202] For example, suppose we obtain the first frame, the second frame, the third frame, the fourth frame, and the fifth frame from image data, and for each frame in the corresponding frame, we obtain the first text-based pillar information, the second text-based pillar information, the third text-based pillar information, the fourth text-based pillar information, and the fifth text-based pillar information from the valid text information as pillar information.

[0203] Furthermore, assuming the position data is used as the position data for each of the first, second, third, fourth, and fifth frames, the first position data, second position data, third position data, fourth position data, and fifth position data are obtained.

[0204] If the first to fifth text-based pillar information obtained are all identical to each other, and the longitude and / or latitude difference between the first and fifth location data is less than the third threshold, then the pillar indicated by the first to fifth text-based pillar information can be identified as the final area.

[0205] In S1180, the vehicle control unit can obtain parking location information based on the location change recognition result. The parking location information includes floor information identified as the final floor and area information identified as the final area. The vehicle control unit can then send the acquired parking location information to user equipment operating in conjunction with it.

[0206] Figure 12 This is an example of an interface for displaying parking location information on a user device according to embodiments of the present disclosure.

[0207] Reference Figure 12 User equipment (e.g.) Figure 1 The user device 130 displays a notification message providing parking location information on its display. The notification message may be displayed as a pop-up message on the application screen associated with the vehicle.

[0208] The vehicle's application screen includes information about the vehicle the user owns.

[0209] Alternatively, the notification message can be displayed as a pop-up message on the user's active screen.

[0210] The vehicle control unit can also display notification messages providing parking location information via a display included in the vehicle and electrically or communicatively connected to the vehicle control unit. For example, the vehicle control unit displays the notification message as a pop-up message on a screen displayed on a monitor (such as the vehicle's navigation screen).

[0211] In addition, to verify the accuracy of the information provided and to provide users with more accurate information, the vehicle control device or user equipment (or the application installed on it) that works in conjunction with the vehicle control device can additionally provide the function of querying (saving or modifying information) whether the provided parking location is correct.

[0212] For example, the vehicle control unit displays a pop-up screen including a notification message with parking location information. The pop-up screen also includes a selection button for saving or modifying the parking location information.

[0213] For example, a pop-up screen displayed on the vehicle control unit or user device includes a message such as "The vehicle is currently parked in area B2F of A1 zone", and below the message also includes a selection button for "Save" and / or a selection button for "Modify Information".

[0214] According to the various embodiments disclosed in the specification, as a service for parking location information, the vehicle control device allows a single vehicle to acquire driving environment information through an image recognition model in an embedded environment, and performs optimal location estimation by fusing only useful information with location data.

[0215] Vehicle control devices can apply OCR models to secure text information in the vehicle's driving environment. According to embodiments of this disclosure, the vehicle control device can obtain text information by considering scenarios where the OCR model can be effectively operated under specific conditions, taking into account memory constraints.

[0216] Furthermore, the vehicle control unit can also acquire text information through processing following user operations with minimal resource utilization (e.g., after parking). The vehicle control unit can select only valid data from the text information and derive the optimal location estimate by fusing the selected text information with vehicle location data. Additionally, to ensure the accuracy of location information estimation in a parking environment, the parking lot type can be additionally loaded, providing accurate information to the customer.

[0217] Thus, according to embodiments of this disclosure, the vehicle control device can correct its position by using text information and further utilizing location information in various environments with low positioning accuracy, such as parking lots, tunnels, and multipaths. Furthermore, according to embodiments of this disclosure, even without a precise map of the parking lot, the parking location of any arbitrary parking lot (an area where the user has not driven the vehicle, such as a newly built parking lot) can be identified. According to embodiments of this disclosure, the vehicle control device can provide a notification of the identified parking location to the driver who has finished driving via a mobile phone, thereby helping the driver who wants to use the vehicle again to find the vehicle.

[0218] Figure 13 A computing system according to an embodiment of the present disclosure is shown.

[0219] Reference Figure 13 The computing system 2000 includes at least one processor 2100, memory 2300, user interface input device 2400, user interface output device 2500, storage device 2600 and network interface 2700, which are connected to each other via bus 2200.

[0220] Processor 2100 may be a central processing unit (CPU) or a semiconductor device that processes instructions stored in memory 2300 and / or storage device 2600. Each of memory 2300 and storage device 2600 includes various types of volatile or non-volatile storage media. For example, memory 2300 includes read-only memory (ROM) and random access memory (RAM).

[0221] Therefore, the operation of the methods or algorithms described in conjunction with the embodiments of this disclosure can be directly implemented by hardware modules, software modules, or a combination of hardware modules and software modules executed by processor 2100. Software modules can reside on storage media (i.e., memory 2300 and / or storage device 2600), such as random access memory (RAM), flash memory, read-only memory (ROM), erasable programmable ROM (EPROM), electrically EPROM (EEPROM), registers, hard disks, removable disks, or optical disc read-only memory (CD-ROM).

[0222] The storage medium can be coupled to the processor 2100. The processor 2100 can read information from the storage medium and write information to the storage medium. Alternatively, the storage medium can be integrated with the processor 2100. The processor and storage medium can be implemented in an application-specific integrated circuit (ASIC). The ASIC can be located in the user terminal. Alternatively, the processor and storage medium can be implemented as separate components in the user terminal.

[0223] The above description is merely an example of the technical concept of this disclosure, and those skilled in the art can make various modifications and changes without departing from the basic features of this disclosure.

[0224] Therefore, the embodiments of this disclosure are intended to explain the technical concept of this disclosure, not to limit it, and the scope and spirit of this disclosure are not limited to the above embodiments. The scope of protection of this disclosure should be interpreted by the appended claims, and all its equivalents should be interpreted as being included within the scope of this disclosure.

[0225] According to embodiments of this disclosure, accurate location information can be provided by using text information in various environments with low positioning accuracy, such as parking lots, tunnels, and multipaths.

[0226] According to embodiments of this disclosure, vehicle parking location information can be provided directly and immediately to vehicle users through data transmission between the vehicle and the vehicle user.

[0227] According to embodiments of this disclosure, a notification path can be formed so that vehicle users can identify vehicle parking location information without a special identification process for identifying the parking location when the vehicle is parked, thereby providing vehicle users with an improved parking experience.

[0228] In addition, various effects can be provided directly or indirectly through this disclosure.

[0229] In addition, although this disclosure has been described with reference to exemplary embodiments and drawings, this disclosure is not limited thereto, and various modifications and changes can be made by those skilled in the art without departing from the spirit and scope of this disclosure as claimed in the appended claims.

Claims

1. A vehicle parking location information providing system, the system comprising: The vehicle includes: a vehicle control device configured to identify parking location information of the vehicle; An image capture device installed in the vehicle; and Position measuring device installed in the vehicle. The vehicle control device is configured as follows: Image data obtained from at least one exterior of the vehicle by the image capturing device; Acquire position data from the position measuring device; Multiple image frames are obtained from the image data; Obtain the text information included in the plurality of image frames; and Based on the acquired text information and location data, the parking location information of the vehicle is obtained.

2. The system of claim 1, wherein the vehicle control device is configured to: The acquired parking location information is sent to the user equipment that operates in conjunction with the vehicle control device.

3. The system of claim 2, wherein the user equipment operating in conjunction with the vehicle control device is a user equipment operating in conjunction with a user profile stored in the vehicle control device.

4. The system according to claim 1, further comprising: Displays installed inside the vehicle The vehicle control device is configured as follows: The display shows a message including the acquired parking location information.

5. The system according to claim 4, wherein the message including the parking location information further includes a selection button for modifying the parking location information.

6. The system according to claim 1, wherein the parking location information includes the floor information where the vehicle is parked and the area information where the vehicle is parked.

7. The system of claim 1, wherein the vehicle control device is configured to: Obtain valid text information from the text information that is associated with at least one floor of the parking lot or one area of ​​the parking lot; and Based on the valid text information and the location data, the parking location information is obtained.

8. The system of claim 7, wherein the vehicle control device is configured to: In the text information, text information including arrows is excluded from the valid text information.

9. The system of claim 7, wherein the vehicle control device is configured to: Obtain the vehicle's driving information, and obtain the valid text information based on the driving information; or Obtain information about the type of parking lot where the vehicle is located, and obtain the valid text information based on the type information.

10. The system of claim 1, wherein the vehicle control device is configured to: The text information is obtained based on an optical character recognition (OCR) model.

11. The system of claim 10, further comprising: Illumination sensor installed inside the vehicle The vehicle control device is configured as follows: The OCR model is activated based on the data obtained from the illuminance sensor.

12. The system of claim 10, wherein the vehicle includes a gear for changing driving modes, and wherein the vehicle control device is configured to: The OCR model is activated based on the movement of the gear position.

13. The system of claim 12, wherein the vehicle control device is configured to: The acquired image data is played back in reverse when the gear is in parking mode; and Multiple image frames are acquired when the image data is played in reverse.

14. The system of claim 1, wherein the location data further includes time information, and wherein the vehicle control device is configured to: The location data is matched with the image data using timestamps.

15. The system of claim 1, wherein the vehicle control device is configured to: The text information included in a predetermined number of consecutive image frames from the plurality of image frames is obtained, and the position of the vehicle is determined based on the text information included in the predetermined number of consecutive image frames. Obtain position data corresponding to at least two of the plurality of image frames, and determine whether the position of the vehicle has changed based on the position data corresponding to the at least two image frames; as well as The parking location information is obtained based on the determination result of whether the vehicle's location has changed based on the text information and the determination result of whether the vehicle's location has changed based on the location data.

16. A parking position recognition method performed by a vehicle control device included in a vehicle, the method comprising the following steps: Image data obtained by capturing at least one exterior of the vehicle is acquired from an image capture device installed in the vehicle; Multiple image frames are obtained from the image data; Obtain the text information included in the multiple image frames; The vehicle's position data is obtained from a position measuring device installed in the vehicle; as well as Based on the acquired text information and the location data, the parking location information of the vehicle is obtained.

17. The method of claim 16, further comprising the step of: The acquired parking location information is sent to the user equipment that operates in conjunction with the vehicle control device.

18. The method of claim 17, wherein the user equipment operating in conjunction with the vehicle control device is a user equipment operating in conjunction with a user profile stored in the vehicle control device.

19. The method of claim 16, further comprising the step of: The message, including the acquired parking location information, is displayed on a monitor installed in the vehicle.

20. The method of claim 19, wherein the message including the parking location information further includes a selection button for modifying the parking location information.

Images