System for providing pickup service by using vehicle

Abstract

Provided is a system for providing a pickup service by using a vehicle, the system comprising: a user terminal for outputting a pickup request event; a pickup terminal which is connected to the user terminal for a pickup service, and which generates a route with the location of the user terminal as a destination and outputs same to a navigation device if the pickup request event is received from the user terminal; and a pickup service provision server including a registration unit, which stores the user terminal and the pickup terminal to be mapped if connection for a pickup service is requested from the user terminal and the pickup terminal, a reception unit, which receives the pickup request event from the user terminal, a route generation unit, which generates the route with the location of the pickup terminal as a starting point and the location of the user terminal as the destination while transmitting the pickup request event of the user terminal to the pickup terminal, and a route guidance unit for outputting the generated route from the pickup terminal to the navigation device.

Description

Vehicle pickup service system

[0001] The present invention relates to a system for providing a pickup service using a vehicle, and provides a system that sets the location of a user terminal as a destination when a pickup request event is output, performs route guidance at a pickup terminal, and enables the user terminal to determine the distance and direction between pickup terminals.

[0002] As school bus accidents continue to occur annually, concerns are growing. Student safety is paramount during commutes and drop-offs. However, existing school bus systems struggle to accommodate large student populations, making it difficult to adapt to individual circumstances. Furthermore, boarding and drop-off times often vary, hindering flexibility. Furthermore, for students traveling long distances to and from school, the long commutes make it difficult to manage their physical condition and time, further increasing parental concerns about their children's safety. Therefore, a system that not only ensures the safety and comfort of students but also efficiently manages their time and condition is essential.

[0003] At this time, a method of guiding a route or sharing the other party's location information in real time when picking up the other party using a vehicle was studied and developed. In relation to this, prior art Korean Patent Registration No. 10-1554139 (announced on September 18, 2015) and Korean Patent Publication No. 2018-0089087 (published on August 8, 2018) disclose a configuration in which a pickup terminal sets the other party's current location as a destination, searches for a movement route and a recommended stopping location to the destination by reflecting traffic information, and provides guidance by setting the searched movement route and recommended stopping location, and a configuration in which, when a pickup request is received from a user terminal, a pickup vehicle is placed at the location where the pickup request occurred, and when movement information of the user terminal is received, a corrected location is transmitted to the pickup vehicle based on the movement information, respectively.

[0004] However, in both the former and latter cases, while the pickup terminal can identify the other party's location, the other party cannot identify the pickup vehicle's location. In various situations, such as picking up someone at the airport, picking up a child from an academy or school, or picking up someone at a meeting place, vehicles and people must meet. Drivers must be vigilant against traffic congestion and illegal parking, while also keeping a close eye on their child or other person in the crowd. This can lead to not only traffic congestion but also the risk of traffic accidents. Therefore, research and development of solutions that enable people and pickup vehicles to quickly find and meet each other is needed.

[0005] One embodiment of the present invention provides a system for providing a pickup service using a vehicle, which stores the location of a user terminal and a pickup terminal so as to be mapped, and when a pickup request event is output from the user terminal, transmits the location of the user terminal to the pickup terminal and generates a route with the location as a destination, and guides the user to drive along the route from the pickup terminal, while guiding the pickup terminal to determine the distance and direction from the user terminal and the user terminal to determine the distance and direction from the pickup terminal, thereby enabling the user to quickly find each other and quickly pick up and depart without causing traffic congestion, and helps to quickly detect the user without obstructing the driver's view by finding the user using an object recognition algorithm and outputting the information on a head-up display. However, the technical problem to be achieved by the present embodiment is not limited to the technical problem described above, and other technical problems may exist.

[0006] As a technical means for achieving the above-described technical task, one embodiment of the present invention includes a pickup service providing server including a user terminal that outputs a pickup request event, a pickup terminal that is connected to the user terminal for a pickup service and, when a pickup request event is received from the user terminal, generates a route with the location of the user terminal as a destination and outputs the route to a navigation system, a registration unit that stores the user terminal and the pickup terminal so that they are mapped when a connection is requested from the user terminal and the pickup terminal for a pickup service, a receiving unit that receives a pickup request event from the user terminal, a route generating unit that generates a route with the location of the pickup terminal as a starting point and the location of the user terminal as a destination while transmitting the pickup request event of the user terminal to the pickup terminal, and a route guidance unit that outputs the generated route to a navigation system from the pickup terminal.

[0007] According to any one of the problem solving means of the present invention described above, a user terminal and a pickup terminal are connected and stored so as to be mapped, and when a pickup request event is output from the user terminal, the location of the user terminal is transmitted to the pickup terminal and a route with the location as a destination is generated, and while guiding driving along the route from the pickup terminal, the pickup terminal is guided to determine the distance and direction from the user terminal, and the user terminal is guided to determine the distance and direction from the pickup terminal, thereby enabling quick finding of each other and quick pickup and departure without causing traffic congestion, and by using an object recognition algorithm to find the user and outputting it on a head-up display, it is possible to help quickly detect the user without obstructing the driver's view.

[0008] FIG. 1 is a drawing for explaining a system for providing a pickup service using a vehicle according to one embodiment of the present invention.

[0009] FIG. 2 is a block diagram illustrating a pickup service providing server included in the system of FIG. 1.

[0010] FIG. 3 and FIG. 4 are drawings for explaining an embodiment in which a pickup service using a vehicle according to one embodiment of the present invention is implemented.

[0011] FIG. 5 is a flowchart illustrating a method for providing a pickup service using a vehicle according to one embodiment of the present invention.

[0012] Below, with reference to the attached drawings, embodiments of the present invention are described in detail so that those skilled in the art can easily implement them. However, the present invention may be implemented in various different forms and is not limited to the embodiments described herein. In the drawings, irrelevant parts have been omitted for clarity of description, and similar reference numerals have been used throughout the specification to indicate similar elements.

[0013] Throughout the specification, when a part is said to be "connected" to another part, this includes not only the case where it is "directly connected" but also the case where it is "electrically connected" with another element in between. Furthermore, when a part is said to "include" a component, this should be understood to mean that, unless specifically stated to the contrary, it may include other components rather than excluding them, and does not preclude the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0014] The terms "about," "substantially," and the like used throughout the specification are used in a sense of degree or in a sense close to the numerical value when manufacturing and material tolerances inherent to the meanings mentioned are presented, and are used to prevent unscrupulous infringers from unfairly exploiting disclosures that mention precise or absolute numerical values ​​to aid understanding of the present invention. The terms "step of doing" or "step of" used throughout the specification of the present invention do not mean "step for doing."

[0015] In this specification, the term "unit" includes a unit realized by hardware, a unit realized by software, and a unit realized using both. In addition, one unit may be realized by using two or more pieces of hardware, and two or more units may be realized by one piece of hardware. Meanwhile, the "unit" is not limited to software or hardware, and the "unit" may be configured to be on an addressable storage medium or may be configured to reproduce one or more processors. Accordingly, as an example, the "unit" includes components such as software components, object-oriented software components, class components, and task components, as well as processes, functions, attributes, procedures, subroutines, segments of program code, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, and variables. The functionality provided within the components and "units" may be combined into a smaller number of components and "units," or further separated into additional components and "units." Additionally, components and '~parts' may be implemented to regenerate one or more CPUs within a device or secure multimedia card.

[0016] Some of the operations or functions described herein as being performed by a terminal, apparatus, or device may instead be performed by a server connected to the terminal, apparatus, or device. Similarly, some of the operations or functions described herein as being performed by a server may also be performed by a terminal, apparatus, or device connected to the server.

[0017] In this specification, some of the operations or functions described as terminal and mapping or matching may be interpreted to mean mapping or matching the terminal's unique number or personal identification information, which is the terminal's identifying data.

[0018] The present invention will be described in detail with reference to the attached drawings below.

[0019] FIG. 1 is a diagram illustrating a vehicle-based pickup service providing system according to one embodiment of the present invention. Referring to FIG. 1, the vehicle-based pickup service providing system (1) may include at least one user terminal (100), a pickup service providing server (300), and at least one pickup terminal (400). However, the vehicle-based pickup service providing system (1) of FIG. 1 is merely one embodiment of the present invention, and thus the present invention is not limited to FIG. 1.

[0020] At this time, each component of FIG. 1 is generally connected via a network (Network, 200). For example, as illustrated in FIG. 1, at least one user terminal (100) may be connected to a pickup service providing server (300) via a network (200). In addition, the pickup service providing server (300) may be connected to at least one user terminal (100) and at least one pickup terminal (400) via the network (200). In addition, at least one pickup terminal (400) may be connected to the pickup service providing server (300) via the network (200).

[0021] Here, a network means a connection structure that enables information exchange between each node, such as multiple terminals and servers, and examples of such networks include a local area network (LAN), a wide area network (WAN), the Internet (WWW), a wired and wireless data communication network, a telephone network, and a wired and wireless television communication network. Examples of wireless data communication networks include, but are not limited to, 3G, 4G, 5G, 3GPP (3rd Generation Partnership Project), 5GPP (5th Generation Partnership Project), 5G NR (New Radio), 6G (6th Generation of Cellular Networks), LTE (Long Term Evolution), WIMAX (World Interoperability for Microwave Access), Wi-Fi, the Internet, LAN (Local Area Network), Wireless LAN (Wireless Local Area Network), WAN (Wide Area Network), PAN (Personal Area Network), RF (Radio Frequency), Bluetooth networks, NFC (Near-Field Communication) networks, satellite broadcasting networks, analog broadcasting networks, and DMB (Digital Multimedia Broadcasting) networks.

[0022] In the following, the term "at least one" is defined as a term including both singular and plural, and it will be clear that even if the term "at least one" does not exist, each component can exist in the singular or plural and can mean either the singular or plural. Furthermore, whether each component is provided in the singular or plural may vary depending on the embodiment.

[0023] At least one user terminal (100) may be a user terminal that outputs a pickup request event using a web page, app page, program, or application related to a pickup service using a vehicle.

[0024] Here, at least one user terminal (100) may be implemented as a computer capable of accessing a remote server or terminal via a network. Here, the computer may include, for example, a notebook, desktop, or laptop equipped with a navigation system or web browser. In this case, at least one user terminal (100) may be implemented as a terminal capable of accessing a remote server or terminal via a network. At least one user terminal (100) may include, for example, a wireless communication device that ensures portability and mobility, and may include all types of handheld-based wireless communication devices such as navigation, PCS (Personal Communication System), GSM (Global System for Mobile communications), PDC (Personal Digital Cellular), PHS (Personal Handyphone System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication)-2000, CDMA (Code Division Multiple Access)-2000, W-CDMA (W-Code Division Multiple Access), Wibro (Wireless Broadband Internet) terminals, smartphones, smartpads, tablet PCs, etc.

[0025] The pickup service providing server (300) may be a server that provides a vehicle-based pickup service web page, app page, program, or application. Furthermore, the pickup service providing server (300) may be a server that maps and stores user terminals (100) and pickup terminals (400) and obtains consent for location information sharing and stores the information. Furthermore, the pickup service providing server (300) may be a server that, when a pickup request event is transmitted from a user terminal (100), transmits it to a pickup terminal (400), and generates a route with the location of the user terminal (100) as a destination on the pickup terminal (400) to drive navigation. Furthermore, the pickup service providing server (300) may be a server that provides information on the distance and direction between pickup terminals (400) based on the location of the user terminal (100), and conversely, provides information on the distance and direction between user terminals (100) based on the location of the pickup terminal (400). In addition, the pickup service providing server (300) may be a server that uses an object detection algorithm to quickly recognize the user of the user terminal (100) at the pickup terminal (400), detects the user based on the user's body shape or clothing at a long distance, or based on the user's face at a close distance, and then outputs the detection result to the pickup terminal (400) or a head-up display linked to the pickup terminal (400).

[0026] Here, the pickup service providing server (300) may be implemented as a computer capable of connecting to a remote server or terminal via a network. Here, the computer may include, for example, a notebook computer, desktop computer, or laptop computer equipped with a navigation system or web browser.

[0027]

[0028] *At least one pickup terminal (400) may be a terminal of a person who picks up a vehicle using a web page, app page, program, or application related to a pickup service, such as a user's acquaintance, parent, guardian, etc., but is not limited thereto. The pickup terminal (400) may be a terminal that receives a pickup request event from a user terminal (100) via a pickup service providing server (300) and performs route guidance.

[0029] Here, at least one pickup terminal (400) may be implemented as a computer capable of connecting to a remote server or terminal via a network. Here, the computer may include, for example, a notebook computer, desktop computer, or laptop computer equipped with a navigation system or web browser. In this case, at least one pickup terminal (400) may be implemented as a terminal capable of connecting to a remote server or terminal via a network. At least one pickup terminal (400) may include, for example, all kinds of handheld-based wireless communication devices such as navigation, PCS (Personal Communication System), GSM (Global System for Mobile communications), PDC (Personal Digital Cellular), PHS (Personal Handyphone System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication)-2000, CDMA (Code Division Multiple Access)-2000, W-CDMA (W-Code Division Multiple Access), Wibro (Wireless Broadband Internet) terminals, smartphones, smartpads, tablet PCs, etc., as wireless communication devices that ensure portability and mobility.

[0030] FIG. 2 is a block diagram for explaining a pickup service providing server included in the system of FIG. 1, and FIGS. 3 and 4 are drawings for explaining an embodiment in which a pickup service using a vehicle is implemented according to an embodiment of the present invention.

[0031] Referring to FIG. 2, the pickup service providing server (300) may include a registration unit (310), a receiving unit (320), a route generation unit (330), a route guidance unit (340), a display unit (350), a location sharing unit (360), a location guidance unit (370), a face recognition unit (380), a front output unit (390), and an autonomous driving unit (391).

[0032] When the pickup service providing server (300) according to one embodiment of the present invention or another server (not shown) that operates in conjunction with it transmits a vehicle-based pickup service application, program, app page, web page, etc. to at least one user terminal (100) and at least one pickup terminal (400), the at least one user terminal (100) and the at least one pickup terminal (400) can install or open the vehicle-based pickup service application, program, app page, web page, etc. In addition, the service program may be driven in the at least one user terminal (100) and the at least one pickup terminal (400) using a script executed in a web browser. Here, the web browser refers to a program that enables the use of a web (WWW: World Wide Web) service and receives and displays hypertext described in HTML (Hyper Text Mark-up Language), and includes, for example, Chrome, Edge (Microsoft Edge), Safari, Firefox, Whale, UC Browser, etc. Additionally, the application refers to an application on a terminal, and includes, for example, an app running on a mobile terminal (smartphone).

[0033] Referring to FIG. 2, the registration unit (310) can store the user terminal (100) and the pickup terminal (400) so that they are mapped when a connection request for a pickup service is made between the user terminal (100) and the pickup terminal (400). For example, if the user is a child and the pickup is a parent, registration can be performed in a manner in which the parent registers the child. Once the connection between the guardian and the ward is completed in this way, when the ward user requests a pickup, the location can be shared immediately without the guardian's or ward's permission to share the location.

[0034] The receiving unit (320) can receive a pickup request event from the user terminal (100). The pickup terminal (400) can be connected to the user terminal (100) for pickup services. The user terminal (100) can output a pickup request event. For example, when the academy or school is over, the user can request a pickup from a guardian, and the user terminal (100) can transmit the pickup request event to the pickup terminal (400). To this end, the user terminal (100) and the pickup terminal (400) begin to share their locations.

[0035] The route generation unit (330) can generate a route with the location of the pickup terminal (400) as the starting point and the location of the user terminal (100) as the destination while transmitting a pickup request event of the user terminal (100) to the pickup terminal (400). In this case, if there are many vehicles or people waiting in the space where the user of the user terminal (100) is standing, the vehicle may not be able to enter, or the user may move to find a location. For this purpose, the user's real-time location can be set as the destination to set navigation. For this purpose, the real-time location of the user terminal (100) can be collected in real time to dynamically regenerate and update the route.

[0036] At this time, in order to generate a path for following the user terminal (100), location information and information on the optimal movement path from the current location to the destination are essential. In one embodiment of the present invention, the location of the vehicle is recognized using DGPS (Differential GPS) positioning technology using RTK (Real Time Kinematic) method, which is a real-time movement measurement technique. The vehicle drives based on reliable vehicle location information and a pre-generated global path to the destination, and if obstacle data is located on the global path, a local path is generated based on the driving environment recognition information obtained from the driving environment recognition system and the vehicle location information obtained from the location recognition system, and this is reflected in the global path to generate an optimal movement path to the destination. At this time, it is assumed that the vehicle is an autonomous vehicle. However, it will be obvious that the location of the pickup terminal (400), which is the location of the pickup person, can be identified using the following method even if the vehicle is not an autonomous vehicle.

[0037] In addition, the vehicle's position and attitude can be linearly corrected by restoring the vehicle's position information using the generated optimal path-based fuzzy system. At this time, reliable and precise position information of the vehicle is essential for the vehicle to drive. Among the positioning technologies that can provide position information, the satellite navigation system GPS, which is the most widely used, provides the absolute position in the Earth's coordinate system and has the advantage of not accumulating position errors, but has an error of approximately 0.05 m to 10 m due to satellite signal loss, interference, and radio jamming. Therefore, it is difficult to accurately recognize the vehicle's position using GPS alone. In one embodiment of the present invention, the vehicle's position can be precisely recognized using DGPS positioning technology using the RTK method, which is a real-time kinematic positioning method. DGPS is a relative positioning technology that consists of a reference station and a rover, and transmits the range of errors from the reference station, which determines the exact position through precise positioning, to the rover to correct the GPS measurements of the rover. RTK-DGPS is a real-time DGPS method that uses the carrier error correction value of a reference station to correct GPS measurements from a mobile station in real time. Compared to standalone positioning using a single GPS unit, RTK-DGPS can reduce the error range to approximately 0.5 meters.

[0038] <Create Path>

[0039] <Generate global path>

[0040] A global route is a pre-generated route from a starting point to a destination based on information collected in advance before a vehicle starts driving. The purpose of a global route is to create an optimal route that enables stable and reliable driving to the vehicle's reference route destination. In one embodiment of the present invention, a waypoint-based global route can be generated from a starting point to a destination using information collected in advance using GPS positioning technology, such as latitude, longitude, and azimuth. The positioning information obtained from existing GPS is given in a three-dimensional latitude and longitude coordinate system corresponding to an ellipsoid of latitude, longitude, and altitude. This is different from the coordinates on a two-dimensional map that we see, making it difficult to generate and calculate global and local routes. Therefore, the latitude, longitude, and altitude information based on the WGS84 (World Geodetic System 1984) coordinate system, the international standard coordinate system of GPS positioning information, can be converted to the TM coordinate system, an orthogonal coordinate system that can be used in Korea.

[0041] <Create local route>

[0042] A local route is a newly generated local route based on the vehicle's current position and driving environment recognition information, taking into account static and dynamic obstacle avoidance in real time while the vehicle is driving based on the global route. The route is generated based on obstacle detection information from the driving environment recognition system and the vehicle's current position information obtained through the DGPS of the position recognition system. The A* algorithm, one of the existing local route generation algorithms, searches for the lowest-cost path from a starting point to a target point by examining adjacent nodes within a state space. Rather than considering all nodes within a given space, it uses a heuristic search method that includes information about the target point in each node. This depth-first search method prioritizes more promising nodes when searching adjacent nodes, resulting in relatively rapid progress toward the target. However, because it considers all eight nodes adjacent to the starting node, it fails to reflect the vehicle's dynamic characteristics. Furthermore, its computationally intensive nature makes it difficult to apply to high-speed vehicles.

[0043] Therefore, in one embodiment of the present invention, a local route can be generated through a forward search algorithm that detects an obstacle ahead and generates a new waypoint. When a vehicle detects an obstacle through a driving environment recognition system while driving based on a global route, a certain area is searched in the direction of travel of the vehicle considering the width of the vehicle. By searching ahead, a group of candidate routes that are free of obstacles and in which the vehicle can proceed is selected. Among the group of candidate routes, the route with the shortest distance r between the obstacle and the candidate routes is selected as the optimal route so that the expected driving distance can be minimized, and a waypoint corresponding to the local route is generated so that the vehicle can drive. The generated waypoint must be located on an extension of the perpendicular of the obstacle's origin.

[0044] The distance l from the current position to an obstacle can be determined using distance information from the obstacle detected by LiDAR. Knowing the distance l allows the distance r between the corresponding waypoint on the local route and the obstacle to be calculated using Equation 1.

[0045]

[0046] By calculating r for each path in this way, the final path is selected. In one embodiment of the present invention, since path-following driving is performed based on path points, a process of calculating new path points is necessary. To do this, the coordinates (P) of the obstacle are first calculated. When the current location is (x0, y0), the coordinates P of the obstacle are as shown in Mathematical Expression 2.

[0047]

[0048] Here, φ is the azimuth of the path. Knowing the coordinates P of the obstacle, a new waypoint NW corresponding to the local path can be obtained as in Equation 3.

[0049]

[0050] The route guidance unit (340) can output the generated route to the navigation system in the pickup terminal (400). When a pickup request event is received from the user terminal (100), the pickup terminal (400) can generate a route with the location of the user terminal (100) as the destination and output the route to the navigation system. At this time, in order to accurately determine and track the location of the user terminal (100), both a gyroscope and an acceleration sensor are applied, and then the raw acceleration data is double-integrated. Thereafter, a complementary filter can be applied to the signal. The movement path trajectory of the location of the user terminal (100) according to this can be provided by 3D plotting. Here, the case where these two sensors (a gyroscope and an acceleration sensor) are further used for the location of the user terminal (100) can be used, for example, when an indoor location is to be determined, or when a user moving along the Z axis is to be tracked. For example, this could be to determine if you were supposed to meet in the building's underground parking lot but don't know which floor it is on, or if the user said they were on the second basement floor but moved. However, the number of cases is not limited to these.

[0051] In one embodiment of the present invention, a complementary filter can be applied to remove noise generated by an acceleration sensor and a gyroscope sensor to accurately measure a location. Acceleration sensors can induce large errors when subjected to external forces. They are particularly susceptible to rapid vibrations and suffer from severe distortion in the high-frequency range. To address this issue, a low-pass filter can be applied to the angle measured by the acceleration sensor to utilize only low-frequency components. Furthermore, gyroscope sensors exhibit small errors even when stationary, and drift occurs over time, causing gradual distortion as the angle value accumulates. This drift is a characteristic of the sensor itself and primarily occurs in the low-frequency components. To address this, a high-pass filter can be applied to utilize only high-frequency components. The two filtered values ​​are then combined to form a complementary filter, which can then be used to calculate the location. In addition to the above-described methods, it goes without saying that various methods can be used to implement LBS services, for example, RTLS (Real-time Location Systems) such as RSSI (Received Signal Strength Indicator), GNSS (Global Navigation Satellite System), FingerPrint, WiFi, RFID, GPS, BLE, and UWB. In addition, it is also possible to use the Hyper Enhanced Local Positioning System (Hyper Enhanced Local Positioning System), a mobile communication signal-based precise positioning technology that can identify the location of an emergency rescue requester using only LTE signals, recently developed by the Communication Systems Laboratory of the Department of Convergence Electronic Engineering at Hanyang University. Of course, since various methods may exist in addition to the above-described methods, they are not limited to the listed ones and are not excluded for reasons not listed.

[0052] The display unit (350) can be configured to output a route to the vehicle's navigation system when the user terminal (100) and the vehicle's navigation system are linked, and to display the direction and distance to which the user terminal (100) is present on the head-up display when the vehicle includes a head-up display. By updating the location of the vehicle, i.e., the pickup terminal (400), measured using the above-described method, and the location of the user terminal (100) in real time, the distance and direction from the location of the pickup terminal (400) to the user terminal (100) can be extracted in real time and then output on the head-up display. Accordingly, the person picking up the vehicle can check where the user is while looking ahead.

[0053] The location sharing unit (360) can output the location of the pickup terminal (400) to the user terminal (100) when responding to a pickup request event from the pickup terminal (400). This allows the vehicle to determine where the user is. Conversely, the location guidance unit (370) can output the direction and distance to which the pickup terminal (400) is located from the user terminal (100). In other words, this allows the user to also know where the vehicle is, i.e., the direction and distance to the pickup terminal (400).

[0054] The facial recognition unit (380) determines whether a face collected from the camera matches a face registered in the user terminal (100) when the pickup terminal (400) is connected to the vehicle's camera and the pickup terminal (400) and the vehicle's camera capture the front, side, or rear of the vehicle, and notifies the pickup terminal (400) of the presence of a pickup object, and if a matching face exists, outputs the location where the matching face exists from the pickup terminal (400). At this time, if the child is at a long distance, the child can be distinguished by clothing or body type, and if the child is at a close distance, facial recognition can be performed. In addition, most parents are preoccupied with figuring out whether their child is coming out and, if so, where their child is, rather than keeping an eye on the front when their children pour out of an academy or school. To help with this, object detection and facial recognition can be performed. Object detection can be used at a distance, and facial recognition can be used at a close range. To distinguish children at a distance, a single-step detection method is more accurate than a two-step detection method due to its speed. Additionally, while feature-based methods can be used for facial recognition, if this is slow, a single-step detection method, such as YOLO, can be used as described above. Recognition based on body shape or clothing can utilize the overall proportions of the face, torso, and legs, as well as the aspect ratio of the torso and the aspect ratio of the legs. Clothing can change daily, requiring daily input of default values. However, it is also possible to utilize accessories worn daily, such as glasses or bags.

[0055] The front output unit (390) can output pickup target guidance on the head-up display when a matching face exists when connected to the pickup terminal (400) and the vehicle's head-up display. Recently, a method of augmenting the use of the head-up display has been researched and developed. This refers to a method of recognizing an object and then augmenting and displaying content on the object, similar to when outputting AR content. When using this, if the user is detected by the user's body shape and the user's face is confirmed and the user's location is identified, the content is augmented and displayed on the user object, allowing parents or guardians to see at a glance where their child is.

[0056] The autonomous driving unit (391), when the pickup terminal (400) and the vehicle are connected and the vehicle is a vehicle with a built-in autonomous driving mode, can generate a route with the location of the user terminal (100) as the destination and then operate in autonomous driving mode. That is, if the autonomous driving mode is set to follow the user terminal (100) and the location of the user terminal (100) is updated in real time, the vehicle follows the user of the user terminal (100) like a robot, so this method can be used. At this time, if the vehicle is moving in autonomous driving mode or is actually an autonomous vehicle and a guardian does not pick it up, that is, in the case of autonomous mobility on demand, and if the pickup terminal (400) also requests to pick up a lunchbox for the user, that is, their child, the autonomous vehicle can be set to stop by the lunchbox pickup location and pick up the child. In this case, the user can board the autonomous vehicle, eat the picked-up lunchbox, and then move on to the next destination, for example, an academy.

[0057] First, when a pickup request event is output from the user terminal (100), an autonomous vehicle is called, and when called, the service can inform the user of the boarding time and boarding location by considering real-time traffic conditions. Immediately after the call, the vehicle can quickly move along a real-time optimized route, and the student user can check the real-time vehicle status of the vehicle and wait. When the student user gets on or off the vehicle, the autonomous driving unit (391) can provide real-time boarding and alighting notifications and location status to the pickup terminal (400), i.e., the guardian or parent. If the vehicle arrives at the boarding location, but the student user does not get on the vehicle after N minutes or is determined to not be close to the vehicle, an emergency contact is made to the pickup terminal (400) so that the problem can be dealt with. In addition, if the user is riding in the vehicle with other people, such as adults or teenagers who are not the same age, the user should be immediately taken to the nearest police station, or if someone other than the user is riding in the vehicle, an electric shock should be applied to the seat occupied by the other person so that an electric current flows to prepare for situations such as kidnapping, enticement, or abduction.

[0058] In addition, to provide a comfortable experience and efficient condition and time management while riding in the vehicle, the autonomous vehicle can provide four modes: a basic comfortable driving mode, a resting mode, a meal mode, and a study mode. At this time, the autonomous vehicle can suggest a mode based on the user's emotions and situational context. For example, if the user is in a positive emotional state such as joy, the autonomous vehicle can set a task goal together to build anticipation for the future schedule, encourage the user to achieve the goal, and guide the user into a study mode. If the user is in a negative emotional state such as sadness or depression, the autonomous vehicle can help the user calm down through an empathetic conversation. The conversation at this time can be, but is not limited to, ChatGPT, which is based on a large language model. After the empathetic conversation, the autonomous vehicle can suggest an appropriate mode based on the user's situation and the urgency of the homework on the user terminal (100).

[0059] The vehicle can provide passengers with an environment optimized for each mode, including desks, chairs, and lighting, as well as appropriate content. The user terminal (100) can switch to a suitable mode through interaction with the autonomous vehicle, allowing for detailed adjustments to the vehicle environment for each mode. For example, among the vehicle's default driving modes, Comfort Mode is provided when passengers are not engaged in specific activities, such as eating, resting, or doing homework. The environment automatically adjusts to a user-customized desk, chair, and lighting. Meal Mode provides an environment in which passengers can comfortably eat. The chair's incline can be automatically adjusted. Study Mode provides an environment and content that allows passengers to effectively study within the vehicle. Based on data from other academy and class management services, the vehicle proposes a comprehensive academy schedule and homework assignments to the user, allowing the user to review this schedule and proceed with their studies within the vehicle. Rest Mode is provided for complete relaxation, facilitating deep sleep or providing themed relaxation content tailored to the passenger's preferences to facilitate a comfortable rest. From the moment a student boards the vehicle, fatigue levels can be measured using features such as electrocardiogram sensors and eye tracking to create a customized rest environment.

[0060] Upon arrival at the academy, real-time traffic data is used to determine the academy area's traffic conditions and guide the user to the optimal drop-off location. Upon exiting, the autonomous vehicle will send the user off with a cheering message and a voice guidance system activated to ensure a safe exit. If the academy closes late or early, the vehicle's closest available time can be adjusted to accommodate the delay. In the event of a delay, the changed time and reason can be communicated to parents to prevent emergency contact.

[0061] Hereinafter, the operation process according to the configuration of the pickup service providing server of FIG. 2 described above will be described in detail using FIG. 3 and FIG. 4 as examples. However, it will be apparent that the embodiment is merely one of various embodiments of the present invention and is not limited thereto.

[0062] Referring to FIG. 3, (a) the pickup service providing server (300) registers the user terminal (100) in the pickup terminal (400), and if the user terminal (100) agrees to share location information, maps the pickup terminal (400) and the user terminal (100) and stores and registers them. Then, as in (b), when the user terminal (100) outputs a pickup request event, the pickup service providing server (300) transmits the event to the user terminal (100) and drives the navigation so that the generated route is output from the pickup terminal (400). And, the pickup service providing server (300) can enable the user terminal (100) to view the location of the pickup terminal (400) as in (d), output the distance and direction to the user terminal (400) on the head-up display as in (a) of FIG. 4, and (b) when facial recognition is performed, output augmented content on the recognized object so that it can be output on the head-up display connected to the pickup terminal (400). And, the pickup service providing server (300) can enable the user terminal (100) to be guided on the distance and direction to the pickup terminal (400) as in (c), and conversely, the pickup terminal (400) to be guided on the distance and direction to the user terminal (100), and can generate and drive a route so as to receive updates on the real-time current location of the user terminal (100) in the autonomous driving mode as in (d).

[0063] Matters not described in the method for providing a pickup service using a vehicle as shown in FIGS. 2 to 4 are the same as or can be easily inferred from the contents described in the method for providing a pickup service using a vehicle as shown in FIG. 1 above, and therefore, description thereof will be omitted below.

[0064] FIG. 5 is a diagram illustrating a process of transmitting and receiving data between components included in the vehicle-based pickup service providing system of FIG. 1 according to one embodiment of the present invention. Hereinafter, an example of the process of transmitting and receiving data between components will be described with reference to FIG. 5. However, the present invention is not limited to this embodiment, and it will be apparent to those skilled in the art that the process of transmitting and receiving data illustrated in FIG. 5 may be modified according to various embodiments described above.

[0065] Referring to FIG. 5, when a pickup service providing server requests a connection for a pickup service from a user terminal and a pickup terminal, the pickup service providing server stores the user terminal and the pickup terminal so that they are mapped (S5100), and receives a pickup request event from the user terminal (S5200).

[0066] In addition, the pickup service providing server generates a route with the location of the pickup terminal as the starting point and the location of the user terminal as the destination while transmitting a pickup request event of the user terminal to the pickup terminal (S5300), and outputs the generated route to the navigation system from the pickup terminal (S5400).

[0067] The order of the above-described steps (S5100 to S5400) is merely an example and is not limited thereto. That is, the order of the above-described steps (S5100 to S5400) may be mutually changed, and some of the steps may be executed simultaneously or deleted.

[0068] Matters not described in the method for providing a pickup service using a vehicle as shown in FIG. 5 are the same as or can be easily inferred from the contents described in the method for providing a pickup service using a vehicle as shown in FIGS. 1 to 4, and therefore, description thereof will be omitted below.

[0069] The method for providing a pickup service using a vehicle according to one embodiment described through FIG. 5 may also be implemented in the form of a recording medium containing computer-executable instructions, such as an application or program module executed by a computer. Computer-readable media may be any available media that can be accessed by a computer, and include both volatile and nonvolatile media, removable and non-removable media. Furthermore, computer-readable media may include all computer storage media. Computer storage media include both volatile and nonvolatile, removable and non-removable media implemented with any method or technology for storing information, such as computer-readable instructions, data structures, program modules, or other data.

[0070] The method for providing a pickup service using a vehicle according to an embodiment of the present invention described above can be executed by an application that is installed by default on the terminal (which may include a program included in a platform or operating system installed by default on the terminal), or by an application (i.e., a program) that the user directly installs on the master terminal through an application providing server such as an application store server, an application, or a web server related to the service. In this sense, the method for providing a pickup service using a vehicle according to an embodiment of the present invention described above can be implemented as an application (i.e., a program) that is installed by default on the terminal or directly installed by the user, and can be recorded on a computer-readable recording medium such as the terminal.

[0071] The foregoing description of the present invention is for illustrative purposes only, and those skilled in the art will readily appreciate that the present invention can be readily modified into other specific forms without altering the technical spirit or essential characteristics of the present invention. Therefore, the embodiments described above should be understood as illustrative in all respects and not restrictive. For example, each component described as a single entity may be implemented in a distributed manner, and similarly, components described as distributed may be implemented in a combined manner.

[0072] The scope of the present invention is indicated by the claims described below rather than the detailed description above, and all changes or modifications derived from the meaning and scope of the claims and their equivalent concepts should be interpreted as being included in the scope of the present invention.

[0073] The mode for carrying out the invention has been described together with the best mode for carrying out the invention above.

[0074] The present invention connects a user terminal and a pickup terminal and stores them so as to be mapped, and when a pickup request event is output from the user terminal, transmits the location of the user terminal to the pickup terminal and generates a route with the location as a destination, and guides the pickup terminal to drive along the route while guiding the pickup terminal to determine the distance and direction from the user terminal and the user terminal to determine the distance and direction from the pickup terminal, thereby enabling quick pickup and departure without causing traffic congestion by quickly finding each other, and thus having industrial applicability.

Claims

1. User terminal that outputs a pickup request event; A pickup terminal that is connected to the user terminal for pickup service, and when a pickup request event is received from the user terminal, generates a route with the location of the user terminal as the destination and outputs it to the navigation; and A pickup service providing server including a registration unit that stores the user terminal and the pickup terminal so that they are mapped when a connection is requested for the pickup service from the user terminal and the pickup terminal, a receiving unit that receives a pickup request event from the user terminal, a route generation unit that generates a route with the location of the pickup terminal as the starting point and the location of the user terminal as the destination while transmitting the pickup request event of the user terminal to the pickup terminal, and a route guidance unit that outputs the generated route as a navigation device from the pickup terminal; A system for providing a pickup service using a vehicle including:

2. In paragraph 1, The above pickup service providing server is, When the user terminal and the vehicle's navigation are linked, a display unit that outputs the route to the vehicle's navigation, and when the vehicle includes a head-up display, displays the direction and distance to which the user terminal is present on the head-up display; A vehicle-based pickup service providing system characterized by further including:

3. In paragraph 1, The above pickup service providing server is, A location sharing unit that outputs the location of the pickup terminal to the user terminal when the pickup request event is responded to at the pickup terminal; A vehicle-based pickup service providing system characterized by further including:

4. In paragraph 3, The above pickup service providing server is, A location guide unit that outputs the direction and distance in which the pickup terminal is located from the user terminal; A vehicle-based pickup service providing system characterized by further including:

5. In paragraph 1, The above pickup service providing server is, A facial recognition unit that determines whether a face collected from the camera matches a face registered in the user terminal when the pickup terminal is connected to a camera of the vehicle and the pickup terminal and the camera of the vehicle capture the front, side or rear of the vehicle, and informs the pickup terminal of the presence of a pickup object, and if a matching face exists, outputs the location where the matching face exists from the pickup terminal; A vehicle-based pickup service providing system characterized by further including:

6. In paragraph 5, The above pickup service providing server is, When the pickup terminal is connected to the head-up display of the vehicle, a front output unit that outputs pickup target guidance to the head-up display when a matching face exists; A system for providing a pickup service using a vehicle, characterized by including:

7. In paragraph 1, The above pickup service providing server is, When the above pickup terminal and vehicle are connected and the vehicle is a vehicle with a built-in autonomous driving mode, an autonomous driving unit that generates a route with the location of the user terminal as a destination and then operates in autonomous driving mode; A vehicle-based pickup service providing system characterized by further including:

Images