Location-based avatar communication service providing method and apparatus

CN114430406BActive Publication Date: 2026-09-04LIANPLUS CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202111170086.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2020-10-15
Filing Date
2021-10-08
Publication Date
2026-09-04
Estimated Expiration
2041-10-08

AI Technical Summary

Technical Problem

一方面,线上通讯服务作为基于熟人的服务,处于没有积极导入增强现实技术的情况

Benefits of technology

[0030] According to one embodiment of this disclosure, a user can locate other users in the real world without moving their position, by adjusting the shooting direction and zoom level of the image sensor. Furthermore, by confirming the addition or removal of avatars through the shooting direction and zoom level of the image sensor, the approximate location in real space of other users corresponding to those avatars can be determined.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114430406B_ABST
    Figure CN114430406B_ABST
Patent Text Reader

Abstract

The present disclosure relates to a location-based avatar communication service providing method and apparatus. The location-based avatar communication service providing method can include the steps of transmitting location information of a user terminal to an external system, receiving information about users located around the user terminal from the external system, receiving at least one image from an image sensor of the user terminal, and superimposing a first group of avatars related to the users located around on the at least one image and displaying on a display portion of the user terminal.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This disclosure relates to a method and apparatus for providing location-based avatar communication services, specifically, to a method and apparatus for providing location-based avatar communication services that enable messaging and calls using avatars on instant messaging applications. Background Technology

[0002] The proliferation of devices such as smartphones, tablets (PCs), laptops, and desktop computers equipped with cameras is expanding. In this environment, the use of cameras mounted on these devices is increasing. As a representative example, various augmented reality (AR) services are being provided using cameras mounted on devices.

[0003] The augmented reality services mentioned primarily extend from mobile gaming to areas closely related to daily life, such as virtual configuration of home appliances and furniture. On the other hand, online communication services, being based on familiar relationships, have not actively adopted augmented reality technology. Summary of the Invention

[0004] Technical issues

[0005] This disclosure provides a method for providing avatar communication services, a recording medium storing a computer program, and an apparatus for solving the problems described above.

[0006] This disclosure provides a method and apparatus for providing location-based avatar communication services by acquiring the location information of surrounding user terminals, thereby overlaying the avatars of surrounding users onto a real-world image, and using the displayed avatars to provide messaging and call functions.

[0007] Technical solution

[0008] This disclosure can be implemented in various ways, including methods, apparatus or recording media storing computer programs.

[0009] According to an embodiment of this disclosure, a method for providing location-based avatar communication services may include: transmitting location information of a user terminal to an external system; receiving information about users located around the user terminal from the external system; receiving at least one image from an image sensor of the user terminal; and overlaying a first set of avatars associated with the users located around the user terminal onto the at least one image and displaying it on a display unit of the user terminal.

[0010] According to one embodiment, the method for providing location-based avatar communication services may further include: receiving a selection of an avatar from a first set of avatars displayed on a display unit; and displaying profile information of a user associated with the selected avatar on the display unit.

[0011] According to one embodiment, the method for providing location-based avatar communication services may further include: receiving a selection of an avatar from a first set of avatars displayed on a display unit; and transmitting a request to an external system for generating a chat window for a user associated with the selected avatar in an instant messaging application.

[0012] According to one embodiment, the chat window can be an open chat window that minimizes the exposure of personal information.

[0013] According to one embodiment, the method for providing location-based avatar communication services may further include: receiving a selection of an avatar from a first set of avatars displayed on a display unit; and transmitting a request to an external system for generating a voice call for a user associated with the selected avatar on an instant messaging application.

[0014] According to one embodiment, the method for providing location-based avatar communication services may further include: displaying a selected avatar on a display unit during a voice call, and controlling the action of the selected avatar displayed on the display unit based on the voice data of the other party in the voice call.

[0015] According to one embodiment, in a location-based avatar communication service provision method, the first set of avatars may be avatars associated with users located in the vicinity and within a predetermined distance in the direction of the image sensor.

[0016] According to one embodiment, in a location-based avatar communication service provision method, the size of each of the first set of avatars displayed on the display unit can be determined based on the distance between users and user terminals located in the vicinity.

[0017] According to one embodiment, in a location-based avatar communication service provision method, the position of each of the first group of avatars displayed on the display unit can be determined based on the distance between users and user terminals located in the vicinity.

[0018] According to one embodiment, in a location-based avatar communication service provision method, the facial size of each of the first group of avatars displayed on the display unit can be determined based on the rating scores associated with users located in the vicinity.

[0019] According to one embodiment, in a location-based avatar communication service provision method, the size of each of the first group of avatars displayed on the display unit can be determined based on the rating scores associated with users in the vicinity.

[0020] According to one embodiment, in a location-based avatar communication service provision method, a first set of avatars to be displayed on a display unit can be determined based on rating scores associated with users located in the vicinity.

[0021] According to one embodiment, the method for providing location-based avatar communication services may further include the step of displaying a first graphic object on the avatar of a user associated with a rating score above a predetermined threshold among users located in the vicinity.

[0022] According to one embodiment, the method for providing location-based avatar communication services may further include: in response to a change in the direction of an image sensor, overlaying a second set of avatars associated with users located in the vicinity onto at least one image and displaying them on a display unit of a user terminal.

[0023] According to one embodiment, the method for providing location-based avatar communication services may further include: in response to a change in the zoom level of an image sensor, overlaying a third set of avatars associated with users located in the vicinity onto at least one image and displaying them on a display unit of a user terminal.

[0024] According to one embodiment, the method for providing location-based avatar communication services may further include: in response to receiving filtering conditions, overlaying a fourth set of avatars associated with users in the vicinity who meet the filtering conditions, and displaying them on a display unit of a user terminal.

[0025] According to one embodiment, the method for providing location-based avatar communication services may further include: receiving an input for masking one of the avatars displayed on a display unit; and not displaying the masked avatar on the display unit.

[0026] According to one embodiment, the method for providing location-based avatar communication services may further include the step of: when receiving a message from an instant messaging application from another user, overlaying a second graphic object related to the location of the other user onto at least one image and displaying it on a display unit.

[0027] A computer-readable recording medium is provided, which records a computer program for performing a method according to an embodiment of the present disclosure on a computer.

[0028] According to one embodiment of the present disclosure, a location-based avatar communication service providing apparatus may include: a communication module; a memory; an image sensor; a display unit; and at least one processor configured to be connected to the memory and to run at least one computer-readable program contained in the memory, the at least one program including instructions for performing the following actions: transmitting location information of the device to an external system, receiving information about users located around the device from the external system, receiving at least one image from the image sensor, overlaying a first set of avatars associated with users located around the device onto the at least one image, and displaying them on the display unit.

[0029] Invention Effects

[0030] According to one embodiment of this disclosure, a user can locate other users in the real world without moving their position, by adjusting the shooting direction and zoom level of the image sensor. Furthermore, by confirming the addition or removal of avatars through the shooting direction and zoom level of the image sensor, the approximate location in real space of other users corresponding to those avatars can be determined.

[0031] According to one embodiment of this disclosure, users can more easily view the avatars of other users with high ratings on the enhanced screen.

[0032] According to one embodiment of this disclosure, a user can identify someone who has expressed liking for their profile picture, and can attempt to communicate with that person even if they are not currently nearby.

[0033] According to one embodiment of this disclosure, a user can easily identify information about users with many commonalities from other users who have a favorable impression of them without making any further effort.

[0034] According to one embodiment of this disclosure, users of a location-based avatar communication service can conduct video calls using avatar images without revealing their faces.

[0035] The effects of this disclosure are not limited to those mentioned above. Other effects not mentioned may be clearly understood by a person skilled in the art to which this disclosure pertains (referred to as "the person skilled in the art") by way of the claims. Attached Figure Description

[0036] Figure 1 This is an example illustrating a user using a user terminal to utilize a location-based avatar communication service according to an embodiment of the present disclosure.

[0037] Figure 2 This is a schematic diagram illustrating the configuration of an information processing system communicably connected to multiple user terminals in order to provide a location-based avatar communication service and an instant messaging service according to an embodiment of the present disclosure.

[0038] Figure 3 This is a block diagram illustrating the internal configuration of a user terminal and an information processing system according to an embodiment of the present disclosure.

[0039] Figure 4 This is an example illustrating a user setting of an avatar and profile for use in a location-based avatar communication service according to one embodiment.

[0040] Figure 5 This is an example illustrating a user selecting an avatar and profile picture to initiate a location-based avatar communication service according to an embodiment of the present disclosure.

[0041] Figure 6 This is an example illustrating how a user changes the zoom level of an image sensor to change the avatar displayed on a display unit, according to an embodiment of the present disclosure.

[0042] Figure 7 This is an example illustrating how a user selects an avatar and confirms profile information of an interested user according to an embodiment of the present disclosure.

[0043] Figure 8 This is an example illustrating adding graphic objects around an avatar according to an evaluation score assigned to the avatar, based on an embodiment of the present disclosure.

[0044] Figure 9 This is an example illustrating a user's confirmation of their own rating score, determined by feedback from other users, according to an embodiment of the present disclosure.

[0045] Figure 10 This is an example illustrating a user blocking or reporting other users according to an embodiment of this disclosure.

[0046] Figure 11 This is an example illustrating a user using an avatar to make a voice call with another user according to an embodiment of the present disclosure.

[0047] Figure 12 This illustrates a method for providing location-based avatar communication services according to an embodiment of the present disclosure.

[0048] Figure label:

[0049] 110: User, 120: User terminal, 122: Enhanced screen. Detailed Implementation

[0050] The following description, with reference to the accompanying drawings, details the specific contents used to implement this disclosure. However, in the following description, specific descriptions relating to well-known functions or structures are omitted, in cases where there is a concern that this might unnecessarily obscure the gist of the disclosure.

[0051] In the accompanying drawings, the same or corresponding constituent elements are given the same reference numerals. Furthermore, in the following description of the embodiments, repeated descriptions of the same or corresponding constituent elements may be omitted. However, even if descriptions related to constituent elements are omitted, it is not intended that the constituent element is not included in a particular embodiment.

[0052] The advantages, features, and methods of achieving the disclosed embodiments are described in conjunction with the appendix. Figure 1 The specific embodiments described below will become clearer. However, this disclosure is not limited to the embodiments disclosed below and can be implemented in various different forms. These embodiments are provided only to make this disclosure complete and to fully inform those skilled in the art of the scope of the invention.

[0053] The terminology used in this specification is briefly explained, while the disclosed embodiments are described in detail. The terminology used in this specification has been chosen based on its function in this disclosure, taking into account general terms that are currently used as widely as possible; however, it may vary depending on the intent of a person skilled in the art, precedent, the emergence of new technologies, etc. Furthermore, in certain cases, there are terms arbitrarily selected by the applicant; in such cases, their meanings will be described in detail in the description of the relevant invention. Therefore, the terminology used in this disclosure is not merely a name, but should be defined based on the meaning of the term and the overall content of this disclosure.

[0054] Where no particular singular is explicitly stated in the context, singular expressions in this specification include plural expressions. Conversely, where no particular plural is explicitly stated in the context, plural expressions include singular expressions. When a part of this specification is mentioned throughout the specification as including a particular element, unless specifically stated otherwise, it means that other elements are not excluded, but may be included.

[0055] Furthermore, the terms "module" or "section" used in this specification refer to software or hardware components that perform a certain function. However, "module" or "section" is not limited to the meaning of software or hardware. A "module" or "section" can also be configured to exist in an accessible storage medium or to enable one or more processors to reproduce it. Thus, as an example, a "module" or "section" can include at least one of the following: software components, components such as object-oriented software components, class components, and task components, procedures, functions, attributes, steps, subroutines, segments of program code, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, or variables. The functionality provided within a component and a "module" or "section" can be combined from a smaller number of components and "sections" or further subdivided into further components and "modules" or "sections".

[0056] According to one embodiment of this disclosure, a "module" or "unit" may be implemented by a processor and a memory. "Processor" should be interpreted broadly to include general-purpose processors, central processing units (CPUs), microprocessors, digital signal processors (DSPs), controllers, microcontrollers, state machines, etc. In some contexts, "processor" may also refer to application-specific integrated circuits (ASICs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), etc. "Processor" may also refer to a combination of processing devices, such as a combination of a DSP and a microprocessor, a combination of multiple microprocessors, a combination of one or more microprocessors combined with a DSP core, or any other combination of the aforementioned structures. Furthermore, "memory" should be interpreted broadly to include any electronic component capable of storing electronic information. "Memory" may also refer to various types of processor-readable media, such as random access memory (RAM), read-only memory (ROM), non-volatile random access memory (NVRAM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), flash memory, magnetic or optical data storage devices, registers, etc. The memory and processor are said to be in electrical communication as long as the processor can read information from the memory and / or record information in the memory. Memory integrated with the processor is in electrical communication with the processor.

[0057] In this disclosure, "chat window" can refer to a virtual space or group that can be created by an instant messaging application installed on a computing device and is open to more than one user (or user account). For example, more than one user account can participate in or be included in the chat window, allowing them to send and receive messages, files, etc. in various formats. Furthermore, the chat window provides VoIP (Voice over Internet Protocol) voice call functionality, VoIP video call functionality, and live streaming functionality (VoIP real-time video transmission), enabling user accounts to conduct voice calls, video calls, video streaming, etc.

[0058] In this disclosure, an "open chat window" refers to a chat window that a user (or user account) can enter by arbitrarily entering new profile information (e.g., profile information to be used in an open chat window, profile information to be used in a location-based avatar messaging service, etc.). This can refer to a chat window that guarantees anonymity. In one embodiment, an open chat window does not require participating users to be friends with each other in the instant messaging application. Furthermore, the basic profile information (profile photo, name, birthday, status messages, etc.) set by the user in the instant messaging application is not disclosed to other users in the open chat window. An open chat window can be distinguished from a regular chat window that discloses the user's basic profile information set in the instant messaging application to other users. Additionally, two or more users can participate in an open chat window.

[0059] In this disclosure, "user account" can refer to an account or related data generated and used by a user in an instant messaging application. Additionally, an instant messaging application's user account can refer to a user using the instant messaging application. Similarly, a user can refer to an instant messaging application's user account.

[0060] Figure 1 This illustrates an example of a user using a location-based avatar communication service via a user terminal according to an embodiment of the present disclosure. As shown, user 110 can use the image sensor of user terminal 120 (e.g., a smartphone camera, a tablet camera, etc.) to capture images of the real space. In this case, user 110 can identify other users around them by viewing the enhanced image 122 displayed on the display of user terminal 120.

[0061] In one embodiment, the enhanced screen 122 may include an image of the real space captured by the image sensor of the user terminal 120, and overlaid images of other users 124_1, 124_2, 124_3, and 124_4 on the image of the real space. The images of other users displayed on the enhanced screen 122 may be images of other users located within a predetermined distance (e.g., 200m) in the direction captured by the image sensor of the user terminal 120. The user 110 can freely change the predetermined distance, such as the number of images displayed on the screen.

[0062] In one embodiment, the positions of the avatars 124_1, 124_2, 124_3, and 124_4 on the enhanced screen 122 can be determined based on the distance between other users and the user terminal 120. For example, when a user associated with the second avatar 124_2 is closer to the user terminal 120 than a user associated with the third avatar 124_3, the second avatar 124_2 may be displayed below the third avatar 124_3 on the enhanced screen 122. Similarly, when a user associated with the first avatar 124_1 is located to the left of the image sensor of the user terminal 120 in the direction of image capture compared to a user associated with the fourth avatar 124_4, the first avatar 124_1 may be displayed to the left of the fourth avatar 124_4 on the enhanced screen 122.

[0063] In one embodiment, when user 110 changes the direction or magnification of the image sensor of user terminal 120, the avatar displayed on the augmented screen 122 can be changed. For example, when user 110 rotates user terminal 120 to the left to change the direction of the image sensor, the avatars of other users located within a predetermined distance in the changed direction of the image sensor can be overlaid on the image of real space captured by the image sensor. In other examples, when user 110 changes the zoom level (e.g., optical zoom, digital zoom, etc.) of the image sensor of user terminal 120, the avatars of users located closer or farther away can be overlaid on the image of real space according to the changed zoom level.

[0064] In one embodiment, user 110 may also configure the enhanced screen 122 to only display the avatars of users who meet predetermined conditions. For example, user 110 may input filter conditions (age, gender, hobbies, occupation, rating score, etc.) on user terminal 120, and the enhanced screen 122 will only display the avatars of surrounding users who meet the filter conditions. Further, or as an alternative, the enhanced screen 122 may not display the avatars of other users with rating scores below a predetermined level, or other users that user 110 has blocked.

[0065] In one embodiment, user 110 can configure the enhanced screen 122 to only display other users located nearby via a server (e.g., Figure 2 The information processing system recommends avatars of other users. The list of recommended users can be determined based on other users' profile information (e.g., gender, region, age, hobbies, occupation, topics of interest, etc.) and their activity history (past clicks on "likes," star ratings, chat history, etc.). For example, the enhanced screen 122 can only display avatars of users in the vicinity whose profile information is highly similar to the user's. Further, or as an alternative, the enhanced screen 122 can only display avatars of users in the vicinity whose activity patterns are similar to the user's. In this case, the enhanced screen 122 can display the top n (10th, 20th, 50th, etc.) avatars with the highest matching scores to the user.

[0066] In one embodiment, user 110 can select one of the avatars 124_1, 124_2, 124_3, and 124_4 displayed on the enhanced screen 122 via touch input or other means, and confirm the profile information of the user associated with that avatar. The profile information of other users may include the user's entered name (e.g., an anonymous nickname), gender, occupation, hobbies, and topics of interest. Furthermore, user 110 can generate a chat window on an instant messaging application with the user associated with the selected avatar, and engage in chatting, voice calls, video calls, etc. The chat window on the instant messaging application can be an open chat window that minimizes the exposure of personal information. Further, or as an alternative, user 110 can engage in online games or other online activities with the other party within the generated chat window.

[0067] By configuring the interface as described above, users can initiate more intimate conversations with visually represented individuals using avatars that reflect their personality. In this case, the information disclosed to the other party is a virtual profile based on the avatar, rather than the user's actual personal information, thus ensuring user anonymity. Furthermore, users can switch from conversations using virtual profile information (e.g., chat in an open chat window) to conversations using their actual personal accounts (e.g., chat in a regular chat window) if they wish, thereby providing users with a wide range of choices regarding the disclosure of their personal information.

[0068] Figure 2This is a schematic diagram illustrating the configuration of an information processing system communicatively connected to multiple user terminals in order to provide a location-based avatar communication service and instant messaging service according to an embodiment of the present disclosure. The information processing system 230 may include (multiple) systems that can provide location-based avatar communication services and / or instant messaging services via network 220. In one embodiment, the information processing system 230 may include one or more server devices and / or databases, or one or more distributed computing devices and / or distributed databases based on cloud computing services, that are associated with the location-based avatar communication service or instant messaging service and can store, provide, and execute computer-executable programs (e.g., downloadable applications) and data. For example, the information processing system 230 may include additional systems (e.g., servers) for providing location-based avatar communication services or instant messaging services.

[0069] The location-based avatar communication service or instant messaging service provided by the information processing system 230 can be provided to users through location-based avatar communication or instant messaging applications or web browser applications installed on each of the multiple user terminals 210_1, 210_2, 210_3. In one embodiment, the location-based avatar communication service can be provided as part of the instant messaging service. The location-based avatar communication service or instant messaging service provided by the information processing system 230 can be provided to users through location-based avatar communication / instant messaging applications or web browser applications installed on each of the multiple user terminals 210_1, 210_2, 210_3.

[0070] Multiple user terminals 210_1, 210_2, and 210_3 can communicate with the information processing system 230 via network 220. Network 220 can be configured to enable communication between the multiple user terminals 210_1, 210_2, and 210_3 and the information processing system 230. Depending on the setup environment, network 220 can consist of wired networks such as Ethernet, Power Line Communication, telephone line communication devices, and RS-serial communication; mobile communication networks; WLAN (Wireless LAN); Wi-Fi; Bluetooth; and ZigBee; or combinations thereof. The communication method is not limited and can include communication using communication networks that network 220 may include (for example, mobile communication networks, wired internet, wireless internet, broadcast networks, satellite networks, etc.), as well as short-range wireless communication between user terminals 210_1, 210_2, and 210_3.

[0071] Figure 2 Examples of user terminals shown are mobile phone terminal 210_1, tablet computer terminal 210_2, and PC terminal 210_3. However, these are not the only examples; user terminals 210_1, 210_2, and 210_3 can be any computing device equipped with an image sensor capable of wired and / or wireless communication. For example, user terminals may include smartphones, mobile phones, navigators, computers, laptops, digital broadcasting terminals, PDAs (Personal Digital Assistants), PMPs (Portable Multimedia Players), tablet PCs, game consoles, wearable devices, Internet of Things (IoT) devices, VR (Virtual Reality) devices, AR (Augmented Reality) devices, etc. Furthermore, Figure 2 The diagram shows three user terminals 210_1, 210_2, and 210_3 communicating with the information processing system 230 via network 220. However, this is not the only possibility; different numbers of user terminals may also communicate with the information processing system 230 via network 220. The multiple user terminals 210_1, 210_2, and 210_3 can be user terminals of users utilizing location-based avatar communication services / instant messaging services.

[0072] In one embodiment, the information processing system 230 can receive media data (e.g., photos, videos, text, etc.) input from a user terminal via an application for location-based avatar communication or instant messaging, operated on the user terminal. The information processing system 230 can then store the received media data and / or transmit it to other user terminals connected to the network 220. Furthermore, the information processing system 230 can control the location-based avatar communication service or instant messaging service based on user input from the user terminal.

[0073] Figure 3 This is a block diagram illustrating the internal configuration of a user terminal and an information processing system according to an embodiment of the present disclosure. The user terminal 210 can refer to any computing device capable of wired / wireless communication, such as an application for location-based avatar communication or instant messaging, a web browser application, etc. For example, it may include... Figure 2The mobile terminal 210_1, tablet terminal 210_2, and PC terminal 210_3 are examples of such devices. As shown in the figure, the user terminal 210 may include a memory 312, a processor 314, a communication module 316, and an input / output interface 318. Similarly, the information processing system 230 may include a memory 332, a processor 334, a communication module 336, and an input / output interface 338. For example... Figure 3 As shown, the user terminal 210 and the information processing system 230 can be configured to communicate information and / or data via the network 220 using their respective communication modules 316 and 336. Additionally, the input / output device 320 can be configured to input information and / or data to the user terminal 210 via the input / output interface 318, or output information and / or data generated from the user terminal 210.

[0074] Memory 312, 332 may include any non-transitory computer-readable recording medium. According to one embodiment, memory 312, 332 may include non-volatile mass storage devices such as RAM (random access memory), ROM (read only memory), disk drives, SSDs (solid state drives), flash memory, etc. As other examples, non-volatile mass storage devices such as ROM, SSDs, flash memory, disk drives, etc., as separate permanent storage devices distinct from memory, may be included in user terminal 210 or information processing system 230. Additionally, memory 312, 332 may store an operating system and at least one program code (e.g., code for a location-based avatar communication or instant messaging application, etc., installed on user terminal 210 and driven).

[0075] The software components can be loaded from a computer-readable recording medium separate from the memories 312 and 332. This separate computer-readable recording medium may include recording media that can be directly connected to the user terminal 210 and the information processing system 230, such as computer-readable recording media including floppy disk drives, hard disks, magnetic tapes, DVD / CD-ROM drives, memory cards, etc. As another example, the software components may also be loaded into the memories 312 and 332 via a communication module that is not a computer-readable recording medium. For example, at least one program may be loaded into the memories 312 and 332 based on a computer program (e.g., an application for location-based avatar communication or instant messaging), which is installed via a file distribution system provided by the developer or the application's installation files through network 220.

[0076] Processors 314 and 334 can be configured to process computer program instructions by performing basic arithmetic, logic, and input / output operations. Instructions can be provided to processors 314 and 334 via memories 312 and 332 or communication modules 316 and 336. For example, processors 314 and 334 can be configured to execute received instructions based on program code stored in recording devices such as memories 312 and 332.

[0077] Communication modules 316 and 336 can provide the configuration or function for communication between user terminal 210 and information processing system 230 via network 220, and can provide the configuration or function for communication between user terminal 210 and / or information processing system 230 and other user terminals or other systems (for example, cloud systems, etc.). For example, under the control of communication module 316, requests or data (e.g., requests for generating open chat windows, voice data, etc.) can be transmitted to information processing system 230 via network 220. These requests or data are generated by processor 314 of user terminal 210 based on program code stored in a recording device such as memory 312. Conversely, control signals or instructions provided under the control of processor 334 of information processing system 230 can be received by user terminal 210 via communication module 316 through communication module 336 and network 220. For example, user terminal 210 can receive information about surrounding users (location information, profile information, avatar information, etc.) from information processing system 230.

[0078] The input / output interface 318 can be a unit for interfacing with the input / output device 320. As an example, the input device may include a camera, keyboard, microphone, mouse, etc., containing an audio sensor and / or an image sensor, and the output device may include a display, speaker, haptic feedback device, etc. As another example, the input / output interface 318 can be a unit for interfacing with a device, such as a touchscreen, that integrates input and output functions.

[0079] Figure 3 The input / output device 320 shown is not included in the user terminal 210, but it is not limited thereto and can be configured as a device with the user terminal 210. In addition, the input / output interface 338 of the information processing system 230 can be a unit for interfacing with a device (not shown) connected to the information processing system 230 or that may be included in the information processing system 230 for input or output. Figure 3 The input / output interfaces 318 and 338 are shown as elements that are independently constituted with the processors 314 and 334, but they are not limited thereto and can be configured to be included in the processors 314 and 334.

[0080] The user terminal 210 and the information processing system 230 may include a ratio Figure 3 The constituent elements are more numerous. However, it is not necessary to explicitly illustrate most of the constituent elements of the prior art. According to one embodiment, the user terminal 210 can be implemented to include at least a portion of the input / output devices 320 described above. In addition, the user terminal 210 may also include other constituent elements such as a transceiver, a GPS (Global Positioning system) module, a camera, various sensors, a database, etc. For example, when the user terminal 210 is a smartphone, it may include the constituent elements included in a typical smartphone. For example, the user terminal 210 may also include an accelerometer, a gyroscope sensor, a camera module, various physical buttons, buttons using a touch panel, input / output ports, a vibrator for vibration, and other various constituent elements.

[0081] According to one embodiment, the processor 314 of the user terminal 210 can be configured to run an application for location-based avatar communication or instant messaging, or a web browser application. In this case, program code related to the application can be loaded into the memory 312 of the user terminal 210. During application execution, the processor 314 of the user terminal 210 can receive information and / or data provided from the input / output device 320 via the input / output interface 318, or receive information and / or data from the information processing system 230 via the communication module 316, and can process the received information and / or data and store it in the memory 312. Additionally, the information and / or data can be provided to the information processing system 230 via the communication module 316.

[0082] During the operation of applications for location-based avatar communication or instant messaging, or web browser applications, processor 314 may receive text, images, videos, etc., input or selected via an input device such as a touch screen, keyboard, camera including an audio sensor and / or image sensor, microphone, etc., connected to input / output interface 318, and may store the received text, images, and / or videos in memory 312 or provide them to information processing system 230 via communication module 316 and network 220.

[0083] The processor 334 of the information processing system 230 may be configured to manage, process, and / or store information and / or data received from multiple user terminals and / or multiple external systems. In one embodiment, the processor 334 may store, process, and transmit location information, profile information, avatar information, etc., received from the user terminal 210. Further, or alternatively, the processor 334 may control location-based avatar communication services or instant messaging services in response to user input received from the user terminal 210.

[0084] Figure 4 This is an example illustrating a user-defined avatar and profile for use in a location-based avatar communication service, according to one embodiment. Figure 4 The diagram illustrates the first action step 410, the second action step 420, and the third action step 430 of the user terminal. The first action step 410 shows an example of a user selecting an avatar to use in a location-based avatar communication service. As shown, the user can select one of their previously generated avatars. For example, the user can select one of their previously generated avatars by using touch input or the like to select the first icon 412 displayed on the display. At this time, the avatar selected by the user can be displayed as that user's avatar on the terminals of other users in the vicinity using the same service.

[0085] In one embodiment, a user can generate a new avatar to use in a location-based avatar communication service. In this case, the user can decide on the face, body, and items (clothing, accessories, etc.) of the newly generated avatar. Additionally, users can decorate their avatars with paid items to make them more eye-catching than other users' avatars. For example, users can use the speech bubble item to add speech bubbles with specific text input around their avatar or add various visual objects or effects (e.g., an avatar glowing effect).

[0086] The second action step 420 illustrates an example of a user selecting one of previously generated profiles. As shown, the user can select one of previously generated profiles (Loki, Jo, Aims, Lesile, Jim) (Loki), and then select the second icon 422 to edit it. The profile may include information such as name, gender, age, etc. In other embodiments, the user can generate a new profile.

[0087] The third action step 430 illustrates an example of a user editing their profile. As shown, users can input / modify their name (e.g., an anonymous nickname), gender, age, occupation, hobbies, followed topics, etc., via touch input or other means. Users can input any profile information, thus maintaining anonymity while using location-based avatar messaging services. The profile used by a user in the location-based avatar messaging service can differ from the profile used in the instant messaging application.

[0088] In one embodiment, a user can authenticate a portion of their profile information (e.g., gender, age, etc.). In this case, the authenticated information in the user's profile, i.e., information consistent with the user's actual information, can be displayed differently from other information for distinction. For example, an authentication icon can be marked around the authenticated information in the user's profile, or the authenticated information can be represented by a different color, font, or font size. In one embodiment, the user can authenticate a portion of their profile information through services other than the avatar communication service (e.g., instant messaging service, mobile SMS authentication service, etc.). Alternatively or further, the user can automatically input some or all of the personal information authenticated in services other than the avatar communication service into the profile of the avatar communication service. With this configuration, other users can easily confirm that the information in the user's profile is consistent with the user's actual information.

[0089] Furthermore, or as an alternative, users can choose to make part or all of their profile information public or private. For example, a user can choose to only disclose their name, gender, and followed topics in their profile. In other examples, a user can choose to only share their profile information with other users who share the same followed topics or are of the opposite sex.

[0090] Figure 5 This is an example illustrating a user selecting an avatar and profile picture to initiate a location-based avatar communication service according to an embodiment of the present disclosure. Figure 5 The figure illustrates the first operation step 510, the second operation step 520, and the third operation step 530 of the user terminal. The first operation step 510 shows an example of a user selecting an avatar to use in a location-based avatar communication service. As shown, the user can select one of their previously generated avatars by selecting an icon 512 displayed on the display unit through touch input or the like.

[0091] The second operation step 520 illustrates an example of a user selecting one of previously generated profiles. As shown, the user can select one of the previously generated profiles (Loki, Jo, Aims, Lesile, Jim) by using touch input or other means to select area 522. In one embodiment, the user's most recently used profiles can be displayed at the top of the profile list.

[0092] The third operation step 530 illustrates an example of a user in response to selecting area 522, initiating a location-based avatar communication service. When the avatar communication service is initiated, the user terminal's image sensor is activated, and an image captured by the image sensor can be displayed on the display unit. Additionally, the avatars of other users located around the user can be overlaid on the image of the real-world space captured by the image sensor.

[0093] Specifically, when the avatar communication service is started, the user terminal can send messages to external systems (e.g., Figure 2 The information processing system transmits its own location information. Additionally, it can transmit the user-defined avatar and profile information to external systems. In this case, the external system can use the user terminal's location information and the location information of other user terminals to transmit information about other users located around the user (e.g., other users' location information, profile information, avatar images, etc.). Thus, the user terminal can display the avatars of other users located around the user on its display.

[0094] Figure 6 This is an example illustrating how a user changes the zoom level of an image sensor to change the avatar displayed on a display unit, according to an embodiment of the present disclosure. Figure 6The figure illustrates a first operation step 610 and a second operation step 620 of the user terminal. The first operation step 610 shows an example of the user terminal displaying a first enhanced image with a first set of headshots 612_1, 612_2, 612_3, and 612_4 superimposed. As shown, the user terminal can receive user input (multi-touch input, zoom gestures, etc.) to increase the FOV (Field of View) of the image sensor (i.e., zoom out).

[0095] In one embodiment, the size of each of the first set of avatars 612_1, 612_2, 612_3, and 612_4 displayed on the first enhanced screen can be determined based on the distance between the avatars and other users associated with them and the user terminal. For example, the avatar associated with another user located 150m away from the user terminal can be displayed as larger than the avatar associated with another user located 200m away from the user terminal. With this configuration, the user can roughly estimate the relative positions of other users based on the size of the avatars.

[0096] The second operation step 620 illustrates an example of a second enhanced image superimposed with a second set of headshots 612_1, 612_2, 612_3, 612_4, 622_1, and 622_2, in response to receiving user input for increasing the FOV (Field of View) of the image sensor. As shown, the real-space image of the second enhanced image includes an image of the real-space taken from the same direction as the first enhanced image through a wider viewing angle. Furthermore, with the increase in the FOV of the image sensor, the second enhanced image may include new headshots 622_1 and 622_2. These new headshots 622_1 and 622_2 may be headshots of a user that are not included in the FOV of the first enhanced image but are included in the FOV of the second enhanced image.

[0097] Furthermore, or as an alternative, as the FOV of the image sensor increases, the heads of users located beyond a certain distance in the first set of heads 612_1, 612_2, 612_3, and 612_4 may not be displayed. For example, the first enhanced image may display the heads of other users within 200m, and conversely, the second enhanced image may display the heads of other users within 150m. That is, inversely proportional to the increase in the FOV of the image sensor, the depth of field of the heads displayed on the display unit can be reduced.

[0098] Figure 6The illustration shows an example of a user increasing the FOV (field of view) of the image sensor (reducing it); however, the user can also decrease the FOV (magnifying) of the image sensor. In this case, a third enhanced image, captured from the real space in the same direction as the first enhanced image but with a narrower viewing angle, can be displayed on the display unit. As the FOV decreases, the third enhanced image can include a third set of headshots from the first set of headshots 612_1, 612_2, 612_3, and 612_4 after removing a portion of the headshots. The headshots removed from the third enhanced image can be the user's headshot, which is included in the FOV of the first enhanced image but not in the FOV of the third enhanced image.

[0099] Furthermore, or as an alternative, as the FOV of the image sensor decreases, the third enhanced image can include heads located at a greater distance that are not included in the first enhanced image. For example, the first enhanced image could display heads of other users within 200m, while the third enhanced image could display heads of other users within 250m. That is, inversely proportional to the decrease in the FOV of the image sensor, the depth of field of the heads displayed on the display unit can increase.

[0100] In this disclosure, user input for changing the zoom level of the image sensor can refer to touch input on the display unit, but is not limited to this. For example, a user can change the zoom level of the image sensor using a physical button on the user terminal. As another example, the user terminal can change the zoom level of the image sensor through user gestures detected by the image sensor.

[0101] Furthermore, or as an alternative, as the user changes the shooting direction of the image sensor, the user terminal can display on the display a fourth enhanced image of the real space captured in a different direction than the first enhanced image. In this case, the fourth enhanced image may include a second set of headshots different from the first set of headshots. The second set of headshots may be headshots of other users located within a predetermined distance in the changed direction of the image sensor.

[0102] With this configuration, users can locate other users in the real world without moving, by adjusting the image sensor's shooting direction and zoom level. Furthermore, by observing the addition or removal of avatars as the image sensor's shooting direction and zoom level change, users can determine the approximate location in real space of other users corresponding to those avatars.

[0103] Figure 7 This is an example illustrating how a user selects an avatar and confirms profile information of an interested user according to an embodiment of the present disclosure. Figure 7The diagram illustrates a first operation step 710, a second operation step 720, and a third operation step 730 of a user terminal. The first operation step 710 illustrates an example of a user selecting one of multiple avatars 712 displayed on the display unit via touch input or the like.

[0104] The second operation step 720 illustrates an example of displaying the user's profile information associated with the avatar 712 in response to the user selecting the avatar 712. In one embodiment, the user's profile information 722 associated with the avatar 712 can be displayed on the display in the form of a balloon icon. For example, the profile information 722 may include the avatar's facial image, name (e.g., anonymous), rating (e.g., number of stars, number of likes, etc.), age, gender, occupation, etc. The user selects the profile information 722 displayed on the display via touch input or the like, thereby navigating to the detailed profile page of the user associated with the selected avatar 712.

[0105] The third operation step 730 illustrates an example where, in response to the user selecting profile information 722, the user terminal displays a detailed profile page of the user associated with the selected avatar 712 on the display unit. The profile page screen may include profile information, icons 732 and 734 for giving rating scores, and icons 736 and 738 for communicating with the user associated with the avatar. In one embodiment, the user can select the first icon 732 via touch input or the like to give the user associated with the avatar 712 a star rating (e.g., etiquette score) or confirm the star ratings for various items of the user associated with the avatar 712 (e.g., response speed, chat etiquette, call etiquette, etc.). Further, or alternatively, the user can select the second icon 734 via touch input or the like to click "like" on the user associated with the avatar 712.

[0106] In one embodiment, a user can select a third icon 736 to send a message to the user associated with avatar 712. In this case, to ensure the anonymity of users using the location-based avatar communication service, an open chat window can be generated on the instant messaging application for the user associated with avatar 712. In other embodiments, a user can select a fourth icon 738 to initiate a voice or video call with the user associated with avatar 712. In this case, to ensure the anonymity of users using the location-based avatar communication service, the user uses the avatar for video calls.

[0107] Figure 8This illustration shows an example of adding graphic objects around an avatar according to an embodiment of the present disclosure, based on the rating score given to the avatar. As shown, graphic objects 812 can be displayed on avatars associated with users who have a rating score above a predetermined threshold among users in the vicinity of the user. For example, when the rating score given to the user associated with the avatar is within a first range (e.g., 3 to 4 stars or 500 to 1000 "likes"), a heart icon can be displayed above the face of the avatar. Similarly, when the rating score given to the user associated with the avatar is within a second range (e.g., 4 to 4.5 stars or 1000 to 2000 "likes") and within a third range (e.g., 4.5 to 5 stars or more than 2000 "likes"), two heart icons and three heart icons can be displayed respectively. With the configuration described above, the user can easily confirm the rating scores of surrounding users by referring to the graphic objects displayed around the avatar on the display unit.

[0108] In one embodiment, the size of the avatar can be determined based on the rating score given by the user associated with the avatar. For example, the avatar of a user with a high rating score can be displayed larger than the avatar of a user with a low rating score. Alternatively, or further, the face size of the avatar of a user with a high rating score can be displayed larger than the face size of the avatar of a user with a low rating score. In this case, the avatars can be displayed with the same body size but different face sizes. With this configuration, users can more easily grasp the avatars of other users with high rating scores in the enhanced display.

[0109] Furthermore, when a user terminal receives messages, voice call requests, etc., from other users on instant messaging applications, it can display graphic objects related to the location of those other users. For example, when a user terminal receives a message from another user, it can display graphic objects (e.g., envelope icons, etc.) around the other user's avatar 810. In other examples, when receiving a message from another user whose avatar is not displayed on the display, the user terminal can overlay graphic objects (e.g., arrow icons, etc.) pointing in the direction of that other user's location in real space on the display. With this configuration, the user can grasp the approximate location in real space of the other user sending them a message through the enhanced screen.

[0110] Figure 9 This is an example illustrating a user's confirmation of their own rating score, determined by feedback from other users, according to an embodiment of the present disclosure. Figure 9The diagram illustrates the first operation step 910, the second operation step 920, and the third operation step 930 of the user terminal. The first operation step 910 shows an example of a user selecting the first region 912 to confirm the rating score given by a profile (Loki) among previously generated profiles (Loki, Jo, Aims, Lesile, Jim).

[0111] The second operation step 920 illustrates an example of displaying the star rating of the selected profile (Loki) on the display unit in response to the user selecting the first area 912. In one embodiment, the display unit may display the star ratings for each item given to the selected profile. For example, the star ratings for each item may include star ratings for quick response, good chat manners, good phone manners, etc. Furthermore, the display unit may also display an average star rating calculated based on the star ratings for each item. By confirming the star ratings for each item and the average star rating given to them, users can confirm the evaluations of themselves by other users in the location-based avatar communication service.

[0112] The third operation step 930 illustrates an example of displaying information related to "Likes" clicked on the selected profile on the display unit in response to the user selecting the second area 922. In one embodiment, the user can check the number of "Likes" their profile has received (e.g., 1300 likes). Further, or alternatively, the user can check a list of other users' profiles that have clicked "Likes" on their profile in the third area 932. This list of other users' profiles may include each user's avatar image, name (e.g., nickname), and other information.

[0113] Furthermore, users can also select from other users' profile lists via touch input, confirm the profile's details (e.g., name, age, gender, hobbies, occupation, topics of interest, etc.), and start a chat or voice / video call with that user. Through this mechanism, users can identify individuals who have expressed interest in their profile picture and attempt to communicate with them even if that individual is not currently nearby.

[0114] Furthermore, users can be provided with a list of recommended users who have given them a star rating or "liked" their profile picture within a certain period. For example, a user can be provided with a list of other users whose profiles are highly similar to their own based on the profile information (e.g., gender, region, age, hobbies, occupation, topics of interest, etc.) of other users who have given them a certain star rating (e.g., 4 stars or higher) within a week. Alternatively, users can be provided with a list of other users whose profiles are highly similar to their own based on the profile information (e.g., gender, region, age, hobbies, occupation, topics of interest, etc.) of other users who have clicked "like" on them within a week. In one embodiment, the information about recommended users can be provided in list form or in profile picture form on the enhanced screen. With this configuration, users can easily identify users with many similarities from other users who have a positive impression of them without further effort.

[0115] Figure 10 This is an example illustrating a user blocking or reporting other users according to an embodiment of this disclosure. Figure 10 The diagram illustrates the first operation step 1010, the second operation step 1020, and the third operation step 1030 of the user terminal. The first operation step 1010 shows an example of a user selecting the first area 1012 in order to block or report other users.

[0116] The second operation step 1020 illustrates an example of displaying a second area 1022 for reporting other users and a third area 1024 for blocking other users on the display unit. Users can select the second area 1022 via touch input or the like to report inappropriate behavior by other users to a location-based avatar communication service provider. Alternatively, or further, users can block other users by selecting the third area 1024.

[0117] The third operation step 1030 illustrates an example where a user selects either the second area 1022 or the third area 1024 via touch input, thereby preventing the display of the avatars of other users who have been blocked or reported on the user's terminal. In this case, even if the blocked or reported user is within a predetermined distance (e.g., 200m) in the direction the user's terminal is shooting, that user's avatar may not be displayed on the user's terminal. Further, or as an alternative, the user's avatar may not be displayed on the terminal of the blocked or reported user. Further, or as an alternative, the blocked or reported user's use of location-based avatar communication services may be restricted to some or all of the services. Further, or as an alternative, the blocked or reported user may be prohibited from sending messages or making calls to the user.

[0118] In one embodiment, a user can view a list of other users they have blocked or reported, and unblock or unreport some or all other users. In this case, the avatars of the unblocked or unreported users can be redisplayed on the user's device. Additionally, the user's avatar can be redisplayed on the devices of the unblocked or unreported users.

[0119] Figure 11 This illustrates an example of a user making a voice call with another user using an avatar according to an embodiment of the present disclosure. In one embodiment, the user can select one of the avatars of surrounding users displayed on an enhanced screen and make a voice call with the user associated with that avatar. In this case, during the voice call, the other party's avatar 1110 and the user's avatar 1120 can be displayed on the display unit.

[0120] In one embodiment, the actions of the other party's avatar 1110 can be controlled based on the other party's voice data. For example, the mouth shape and facial expressions of the other party's avatar 1110 can be controlled based on the other party's voice data. Similarly, the actions of the user's avatar 1120 can be controlled based on the user's voice data. With this configuration, users utilizing the location-based avatar communication service can conduct video calls using avatar images without revealing their faces.

[0121] Figure 12 This illustrates a method for providing location-based avatar communication services according to an embodiment of the present disclosure. In one embodiment, the method 1200 for providing location-based avatar communication services can be executed by a user terminal (e.g., at least one processor of the user terminal). The method 1200 may begin with step S1210, which transmits the location information of the user terminal to an external system.

[0122] Then, the user terminal can receive information about users located in the vicinity of the user terminal from an external system (S1220). This information may include the user's location information, profile information, avatar information, etc. Additionally, the user terminal can receive at least one image from its image sensor (S1230).

[0123] In response to receiving at least one image, the user terminal may overlay avatars associated with surrounding users onto the at least one image and display them on the display unit of the user terminal (S1240). For example, the user may overlay a first set of avatars associated with surrounding users onto at least one image and display them on the display unit. The first set of avatars may be avatars associated with users located within a predetermined distance in the direction of image sensor capture among the surrounding users. Further, or alternatively, the first set of avatars displayed on the display unit may be determined based on evaluation scores associated with surrounding users.

[0124] In one embodiment, the size of each of the first set of avatars displayed on the display unit can be determined based on the distance between surrounding users and user terminals. Further, or alternatively, the position of each of the first set of avatars displayed on the display unit can be determined based on the distance between surrounding users and user terminals. Further, or alternatively, the facial size of each of the first set of avatars displayed on the display unit can be determined based on rating scores associated with surrounding users. Further, or alternatively, the size of each of the first set of avatars displayed on the display unit can be determined based on rating scores associated with surrounding users.

[0125] Then, the user terminal can receive a selection of one of the avatars displayed on the display (S1250). In this case, the user terminal can display the user's profile information associated with the selected avatar on the display (S1260). Additionally, the user terminal can send a request to an external system to generate a chat window for the user associated with the selected avatar on an instant messaging application (S1270). The chat window can be an open chat window that minimizes the exposure of personal information.

[0126] Furthermore, or as an alternative, the user terminal can transmit a request to an external system for the user associated with the selected avatar to conduct a voice call on an instant messaging application. In this case, the user terminal can display the selected avatar on the display during the voice call, and can control the movement of the selected avatar displayed on the display based on the voice data of the other party in the voice call.

[0127] The methods, operations, or techniques disclosed herein can be implemented by various entities. For example, the techniques can also be implemented by hardware, firmware, software, or a combination thereof. Those skilled in the art will understand that the various exemplary logical blocks, modules, circuits, and algorithm steps described in connection with this disclosure can also be implemented by electronic hardware, computer software, or a combination of both. To clearly illustrate this substitution between hardware and software, various exemplary components, blocks, modules, circuits, and steps have been described above from a functional point of view. Whether the function is implemented in hardware or software depends on the design requirements imposed on a particular application and the system as a whole. Those skilled in the art can also implement the described functions in various ways for various specific applications; however, such implementations should not be construed as departing from the scope of this disclosure.

[0128] In the hardware implementation, the processing unit used to perform the technique may also be implemented within one or more ASICs (Application-Specific Integrated Circuits), DSPs (Digital Signal Processors), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), processors, controllers, microcontrollers, microprocessors, electronic devices, other electronic units designed to perform the functions described in this disclosure, computers, or combinations thereof.

[0129] Therefore, the various exemplary logic blocks, modules, and circuits described in connection with this disclosure can also be implemented or performed by a general-purpose processor, DSP, ASIC, FPGA, or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination designed to perform the functions described herein. The general-purpose processor can also be a microprocessor; alternatively, the processor can be any existing processor, controller, microcontroller, or state machine. The processor can also be implemented by a combination of computing devices, such as a DSP and a microprocessor, multiple microprocessors, one or more microprocessors associated with a DSP core, or any other combination thereof.

[0130] In firmware and / or software implementations, the techniques can also be implemented by instructions stored on a computer-readable medium such as random access memory (RAM), read-only memory (ROM), non-volatile random access memory (NVRAM), PROM (programmable read-only memory), EPROM (erasable programmable read-only memory), EEPROM (electrically erasable PROM), flash memory, compact disc (CD), electromagnetic or optical data storage devices, etc. The instructions can also be executed by more than one processor, or can cause the processor to perform specific configurations of the functions described in this disclosure.

[0131] The embodiments described above utilize the form of the currently disclosed subject matter in one or more standalone computer systems; however, this disclosure is not limited thereto and can also be implemented in conjunction with any computing environment such as a network or distributed computing environment. Furthermore, in this disclosure, the form of the subject matter can also be implemented in multiple processing chips or devices, and memory can be similarly affected by multiple devices. These devices may also include PCs, network servers, and portable devices.

[0132] This specification describes a subset of embodiments; however, various modifications and alterations can be made without departing from the scope of this disclosure, as will be understood by those skilled in the art. Furthermore, such modifications and alterations should be considered to fall within the scope of the appended claims.

Claims

1. A method for providing location-based avatar communication services executed by a user terminal, the method comprising: The step of transmitting the location information of the user terminal to an external system; The step of receiving information about users located around the user terminal from the external system; The step of receiving at least one image from the image sensor of the user terminal; The step of overlaying a first set of avatars associated with users located around the user terminal onto the at least one image and displaying them on the display of the user terminal; The step of receiving a selection of one of the first group of avatars displayed on the display unit; The step of transmitting a request to the external system for generating an open chat window on an instant messaging application associated with a selected avatar, wherein the open chat window is a chat window that minimizes the exposure of personal information and does not disclose the basic profile information set by the user on the instant messaging application to other users within the open chat window. In response to receiving user input, the step of transmitting a request to the external system to convert the open chat window into a regular chat window; In response to the open chat window being converted into the general chat window, the steps of changing the user's profile information in the chat window from virtual profile information set for the avatar to actual personal account profile information and displaying it; and The step of disclosing the virtual profile information only to a subset of users in the surrounding user base, as determined by the similarity of the profile information.

2. The method for providing location-based avatar communication services according to claim 1 further includes: The step of receiving a selection of one of the first group of avatars displayed on the display unit; as well as The steps to display the profile information of the user associated with the selected avatar on the display panel.

3. The method for providing location-based avatar communication services according to claim 1 further includes: The step of receiving a selection of one of the first group of avatars displayed on the display unit; as well as The step of transmitting a request to the external system to perform a voice call on an instant messaging application associated with the selected avatar.

4. The method for providing location-based avatar communication services according to claim 3 further includes: The step of displaying the selected avatar on the display unit during the voice call. Based on the voice data of the other party in the voice call, the action of the selected avatar displayed on the display unit is controlled.

5. The method for providing location-based avatar communication services according to claim 1, wherein, The first set of avatars consists of avatars associated with users located in the surrounding area and within a predetermined distance in the direction of the image sensor.

6. The method for providing location-based avatar communication services according to claim 1, wherein, The size of each of the first group of avatars displayed on the display is determined based on the distance between the users located in the vicinity and the user terminal.

7. The method for providing location-based avatar communication services according to claim 1, wherein, The position of each of the first group of avatars displayed on the display is determined based on the distance between the users in the vicinity and the user terminal.

8. The method for providing location-based avatar communication services according to claim 1, wherein, The facial size of each of the first group of avatars displayed on the display is determined based on the rating scores associated with users in the vicinity.

9. The method for providing location-based avatar communication services according to claim 1, wherein, The size of each of the first group of avatars displayed on the display is determined based on the rating scores associated with users in the surrounding area.

10. The method for providing location-based avatar communication services according to claim 1, wherein, The first set of avatars to be displayed on the display unit is determined based on the rating scores associated with users in the surrounding area.

11. The method for providing location-based avatar communication services according to claim 1, further comprising: The step of displaying a first graphical object on the avatar of a user associated with a predetermined threshold rating score among the users in the surrounding area.

12. The method for providing location-based avatar communication services according to claim 1, further comprising: The step of overlaying a second set of avatars associated with a user located in the vicinity onto the at least one image in response to a change in the direction of the image sensor, and displaying them on the display of the user terminal.

13. The method for providing location-based avatar communication services according to claim 1, further comprising: The step of overlaying a third set of avatars associated with the user located in the vicinity onto the at least one image in response to a change in the zoom level of the image sensor, and displaying them on the display of the user terminal.

14. The method for providing location-based avatar communication services according to claim 1, further comprising: The step of receiving the filtering criteria, overlaying a fourth set of avatars associated with users in the surrounding area who meet the filtering criteria, and displaying them on the display of the user terminal.

15. The method for providing location-based avatar communication services according to claim 1, further comprising: The step of receiving input for masking one of the first group of avatars displayed on the display unit; as well as The step of not displaying the blocked avatar on the display unit.

16. The method for providing location-based avatar communication services according to claim 1, further comprising: The step of displaying a second graphic object related to the location of the other user overlaid on the at least one image when receiving a message from another user on an instant messaging application, on the display unit.

17. A computer-readable recording medium having a computer program recorded thereon for performing the method according to any one of claims 1 to 16 on a computer.

18. A location-based avatar communication service providing device, comprising: Communication module; Memory; Image sensor; Display section; as well as At least one processor is configured to be connected to the memory and to run at least one computer-readable program contained in the memory. The at least one program includes instructions for performing the following actions: Transmit the location information of the device to external systems. Receive information about users located around the device from the external system. Receive at least one image from the image sensor Overlaying a first set of avatars associated with users located around the at least one image onto the display unit, and displaying them on the display unit. Receive selection of one of the first group of avatars displayed on the display unit. A request is sent to the external system to generate an open chat window on the instant messaging application associated with the selected avatar, wherein the open chat window is a chat window that minimizes the exposure of personal information and does not disclose the user's basic profile information set on the instant messaging application to other users within the open chat window. In response to receiving user input, a request is sent to the external system to convert the open chat window into a regular chat window. In response to the open chat window being converted into the regular chat window, the user's profile information within the chat window is changed from virtual information set for the avatar to actual personal account information and displayed. The virtual profile information is only disclosed to a subset of users in the surrounding area, as determined by the similarity of the profile information.

Citation Information

Patent Citations

  • Portable telephone terminal having animation function and its control method

    JP2005064939A

  • Communication terminal device and computer program

    JP2007129609A

  • Augmented reality messenger providing system and controlling method thereof

    KR1020110057298A

  • System for providing location based mobile communication service using augmented reality

    KR1020110072438A