Method and system for providing a chat room in three-dimensional form and non-transitory computer-readable recording medium
By identifying the screen conversion events related to chat rooms in the electronic device and converting them into three-dimensional space, using position information and status information to express the distance and status between the user and the chat object in the three-dimensional space, the problem of difficulty in adjusting depth and displaying state information in the prior art is solved, and efficient three-dimensional chat room interaction is achieved.
Patent Information
- Application Number
- CN201880086864.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2018-02-08
- Publication Date
- 2025-05-02
- Estimated Expiration
- 2038-02-08
AI Technical Summary
The prior art is difficult to adjust depth in a chat room using three-dimensional technology to express the status information of the chat object, and it is difficult to output the corresponding status information by tracking the user's line of sight.
By identifying the screen conversion events related to the chat room in the electronic device, it is converted into a three-dimensional space, and using the location information and the status information of the chat object to express the distance and state between the user and the chat object in the three-dimensional space.
It realizes that the chat room is displayed in a three-dimensional mode with adjustable depth in the chat room, which can effectively express the distance and status information between the user and the chat object, and output the corresponding status information by tracking the user's sight, improving the intuitiveness and effectiveness of the interaction.
Smart Images

Figure CN111630556B_ABST
Abstract
Description
Technical Field
[0001] The following description relates to techniques for displaying a chat room. Background Art
[0002] Generally, instant messaging software (instant messenger) as a communication tool can be software that can send and receive messages or data in real time. A user can log in to a chat partner on the messaging software and can send and receive messages in real time with the other party on the chat partner list.
[0003] The use of such communication software functions has become popular in the mobile environment of personal computers PCs and mobile communication terminals.
[0004] For example, Korean Patent Publication No. 10-2002-0074304 (published on September 30, 2002) discloses a mobile communication software service system and method for mobile terminals using a wireless communication network that can provide communication software services between mobile communication software installed in the mobile terminals. Summary of the invention
[0005] Technical issues
[0006] The chat room can be represented in a three-dimensional mode with adjustable depth using three-dimensional technology.
[0007] The distance to the chat partner can be expressed as depth information in three-dimensional space.
[0008] Status information related to the chat object can be expressed in three-dimensional space.
[0009] The status information of the chat object corresponding to the user's line of sight may be output by tracking the user's line of sight to the chat room.
[0010] Technical Solution
[0011] The present invention provides a chat room display method, which is executed in an electronic device and is characterized in that the electronic device includes at least one processor configured to execute multiple computer-readable instructions contained in a memory, and the chat room display method includes: an identification step, identifying a screen conversion event related to a chat room displayed on the electronic device through at least one of the above processors; a conversion step, converting the screen according to the screen conversion event through at least one of the above processors so as to display the chat room in the form of a three-dimensional space; and a representation step, representing the distance between the user of the electronic device and the chat object through the depth information of the above three-dimensional space based on the position information of the electronic device and the position information of at least one chat object contained in the chat room through at least one of the above processors.
[0012] According to one embodiment, the recognition step may include: if a preset gesture is input into the chat room, recognizing it as the screen transition event.
[0013] According to still another embodiment, the identification step may include: identifying the screen conversion event related to the chat room based on time information or location information set in the chat room.
[0014] According to another embodiment, the identification step may include: identifying the screen conversion event related to the chat room based on the location information of the electronic device and the location information of at least one chat object included in the chat room.
[0015] According to another embodiment, the conversion step may include: a step of changing the chat room to a three-dimensional space with depth information for display according to the screen conversion event; and a step of adjusting the depth of the three-dimensional space according to a prescribed gesture related to the three-dimensional space.
[0016] According to another embodiment, the above-mentioned expression step may include: expressing the distance between the above-mentioned user and the above-mentioned chat object in the above-mentioned three-dimensional space by using depth information between a user icon representing the above-mentioned user and an object icon representing the above-mentioned chat object.
[0017] According to another embodiment, the above-mentioned expression step may include: distinguishing the movement type of the above-mentioned chat object based on the movement speed or movement path based on the location information of the above-mentioned chat object, and displaying the movement status icon of the corresponding movement type at a position adjacent to the above-mentioned object icon.
[0018] According to another embodiment, the presenting step may include: when a new message is received from the chat object, displaying the new message at a position adjacent to the object icon for a specified time.
[0019] According to another embodiment, the presenting step may include: in a case where a new message received from the chat object is processed as an unconfirmed message, displaying an identifier representing the unconfirmed message at a position adjacent to the object icon.
[0020] According to another embodiment, the presenting step may include: displaying an icon representing other services being used by the chat object at a position adjacent to the object icon.
[0021] According to another embodiment, the above-mentioned performance step may include: tracking the line of sight of the above-mentioned user to the above-mentioned three-dimensional space, and outputting the content being used by the chat object corresponding to the line of sight of the above-mentioned user in the above-mentioned other services through the output device of the above-mentioned electronic device.
[0022] The present invention provides a non-transitory computer-readable recording medium having recorded thereon a program for executing the chat room display method in a computer.
[0023] The present invention provides a chat room display system, which is implemented in an electronic device and is characterized in that it includes: a memory; and at least one processor, connected to the memory and configured to execute multiple computer-readable instructions contained in the memory, at least one of the processors including: an event recognition unit, used to recognize a screen conversion event related to a chat room displayed on the electronic device; a screen conversion unit, which converts the screen according to the screen conversion event so as to display the chat room in the form of a three-dimensional space; and an information output unit, which outputs status information related to at least one chat object contained in the chat room in the three-dimensional space, the information output unit uses the position information of the electronic device and the position information of the chat object as a basis to express the distance between the user of the electronic device and the chat object using the depth information of the three-dimensional space. BRIEF DESCRIPTION OF THE DRAWINGS
[0024] Figure 1 A diagram showing an example of a network environment according to an embodiment of the present invention.
[0025] Figure 2 The present invention is a block diagram for describing the internal structure of an electronic device and a server according to an embodiment of the present invention.
[0026] Figure 3 The present invention is a block diagram showing an example of structural elements that may be included in a processor of an electronic device according to an embodiment of the present invention.
[0027] Figure 4 The flowchart is a flowchart showing an example of a method that can be executed by an electronic device according to an embodiment of the present invention.
[0028] Figures 5 and 6 The diagram is an example diagram for explaining a process of displaying a chat room in a three-dimensional form according to an embodiment of the present invention.
[0029] Figures 7 to 13 The diagram is used to illustrate a process of displaying status information in a three-dimensional space of a chat room according to an embodiment of the present invention. DETAILED DESCRIPTION
[0030] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.
[0031] An embodiment of the present invention relates to a technology for representing a chat room as a chat interface screen, and more specifically, to a technology for representing a chat room in a three-dimensional mode with adjustable depth.
[0032] An embodiment including the contents specifically disclosed in this specification can present a chat room in a three-dimensional mode with adjustable depth, thereby having many advantages in terms of intuitiveness, effectiveness, scalability, convenience, etc.
[0033] Figure 1 A diagram showing an example of a network environment according to an embodiment of the present invention. Figure 1 The network environment shown in FIG. 1 includes a plurality of electronic devices 110, 120, 130, 140, a plurality of servers 150, 160, and a network 170. Figure 1 For the purpose of illustrating an example of the present invention, the number of electronic devices or the number of servers is not limited to Figure 1 shown.
[0034] The multiple electronic devices 110, 120, 130, 140 may be fixed terminals or mobile terminals implemented by a computer system. Examples of the multiple electronic devices 110, 120, 130, 140 include smart phones, mobile phones, navigation, computers, laptops, digital broadcast terminals, personal digital assistants (PDA), portable multimedia players (PMP), tablet computers, game consoles, wearable devices, Internet of Things (IoT) devices, virtual reality (VR) devices, augmented reality (AR) devices, etc. As an example, Figure 1 In the figure, the shape of a smartphone is shown as an example of the electronic device 110, but in the embodiment of the present invention, in essence, the electronic device 110 can be one of a variety of physical computer systems that can communicate with other electronic devices 120, 130, 140 and / or servers 150, 160 through a network 170 using wireless or wired communication methods.
[0035] The communication method is not limited, and may include a communication method using a communication network that the network 170 can include (for example, a mobile communication network, a wired Internet, a wireless Internet, a broadcast network, a satellite network, etc.) and short-range wireless communication between multiple devices. For example, the network 170 may include one or more of a personal area network (PAN), a local area network (LAN), a campus area network (CAN), a metropolitan area network (MAN), a wide area network (WAN), a broadband network (BBN), the Internet, and the like. Furthermore, the network 170 may include any one or more of a network topology structure including a bus network, a star network, a ring network, a mesh network, a star bus network, a tree or hierarchical network, etc., but is not limited thereto.
[0036] Each server 150, 160 may be implemented as a computer device or multiple computer devices that communicate with multiple electronic devices 110, 120, 130, 140 through a network 170 to provide instructions, codes, files, content, services, etc. For example, the server 150 may be a system that provides a first service to multiple electronic devices 110, 120, 130, 140 connected through the network 170, and the server 160 may also be a system that provides a second service to multiple electronic devices 110, 120, 130, 140 connected through the network 170. As a more specific example, the server 150 may provide the service required by the corresponding application (for example, communication software service, etc.) as a first service to multiple electronic devices 110, 120, 130, 140 through an application of a computer program installed in multiple electronic devices 110, 120, 130, 140 to drive. As another example, the server 160 may provide a service for distributing files for installing and driving the above-mentioned application to multiple electronic devices 110, 120, 130, 140 as a second service.
[0037] Figure 2 The present invention is a block diagram for describing the internal structure of an electronic device and a server according to an embodiment of the present invention. Figure 2 In the embodiment, the internal structures of the electronic device 110 and the server 150 are described as examples of electronic devices. In addition, other electronic devices 120, 130, 140 or the server 160 may also have the same or similar internal structures as the electronic device 110 or the server 150 described above.
[0038] The electronic device 110 and the server 150 may include memories 211, 221, processors 212, 222, communication modules 213, 223, and input / output interfaces 214, 224. The memories 211, 221, as non-temporary computer-readable recording media, may include permanent mass storage devices such as random access memory (RAM), read-only memory (ROM), disk drives, solid state drives (SSD), flash memory, etc. Among them, permanent mass storage devices such as read-only memory, flash memory, disk drives, etc. are additional permanent storage devices distinguished from the memories 211, 221, and may be included in the electronic device 110 or the server 150. In addition, the memories 211, 221 may store an operating system and at least one program code (as an example, a browser installed in the electronic device 110 to drive or an application installed in the electronic device 110 to provide a specific service, etc.). Such software structural elements may be loaded from a computer-readable recording medium different from the memories 211, 221. Such additional computer-readable recording media may include computer-readable recording media such as floppy disk drives, disks, tapes, DVD / CD-ROM drives, and memory cards. In another embodiment, the software structural elements may be loaded into the memories 211 and 221 via the communication modules 213 and 223, rather than via computer-readable recording media. For example, at least one program may be loaded into the memories 211 and 221 based on a computer program (for example, the above-mentioned application) installed from a file provided by a developer or a file distribution system (for example, the above-mentioned server 160) that distributes the installation file of the application via the network 170.
[0039] The processors 212 and 222 may be configured to perform basic arithmetic, logic, and input / output operations to process instructions of a computer program. The instructions may be provided to the processors 212 and 222 via the memory 211 and 221 or the communication modules 213 and 223. For example, the processors 212 and 222 may be configured to execute received instructions according to program codes stored in a recording device such as the memory 211 and 221.
[0040] The communication modules 213 and 223 may provide a function for the electronic device 110 to communicate with the server 150 through the network 170, and may provide a function for the electronic device 110 and / or the server 150 to communicate with other electronic devices (for example, the electronic device 120) or other servers (for example, the server 160). For example, the request generated by the processor 212 of the electronic device 110 according to the program code stored in the recording device such as the memory 211 may be transmitted to the server 150 through the network 170 according to the control of the communication module 213. On the contrary, the control signal or instruction, content, file, etc. provided according to the control of the processor 222 of the server 150 may be transmitted to the electronic device 110 through the communication module 213 of the electronic device 110 through the communication module 223 and the network 170. For example, the control signal or instruction, content, file, etc. of the server 150 received through the communication module 213 may be transmitted to the processor 212 or the memory 211, and the content or file, etc. may be stored in the storage medium (the above-mentioned permanent storage device) that the electronic device 110 may also include.
[0041] The input-output interface 214 may be a unit for providing a connection with the input-output device 215. For example, the input device may include a keyboard, a mouse, a microphone, a camera, and the like, and the output device may include a display, a speaker, a haptic feedback device, and the like. As another example, the input-output interface 214 may be a unit for connecting with a device such as a touch screen that combines the functions of input and output into one. The input-output device 215 may be formed as one device with the electronic device 110. Furthermore, the input-output interface 224 of the server 150 may be a unit for connecting with a device (not shown) for input or output that is connected to the server 150 or that the server 150 may include. As a more specific example, in the process of the processor 212 of the electronic device 110 processing the instructions of the computer program loaded in the memory 211, the service screen or content formed by using the data provided by the server 150 or the electronic device 120 may be displayed on the display through the input-output interface 214.
[0042] Furthermore, in another embodiment, the electronic device 110 and the server 150 may include Figure 2More structural elements. However, it is not necessary to explicitly show most of the structural elements of the prior art. For example, the electronic device 110 can be implemented to include at least a part of the above-mentioned input and output device 215 or can also include other structural elements such as a transceiver, a global positioning system (GPS) module, a camera, various sensors, a database, etc. As a more specific example, in the case where the electronic device 110 is a smart phone, it can be implemented in the following manner, that is, the various structural elements included in a general smart phone, such as an acceleration sensor or a gyroscope sensor, a camera module, various physical buttons, buttons using a touch pad, input and output ports, a vibrator for vibration, etc., are also included in the electronic device 110.
[0043] The following describes a specific embodiment of a method and system for representing a chat room in a three-dimensional form.
[0044] Figure 3 The present invention is a block diagram showing an example of structural elements that may be included in a processor of an electronic device according to an embodiment of the present invention. Figure 4 The flowchart is a flowchart showing an example of a method that can be executed by an electronic device according to an embodiment of the present invention.
[0045] In the electronic device 110 of the present embodiment, a chat system implemented by a computer may be constructed. As an example, the chat system may be implemented as an independently operated program, or may be constructed in an in-app form of a specific application to be able to operate on the specific application, and may provide communication software services through interaction with the server 150 as appropriate.
[0046] Based on the instructions provided by the application installed in the electronic device 110, the chat system implemented in the electronic device 110 can execute the chat method. Figure 4 Chat methods such as Figure 3 As shown, the processor 212 of the electronic device 110 may include an event recognition unit 310, a screen conversion unit 320, and an information output unit 330 as structural elements. According to an embodiment, the structural elements of the processor 212 may be selectively included in the processor 212 or removed. Moreover, according to an embodiment, the structural elements of the processor 212 may be separated or combined for the performance of the functions of the processor 212.
[0047] The processor 212 and the components of the processor 212 can control the electronic device 110 to execute Figure 4 For example, the processor 212 and the structural elements of the processor 212 can be implemented as instructions for executing the code of the operating system contained in the memory 211 and the code based on at least one program.
[0048] The structural elements of the processor 212 may be the performance of different functions of the processor 212 executed by the processor 212 according to instructions provided by the program code stored in the electronic device 110 (for example, instructions provided by an application driven in the electronic device 110). For example, the event recognition unit 310 may be used as a functional performance of controlling the processor 212 of the electronic device 110 according to the instructions in a manner that the electronic device 110 recognizes a screen transition event related to a chat room.
[0049] In step S410, the processor 212 may read the required instructions from the memory 211 loaded with instructions related to the control of the electronic device 110. In this case, the read instructions may include instructions for controlling the processor 212 to execute the steps (steps S420 to S440) to be described later.
[0050] In step S420, the event recognition unit 310 can recognize a screen conversion event related to a chat room as a chat interface screen of a communication software installed on the electronic device 110. The chat room is an interface screen corresponding to a communication session set between an account of a user of the electronic device 110 and an account of at least one chat object, and can basically be composed of and displayed by a two-dimensional screen. As an example, if a preset gesture is input to the chat room, for example, a three-dimensional touch input to the screen of the electronic device 110, the event recognition unit 310 can recognize it as a screen conversion event. As another example, the event recognition unit 310 can recognize it as a screen conversion event when a screen conversion menu included in the chat room is directly selected based on the user's touch or when a chat object directory or data is entered. As another example, the event recognition unit 310 can automatically recognize a screen conversion event related to the corresponding chat room based on the time information set in the chat room. For example, the event recognition unit 310 recognizes a time point 30 minutes ago as a screen conversion event based on the agreed time set in the chat room. As another example, the event recognition unit 310 can automatically recognize screen conversion events related to the corresponding chat room based on the location information set in the chat room. For example, if the location of the electronic device 110 reaches the agreed place set in the chat room, the event recognition unit 310 can recognize it as a screen conversion event. As another example, the event recognition unit 310 can recognize screen conversion events related to the corresponding chat room based on a location distribution map based on the location information of the electronic device 110 and the location information of the chat objects contained in the chat room. For example, in the case where multiple users contained in the chat room are dispersed above a specified level, the event recognition unit 310 can recognize it as a screen conversion event. As another example, if a video call (VoIP call) between chat room users is started, the event recognition unit 310 can automatically recognize screen conversion events related to the corresponding chat room.
[0051] In step S430, upon recognizing the screen switching event, the screen switching unit 320 may switch the screen so as to display the chat room in a three-dimensional form. Figure 5 If a screen conversion event is recognized in a chat room 510 displayed in a two-dimensional form, the screen conversion unit 320 may change the corresponding chat room 510 to a three-dimensional space 520 having specified depth information for display. In this case, after the chat room is changed to a three-dimensional form (i.e., after the chat room is displayed in a three-dimensional form), if a specified gesture is input, the screen conversion unit 320 may adjust the depth of the corresponding three-dimensional space 520. For example, Figure 6 As shown, the depth of the three-dimensional space 520 can be adjusted by using a spread gesture 601 and a pinch gesture 602 using two fingers.
[0052] Again in Figure 4 In step S440, the information output unit 330 may output status information related to the user of the electronic device 110 and status information related to the chat object contained in the chat room in three-dimensional space. In this case, the status information may include information about the profile logged in to the communication software. In addition to basic information such as the profile, the status information may also include new messages, message unconfirmed status, location information or activity information based on location information, whether other services related to the communication software account are used or not, etc. The communication software may include functions for sending and receiving messages through a chat room, functions for sharing location information or activity information between a user and a chat object, and functions for providing other services such as music services to the account of the communication software, etc. As an example, the information output unit 330 may represent the distance between the user and the chat object in three-dimensional space based on the location information of the electronic device 110 and the location information of the chat object contained in the chat room as depth information in three-dimensional space. As another example, the information output unit 330 may output activity information representing the movement status of the chat object (e.g., walking movement, public transportation (bus, subway) movement, self-driving movement, etc.) in three-dimensional space based on the location information of the chat object contained in the chat room. As another example, the information output unit 330 may output new messages or message unconfirmed status received from the chat objects included in the chat room in three-dimensional space. As another example, the information output unit 330 may output icons representing other services being used by each chat object included in the chat room in three-dimensional space. For example, if each chat object uses a music service, the information output unit 330 may output a corresponding chat icon in the three-dimensional space of the chat room. In this case, the user's line of sight of the electronic device 110 in the three-dimensional space is tracked to output the content being used by the chat object corresponding to the user's line of sight through the output device of the electronic device 110 (speaker or display, etc.).
[0053] Figures 7 to 13 The diagram is an example diagram for explaining a process of displaying status information in a three-dimensional space of a chat room according to an embodiment of the present invention.
[0054] The following is an example of a chat room in which the user of electronic device 110 and chat partner A, chat partner B, chat partner C, and chat partner D participate.
[0055] Reference Figure 7, the information output unit 330 may display a user icon 701 representing the user and an object icon 702 representing the chat object on the three-dimensional space 520 as a chat room and having depth information. In this case, the user icon 701 and the object icon 702 may be composed of a preset profile image or a default image. In the case of the chat object A and the chat object B that are allowed to share a location with the user, the depth information d between the user icon 701 and the object icon 702 on the three-dimensional space 520 may be used to display the user icon 701 and the object icon 702. A ,d B The distance between the user and the chat object A and chat object B is expressed. In the case of chat objects C and D that are not allowed to share the position with the user, the object icon 702 may be displayed around the user icon 701 without depth information. As another example, in the case where the direction of the chat object A and chat object B relative to the user or the orientation of the chat object A and chat object B can be confirmed from the position information of the chat object A and chat object B, the user icon 701 may be displayed at the center of the three-dimensional space 520, and the object icon 702 may be arranged according to the confirmed direction of the chat object A and chat object B relative to the user or the orientation of the chat object A and chat object B. As another example, when a video call (VoIP call) between chat room users is started and the screen is switched so as to display the chat room in a three-dimensional form, the information output unit 330 may provide a video call screen using the three-dimensional space 520. In this case, the user icon 701 and the object icon 702 may be composed of a video call screen instead of their respective profile images.
[0056] Reference Figure 8 If movement is detected for chat objects A and B that are allowed to share their location with the user, the information output unit 330 may display a movement status icon 803 at a position adjacent to the corresponding object icon 702, for example, at the upper right end of the object icon 702. In this case, the movement type of the chat object may be distinguished based on the movement speed or movement path of the chat object, such as walking movement, public transportation (bus, subway) movement, self-driving movement, etc., and the corresponding type of movement status icon 803 may be displayed. The movement speed or movement path of the chat object may be information received from the electronic device of the chat object (for example, the electronic device 120), or may be information calculated by the user's electronic device 110 based on the location information of the chat object received from the chat object.
[0057] Reference Fig. 9If a new message is received from chat partner A through the chat room, the information output unit 330 may display a bubble box 904 containing the new message at a position adjacent to the corresponding object icon 702, for example, at the upper right end of the object icon 702 for a specified time (e.g., 3 seconds). In this case, if the user clicks the bubble box 904 within the specified time, it may be processed as a confirmed message, and if the user does not click the bubble box 904 and the specified time has passed, it may be processed as an unconfirmed message.
[0058] After receiving a new message, if a specified time has passed, the information output unit 330 can remove the bubble frame 904. In the case where the corresponding message is processed as an unconfirmed message, such as Fig.10 As shown, an identifier 1005 indicating the existence of an unconfirmed message may be displayed at a position adjacent to the object icon 702 that sent the corresponding message, for example, at the upper right end of the object icon 702 .
[0059] Reference Fig.11 When at least some of the chat objects included in the chat room use the music service, the information output unit 330 can output a service icon 1106 representing the music service in the three-dimensional space 520 at a position adjacent to the corresponding object icon 702, for example, at the upper right end of the object icon 702.
[0060] Reference Fig.12 The information output unit 330 can track the user's line of sight 1200 of the three-dimensional space 520 to output the music being used by the chat partner corresponding to the user's line of sight 1200 through the output device of the electronic device 110. Fig.12 As shown in FIG. 1 , when chat object A and chat object B use a music service, if the user's sight 1200 stays on the object icon 702 of chat object A, the information output unit 330 may output the music that chat object A is listening to. In this case, a mute icon 1207 may be displayed adjacent to the object icon 702 or service icon 1106 of chat object B. Fig.13 As shown, the information output unit 330 can track the user's line of sight 1200. If the user's line of sight 1200 stays on the object icon 702 of the chat object A and then moves to the object icon 702 of the chat object B, the output of the music that the chat object A is listening to is interrupted and the music that the chat object B is listening to is output. In this case, the effect that the volume of the music that the chat object A is listening to gradually becomes smaller and the volume of the music that the chat object B is listening to gradually increases can be applied. If the output of the music that the chat object A is listening to is interrupted, a mute icon 1207 can be displayed at a position adjacent to the object icon 702 of the chat object A or the service icon 1106.
[0061] In the case of icons representing other services being used by the chat partner, the information output unit 330 can output them not only in three-dimensional space but also in a chat room represented in two-dimensional form. For example, the information output unit 330 can display the object icons composed of profile images in a two-dimensional chat room in the order of message reception. In this case, if the chat partner uses a music service, the service icon can be displayed adjacent to the object icon, and the music being used by the chat partner corresponding to the user's line of sight can be output through the output device of the electronic device 110 by tracking the user's line of sight.
[0062] Thus, according to an embodiment of the present invention, a chat room can be presented in a three-dimensional mode with adjustable depth using three-dimensional technology. In this case, the distance to the chat object can be presented as depth information in three-dimensional space. In addition, new messages, message unconfirmed status, location information or activity information based on location information, and whether other services related to the communication software account are used or not can be output in three-dimensional space as status information related to the chat object. Furthermore, the status information of the chat object corresponding to the user's line of sight can be output by tracking the user's line of sight to the chat room.
[0063] The above-described device can be implemented by hardware structural elements, software structural elements and / or a combination of hardware structural elements and software structural elements. For example, the device and structural elements described in the embodiment can be implemented using one or more general-purpose computers or special-purpose computers (such as processors, controllers, arithmetic logic units (arithmetic logic units, ALU), digital signal processors (digital signal processors), microcomputers, field programmable gate arrays (field programmable gate arrays, FPGA), programmable logic units (programmable logic units, PLU), microprocessors or any other device that can execute instructions and respond). The processing device can execute an operating system (OS) and one or more software applications executed on the above operating system. In addition, the processing device can access, store, operate, process and generate data in response to the execution of the software. For ease of understanding, sometimes only one processing device is used for description. Ordinary technicians in the technical field of the present invention can be familiar with the processing device that can include multiple processing elements (processing element) and / or multiple types of processing elements. For example, the processing device may include multiple processors or a processor and a controller. In addition, other processing structures (processing configuration) such as parallel processors (parallel processors) may also be included.
[0064] Software may include a computer program, code, instruction, or a combination of more than one of them, to form a processing device in a manner to perform operations as required or to issue instructions to a processing device independently or collectively. Software and / or data may be embodied in any type of machine, component, physical device, computer storage medium or device for parsing by a processing device or providing instructions or data to a processing device. Software may be distributed on computer systems connected by a network and stored or executed by a distributed method. Software and data may be stored in one or more computer-readable recording media.
[0065] The method of the embodiment can be implemented as a program instruction form that can be executed by a variety of computer units and recorded on a computer-readable medium. In this case, the medium continues to store the computer executable program, or can be temporarily stored for execution or downloading. In addition, the medium can be a variety of recording units or storage units in the form of a single or multiple hardware combinations, and is not limited to a medium directly connected to a certain computer system, but can also be dispersed on the network. As an example of the medium, there can be a medium composed of a method of storing program instructions, including magnetic media such as hard disks, floppy disks and tapes, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floppy disks, and read-only memories, random access memories, flash memories, etc. In addition, as examples of other media, application stores for circulating applications, websites for supplying or circulating other various software, and recording media or storage media managed in servers, etc. can be listed.
[0066] As described above, although the embodiments are described by limited embodiments and drawings, a person skilled in the art of the present invention can make various modifications and variations from the above description. For example, even if the described techniques are performed in a different order than the described method, and / or the structural elements of the described systems, structures, devices, circuits, etc. are combined or combined in a different form than the described method, or are replaced or substituted by other structural elements or equivalents, appropriate results can be achieved.
[0067] Therefore, other examples, other embodiments and contents equivalent to the scope of protection of the invention also fall within the scope of protection of the invention described later.
Claims
1. A chat room display method, executed in an electronic device, characterized in that: The electronic device includes at least one processor configured to execute a plurality of computer-readable instructions contained in a memory, The chat room display method includes: an identification step, identifying, by at least one of the processors, a screen conversion event related to a chat room displayed on the electronic device; a conversion step, converting the screen according to the screen conversion event by at least one of the processors so as to display the chat room in a three-dimensional space; and a step of expressing, by at least one of the processors, the distance between the user of the electronic device and the chat object using the depth information of the three-dimensional space based on the location information of the electronic device and the location information of at least one chat object included in the chat room; The converting step includes adjusting the depth of the three-dimensional space according to the user's gesture input to the three-dimensional space, and In the above-mentioned presentation step, the first chat object that allows position sharing is displayed on the above-mentioned three-dimensional space using depth information corresponding to the actual physical distance between the above-mentioned user and the above-mentioned first chat object, and the second chat object that does not allow position sharing is displayed on the above-mentioned three-dimensional space without using depth information.
2. The chat room display method according to claim 1, characterized in that: The recognition step includes: if a preset gesture is input into the chat room, it is recognized as the screen conversion event.
3. The chat room display method according to claim 1, characterized in that: The identification step includes: identifying the screen conversion event related to the chat room based on time information or location information set in the chat room.
4. The chat room display method according to claim 1, characterized in that: The identification step includes: identifying the screen conversion event related to the chat room based on the location information of the electronic device and the location information of at least one chat object included in the chat room.
5. The chat room display method according to claim 1, characterized in that: The above conversion steps include: The step of changing the chat room to display in a three-dimensional space having depth information according to the screen transition event.
6. The chat room display method according to claim 1, characterized in that: The expressing step includes expressing the distance between the user and the chat object in the three-dimensional space by using depth information between a user icon representing the user and an object icon representing the chat object.
7. The chat room display method according to claim 6, characterized in that: The above-mentioned expression step also includes: distinguishing the movement type of the above-mentioned chat object based on the movement speed or movement path based on the position information of the above-mentioned chat object, and displaying the movement status icon of the corresponding movement type at a position adjacent to the above-mentioned object icon.
8. The chat room display method according to claim 6, characterized in that: The above-mentioned display step also includes: when a new message is received from the above-mentioned chat object, the above-mentioned new message is displayed at a position adjacent to the above-mentioned object icon for a specified time.
9. The chat room display method according to claim 6, characterized in that: The above-mentioned display step also includes: when a new message received from the above-mentioned chat object is processed as an unconfirmed message, an identifier representing the above-mentioned unconfirmed message is displayed at a position adjacent to the above-mentioned object icon.
10. The chat room display method according to claim 6, characterized in that: The above-mentioned expression step also includes: displaying an icon representing other services that the above-mentioned chat object is using at a position adjacent to the above-mentioned object icon.
11. The chat room display method according to claim 10, characterized in that: The above-mentioned expression step also includes: tracking the line of sight of the above-mentioned user on the above-mentioned three-dimensional space, and outputting the content being used by the chat object corresponding to the line of sight of the above-mentioned user in the above-mentioned other services through the output device of the above-mentioned electronic device.
12. A non-transitory computer-readable recording medium, characterized in that A program for executing the chat room display method according to any one of claims 1 to 11 on a computer is recorded.
13. A chat room display system implemented in an electronic device, characterized in that: include: Memory; as well as at least one processor, connected to the memory and configured to execute a plurality of computer-readable instructions contained in the memory, At least one of the above processors includes: An event recognition unit, used for recognizing a screen transition event related to a chat room displayed on the electronic device; a screen conversion unit that converts the screen according to the screen conversion event so as to display the chat room in a three-dimensional space; and an information output unit, outputting status information related to at least one chat object included in the chat room in the three-dimensional space, The screen conversion unit adjusts the depth of the three-dimensional space according to a user's gesture input to the three-dimensional space. The information output unit represents the distance between the user of the electronic device and the chat object using the depth information of the three-dimensional space based on the position information of the electronic device and the position information of the chat object, and displays the first chat object that allows position sharing in the three-dimensional space using the depth information corresponding to the actual physical distance between the user and the first chat object, and displays the second chat object that does not allow position sharing in the three-dimensional space without using the depth information.
14. The chat room display system according to claim 13, characterized in that: The screen conversion unit changes the chat room into a three-dimensional space having depth information and displays the chat room according to the screen conversion event.
15. The chat room display system according to claim 13, characterized in that: The information output unit further represents the distance between the user and the chat object in the three-dimensional space by using depth information between a user icon representing the user and an object icon representing the chat object.
16. The chat room display system according to claim 15, characterized in that: The information output unit further distinguishes the movement type of the chat object based on the movement speed or movement path based on the location information of the chat object, and displays the movement status icon of the corresponding movement type at a position adjacent to the object icon.
17. The chat room display system according to claim 15, characterized in that: When a new message is received from the chat partner, the information output unit further displays the new message at a position adjacent to the partner icon for a predetermined time.
18. The chat room display system according to claim 15, characterized in that: In the case where the new message received from the chat object is processed as an unconfirmed message, the information output unit further displays an identifier indicating the unconfirmed message at a position adjacent to the object icon.
19. The chat room display system according to claim 15, characterized in that: The information output unit may further display an icon indicating other services being used by the chat partner at a position adjacent to the partner icon.
20. The chat room display system according to claim 19, characterized in that: The information output unit also tracks the user's line of sight on the three-dimensional space, and outputs the content being used by the chat partner corresponding to the user's line of sight in the other services through the output device of the electronic device.
Citation Information
Patent Citations
Service system and method for mobile messenger ofmobile phone using wireless communication network
KR1020020074304A
Systems and methods for providing feedback by tracking user gaze and gestures
CN102749990A
Mobile terminal and 3D image controlling method thereof
KR1020130063324A
System and method for exercise game of social network type using augmented reality
KR1020140108436A
Visualization of Network Members Based on Location and Direction
US20130331130A1