Electronic device for representing 3-dimensional object, operation method thereof, and storage medium
By adjusting the size of 3D object parts based on distortion conditions and field of view, the electronic device improves immersion and interaction in VR, AR, and MR environments, addressing rendering challenges in existing technologies.
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- SAMSUNG ELECTRONICS CO LTD
- Filing Date
- 2025-12-02
- Publication Date
- 2026-06-11
Smart Images

Figure KR2025020448_11062026_PF_FP_ABST
Abstract
Description
Electronic device representing a three-dimensional object, method of operation thereof, and storage medium
[0001] The present disclosure relates to an electronic device for representing a three-dimensional object, a method of operation thereof, and a storage medium.
[0002] Virtual Reality (VR), Augmented Reality (AR), Mixed Reality (MR), and / or Extended Reality (XR) provide users with immersive experiences and are utilized across various industries by blurring the boundaries between the physical environment and digital content. Virtual Reality is a technology that immerses users in a fully digital, computer-generated environment; it can be designed to allow users to focus on the digital environment while disconnected from the real world. Virtual Reality can provide realistic experiences by stimulating, for example, visual, auditory, and / or tactile senses. Augmented Reality is a technology that provides users with mixed information by overlaying digital information onto the physical environment of the real world, enabling users to perceive both the real world and digital content simultaneously. Mixed Reality can be a technology that integrates Virtual Reality and Augmented Reality to enable real-time interaction between users and digital content. Extended Reality is a comprehensive concept encompassing Virtual Reality, Augmented Reality, and Mixed Reality, which combines digital and real-world environments to provide users with a sense of immersion.
[0003] In virtual reality, augmented reality, mixed reality, and / or extended reality services, 3-dimensional objects (hereinafter referred to as 3D objects) may be represented. Sophisticated rendering and / or real-time interaction of 3D objects can have a significant impact on the immersion of virtual reality, augmented reality, mixed reality, and / or extended reality services.
[0004] The information described above may be provided as related art for the purpose of aiding understanding of the present disclosure. No claim or determination is made as to whether any of the foregoing may be applied as prior art related to the present disclosure.
[0005] The electronic device may include at least one processor and a memory for storing instructions.
[0006] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the electronic device to confirm a request for rendering of a 3D object composed of a plurality of parts.
[0007] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause to identify locations in virtual space based on the user's view point corresponding to each of the plurality of parts of the 3D object based on confirming the request for rendering.
[0008] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the first part to confirm that the first part satisfies a distortion representation condition based on a first location of the first part among the plurality of parts.
[0009] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the size identified based on the first position of the first part to be adjusted to a different size based on confirming the satisfaction of the distortion representation condition of the first part.
[0010] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the 3D object composed of the scaled first part and the remaining parts excluding the first part.
[0011] The above remaining parts may have a size determined based on the location of each of the above remaining parts.
[0012] The method of operation of an electronic device may include an operation to confirm a request for rendering of a 3D object composed of multiple parts.
[0013] The method of operation of the electronic device may include, based on confirming the request for rendering, an operation of confirming locations within the virtual space based on a user's view point corresponding to each of the plurality of parts of the 3D object.
[0014] The method of operation of the electronic device may include an operation of confirming that the first part satisfies a distortion expression condition based on a first position of the first part among the plurality of parts.
[0015] The method of operation of the electronic device may include an operation of adjusting the size identified based on the first position of the first part to a different size, based on confirming the satisfaction of the distortion expression condition of the first part.
[0016] The method of operation of the electronic device may include rendering the 3D object composed of the resized first part and the remaining parts excluding the first part.
[0017] The above remaining parts may have a size determined based on the location of each of the above remaining parts.
[0018] A storage medium for storing computer-executable instructions may be provided.
[0019] When the above instructions are executed individually or collectively by at least one processor of the electronic device, the electronic device may cause the electronic device to confirm a request for rendering of a 3D object composed of a plurality of parts.
[0020] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause to identify locations in virtual space based on the user's view point corresponding to each of the plurality of parts of the 3D object based on confirming the request for rendering.
[0021] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the first part to confirm that the first part satisfies a distortion representation condition based on a first location of the first part among the plurality of parts.
[0022] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the size identified based on the first position of the first part to be adjusted to a different size based on confirming the satisfaction of the distortion representation condition of the first part.
[0023] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the 3D object composed of the scaled first part and the remaining parts excluding the first part.
[0024] The electronic device may include at least one processor and a memory for storing instructions.
[0025] When the above instructions are executed individually or collectively by the at least one processor, they may cause the electronic device to acquire data for representing a 3D object created based on a first FOV.
[0026] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to check whether at least a portion of the data for representing the 3D object is adjusted based on at least one of the first FOV or the second FOV of the electronic device.
[0027] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to identify the part of the 3D object to be adjusted based on the requirement to adjust at least a part of the data for representing the 3D object.
[0028] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to store adjusted data for representing the 3D object created by adjusting the data corresponding to the part to be adjusted.
[0029] Data regarding the remaining parts, excluding the data corresponding to the above-mentioned adjustment target part, may be retained.
[0030] The method of operating an electronic device may include the operation of acquiring data for representing a 3D object generated based on a first FOV.
[0031] The method of operation of the electronic device may include an operation of checking whether at least a portion of the data for representing the 3D object is adjusted based on at least one of the first FOV or the second FOV of the electronic device.
[0032] The method of operation of the electronic device may include an operation to identify a part of the 3D object to be adjusted, based on the requirement that adjustment of at least a part of the data for representing the 3D object be required.
[0033] The method of operation of the electronic device may include the operation of storing adjusted data to represent the 3D object generated by adjusting data corresponding to the adjustment target part.
[0034] Data regarding the remaining parts, excluding the data corresponding to the above-mentioned adjustment target part, may be retained.
[0035] A storage medium for storing computer-executable instructions may be provided.
[0036] When the above instructions are executed individually or collectively by at least one processor of the electronic device, the electronic device may be caused to acquire data for representing a 3D object created based on a first FOV.
[0037] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to check whether at least a portion of the data for representing the 3D object is adjusted based on at least one of the first FOV or the second FOV of the electronic device.
[0038] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to identify the part of the 3D object to be adjusted based on the requirement to adjust at least a part of the data for representing the 3D object.
[0039] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to store adjusted data for representing the 3D object created by adjusting the data corresponding to the part to be adjusted.
[0040] Data regarding the remaining parts, excluding the data corresponding to the above-mentioned adjustment target part, may be retained.
[0041] The electronic device may include at least one processor and a memory for storing instructions.
[0042] When the above instructions are executed individually or collectively by the at least one processor, they may cause the electronic device to confirm a request for rendering of a 3D object.
[0043] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause to identify locations in virtual space based on the user's view point corresponding to each of the plurality of parts of the 3D object based on confirming the request for rendering.
[0044] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the first part to confirm that the first part satisfies a distortion representation condition based on a first location of the first part among the plurality of parts.
[0045] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the size identified based on the first position of the first part to be adjusted to a different size based on confirming the satisfaction of the distortion representation condition of the first part.
[0046] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the 3D object composed of the scaled first part and the remaining parts excluding the first part.
[0047] The above remaining parts may have a size determined based on the location of each of the above remaining parts.
[0048] The method of operation of an electronic device may include an operation to confirm a request for rendering of a 3D object.
[0049] The method of operation of the electronic device may include, based on confirming the request for rendering, an operation of confirming locations in a virtual space based on a user's view point corresponding to each of the plurality of parts of the 3D object.
[0050] The method of operation of the electronic device may include an operation of confirming that the first part satisfies a distortion expression condition based on a first position of the first part among the plurality of parts.
[0051] The method of operation of the electronic device may include an operation of adjusting the size identified based on the first position of the first part to a different size, based on confirming the satisfaction of the distortion expression condition of the first part.
[0052] The method of operation of the electronic device may include rendering the 3D object composed of the resized first part and the remaining parts excluding the first part.
[0053] The above remaining parts may have a size determined based on the location of each of the above remaining parts.
[0054] A storage medium for storing computer-executable instructions may be provided.
[0055] When the above instructions are executed individually or collectively by at least one processor of the electronic device, the electronic device may be caused to confirm a request for rendering of a 3D object.
[0056] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause to identify locations in virtual space based on the user's view point corresponding to each of the plurality of parts of the 3D object based on confirming the request for rendering.
[0057] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the first part to confirm that the first part satisfies a distortion representation condition based on a first location of the first part among the plurality of parts.
[0058] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the size identified based on the first position of the first part to be adjusted to a different size based on confirming the satisfaction of the distortion representation condition of the first part.
[0059] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the 3D object composed of the scaled first part and the remaining parts excluding the first part.
[0060] The electronic device may include at least one processor and a memory for storing instructions.
[0061] When the above instructions are executed individually or collectively by the at least one processor, they may cause the electronic device to acquire data for representing a 3D object created based on a first FOV.
[0062] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to check whether at least a portion of the data for representing the 3D object is adjusted based on at least one of the first FOV or the second FOV of the electronic device.
[0063] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to identify the part of the 3D object to be adjusted based on the requirement to adjust at least a part of the data for representing the 3D object.
[0064] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to store adjusted data for representing the 3D object created by adjusting the data corresponding to the part to be adjusted.
[0065] Data regarding the remaining parts, excluding the data corresponding to the above-mentioned adjustment target part, may be retained.
[0066] The method of operating an electronic device may include the operation of acquiring data for representing a 3D object generated based on a first FOV.
[0067] The method of operation of the electronic device may include an operation of checking whether at least a portion of the data for representing the 3D object is adjusted based on at least one of the first FOV or the second FOV of the electronic device.
[0068] The method of operation of the electronic device may include an operation to identify a part of the 3D object to be adjusted, based on the requirement that adjustment of at least a part of the data for representing the 3D object be required.
[0069] The method of operation of the electronic device may include the operation of storing adjusted data to represent the 3D object generated by adjusting data corresponding to the adjustment target part.
[0070] Data regarding the remaining parts, excluding the data corresponding to the above-mentioned adjustment target part, may be retained.
[0071] A storage medium for storing computer-executable instructions may be provided.
[0072] When the above instructions are executed individually or collectively by at least one processor of the electronic device, the electronic device may be caused to acquire data for representing a 3D object created based on a first FOV.
[0073] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to check whether at least a portion of the data for representing the 3D object is adjusted based on at least one of the first FOV or the second FOV of the electronic device.
[0074] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to identify the part of the 3D object to be adjusted based on the requirement to adjust at least a part of the data for representing the 3D object.
[0075] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to store adjusted data for representing the 3D object created by adjusting the data corresponding to the part to be adjusted.
[0076] Data regarding the remaining parts, excluding the data corresponding to the above-mentioned adjustment target part, may be retained.
[0077] The electronic device may include at least one processor and a memory for storing instructions.
[0078] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to confirm a request for rendering of an avatar.
[0079] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the location of each of the plurality of body parts constituting the avatar in the virtual space relative to the user's view point, based on confirming the request for rendering.
[0080] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the first part to satisfy a distortion representation condition based on a first position of the first body part among the plurality of parts.
[0081] The first body part above may correspond to the extremity part of the avatar.
[0082] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the size identified based on the first position of the first body part to be adjusted to a different size based on confirming the satisfaction of the distortion representation condition of the first body part.
[0083] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the avatar to render the avatar composed of the resized first body part and the remaining body parts excluding the first part.
[0084] The above remaining body parts may have a size determined based on the location of each of the above remaining parts.
[0085] The method of operation of the electronic device may include an operation to confirm a request for rendering of an avatar.
[0086] The method of operation of the electronic device may include, based on confirming the request for rendering, an operation of confirming the locations within the virtual space of each of the plurality of body parts constituting the avatar relative to the user's view point.
[0087] The method of operation of the electronic device may include an operation of confirming that the first part satisfies a distortion expression condition based on a first position of the first body part among the plurality of parts.
[0088] The first body part above may correspond to the extremity part of the avatar.
[0089] The method of operation of the electronic device may include an operation of adjusting the size identified based on the first position of the first body part to a different size, based on confirming the satisfaction of the distortion expression condition of the first body part.
[0090] The method of operation of the electronic device may include rendering the avatar composed of the resized first body part and the remaining body parts excluding the first part.
[0091] The above remaining body parts may have a size determined based on the location of each of the above remaining parts.
[0092] A storage medium for storing computer-executable instructions may be provided.
[0093] When the above instructions are executed individually or collectively by at least one processor of the electronic device, the electronic device may be caused to confirm a request for rendering of an avatar.
[0094] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the location of each of the plurality of body parts constituting the avatar in the virtual space relative to the user's view point, based on confirming the request for rendering.
[0095] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the first part to satisfy a distortion representation condition based on a first position of the first body part among the plurality of parts.
[0096] The first body part above may correspond to the extremity part of the avatar.
[0097] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the size identified based on the first position of the first body part to be adjusted to a different size based on confirming the satisfaction of the distortion representation condition of the first body part.
[0098] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the avatar to render the avatar composed of the resized first body part and the remaining body parts excluding the first part.
[0099] The above remaining body parts may have a size determined based on the location of each of the above remaining parts.
[0100] The electronic device may include at least one processor and a memory for storing instructions.
[0101] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to confirm a request for rendering of an avatar.
[0102] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the location of each of the plurality of body parts constituting the avatar in virtual space relative to the user's view point, based on confirming the request for rendering.
[0103] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the first part to satisfy a distortion representation condition based on a first position of the first body part among the plurality of parts.
[0104] The first body part above may correspond to the extremity part of the avatar.
[0105] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the size identified based on the first position of the first body part to be adjusted to a different size based on confirming the satisfaction of the distortion representation condition of the first body part.
[0106] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the avatar to render the avatar composed of the resized first body part and the remaining body parts excluding the first part.
[0107] The above remaining body parts may have a size determined based on the location of each of the above remaining parts.
[0108] The method of operation of the electronic device may include an operation to confirm a request for rendering of an avatar.
[0109] The method of operation of the above electronic device may include, based on confirming the request for rendering, an operation of confirming the positions within the virtual space of each of the plurality of body parts constituting the avatar relative to the user's view point.
[0110] The method of operation of the electronic device may include an operation of confirming that the first part satisfies a distortion expression condition based on a first position of the first body part among the plurality of parts.
[0111] The first body part above may correspond to the extremity part of the avatar.
[0112] The method of operation of the electronic device may include an operation of adjusting the size identified based on the first position of the first body part to a different size, based on confirming the satisfaction of the distortion expression condition of the first body part.
[0113] The method of operation of the electronic device may include rendering the avatar composed of the resized first body part and the remaining body parts excluding the first part.
[0114] The above remaining body parts have a size identified based on the location of each of the above remaining parts.
[0115] A storage medium for storing computer-executable instructions may be provided.
[0116] When the above instructions are executed individually or collectively by at least one processor of the electronic device, the electronic device may be caused to confirm a request for rendering of an avatar.
[0117] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the location of each of the plurality of body parts constituting the avatar in virtual space relative to the user's view point, based on confirming the request for rendering.
[0118] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the first part to satisfy a distortion representation condition based on a first position of the first body part among the plurality of parts.
[0119] The first body part above may correspond to the extremity part of the avatar.
[0120] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the size identified based on the first position of the first body part to be adjusted to a different size based on confirming the satisfaction of the distortion representation condition of the first body part.
[0121] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the avatar to render the avatar composed of the resized first body part and the remaining body parts excluding the first part.
[0122] The above remaining body parts may have a size determined based on the location of each of the above remaining parts.
[0123] FIG. 1 is a block diagram of an electronic device in a network environment according to one embodiment.
[0124] FIG. 2 is a perspective view for explaining the internal configuration of a wearable electronic device according to one embodiment of the present disclosure.
[0125] FIG. 3a is a drawing showing the front and rear of a wearable electronic device according to one embodiment.
[0126] FIG. 3b is a drawing showing the front and rear of a wearable electronic device according to one embodiment.
[0127] Figure 4 is a diagram illustrating the field of view (FOV) for each electronic device.
[0128] FIG. 5 is a diagram illustrating a method of operation of an electronic device according to one embodiment.
[0129] FIG. 6a is a drawing for explaining a virtual space defined to represent a virtual reality service according to one embodiment.
[0130] FIG. 6b is a diagram illustrating 3D object adjustment based on the position of a 3D object in a virtual space according to one embodiment.
[0131] FIG. 6c is a drawing for explaining 3D object adjustment according to one embodiment.
[0132] FIG. 6d is a drawing for explaining 3D object adjustment according to one embodiment.
[0133] FIG. 6e is a diagram illustrating a method of operation of an electronic device according to one embodiment.
[0134] FIG. 6f is a diagram illustrating a method of operation of an electronic device according to one embodiment.
[0135] FIG. 7 is a diagram illustrating a method of operation of an electronic device according to one embodiment.
[0136] FIG. 8a is a drawing for explaining a plurality of parts of a 3D object according to one embodiment.
[0137] FIGS. 8b, 8c, and 8d are drawings for illustrating 3D objects according to various embodiments.
[0138] FIG. 8e is a drawing for explaining the operation method of an electronic device according to one embodiment.
[0139] FIG. 9 is a drawing for explaining the operation method of an electronic device according to one embodiment.
[0140] FIG. 10 is a drawing for explaining the adjustment of a 3D object according to one embodiment.
[0141] FIG. 11 is a drawing for explaining the operation method of an electronic device according to one embodiment.
[0142] FIG. 12 is a drawing for explaining the operation method of an electronic device according to one embodiment.
[0143] FIG. 13 is a drawing for explaining the operation method of an electronic device according to one embodiment.
[0144] FIG. 14 is a drawing for explaining the adjustment of a 3D object according to a view point change according to one embodiment.
[0145] FIG. 15 is a diagram illustrating the adjustment of a 3D object according to the rotation of a 3D object according to one embodiment.
[0146] FIG. 16a is a drawing for explaining the operation method of an electronic device according to one embodiment.
[0147] FIG. 16b is a drawing for explaining the adjustment of a 3D object according to one embodiment.
[0148] FIG. 1 is a block diagram of an electronic device in a network environment according to one embodiment.
[0149] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or with at least one of an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) through a server (108). According to one embodiment, the electronic device (101) may include a processor (120), memory (130), input module (150), sound output module (155), display module (160), audio module (170), sensor module (176), interface (177), connection terminal (178), haptic module (179), camera module (180), power management module (188), battery (189), communication module (190), subscriber identification module (196), or antenna module (197). In some embodiments, at least one of these components (e.g., connection terminal (178)) may be omitted from the electronic device (101), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (176), camera module (180), or antenna module (197)) may be integrated into a single component (e.g., display module (160)).
[0150] The processor (120) can control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) by executing software (e.g., a program (140)), and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (120) can store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in volatile memory (132), process the commands or data stored in volatile memory (132), and store the resulting data in non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) that can operate independently or together with it (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device (101) includes a main processor (121) and an auxiliary processor (123), the auxiliary processor (123) may be configured to use lower power than the main processor (121) or to be specialized for a designated function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as part thereof.
[0151] The auxiliary processor (123) may control at least some of the functions or states associated with at least one component of the electronic device (101) (e.g., display module (160), sensor module (176), or communication module (190)) on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (123) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (180) or communication module (190)). According to one embodiment, the auxiliary processor (123) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (108)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.
[0152] The memory (130) can store various data used by at least one component of the electronic device (101) (e.g., processor (120) or sensor module (176)). The data may include, for example, input data or output data for software (e.g., program (140)) and related commands. The memory (130) may include volatile memory (132) or non-volatile memory (134).
[0153] The program (140) may be stored as software in memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).
[0154] The input module (150) can receive commands or data to be used for a component of the electronic device (101) (e.g., processor (120)) from outside the electronic device (101) (e.g., user). The input module (150) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
[0155] The sound output module (155) can output a sound signal to the outside of the electronic device (101). The sound output module (155) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.
[0156] The display module (160) can visually provide information to an external (e.g., user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.
[0157] The audio module (170) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150) or output sound through the sound output module (155) or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (101).
[0158] The sensor module (176) can detect the operating state of the electronic device (101) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
[0159] The interface (177) may support one or more specified protocols that can be used for the electronic device (101) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (102)). According to one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
[0160] The connection terminal (178) may include a connector through which the electronic device (101) can be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0161] The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that can be perceived by the user through tactile or kinesthetic senses. According to one embodiment, the haptic module (179) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.
[0162] The camera module (180) can capture still images and video. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.
[0163] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).
[0164] The battery (189) can supply power to at least one component of the electronic device (101). According to one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0165] The communication module (190) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may include one or more communication processors that operate independently of the processor (120) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (194) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (104) through a first network (198) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can identify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (196).
[0166] The wireless communication module (192) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (192) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (192) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), external electronic device (e.g., electronic device (104)), or network system (e.g., second network (199)). According to one embodiment, the wireless communication module (192) may support a Peak data rate (e.g., 20 Gbps or more) for eMBB realization, loss coverage (e.g., 164 dB or less) for mMTC realization, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for URLLC realization.
[0167] An antenna module (197) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (198) or a second network (199), may be selected from the plurality of antennas, for example, by a communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (197).
[0168] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.
[0169] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.
[0170] According to one embodiment, commands or data may be transmitted or received between an electronic device (101) and an external electronic device (104) through a server (108) connected to a second network (199). Each of the external electronic devices (102, or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations performed on the electronic device (101) may be performed on one or more of the external electronic devices (102, 104, or 108). For example, if the electronic device (101) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (101) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (101) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or neural networks. According to one embodiment, the external electronic device (104) or the server (108) may be included within a second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.
[0171] FIG. 2 is a perspective view for explaining the internal configuration of a wearable electronic device according to one embodiment of the present disclosure.
[0172] Referring to FIG. 2, a wearable electronic device (200) according to one embodiment of the present disclosure may include at least one of a light output module (211), a display member (201), and a camera module (250).
[0173] According to one embodiment of the present disclosure, the light output module (211) may include a light source capable of outputting an image and a lens that guides the image to a display member (201). According to one embodiment of the present disclosure, the light output module (211) may include at least one of a liquid crystal display (LCD), a digital mirror device (DMD), a liquid crystal on silicon (LCoS), an organic light emitting diode (OLED), an organic light emitting diode on silicon (OLEDoS), or a micro light emitting diode (micro LED).
[0174] According to one embodiment of the present disclosure, the display member (201) may include an optical waveguide (e.g., a waveguide). According to one embodiment of the present disclosure, an output image of an optical output module (211) incident on one end of the optical waveguide may propagate within the optical waveguide and be provided to a user. According to one embodiment of the present disclosure, the optical waveguide may include at least one diffractive element (e.g., a Diffractive Optical Element (DOE), a Holographic Optical Element (HOE)) or a reflective element (e.g., a reflective mirror). For example, the optical waveguide may guide the output image of the optical output module (211) to the user's eye using at least one diffractive element or reflective element.
[0175] According to one embodiment of the present disclosure, the camera module (250) can capture still images and / or video. According to one embodiment, the camera module (250) may be placed within a lens frame and around a display member (201).
[0176] According to one embodiment of the present disclosure, the first camera module (251) can capture and / or recognize the trajectory of the user's eye (e.g., pupil, iris) or gaze. According to one embodiment of the present disclosure, the first camera module (251) can periodically or non-periodically transmit information related to the trajectory of the user's eye or gaze (e.g., trajectory information) to a processor (e.g., processor (120) of FIG. 1).
[0177] According to one embodiment of the present disclosure, the second camera module (253) can capture an external image.
[0178] According to one embodiment of the present disclosure, a third camera module (255) may be used for hand detection and tracking and recognition of user gestures (e.g., hand movements). According to one embodiment of the present disclosure, a third camera module (255) may be used for 3 degrees of freedom (3DoF), 6DoF head tracking, location (space, environment) recognition, and / or movement recognition. According to one embodiment of the present disclosure, a second camera module (253) may be used for hand detection and tracking and recognition of user gestures. According to one embodiment of the present disclosure, at least one of the first camera module (251) to the third camera module (255) may be replaced with a sensor module (e.g., a LiDAR sensor). For example, the sensor module may include at least one of a vertical cavity surface emitting laser (VCSEL), an infrared sensor, and / or a photodiode.
[0179] FIG. 3a is a drawing showing the front and rear of a wearable electronic device according to one embodiment.
[0180] FIG. 3b is a drawing showing the front and rear of a wearable electronic device according to one embodiment.
[0181] Referring to FIG. 3a and FIG. 3b, in one embodiment, camera modules (311, 312, 313, 314, 315, 316) and / or a depth sensor (317) for acquiring information related to the surrounding environment of the wearable electronic device (300) may be disposed on the first surface (310) of the housing.
[0182] In one embodiment, camera modules (311, 312) can acquire images related to the surrounding environment of a wearable electronic device.
[0183] In one embodiment, camera modules (313, 314, 315, 316) can acquire images while the wearable electronic device is worn by a user. Camera modules (313, 314, 315, 316) can be used for hand detection, tracking, and user gesture (e.g., hand movements) recognition. Camera modules (313, 314, 315, 316) can be used for 3DoF, 6DoF head tracking, position (space, environment) recognition, and / or movement recognition. In one embodiment, camera modules (311, 312) may be used for hand detection and tracking and user gestures.
[0184] In one embodiment, the depth sensor (317) may be configured to transmit a signal and receive a signal reflected from an object, and may be used for purposes such as time of flight (TOF) to determine the distance to an object.
[0185] According to one embodiment, a face recognition camera module (325, 326,) and / or a display (321) (and / or a lens) may be disposed on the second surface (320) of the housing.
[0186] In one embodiment, a face recognition camera module (325, 326) adjacent to the display may be used to recognize the user's face or to recognize and / or track both of the user's eyes.
[0187] In one embodiment, the display (321) (and / or lens) may be disposed on a second surface (320) of the wearable electronic device (300). In one embodiment, the wearable electronic device (300) may not include camera modules (315, 316) among a plurality of camera modules (313, 314, 315, 316). Although not illustrated in FIG. 3a and 3b, the wearable electronic device (300) may further include at least one of the configurations illustrated in FIG. 2.
[0188] As described above, according to one embodiment, the wearable electronic device (300) may have a form factor for being worn on a user's head. The wearable electronic device (300) may further include a strap and / or a wearing member for being secured on a part of the user's body. The wearable electronic device (101) may provide a user experience based on augmented reality, virtual reality, and / or mixed reality while being worn on the user's head.
[0189] Figure 4 is a diagram illustrating the field of view (FOV) for each electronic device.
[0190] For example, an electronic device (400), such as a smartphone, may provide content (410) corresponding to the first FOV (411). The content (410) may be, for example, an application execution screen, but is not limited thereto. For example, as shown in FIG. 4, the electronic device (400) may provide a 3D object (411), such as an avatar. Although FIG. 4 is illustrated as if an avatar is represented as the 3D object (411), this is merely illustrative. A wearable electronic device (300) worn by a user (401) may provide, for example, content (425) for virtual reality. The content (425) may include, for example, a 3D object (421). Although FIG. 4 is illustrated as if an avatar is represented as the 3D object (421), this is merely illustrative. A first FOV (411) corresponding to content (410) provided by an electronic device (400), such as a smartphone, may be smaller than a second FOV (421) corresponding to content (425) provided by a wearable electronic device (300), for example. For example, the virtual reality content (425) provided by the wearable electronic device (300) may be created for user immersion, and accordingly, the second FOV (421) corresponding to the virtual reality content (425) may be relatively large. The FOV and / or rendering conditions (e.g., distance to a 3D object part (e.g., tip part) in the user's line of sight from the FOV) may be set differently for each device or may have different values. For example, the FOV and / or rendering conditions may be set according to the device characteristics or design characteristics of the device. For example, the FOV and / or rendering conditions may be set according to software limitations specific to each device.
[0191] For example, an electronic device (400), such as a smartphone, may support an avatar creation function. Data for representing an avatar created by the electronic device (400) may also be shared with other electronic devices, such as a wearable electronic device (300). Accordingly, data for representing an avatar created based on the first FOV (411) may be represented by the wearable electronic device (300) corresponding to the second FOV (421), and there is a possibility of distortion occurring when representing content based on the difference between the FOVs (411, 421).
[0192] For example, the wearable electronic device (300) can display content (425) so that the user (401) perceives the 3D object (421) as being located at a distance of d1. For example, the wearable electronic device (300) can set the location (or coordinates, or depth) of the 3D object (421) within virtual space and can display content (425) so that the user perceives the 3D object (421) as being located at that location. Meanwhile, as described above, data for displaying an avatar generated based on the first FOV (411) can be displayed by the wearable electronic device (300) corresponding to the second FOV (421). When displaying content based on differences in FOVs (411, 421), there is a possibility of distortion occurring. For example, if the distance from the user's (401) viewpoint to the 3D object (421) (e.g., d1) (or may be referred to as depth) is relatively small, the possibility of distortion may be relatively large. For example, as shown in FIG. 4, there is a possibility that the face of the avatar, which is the 3D object (421), may be displayed as excessively large. Below, the prediction of the possibility of distortion and adjustments to suppress the occurrence of distortion according to various embodiments are described.
[0193] FIG. 5 is a diagram illustrating a method of operation of an electronic device according to one embodiment. The embodiment of FIG. 5 will be described with reference to FIG. 6a to 6d. FIG. 6a is a diagram illustrating a virtual space defined to represent a virtual reality service according to one embodiment. FIG. 6b is a diagram illustrating 3D object adjustment based on the position of a 3D object within a virtual space according to one embodiment. FIG. 6c is a diagram illustrating 3D object adjustment according to one embodiment. FIG. 6d is a diagram illustrating 3D object adjustment according to one embodiment.
[0194] According to one embodiment, the electronic device (101) may recognize a request for rendering of a 3D object in operation 501. Although it has been described below as if the electronic device (101) performs at least some of the operations of FIG. 5, those skilled in the art will understand that the entity performing the operations may be a wearable electronic device (200, 300), and that this applies not only to the example of FIG. 5 but to the entire disclosure. For example, the electronic device (101) may recognize the execution of an application for virtual reality containing a 3D object as a rendering request. For example, the electronic device (101) may recognize a request for providing content of virtual reality containing a 3D object as a rendering request. For example, the electronic device (101) may determine whether to adjust the 3D object at each frame while providing content containing the 3D object, or may determine whether to adjust the 3D object based on changes in the position, placement direction, and / or shape of the 3D object, but this is exemplary and not limited.
[0195] The electronic device (101) can determine the rendering positions of each of the multiple parts constituting a 3D object based on, for example, the view point (601) of FIG. 6a in operation 503. Those skilled in the art will understand that the parts constituting the 3D object may be placed in a field of view of a user based on the view point (601). For example, the electronic device (101) may manage a virtual space coordinate system based on the view point (601) as in FIG. 6a. For example, the electronic device (101) may manage a rectangular coordinate system or an angular coordinate system, but there are no limitations. Meanwhile, those skilled in the art will understand that the two-dimensional coordinate system in FIG. 6a is merely for convenience of explanation and that the virtual space may be implemented in three dimensions. For example, a single 3D object may be composed of multiple parts. For example, based on a joint, parts adjacent to the joint may be implemented to move relatively, and this will be described later. The electronic device (101) can check the rendering position of each of the multiple parts constituting the 3D object. Meanwhile, as this is exemplary, the electronic device (101) may be implemented to check a single position (which may be expressed as a representative position or a center position) for the 3D object.
[0196] The electronic device (101) can confirm that the first part satisfies the distortion expression condition based on the first rendering position of the first part among the plurality of parts in operation 505. For example, if the 3D object is placed close to the view point (601), or if the 3D object is placed to the left or right of the reference direction (615) (e.g., the front direction) of the view point (601), the possibility of distortion expression may be high.
[0197] In one example, the electronic device (101) can determine whether the distance from the view point (601) to the 3D object is less than or equal to a threshold distance (Dth) as whether the distortion expression condition is satisfied. In FIG. 6a, a set of points separated by a threshold distance (Dth) from the view point (601) may be named the distortion prediction range (620), but there are no limitations. For example, in the example of FIG. 6a, the distance from the view point (611) to the first 3D object (611) (or part) may be less than the threshold distance (Dth). The electronic device (101) can determine that the first 3D object (611) (or part) satisfies the distortion expression condition and can perform resizing to prevent (or mitigate) the distortion expression below. For example, in the example of FIG. 6a, the distance from the view point (611) to the second 3D object (613) (or part) may exceed a threshold distance (Dth). The electronic device (101) can determine that the second 3D object (613) (or part) does not satisfy the distortion representation condition and can represent the second 3D object (613) based on the original data without scaling. Meanwhile, a single condition corresponding to a single threshold distance (Dth) is merely illustrative, and those skilled in the art will understand that multiple conditions (or multiple regions) based on multiple threshold distances may be set. For example, multiple adjustment target regions may be set from a region relatively close to the view point (601), in which case the scaling parameter (or degree of scaling) for each region may be set differently.
[0198] In one example, the electronic device (101) can determine whether the angle between the reference direction (615) and the direction from the view point (601) to the 3D object is greater than or equal to the critical angle (617) as whether the distortion expression condition is satisfied. For example, in the example of FIG. 6a, the angle between the reference direction (615) and the direction from the view point (601) to the first 3D object (611) may be greater than the critical angle (617). The electronic device (101) can determine that the first 3D object (611) (or part) satisfies the distortion expression condition and can perform scaling to prevent (or mitigate) distortion expression below. For example, in the example of FIG. 6a, the angle between the reference direction (615) and the direction from the view point (601) to the first 3D object (611) may be less than or equal to the critical angle (617). The electronic device (101) can determine that the second 3D object (613) (or part) does not satisfy the distortion representation condition and can represent the second 3D object (613) based on the original data without scaling. The critical angle (617) may be set, for example, in relation to the focal length. The critical angle (617) may be set relatively smaller as the focal length is relatively larger, but there is no limitation. Meanwhile, a single condition corresponding to a single critical angle (617) is merely illustrative, and those skilled in the art will understand that multiple conditions (or multiple regions) based on multiple critical angles may be set. For example, multiple adjustment target regions may be set from a region relatively close to the reference direction (615), and in this case, the scaling parameter (or degree of scaling) for each region may be set differently.
[0199] The electronic device (101) can check whether a first condition related to the distance to a 3D object and / or a second condition related to the direction in which the 3D object is placed is satisfied, for example, but this is exemplary and there is no limit to the type and / or number of distortion expression conditions.
[0200] The electronic device (101) may, in operation 507, resize the first part based on confirming that the first 3D object (611) (or part) satisfies the distortion representation condition. The electronic device (101) may, in operation 509, render a 3D object composed of the resized first part and the remaining parts excluding the first part. In one example, the electronic device (101) may, based on confirming that the first 3D object (611) (or part) satisfies the distortion representation condition, resize the first 3D object (611) (or part) based on a specified resizing ratio (e.g., 80% reduction). For example, for a 3D object placed within the distortion prediction range (620), the electronic device (101) may reduce the size according to a specified ratio (e.g., 80%). In one example, the electronic device (101) may scale the first 3D object (611) (or part) based on a scaling ratio determined based on rendering parameters (e.g., distance, and / or angle) of the first 3D object (611), based on determining that the first 3D object (611) (or part) satisfies distortion representation conditions. For example, the electronic device (101) may scale the 3D object based on a ratio determined based on the distance from the viewpoint (601). For example, the electronic device (101) may scale the 3D object based on a ratio determined based on the angle between the reference direction (615) and the direction toward the 3D object. The scaling may be performed, for example, based on scaling of joints and / or mesh transforms, but is not limited thereto.
[0201] For example, if the 3D object is relatively close to the view point (601), the entire 3D object may be represented as relatively large, and if the 3D object is relatively far from the view point (601), the entire 3D object may be represented as relatively small. The adjustment of the size of the first part in the present disclosure may be the adjustment of the ratio of the size of the first part to the size of the other part. For example, if the ratio of the size of the first part and the size of the second part of the 3D object is A, the ratio of the size of the first part that has been resized and the size of the second part that has not been resized may be B, which is different from A. For example, those skilled in the art will understand that reducing the size of the first part may mean reducing the ratio of the size of the first part to the other part.
[0202] In FIG. 6b, an original 3D object composed of a plurality of parts (631a, 631b) is illustrated. An electronic device (101) can, for example, verify that the position of the 3D object is within the distortion prediction range (620). The electronic device (101) can, for example, adjust the size of the first part (632a) and maintain the size of the second part (632b). In one example, the electronic device (101) may adjust the size of the first part (632a) based on the fact that the first part (632a) is a designated object to be adjusted, and may not adjust the size of the second part (632b) based on the fact that the second part (632b) is not a designated object to be adjusted, which will be explained with reference to FIG. 7. Accordingly, a 3D object composed of a resized first part (632a) and a second part (632b) that is not resized can be represented. Referring to FIG. 6c, the original 3D object (640) may be composed of a first part (641) and a second part (642). Meanwhile, if the distance from the viewpoint is the first distance and no scaling is performed, the 3D object (650) may be represented. The 3D object (650) may be composed of multiple parts (651, 652), and in particular, there is a possibility that the first part (651) may be represented as excessively large. As described above, the electronic device (101) can confirm that the distortion representation condition for the first part (651) is satisfied and, in response, can adjust the size of the first part (651). Referring to FIG. 6c, a 3D object (660) composed of a first part (661) having an adjusted size and a second part (662) that is not adjusted may be represented. Referring to FIG. 6d, the original 3D object (670) may be composed of a first part (671), a second part (672), and a third part (673). Meanwhile, if the distance from the viewpoint is the first distance and no scaling is performed, the 3D object (680) may be represented.A 3D object (680) may be composed of multiple parts (681, 682, 683), and in particular, there is a possibility that the first part (681) and the third part (683) may be represented as excessively large. As described above, the electronic device (101) can confirm that the distortion representation conditions for the first part (681) and the third part (683) are satisfied, and accordingly, the size of the first part (681) and the third part (683) can be adjusted. Referring to FIG. 6d, a 3D object (690) composed of a first part (691), a third part (693) having adjusted sizes, and an unadjusted second part (692) can be represented.
[0203] As described above, the electronic device (101) can represent a 3D object composed of a scaled-up portion and an unscaled-up portion. In one example, the scaled-up portion may satisfy the distortion representation condition, while the other portion may not satisfy the distortion representation condition. In one example, even if the distance and / or angle to the other portion satisfies the distortion representation condition, the other portion may not be scaled on the basis that it is not a scaled-up portion, which will be explained with reference to FIG. 7. In one example, the electronic device (101) may scale only the scaled-up portion among the parts constituting the 3D object when the distance and / or angle to any one point (e.g., a midpoint) of the 3D object satisfies the distortion representation condition, which will be explained with reference to FIG. 7.
[0204] FIG. 6e is a diagram illustrating a method of operation of an electronic device according to one embodiment.
[0205] According to one embodiment, the electronic device (101) may, in operation 695, confirm a rendering request for a 3D object. Based on the confirmation of the rendering request, the electronic device (101) may, in operation 696, confirm rendering positions based on a user's view point corresponding to each of the plurality of parts of the 3D object. In operation 696, the electronic device (101) may, based on a first rendering position of the first part among the plurality of parts, adjust the size of the first part. In one example, the electronic device (101) may, based on the degree of adjustment confirmed based on the distance from the view point to the first part, adjust the size of the first part. In operation 697, the electronic device (101) may, in operation 697, render a 3D object composed of the resized first part and the remaining parts excluding the first part. For example, the electronic device (101) may determine the degree of size adjustment of the first part by referring to information on the degree of size adjustment by distance such as Table 1.
[0206] Distance to 3D Object Scale (Relative to Original Size) D > Dth100% D ≤ Dth80%
[0207] Meanwhile, Table 1 is exemplary, and there may be multiple areas to be resized, as shown in Table 2.
[0208] Distance to 3D Object Scaling Degree (Relative to Original Size) D > Dth1 100% Dth2 < D ≤ Dth1 80% D ≤ Dth2 60%
[0209] Meanwhile, the scaling based on association information (or lookup tables) such as Table 1 and Table 2 is exemplary, and the electronic device (101) may also determine the degree of scaling identified based on a mathematical formula. The mathematical formula may be expressed, for example, in a linear form, an exponential form, a logarithmic form, a sigmoid form, and / or a trigonometric form, but this is exemplary and there are no restrictions on the form of expression of the mathematical formula.
[0210] FIG. 6f is a diagram illustrating a method of operation of an electronic device according to one embodiment.
[0211] According to one embodiment, the electronic device (101) may, in operation 621, confirm a rendering request for a 3D object. Based on the confirmation of the rendering request, the electronic device (101) may, in operation 623, confirm rendering positions based on a user's view point corresponding to each of the plurality of parts of the 3D object. In operation 625, the electronic device (101) may adjust the position, size, and / or shape of the first part based on the first rendering position of the first part among the plurality of parts. For example, the electronic device (101) may adjust the position, size, and / or shape of the first part based on mesh transformation. In one example, the electronic device (101) may reduce or enlarge the size of the first part. For example, if the first part is a face, the electronic device (101) may reduce the size of the first part based on the finding that the size of the first part is relatively large. For example, the electronic device (101) may reduce the size of the first part by reducing the size of at least some of the plurality of meshes constituting the first part, but this is exemplary and not limited. In one example, the electronic device (101) may change the position of the first part. For example, the electronic device (101) may change the position of the first part based on the translation of at least some of the plurality of meshes constituting the first part. For example, if the first part is a hand, and the first part is positioned relatively far from the viewpoint compared to other parts, the electronic device (101) may change the position of the first part by positioning the first part relatively close to the viewpoint. In one example, the electronic device (101) may change the shape of the first part.For example, the electronic device (101) can change the shape of the first part by performing a shape transformation (which may be referred to as a shear transformation) on at least some of the plurality of meshes constituting the first part. For example, if the first part is a hand, and the hand corresponding to the first part is expected to be represented as relatively long or relatively short, the electronic device (101) can change the shape (or change the length) of the hand (e.g., fingers, but not limited to) by performing a shape transformation. The electronic device (101) can render a 3D object composed of the adjusted first part and the remaining parts excluding the first part in operation 627.
[0212] FIG. 7 is a drawing for explaining a method of operation of an electronic device according to one embodiment. The embodiment of FIG. 7 will be explained with reference to FIG. 8a. FIG. 8a is a drawing for explaining a plurality of parts of a 3D object according to one embodiment.
[0213] According to one embodiment, the electronic device (101) can confirm a request for rendering of a 3D object in operation 701. In operation 703, the electronic device (101) can confirm the rendering positions of each of the plurality of parts constituting the 3D object based on the user's view point. In operation 705, the electronic device (101) can confirm that the first part satisfies a distortion representation condition based on the first rendering position of the first part among the plurality of parts. In operation 707, the electronic device (101) can confirm that the first part is subject to distortion adjustment. For example, referring to FIG. 8a, the 3D object (810) may be composed of a plurality of parts (811, 812, 813, 814, 815, 816). In one example, the parts (811, 813, 814, 815, 816) that are the tip (or end) of a plurality of parts (811, 812, 813, 814, 815, 816) may be set as distortion adjustment targets, and the remaining parts (e.g., part (812)) may not be set as distortion adjustment targets. In one example, the electronic device (101) may identify distortion adjustment targets according to the type (or attribute) of the 3D object. For example, if the type of the 3D object is an avatar corresponding to a human (or a similar or anthropomorphic object), the electronic device (101) may identify the part corresponding to the face and / or hand as a distortion adjustment target. In one example, the electronic device (101) may identify the first part as a distortion adjustment target if the size of the first part of the 3D object is larger than the size of the other part by a specified ratio. Meanwhile, the above-described distortion adjustment target setting conditions are exemplary, and there are no restrictions on the setting conditions for the distortion adjustment target. The electronic device (101) can adjust the size of the first part in operation 709 based on the fact that the first part satisfies the distortion expression conditions and the first part is a distortion adjustment target.The electronic device (101) can render a 3D object composed of a scaled-up first part and the remaining parts excluding the first part in 711 operation.
[0214] FIGS. 8b to 8d are drawings for illustrating 3D objects according to various embodiments.
[0215] Referring to FIG. 8b, a 3D object (820) of a cartoon character can be represented by an electronic device (101) according to one embodiment. Adjacent parts (821, 823) of the 3D object (820) can be connected based on a joint (822). Based on the joint (822), the adjacent parts (821, 823) can be implemented to move relative to each other. Referring to FIG. 8c, a 3D object (830) of an animal can be represented by an electronic device (101) according to one embodiment. Adjacent parts (831, 833) of the 3D object (830) can be connected based on a joint (832). Referring to FIG. 8d, a 3D object (840) of an anthropomorphic object can be represented by an electronic device (101) according to one embodiment. Adjacent parts (841, 843) of a 3D object (840) can be connected based on a joint (842).
[0216] FIG. 8e is a drawing for explaining the operation method of an electronic device according to one embodiment.
[0217] According to one embodiment, the electronic device (101) may, in operation 891, confirm a request for rendering of an avatar. In operation 893, the electronic device (101) may confirm that the first body part satisfies a distortion expression condition based on the position of the first body part among a plurality of body parts constituting the avatar relative to a viewpoint. The distortion expression condition may be expressed, for example, based on the distance from the viewpoint to the first body part and / or the angle between the direction from the viewpoint to the first body part and the reference direction, but is not limited thereto. In operation 895, the electronic device (101) may adjust the size of the first part based on confirming the satisfaction of the distortion expression condition of the first body part. In one example, the electronic device (101) may adjust the size of the first part according to the satisfaction of the distortion expression condition of the first body part and maintain the size of the remaining parts. In one example, the electronic device (101) can adjust the size of the first body part based on the fact that the first body part satisfies a distortion representation condition and additionally the first body part is a distortion adjustment target (e.g., face and / or hand). The electronic device (101) can render an avatar consisting of the resized first body part and the remaining body parts in operation 897.
[0218] FIG. 9 is a drawing for explaining a method of operation of an electronic device according to one embodiment. The embodiment of FIG. 9 will be explained with reference to FIG. 10. FIG. 10 is a drawing for explaining the adjustment of a 3D object according to one embodiment.
[0219] According to one embodiment, the electronic device (101) can confirm a request for rendering of an avatar in operation 901. In operation 903, the electronic device (101) can confirm the rendering positions of each of the plurality of parts constituting a 3D object based on a view point. In operation 905, the electronic device (101) can confirm that the first part satisfies a distortion representation condition based on the first rendering position of the first part among the plurality of parts. In operation 907, the electronic device (101) can adjust the size of the first part. In operation 909, the electronic device (101) can perform adjustments to the connection portion between the first part and the adjacent part. For example, the electronic device (101) can perform adjustments to the connection portion so that the resized first part and the unresized adjacent part can be represented as being seamlessly connected. For example, the electronic device (101) may reduce the size of the portion adjacent to the first portion of the connection part, but there is no limitation. The electronic device (101) may render a 3D object composed of the resized first portion, the connection part, and the remaining portions excluding the first portion in the 911 operation. Meanwhile, the embodiment of FIG. 9 is exemplary, and those skilled in the art will understand that no adjustment may be performed on the connection part between the first portion and the adjacent portion. For example, referring to FIG. 10, the electronic device (101) may resize the first portion (811), and thus provide a resized first portion (1011). The electronic device (101) may also resize the connection part (819) for the first portion (811), and thus provide a resized connection part (819). For example, the size of the part adjacent to the first part (1011) of the connected part (1019) that has been resized may be reduced, but this is exemplary.Accordingly, the connecting part (1053) of the resized first part (1051) and second part (1052) of the 3D object may be at least partially different from the connecting part (1042) between the first part (1041) and second part (1042) prior to resizing.
[0220] FIG. 11 is a drawing for explaining the operation method of an electronic device according to one embodiment.
[0221] According to one embodiment, the electronic device (101) may acquire data for representing a 3D object created based on a first FOV in operation 1101. For example, as described with reference to FIG. 4, the 3D object may be created based on the first FOV (411). The electronic device (101) may receive data for representing the 3D object from an electronic device (400), such as a smartphone of FIG. 4, for example. In operation 1103, the electronic device (101) may determine whether at least a portion of the data for representing the 3D object is adjusted based on the first FOV and / or the second FOV of the electronic device (101). In one example, the electronic device (101) may determine whether the second FOV of the electronic device (101) is greater than or equal to a specified FOV as whether at least a portion of the data for representing the 3D object is adjusted. For example, if the second FOV of the electronic device (101) is relatively large, as described above, there is a high probability that a 3D object placed relatively close to the view point will be displayed excessively large. Accordingly, the electronic device (101) can check whether the second FOV of the electronic device (101) is greater than or equal to the first threshold FOV by adjusting the data for displaying the 3D object. In one example, the electronic device (101) can check whether the ratio of the second FOV to the first FOV is greater than or equal to the threshold ratio by adjusting the data for displaying the 3D object. For example, if the ratio of the second FOV to the first FOV is relatively large, there is a high probability that a 3D object placed relatively close to the view point will be displayed excessively large. Accordingly, the electronic device (101) can check whether the ratio of the second FOV to the first FOV is greater than or equal to the threshold ratio by adjusting the data for displaying the 3D object.In one example, the electronic device (101) can determine whether the first FOV is less than or equal to the second threshold FOV by adjusting the data for representing the 3D object. For example, if data for representing a 3D object created based on a relatively small first FOV is represented by the electronic device (101) based on the second FOV, it is highly likely that the 3D object placed relatively close to the view point will be represented excessively large. Accordingly, the electronic device (101) can determine whether the first FOV is less than or equal to the second threshold FOV by adjusting the data for representing the 3D object. The electronic device (101) can determine the part of the 3D object to be adjusted based on the fact that adjustment of at least part of the data for representing the 3D object is required in the operation 1105. For example, the electronic device (101) may determine whether a part is subject to adjustment based on the attributes of each part constituting the 3D object, the size ratio relative to other parts, and / or whether it is an end part (or tip part), as described with reference to FIG. 7, but this is exemplary and not limited. The electronic device (101) may store adjusted data to represent the 3D object created by adjusting the data corresponding to the part subject to adjustment in operation 1107. The electronic device (101) may then represent the 3D object using the adjusted data when a request for rendering of the 3D object is confirmed.
[0222] FIG. 12 is a drawing for explaining the operation method of an electronic device according to one embodiment.
[0223] According to one embodiment, the electronic device (101) may acquire data for representing a 3D object created based on a first FOV in operation 1201. For example, as described with reference to FIG. 4, the 3D object may be created based on the first FOV (411). The electronic device (101) may receive data for representing the 3D object from an electronic device (400), such as a smartphone of FIG. 4, for example. In operation 1203, the electronic device (101) may check whether at least a portion of the data for representing the 3D object is adjusted based on the first FOV and / or the second FOV of the electronic device (101). In operation 1205, the electronic device (101) may check the portion of the 3D object to be adjusted based on whether adjustment of at least a portion of the data for representing the 3D object is required. Operations 1203 and 1205 have been explained with reference to FIG. 11, so the explanation here is not repeated.
[0224] The electronic device (101) may store, for example, two sets of data, adjusted data and original data, for representing a 3D object created by adjusting data corresponding to the part to be adjusted in operation 1207. The electronic device (101) may perform rendering using either of the original data or the adjusted data based on rendering conditions in operation 1209. For example, the electronic device (101) may perform rendering of the 3D object using the adjusted data when the distance from the view point to the 3D object is less than or equal to a threshold distance. For example, the electronic device (101) may perform rendering of the 3D object using the original data rather than the adjusted data when the distance from the view point to the 3D object is greater than the threshold distance.
[0225] FIG. 13 is a drawing for explaining a method of operation of an electronic device according to one embodiment. The embodiment of FIG. 13 will be described with reference to FIG. 14 and FIG. 15. FIG. 14 is a drawing for explaining the adjustment of a 3D object according to a change in view point according to one embodiment. FIG. 15 is a drawing for explaining the adjustment of a 3D object according to a rotation of a 3D object according to one embodiment.
[0226] According to one embodiment, the electronic device (101) can render an unscaled 3D object in operation 1301. For example, the electronic device (101) can render an unscaled 3D object based on the fact that parts constituting the 3D object do not satisfy distortion representation conditions. The electronic device (101) can check for a change in the position of a first part of the 3D object relative to a viewpoint in operation 1303. In one example, the position of the 3D object may change when the user's viewpoint is fixed in virtual space. In one example, the user's viewpoint may change in virtual space, and accordingly, the position of the 3D object relative to the user's viewpoint in virtual space may change. The electronic device (101) can check in operation 1305 that the first part satisfies distortion representation conditions based on the changed position. For example, the electronic device (101) can determine, as satisfaction of the distortion representation condition, that the distance from the view point identified based on the changed position of the first part to the first part is less than or equal to a threshold distance. In operation 1307, the electronic device (101) can adjust the size of the first part based on the satisfaction of the distortion representation condition of the first part. In operation 1309, the electronic device (101) can render an avatar composed of the resized first part and the remaining parts. For example, as in FIG. 14, at a first time point (T1), the user (1401) can wear the electronic device (101) while sitting. The electronic device (101) can render 3D objects (1402, 1403) for virtual reality. At the first time point (T1), the distance from the view point to the 3D object (1402) may be, for example, less than or equal to a threshold distance, and accordingly, the electronic device (101) may adjust the size of some of the 3D object (1402).Meanwhile, at the second time point (T2), the user (1411) may stand up while wearing the electronic device (101). This may cause a movement of the viewpoint within the virtual space. At the second time point (T2), the distance from the viewpoint to the 3D object (1412) may, for example, exceed a threshold distance, and accordingly, parts of the 3D object (1412) may not satisfy the distortion representation conditions. The electronic device (101) may represent the object (1412) that has not been scaled at the second time point (T2). The object (1413) may be placed at the position of the object (1403) at the first time point (T1). Meanwhile, at the third time point (T3), the objects (1422, 1423) may move in correspondence with the changed viewpoint. In this case, at the third time point (T3), the distance from the view point to the 3D object (1422) may be, for example, less than or equal to a threshold distance, and accordingly, the electronic device (101) may adjust the size of a portion of the 3D object (1422). As described above, the distance from the view point to the 3D object may change depending on the movement of the view point and / or the movement of the 3D object, and adjustment and / or suspension of adjustment of the 3D object may be performed in real time based on the changed distance. For example, referring to FIG. 15, at the first time point (T1), the distance from the view point (1501) to the first part (1502) may be D1. For example, the distance D1 may not satisfy the distortion representation condition, and the electronic device (101) may not perform adjustment for the first part (1502). Meanwhile, at the second viewpoint (T2), the 3D object including the first part (1502) can be rotated, and the distance from the viewpoint (1501) to the first part (1502) can be D2. For example, the distance D2 can satisfy the distortion expression condition, and the electronic device (101) can adjust the size of the first part (1502).
[0227] FIG. 16a is a drawing for explaining a method of operation of an electronic device according to one embodiment. FIG. 16a will be explained with reference to FIG. 16b. FIG. 16b is a drawing for explaining the adjustment of a 3D object according to one embodiment.
[0228] According to one embodiment, the electronic device (101) can confirm a rendering request for a 3D object in operation 1601. Based on the confirmation of the rendering request, the electronic device (101) can confirm rendering positions based on a user's view point corresponding to each of the plurality of parts of the 3D object in operation 1603. In operation 1605, the electronic device (101) can adjust the position, size, and / or shape of the first part based on user input regarding the first part among the plurality of parts. For example, referring to FIG. 16b, the electronic device (101) can represent a bar (1621) on which a slider (1622) can be placed. The position of the slider (1622) on the bar (1621) can be changed according to user input. For example, as shown in FIG. 16b, the size of parts (651, 661) of a 3D object corresponding to a face can be adjusted according to the position of the slider (1622) on the bar (1621). Here, the adjustment of size according to the position of the slide (1622) is exemplary, and there are no limitations on the method of adjustment of size. For example, the electronic device (101) may check the degree of adjustment based on the selection of at least one candidate setting (e.g., may be expressed as "natural setting" or "realistic setting," but without limitation). Meanwhile, those skilled in the art will understand that the adjustment of size is also exemplary, and that the adjustment of shape and / or position may also be performed according to user input. In one example, the electronic device (101) may be implemented to perform an adjustment according to the rendering position of the first part first, as described with reference to FIG. 5, and then perform additional adjustment of the first part according to user input, but without limitation. The electronic device (101) can render a 3D object composed of a first adjusted part and the remaining parts excluding the first part in operation 1607.
[0229] The electronic device (101; 200; 300) may include at least one processor (120) and a memory (130) for storing instructions.
[0230] When the above instructions are executed individually or collectively by the at least one processor (120), they may cause the electronic device (101; 200; 300) to confirm a request for rendering of a 3D object composed of a plurality of parts.
[0231] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101; 200; 300) may cause the location in virtual space based on the user's view point corresponding to each of the plurality of parts of the 3D object to be identified based on the request for rendering.
[0232] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101; 200; 300) may cause the first part to satisfy a distortion representation condition based on a first location of the first part among the plurality of parts.
[0233] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101; 200; 300) may cause the size identified based on the first position of the first part to be adjusted to a different size based on confirming the satisfaction of the distortion representation condition of the first part.
[0234] When the above instructions are executed individually or collectively by the at least one processor (120), they may cause the electronic device (101; 200; 300) to render the 3D object composed of the scaled first part and the remaining parts excluding the first part.
[0235] The above remaining parts may have a size determined based on the location of each of the above remaining parts.
[0236] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101; 200; 300) may cause the size identified based on the first position of the first part to be adjusted as at least part of the operation of adjusting the size identified based on the first position of the first part, based on satisfying the distortion representation condition of the first part and confirming that the first part is subject to distortion adjustment.
[0237] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101; 200; 300) may be caused to confirm, as at least part of an operation confirming that the first part satisfies the distortion representation condition, that the first distance from the view point confirmed based on the first position of the first part is less than or equal to the threshold distance, as the satisfaction of the distortion representation condition.
[0238] When the above instructions are executed individually or collectively by the at least one processor (120), they may cause the size of the first part to be adjusted by a specified ratio based on the first distance being less than or equal to the threshold distance as at least part of the operation of adjusting the size of the first part.
[0239] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101; 200; 300) may cause the size of the first part to be adjusted by a ratio determined based on the first distance, based on the first distance being less than or equal to the threshold distance, as at least part of the operation of adjusting the size of the first part.
[0240] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101; 200; 300) may be caused to confirm, as at least part of an operation confirming that the first part satisfies the distortion expression condition, that the angle between the reference direction based on the view point and the first direction from the view point to the first position is greater than or equal to a critical angle, as the satisfaction of the distortion expression condition.
[0241] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101; 200; 300) may cause the size of the first part to be adjusted by a specified ratio based on the angle being greater than or equal to the critical angle as at least part of the operation of adjusting the size of the first part.
[0242] The above instructions, when executed individually or collectively by the at least one processor (120), cause the electronic device (101; 200; 300) to adjust the size of the first part by a ratio determined based on the angle, based on the fact that the angle is greater than or equal to the critical angle.
[0243] Two adjacent parts among the plurality of parts of the above 3D object can be connected by a joint.
[0244] Based on the above joint, one of the two parts may be movable relative to the other part.
[0245] When the above instructions are executed individually or collectively by the at least one processor (120), they may cause the electronic device (101; 200; 300) to perform adjustments to express a seamless connection with respect to the connection portion of the scaled first part and the second part adjacent to the first part.
[0246] The size identified based on the first position of the first part above can be set to correspond to a FOV different from the FOV of the electronic device (101; 200; 300).
[0247] The electronic device (101; 200; 300) further includes a display configured to provide binocular content corresponding to the 3D object, and the rendering result of the 3D object, composed of the resized first part and the remaining parts excluding the first part, can be provided through the display.
[0248] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101; 200; 300) may cause the size identified based on the first position of the first part to be adjusted to a different size based on user input.
[0249] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101; 200; 300) may cause the first part to be adjusted by performing the size, shape and / or movement of at least some of the plurality of meshes constituting the first part.
[0250] The method of operation of the electronic device (101; 200; 300) may include an operation to confirm a request for rendering of a 3D object composed of a plurality of parts.
[0251] The method of operation of the above electronic device (101; 200; 300) may include, based on confirming the request for rendering, an operation of confirming locations in a virtual space based on a user's view point corresponding to each of the plurality of parts of the 3D object.
[0252] The method of operation of the above electronic device (101; 200; 300) may include an operation of confirming that the first part satisfies a distortion expression condition based on a first position of the first part among the plurality of parts.
[0253] The method of operation of the electronic device (101; 200; 300) may include an operation of adjusting the size identified based on the first position of the first part to a different size based on confirming the satisfaction of the distortion expression condition of the first part.
[0254] The method of operation of the electronic device (101; 200; 300) may include the operation of rendering the 3D object composed of the resized first part and the remaining parts excluding the first part.
[0255] It includes, and the remaining parts may have a size determined based on the location of each of the remaining parts.
[0256] The operation of adjusting the size identified based on the first position of the first part may include the operation of adjusting the size identified based on the first position of the first part, based on satisfying the distortion expression condition of the first part and confirming that the first part is a distortion adjustment target.
[0257] The operation of confirming that the first part satisfies the distortion expression condition may include confirming, as satisfaction of the distortion expression condition, that the first distance from the view point confirmed based on the first position of the first part is less than or equal to the threshold distance.
[0258] The operation of adjusting the size of the first part may include adjusting the size of the first part by a specified ratio based on the first distance being less than or equal to the threshold distance.
[0259] The operation of adjusting the size of the first part may include adjusting the size of the first part by a ratio determined based on the first distance, based on the first distance being less than or equal to the threshold distance.
[0260] The operation of confirming that the first part satisfies the distortion expression condition may include confirming that the angle between the reference direction based on the view point and the first direction from the view point to the first position is greater than or equal to a critical angle as the satisfaction of the distortion expression condition.
[0261] The operation of adjusting the size of the first part may include adjusting the size of the first part by a specified ratio based on the fact that the angle is greater than or equal to the critical angle.
[0262] The method of operation of the electronic device (101; 200; 300) may include an operation to confirm a request for rendering of a 3D object composed of a plurality of parts.
[0263] The method of operation of the above electronic device (101; 200; 300) may include, based on confirming the request for rendering, an operation of confirming locations in a virtual space based on a user's view point corresponding to each of the plurality of parts of the 3D object.
[0264] The method of operation of the above electronic device (101; 200; 300) may include an operation of confirming that the first part satisfies a distortion expression condition based on a first position of the first part among the plurality of parts.
[0265] The method of operation of the electronic device (101; 200; 300) may include an operation of adjusting the size identified based on the first position of the first part to a different size based on confirming the satisfaction of the distortion expression condition of the first part.
[0266] The method of operation of the electronic device (101; 200; 300) may include the operation of rendering the 3D object composed of the resized first part and the remaining parts excluding the first part.
[0267] The above remaining parts may have a size determined based on the location of each of the above remaining parts.
[0268] The size identified based on the first position of the first part above can be set to correspond to a FOV different from the FOV of the electronic device (101; 200; 300).
[0269] The rendering result of the 3D object composed of the above-mentioned resized first part and the remaining parts excluding the first part can be provided through a display.
[0270] The method of operation of the electronic device (101; 200; 300) may include an operation of adjusting the size identified based on the first position of the first part to a different size based on user input.
[0271] The method of operation of the electronic device (101; 200; 300) may include an operation of adjusting the first part by performing a size, shape and / or movement of at least some of the plurality of meshes constituting the first part.
[0272] A storage medium for storing computer-executable instructions may be provided.
[0273] When the above instructions are executed individually or collectively by at least one processor (120) of the electronic device (101; 200; 300), the electronic device (101; 200; 300) may cause the electronic device (101; 200; 300) to confirm a request for rendering of a 3D object composed of a plurality of parts.
[0274] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101; 200; 300) may cause the location in virtual space based on the user's view point corresponding to each of the plurality of parts of the 3D object to be identified based on the request for rendering.
[0275] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101; 200; 300) may cause the first part to satisfy a distortion representation condition based on a first location of the first part among the plurality of parts.
[0276] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101; 200; 300) may cause the size identified based on the first position of the first part to be adjusted to a different size based on confirming the satisfaction of the distortion representation condition of the first part.
[0277] When the above instructions are executed individually or collectively by the at least one processor (120), they may cause the electronic device (101; 200; 300) to render the 3D object composed of the scaled first part and the remaining parts excluding the first part.
[0278] The electronic device (101; 200; 300) may include at least one processor (120) and a memory (130) for storing instructions.
[0279] When the above instructions are executed individually or collectively by the at least one processor (120), they may cause the electronic device (101; 200; 300) to acquire data for representing a 3D object created based on the first FOV.
[0280] When the above instructions are executed individually or collectively by the at least one processor (120), they may cause the electronic device (101; 200; 300) to check whether at least a portion of the data for representing the 3D object is adjusted based on at least one of the first FOV or the second FOV of the electronic device (101; 200; 300).
[0281] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101; 200; 300) may be caused to identify the part of the 3D object to be adjusted based on the requirement to adjust at least a part of the data for representing the 3D object.
[0282] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101; 200; 300) may be caused to store adjusted data for representing the 3D object created by adjusting the data corresponding to the part to be adjusted.
[0283] Data regarding the remaining parts, excluding the data corresponding to the above-mentioned adjustment target part, may be retained.
[0284] The method of operation of the electronic device (101; 200; 300) may include the operation of acquiring data for representing a 3D object generated based on the first FOV.
[0285] The method of operation of the electronic device (101; 200; 300) may include an operation of checking whether at least a portion of the data for representing the 3D object is adjusted based on at least one of the first FOV or the second FOV of the electronic device (101; 200; 300).
[0286] The method of operation of the above electronic device (101; 200; 300) may include an operation of identifying a part of the 3D object to be adjusted based on the requirement to adjust at least a part of the data for representing the 3D object.
[0287] The method of operation of the above electronic device (101; 200; 300) may include the operation of storing adjusted data to represent the 3D object created by adjusting data corresponding to the adjustment target part.
[0288] Data regarding the remaining parts, excluding the data corresponding to the above-mentioned adjustment target part, may be retained.
[0289] A storage medium for storing computer-executable instructions may be provided.
[0290] When the above instructions are executed individually or collectively by at least one processor (120) of the electronic device (101; 200; 300), the electronic device (101; 200; 300) may cause the electronic device (101; 200; 300) to acquire data for representing a 3D object created based on a first FOV.
[0291] When the above instructions are executed individually or collectively by the at least one processor (120), they may cause the electronic device (101; 200; 300) to check whether at least a portion of the data for representing the 3D object is adjusted based on at least one of the first FOV or the second FOV of the electronic device (101; 200; 300).
[0292] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101; 200; 300) may be caused to identify the part of the 3D object to be adjusted based on the requirement to adjust at least a part of the data for representing the 3D object.
[0293] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101; 200; 300) may be caused to store adjusted data for representing the 3D object created by adjusting the data corresponding to the part to be adjusted.
[0294] Data regarding the remaining parts, excluding the data corresponding to the above-mentioned adjustment target part, may be retained.
[0295] The electronic device (101; 200; 300) may include at least one processor (120) and a memory (130) for storing instructions.
[0296] When the above instructions are executed individually or collectively by the at least one processor (120), they may cause the electronic device (101; 200; 300) to confirm a request for rendering of an avatar.
[0297] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101; 200; 300) may cause the locations within the virtual space of each of the plurality of body parts constituting the avatar based on the user's view point in the virtual space, based on confirming the request for the rendering.
[0298] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101; 200; 300) may cause the first part to satisfy a distortion representation condition based on a first position of the first body part among the plurality of parts.
[0299] The first body part above may correspond to the extremity part of the avatar.
[0300] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101; 200; 300) may cause the size identified based on the first position of the first body part to be adjusted based on confirming the satisfaction of the distortion representation condition of the first body part.
[0301] When the above instructions are executed individually or collectively by the at least one processor (120), they may cause the electronic device (101; 200; 300) to render the avatar composed of the resized first body part and the remaining body parts excluding the first part.
[0302] The above remaining body parts may have a size determined based on the location of each of the above remaining parts.
[0303] The method of operation of the electronic device (101; 200; 300) may include an operation to confirm a request for rendering of an avatar.
[0304] The method of operation of the above electronic device (101; 200; 300) may include, based on confirming the request for rendering, the operation of confirming the locations within the virtual space of each of the plurality of body parts constituting the avatar based on a view point in the virtual space.
[0305] The method of operation of the above electronic device (101; 200; 300) may include an operation of confirming that the first part satisfies a distortion expression condition based on a first position of the first body part among the plurality of parts.
[0306] The first body part above may correspond to the extremity part of the avatar.
[0307] The method of operation of the electronic device (101; 200; 300) may include an operation of adjusting the size identified based on the first position of the first body part, based on confirming the satisfaction of the distortion expression condition of the first body part.
[0308] The method of operation of the electronic device (101; 200; 300) may include the operation of rendering the avatar composed of the resized first body part and the remaining body parts excluding the first part.
[0309] The above remaining body parts have a size identified based on the location of each of the above remaining parts.
[0310] A storage medium for storing computer-executable instructions may be provided.
[0311] When the above instructions are executed individually or collectively by at least one processor (120) of the electronic device (101; 200; 300), the electronic device (101; 200; 300) may cause the electronic device (101; 200; 300) to confirm a request for rendering of an avatar.
[0312] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101; 200; 300) may cause the locations within the virtual space of each of the plurality of body parts constituting the avatar based on the user's view point in the virtual space, based on confirming the request for the rendering.
[0313] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101; 200; 300) may cause the first part to satisfy a distortion representation condition based on a first position of the first body part among the plurality of parts.
[0314] The first body part above may correspond to the extremity part of the avatar.
[0315] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101; 200; 300) may cause the size identified based on the first position of the first body part to be adjusted to a different size based on confirming the satisfaction of the distortion representation condition of the first body part.
[0316] When the above instructions are executed individually or collectively by the at least one processor (120), they may cause the electronic device (101; 200; 300) to render the avatar composed of the resized first body part and the remaining body parts excluding the first part.
[0317] The above remaining body parts may have a size determined based on the location of each of the above remaining parts.
[0318] The electronic device according to the various embodiments disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this document is not limited to the devices described above.
[0319] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as “coupled” or “connected” to another (e.g., 2nd) component, with or without the terms “functionally” or “communicationly,” it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.
[0320] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).
[0321] One embodiment of the present document may be implemented as software (e.g., program (140)) comprising one or more instructions stored in a storage medium (e.g., internal memory (136) or external memory (138)) readable by a machine (e.g., electronic device (101)). For example, a processor (e.g., processor (120)) of the machine (e.g., electronic device (101)) may call at least one of the one or more instructions stored in the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.
[0322] According to one embodiment, the method according to the embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or an application store (e.g., Play Store). TM It can be distributed online (e.g., downloaded or uploaded) through ) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.
[0323] According to one embodiment, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to one embodiment, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the components of the multiple components in the same or similar manner as those performed by the corresponding components among the multiple components prior to integration. According to one embodiment, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.
Claims
1. In an electronic device (101; 200; 300), At least one processor (120); and The electronic device (101; 200; 300) includes a memory (130) for storing instructions, wherein the instructions are executed individually or collectively by the at least one processor (120): Check the request for rendering a 3D object composed of multiple parts, and Based on confirming the request for the above rendering, the locations within a virtual space corresponding to each of the plurality of parts of the 3D object, based on the user's view point, are identified, and Based on the first position of the first part among the plurality of parts above, it is confirmed that the first part satisfies the distortion representation condition, and Based on confirming the satisfaction of the distortion expression condition of the first part, the size confirmed based on the first position of the first part is adjusted to a different size, and An electronic device (101; 200; 300) that causes rendering of the 3D object composed of the first portion with the size adjusted and the remaining portions excluding the first portion, wherein the remaining portions have a size determined based on the position of each of the remaining portions.
2. In Paragraph 1, When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101; 200; 300) causes at least as part of an operation to adjust the size identified based on the first position of the first part: An electronic device (101; 200; 300) that causes to adjust the size identified based on the first position of the first part, based on the satisfaction of the distortion expression condition of the first part and the confirmation that the first part is subject to distortion adjustment.
3. In any one of paragraphs 1 to 2, When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101; 200; 300) causes the first part to satisfy a distortion representation condition as at least part of an operation: An electronic device (101; 200; 300) that causes to confirm, as satisfaction of the distortion expression condition, that the first distance from the view point confirmed based on the first position of the first part is less than or equal to the threshold distance.
4. In Paragraph 3, The above instructions, when executed individually or collectively by the at least one processor (120), are at least as part of an operation to resize the first part: An electronic device (101; 200; 300) that causes the size of the first part to be adjusted by a specified ratio based on the fact that the first distance is less than or equal to the critical distance.
5. In Paragraph 4, When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101; 200; 300) causes, at least as part of an operation to adjust the size of the first part: An electronic device (101; 200; 300) that causes the size of the first part to be adjusted by a ratio determined based on the first distance, based on the fact that the first distance is less than or equal to the critical distance.
6. In any one of paragraphs 1 to 5, When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101; 200; 300) causes the first part to satisfy a distortion representation condition as at least part of an operation: An electronic device (101; 200; 300) that causes the angle between a reference direction based on the above view point and a first direction from the above view point to the first position to be greater than or equal to a critical angle as satisfaction of the distortion expression condition.
7. In Paragraph 6, When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101; 200; 300) causes, at least as part of an operation to adjust the size of the first part: An electronic device (101; 200; 300) that causes the size of the first part to be adjusted to a specified ratio based on the fact that the above angle is greater than or equal to the above critical angle.
8. In Paragraph 6, When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101; 200; 300) causes, at least as part of an operation to adjust the size of the first part: An electronic device (101; 200; 300) that causes the size of the first part to be adjusted by a ratio determined based on the angle, based on the fact that the angle is greater than or equal to the critical angle.
9. In any one of paragraphs 1 through 8, Two adjacent parts among the plurality of parts of the above 3D object are connected by a joint, and An electronic device (101; 200; 300) in which one of the two parts is movable relative to the other part based on the joint.
10. In any one of paragraphs 1 through 9, When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101; 200; 300) causes: An electronic device (101; 200; 300) that causes adjustment to be performed to express a seamless connection with respect to the connection portion of the first portion with the size adjusted above and the second portion adjacent to the first portion.
11. In any one of paragraphs 1 through 10, The size identified based on the first position of the first part is an electronic device (101; 200; 300) set to correspond to a FOV different from the FOV of the electronic device (101; 200; 300).
12. In any one of paragraphs 1 to 11, The electronic device (101; 200; 300) comprises a display configured to provide binocular content corresponding to the 3D object; Includes more, The rendering result of the 3D object, composed of the first portion with the size adjusted and the remaining portions excluding the first portion, is provided through the display of the electronic device (101; 200; 300).
13. In any one of paragraphs 1 through 12, When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101; 200; 300) causes: An electronic device that causes the size identified based on the first position of the first part to be adjusted to a different size based on user input.
14. In any one of paragraphs 1 through 13, When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101; 200; 300) causes: An electronic device that causes the first part to be adjusted by performing size, shape, and / or movement of at least some of the plurality of meshes constituting the first part.
15. A method of operating an electronic device (101; 200; 300), An action to confirm a request for rendering of a 3D object composed of multiple parts; An operation to identify locations within a virtual space based on a user's view point corresponding to each of the plurality of parts of the 3D object, based on confirming the request for the above rendering; An operation to confirm that the first part satisfies a distortion expression condition based on a first position of the first part among the plurality of parts; Based on confirming the satisfaction of the distortion expression condition of the first part, an operation of adjusting the size confirmed based on the first position of the first part to another size; and The operation of rendering the 3D object composed of the above-mentioned resized first part and the remaining parts excluding the first part. A method of operation of an electronic device (101; 200; 300) comprising, wherein the remaining parts have a size determined based on the location of each of the remaining parts.