Three-dimensional scene display method and electronic device using same
Through the HID angle conversion technology and operation balance mechanism, the problem of unspecified remote control devices being unable to control the three-dimensional scenes and processors is solved, and flexible control of the three-dimensional scenes and reduced processor burden is achieved, and the system operation efficiency is improved. .
Patent Information
- Application Number
- CN202310844401.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-07-11
- Publication Date
- 2025-01-14
AI Technical Summary
The prior art cannot control the stereoscopic scene through non-specific matching remote control devices, and when displaying and manipulating the stereoscopic scene, the central processor or graphics processor is overloaded, resulting in inefficiency.
Using HID angle conversion technology to convert the HID signal of the input unit into an angle signal, realizing the manipulation of any input unit on the stereoscopic scene, and guiding the inference program of artificial intelligence to the artificial intelligence acceleration processor through the operation balance mechanism to reduce the central processor or The burden of graphics processors.
The operation of any input unit on the three-dimensional scene is realized, which reduces the burden on the central processor or graphics processor and improves the operating efficiency and processing capabilities of the system.
Smart Images
Figure CN119316579A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to a display method and an electronic device using the same, and in particular to a display method of a three-dimensional scene and an electronic device using the same. Background Art
[0002] With the rapid development of multimedia and gaming industries, users can control 3D scenes through specially matched remote control devices. For example, users can use head mounted displays to view virtual images from different angles. However, if users do not have specially matched remote control devices, they will not be able to control these 3D scenes. Summary of the invention
[0003] The present disclosure is related to a display method of a three-dimensional scene and an electronic device using the same. Through the HID angle conversion technology, the HID signal of the input unit can be converted into an angle signal, so that various input units can control the three-dimensional scene. In addition, the present disclosure can also guide the inference program of artificial intelligence to the artificial intelligence acceleration processor through the calculation balance mechanism to reduce the burden of the central processing unit or the graphics processing unit.
[0004] According to one aspect of the present disclosure, a method for displaying a stereoscopic scene is provided. The method for displaying a stereoscopic scene includes the following steps. Determine whether a shortcut key of an input unit is pressed. If the shortcut key is pressed, a stereoscopic scene is generated. The stereoscopic scene is composed of several pictures. Receive a human interface device (HID) signal from the input unit. Convert the HID signal into an angle signal. Based on the angle signal, display one of the pictures of the stereoscopic scene on the display unit.
[0005] According to another aspect of the present disclosure, an electronic device is provided. The electronic device includes a display unit, an input unit, a stereoscopic scene generation unit, a control unit and an imaging unit. The input unit includes a shortcut key. If the shortcut key is pressed, the stereoscopic scene generation unit generates a stereoscopic scene. The stereoscopic scene is composed of several pictures. The control unit is used to receive a human interface device (HID) signal from the input unit and convert the HID signal into an angle signal. The imaging unit is used to display one of the pictures of the stereoscopic scene on the display unit according to the angle signal.
[0006] In order to better understand the above and other aspects of the present disclosure, embodiments are given below and described in detail with reference to the accompanying drawings: BRIEF DESCRIPTION OF THE DRAWINGS
[0007] Figure 1A The example illustrates the manipulation of a stereoscopic scene by an electronic device.
[0008] Figure 1B The example illustrates the manipulation of a stereoscopic scene by an electronic device.
[0009] Figure 2 A block diagram of an electronic device according to an embodiment is shown.
[0010] Figure 3 A flow chart of a method for displaying a stereoscopic scene according to an embodiment is shown.
[0011] Figure 4 A detailed block diagram of a control unit according to an embodiment is shown.
[0012] Figure 5 A detailed flow chart of step S160 according to an embodiment is shown.
[0013] Figure 6 A detailed block diagram of a stereoscopic scene generation unit according to an embodiment is shown.
[0014] Figure 7 A detailed flow chart of step S140 according to an embodiment is shown.
[0015] Figure 8 A flow chart of a method for displaying a stereoscopic scene according to another embodiment is shown.
[0016] Fig. 9 A detailed flow chart of step S190 according to an embodiment is shown.
[0017] Description of Reference Numerals
[0018] 100: Electronic devices
[0019] 111:CPU
[0020] 112: Graphics Processor
[0021] 113: Artificial Intelligence Acceleration Processor
[0022] 120: Display unit
[0023] 130: Input unit
[0024] 131: Shortcut keys
[0025] 140: Stereoscopic scene generation unit
[0026] 141:Search for components
[0027] 142: Scene register
[0028] 150k: scratchpad
[0029] 160: Control unit
[0030] 161:HID value acquisition component
[0031] 162: Normalization element
[0032] 163: Angle conversion element
[0033] 170: Imaging unit
[0034] 190: Inference Process Translation Unit
[0035] 191: Operation register
[0036] A1: Angle control signal
[0037] AP: Application Unit
[0038] An: Angle signal
[0039] CT1: Gaming steering wheel
[0040] CT2: Game joystick
[0041] CT3: Mouse
[0042] FMt, FMt': screen
[0043] H2,H3,Hn:HID signal
[0044] MD: Inference Model
[0045] Oi,Oj: Object
[0046] S110,S140,S141,S142,S150,S160,S161,S162,S163,S170,S180,S190,S191,S192,S193: Steps
[0047] SN1,SN2,SNm: Stereoscopic scene
[0048] Vn:HID value
[0049] Vn': Normalized value DETAILED DESCRIPTION
[0050] Please refer to Figure 1A , which illustrates the manipulation of a stereoscopic scene SN1 by the electronic device 100. The stereoscopic scene SN1 is, for example, a spatial surround image. The stereoscopic scene SN1 can be rotated manually or automatically to display images in different directions. When the stereoscopic scene SN1 rotates, the object Oi also moves with it. Figure 1AAs shown, the stereoscopic scene SN1 is, for example, a scene of a racing game, which is preset to be controlled by a game steering wheel CT1. When the game steering wheel CT1 is rotated, an angle control signal A1 can be input to rotate the stereoscopic scene SN1. A general peripheral input unit (such as a game joystick CT2) can only input a human interface device (HID) signal H2, which is not compatible with the racing game, and therefore cannot control the stereoscopic scene SN1.
[0051] In this embodiment, through the HID angle conversion technology, the HID signal H2 of any peripheral input unit (such as the game joystick CT2) can be converted into an angle signal to control the stereoscopic scene SN1.
[0052] Please refer to Figure 1B , which illustrates the manipulation of a stereoscopic scene SN2 by the electronic device 100. The stereoscopic scene SN2 is, for example, a stereoscopic character. The stereoscopic scene SN2 can be rotated manually or automatically to display images from different directions. In this embodiment, through the HID angle conversion technology, the HID signal H3 of any peripheral input unit (such as the mouse CT3) can be converted into an angle signal to manipulate the stereoscopic scene SN2.
[0053] In addition, in the process of displaying and manipulating the three-dimensional scenes SN1 and SN2, the burden on the central processing unit (CPU) 111 or the graphics processing unit (GPU) 112 is already quite heavy. At this time, if the object Oj is to be identified and inferred, it will cause excessive burden on the central processing unit 111 or the graphics processing unit 112. In this embodiment, through the calculation balance mechanism, the artificial intelligence inference program is directed to the artificial intelligence acceleration processor 113 to reduce the burden on the central processing unit 111 or the graphics processing unit 112.
[0054] Please refer to Figure 2, which illustrates a block diagram of an electronic device 100 according to an embodiment. The electronic device 100 includes the aforementioned central processing unit 111, the aforementioned graphics processing unit 112, the aforementioned artificial intelligence acceleration processor 113, a display unit 120, an input unit 130, a stereoscopic scene generation unit 140, a plurality of registers 150k, a control unit 160, an imaging unit 170, and an inference process translation unit 190. The artificial intelligence acceleration processor 113 is, for example, a neural network processor (Neural-network Processing Unit, NPU) or an intelligent processor (Intelligence Processing Unit, IPU). The artificial intelligence acceleration processor 113 is different from the graphics processing unit 112 or the artificial intelligence acceleration processor 113, and has an in-memory computing architecture (In Memory Computing) or an in-memory search architecture (In Memory Searching), which is suitable for artificial intelligence inference programs.
[0055] The display unit 120 is, for example, a liquid crystal display panel, an OLED display panel, an electronic paper, a head-mounted display, an AR glasses or a projector. The input unit 130 is, for example, a keyboard, a mouse or a joystick. The input unit 130 is not limited to a single device, but may also be composed of multiple devices. The stereoscopic scene generation unit 140, the control unit 160, the imaging unit 170, and the inference process translation unit 190 are used to execute various processing procedures, calculation procedures, analysis procedures or judgment procedures, such as a circuit, a circuit board, a chip, or a storage device for storing program code. The register 180k is used to temporarily store data, such as a storage block of a memory or a hard disk. In this embodiment, the control unit 160 can convert the HID signal Hn of the input unit 130 into an angle signal An through the HID angle conversion technology to manipulate the stereoscopic scene SNm. In addition, in this embodiment, the inference process translation unit 190 can further direct the AI inference process to the AI accelerator processor 113 through a computational balancing mechanism to reduce the burden of the CPU 111 or the GPU 112. The operation of each component is described in detail below with the help of a flowchart.
[0056] Please refer to Figure 3 , which illustrates a flow chart of a method for displaying a stereoscopic scene SNm according to an embodiment. In step S110, the control unit 160 determines whether a shortcut key 131 of the input unit 130 is pressed. The shortcut key 131 is a predefined single key or a combination of multiple keys. When the user has a need for a stereoscopic scene SNm, the shortcut key 131 can be pressed. In one embodiment, the shortcut key 131 is, for example, a function key on a keyboard. If the shortcut key 131 is pressed, step S140 is entered.
[0057] In step S140, the 3D scene generation unit 140 generates a 3D scene SNm. The 3D scene SNm is composed of a plurality of frames FMt. The 3D scene SNm is, for example, a spatial surround image (such as the 3D scene SN1 shown in FIG. 1 ); the 3D scene SNm may be a 3D person or object (such as Figure 2 The stereoscopic scene SN2 shown).
[0058] Then, in step S150, the control unit 160 receives the HID signal Hn of the input unit 130. The device that transmits the HID signal Hn may be different from the device that sets the shortcut key 131. For example, the device that transmits the HID signal Hn may be an external joystick, mouse, external touch panel, game handle or similar input device, and the device that sets the shortcut key 131 may be a keyboard or a built-in touch panel on a notebook computer, etc.
[0059] Next, in step S160 , the control unit 160 converts the HID signal Hn into an angle signal An.
[0060] Please refer to Figure 4 and Figure 5 , Figure 4 FIG. 1 is a detailed block diagram of the control unit 160 according to an embodiment. Figure 5 A detailed flow chart of step S160 according to an embodiment is shown. The control unit 160 includes a HID value capture element 161, a normalization element 162 and an angle conversion element 163. Step S160 includes steps S161 to S163. In step S161, the HID value capture element 161 of the control unit 160 obtains a HID value Vn of the HID signal Hn. For example, when the HID signal Hn comes from a pressed button, its HID value Vn may be 0 or 1; when the HID signal Hn comes from the mushroom head of the joystick, its HID value Vn may be a decimal value in the X direction and the Y direction; when the HID signal Hn comes from the touch pad, its HID value Vn may be a coordinate value of the X axis and the Y axis.
[0061] Next, in step S162, the normalization element 162 of the control unit 160 normalizes the HID value Vn to obtain a normalized value Vn'. For example, the normalization element 162 normalizes the HID value Vn to a normalized value Vn' between -1 and +1. For example, the maximum possible value of the HID value Vn will be normalized to +1, and the minimum possible value of the HID value Vn will be normalized to -1. Alternatively, the normalization element 162 can also normalize according to the X-axis and the Y-axis into two normalized values Vn' in the X direction and the Y direction.
[0062] Then, in step S163, the angle conversion element 163 of the control unit 160 multiplies the normalized value Vn' by 90 degrees to obtain the angle signal An. That is, the normalized value Vn' of "+1" will be converted into the angle signal An of "+90 degrees"; the normalized value Vn' of "-1" will be converted into the angle signal An of "-90 degrees"; the normalized value Vn' of "+0.5" will be converted into the angle signal An of "+45 degrees", and so on.
[0063] Through the above steps S161 - S163 , the control unit 160 can convert the HID signal Hn into the angle signal An.
[0064] Then, in Figure 3 In step S170, the imaging unit 170 displays a certain picture FMt' of the stereoscopic scene SNm on the display unit 120 according to the angle signal An. During the user's operation, different HID signals Hn generated by the input unit 130 may correspond to different angle signals An, and the picture FMt' corresponding to a certain angle in the stereoscopic scene SNm may be displayed on the display unit 120. In this way, through the above steps S110 to S170, the user can use any input unit 130 to control the display of the stereoscopic scene SNm.
[0065] Please refer to Figure 6 and Figure 7 , Figure 6 FIG. 1 is a detailed block diagram of a stereoscopic scene generation unit 140 according to an embodiment. Figure 7 A detailed flow chart of step S140 according to an embodiment is shown. The stereoscopic scene generation unit 140 includes a search element 141 and a scene register 142. In one embodiment, when the imaging unit 170 performs imaging, the image data may come from an external server connected to the application unit AP. The electronic device 100 itself does not have a stereoscopic scene SNm, so it needs to generate a stereoscopic scene SNm through the stereoscopic scene generation unit 140.
[0066] In step S141, the search component 141 of the 3D scene generation unit 140 searches the frame FMt required for the 3D scene SNm from the frame buffer 150k. During the operation of the application unit AP, it is necessary to perform operations such as decoding and rendering on the frame, so the frame FMt of various angles will be temporarily stored in the frame buffer 150k, and the search component 141 can collect the frames FMt of different angles from these frame buffers 150k.
[0067] Then, in step S142 , the scene buffer 142 of the 3D scene generating unit 140 temporarily stores these frames FMt to form a 3D scene SNm.
[0068] Through the above steps S141 - S142 , the 3D scene generating unit 140 can generate a 3D scene SNm.
[0069] Please refer to Figure 8 , which illustrates a flow chart of a method for displaying a stereoscopic scene SNm according to another embodiment. Figure 8 The display method further includes steps S180 to S190. In the process of displaying and manipulating the three-dimensional scene SNm in steps S110 to S170, the central processing unit 111 or the graphics processing unit 112 needs to perform calculations. At this time, if an artificial intelligence inference program is to be performed, it will cause an excessive burden on the central processing unit 111 or the graphics processing unit 112. In this embodiment, the artificial intelligence inference program can be directed to the artificial intelligence acceleration processor 113 through the calculation balancing mechanism of steps S180 to S190 to reduce the burden on the central processing unit 111 or the graphics processing unit 112.
[0070] In step S180, the inference process translation unit 190 determines whether an inference process needs to be performed. If an inference process needs to be performed, the process proceeds to step S190.
[0071] In step S190 , the inference process translation unit 190 activates the operation balancing mechanism to control the electronic device 100 to perform the inference process with the artificial intelligence acceleration processor 113 .
[0072] Please refer to Fig. 9 , which illustrates a detailed flow chart of step S190 according to an embodiment. Step S190 includes steps S191 to S193. In step S191, the inference process translation unit 190 loads an inference model MD into a calculation register 191.
[0073] Next, in step S192 , the inference process translation unit 190 directs the address of the operation register 191 to the artificial intelligence acceleration processor 113 .
[0074] Then, in step S193, the inference model MD is executed by the artificial intelligence acceleration processor 193 to perform the inference process. Through the above steps S191 to S193, during the process of displaying and manipulating the stereoscopic scene SNm, the artificial intelligence inference process will be automatically directed to the artificial intelligence acceleration processor 193 without increasing the burden of the CPU 111 or the GPU 112.
[0075] According to the above embodiment, through the HID angle conversion technology, the HID signal Hn of the input unit 130 can be converted into the angle signal An to manipulate the stereoscopic scene SNm. In addition, the above embodiment can further guide the artificial intelligence inference program to the artificial intelligence acceleration processor 113 through the calculation balance mechanism to reduce the burden of the central processing unit 111 or the graphics processor 112.
[0076] In summary, although the present disclosure has been disclosed as above by way of embodiments, it is not intended to limit the present disclosure. A person with ordinary knowledge in the technical field to which the present disclosure belongs may make various changes and modifications without departing from the spirit and scope of the present disclosure. Therefore, the protection scope of the present disclosure shall be determined by the definition of the appended claims.
Claims
1. A method for displaying a stereoscopic scene, comprising: Determine whether a shortcut key of an input unit is pressed; If the shortcut key is pressed, a 3D scene is generated, which is composed of several pictures; receiving a human interface device (HID) signal from the input unit; Converting the HID signal into an angle signal; as well as According to the angle signal, one of the plurality of frames of the three-dimensional scene is displayed on a display unit.
2. The method for displaying a three-dimensional scene according to claim 1, wherein: The step of converting the HID signal into the angle signal comprises: Obtaining a HID value of the HID signal; Normalizing the HID value to obtain a normalized value; and The normalized value is multiplied by 90 degrees to obtain the angle signal.
3. The method for displaying a three-dimensional scene according to claim 2, wherein: The normalized value is between -1 and +1.
4. The method for displaying a three-dimensional scene according to claim 1, wherein: The steps of generating the stereoscopic scene include: Searching the plurality of frames required for the three-dimensional scene from the plurality of frame registers; and Temporarily save the 3D scene.
5. The method for displaying a three-dimensional scene according to claim 1, characterized in that: Also includes: When the three-dimensional scene is being generated and an inference process is required, an artificial intelligence acceleration processor is used to perform the inference process.
6. The method for displaying a three-dimensional scene according to claim 5, characterized in that: The artificial intelligence acceleration processor is a neural network processor or an intelligent processor.
7. The method for displaying a three-dimensional scene according to claim 5, characterized in that: include: loading an inference model into a computation register; Point the address of the operation register to the artificial intelligence acceleration processor; as well as The inference model is executed by the artificial intelligence acceleration processor to perform the inference procedure.
8. An electronic device, characterized in that: include: A display unit an input unit, comprising a shortcut key; a 3D scene generation unit, which generates a 3D scene composed of a plurality of pictures if the shortcut key is pressed; a control unit for receiving a human interface device (HID) signal from the input unit and converting the HID signal into an angle signal; as well as An imaging unit is used to display one of the plurality of pictures of the three-dimensional scene on the display unit according to the angle signal.
9. The electronic device as claimed in claim 8, characterized in that: The control unit comprises: A HID value acquisition component, used for obtaining a HID value of the HID signal; a normalization element, used to normalize the HID value to obtain a normalized value; and An angle conversion element is used for multiplying the normalized value by 90 degrees to obtain the angle signal.
10. The electronic device according to claim 9, wherein: The normalized value is between -1 and +1.
11. The electronic device according to claim 8, wherein: The stereoscopic scene generation unit comprises: A search component for searching the plurality of frames required for the three-dimensional scene from the plurality of frame registers; and A scene temporary storage is used to temporarily store the 3D scene.
12. The electronic device as claimed in claim 8, characterized in that: Also includes: an AI acceleration processor; and An inference process translation unit, when the three-dimensional scene is being generated and an inference process needs to be performed, the inference process translation unit performs the inference process with the artificial intelligence acceleration processor.
13. The electronic device according to claim 12, wherein: The artificial intelligence acceleration processor is a neural network processor or an intelligent processor.
14. The electronic device according to claim 12, wherein: The inference process translation unit loads an inference model into a calculation register and points the address of the calculation register to the artificial intelligence acceleration processor, so that the artificial intelligence acceleration processor executes the inference model to perform the inference program.