Viewpoint data transmission method, device, system, medium and program product
By working together with terminal devices and base station equipment, and utilizing eye-tracking technology and viewpoint transmission strategies, only necessary viewpoint data is transmitted, solving the problem of excessive network bandwidth in naked-eye 3D services and achieving stable display effects and resource optimization.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- CHINA MOBILE COMM LTD RES INST
- Filing Date
- 2024-10-30
- Publication Date
- 2026-05-01
AI Technical Summary
In existing glasses-free 3D services, the data transmission load on network devices is too heavy, causing stuttering and failing to guarantee display quality.
Terminal devices and base station devices use eye-tracking technology to determine display requirement parameters, and combined with viewpoint transmission strategies, transmit only the necessary target viewpoint data, reducing network bandwidth requirements and optimizing data transmission strategies to match current service needs.
It reduces the consumption of network bandwidth resources, improves the data processing matching degree of naked-eye 3D services, meets the viewpoint data display requirements of terminal devices, and achieves a balance between data transmission and display.
Smart Images

Figure CN121967654A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of naked-eye 3D data transmission technology, and in particular to a viewpoint data transmission method, device, system, medium and program product. Background Technology
[0002] In the actual implementation of glasses-free 3D services, network devices transmit all viewpoint data associated with the glasses-free 3D service to the terminal devices for loading. However, this method increases the load on network devices, easily leading to data transmission stuttering and failing to guarantee the display effect of glasses-free 3D. Summary of the Invention
[0003] Based on the above technical problems, embodiments of this application provide a viewpoint data transmission method, device, system, medium, and program product.
[0004] This application first provides a viewpoint data transmission method, the method including:
[0005] A terminal device receives target viewpoint data transmitted by a base station device; wherein, the base station device is used to determine and transmit the target viewpoint data to the terminal device based on a viewpoint transmission strategy associated with the data processing status of the naked-eye 3D service at the current moment of the terminal device; the number of viewpoint data in the target viewpoint data is less than the number of viewpoint data in the viewpoint data set; the viewpoint data set is associated with the naked-eye 3D service;
[0006] Load the target viewpoint data.
[0007] In some embodiments, before the terminal device receives target viewpoint data transmitted by the base station device, the method further includes:
[0008] Receive a set of viewpoint parameters associated with the viewpoint data set sent by the application server; wherein the application server is associated with the naked-eye 3D service;
[0009] Determine the eye-tracking results;
[0010] Based on the eye-tracking results and the viewpoint parameter set, display requirement parameters are determined; wherein, the display requirement parameters include parameters of the viewpoint data associated with the data processing state.
[0011] In some embodiments, after determining the display requirement parameters, the method further includes:
[0012] In response to the parameter reporting instruction sent by the base station device, the display requirement parameters are sent to the base station device to trigger the base station device to determine the viewpoint transmission strategy based on the display requirement parameters and the data processing status.
[0013] In some embodiments, sending the display requirement parameters to the base station device includes:
[0014] The display requirement parameters are sent to the base station equipment according to the first preset cycle;
[0015] or,
[0016] Based on the changes in the eye-tracking results, the display requirement parameters are sent to the base station device.
[0017] In some embodiments, after determining the display requirement parameters, the method further includes:
[0018] The display requirement parameters are sent to the application server to trigger the application server to generate and send transmission requirement parameters to the core network device based on the display requirement parameters and the viewpoint parameter set associated with the viewpoint data set; wherein, the core network device is used to determine and send the viewpoint transmission strategy to the base station device based on the transmission requirement parameters, or to trigger the base station device to determine the viewpoint transmission strategy based at least on the transmission requirement parameters.
[0019] In some embodiments, sending the display requirement parameters to the application server includes:
[0020] The display requirement parameters are sent to the application server according to the second preset cycle;
[0021] or,
[0022] Based on the changes in the eye-tracking results, the display requirement parameters are sent to the application server.
[0023] This application embodiment also provides a viewpoint data transmission method, the method comprising:
[0024] The base station equipment determines target viewpoint data from the viewpoint data set based on the viewpoint transmission strategy associated with the data processing status of the naked-eye 3D service of the terminal device at the current moment; wherein, the number of viewpoint data in the target viewpoint data is less than the number of viewpoint data in the viewpoint data set; the viewpoint data set is associated with the naked-eye 3D service;
[0025] The target viewpoint data is transmitted to the terminal device so that the terminal device can load the target viewpoint data.
[0026] In some embodiments, before the base station device determines the target viewpoint data from the viewpoint data set based on the viewpoint transmission strategy associated with the data processing status of the naked-eye 3D service of the terminal device at the current moment, the method further includes:
[0027] A parameter reporting instruction is sent to the terminal device to trigger the terminal device to determine and send display requirement parameters to the base station device; wherein, the display requirement parameters are determined by the terminal device based on the viewpoint parameter set associated with the viewpoint data set sent by the application server and the eye tracking results; the display requirement parameters include parameters of the viewpoint data associated with the data processing status; the application server is associated with the naked-eye 3D service;
[0028] The viewpoint transmission strategy is determined based on the display requirement parameters.
[0029] In some embodiments, before the base station device determines the target viewpoint data from the viewpoint data set based on the viewpoint transmission strategy associated with the data processing status of the naked-eye 3D service of the terminal device at the current moment, the method further includes:
[0030] The system receives the viewpoint transmission strategy sent by the core network device; wherein the core network device determines the viewpoint transmission strategy based on transmission requirement parameters sent by the application server; the transmission requirement parameters are generated by the application server based on display requirement parameters and a viewpoint parameter set associated with the viewpoint data set; the display requirement parameters are determined by the terminal device based on the viewpoint parameter set sent by the application server and eye-tracking results; the display requirement parameters include parameters of the viewpoint data associated with the data processing status; the application server is associated with naked-eye 3D services.
[0031] In some embodiments, before the base station device determines the target viewpoint data from the viewpoint data set based on the viewpoint transmission strategy associated with the data processing status of the naked-eye 3D service of the terminal device at the current moment, the method further includes:
[0032] The system receives transmission requirement parameters sent by the core network equipment; wherein, the transmission requirement parameters are generated by the application server based on display requirement parameters and a set of viewpoint parameters associated with the viewpoint data set; the display requirement parameters are determined by the terminal device based on the set of viewpoint parameters associated with the viewpoint data set sent by the application server and eye-tracking results; the display requirement parameters include parameters of the viewpoint data associated with the data processing status; the application server is associated with the naked-eye 3D service;
[0033] Based on the transmission requirement parameters, the viewpoint transmission strategy is determined.
[0034] In some embodiments, the method further includes:
[0035] Based at least on the load status of the base station equipment, determining the data transmission strategy of the base station equipment includes at least: adjusting the transmission priority of viewpoint data associated with the viewpoint transmission strategy to be greater than the transmission priority of non-viewpoint data, transmitting the viewpoint data at a first rate, and transmitting the non-viewpoint data at a second rate; the first rate is greater than the second rate.
[0036] In some embodiments, the method further includes:
[0037] Based on the changing status of the data transmission resources associated with the base station equipment and the priority of the service type, the data discarding mechanism in the data transmission strategy of the base station equipment is adjusted; wherein, the priority of naked-eye 3D service is greater than the priority threshold; the data transmission strategy includes the viewpoint transmission strategy.
[0038] This application also provides a terminal device, which includes a first processor and a first memory; the first memory stores a first computer program; when the first computer program is executed by the first processor, it can implement the viewpoint data transmission method applied to the terminal device as described above.
[0039] This application also provides a base station device, which includes a second processor and a second memory; the second memory stores a second computer program; when the second computer program is executed by the second processor, it can implement the viewpoint data transmission method applied to the base station device as described above.
[0040] This application also provides a viewpoint data transmission system, which includes core network equipment, application server, terminal equipment as described above, and base station equipment as described above.
[0041] This application also provides a computer-readable storage medium storing a third computer program; when executed by a processor of an electronic device, the third computer program can implement the viewpoint data transmission method as described above.
[0042] This application also provides a computer program product, which includes a third computer program; when the third computer program is executed by the processor of an electronic device, it can implement the viewpoint data transmission method as described above.
[0043] The viewpoint data transmission method for terminal devices provided in this application embodiment has a smaller data volume of viewpoint data in the target viewpoint data transmitted by the base station to the terminal device than the data volume of viewpoint data in the viewpoint data set associated with the terminal device's naked-eye 3D service. This reduces the network bandwidth consumption caused by the base station transmitting the entire viewpoint data set associated with the terminal device's naked-eye 3D service to the terminal device, and also reduces the bandwidth requirements. Furthermore, the target viewpoint data is determined by the base station based on a viewpoint transmission strategy associated with the terminal device's current naked-eye 3D service data processing state and transmitted to the terminal device. By using terminal devices, the matching degree between target viewpoint data and the naked-eye 3D service data processing of the terminal device at the current moment can be improved, thereby meeting the viewpoint data display requirements of the naked-eye 3D service of the terminal device at the current moment. On this basis, the technical solution provided by the embodiments of this application, while reducing the data transmission volume between the base station equipment and the terminal equipment and thus reducing the network bandwidth requirements between the base station equipment and the terminal equipment, can also specifically meet the viewpoint data display requirements of the naked-eye 3D service of the terminal device at the current moment, thereby achieving a balance between the transmission of target viewpoint data and the viewpoint data display of the naked-eye 3D service of the terminal device. Attached Figure Description
[0044] Figure 1 A schematic flowchart illustrating a viewpoint data transmission method applied to a terminal device according to an embodiment of this application;
[0045] Figure 2 A schematic flowchart illustrating a viewpoint data transmission method applied to base station equipment according to an embodiment of this application;
[0046] Figure 3 This is a schematic diagram of the structure of the terminal device provided in the embodiments of this application;
[0047] Figure 4 This is a schematic diagram of the structure of a base station device provided in an embodiment of this application;
[0048] Figure 5 This is a schematic diagram of the viewpoint data transmission system provided in an embodiment of this application;
[0049] Figure 6 This is a schematic diagram illustrating the process of transmitting viewpoint data using the viewpoint data transmission system provided in this application embodiment;
[0050] Figure 7 This is another schematic diagram illustrating the process of transmitting viewpoint data in the viewpoint data transmission system provided in this application embodiment. Detailed Implementation
[0051] The technical solutions in the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings.
[0052] It should be understood that the specific embodiments described herein are merely illustrative of this application and are not intended to limit this application.
[0053] With the rapid development of data processing technology, glasses-free 3D technology, as a cutting-edge technology in the current display field, is changing people's visual experience. Glasses-free 3D technology allows users to see stereoscopic 3D images directly with their naked eyes without wearing special glasses or helmets. It utilizes a special display screen and image processing algorithms to allow the user's two eyes to receive different images, thus creating a sense of depth. Therefore, glasses-free 3D technology offers more realistic and stunning visual effects, providing users with a more immersive experience.
[0054] In glasses-free 3D technology, eye-tracking technology plays a crucial role in improving the accuracy and immersion of the 3D experience. Eye-tracking technology tracks subtle changes in eye characteristics; for example, when a user's eyes look in different directions, their eyes exhibit subtle shifts. Eye-tracking technology uses image capture or scanning extraction methods to track these changes in real time, predicting the user's state and visual display needs, and responding accordingly. For instance, when a user's eyes move, eye-tracking technology can adjust the display angle and depth of the 3D image in real time to match the user's perspective, thus providing a more targeted, natural, and realistic 3D effect.
[0055] In practical applications, based on the number of users simultaneously capable of viewing, glasses-free 3D technology can be categorized into dual-viewpoint and multi-viewpoint types. Dual-viewpoint glasses-free 3D divides the image into left and right viewpoints to satisfy the viewing needs of the user's left and right eyes respectively. Furthermore, combined with special screen structures or image processing algorithms, the user's left eye only sees the image from the left viewpoint, and the right eye only sees the image from the right viewpoint, thus achieving a glasses-free 3D effect. However, the existence of only two viewpoints in this approach limits the 3D effect, requiring users to be in specific positions and angles to see the optimal 3D effect. Moreover, due to limitations in display manufacturing technology and costs, current glasses-free 3D displays in terminal products typically utilize dual-viewpoint technology.
[0056] Multi-viewpoint glasses-free 3D technology is a further extension of dual-viewpoint glasses-free 3D technology. It provides a richer 3D experience by dividing the display screen into more viewpoints to simulate more viewing positions and angles. Therefore, multi-viewpoint glasses-free 3D technology can achieve smoother 3D transitions and more natural depth perception, allowing multiple users in different positions and angles to obtain good 3D visual effects.
[0057] From a network transmission perspective, the implementation of dual-view naked-eye 3D technology requires the network to simultaneously transmit two frames of images for each eye, while multi-view naked-eye 3D technology requires the network to simultaneously transmit multiple frames of images corresponding to more viewpoints to cover a wider range of viewing angles and positions. Therefore, the implementation of any type of naked-eye 3D technology requires more bandwidth resources to ensure synchronization between multi-view images.
[0058] On the other hand, from the perspective of display terminals, due to the complexity, high production cost, and difficulty of implementing multi-view naked-eye 3D technology, it is typically applied to electronic products with larger displays. For smaller displays, such as computer devices, mobile phones, and tablets, dual-view display technology combined with eye-tracking technology is usually used to provide a more realistic 3D visual experience. Therefore, to provide a more immersive visual effect and adapt to more display terminals, current application platforms mostly encode and produce naked-eye 3D content as image data from multiple perspectives, pushing this data to the display terminal for eye-tracking technology to provide a naked-eye 3D display effect. This image data transmission method places high demands on network bandwidth. For example, in field tests, when transmitting 60FPS 2K resolution video, the bandwidth requirement for dual-view data is 30Mbps, and the bandwidth requirement for multi-view data increases exponentially with the number of viewpoints.
[0059] To ensure the stable operation of glasses-free 3D services on terminal devices and reduce the network bandwidth requirements of these services, a technical solution for overall QoS policy protection is provided. This solution prioritizes bandwidth resources and scheduling for glasses-free 3D services to guarantee transmission rate and latency, thereby reducing stuttering or screen flickering issues experienced by users during the glasses-free 3D service experience.
[0060] However, with the increasing number of users of glasses-free 3D services and other types of services, the limited network bandwidth resources continue to face greater challenges. Therefore, how to stably transmit viewpoint data corresponding to glasses-free 3D services under the premise of limited network bandwidth resources has become an urgent technical problem to be solved.
[0061] Based on the above technical problems, embodiments of this application provide a viewpoint data transmission method, device, system, medium, and program product.
[0062] This application first provides a viewpoint data transmission method applied to terminal devices. Figure 1 This is a flowchart illustrating a viewpoint data transmission method applied to a terminal device according to an embodiment of this application. Figure 1 As shown, the method may include the following steps:
[0063] Step 101: The terminal device receives the target viewpoint data transmitted by the base station device.
[0064] Among them, the base station equipment is used to determine and transmit target viewpoint data to the terminal device based on the viewpoint transmission strategy associated with the data processing status of the naked-eye 3D service at the current moment of the terminal device; the number of viewpoint data in the target viewpoint data is less than the number of viewpoint data in the viewpoint data set; the viewpoint data set is associated with the naked-eye 3D service.
[0065] In one implementation, the terminal device may include devices such as smartphones, tablets, laptops, and televisions.
[0066] In one implementation, the terminal device can provide glasses-free 3D services with dual viewpoints and / or multiple viewpoints.
[0067] In one implementation, the naked-eye 3D service of the terminal device at the current moment can be of the dual-viewpoint or multi-viewpoint type.
[0068] In one implementation, the data processing status can characterize whether the naked-eye 3D service being performed by the terminal device at the current moment has been started, the data resolution and data refresh rate of the terminal device's display screen, and at least one of the types of the aforementioned services.
[0069] In one implementation, the viewpoint transmission strategy may include the time point, rate, reserved bandwidth for transmitting viewpoint data from the base station device to the terminal device, and how to determine at least one of the target viewpoint data required by the terminal device from the viewpoint data set.
[0070] In one implementation, the viewpoint transmission strategy can be determined in any of the following ways:
[0071] The base station equipment receives service requirement parameters sent by the terminal equipment and determines a viewpoint transmission strategy based on the service requirement parameters. The service requirement parameters may include at least one of the following: the type of naked-eye 3D service, the resolution of the terminal equipment, and the data refresh rate of the terminal equipment's display screen. For example, the viewpoint transmission strategy may vary depending on the service requirement parameters. For instance, the first strategy corresponding to a dual-view naked-eye 3D service may differ from the second strategy corresponding to a multi-view naked-eye 3D service. Similarly, the third strategy corresponding to a first data refresh rate may differ from the fourth strategy corresponding to a second data refresh rate. The viewpoint transmission strategy may include the first to the fourth strategies.
[0072] The viewpoint transmission strategy sent by the receiving terminal device can be determined by the user of the terminal device or by the terminal device based on service requirement parameters.
[0073] Receive viewpoint transmission strategies sent by core network equipment.
[0074] In one implementation, the viewpoint data set may include a collection of all viewpoint data associated with the naked-eye 3D service of the terminal device at the current moment.
[0075] In one implementation, the base station equipment can determine the target viewpoint data to the terminal equipment in the following manner:
[0076] The viewpoint filtering parameters are determined according to the viewpoint transmission strategy, and then the viewpoint data in the viewpoint data set is filtered according to the viewpoint filtering parameters to obtain the target viewpoint data. For example, the viewpoint filtering parameters may include the resolution parameters of the viewpoint data required by the terminal device and / or the data refresh rate of the terminal device. For example, the number of viewpoint data in the target viewpoint data may increase with the increase of the data refresh rate.
[0077] In one implementation, the target viewpoint data may include only the two or more viewpoint data that the terminal device needs to load at the current moment, and may also include candidate viewpoint data whose importance is greater than or equal to a degree threshold; for example, candidate viewpoint data may include data adjacent to the two or more viewpoint data that it only needs to load at the current moment, and may also include viewpoint data whose display probability at the next moment is greater than or equal to a probability threshold, as determined according to the data processing status.
[0078] Step 102: Load target viewpoint data.
[0079] In one implementation, after receiving the target viewpoint data, the application corresponding to the naked-eye 3D service on the terminal device can load and display the target viewpoint data according to the data processing status.
[0080] As can be seen from the above, the viewpoint data transmission method for terminal devices provided in this application embodiment has a smaller data volume of viewpoint data in the target viewpoint data transmitted by the base station to the terminal device than the data volume of viewpoint data in the viewpoint data set associated with the terminal device's naked-eye 3D service. This reduces the network bandwidth consumption caused by the base station transmitting the entire viewpoint data set associated with the terminal device's naked-eye 3D service to the terminal device, and also reduces the bandwidth requirements. Furthermore, the target viewpoint data is determined and transmitted by the base station based on a viewpoint transmission strategy associated with the terminal device's current naked-eye 3D service data processing state. The data is transmitted to the terminal device, thereby improving the matching degree between the target viewpoint data and the naked-eye 3D service data processing of the terminal device at the current moment, thus meeting the viewpoint data display requirements of the naked-eye 3D service of the terminal device at the current moment. On this basis, the technical solution provided by the embodiments of this application, while reducing the data transmission volume between the base station equipment and the terminal device, and thus reducing the network bandwidth requirements between the base station equipment and the terminal device, can also specifically meet the viewpoint data display requirements of the naked-eye 3D service of the terminal device at the current moment, thereby achieving a balance between the transmission of target viewpoint data and the viewpoint data display of the naked-eye 3D service of the terminal device.
[0081] Based on the foregoing embodiments, in the viewpoint data transmission method for terminal devices provided in this application, before the terminal device receives the target viewpoint data transmitted by the base station device, the following steps may also be performed:
[0082] Step A1: Receive the set of viewpoint parameters associated with the viewpoint data set sent by the application server.
[0083] The application server is associated with the glasses-free 3D service.
[0084] In one implementation, the application server may include a server device for providing viewpoint data support services for naked-eye 3D services of terminal devices; exemplarily, the server device may include a physical machine device or a virtual machine device; exemplarily, the viewpoint data set may be generated by the application server and sent to a base station device or a core network device, wherein if the core network device receives the viewpoint data set, it may send the viewpoint data set to the base station device.
[0085] In one implementation, the viewpoint parameter set may include a set of parameters of viewpoint data in the viewpoint data set; for example, the viewpoint parameter set may include a set of numbers and / or names of viewpoint data in the viewpoint data set.
[0086] In one implementation, after generating the viewpoint data set, the application server can assign numbers and / or names to the viewpoint data in the viewpoint data set.
[0087] In one implementation, after the terminal device starts the naked-eye 3D service, it can send a service request to the application server. After receiving the service request, the application server can establish a session connection with the terminal device and send a set of viewpoint parameters to the terminal device through the connection.
[0088] Step A2: Determine the eye-tracking results.
[0089] In one implementation, after the terminal device starts the naked-eye 3D service, it can acquire eye images or videos including the user's eyes through an image acquisition device, and perform feature extraction and recognition on the eye images or videos to determine the eye tracking results.
[0090] In one implementation, the eye-tracking result may include the user's eye movement state; for example, the eye movement state may include the rotation angle of the eyeball and its change state, the position of the eyeball and its change state due to the displacement of the user's head, etc.
[0091] Step A3: Based on the eye-tracking results and the set of viewpoint parameters, determine the display requirement parameters.
[0092] Among them, the display requirement parameters include parameters of viewpoint data associated with the data processing status.
[0093] In one implementation, the display requirement parameters may include parameters of viewpoint data required to provide users with a realistic and vivid naked-eye 3D display effect; for example, the display requirement parameters may include a target viewpoint identifier; for example, the target viewpoint identifier may include the number and / or name of the viewpoint data in the viewpoint data set that matches the eye-tracking results.
[0094] In one implementation, the display requirement parameters can vary with changes in eye-tracking results, and can also vary depending on the type of naked-eye 3D service offered by the terminal device.
[0095] As can be seen from the above, the viewpoint data transmission method for terminal devices provided in this application embodiment involves the terminal device receiving a set of viewpoint parameters associated with a set of viewpoint data sent by an application server. The application server is associated with a glasses-free 3D service. Thus, through the above steps, the viewpoint parameter set of the set of viewpoint data associated with the glasses-free 3D service executed by the terminal device at the current moment is synchronized between the application server and the terminal device. Furthermore, after determining the eye-tracking result, display requirement parameters are determined based on the eye-tracking result and the set of viewpoint parameters. These display requirement parameters include parameters of the viewpoint data associated with the data processing state. This not only improves the consistency between the display requirement parameters and the viewpoint display requirements of the glasses-free 3D service at the current moment for the terminal device, but also improves the accuracy of the display requirement parameters. On the other hand, through the above operations, the association between the eye-tracking result and the display requirement parameters is realized, allowing the display requirement parameters to change adaptively with changes in the eye-tracking result, thereby further improving the accuracy of the display requirement parameters.
[0096] Based on the foregoing embodiments, in the viewpoint data transmission method for terminal devices provided in this application, after determining the display requirement parameters, the following operations can also be performed:
[0097] In response to the parameter reporting instruction sent by the base station equipment, display requirement parameters are sent to the base station equipment to trigger the base station equipment to determine the viewpoint transmission strategy based on the display requirement parameters and the data processing status.
[0098] In one embodiment, the parameter reporting instruction can be used by the base station device to instruct the terminal device to send display requirement parameters; for example, the parameter reporting instruction may include at least one of the following: the type of display requirement parameters sent by the base station device to the terminal device, the period and format of the terminal device reporting display requirement parameters, and the target signaling or target parameters on which the reporting of display requirement parameters is based; wherein the target signaling or target parameters are used to carry the display requirement parameters.
[0099] In one implementation, after the application server establishes a session connection with the terminal device, it can send the viewpoint data set and the device identifier of the terminal device to the base station device. At this time, the base station device can determine the target signaling or target parameters, and generate and send parameter reporting instructions to the terminal device based on the device identifier.
[0100] In one implementation, the base station equipment can send parameter reporting instructions to the terminal equipment via Downlink Control Information (DCI) of the Physical Downlink Control Channel (PDCCH), and can also send parameter reporting instructions to the terminal equipment via the control element (CE) of the Media Access Control (MAC) layer; specifically as follows:
[0101] When the base station equipment sends parameter reporting instructions to the terminal equipment via DCI in the PDCCH, the DCI format can be configured as DCI 2_8, which is used to indicate the location and format of the display parameters to be sent to the terminal equipment; as shown in Table 1:
[0102]
[0103] Table 1
[0104] The base station equipment can also define the transmission requirement indication MAC CE in the MAC layer CE to instruct the terminal equipment to report and display the required parameters.
[0105] Accordingly, for the PDCCH method, the terminal device can add relevant fields to the Uplink Control Information (UCI) to display the reporting requirements parameters; among which, the display requirements parameters can be as shown in Table 2:
[0106]
[0107] Table 2
[0108] In one implementation, the viewpoint transmission strategy can be determined in the following way:
[0109] The base station equipment parses the display requirement parameters to obtain the target viewpoint identifier and the data refresh rate of the terminal device's display screen. Then, after determining that the data processing status indicates that the naked-eye 3D service is in normal execution, the viewpoint transmission strategy is determined, including: filtering the viewpoint data in the viewpoint identifier set based on the target viewpoint identifier to obtain the target viewpoint data, and controlling the execution rate of the above filtering operation to be greater than or equal to the data refresh rate, so as to ensure the display effect of the naked-eye 3D service of the terminal device.
[0110] As described above, in the viewpoint data transmission method for terminal devices provided in this application embodiment, the terminal device responds to the parameter reporting instruction sent by the base station device by sending display requirement parameters to the base station device, thereby triggering the base station device to determine a viewpoint transmission strategy based on the display requirement parameters and the data processing status. Thus, through the above method, the base station device controls the operation of the terminal device reporting display requirement parameters, and also enables the synchronization of display requirement parameters between the base station device and the terminal device. Furthermore, through the above operation, the viewpoint transmission strategy determined by the base station device can be associated with the display requirement parameters determined by the terminal device, thereby improving the matching degree between the viewpoint transmission strategy and the display requirement parameters, and further improving the accuracy and relevance of the viewpoint transmission strategy.
[0111] Based on the foregoing embodiments, the viewpoint data transmission method for terminal devices provided in this application can send display requirement parameters to the base station device in the following ways:
[0112] The display requirement parameters are sent to the base station equipment according to the first preset cycle;
[0113] or,
[0114] Based on the changes in the eye-tracking results, display requirement parameters are sent to the base station equipment.
[0115] In one implementation, the first preset period can be determined by the terminal device or the base station device; for example, after determining the first preset period, the base station device can send a parameter reporting instruction to the terminal device.
[0116] In one implementation, after detecting a change in the eye-tracking result, the terminal device can send display requirement parameters to the base station device in the manner indicated by the parameter reporting instruction. For example, the change in the eye-tracking result can be triggered by eye displacement caused by a change in the user's position, or by rotation of the user's eyeballs or opening and closing of the eyes.
[0117] In one implementation, the method for the terminal device to report and display required parameters can be predetermined or determined through negotiation between the base station device and the terminal device. This application does not limit this method.
[0118] As can be seen from the above, the viewpoint data transmission method for terminal devices provided in this application allows the terminal device to send display requirement parameters to the base station device according to a first preset period, thereby enabling the base station device to stably obtain the display requirement parameters according to the first preset period and providing data support for the base station device to flexibly determine or adjust the viewpoint transmission strategy. Furthermore, the terminal device sends display requirement parameters to the base station device based on the changing state of the eye tracking results, enabling the terminal device to dynamically and flexibly send display requirement parameters to the base station device according to the changing state of the eye tracking results, and also reducing unnecessary display requirement parameter sending operations. By sending display requirement parameters to the base station device in the above two ways, the flexibility of the terminal device in sending display requirement parameters is improved.
[0119] Based on the foregoing embodiments, the viewpoint data transmission method for terminal devices provided in this application can further perform the following operations after determining the display requirement parameters:
[0120] Send display requirement parameters to the application server to trigger the application server to generate and send transmission requirement parameters to the core network device based on the display requirement parameters and the viewpoint parameter set associated with the viewpoint data set.
[0121] The core network equipment is used to determine and send the viewpoint transmission strategy to the base station equipment based on the transmission demand parameters, or to trigger the base station equipment to determine the viewpoint transmission strategy based at least on the transmission demand parameters.
[0122] In one implementation, after the terminal device establishes a session connection with the application server and determines the display requirement parameters, the display requirement parameters can be sent to the application server through the session connection.
[0123] In one implementation, the transmission requirement parameters may include the target viewpoint identifier of the viewpoint data to be transmitted, and may also include the rate and / or frame rate of transmitting the viewpoint identifier.
[0124] In one implementation, the transmission requirement parameters can be determined in the following way:
[0125] The application server determines the target viewpoint identifier and eye-tracking results based on the display requirement parameters, configures the importance of viewpoint data in the viewpoint data set, sets the importance of two or more viewpoint data that the terminal device needs to display at the current moment to the first level, sets the importance of candidate viewpoint data to the second level, and determines the set of viewpoint identifiers of viewpoint data with the first and second levels of importance based on the viewpoint parameter set. Then, the set of the above viewpoint identifiers is determined as the transmission requirement parameters.
[0126] In one implementation, the application server can send transmission requirement parameters to the core network device via control plane signaling. For example, the target viewpoint identifier included in the transmission requirement parameters can be a Transmission Number Information (TNI), which can be 4 bits and has a value range of 0-15; the Transmission Importance Parameter (TIP) can be 2 bits and has a value range of 0-3, and the importance can decrease as its value increases.
[0127] In one implementation, after receiving the transmission requirement parameters and the viewpoint parameter set, the core network device can determine a method for filtering and transmitting viewpoint data in the viewpoint parameter set based on the set of viewpoint identifiers of the first and second levels in the transmission requirement parameters, and determine the above-mentioned filtering and transmission method as the viewpoint transmission strategy.
[0128] Table 3 describes the fields representing the importance of viewpoint data in the transmission requirement parameters determined by the application server, such as...
[0129] As shown in Table 3:
[0130]
[0131] Table 3
[0132] In one implementation, the viewpoint transmission strategy may include transmitting viewpoint data of a first importance level at a first rate and transmitting viewpoint data of a second importance level at a second rate.
[0133] In one implementation, after receiving the transmission requirement parameters, the core network equipment can also send the transmission requirement parameters to the base station equipment via control plane signaling. After receiving the viewpoint data set and the transmission requirement parameters, the base station equipment can determine the viewpoint transmission strategy using a similar method described above.
[0134] As can be seen from the above, in the viewpoint data transmission method for terminal devices provided in this application embodiment, the terminal device sends display requirement parameters to the application server, triggering the application server to generate and send transmission requirement parameters to the core network device based on the display requirement parameters and the viewpoint parameter set associated with the viewpoint data set. Through the above operations, precise control is achieved over the operation of the application server determining and sending transmission requirement parameters to the core network device. Furthermore, the core network device is used to determine and send viewpoint transmission strategies to the base station device based on the transmission requirement parameters. In this way, the data computing resources of the core network device can be fully utilized, reducing the time cost for the base station device to determine the viewpoint transmission strategy. On the other hand, the core network device can also trigger the base station device to determine the viewpoint transmission strategy based at least on the transmission requirement parameters, thereby providing a variety of methods for determining the viewpoint transmission strategy and improving the flexibility of viewpoint transmission strategy determination.
[0135] Based on the foregoing embodiments, the viewpoint data transmission method for application terminal devices provided in this application embodiment, which sends display requirement parameters to the application server, can be implemented in the following ways:
[0136] The display requirement parameters are sent to the application server according to the second preset cycle;
[0137] or,
[0138] Based on the changes in the eye-tracking results, display requirement parameters are sent to the application server.
[0139] In one implementation, the reciprocal of the second preset period can be greater than the data refresh rate; for example, the first preset period and the second preset period can be the same or different.
[0140] In one implementation, the second preset period can be pre-set, determined by the terminal device itself, or determined by the application server based on the data processing status of the naked-eye 3D service. This application embodiment does not limit this.
[0141] In one implementation, after detecting a change in the eye-tracking result, the terminal device can generate new display requirement parameters based on the new eye-tracking result and send the new display requirement parameters to the application server.
[0142] As can be seen from the above, the viewpoint data transmission method for terminal devices provided in this application embodiment allows the terminal device to send display requirement parameters to the application server according to a second preset period, or to send display requirement parameters to the application server based on changes in eye-tracking results. Thus, through the above operations, diverse methods for terminal devices to send display requirement parameters are provided, thereby meeting the needs for sending display requirement parameters in various scenarios or under various circumstances.
[0143] Based on the foregoing embodiments, this application also provides a viewpoint data transmission method applied to base station equipment. Figure 2 This is a flowchart illustrating the viewpoint data transmission method applied to base station equipment provided in an embodiment of this application, as shown below. Figure 2 As shown, the method may include the following steps:
[0144] Step 201: Based on the viewpoint transmission strategy associated with the data processing status of the naked-eye 3D service of the terminal device at the current moment, the base station equipment determines the target viewpoint data from the viewpoint data set.
[0145] Among them, the number of viewpoint data in the target viewpoint data is less than the number of viewpoint data in the viewpoint data set; the viewpoint data set is associated with naked-eye 3D services.
[0146] Step 202: Transmit the target viewpoint data to the terminal device so that the terminal device can load the target viewpoint data.
[0147] As can be seen from the above, the viewpoint data transmission method for base station equipment provided in this application embodiment determines the target viewpoint data from the viewpoint data set associated with the naked-eye 3D service based on the data transmission strategy associated with the data processing status of the naked-eye 3D service of the terminal equipment at the current moment. This improves the matching degree between the target viewpoint data and the data processing status of the naked-eye 3D service of the terminal equipment at the current moment. Furthermore, since the number of viewpoint data in the target viewpoint data is less than the number of viewpoint data in the viewpoint data set, and the base station equipment transmits the target viewpoint data rather than the viewpoint data set to the terminal equipment for the terminal equipment to load the target viewpoint data, redundant data transmission operations caused by transmitting the viewpoint data set can be reduced, and the network bandwidth requirements between the base station equipment and the terminal equipment can be reduced. This achieves a balance between ensuring the data processing status of the naked-eye 3D service of the terminal equipment and transmitting the target viewpoint data, thereby meeting the viewpoint data display requirements of the naked-eye 3D service of the terminal equipment.
[0148] Based on the foregoing embodiments, in the viewpoint data transmission method for base station equipment provided in this application, before determining the target viewpoint data from the viewpoint data set based on the viewpoint transmission strategy associated with the data processing status of the naked-eye 3D service of the terminal equipment at the current moment, the base station equipment may also perform the following steps:
[0149] Step B1: Send parameter reporting instructions to the terminal device to trigger the terminal device to determine and send the display requirement parameters to the base station device.
[0150] Among them, the display requirement parameters are determined by the terminal device based on the set of viewpoint parameters associated with the viewpoint data set sent by the application server, and the eye tracking results; the display requirement parameters include the parameters of the viewpoint data in the data processing status; the application server is associated with the naked-eye 3D service.
[0151] Step B2: Determine the viewpoint transmission strategy based on display requirement parameters.
[0152] As can be seen from the above, the viewpoint data transmission method for base station equipment provided in this application involves the base station equipment sending a parameter reporting instruction to the terminal equipment to trigger the terminal equipment to determine and send display requirement parameters to the base station equipment, thereby realizing the control of the base station equipment over the terminal equipment's determination and sending of display requirement parameters. Furthermore, the display requirement parameters are determined by the terminal equipment based on the viewpoint parameter set associated with the viewpoint data set sent by the application server and the eye tracking results. The display requirement parameters include parameters of the viewpoint data associated with the data processing state, and the application server is associated with the naked-eye 3D service. This improves the accuracy of the display requirement parameters. Based on this, determining the viewpoint transmission strategy based on the display requirement parameters can improve the matching degree between the viewpoint transmission strategy and the data processing state of the naked-eye 3D service of the terminal equipment at the current moment, thereby improving the accuracy of the viewpoint transmission strategy.
[0153] Based on the foregoing embodiments, in the viewpoint data transmission method for base station equipment provided in this application, before determining the target viewpoint data from the viewpoint data set based on the viewpoint transmission strategy associated with the data processing status of the naked-eye 3D service of the terminal equipment at the current moment, the base station equipment may also perform the following operations:
[0154] Receive viewpoint transmission strategies sent by core network equipment.
[0155] The core network equipment is used to determine the viewpoint transmission strategy based on the transmission requirement parameters sent by the application server. The transmission requirement parameters are generated by the application server based on the display requirement parameters and the viewpoint parameter set associated with the viewpoint data set. The display requirement parameters are determined by the terminal equipment based on the viewpoint parameter set sent by the application server and the eye tracking results. The display requirement parameters include the parameters of the viewpoint data associated with the data processing status. The application server is associated with the naked-eye 3D service.
[0156] As can be seen from the above, the viewpoint data transmission method for base station equipment provided in this application embodiment involves the base station equipment receiving a viewpoint transmission strategy sent by the core network equipment. The core network equipment then determines the viewpoint transmission strategy based on transmission requirement parameters sent by the application server. This fully utilizes the high-speed data processing capabilities of the core network equipment, improves the efficiency of viewpoint transmission strategy determination, and enhances the matching degree between the viewpoint transmission strategy and the transmission requirement parameters. Furthermore, the transmission requirement parameters are generated by the application server based on display requirement parameters and a viewpoint parameter set associated with the viewpoint data set, thereby improving the accuracy of the transmission requirement parameters. On the other hand, since the display requirement parameters are determined by the terminal device based on the viewpoint parameter set sent by the application server and the eye-tracking results, and the display requirement parameters include parameters of the viewpoint data associated with the data processing status, the accuracy of the display requirement parameters is also improved.
[0157] Based on the foregoing embodiments, in the viewpoint data transmission method for base station equipment provided in this application, before determining the target viewpoint data from the viewpoint data set based on the viewpoint transmission strategy associated with the data processing status of the naked-eye 3D service of the terminal equipment at the current moment, the base station equipment may also perform the following operations:
[0158] Receive transmission requirement parameters sent by core network equipment; determine the viewpoint transmission strategy based on the transmission requirement parameters.
[0159] Among them, the transmission requirement parameters are generated by the application server based on the display requirement parameters and the viewpoint parameter set associated with the viewpoint data set; the display requirement parameters are determined by the terminal device based on the viewpoint parameter set associated with the viewpoint data set sent by the application server and the eye tracking results; the display requirement parameters include the parameters of the viewpoint data associated with the data processing status; the application server is associated with the naked-eye 3D service.
[0160] As described above, the viewpoint data transmission method for base station equipment provided in this application involves the base station equipment receiving transmission requirement parameters sent by the core network equipment and determining a viewpoint transmission strategy based on these parameters. The transmission requirement parameters are generated by the application server based on display requirement parameters and a viewpoint parameter set associated with the viewpoint data set. The display requirement parameters are determined by the terminal equipment based on the viewpoint parameter set associated with the viewpoint data set sent by the application server and the eye-tracking results. Furthermore, the display requirement parameters include parameters of the viewpoint data associated with the data processing status. Thus, through this process, synchronization of transmission requirement parameters between the core network equipment and the base station equipment, and synchronization of display requirement parameters between the terminal equipment and the application server, are achieved. This improves the matching degree between the viewpoint transmission strategy and the transmission and display requirement parameters, thereby increasing the probability that the viewpoint transmission strategy meets the data processing requirements of the terminal equipment's naked-eye 3D service.
[0161] Based on the foregoing embodiments, the viewpoint data transmission method for base station equipment provided in this application can also perform the following operations:
[0162] Based at least on the load status of the base station equipment, the data transmission strategy of the base station equipment shall include at least the following: adjusting the transmission priority of viewpoint data associated with the viewpoint transmission strategy to be greater than the transmission priority of non-viewpoint data, transmitting viewpoint data at a first rate, and transmitting non-viewpoint data at a second rate; the first rate is greater than the second rate.
[0163] In one implementation, the load status may include the state in which the data processing resources of the base station equipment are occupied.
[0164] In one implementation, the data transmission strategy may include a method for base station equipment to transmit viewpoint data and non-viewpoint data; for example, non-viewpoint data may include data unrelated to naked-eye 3D services.
[0165] In one implementation, the transmission priority and data transmission rate included in the data transmission strategy can change with the load state; wherein, the transmission priority may include the priority of viewpoint data transmission and the priority of non-viewpoint data transmission, and the data transmission rate may include the rate at which viewpoint data and non-viewpoint data are transmitted to the terminal device.
[0166] In one implementation, the base station device may also send the load status to the core network device to trigger the core network device to determine a target transmission policy that at least matches the load status, and configure the target transmission policy to the base station device so that the base station device can transmit viewpoint data and non-viewpoint data based on the target transmission policy; wherein, the data transmission policy may include the target transmission policy.
[0167] In one implementation, the data transmission strategy and the target transmission strategy may include a Quality of Service (QoS) level and a scheduling guarantee strategy. For example, after receiving transmission request parameters, the core network device can parse the parameters to determine data such as the target viewpoint identifier and the importance of the corresponding viewpoint data. Based on the target viewpoint identifier and importance data, it can assign different QoS levels and scheduling guarantee strategies to the viewpoint data in the viewpoint data set, defining these QoS levels and scheduling guarantee strategies as the target transmission strategy. This strategy is then sent to the base station device via GTP-U header extension information to trigger the base station device to perform differentiated transmission of viewpoint data and non-viewpoint data based on the target transmission strategy. The scheduling guarantee strategy can be characterized by indicators such as latency, bit error rate, and data transmission rate.
[0168] In related technologies, core network equipment typically configures a static QoS level for a specific transport flow to control the data transmission process of that transport flow. However, the embodiments of this application can flexibly adjust the QoS level based on factors such as the importance of viewpoint data and the load status of base station equipment.
[0169] Since the importance of viewpoint data is related to the eye-tracking results of the naked-eye 3D service of the terminal device, the above-mentioned QoS level can take into account the naked-eye 3D data display needs of the terminal device, and can adjust the transmission status of the base station equipment for viewpoint data in a more granular, flexible and targeted manner.
[0170] It should be noted that, under normal circumstances, the data transmission strategy of base station equipment can include prioritizing the transmission of target viewpoint data to terminal equipment. Under this condition, the priority and / or rate of non-viewpoint data to be transmitted by the base station can be adjusted according to the load status.
[0171] For example, adjusting the data transmission strategy based on load status can be achieved in the following way:
[0172] The load status is pre-divided into three levels: L1, L2, and L3. When the load status is at level L1, it can be determined that the base station is under high load or that data processing resources are under strain. The data transmission strategy at this time can include transmitting target viewpoint data with the first priority and non-viewpoint data with the second priority. The transmission rate and latency of non-viewpoint data can also be limited to improve the stability of target viewpoint data transmission. When the load status is at level L2 or L3, it can be determined that the base station is under medium load or that data processing resources are not under strain. The data transmission strategy at this time can include transmitting target viewpoint data with the first priority and non-viewpoint data with the second priority, but the transmission rate and latency of non-viewpoint data are not limited.
[0173] As can be seen from the above, the viewpoint data transmission method for base station equipment provided in this application embodiment determines the data transmission strategy of the base station equipment based on the load state of the base station equipment, including at least: adjusting the transmission priority of viewpoint data associated with the viewpoint transmission strategy to be greater than the transmission priority of non-viewpoint data, transmitting viewpoint data at a first rate, and transmitting non-viewpoint data at a second rate, wherein the first rate is greater than the second rate. Thus, through the above steps, even when the load state of the base station equipment fluctuates, the transmission priority and transmission rate of viewpoint data associated with the viewpoint transmission strategy can still be guaranteed, thereby ensuring the display effect of naked-eye 3D viewpoint data for the naked-eye 3D service of the terminal equipment.
[0174] Based on the foregoing embodiments, the viewpoint data transmission method for base station equipment provided in this application can also perform the following operations:
[0175] Based on the changing status of data transmission resources associated with the base station equipment and the priority of service types, adjust the data dropping mechanism in the data transmission strategy of the base station equipment.
[0176] Among them, naked-eye 3D services have a higher priority than the priority threshold, and the data transmission strategy includes the viewpoint transmission strategy.
[0177] In one implementation, data transmission resources may include the amount of remaining available data processing resources of the base station equipment, and may also include the remaining bandwidth in the network transmission bandwidth that the base station equipment can control.
[0178] In one implementation, the service type may include the type of service corresponding to the data being processed or transmitted by the base station device at the current moment; for example, the service type may include naked-eye 3D service and non-naked-eye 3D service.
[0179] In one implementation, adjusting the data discarding mechanism in the data transmission strategy of the base station equipment may include:
[0180] For data transmission of service types with priority greater than the priority threshold, data packets may not be dropped; for data transmission of service types with priority less than the priority threshold, a first number of data packets may be dropped; for data transmission of service types with priority equal to the priority threshold, a second number of data packets may be dropped; wherein, the first number may be greater than the second number.
[0181] In one implementation, when data transmission resources are scarce or strained, the base station equipment can adjust the priority and data discarding mechanism for non-viewpoint data in the data transmission strategy, while maintaining the priority for viewpoint data and not discarding viewpoint data, so as to meet the viewpoint data display requirements of naked-eye 3D services.
[0182] In one implementation, when data transmission resources are scarce or strained, the data discarding mechanism for viewpoint data can be adjusted. For example, viewpoint data to be loaded that is only used for display on the terminal device can be transmitted to the terminal device from the target viewpoint data, while candidate viewpoint data in the target viewpoint data can be discarded or cached.
[0183] In one implementation, when data transmission resources are scarce or strained, the data dropping mechanism can be adjusted according to the importance of the data frame. For example, the base station equipment can set different dropping mechanisms for viewpoint data of different importance, thereby reducing the probability of redundant viewpoint data transmission and reducing the consumption of data transmission resources. Alternatively, the base station equipment can drop data packets or viewpoint data of the first importance based on a first packet dropping mechanism, and drop data packets or viewpoint data of the second importance based on a second packet dropping mechanism, in order to reduce the probability of service processing interruption caused by only dropping data packets of lower importance, and also to a certain extent ensure the transmission effect of data packets of higher importance.
[0184] As can be seen from the above, the viewpoint data transmission method for base station equipment provided in this application adjusts the data discarding mechanism in the data transmission strategy of the base station equipment based on the changing state of the data transmission resources associated with the base station equipment and the priority of the service type. The priority of the naked-eye 3D service is greater than the priority threshold, and the data transmission strategy includes a viewpoint transmission strategy. Thus, through the above operations, the base station equipment can dynamically, differentiatedly, elastically, and flexibly adjust its data discarding mechanism during the data transmission process. This allows the base station equipment to cope with diverse data transmission fluctuations from the dimensions of changing data transmission resource states and service type priorities, thereby ensuring data transmission needs, including those for naked-eye 3D services.
[0185] Based on the foregoing embodiments, this application also provides a terminal device. Figure 3 This is a schematic diagram of the structure of the terminal device provided in the embodiments of this application, such as... Figure 3 As shown, the terminal device 3 may include a first processor 301 and a first memory 302; wherein, the first memory 302 stores a first computer program; when the first computer program is executed by the first processor 301, it can implement the viewpoint data transmission method applied to the terminal device as provided in any of the preceding embodiments.
[0186] Based on the foregoing embodiments, this application also provides a base station device. Figure 4 This is a schematic diagram of the structure of the base station equipment provided in the embodiments of this application, such as... Figure 4 As shown, the base station device 4 may include a second processor 401 and a second memory 402; wherein, the second memory 402 stores a second computer program; when the second computer program is executed by the second processor 401, it can implement the viewpoint data transmission method applied to the base station device as provided in any of the preceding embodiments.
[0187] Based on the foregoing embodiments, this application also provides a viewpoint transmission system. Figure 5 This is a schematic diagram of the viewpoint data transmission system provided in the embodiments of this application, as shown below. Figure 5 As shown, the viewpoint data transmission system 5 may include core network equipment 501, application server 502, terminal equipment 3, and base station equipment 4.
[0188] Figure 6 This is a schematic diagram illustrating the process of transmitting viewpoint data in the viewpoint data transmission system provided in the embodiments of this application, as shown below. Figure 6 As shown, the method may include the following steps:
[0189] Step 601: Initiate a request to establish the application.
[0190] For example, terminal device 3 can initiate a mobile access request to base station device 4, and after establishing a communication connection between it and base station device 4, send a naked-eye 3D service processing request to application server 502.
[0191] Step 602: Establish a business session.
[0192] For example, after receiving a business processing request, the application server 502 can respond to the request and establish a business session; wherein, the business session can be the session connection in the aforementioned embodiment.
[0193] Step 603: Launch of naked-eye 3D service.
[0194] For example, the application server 502 can initiate a glasses-free 3D service and transmit a set of viewpoint data to the base station equipment.
[0195] Step 604: Business diversion and business characteristic perception.
[0196] For example, after the application server 502 generates the viewpoint data set, it can transmit the viewpoint data set to the core network device 501 through the N33 interface, and send the viewpoint parameter set to the policy control function (PCF) through the application function (AF), and then transmit it sequentially according to the path from PCF to the session management function (SMF) and finally to the user plane function (UPF).
[0197] Step 605: Determine the display requirements parameters.
[0198] For example, terminal device 3 can determine display requirement parameters.
[0199] Step 606: Send display requirement parameters.
[0200] For example, terminal device 3 can send display requirement parameters to the application server.
[0201] Step 607: Issue the importance of the viewpoint.
[0202] For example, the application server can determine the transmission requirement parameters, including the target viewpoint identifier, based on the display requirement parameters and send them to the core network device; for example, the viewpoint importance can be the target viewpoint identifier in the transmission requirement parameters.
[0203] Step 608: Configure QoS.
[0204] For example, the core network equipment can determine the QoS using the method provided in the foregoing embodiments and send it to the base station equipment.
[0205] Step 609: Transmit viewpoint data according to QoS.
[0206] For example, the base station equipment can transmit target viewpoint data to the terminal equipment according to QoS.
[0207] Step 610: Convey the importance of the viewpoint.
[0208] For example, core network equipment can send transmission requirement parameters to base station equipment.
[0209] Step 611: Adjust the data transmission strategy.
[0210] For example, the base station equipment can adjust the data transmission strategy, including the viewpoint transmission strategy, according to the transmission requirement parameters sent by the core network equipment, so as to meet the viewpoint data display requirements of the terminal equipment for naked-eye 3D.
[0211] It should be noted that the first branch represented by steps 607 to 608 and the second branch represented by steps 610 and 611 can be executed selectively.
[0212] Through the above steps, flexible and stable transmission of target viewpoint data in the viewpoint data transmission system is achieved. This not only reduces the waste of data transmission resources in the viewpoint data transmission system and reduces redundant viewpoint data transmission operations, but also meets the viewpoint data display requirements of naked-eye 3D on terminal devices.
[0213] Figure 7 This is another schematic diagram illustrating the process of transmitting viewpoint data in the viewpoint data transmission system provided in this application embodiment. For example... Figure 7 As shown, the process may include the following steps:
[0214] Step 701: Initiate a request to establish the application.
[0215] Step 702: Establish a business session.
[0216] Step 703: Launch of naked-eye 3D service.
[0217] Step 704: Business diversion and business characteristic perception.
[0218] Step 705: Transmit the viewpoint data set.
[0219] For example, after the application server generates a set of viewpoint data, it can send it to the base station equipment.
[0220] Step 706: Determine the display requirements parameters.
[0221] Step 707: Instruct on the reporting location and format.
[0222] For example, after receiving the viewpoint data set, the base station device can send a reporting instruction parameter through the method provided in the foregoing embodiments to instruct the terminal device to send the display requirement parameter in terms of location and format.
[0223] Step 708: Report and display required parameters.
[0224] For example, the terminal device can report display requirement parameters according to the location and format indicated by the base station device.
[0225] Step 709: Adjust the data transmission strategy.
[0226] For example, after receiving the display requirement parameters, the base station device can determine the target viewpoint identifier and transmit the target viewpoint data corresponding to the target viewpoint identifier to the terminal device with high priority, while transmitting non-viewpoint data with lower priority.
[0227] Step 710: Adjust the data discarding mechanism.
[0228] For example, when data transmission resources fluctuate, the base station equipment can adjust the data discarding mechanism using the method provided in the foregoing embodiments.
[0229] Step 711, Differentiated transmission.
[0230] For example, the base station equipment can selectively discard candidate viewpoint data in the target viewpoint data according to the data discarding mechanism, and can also selectively discard transmission data of service types with lower priority than naked-eye 3D services, so as to ensure the transmission efficiency of target viewpoint data of naked-eye 3D services.
[0231] Through the above process, the base station equipment can transmit target viewpoint data to the terminal equipment in a targeted, controllable, and differentiated manner. Moreover, the base station equipment can adjust the data transmission strategy and data discarding mechanism, thereby enhancing the controllability and flexibility of the base station equipment in transmitting target viewpoint data to the terminal equipment.
[0232] Based on the foregoing embodiments, this application also provides a computer-readable storage medium storing a third computer program; when the third computer program is executed by the processor of an electronic device, it can implement the viewpoint data transmission method as described above.
[0233] Based on the foregoing embodiments, this application also provides a computer program product, which includes a third computer program; when the third computer program is executed by the processor of an electronic device, it can implement the viewpoint data transmission method as described above.
[0234] The description of the various embodiments above tends to emphasize the differences between the various embodiments. The similarities or similarities between them can be referred to, and for the sake of brevity, they will not be repeated here.
[0235] The methods disclosed in the various method embodiments provided in this application can be arbitrarily combined without conflict to obtain new method embodiments.
[0236] The features disclosed in the various product embodiments provided in this application can be arbitrarily combined without conflict to obtain new product embodiments.
[0237] The features disclosed in the various method or device embodiments provided in this application can be arbitrarily combined without conflict to obtain new method or device embodiments.
[0238] It should be noted that the aforementioned computer-readable storage media can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), magnetic random access memory (FRAM), flash memory, magnetic surface memory, optical disc, or compact disc read-only memory (CD-ROM), etc.; or it can be various electronic devices that include one or any combination of the above-mentioned memories, such as mobile phones, computers, tablet devices, personal digital assistants, etc.
[0239] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.
[0240] The sequence numbers of the embodiments in this application are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.
[0241] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware nodes. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in the various embodiments of this application.
[0242] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart... Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.
[0243] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.
[0244] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.
[0245] The above are merely preferred embodiments of this application and do not limit the patent scope of this application. Any equivalent structural or procedural transformations made using the content of this application's specification and drawings, or direct or indirect applications in other related technical fields, are similarly included within the patent protection scope of this application.
Claims
1. A viewpoint data transmission method, characterized in that, The method includes: A terminal device receives target viewpoint data transmitted by a base station device; wherein, the base station device is used to determine and transmit the target viewpoint data to the terminal device based on a viewpoint transmission strategy associated with the data processing status of the naked-eye 3D service at the current moment of the terminal device; the number of viewpoint data in the target viewpoint data is less than the number of viewpoint data in the viewpoint data set; the viewpoint data set is associated with the naked-eye 3D service; Load the target viewpoint data.
2. The method according to claim 1, characterized in that, Before the terminal device receives the target viewpoint data transmitted by the base station device, the method further includes: Receive a set of viewpoint parameters associated with the viewpoint data set sent by the application server; wherein the application server is associated with the naked-eye 3D service; Determine the eye-tracking results; Based on the eye-tracking results and the viewpoint parameter set, display requirement parameters are determined; wherein, the display requirement parameters include parameters of the viewpoint data associated with the data processing state.
3. The method according to claim 2, characterized in that, After determining the display requirement parameters, the method further includes: In response to the parameter reporting instruction sent by the base station device, the display requirement parameters are sent to the base station device to trigger the base station device to determine the viewpoint transmission strategy based on the display requirement parameters and the data processing status.
4. The method according to claim 3, characterized in that, Sending the display requirement parameters to the base station device includes: The display requirement parameters are sent to the base station equipment according to the first preset cycle; or, Based on the changes in the eye-tracking results, the display requirement parameters are sent to the base station device.
5. The method according to claim 2, characterized in that, After determining the display requirement parameters, the method further includes: The display requirement parameters are sent to the application server to trigger the application server to generate and send transmission requirement parameters to the core network device based on the display requirement parameters and the viewpoint parameter set associated with the viewpoint data set; wherein, the core network device is used to determine and send the viewpoint transmission strategy to the base station device based on the transmission requirement parameters, or to trigger the base station device to determine the viewpoint transmission strategy based at least on the transmission requirement parameters.
6. The method according to claim 5, characterized in that, Sending the display requirement parameters to the application server includes: The display requirement parameters are sent to the application server according to the second preset cycle; or, Based on the changes in the eye-tracking results, the display requirement parameters are sent to the application server.
7. A viewpoint data transmission method, characterized in that, The method includes: The base station equipment determines target viewpoint data from the viewpoint data set based on the viewpoint transmission strategy associated with the data processing status of the naked-eye 3D service of the terminal device at the current moment; wherein, the number of viewpoint data in the target viewpoint data is less than the number of viewpoint data in the viewpoint data set; the viewpoint data set is associated with the naked-eye 3D service; The target viewpoint data is transmitted to the terminal device so that the terminal device can load the target viewpoint data.
8. The method according to claim 7, characterized in that, Before determining the target viewpoint data from the viewpoint data set based on the viewpoint transmission strategy associated with the data processing status of the naked-eye 3D service of the terminal device at the current moment, the method further includes: A parameter reporting instruction is sent to the terminal device to trigger the terminal device to determine and send display requirement parameters to the base station device; wherein, the display requirement parameters are determined by the terminal device based on the viewpoint parameter set associated with the viewpoint data set sent by the application server and the eye tracking results; the display requirement parameters include parameters of the viewpoint data associated with the data processing status; the application server is associated with the naked-eye 3D service; The viewpoint transmission strategy is determined based on the display requirement parameters.
9. The method according to claim 7, characterized in that, Before determining the target viewpoint data from the viewpoint data set based on the viewpoint transmission strategy associated with the data processing status of the naked-eye 3D service of the terminal device at the current moment, the method further includes: The system receives the viewpoint transmission strategy sent by the core network device; wherein the core network device determines the viewpoint transmission strategy based on transmission requirement parameters sent by the application server; the transmission requirement parameters are generated by the application server based on display requirement parameters and a viewpoint parameter set associated with the viewpoint data set; the display requirement parameters are determined by the terminal device based on the viewpoint parameter set sent by the application server and eye-tracking results; the display requirement parameters include parameters of the viewpoint data associated with the data processing status; the application server is associated with naked-eye 3D services.
10. The method according to claim 7, characterized in that, Before determining the target viewpoint data from the viewpoint data set based on the viewpoint transmission strategy associated with the data processing status of the naked-eye 3D service of the terminal device at the current moment, the method further includes: The system receives transmission requirement parameters sent by the core network equipment; wherein, the transmission requirement parameters are generated by the application server based on display requirement parameters and a set of viewpoint parameters associated with the viewpoint data set; the display requirement parameters are determined by the terminal device based on the set of viewpoint parameters associated with the viewpoint data set sent by the application server and eye-tracking results; the display requirement parameters include parameters of the viewpoint data associated with the data processing status; the application server is associated with the naked-eye 3D service; Based on the transmission requirement parameters, the viewpoint transmission strategy is determined.
11. The method according to any one of claims 7 to 10, characterized in that, The method further includes: Based at least on the load status of the base station equipment, determining the data transmission strategy of the base station equipment includes at least: adjusting the transmission priority of viewpoint data associated with the viewpoint transmission strategy to be greater than the transmission priority of non-viewpoint data, transmitting the viewpoint data at a first rate, and transmitting the non-viewpoint data at a second rate; the first rate is greater than the second rate.
12. The method according to any one of claims 7 to 10, characterized in that, The method further includes: Based on the changing status of the data transmission resources associated with the base station equipment and the priority of the service type, the data discarding mechanism in the data transmission strategy of the base station equipment is adjusted; wherein, the priority of naked-eye 3D service is greater than the priority threshold; the data transmission strategy includes the viewpoint transmission strategy.
13. A terminal device, characterized in that, The terminal device includes a first processor and a first memory; the first memory stores a first computer program; when the first computer program is executed by the first processor, it can implement the viewpoint data transmission method as described in any one of claims 1 to 6.
14. A base station device, characterized in that, The base station equipment includes a second processor and a second memory; the second memory stores a second computer program; when the second computer program is executed by the second processor, it can implement the viewpoint data transmission method as described in any one of claims 7 to 12.
15. A viewpoint data transmission system, characterized in that, The viewpoint transmission system includes core network equipment, application server, terminal equipment as described in claim 13, and base station equipment as described in claim 14.
16. A computer-readable storage medium, characterized in that, The storage medium stores a third computer program; when the third computer program is executed by the processor of the electronic device, it is able to implement the viewpoint data transmission method as described in any one of claims 1 to 6 or 7 to 12.
17. A computer program product, characterized in that, The program product includes a third computer program; when executed by the processor of an electronic device, the third computer program is capable of implementing the viewpoint data transmission method as described in any one of claims 1 to 6 or 7 to 12.