Method and apparatus for delivering media content

By receiving the user's human-computer interaction environment indication information, it is determined whether to deliver media content to the user equipment during a call, which solves the problem of poor user experience in the existing technology and achieves more efficient media content delivery.

CN115695379BActive Publication Date: 2026-01-16HUAWEI TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202110838469.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-07-23
Publication Date
2026-01-16
Estimated Expiration
2041-07-23

AI Technical Summary

Technical Problem

When delivering media content to user equipment (UE), determining the media content solely based on the user's tag information results in poor user experience and delivery effectiveness.

Method used

By receiving call service human-machine interaction environment indication information sent by the UE, the user's state during the call service is determined, such as whether they are looking at the screen or whether it is appropriate to watch or listen to media content, so as to decide whether and how to deliver media content.

Benefits of technology

It improved user experience and the effectiveness of media content delivery, reduced data traffic consumption, and saved air interface resources.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115695379B_ABST
    Figure CN115695379B_ABST
Patent Text Reader

Abstract

The application discloses a media content delivery method and device, and relates to the field of communication. In the method, a media delivery server can receive indication information sent by a user equipment (UE) and used for indicating a human-computer interaction environment of a user corresponding to the UE during a call service. After receiving the indication information, the media delivery server can determine whether to deliver media content to the UE during the call service according to the indication information. Alternatively, after receiving the indication information, the media delivery server can determine to-be-delivered media content according to the indication information, and deliver the to-be-delivered media content to the UE during the call service. The indication information can reflect the human-computer interaction environment of the user during the call service, so that the determination of whether to deliver media content or the determination of to-be-delivered media content according to the indication information is more in line with the demand of the user, and the user experience and the delivery effect of the media content can be improved.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to the field of communication, in particular to a media content delivery method and device. BACKGROUND

[0002] With the development of mobile communication technology, voice over long term evolution (VOLTE) technology emerges as the times require. VOLTE can be carried on the fourth generation (4G) or fifth generation (5G) network, and voice control is realized based on the internet protocol multimedia subsystem (IMS) to provide shorter connection for user equipment (UE) to provide high-definition voice.

[0003] In order to show rich media content, such as advertisements or promotional information, to the user corresponding to the UE, the media content can be delivered to the UE when the user uses the VOLTE technology to call. However, when delivering the media content to the UE, only according to the tag information of the user to determine the media content to be delivered, there is still a certain blindness, which will affect the user experience and the delivery effect of the media content. SUMMARY

[0004] The present application provides a media content delivery method and device, which can determine whether to deliver media content to the UE during the call service period according to the human-computer interaction environment of the user corresponding to the UE during the call service period, or determine the media content delivered to the UE during the call service period, thereby improving the user experience and the delivery effect of the media content.

[0005] To achieve the above purpose, the embodiments of the present application adopt the following technical solutions:

[0006] In a first aspect, the embodiments of the present application provide a media content delivery method, which can be applied to a media delivery server, and the method comprises: receiving call service human-computer interaction environment indication information sent by a UE, the call service human-computer interaction environment indication information indicating the human-computer interaction environment of the user corresponding to the UE during the call service period; determining the to-be-delivered media content according to the call service human-computer interaction environment indication information, and delivering the to-be-delivered media content to the UE during the call service period.

[0007] Based on the above method, the media delivery server can receive the call service human-computer interaction environment indication information sent by the UE, and determine the to-be-delivered media content according to the indication information. The human-computer interaction environment indicated by the call service human-computer interaction environment indication information can reflect the current state of the user, for example, whether the user is looking at the screen of the UE, whether the user is suitable for watching or listening to the media content, and the like. Therefore, the to-be-delivered media content determined according to the call service human-computer interaction environment indication information is more in line with the needs of the user, and the media delivery server delivering the media content in line with the needs of the user to the user can improve the user experience and the delivery effect of the media content.

[0008] Alternatively, in a first aspect, the embodiments of the present application provide a media content delivery method, which can be applied to a media delivery server, and the method comprises: receiving call service human-computer interaction environment indication information sent by a UE, the call service human-computer interaction environment indication information indicating a human-computer interaction environment of a user corresponding to the UE during a call service; and determining, according to the call service human-computer interaction environment indication information, that no media content is to be delivered to the UE during the call service.

[0009] Based on the above method, the media delivery server can determine that no media content is to be delivered to the UE during the call service according to the call service human-computer interaction environment indication information. The human-computer interaction environment indicated by the call service human-computer interaction environment indication information can reflect the current state of the user, for example, whether the user is looking at the screen of the UE, whether the user is suitable for watching or listening to the media content, and the like. Therefore, the media delivery server can not deliver media content to the UE in the case where it is not suitable to deliver media content to the UE, thereby improving the user experience, and also reducing or avoiding the consumption of data flow of the UE and saving air interface resources.

[0010] In a possible implementation, the human-computer interaction environment includes any one or any combination of the following: whether the screen of the UE is on, whether the interface of the call program of the UE is visible, whether the hands-free function of the UE is turned on, whether the wired earphone of the UE is plugged in, whether the wireless earphone of the UE is connected, or whether the user is within the visible range of the UE. Based on the above method, the current state of the user, for example, whether the user is looking at the screen of the UE, whether the user is suitable for watching or listening to the media content, and the like, can be determined according to whether the screen of the UE is on, whether the interface of the call program of the UE is visible, whether the hands-free function of the UE is turned on, whether the wired earphone of the UE is plugged in, whether the wireless earphone of the UE is connected, or whether the user is within the visible range of the UE, and then the to-be-delivered media content can be determined, or it can be determined that no media content is to be delivered to the UE during the call service.

[0011] In a possible implementation, the media content to be played is determined according to the call service man-machine interactive environment indication information, including: determining a media form according to the call service man-machine interactive environment indication information, the media form including an audio form, a silent video form, a voiced video form, or a low-volume video form, and the default volume of the media content in the low-volume video form being greater than 0 and less than a preset threshold; and determining media content conforming to the media form as the media content to be played. Based on the foregoing method, the media content to be played can be determined according to the media form, so as to improve the playing effect of the media content.

[0012] In a possible implementation, the media form is determined according to the call service man-machine interactive environment indication information, including: if any of the following conditions is met, the media form is determined as an audio form: the call service man-machine interactive environment indication information indicates that the screen of the UE is turned off, or the call service man-machine interactive environment indication information indicates that the screen of the UE is turned on and the interface of the call program of the UE is invisible, or the call service man-machine interactive environment indication information indicates that the screen of the UE is turned on, the wired earphone of the UE is plugged in, and the user is not within the visual range of the UE, or the call service man-machine interactive environment indication information indicates that the screen of the UE is turned on, the wireless earphone of the UE is connected, and the user is not within the visual range of the UE. Based on the foregoing method, the media form can be determined as an audio form in a case where the call service man-machine interactive environment is suitable for the user to listen to the sound played by the UE. In this case, the media playing server will not play media content in a video form to the UE, which can improve the user experience, reduce or avoid the consumption of data flow of the UE, and save the air interface resource.

[0013] In a possible implementation, the media form is determined according to the call service man-machine interactive environment indication information, including: if any of the following conditions is met, the media form is determined as a voiced video form: the call service man-machine interactive environment indication information indicates that the screen of the UE is turned on, the interface of the call program of the UE is visible, and the wired earphone of the UE is plugged in; or the call service man-machine interactive environment indication information indicates that the screen of the UE is turned on, the interface of the call program of the UE is visible, and the wireless earphone of the UE is connected; or the call service man-machine interactive environment indication information indicates that the screen of the UE is turned on, the interface of the call program of the UE is visible, the wireless earphone of the UE is connected, and the user is within the visual range of the UE; or the call service man-machine interactive environment indication information indicates that the screen of the UE is turned on, the interface of the call program of the UE is visible, the wired earphone of the UE is plugged in, and the user is within the visual range of the UE. Based on the foregoing method, if the call service man-machine interactive environment is suitable for the user to watch the video played by the UE, the media playing server can determine the media form as a voiced video form.

[0014] In a possible implementation, the media form is determined according to the call service man-machine interactive environment indication information, and the method comprises the following steps: if the screen of the UE is on, the interface of the call program of the UE is visible, and the hands-free function of the UE is on, it is determined that the media form is a silent video form. Based on the above method, if the call service man-machine interactive environment is suitable for the user to watch the video played by the UE, but the call service man-machine interactive environment is not suitable for the UE to play the external sound, the media delivery server can determine that the media form is a silent video form.

[0015] In a possible implementation, the media form is determined according to the call service man-machine interactive environment indication information, and the method comprises the following steps: if any of the following conditions is met, it is determined that the media form is a low sound video form: the wired earphone of the UE is inserted, indicated by the call service man-machine interactive environment indication information; or the wireless earphone of the UE is connected, indicated by the call service man-machine interactive environment indication information; or the screen of the UE is on, the interface of the call program of the UE is visible, the hands-free function of the UE is off, the wired earphone of the UE is not inserted, the wireless earphone of the UE is not connected, and the user is within the visual range of the UE, indicated by the call service man-machine interactive environment indication information. Based on the above method, if the call service man-machine interactive environment is suitable for the user to watch the video played by the UE, but the call service man-machine interactive environment is not suitable for the UE to play the external sound which is too loud, the media delivery server can determine that the media form is a low sound video form.

[0016] In a possible implementation, the media content to be delivered is determined according to the call service man-machine interactive environment indication information, and the method comprises the following steps: if any of the following conditions is met, it is determined that the media content to be delivered is the media content for delivering media information through voice: the screen of the UE is off, indicated by the call service man-machine interactive environment indication information; or the screen of the UE is on, and the interface of the call program of the UE is invisible, indicated by the call service man-machine interactive environment indication information; or the screen of the UE is on, the wired earphone of the UE is inserted, and the user is not within the visual range of the UE, indicated by the call service man-machine interactive environment indication information; or the screen of the UE is on, the wireless earphone of the UE is connected, and the user is not within the visual range of the UE, indicated by the call service man-machine interactive environment indication information. Based on the above method, if the call service man-machine interactive environment is suitable for the user to listen to the sound played by the UE, the media delivery server can determine that the media content to be delivered is the media content for delivering media information through voice.

[0017] In a possible implementation, the media content to be delivered is determined according to the call service man-machine interactive environment indication information, including: if any of the following conditions is met, the media content to be delivered is determined as the media content that delivers information through an image: the call service man-machine interactive environment indication information indicates that the screen of the UE is on, the interface of the call program of the UE is visible, and the hands-free function of the UE is off; or the call service man-machine interactive environment indication information indicates that the screen of the UE is on, the interface of the call program of the UE is visible, and the hands-free function of the UE is on. Based on the foregoing method, if the call service man-machine interactive environment is suitable for the user to watch the video played by the UE, the media delivery server can determine the media content to be delivered as the media content that delivers media information through an image.

[0018] In a possible implementation, the media content to be delivered is determined according to the call service man-machine interactive environment indication information, including: determining the group type of the user according to the call service man-machine interactive environment indication information; and determining the media content to be delivered according to the group type. Based on the foregoing method, the media content suitable for the group to which the user belongs is delivered to the UE, thereby improving the user experience and the delivery effect of the media content.

[0019] In a possible implementation, the media content is determined not to be delivered to the UE during the call service according to the call service man-machine interactive environment indication information, including: if any of the following conditions is met, the media content is determined not to be delivered to the UE during the call service: the call service man-machine interactive environment indication information indicates that the screen of the UE is off; or the call service man-machine interactive environment indication information indicates that the screen of the UE is on and the interface of the call program of the UE is invisible; or the call service man-machine interactive environment indication information indicates that the screen of the UE is on, the wired earphone of the UE is inserted, and the user is not within the visible range of the UE; or the call service man-machine interactive environment indication information indicates that the screen of the UE is on, the wireless earphone of the UE is connected, and the user is not within the visible range of the UE. Based on the foregoing method, the media content can be determined not to be delivered to the UE in a case where the call service man-machine interactive environment is not suitable for the media content to be delivered.

[0020] In a possible implementation, the call service man-machine interactive environment indication information sent by the UE is received, including: receiving the SIP-info message sent by the UE, where the SIP-info message includes the call service man-machine interactive environment indication information. Based on the foregoing method, the UE can send the call service man-machine interactive environment indication information to the media delivery server through the SIP-info message.

[0021] In a possible implementation, receiving the call service human-computer interaction environment indication information sent by the UE includes: receiving a SIP-Notifiication message sent by the UE, the SIP-Notifiication message including the call service human-computer interaction environment indication information. Before receiving the call service human-computer interaction environment indication information sent by the UE, the method further includes: sending a subscription message to the UE, the subscription message being used to subscribe to the call service human-computer interaction environment indication information. Based on the foregoing method, the media delivery server can subscribe to the call service human-computer interaction environment indication information through the subscription message, and the UE can send the call service human-computer interaction environment indication information to the media delivery server through the SIP-Notifiication message.

[0022] In a possible implementation, receiving the call service human-computer interaction environment indication information sent by the UE includes: receiving a request message for requesting media content sent by the UE, the request message for requesting media content including the call service human-computer interaction environment indication information. Based on the foregoing method, the UE can send the call service human-computer interaction environment indication information to the media delivery server through the request message for requesting media content.

[0023] In a possible implementation, delivering the to-be-delivered media content to the UE during the call service includes: sending a response message of the request message to the UE during the call service, the response message including the to-be-delivered media content. Based on the foregoing method, the media delivery server can deliver the to-be-delivered media content to the UE through the response message of the request message.

[0024] In a possible implementation, if it is determined, according to the call service human-computer interaction environment indication information, that the media content is not to be delivered to the UE during the call service, the method further includes: sending a response message of the request message to the UE, the response message including first indication information, the first indication information being used to indicate that the media content is not to be delivered to the UE during the call service. Based on the foregoing method, in a case where it is determined that the media content is not to be delivered to the UE during the call service, the media delivery server can indicate, through the first indication information, that the media content is not to be delivered to the UE, so that the UE determines that the to-be-delivered media content does not need to be received.

[0025] In a possible implementation, after determining the to-be-delivered media content according to the call service human-computer interaction environment indication information, the method further includes: establishing a media channel according to the to-be-delivered media content, the type of the media channel including an audio media channel or a video media channel, the audio media channel being used for transmitting media content in an audio form and / or being used for transmitting voice information between UEs corresponding to the call service during call service performance, and the video media channel being used for transmitting media content in a video form; and delivering the to-be-delivered media content to the UE during the call service performance, including: delivering the to-be-delivered media content to the UE through the media channel during the call service performance. Based on the foregoing method, the media delivery server can deliver the to-be-delivered media content to the UE through the media channel.

[0026] In a possible implementation, before determining the to-be-delivered media content according to the call service human-computer interaction environment indication information, the method further includes: establishing a media channel according to the call service, the type of the media channel including an audio media channel or a video media channel, the audio media channel being used for transmitting media content in an audio form and / or being used for transmitting voice information between UEs corresponding to the call service during call service performance, and the video media channel being used for transmitting media content in a video form. Based on the foregoing method, the media delivery server can establish a media channel for the call service between UEs before determining the to-be-delivered content.

[0027] In a possible implementation, after determining the to-be-delivered media content according to the call service human-computer interaction environment indication information, the method further includes: if the media channel cannot transmit the to-be-delivered media content, switching the media channel; and delivering the to-be-delivered media content to the UE during the call service performance, including: delivering the to-be-delivered media content to the UE through the switched media channel during the call service performance. Based on the foregoing method, in a case where the established media channel is not suitable, the to-be-delivered media content can be delivered through a switched media channel.

[0028] In a possible implementation, if the media channel can transmit the to-be-delivered media content, delivering the to-be-delivered media content to the UE during the call service performance, including: delivering the to-be-delivered media content to the UE through the media channel during the call service performance. Based on the foregoing method, in a case where the established media channel is suitable, the to-be-delivered media content can be delivered through the established media channel.

[0029] In a possible implementation, if it is determined according to the call service man-machine interaction environment indication information that the media content is not to be put to the UE during the call service, the method further includes: establishing a media channel according to the call service, the type of the media channel including an audio media channel or a video media channel, the audio media channel being used to transmit media content in an audio form and / or being used to transmit voice information between UEs corresponding to the call service during the call service, and the video media channel being used to transmit media content in a video form. Based on the method, the media putting server can establish a media channel for the call service between the UEs.

[0030] In a second aspect, an embodiment of the present application provides a media content putting method, which can be applied to a UE, and the method includes: obtaining call service man-machine interaction environment indication information, the call service man-machine interaction environment indication information indicating a man-machine interaction environment of a user corresponding to the UE during a call service; sending the call service man-machine interaction environment indication information to a media putting server; and receiving media content to be put sent by the media putting server, and presenting the media content to be put through a program unit related to a call program.

[0031] Based on the method, the UE can send the call service man-machine interaction environment indication information to the media putting server, so that the media putting server can determine the media content to be put according to the indication information. The man-machine interaction environment indicated by the call service man-machine interaction environment indication information can reflect the current state of the user, for example, whether the user is looking at the screen of the UE, whether the user is suitable for watching or listening to the media content, and the like. Therefore, the media content to be put determined according to the call service man-machine interaction environment indication information is more in line with the needs of the user, and the UE presenting the media content in line with the needs of the user can improve the user experience and the putting effect of the media content.

[0032] Alternatively, in the second aspect, an embodiment of the present application provides a media content putting method, which can be applied to a UE, and the method includes: obtaining call service man-machine interaction environment indication information, the call service man-machine interaction environment indication information indicating a man-machine interaction environment of a user corresponding to the UE during a call service; sending the call service man-machine interaction environment indication information to a media putting server; and determining not to present the media content.

[0033] Based on the above method, the UE can send the call service human-computer interaction environment indication information to the media delivery server, so that the media delivery server can determine not to deliver media content to the UE during the call service. The human-computer interaction environment indicated by the call service human-computer interaction environment indication information can reflect the current state of the user, for example, whether the user is looking at the screen of the UE, whether the user is suitable for watching or listening to media content, and the like. Therefore, the media delivery server can not deliver media content to the UE in the case of being unsuitable for delivering media content to the UE, thereby improving the user experience, and reducing or avoiding the consumption of data flow of the UE, and saving air interface resources.

[0034] In a possible implementation, the call service human-computer interaction environment indication information is obtained by at least one of the following: detecting whether the screen of the UE is on; or detecting whether the interface of the call program of the UE is visible; or detecting whether the hands-free function of the UE is turned on; or detecting whether the wired earphone of the UE is plugged in; or detecting whether the wireless earphone of the UE is connected; or detecting whether the user is within the visual range of the UE. Based on the above method, the UE can detect any one of the following: whether the screen of the UE is on, whether the interface of the call program of the UE is visible, whether the hands-free function of the UE is turned on, whether the wired earphone of the UE is plugged in, whether the wireless earphone of the UE is connected, or whether the user is within the visual range of the UE, and then obtain the call service human-computer interaction environment indication information.

[0035] In a possible implementation, the call service human-computer interaction environment indication information is sent to the media delivery server, including: sending a SIP-info message to the media delivery server, the SIP-info message including the call service human-computer interaction environment indication information. Based on the above method, the UE can send the call service human-computer interaction environment indication information to the media delivery server through the SIP-info message.

[0036] In a possible implementation, the call service human-computer interaction environment indication information is sent to the media delivery server, including: sending a SIP-Notifiication message to the media delivery server, the SIP-Notifiication message including the call service human-computer interaction environment indication information; before sending the call service human-computer interaction environment indication information to the media delivery server, the method further includes: receiving a subscription message from the media delivery server, the subscription message being used to subscribe to the call service human-computer interaction environment indication information. Based on the above method, the UE can send the call service human-computer interaction environment indication information to the media delivery server through the SIP-Notifiication message based on the subscription message of the media delivery server.

[0037] In a possible implementation, the call service man-machine interaction environment indication information is sent to the media delivery server, including: sending a request message for requesting media content to the media delivery server, and the request message for requesting media content includes the call service man-machine interaction environment indication information. Based on the method, the UE can send the call service man-machine interaction environment indication information to the media delivery server through the request message for requesting media content.

[0038] In a possible implementation, the media content to be delivered is received from the media delivery server, including: receiving a response message of the request message sent by the media delivery server, and the response message includes the media content to be delivered. Based on the method, the UE can receive the media content to be delivered through the response message of the request message.

[0039] In a possible implementation, it is determined that the media content is not presented, including: receiving first indication information sent by the media delivery server, the first indication information being used to indicate that the media content is not delivered to the UE during the call service; determining that the media content is not presented according to the first indication information; or, no indication information about presenting the media content sent by the media delivery server is received within a preset time range, and it is determined that the media content is not presented. Based on the method, the UE can determine that the media content is not presented in multiple ways.

[0040] In a possible implementation, if the call service man-machine interaction environment indication information is included in the request message for requesting media content, the first indication information sent by the media delivery server is received, including: receiving a response message of the request message sent by the media delivery server, and the response message includes the first indication information. Based on the method, the UE can receive the first indication information through the response message of the request message.

[0041] In a third aspect, an embodiment of the present application provides a media content delivery method, which can be applied to a UE, and the method includes: determining a call service man-machine interaction environment, the call service man-machine interaction environment being a man-machine interaction environment of a user corresponding to the UE during a call service; determining a media form according to the call service man-machine interaction environment; sending indication information of the media form to a media delivery server; and receiving media content conforming to the media form sent by the media delivery server, and presenting the media content through a program unit related to a call program.

[0042] Based on the method, the UE can determine the media form according to the call service human-computer interaction environment, and indicate the media form to the media delivery server, so that the media delivery server can deliver media content conforming to the media form to the UE. The call service human-computer interaction environment can reflect the current state of the user, for example, whether the user is looking at the screen of the UE, whether the user is suitable for watching or listening to media content, and the like. Therefore, the media form determined according to the call service human-computer interaction environment is more in line with the needs of the user, and the user experience and the delivery effect of the media content can be improved. In addition, compared with the method provided in the second aspect, the UE can not send call service human-computer interaction environment indication information to the media delivery server, so as to protect the privacy of the user and improve the information security.

[0043] Alternatively, in a third aspect, an embodiment of the present application provides a method for delivering media content, which can be applied to a UE, and the method comprises: determining a call service human-computer interaction environment, the call service human-computer interaction environment being a human-computer interaction environment of a user corresponding to the UE during a call service; and determining not to present media content during the call service according to the call service human-computer interaction environment.

[0044] Based on the method, the UE can determine not to present media content during the call service according to the call service human-computer interaction environment. The call service human-computer interaction environment can reflect the current state of the user, for example, whether the user is looking at the screen of the UE, whether the user is suitable for watching or listening to media content, and the like. Therefore, in the case that the UE is not suitable for presenting media content, for example, in the case that the user is not looking at the screen or the user is not suitable for watching or listening to media content, the media content is not presented, and the user experience is improved. In addition, compared with the method provided in the second aspect, the UE can not send call service human-computer interaction environment indication information to the media delivery server, so as to protect the privacy of the user and improve the information security.

[0045] In a possible implementation, determining the call service human-computer interaction environment comprises at least one of the following: detecting whether the screen of the UE is on; or detecting whether the interface of the call program of the UE is visible; or detecting whether the hands-free function of the UE is turned on; or detecting whether the wired earphone of the UE is plugged in; or detecting whether the wireless earphone of the UE is connected; or detecting whether the user is within the visual range of the UE. Based on the method, the UE can detect any one of the following: whether the screen of the UE is on, whether the interface of the call program of the UE is visible, whether the hands-free function of the UE is turned on, whether the wired earphone of the UE is plugged in, whether the wireless earphone of the UE is connected, or whether the user is within the visual range of the UE, and then determine the call service human-computer interaction environment.

[0046] In a possible implementation, the media form is determined according to a call service human-computer interaction environment, including: if any of the following environments is detected, the media form is determined as an audio form: it is detected that a screen of the UE is turned off; or, it is detected that the screen of the UE is turned on, and an interface of a call program of the UE is invisible; or, it is detected that the screen of the UE is turned on, a wired earphone of the UE is plugged in, and a user is not within a visual range of the UE; or, it is detected that the screen of the UE is turned on, a wireless earphone of the UE is connected, and the user is not within the visual range of the UE. Based on the foregoing method, the UE can determine the media form as the audio form in a case where the call service human-computer interaction environment is suitable for the user to listen to sound played by the UE, and indicate the media form to a media delivery server. In this case, the media delivery server does not deliver media content in a video form to the UE, which can improve user experience, and reduce or avoid consumption of data traffic of the UE and save air interface resources.

[0047] In a possible implementation, the media form is determined according to a call service human-computer interaction environment, including: if any of the following environments is detected, the media form is determined as a voiced video form: it is detected that the screen of the UE is turned on, an interface of a call program of the UE is visible, and a wired earphone of the UE is plugged in; or, it is detected that the screen of the UE is turned on, the interface of the call program of the UE is visible, and a wireless earphone of the UE is connected; or, it is detected that the screen of the UE is turned on, the interface of the call program of the UE is visible, the wireless earphone of the UE is connected, and a user is within a visual range of the UE; or, it is detected that the screen of the UE is turned on, the interface of the call program of the UE is visible, the wired earphone of the UE is plugged in, and the user is within the visual range of the UE. Based on the foregoing method, if the call service human-computer interaction environment is suitable for the user to watch video played by the UE, the UE can determine the media form as the voiced video form.

[0048] In a possible implementation, the media form is determined according to a call service human-computer interaction environment, including: if it is detected that the screen of the UE is turned on, an interface of a call program of the UE is visible, and a hands-free function of the UE is turned on, the media form is determined as a voiceless video form. Based on the foregoing method, if the call service human-computer interaction environment is suitable for the user to watch video played by the UE, but the call service human-computer interaction environment is not suitable for the UE to play external sound, the UE can determine the media form as the voiceless video form.

[0049] In a possible implementation, the media form is determined according to a call service human-computer interaction environment, including: if any of the following conditions is detected, the media form is determined as a low sound video form: a wired earphone of the UE is detected to be plugged in; or, a wireless earphone of the UE is detected to be connected; or, the screen of the UE is detected to be on, the interface of the call program of the UE is detected to be visible, the speakerphone function of the UE is detected to be off, the wired earphone of the UE is detected to be unplugged, the wireless earphone of the UE is detected to be unconnected, and the user is detected to be within the visual range of the UE. Based on the method, if the call service human-computer interaction environment is suitable for the user to watch the video played by the UE, but the call service human-computer interaction environment is not suitable for the UE to play the sound too loud, the UE can determine the media form as the low sound video form.

[0050] In a possible implementation, the media content is not presented during the call service according to the call service human-computer interaction environment, including: if any of the following conditions is detected, the media content is not presented during the call service: the screen of the UE is detected to be off; or, the screen of the UE is detected to be on, and the interface of the call program of the UE is detected to be invisible; or, the screen of the UE is detected to be on, the wired earphone of the UE is detected to be plugged in, and the user is detected to be out of the visual range of the UE; or, the screen of the UE is detected to be on, the wireless earphone of the UE is detected to be connected, and the user is detected to be out of the visual range of the UE. Based on the method, the UE can not present the media content in the case that the call service human-computer interaction environment is not suitable for the media content.

[0051] In a fourth aspect, an embodiment of the present application provides a media content delivery method, which can be applied to a UE, and the method includes: obtaining information of media content; determining a call service human-computer interaction environment, which is a human-computer interaction environment of a user corresponding to the UE during a call service; determining a media form according to the call service human-computer interaction environment, and presenting, through a program unit related to a call program, media content in the information of the media content, which conforms to the media form.

[0052] Based on the method, the UE can first acquire the information of the media content, determine the call service human-computer interaction environment, and then determine the media form according to the call service human-computer interaction environment. In this way, the UE can present the media content conforming to the media form in the information of the media content after determining the media form. On one hand, the call service human-computer interaction environment can reflect the current state of the user, for example, whether the user is looking at the screen of the UE, whether the user is suitable for watching or listening to the media content, and the like. Therefore, the media form determined according to the call service human-computer interaction environment is more in line with the needs of the user, and the user experience and the delivery effect of the media content can be improved. On the other hand, after determining the media form, the UE does not need to request the media content from the media delivery server, but directly determines the media content conforming to the media form locally and presents the media content, so that the media content can be presented in time, and the time from determining the media form by the UE to presenting the media content by the UE is reduced. Moreover, compared with the method provided in the second aspect, the UE can not send the call service human-computer interaction environment indication information to the media delivery server, the privacy of the user is protected, and the information security is improved.

[0053] Alternatively, in a fourth aspect, an embodiment of the present application provides a media content delivery method, which can be applied to a UE, and the method comprises: acquiring information of media content; determining a call service human-computer interaction environment, which is a human-computer interaction environment of a user corresponding to the UE during call service; and determining not to present the media content during the call service according to the call service human-computer interaction environment.

[0054] Based on the method, the UE can first acquire the information of the media content, determine the call service human-computer interaction environment, and then determine the media form according to the call service human-computer interaction environment. In this way, the UE can present the media content conforming to the media form in the information of the media content after determining the media form. On one hand, the call service human-computer interaction environment can reflect the current state of the user, for example, whether the user is looking at the screen of the UE, whether the user is suitable for watching or listening to the media content, and the like. Therefore, the media form determined according to the call service human-computer interaction environment is more in line with the needs of the user, and the user experience and the delivery effect of the media content can be improved. On the other hand, after determining the media form, the UE does not need to request the media content from the media delivery server, but directly determines the media content conforming to the media form locally and presents the media content, so that the media content can be presented in time, and the time from determining the media form by the UE to presenting the media content by the UE is reduced. Moreover, compared with the method provided in the second aspect, the UE can not send the call service human-computer interaction environment indication information to the media delivery server, the privacy of the user is protected, and the information security is improved.

[0055] In a possible implementation, determining the call service human-machine interaction environment comprises at least one of the following: detecting whether the screen of the UE is on; or, detecting whether the interface of the call program of the UE is visible; or, detecting whether the hands-free function of the UE is on; or, detecting whether the wired earphone of the UE is plugged in; or, detecting whether the wireless earphone of the UE is connected; or, detecting whether the user is within the visual range of the UE. Based on the foregoing method, the UE can detect any one of the following: whether the screen of the UE is on, whether the interface of the call program of the UE is visible, whether the hands-free function of the UE is on, whether the wired earphone of the UE is plugged in, whether the wireless earphone of the UE is connected, or whether the user is within the visual range of the UE, and determine the call service human-machine interaction environment.

[0056] In a possible implementation, determining the media form according to the call service human-machine interaction environment comprises: if any one of the following environments is detected, determining that the media form is an audio form: detecting that the screen of the UE is off; or, detecting that the screen of the UE is on and the interface of the call program of the UE is invisible; or, detecting that the screen of the UE is on, the wired earphone of the UE is plugged in, and the user is not within the visual range of the UE; or, detecting that the screen of the UE is on, the wireless earphone of the UE is connected, and the user is not within the visual range of the UE. Based on the foregoing method, the UE can determine that the media form is an audio form in a case where the call service human-machine interaction environment is suitable for the user to listen to the sound played by the UE.

[0057] In a possible implementation, determining the media form according to the call service human-machine interaction environment comprises: if any one of the following environments is detected, determining that the media form is a video with sound form: detecting that the screen of the UE is on, the interface of the call program of the UE is visible, and the wired earphone of the UE is plugged in; or, detecting that the screen of the UE is on, the interface of the call program of the UE is visible, and the wireless earphone of the UE is connected; or, detecting that the screen of the UE is on, the interface of the call program of the UE is visible, the wireless earphone of the UE is connected, and the user is within the visual range of the UE; or, detecting that the screen of the UE is on, the interface of the call program of the UE is visible, the wired earphone of the UE is plugged in, and the user is within the visual range of the UE. Based on the foregoing method, if the call service human-machine interaction environment is suitable for the user to watch the video played by the UE, the UE can determine that the media form is a video with sound form.

[0058] In a possible implementation, determining the media form according to the call service human-machine interaction environment comprises: if it is detected that the screen of the UE is on, the interface of the call program of the UE is visible, and the hands-free function of the UE is on, determining that the media form is a video without sound form. Based on the foregoing method, if the call service human-machine interaction environment is suitable for the user to watch the video played by the UE, but the call service human-machine interaction environment is not suitable for the UE to play the external sound, the UE can determine that the media form is a video without sound form.

[0059] In a possible implementation, the media form is determined according to a call service human-computer interaction environment, including: if any of the following environments is detected, the media form is determined as a low sound and video form: a wired earphone of the UE is detected to be plugged in; or, a wireless earphone of the UE is detected to be connected; or, a screen of the UE is detected to be lighted up, an interface of a call program of the UE is detected to be visible, a hands-free function of the UE is detected to be turned off, the wired earphone of the UE is detected to be unplugged, the wireless earphone of the UE is detected to be unconnected, and a user is detected to be within a visual range of the UE. Based on the foregoing method, if the call service human-computer interaction environment is suitable for the user to watch a video played by the UE, but the call service human-computer interaction environment is not suitable for the UE to play too loud sound, the UE can determine the media form as the low sound and video form.

[0060] In a possible implementation, it is determined that media content is not presented during a call service according to a call service human-computer interaction environment, including: if any of the following environments is detected, it is determined that the media content is not presented during the call service: the screen of the UE is detected to be turned off; or, the screen of the UE is detected to be lighted up, and the interface of the call program of the UE is detected to be invisible; or, the screen of the UE is detected to be lighted up, the wired earphone of the UE is detected to be plugged in, and the user is detected to be out of the visual range of the UE; or, the screen of the UE is detected to be lighted up, the wireless earphone of the UE is detected to be connected, and the user is detected to be out of the visual range of the UE. Based on the foregoing method, the UE can not present the media content in a case where the call service human-computer interaction environment is not suitable for the media content to be presented.

[0061] In a fifth aspect, an embodiment of the present application provides a media delivery server, which comprises: a transceiver module and a processing module; the transceiver module is configured to receive call service human-computer interaction environment indication information sent by a UE, the call service human-computer interaction environment indication information indicating a human-computer interaction environment of a user corresponding to the UE during a call service; the processing module is configured to determine to-be-delivered media content according to the call service human-computer interaction environment indication information; and the transceiver module is further configured to deliver the to-be-delivered media content to the UE during the call service.

[0062] Alternatively, in the fifth aspect, an embodiment of the present application provides a media delivery server, which comprises: a transceiver module and a processing module; the transceiver module is configured to receive call service human-computer interaction environment indication information sent by a UE, the call service human-computer interaction environment indication information indicating a human-computer interaction environment of a user corresponding to the UE during a call service; and the processing module is configured to determine not to deliver media content to the UE during the call service according to the call service human-computer interaction environment indication information.

[0063] In a possible implementation, the human-machine interaction environment includes any one or any combination of the following: whether the screen of the UE is lit up, whether the interface of the call program of the UE is visible, whether the hands-free function of the UE is turned on, whether the wired earphone of the UE is plugged in, whether the wireless earphone of the UE is connected, or whether the user is within the visual range of the UE.

[0064] In a possible implementation, the processing module is specifically configured to determine the media form according to the human-machine interaction environment indication information of the call service, the media form including an audio form, a silent video form, a voiced video form, or a low-volume video form, and the default volume of media content in the low-volume video form being greater than 0 and less than a preset threshold; and the processing module is further specifically configured to determine the media content conforming to the media form as the media content to be played.

[0065] In a possible implementation, the processing module is specifically configured to determine the media form as the audio form if any one of the following conditions is met: the human-machine interaction environment indication information indicates that the screen of the UE is turned off, or the human-machine interaction environment indication information indicates that the screen of the UE is lit up and the interface of the call program of the UE is invisible, or the human-machine interaction environment indication information indicates that the screen of the UE is lit up, the wired earphone of the UE is plugged in, and the user is not within the visual range of the UE, or the human-machine interaction environment indication information indicates that the screen of the UE is lit up, the wireless earphone of the UE is connected, and the user is not within the visual range of the UE.

[0066] In a possible implementation, the processing module is specifically configured to determine the media form as the voiced video form if any one of the following conditions is met: the human-machine interaction environment indication information indicates that the screen of the UE is lit up, the interface of the call program of the UE is visible, and the wired earphone of the UE is plugged in; or the human-machine interaction environment indication information indicates that the screen of the UE is lit up, the interface of the call program of the UE is visible, and the wireless earphone of the UE is connected; or the human-machine interaction environment indication information indicates that the screen of the UE is lit up, the interface of the call program of the UE is visible, the wireless earphone of the UE is connected, and the user is within the visual range of the UE; or the human-machine interaction environment indication information indicates that the screen of the UE is lit up, the interface of the call program of the UE is visible, the wired earphone of the UE is plugged in, and the user is within the visual range of the UE.

[0067] In a possible implementation, the processing module is specifically configured to determine the media form as the silent video form if the human-machine interaction environment indication information indicates that the screen of the UE is lit up, the interface of the call program of the UE is visible, and the hands-free function of the UE is turned on.

[0068] In a possible implementation, the processing module is specifically configured to determine that the media form is a bass video form if any of the following conditions is met: the call service man-machine interactive environment indication information indicates that a wired earphone of the UE is plugged in; or, the call service man-machine interactive environment indication information indicates that a wireless earphone of the UE is connected; or, the call service man-machine interactive environment indication information indicates that a screen of the UE is on, an interface of a call program of the UE is visible, a hands-free function of the UE is off, the wired earphone of the UE is not plugged in, the wireless earphone of the UE is not connected, and a user is within a visual range of the UE.

[0069] In a possible implementation, the processing module is specifically configured to determine that the media content to be delivered is media content for delivering media information through voice if any of the following conditions is met: the call service man-machine interactive environment indication information indicates that a screen of the UE is off; or, the call service man-machine interactive environment indication information indicates that the screen of the UE is on and an interface of a call program of the UE is invisible; or, the call service man-machine interactive environment indication information indicates that the screen of the UE is on, a wired earphone of the UE is plugged in, and the user is not within a visual range of the UE; or, the call service man-machine interactive environment indication information indicates that the screen of the UE is on, a wireless earphone of the UE is connected, and the user is not within the visual range of the UE.

[0070] In a possible implementation, the processing module is specifically configured to determine that the media content to be delivered is media content for delivering information through image if any of the following conditions is met: the call service man-machine interactive environment indication information indicates that a screen of the UE is on, an interface of a call program of the UE is visible, and a hands-free function of the UE is off; or, the call service man-machine interactive environment indication information indicates that the screen of the UE is on, the interface of the call program of the UE is visible, and the hands-free function of the UE is on.

[0071] In a possible implementation, the processing module is specifically configured to determine a group type of the user according to the call service man-machine interactive environment indication information, and determine the media content to be delivered according to the group type.

[0072] In a possible implementation, the processing module is specifically configured to determine not to deliver the media content to the UE during the call service if any of the following conditions is met: the call service man-machine interactive environment indication information indicates that a screen of the UE is off; or, the call service man-machine interactive environment indication information indicates that the screen of the UE is on and an interface of a call program of the UE is invisible; or, the call service man-machine interactive environment indication information indicates that the screen of the UE is on, a wired earphone of the UE is plugged in, and a user is not within a visual range of the UE; or, the call service man-machine interactive environment indication information indicates that the screen of the UE is on, a wireless earphone of the UE is connected, and the user is not within the visual range of the UE.

[0073] In a possible implementation, the transceiver is specifically configured to receive a SIP-info message sent by the UE, the SIP-info message comprising the call service man-machine interactive environment indication information.

[0074] In a possible implementation, the transceiver is specifically configured to receive a SIP-Notifiication message sent by the UE, the SIP-Notifiication message comprising the call service man-machine interactive environment indication information; and the transceiver is further configured to send a subscription message to the UE, the subscription message being used to subscribe to the call service man-machine interactive environment indication information.

[0075] In a possible implementation, the transceiver is specifically configured to receive a request message for requesting media content sent by the UE, the request message for requesting media content comprising the call service man-machine interactive environment indication information.

[0076] In a possible implementation, the transceiver is specifically configured to send a response message of the request message to the UE during the call service, the response message comprising the to-be-delivered media content.

[0077] In a possible implementation, the transceiver is further configured to send a response message of the request message to the UE, the response message comprising first indication information, the first indication information being used to indicate that the media content is not delivered to the UE during the call service.

[0078] In a possible implementation, the processing module is further configured to establish a media channel according to the to-be-delivered media content, the media channel comprising an audio media channel or a video media channel, the audio media channel being used to transmit media content in an audio form and / or being used to transmit voice information between UEs corresponding to the call service during the call service, and the video media channel being used to transmit media content in a video form; and the transceiver is specifically configured to deliver the to-be-delivered media content to the UE through the media channel during the call service.

[0079] In a possible implementation, the processing module is further configured to establish a media channel according to the call service, the media channel comprising an audio media channel or a video media channel, the audio media channel being used to transmit media content in an audio form and / or being used to transmit voice information between UEs corresponding to the call service during the call service, and the video media channel being used to transmit media content in a video form.

[0080] In a possible implementation, the processing module is further configured to switch the media channel if the media channel cannot transmit the to-be-delivered media content; and the transceiver is specifically configured to deliver the to-be-delivered media content to the UE through the switched media channel during the call service.

[0081] In a possible implementation, the transceiver module is specifically configured to deliver the to-be-delivered media content to the UE through the media channel during the call service.

[0082] In a possible implementation, the processing module is further configured to establish the media channel according to the call service, and the media channel includes an audio media channel or a video media channel, the audio media channel is used to transmit media content in an audio form, and / or, the audio media channel is used to transmit voice information between UEs corresponding to the call service during the call service, and the video media channel is used to transmit media content in a video form.

[0083] In a sixth aspect, an embodiment of the present application provides a UE, which includes: a processing module and a transceiver module, the processing module is configured to acquire call service human-computer interaction environment indication information, the call service human-computer interaction environment indication information indicates a human-computer interaction environment of a user corresponding to the UE during a call service; the transceiver module is configured to send the call service human-computer interaction environment indication information to a media delivery server; the transceiver module is further configured to receive to-be-delivered media content sent by the media delivery server; and the processing module is further configured to present the to-be-delivered media content through a program unit related to a call program.

[0084] Alternatively, in the sixth aspect, an embodiment of the present application provides a UE, which includes: a processing module and a transceiver module, the processing module is configured to acquire call service human-computer interaction environment indication information, the call service human-computer interaction environment indication information indicates a human-computer interaction environment of a user corresponding to the UE during a call service; the transceiver module is configured to send the call service human-computer interaction environment indication information to a media delivery server; and the processing module is further configured to determine not to present media content.

[0085] In a possible implementation, the processing module is specifically configured to detect at least one of the following: whether a screen of the UE is lighted; or whether an interface of a call program of the UE is visible; or whether a hands-free function of the UE is turned on; or whether a wired earphone of the UE is plugged in; or whether a wireless earphone of the UE is connected; or whether a user is within a visible range of the UE.

[0086] In a possible implementation, the transceiver module is specifically configured to send a SIP-info message to the media delivery server, the SIP-info message includes the call service human-computer interaction environment indication information.

[0087] In a possible implementation, the transceiver module is specifically configured to send a SIP-Notifiication message to the media delivery server, where the SIP-Notifiication message comprises the call service human-computer interaction environment indication information; and the transceiver module is further configured to receive a subscription message from the media delivery server, where the subscription message is used to subscribe to the call service human-computer interaction environment indication information.

[0088] In a possible implementation, the transceiver module is specifically configured to send a request message for requesting media content to the media delivery server, where the request message for requesting media content comprises the call service human-computer interaction environment indication information.

[0089] In a possible implementation, the transceiver module is specifically configured to receive a response message of the request message sent by the media delivery server, where the response message comprises the media content to be delivered.

[0090] In a possible implementation, the processing module is specifically configured to receive first indication information sent by the media delivery server through the transceiver module, where the first indication information is used to indicate that no media content is delivered to the UE during the call service; and the processing module is further specifically configured to determine not to present the media content according to the first indication information; or,

[0091] The processing module is specifically configured to determine not to present the media content when no indication information about presenting the media content sent by the media delivery server is received within a preset time range.

[0092] In a possible implementation, the transceiver module is specifically configured to receive a response message of the request message sent by the media delivery server, where the response message comprises the first indication information.

[0093] In a seventh aspect, an embodiment of the present application provides a UE, which comprises: a processing module and a transceiver module; the processing module is configured to determine a call service human-computer interaction environment, where the call service human-computer interaction environment is a human-computer interaction environment of a user corresponding to the UE during a call service; the processing module is further configured to determine a media form according to the call service human-computer interaction environment; the transceiver module is configured to send indication information of the media form to a media delivery server; the transceiver module is further configured to receive media content conforming to the media form sent by the media delivery server; and the processing module is further configured to present the media content through a program unit related to a call program.

[0094] Alternatively, in the seventh aspect, an embodiment of the present application provides a UE, which comprises: a processing module; the processing module is configured to determine a call service human-computer interaction environment, where the call service human-computer interaction environment is a human-computer interaction environment of a user corresponding to the UE during a call service; and the processing module is further configured to determine not to present media content during the call service according to the call service human-computer interaction environment.

[0095] In a possible implementation, the processing module is specifically configured to detect at least one of the following: whether a screen of the UE is on; or whether an interface of a call program of the UE is visible; or whether a hands-free function of the UE is on; or whether a wired earphone of the UE is plugged in; or whether a wireless earphone of the UE is connected; or whether a user is within a visual range of the UE.

[0096] In a possible implementation, the processing module is specifically configured to determine that the media form is an audio form if any of the following is detected: the screen of the UE is off; or the screen of the UE is on and the interface of the call program of the UE is invisible; or the screen of the UE is on, the wired earphone of the UE is plugged in, and the user is not within the visual range of the UE; or the screen of the UE is on, the wireless earphone of the UE is connected, and the user is not within the visual range of the UE.

[0097] In a possible implementation, the processing module is specifically configured to determine that the media form is a voiced video form if any of the following is detected: the screen of the UE is on, the interface of the call program of the UE is visible, and the wired earphone of the UE is plugged in; or the screen of the UE is on, the interface of the call program of the UE is visible, and the wireless earphone of the UE is connected; or the screen of the UE is on, the interface of the call program of the UE is visible, the wireless earphone of the UE is connected, and the user is within the visual range of the UE; or the screen of the UE is on, the interface of the call program of the UE is visible, the wired earphone of the UE is plugged in, and the user is within the visual range of the UE.

[0098] In a possible implementation, the processing module is specifically configured to determine that the media form is a voiceless video form if the screen of the UE is on, the interface of the call program of the UE is visible, and the hands-free function of the UE is on.

[0099] In a possible implementation, the processing module is specifically configured to determine that the media form is a low sound video form if any of the following is detected: the wired earphone of the UE is plugged in; or the wireless earphone of the UE is connected; or the screen of the UE is on, the interface of the call program of the UE is visible, the hands-free function of the UE is off, the wired earphone of the UE is not plugged in, the wireless earphone of the UE is not connected, and the user is within the visual range of the UE.

[0100] In a possible implementation, the processing module is specifically configured to determine that the media content is not presented during the call service if any of the following conditions is detected: the screen of the UE is detected to be turned off; or, the screen of the UE is detected to be turned on and an interface of a call program of the UE is invisible; or, the screen of the UE is detected to be turned on, a wired earphone of the UE is detected to be plugged in, and a user is detected to be out of a visual range of the UE; or, the screen of the UE is detected to be turned on, a wireless earphone of the UE is detected to be connected, and the user is detected to be out of the visual range of the UE.

[0101] In an eighth aspect, an embodiment of the present application provides a UE, which comprises: a transceiver module and a processing module; the transceiver module is configured to acquire information of media content; the processing module is configured to determine a call service human-computer interaction environment, the call service human-computer interaction environment being a human-computer interaction environment of a user corresponding to the UE during a call service; and the processing module is further configured to determine a media form according to the call service human-computer interaction environment, and present, through a program unit related to a call program, media content in the information of the media content that conforms to the media form.

[0102] In an eighth aspect, an embodiment of the present application provides a UE, which comprises: a transceiver module and a processing module; the transceiver module is configured to acquire information of media content; the processing module is configured to determine a call service human-computer interaction environment, the call service human-computer interaction environment being a human-computer interaction environment of a user corresponding to the UE during a call service; and the processing module is further configured to determine that the media content is not presented during the call service according to the call service human-computer interaction environment.

[0103] In a possible implementation, the processing module is specifically configured to detect at least one of the following: whether the screen of the UE is turned on; or, whether an interface of a call program of the UE is visible; or, whether a hands-free function of the UE is turned on; or, whether a wired earphone of the UE is plugged in; or, whether a wireless earphone of the UE is connected; or, whether a user is in a visual range of the UE.

[0104] In a possible implementation, the processing module is specifically configured to determine that the media form is an audio form if any of the following conditions is detected: the screen of the UE is detected to be turned off; or, the screen of the UE is detected to be turned on and an interface of a call program of the UE is invisible; or, the screen of the UE is detected to be turned on, a wired earphone of the UE is detected to be plugged in, and a user is detected to be out of a visual range of the UE; or, the screen of the UE is detected to be turned on, a wireless earphone of the UE is detected to be connected, and the user is detected to be out of the visual range of the UE.

[0105] In a possible implementation, the processing module is specifically configured to determine that the media form is a voice video form if any of the following conditions is detected: the screen of the UE is on, the interface of the call program of the UE is visible, and the wired earphone of the UE is plugged in; or the screen of the UE is on, the interface of the call program of the UE is visible, and the wireless earphone of the UE is connected; or the screen of the UE is on, the interface of the call program of the UE is visible, the wireless earphone of the UE is connected, and the user is within the visual range of the UE; or the screen of the UE is on, the interface of the call program of the UE is visible, the wired earphone of the UE is plugged in, and the user is within the visual range of the UE.

[0106] In a possible implementation, the processing module is specifically configured to determine that the media form is a voiceless video form if the screen of the UE is on, the interface of the call program of the UE is visible, and the hands-free function of the UE is turned on.

[0107] In a possible implementation, the processing module is specifically configured to determine that the media form is a low sound video form if any of the following conditions is detected: the wired earphone of the UE is plugged in; or the wireless earphone of the UE is connected; or the screen of the UE is on, the interface of the call program of the UE is visible, the hands-free function of the UE is turned off, the wired earphone of the UE is not plugged in, the wireless earphone of the UE is not connected, and the user is within the visual range of the UE.

[0108] In a possible implementation, the processing module is specifically configured to determine that the media content is not presented during the call service if any of the following conditions is detected: the screen of the UE is off; or the screen of the UE is on, and the interface of the call program of the UE is not visible; or the screen of the UE is on, the wired earphone of the UE is plugged in, and the user is not within the visual range of the UE; or the screen of the UE is on, the wireless earphone of the UE is connected, and the user is not within the visual range of the UE.

[0109] In a ninth aspect, an embodiment of the present application provides a media delivery server, comprising: a processor; the processor is used to be coupled with a memory, and read instructions in the memory, and then execute the method according to the instructions, as described in the first aspect. The media delivery server can be the media delivery server in the first aspect, or an apparatus containing the media delivery server.

[0110] In combination with the ninth aspect, in a possible implementation, the media delivery server further comprises a memory, configured to save necessary program instructions and data.

[0111] In a tenth aspect, an embodiment of the present application provides a UE, comprising: a processor; the processor is configured to couple with a memory, and read instructions in the memory, and perform the method in any one of the second aspect to the fourth aspect according to the instructions. The UE can be the UE in any one of the second aspect to the fourth aspect, or an apparatus comprising the UE.

[0112] In combination with the tenth aspect, in a possible implementation, the UE further comprises a memory, configured to store necessary program instructions and data.

[0113] In an eleventh aspect, an embodiment of the present application provides a media delivery server, comprising: a processor and an interface circuit; the interface circuit is configured to receive computer programs or instructions and transmit to the processor; the processor is configured to execute the computer programs or instructions, so that the media delivery server performs the method in the first aspect.

[0114] In a twelfth aspect, an embodiment of the present application provides a UE, comprising: a processor and an interface circuit; the interface circuit is configured to receive computer programs or instructions and transmit to the processor; the processor is configured to execute the computer programs or instructions, so that the UE performs the method in any one of the second aspect to the fourth aspect.

[0115] In a thirteenth aspect, an embodiment of the present application provides a computer readable storage medium, which stores instructions, when the instructions run on a computer, the computer can execute the method in any one of the aspects.

[0116] In a fourteenth aspect, an embodiment of the present application provides a computer program product comprising instructions, when the instructions run on a computer, the computer can execute the method in any one of the aspects.

[0117] The technical effects brought by any one of the fifth aspect to the fourteenth aspect or any possible implementation manner of any one of the fifth aspect to the fourteenth aspect can refer to the technical effects brought by any one of the first aspect to the fourth aspect or any possible implementation manner of any one of the first aspect to the fourth aspect, which will not be repeated here.

[0118] In a fifteenth aspect, an embodiment of the present application provides a communication system, comprising the media delivery server for executing the method in the first aspect, and the UE for executing the method in the second aspect, or the communication system comprises the UE for executing the method in the third aspect, or the communication system comprises the UE for executing the method in the fourth aspect. BRIEF DESCRIPTION OF DRAWINGS

[0119] Figure 1 Flowchart of the media content delivery process provided by an embodiment of the present application Figure 1 ;

[0120] Figure 2 Flowchart of the media content delivery process provided by the embodiment of the present application Figure 2 ;

[0121] Figure 3A Communication system architecture provided by the embodiment of the present application Figure 1 ;

[0122] Figure 3B Communication system architecture provided by the embodiment of the present application Figure 2 ;

[0123] Figure 4 Hardware structure of the device provided by the embodiment of the present application

[0124] Figure 5 Flowchart of the media content delivery method provided by the embodiment of the present application Figure 1 ;

[0125] Figure 6A SIP-info message provided by the embodiment of the present application

[0126] Figure 6B SIP-Subscribe message provided by the embodiment of the present application

[0127] Figure 7 Flowchart of the media content delivery method provided by the embodiment of the present application Figure 2 ;

[0128] Figure 8A Image taken by the mobile phone provided by the embodiment of the present application Figure 1 ;

[0129] Figure 8B Image taken by the mobile phone provided by the embodiment of the present application Figure 2 ;

[0130] Figure 9 Flowchart of the media content delivery method provided by the embodiment of the present application

[0131] Figure 10 Flowchart of the media content delivery method provided by the embodiment of the present application Figure 4 ;

[0132] Figure 11 Structure of the media delivery server provided by the embodiment of the present application

[0133] Figure 12 Structure of the UE provided by the embodiment of the present application DETAILED DESCRIPTION

[0134] Before introducing the embodiments of the present application, the related technical terms involved in the embodiments of the present application are explained and described. It should be noted that the explanations and descriptions are for the purpose of making the embodiments of the present application easier to be understood, and should not be regarded as limiting the scope of protection claimed by the embodiments of the present application.

[0135] 1、Call service

[0136] The call service can refer to a voice call service or a video call service between UEs connected through a communication network in a call service in which a UE acts as a caller or a callee. Taking the UE as a caller as an example, the call service can be a voice call service or a video call service in which the UE dials a mobile phone number, a landline number or a customer service center number; or the call service can be a voice call service or a video call service in which the UE calls other UEs through an RTC application. Taking the UE as a callee as an example, the call service can be a voice call service or a video call service in which the UE receives a call from a mobile phone, a landline or a customer service center; or the call service can be a voice call service or a video call service in which the UE receives a call from other UEs through an RTC application.

[0137] 2、Call service process

[0138] The call service process can refer to the entire time range from dialing by a party participating in the call service to the end of the call service (suspension or termination, etc.), which can also be referred to as a "call process" or a "call service process", etc.

[0139] For example, the call service process can include a period from when a user of a calling UE calls a called UE to when the calling UE receives a ringback tone; a period from when the calling UE receives the ringback tone to when the called UE is connected; a period during which the user of the calling UE talks with the user of the called UE; a period from when the call ends to when the user of one UE hangs up before the user of the other UE hangs up; a period from when the user of the calling UE calls the called UE to when the called UE cannot be connected due to reasons such as power-off, insufficient balance or poor network, but before the user of the calling UE hangs up.

[0140] 3、Media content

[0141] The media content can refer to media content suitable for being presented on a UE during a call service process. For example, news, advertisements, recruitment information, scenic pictures, information about a person's life, etc. that are desired to be pushed to the UE during the call service process.

[0142] 4、Media form

[0143] The media form can also be referred to as a form of media content. The media form includes one or more of an audio form, a silent video form, a voiced video form, or a low-voiced video form. Among them, the silent video form, the voiced video form, and the low-voiced video form can be collectively referred to as a video form. The volume of the media content in the silent video form is less than or equal to a first preset threshold. The volume of the media content in the voiced video form is greater than or equal to a second preset threshold. The default volume of the media content in the low-voiced video form is greater than 0 and less than a third preset threshold. For example, the volume of the media content in the low-voiced video form is 10% lower than the volume of the media content in the voiced video form. In the embodiments of the present application, the first preset threshold, the second preset threshold, and the third preset threshold can be the same or different.

[0144] It can be understood that, in the embodiments of the present application, if the media form is an audio form, presenting the media content on the UE can be understood as the UE playing the media content in the audio form. If the media form is a silent video form, a voiced video form, or a low-voiced video form, presenting the media content on the UE can be understood as the UE playing the media content in the video form.

[0145] 5, media content that delivers media information through voice

[0146] The media content that delivers media information through voice can be media content in a video form or media content in an audio form. If the media content that delivers media information through voice is media content in a video form, the media content mainly delivers information through voice in the video, and the image (or picture) in the video can play an auxiliary role in delivering information. Taking a recruitment advertisement as an example, if the recruitment advertisement delivers media information through voice, the user can understand the main information conveyed by the recruitment advertisement by listening to the recruitment advertisement. The media content that delivers media information through voice can also be media content that mainly delivers information through voice, such as epidemic prevention propaganda, traffic safety public service advertisements, and the like.

[0147] 6, media content that delivers information through image

[0148] The media content that delivers information through image can be media content in a video form. The media content mainly delivers information through the image (or picture) in the video, and the sound in the video can play an auxiliary role in delivering information, or the sound in the video does not have a role in delivering information. For example, the media content that delivers information through image can be media content such as a video display effect good car selling advertisement, landscape picture display, sports display, and the like.

[0149] 7, audio media channel and video media channel

[0150] The audio media channel can be used to transmit media content in audio form and / or to transmit voice information between the UEs corresponding to the call service during the call service (e.g., the content of the conversation between the user of UE 1 and the user of UE 2 corresponding to the call service). The video media channel can be used to transmit media content in video form. The audio media channel can also be referred to as an audio media resource channel. The video media channel can also be referred to as a video media resource channel.

[0151] It can be understood that the audio media channel or the video media channel can be established according to a protocol in the conventional technology, for example, a session initiation protocol (SIP). In different protocols, the establishment process of the audio media channel or the video media channel can be different, and specific explanations can be referred to in the conventional technology, which will not be described here.

[0152] In order to facilitate understanding of the technical solutions of the present application, the following will be described with respect to the process of the media resource system (MRS) delivering media content to the UE during the process of the UE calling other UEs by dialing numbers, and the process of the MRS delivering media content to the UE during the process of the UE calling other UEs through an RTC application.

[0153] Please refer to Figure 1 , Figure 1 The flowchart shown in FIG. 1 is a flowchart of the process of the MRS delivering media content in video form to UE A during the process of UE A calling UE B through dialing the number of UE B to perform voice call service. Specifically, the following S101-S147 can be referred to. Figure 1 The method shown in FIG. 1 can be applied to the communication system shown in FIG. 2. Figure 3A The communication system shown in FIG. 2.

[0154] S101: UE A calls UE B.

[0155] For example, the user corresponding to UE A dials the number of UE B to call UE B. The call of UE A to UE B can trigger the call session control function (CSCF) device of the IMS of the caller (i.e., the IMS_CSCF device of the caller) to UE B.

[0156] S102-S103: The IMS_CSCF device of the caller sends a create session invitation request (Invite (SDPa=audio) to a media application server (Media AS). After the Media AS receives the create session invitation request, the Media AS sends a session invitation response message (100 trying) to the IMS_CSCF device of the caller. The create session invitation request can carry a session description protocol (SDP) parameter SDPa=audio to indicate that a voice call service is performed.

[0157] S104-S105: The Media AS sends a create session invitation request (Invite (SDPa=audio) to the IMS_CSCF device of the callee (i.e., UE B). After the IMS_CSCF device of the callee receives the create session invitation request, the IMS_CSCF device of the callee sends a session invitation response message (100 trying) to the Media AS. The create session invitation request can carry the SDP parameter SDPa=audio.

[0158] S106-S111: The IMS_CSCF device of the callee sends a request media negotiation message (183 (SPDb=audio) to the Media AS. After the Media AS receives the request media negotiation message, the Media AS sends the request media negotiation message (183 (SPDb=audio) to the IMS_CSCF device of the caller. The request media negotiation message can carry an SDP parameter SPDb=audio to request to establish an audio media channel between the MRS and the UE A. After the IMS_CSCF device of the caller receives the request media negotiation message, the IMS_CSCF device of the caller sends a request media negotiation response message (PRACK) to the Media AS. After the Media AS receives the request media negotiation response message, the Media AS sends the request media negotiation response message to the IMS_CSCF device of the callee to respond to the IMS_CSCF device of the callee. After the IMS_CSCF device of the callee receives the request media negotiation response message, the IMS_CSCF device of the callee sends an acknowledgement response message (200 ok) to the Media AS. After the Media AS receives the acknowledgement response message, the Media AS sends the acknowledgement response message (200 ok) to the IMS_CSCF device of the caller to acknowledge that the IMS_CSCF device of the caller is connected.

[0159] S112-S116: The IMS_CSCF device of the caller sends an update media status (update) message to the Media AS. After the Media AS receives the update media status message, it sends an update media status message to the IMS_CSCF device of the callee to establish an audio media channel between the MRS and the UE A. After the IMS_CSCF device of the callee receives the update media status message, it sends an acknowledgement response message (200 ok) to the Media AS. After the Media AS receives the acknowledgement response message, it sends the acknowledgement response message to the IMS_CSCF device of the caller. At this time, the audio media channel is successfully established. Subsequently, the IMS_CSCF device of the callee sends a ring (180 Ring (SDP)) message to the Media AS, and the UE B starts ringing.

[0160] S117-S124: The Media AS sends a create session invitation request (Invite (SDPb=audio)) to the MRS. The create session invitation request can carry an SDP parameter SDPb=audio. After the MRS receives the create session invitation request, it sends a session invitation answer message (100 trying) to the Media AS. Subsequently, the MRS sends an acknowledgement response message (200 ok (SDPm=audio)) to the Media AS. The acknowledgement response message can carry an SDP parameter SDPm=audio. After the Media AS receives the acknowledgement response message, it sends a re-negotiation (Re-INVITE) message to the MRS. After the MRS receives the re-negotiation message, it sends an acknowledgement response message (200 ok (SDPm=video)) to the Media AS. The acknowledgement response message can carry an SDP parameter SDPm=video. After the Media AS receives the acknowledgement response message, it sends an update media status (update (SDPm=video)) message to the IMS_CSCF device of the caller. The update media status message can carry an SDP parameter SDPm=video. After the IMS_CSCF device of the caller receives the update media status message, it sends an acknowledgement response message (200 ok (SDPb=video)) to the Media AS. The acknowledgement response message can carry an SDP parameter SDPb=video. After the Media AS receives the acknowledgement response message, it sends a response acknowledgement message (acknowledgement, ACK) to the MRS. The response acknowledgement message can carry an SDP parameter SDPa=video. At this time, the above audio media channel is switched to a video media channel. The switching of the audio media channel to the video media channel can also be described as the change of the audio media channel to the video media channel.

[0161] S125-S130: Media AS sends a request message to the media decision server to obtain the media content delivery policy information. After receiving the request message, the media decision server sends the media content delivery information to the Media AS to indicate the media content to be delivered. After receiving the media content delivery information, the Media AS sends an info message to the MRS to control the MRS to deliver the media content in the form of a video to UE A. The Media AS can also send a ring (180 Ring) message to the calling IMS_CSCF device so that the user of UE A determines that UE B is ringing. After receiving the info message, the MRS sends a confirmation response message (200 OK) to the Media AS and delivers the media content in the form of a video to UE A.

[0162] S131-S142: After the called party answers, the IMS_CSCF device of the called party sends a confirmation response message (200 ok) to the Media AS. After the Media AS receives the confirmation response message, the Media AS sends a response confirmation message (ACK) to the IMS_CSCF device of the called party. The Media AS also sends an end session (BYE) message to the MRS. After the MRS receives the end session message, the MRS sends a confirmation response message (200 ok) to the Media AS. After the Media AS receives the confirmation response message, the Media AS sends a re-negotiation (Re-INVITE) message to the IMS_CSCF device of the called party. After the IMS_CSCF device of the called party receives the re-negotiation message, the IMS_CSCF device of the called party sends a confirmation response message (200 ok (SDPb=audio)) to the Media AS. The confirmation response message can carry the SDP parameter SDPb=audio. After the Media AS receives the confirmation response message, the Media AS sends an update media status (update (SDPb=audio, video=inactive)) message to the IMS_CSCF device of the calling party. The update media status message can carry the SDP parameter SDPb=audio, video=inactive. After the IMS_CSCF device of the calling party receives the update media status message, the IMS_CSCF device of the calling party sends a confirmation response message (200 ok (SDPa=audio)) to the Media AS. The confirmation response message can carry the SDP parameter SDPa=audio. After the Media AS receives the confirmation response message, the Media AS sends a response confirmation message (ACK (SDPa=audio, video=inactive)) to the IMS_CSCF device of the called party. The response confirmation message can carry the SDP parameter SDPa=audio, video=inactive. The Media AS can also send a confirmation response message (200 ok) to the IMS_CSCF device of the calling party. After the IMS_CSCF device of the calling party receives the confirmation response message, the IMS_CSCF device of the calling party sends a response confirmation message (ACK) to the Media AS. At this time, the above-mentioned video media channel is switched to an audio media channel.

[0163] S143-S147: The user of UE A and the user of UE B start a call. After the call is over, the IMS_CSCF device of the caller sends a call end session (BYE) message to the Media AS. After the Media AS receives the end session message, it sends an end session (BYE) message to the IMS_CSCF device of the callee. After the IMS_CSCF device of the callee receives the end session message, it sends an acknowledgement response message (200 ok) to the Media AS. After the Media AS receives the acknowledgement response message, it sends an acknowledgement response message (200 ok) to the IMS_CSCF device of the caller.

[0164] Reference is made to Figure 2 , Figure 2 The flowchart of the method for the MRS to deliver media content to UE A during a voice call service of UE A calling UE B through an RTC application is shown. Specifically, reference is made to the following S201-S226. Figure 2 The method shown can be applied to the communication system shown in the following Figure 3B .

[0165] S201: The RTC application of UE A establishes a connection with a signal server (Signal Server), and the RTC application of UE B establishes a connection with the Signal Server.

[0166] S202-S203: UE A creates a peer connection (Create PeerConnection) and adds streams (AddStreams).

[0167] For example, the RTC application of UE A opens the audio device and the video device of UE A, and determines the parameters of the audio stream or the video stream.

[0168] S204-S209: UE A generates a call offer data (Create Offer), and the RTC application of UE A calls the Signal Server to initiate a request for establishing a call, and sends the call offer data to the Signal Server (Send Offer SDP). The call offer data can indicate whether the current session contains an audio stream or a video stream, and the like. After receiving the call offer data, the Signal Server forwards the call offer data to the RTC application of UE B (Relay Offer SDP). After receiving the call offer data, the RTC application of UE B opens the audio and video devices of UE B, prepares to answer the call offer data (Create Answer), and sends a response message to the Signal Server (Send Answer SDP). After receiving the response message, the Signal Server forwards the response message to UE A (Relay Answer SDP).

[0169] S210-S214: UE A requests an IP address from a network address translation (NAT) session traversal utilities for NAT server (STUN Server) (Ask my Ipaddress). The STUN Server returns allocated channel information to UE A (OnIceCandidate). After receiving the channel information, UE A sends the channel information to the Signal Server (Send candidate). After receiving the channel information, the Signal Server forwards the channel information to UE B (Relay candidate). After receiving the channel information, UE B can add the channel information (AddIceCandidate).

[0170] S215-S218: UE B requests an IP address from the STUN Server (Ask my Ipaddress). The STUN Server returns allocated channel information to UE B (OnIceCandidate). After receiving the channel information, UE B sends the channel information to UE A through the Signal Server (Send candidate). The process of S215-S218 is similar to the process of S210-S213, and thus reference can be made to the description in S210-S213, and details are not described herein.

[0171] S219: UE A and UE B establish an end-to-end (point-to-point, P2P) channel, such as a P2P channel for audio and video transmission.

[0172] S220: UE B Add Stream (OnAddStream).

[0173] S221: UE A and UE B communicate in real time. If UE A and UE B have established a P2P channel for audio and video transmission, then UE A and UE B will communicate in real time for audio and video.

[0174] S222-S224: UE A sends a request message to the media decision server. After receiving the request message, the media decision server decides on the media content to be delivered to UE A and sends the address of the decided media content to UE A.

[0175] S225-S227: UE A requests the media content corresponding to the address of the media content from the MRS based on the address of the media content, and presents the media content after obtaining the media content.

[0176] The embodiments of this application will now be described in detail with reference to the accompanying drawings.

[0177] The method provided in this application can be used in various communication systems. For example, the communication system can be a long-term evolution (LTE) system, a 5th generation (5G) communication system, a wireless-fidelity (WiFi) system, a 3rd generation partnership project (3GPP) related communication system, a future evolution communication system, or a system integrating multiple systems, etc., without limitation. Among them, 5G can also be referred to as new radio (NR). The following uses... Figure 3A and Figure 3B Taking the communication system shown as an example, the method provided in the embodiments of this application will be described.

[0178] like Figure 3A The diagram shown is a schematic representation of the architecture of a communication system provided in an embodiment of this application. Figure 3AThe illustrated communication system can include a media delivery server 303, a UE 301 and a UE 302. Among them, the media delivery server 303, the UE 301 and the UE 302 can be connected through a communication network. The communication network can be an IMS network. The IMS network can be responsible for the routing of call-related signaling messages. Interface with the calling and called UEs and the media delivery server 303. For example, the IMS network can send the media content sent by the media delivery server 303 to the UE 301 or the UE 302; the IMS network can also send the message of the UE 301 or the UE 302 to the media delivery server 303; the IMS network can also transmit messages between the UE 301 and the UE 302.

[0179] Figure 3A The UE in the above, such as the UE 301 or the UE 302, can be a device with call function and media content delivery function. Among them, the UE with call function can be understood as the UE capable of call service. The UE with media content delivery function can be understood as the UE capable of receiving media content and presenting the media content. Exemplarily, Figure 3A The UE in the above can be a handheld device or a wearable device with wireless communication function. For example, Figure 3A The UE in the above can be a mobile phone, a tablet computer or a smart watch, etc. In the embodiment of the application, the UE can also be called a terminal or a terminal device. In the embodiment of the application, the device for realizing the function of the UE can be the UE; or can be a device capable of supporting the UE to realize the function, such as a chip system, which can be installed in the UE or used with the UE. In the embodiment of the application, the chip system can be composed of a chip, or can include a chip and other discrete devices. In the method provided in the embodiment of the application, the device for realizing the function of the UE is taken as an example to describe the method provided in the embodiment of the application. It is uniformly stated here and will not be described again later.

[0180] Figure 3A The media delivery server 303 in the above can receive indication information indicating the human-computer interaction environment of the user corresponding to the UE during the call service, determine whether to deliver media content to the UE during the call service according to the indication information. Or, Figure 3A The media delivery server 303 in the above can receive indication information indicating the human-computer interaction environment of the user corresponding to the UE during the call service, determine the to-be-delivered media content according to the indication information, and deliver the to-be-delivered media content to the UE during the call service.

[0181] It can be understood that the functions of the media delivery server 303 can be deployed on one physical device to improve the cohesiveness of the media delivery server 303, and thus improve the performance of the media delivery server 303. The functions of the media delivery server 303 can also be deployed on multiple physical devices to reduce the requirements for each physical device, so that the functions of the media delivery server 303 are easier to implement.

[0182] Taking the functions of the media delivery server 303 deployed on one physical device as an example, the media delivery server 303 can include a media decision module 3031, a media application module 3032, and a media resource management module 3033. The media application module 3032 can be used to receive the indication information sent by the UE to indicate the human-computer interaction environment of the user corresponding to the UE during the call service. The media decision module 3031 can be used to determine whether to deliver media content to the UE during the call service according to the indication information, or to determine the media content to be delivered according to the indication information. The media resource management module 3033 can be used to deliver the media content to be delivered to the UE during the call service.

[0183] Taking the functions of the media delivery server 303 deployed on multiple physical devices as an example, the functions of the media application module 3032 can be deployed on the Media AS (not shown) to implement the functions of the media application module 3032. The functions of the media decision module 3031 can be deployed on the media decision server (not shown) to implement the functions of the media decision module 3031. The functions of the media resource management module 3033 can be deployed on the MRS (not shown) to implement the functions of the media resource management module 3033. Figure 3A Figure 3A Figure 3B

[0184] As shown in FIG. 6, another architecture of a communication system provided by an embodiment of the present application is shown. Figure 3B As shown in FIG. 6, another architecture of a communication system provided by an embodiment of the present application is shown. Figure 3B As shown in FIG. 6, another architecture of a communication system provided by an embodiment of the present application is shown.

[0185] Figure 3B The UE in the communication system, such as the UE 304 or the UE 305, can be a device installed with an RTC application and having a media content delivery function. The media content delivery function of the UE can be understood as the UE being able to receive media content and present the media content. For example, the UE can be a mobile phone, a tablet computer, a smart watch, or the like. Figure 3B ​​​The UE in this context can be a handheld device, in-vehicle device, wearable device, or computing device with wireless communication capabilities. For example, Figure 3B The UE in this context can be a mobile phone, tablet computer, computer with wireless transceiver capabilities, or smartwatch, etc.

[0186] Figure 3B The media delivery server 306 can receive indication information indicating the human-computer interaction environment of the user corresponding to the UE during a call, and determine whether to deliver media content to the UE during the call based on the indication information. Alternatively, Figure 3B The media delivery server 306 can receive indication information that indicates the human-computer interaction environment of the user corresponding to the UE during the call service, determine the media content to be delivered based on the indication information, and deliver the media content to be delivered to the UE during the call service.

[0187] Understandably, the functions of the media delivery server 306 can be centrally deployed on a single physical device to improve its cohesion and thus its performance. Alternatively, the functions of the media delivery server 306 can be deployed on multiple physical devices to reduce the requirements on each device, making its functionality easier to implement.

[0188] Taking the functions of the media delivery server 306 as an example, which are centrally deployed on a single physical device, the media delivery server 306 may include a media decision module 3061 and a media resource management module 3062. The media decision module 3061 can receive indication information sent by the UE indicating the human-computer interaction environment of the user corresponding to the UE during a call, and determine whether to deliver media content to the UE during the call; alternatively, the media decision module 3061 can receive indication information sent by the UE indicating the human-computer interaction environment of the user corresponding to the UE during a call, and determine the media content to be delivered based on this indication information. The media resource management module 3062 can deliver the media content to be delivered to the UE during the call.

[0189] Taking the media delivery server 306 as an example, whose functions are deployed on multiple physical devices, the media decision module 3061 can be deployed on the media decision server. Figure 3B (Not shown) is used to implement the functions of the media decision module 3061. The functions of the media resource management module 3062 can be deployed on the MRS (Media Resource Management System). Figure 3B (Not shown) is used to implement the functions of the media resource management module 3062.

[0190] Optional, Figure 3AThe illustrated communication system also includes an RTC Server 307. The RTC Server 307 can provide high-availability, high-quality, ultra-low latency voice and video communication services. A UE can integrate instant messaging capabilities based on a software development kit (SDK) provided by the RTC Server 307. The RTC Server 307 can also be responsible for routing of call-related signaling messages. The RTC Server 307 interfaces with the calling and called UEs as well as the media delivery server 306.

[0191] In one possible implementation, the RTC Server 307 can include a STUN Server and a Signal Server. The STUN is a network protocol that allows a client behind a NAT (or multiple NATs) to discover its public address, find out which type of NAT it is behind, and what Internet end port the NAT has bound to its local port. This information is used to create a user datagram protocol (UDP) communication between two hosts that are both behind NAT routers. The STUN Server is a server that handles STUN. The Signal Server is a server that handles RTC signaling. It can be appreciated that the STUN Server and the Signal Server can be deployed on the same physical device or on different physical devices, without limitation.

[0192] It can be appreciated that, Figure 3B or Figure 3A The illustrated communication system is for example only and is not intended to limit the technical solutions of the present application. Those skilled in the art should appreciate that, in a specific implementation process, Figure 3B or Figure 3A The illustrated communication system can also include other devices, and the number of UEs, media delivery servers, and RTC servers can also be determined according to specific needs, without limitation.

[0193] Optionally, each device (such as a media delivery server or a UE, etc.) in the embodiments of the present application Figure 3B or Figure 3A may be a general-purpose device or a special-purpose device, and the embodiments of the present application do not make specific limitations.

[0194] Optionally, each device (such as a media delivery server or a UE, etc.) in the embodiments of the present application Figure 3B or Figure 3AThe functions of each device in the above-mentioned device can be implemented by one device, or can be implemented by multiple devices together, or can be implemented by one or more functional modules in one device, and the embodiments of the present application do not make a specific limitation. It can be understood that the above-mentioned functions can be elements in a hardware device, or software functions running on a special hardware, or a combination of hardware and software, or virtualized functions instantiated on a platform (for example, a cloud platform).

[0195] In a specific implementation, Figure 3B or Figure 4 Each device in the above-mentioned device can adopt the constituent structure shown in Figure 4 or include the components shown in Figure 4 The hardware structure diagram of the device applicable to the embodiments of the present application is shown in Figure 4 The device 40 includes at least one processor 401 and at least one communication interface 404, for implementing the method provided by the embodiments of the present application. The device 40 can also include a communication line 402 and a memory 403.

[0196] The processor 401 can be a general central processing unit (CPU), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits for controlling the execution of programs of the present application.

[0197] The communication line 402 can include a path for transmitting information between the above-mentioned components, such as a bus.

[0198] The communication interface 404 is used for communication with other devices or communication networks. The communication interface 404 can be any transceiver-like device, such as an Ethernet interface, a radio access network (RAN) interface, a wireless local area networks (WLAN) interface, a transceiver, a pin, a bus, or a transceiver circuit, etc.

[0199] The memory 403 may be a read-only memory (ROM) or other type of static storage device capable of storing static information and instructions, random access memory (RAM) or other type of dynamic storage device capable of storing information and instructions, or it may be an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compressed optical discs, laser discs, optical discs, digital universal optical discs, Blu-ray discs, etc.), magnetic disk storage media or other magnetic storage devices, or any other medium capable of carrying or storing desired program code in the form of instructions or data structures and accessible by a computer, but is not limited thereto. The memory may exist independently and be coupled to the processor 401 via communication line 402. The memory 403 may also be integrated with the processor 401. The memory provided in the embodiments of this application may generally be non-volatile.

[0200] The memory 403 stores computer execution instructions involved in the scheme provided in the embodiments of this application, and the processor 401 controls the execution. The processor 401 executes the computer execution instructions stored in the memory 403 to implement the method provided in the embodiments of this application. Alternatively, in the embodiments of this application, the processor 401 may execute the processing-related functions in the method provided in the following embodiments of this application, and the communication interface 404 may be responsible for communicating with other devices or communication networks. The embodiments of this application do not specifically limit this.

[0201] Optionally, the computer execution instructions in the embodiments of this application may also be referred to as application code, and the embodiments of this application do not specifically limit this.

[0202] The coupling in the embodiments of this application is an indirect coupling or communication connection between devices, units, or modules, which can be electrical, mechanical, or other forms, and is used for information interaction between devices, units, or modules.

[0203] As one embodiment, processor 401 may include one or more CPUs, for example Figure 4 CPU0 and CPU1 in the CPU.

[0204] As one embodiment, device 40 may include multiple processors, such as Figure 4The processors 401 and 407 in the device 40 can each be a single-CPU processor or a multi-CPU processor. The processor herein can refer to one or more devices, circuits, and / or processing cores for processing data (e.g., computer program instructions).

[0205] As an embodiment, the device 40 can further include an output device 405 and / or an input device 406. The output device 405 is coupled to the processor 401 and can display information in various ways. For example, the output device 405 can be a liquid crystal display (LCD), a light emitting diode (LED) display device, a cathode ray tube (CRT) display device, a projector, or the like. The input device 406 is coupled to the processor 401 and can receive user input in various ways. For example, the input device 406 can be a mouse, a keyboard, a touch screen device, a sensor device, or the like.

[0206] It can be understood that the constituent structures shown in the device 40 do not constitute a limitation on the device, except that Figure 4 The device can include more or fewer components than shown, or combine certain components, or arrange the components differently than shown. Figure 4 The device can include more or fewer components than shown, or combine certain components, or arrange the components differently than shown.

[0207] The media content delivery method provided by the embodiments of the present application will be described below with reference to the accompanying drawings. Each device in the following embodiments can have the constituent structures shown in the device 40, and details are not described herein. Figure 5 The media content delivery method provided by the embodiments of the present application will be described below with reference to the accompanying drawings. Each device in the following embodiments can have the constituent structures shown in the device 40, and details are not described herein.

[0208] It can be understood that the media content delivery method provided by the embodiments of the present application can be applied to various scenarios. For example, the media content delivery method provided by the embodiments of the present application can be applied to scenarios such as after the calling UE calls the called UE, before the called UE rings (i.e., during the calling UE initiates a call, but the called UE has not yet rung), during the ringing process (i.e., during the calling user hears the ringback tone), during the call (the calling and called parties are in the process of talking), after the call ends (the calling and called parties end the call, one party user hangs up, and the other party user hangs up before), call failure (after the calling UE calls the called UE, the called UE cannot be connected due to reasons such as power off, insufficient balance, or poor network, and before the calling user hangs up), and the like.

[0209] It should be noted that the names of messages between various network elements in the following embodiments of the present application or the names of various parameters in the messages are only examples, and other names can also be used in specific implementations, which are not limited in the embodiments of the present application. It should be noted that the names of messages between various network elements in the following embodiments of the present application or the names of various parameters in the messages are only examples, and other names can also be used in specific implementations, which are not limited in the embodiments of the present application.

[0210] It should be noted that in the embodiments of the present application, "and / or" can be used to describe the relationship between the associated objects, for example, A and / or B, which can represent the following three cases: A exists alone, A and B exist together, B exists alone, where A and B can be singular or plural. In addition, expressions such as "at least one of A, B, and C" or "at least one of A, B, or C" are generally used to represent any one of the following: A exists alone; B exists alone; C exists alone; A and B exist together; A and C exist together; B and C exist together; A, B, and C exist together. The above is an example of A, B, and C with three elements. When there are more elements in the expression, the meaning of the expression can be obtained according to the foregoing rules.

[0211] In order to facilitate the description of the technical solutions of the embodiments of the present application, in the embodiments of the present application, "first", "second" and the like can be used to distinguish functionally identical or similar technical features. The "first", "second" and the like do not limit the quantity and execution order, and the "first", "second" and the like do not necessarily mean different. In the embodiments of the present application, "exemplary" or "for example" is used to represent an example, illustration or description. Any embodiment or design scheme described as "exemplary" or "for example" should not be interpreted as more preferred or more advantageous than other embodiments or design schemes. The use of "exemplary" or "for example" is intended to present the relevant concept in a specific manner, for understanding.

[0212] It should be noted that in the embodiments of the present application, for a technical feature, the technical features in the technical feature are distinguished by "first", "second", "third", "A", "B", "C" and "D". The technical features described by "first", "second", "third", "A", "B", "C" and "D" have no order or size order.

[0213] It can be understood that the same step or step or technical feature with the same function in the embodiments of the present application can be mutually referenced and learned between different embodiments.

[0214] It can be understood that in the embodiments of the present application, the UE and / or the media delivery server can perform part or all of the steps in the embodiments of the present application, and these steps are only examples, and the embodiments of the present application can also perform other steps or various modifications of the steps. In addition, each step can be executed in a different order according to the embodiments of the present application, and it is possible that not all steps in the embodiments of the present application are executed.

[0215] As Figure 3AAs shown, the method for delivering media content provided by the embodiments of the present application includes S501-S505a, or the method for delivering media content includes S501-S502 and S503b.

[0216] S501: The UE acquires the call service human-computer interaction environment indication information.

[0217] The UE can be any UE in Figure 3B or Figure 3A For example, the UE can be the UE 301 or the UE 302 in Figure 3B or the UE can be the UE 304 or the UE 305 in Figure 1 .

[0218] In the embodiments of the present application, the call service human-computer interaction environment indication information can indicate the human-computer interaction environment of the user corresponding to the UE during the call service. The human-computer interaction environment can reflect the current state of the user, for example, whether the user is looking at the screen of the UE, whether the user is suitable for watching or listening to media content, etc. Therefore, the call service human-computer interaction environment can be used by the media delivery server to determine whether it is suitable to deliver media content to the UE during the call service. In the case where it is not suitable to deliver media content to the UE, the media delivery server can not deliver media content to the UE, and in the case where it is suitable to deliver media content to the UE, the media delivery server delivers media content to the UE, thereby improving the user experience and the delivery effect of the media content. Alternatively, the call service human-computer interaction environment can be used by the media delivery server to determine the media content to be delivered. Because the media content to be delivered determined by the media delivery server is determined according to the current state of the user, it meets the needs of the user, and can improve the user experience and the delivery effect of the media content.

[0219] As an example, the human-computer interaction environment can include any one or any combination of the following: whether the screen of the UE is on, whether the interface of the call program of the UE is visible, whether the hands-free function of the UE is on, whether the wired earphone of the UE is plugged in, whether the wireless earphone of the UE is connected, or whether the user is within the visual range of the user equipment.

[0220] In the embodiments of the present application, the call program can be an application program corresponding to the call service. Taking the Android system as an example, the call program can be the Telephony APP on the UE or the RTC software on the UE. The interface of the call program can be the graphical user interface (GUI) of the call program. The interface of the call program of the UE being visible can be understood as the call program of the UE running in the foreground. The interface of the call program of the UE being invisible can be understood as the call program of the UE running in the background.

[0221] In the embodiments of the present application, the wired earphone insertion of the UE can be understood as that the UE is connected with the wired earphone, and the UE can play sound through the wired earphone connected with the UE. The wired earphone non-insertion of the UE can be understood as that the UE is not connected with the wired earphone, and the UE can play sound through the loudspeaker of the UE. It should be noted that the wired earphone of the UE is inserted, but the wired earphone is not used for call service, which can also be considered as the wired earphone non-insertion of the UE.

[0222] In the embodiments of the present application, the wireless earphone connection of the UE can be understood as that the UE is connected with the wireless earphone, and the UE can play sound through the wireless earphone connected with the UE. The wireless earphone non-connection of the UE can be understood as that the UE is not connected with the wireless earphone, and the UE can play sound through the loudspeaker of the UE. The wireless earphone can be a Bluetooth earphone or other Bluetooth device (such as a smart bracelet, a smart watch, etc.) with a call function. It should be noted that the wireless earphone of the UE is connected, but the wireless earphone is not used for call service, which can also be considered as the wireless earphone non-connection of the UE.

[0223] In the embodiments of the present application, the user in the visual range of the UE can be understood as that the user is in the "visual field" range of the screen of the UE, or in other words, the user can see the screen of the UE. The user not in the visual range of the UE can be understood as that the user is out of the "visual field" of the screen of the UE, or in other words, the user cannot see the screen. It can be understood that if the user cannot see the screen, the user can make a call through the wired earphone, the Bluetooth earphone or the like.

[0224] In a possible implementation, the call service man-machine interaction environment indication information can include a plurality of indication information, and each indication information is used to indicate one state included in the man-machine interaction environment.

[0225] For example, the man-machine interaction environment indication information includes at least three indication information, the first indication information can indicate whether the screen of the UE is lighted, the second indication information can indicate whether the interface of the call program of the UE is visible, and the third indication information can indicate whether the hands-free function of the UE is started.

[0226] In a possible implementation, the UE acquires the call service man-machine interaction environment indication information when the call service is about to start or when the call service has started. For example, the call process shown in FIG. 12 can be taken as an example, and S501 can be executed before S125. Figure 2 For example, the call process shown in FIG. 12 can be taken as an example, and S501 can be executed before S125. Figure 7 For example, the call process shown in FIG. 22 can be taken as an example, and S501 can be executed before S222.

[0227] In a possible implementation, the UE can obtain the call service human-computer interaction environment indication information by invoking an application programming interface (API) provided by an operating system of the UE. Optionally, after authorization of a user, the UE obtains the call service human-computer interaction environment indication information by invoking the API provided by the operating system of the UE.

[0228] It can be understood that, for different operating systems (for example, Android, iOS, or Harmony), or for different versions of the same operating system, the process of obtaining the call service human-computer interaction environment indication information by the UE by invoking the API provided by the operating system of the UE is different, and an embodiment of the present application takes Android as an example for description. Specifically, the process of obtaining the call service human-computer interaction environment indication information by the UE by invoking the API provided by the operating system of the UE can be understood with reference to the method shown in Figure 3A , which will not be repeated here.

[0229] S502: The UE sends the call service human-computer interaction environment indication information to the media delivery server. Correspondingly, the media delivery server receives the call service human-computer interaction environment indication information sent by the UE.

[0230] In an embodiment of the present application, if the UE is the UE 301 or the UE 302 in Figure 3A , the media delivery server can be the media delivery server 303 in Figure 3B . If the UE is the UE 304 or the UE 305 in Figure 3B , the media delivery server can be the media delivery server 306 in Figure 3A . The following takes the media delivery server as the media delivery server 303 in Figure 3B and the media delivery server as the media delivery server 306 in Figure 3A as examples to describe the specific process of S502.

[0231] Example 1: The media delivery server is the media delivery server 303 in Figure 6A .

[0232] In a possible implementation, the call service human-computer interaction environment indication information sent by the UE to the media delivery server includes that the UE sends a SIP-info message to the media delivery server. The SIP-info message includes the call service human-computer interaction environment indication information. That is, by extending the SIP-info message, the UE can send the call service human-computer interaction environment indication information to the media delivery server.

[0233] Exemplarily, the UEScrInfo parameter in the Messenger Header can be extended, and the UEScrInfo parameter includes the SCRS, TAPS, HDFS, WEPS, WLES, RLOP and the like as extended parameter filling to realize the function of the call service human-computer interaction environment indication information. The SCRS can indicate whether the screen of the UE is lighted. The TAPS can indicate whether the interface of the call program of the UE is visible. The HDFS can indicate whether the hands-free function of the UE is opened. The WEPS can indicate whether the wired earphone of the UE is inserted. The WLES can indicate whether the wireless earphone of the UE is connected. The RLOP can indicate whether the user is within the visual range of the UE. If the UEScrInfo parameter is as shown in Figure 6B , the UEScrInfo parameter can indicate that the screen of the UE is lighted, the interface of the call program of the UE is visible, the hands-free function of the UE is closed, the wired earphone of the UE is inserted, the wireless earphone of the UE is not connected, and the user is within the visual range of the UE.

[0234] In another possible implementation, the UE sends the call service human-computer interaction environment indication information to the media delivery server, including: the UE sends a Session Initiation Protocol-Notification (SIP-Notifiication) message to the media delivery server. The SIP-Notifiication message includes the call service human-computer interaction environment indication information. In this case, before S502, the UE can receive a subscription (SIP-Subscribe) message from the media delivery server. The subscription message can be used to subscribe to the call service human-computer interaction environment indication information. That is, the media delivery server can subscribe to the call service human-computer interaction environment indication information of the UE, and after the subscription, the UE can send the call service human-computer interaction environment indication information to the media delivery server.

[0235] Exemplarily, the media delivery server can subscribe to the call service human-computer interaction environment indication information of the UE by extending the SIP-Subscribe message. For example, as shown in Figure 3A , in the message header of the SIP-Subscribe message, the ReqScr:request parameter for subscribing to the call service human-computer interaction environment indication information is added to realize the function of subscribing to the call service human-computer interaction environment indication information of the UE.

[0236] As an example, the UE can send the call service man-machine interactive environment indication information to the media delivery server by extending the SIP-Notifiication message. For example, the UEScrInfo parameter is extended in the message header of the SIP-Notifiication message, and the UEScrInfo parameter includes the SCRS, TAPS, HDFS, WEPS, WLES, RLOP and other parameters as extended parameters to fill in, so as to realize the function of the call service man-machine interactive environment indication information. The introduction of the UEScrInfo parameter can refer to the description in the above example.

[0237] As described above, the functions of the media delivery server 303 can be deployed on one physical device or on multiple physical devices. Figure 1 As an example of the communication system shown in FIG. 13, if the functions of the media delivery server 303 are deployed on one physical device, the UE sends the call service man-machine interactive environment indication information to the media application module 3032. Correspondingly, the media application module 3032 receives the call service man-machine interactive environment indication information sent by the UE. Subsequently, the media application module 3032 can send the call service man-machine interactive environment indication information to the media decision module 3031.

[0238] If the functions of the media delivery server 303 are deployed on multiple physical devices, the UE sends the call service man-machine interactive environment indication information to the Media AS. Correspondingly, the Media AS receives the call service man-machine interactive environment indication information sent by the UE. The indication information can be included in the SIP-info message or the SIP-Notifiication message. Subsequently, the Media AS can send the call service man-machine interactive environment indication information to the media decision server. As an example of the flow shown in FIG. 14, the Media AS can send the call service man-machine interactive environment indication information to the media decision server through the request message in S125, that is, the call service man-machine interactive environment indication information can be included in the request message in S125. Figure 3B

[0239] Example 2: The media delivery server is the media delivery server 306 in FIG. 12. Figure 3B

[0240] In a possible implementation, the UE sends the call service man-machine interactive environment indication information to the media delivery server, including: the UE sends a request message for requesting media content to the media delivery server. The request message for requesting media content includes the call service man-machine interactive environment indication information. As an example, the request message for requesting media content is the request message in S222.

[0241] ​​In a possible implementation, the UE communicates with the media delivery server through a hypertext transfer protocol (Http) protocol or a hypertext transfer protocol over secure socket layer (Https). As an example, the call service human-computer interaction environment indication information included in the request message for requesting the media content can be in an extensible markup language (xml), a JavaScript object notation (JSon), or the like. If the call service human-computer interaction environment indication information is in the xml format, the call service human-computer interaction environment indication information can be as follows:

[0242]

[0243] If the call service human-computer interaction environment indication information is in the JSon format, the call service human-computer interaction environment indication information can be as follows:

[0244]

[0245] It can be understood that the call service human-computer interaction environment indication information in the xml format or the JSon format indicates that the screen of the UE is on, the interface of the call program of the UE is visible, the hands-free function of the UE is off, the wired earphone is inserted into the UE, the wireless earphone is connected to the UE, and the user is in the visual range of the UE.

[0246] As described above, the functions of the media delivery server 306 can be deployed on one physical device or on multiple physical devices. For example, as shown in FIG. 3, the functions of the media delivery server 306 are deployed on one physical device. Figure 2 As an example, as shown in FIG. 3, if the functions of the media delivery server 306 are deployed on one physical device, the UE sends the call service human-computer interaction environment indication information to the media decision module 3061. Correspondingly, the media decision module 3061 receives the call service human-computer interaction environment indication information sent by the UE. If the functions of the media delivery server 306 are deployed on multiple physical devices, the UE sends the call service human-computer interaction environment indication information to the media decision server. Correspondingly, the media decision server receives the call service human-computer interaction environment indication information sent by the UE. As an example, as shown in FIG. 4, the UE sends the call service human-computer interaction environment indication information to the media decision server through the request message in S222, that is, the call service human-computer interaction environment indication information can be included in the request message in S222. Figure 3A

[0247] ​It can be understood that, in addition to being sent through the request message for requesting the media content, the call service man-machine interactive environment indication information can also be extended to the SDP offer message in the conventional technology, and the call service man-machine interactive environment indication information is sent through the extended SDP offer message.

[0248] S503a: The media delivery server determines the to-be-delivered media content according to the call service man-machine interactive environment indication information.

[0249] In a possible implementation, the media delivery server can directly determine the to-be-delivered media content according to the call service man-machine interactive environment indication information. Alternatively, the media delivery server can determine the media form according to the call service man-machine interactive environment indication information, and determine the media content conforming to the media form as the to-be-delivered media content. Alternatively, the media delivery server can determine the group type of the user according to the call service man-machine interactive environment indication information, and determine the to-be-delivered media content according to the group type. The above three cases are introduced as follows.

[0250] Case 1: The media delivery server directly determines the to-be-delivered media content according to the call service man-machine interactive environment indication information.

[0251] In case 1, the to-be-delivered media content can be media content for delivering media information through voice or media content for delivering media information through image. The media content for delivering media information through voice or the media content for delivering media information through image are introduced with reference to the above explanation of the related technical terms involved in the embodiments of the present application, and are not described herein.

[0252] It can be understood that, the media delivery server can determine the to-be-delivered media content corresponding to the call service man-machine interactive environment according to different call service man-machine interactive environments. For example, if the call service man-machine interactive environment is suitable for the user to listen to the sound played by the UE, the media delivery server can determine the to-be-delivered media content as the media content for delivering media information through voice. If the call service man-machine interactive environment is suitable for the user to watch the video played by the UE, the media delivery server can determine the to-be-delivered media content as the media content for delivering media information through image. In this way, the media content suitable for the user can be delivered to the UE, and the user experience and the delivery effect of the media content can be improved.

[0253] In a possible implementation, the media delivery server determines the to-be-delivered media content according to the call service man-machine interaction environment indication information, and the determination includes: if any of the following conditions is met, the to-be-delivered media content is determined as the media content that delivers media information through voice: the call service man-machine interaction environment indication information indicates that the screen of the UE is turned off; or the call service man-machine interaction environment indication information indicates that the screen of the UE is turned on and the interface of the call program of the UE is invisible; or the call service man-machine interaction environment indication information indicates that the screen of the UE is turned on, the wired earphone of the UE is plugged in, and the user is not within the visual range of the UE; or the call service man-machine interaction environment indication information indicates that the screen of the UE is turned on, the wireless earphone of the UE is connected, and the user is not within the visual range of the UE.

[0254] As an example, if the man-machine interaction environment indicated by the call service man-machine interaction environment indication information is as shown in Table 1, the media delivery server determines the to-be-delivered media content as the media content that delivers media information through voice. In the embodiments of the present application, " / " indicates that any state is possible, or the call service man-machine interaction environment indication information does not indicate the state, and the unified description is made here and will not be repeated later. As can be seen from Table 1, if the screen of the UE is not turned on, it indicates that the user may not want to watch the screen, so the call service man-machine interaction environment is suitable for the user to listen to the sound played by the UE, and the media delivery server can determine the to-be-delivered media content as the media content that delivers media information through voice. If the screen of the UE is turned on and the interface of the call program of the UE is invisible, it indicates that the user is operating other application programs, although the user may watch the screen, it is not convenient to visually disturb the user, so the call service man-machine interaction environment is suitable for the user to listen to the sound played by the UE, and the media delivery server can determine the to-be-delivered media content as the media content that delivers media information through voice. If the screen of the UE is turned on, the wired earphone of the UE is plugged in (or the wireless earphone of the UE is connected), and the user is not within the visual range of the UE, the possibility of the user watching the screen is small, so the call service man-machine interaction environment is suitable for the user to listen to the sound played by the UE, and the media delivery server can determine the to-be-delivered media content as the media content that delivers media information through voice.

[0255] Table 1

[0256]

[0257] In a possible implementation, the media delivery server determines the to-be-delivered media content according to the call service man-machine interactive environment indication information. The media delivery server determines the to-be-delivered media content as media content for delivering information through an image, if any of the following conditions is met: the call service man-machine interactive environment indication information indicates that the screen of the UE is on, the interface of the call program of the UE is visible, and the hands-free function of the UE is off; or the call service man-machine interactive environment indication information indicates that the screen of the UE is on, the interface of the call program of the UE is visible, and the hands-free function of the UE is on. Specifically, the media delivery server can determine the to-be-delivered media content according to Table 2.

[0258] Table 2

[0259]

[0260]

[0261] In case 2, the media delivery server can determine the media form according to the call service man-machine interactive environment indication information, and determine the media content conforming to the media form as the to-be-delivered media content.

[0262] The media form in case 2 can refer to the above explanation of the related technical terms involved in the embodiments of the present application, and will not be repeated here.

[0263] It can be understood that the media delivery server can determine the media form corresponding to the call service man-machine interactive environment according to different call service man-machine interactive environments. For example, if the call service man-machine interactive environment is suitable for the user to listen to the sound played by the UE, the media delivery server can determine the media form as an audio form. If the call service man-machine interactive environment is suitable for the user to watch the video played by the UE, the media delivery server can determine the media form as a video with sound form. If the call service man-machine interactive environment is suitable for the user to watch the video played by the UE, but the call service man-machine interactive environment is not suitable for the UE to play the external sound, the media delivery server can determine the media form as a video without sound form. If the call service man-machine interactive environment is suitable for the user to watch the video played by the UE, but the call service man-machine interactive environment is not suitable for the UE to play the external sound too loud, the media delivery server can determine the media form as a video with low sound form. Subsequently, the media delivery server determines the media content conforming to the media form as the to-be-delivered media content. In this way, on the one hand, the media content suitable for the user can be delivered to the UE, and the user experience and the delivery effect of the media content can be improved. On the other hand, in the case that the call service man-machine interactive environment is suitable for the user to listen to the sound played by the UE, the media content in the video form will not be delivered to the UE, which can reduce or avoid the consumption of the data flow of the UE and save the air interface resources while improving the user experience.

[0264] In a possible implementation, the media delivery server determines the media form according to the call service man-machine interaction environment indication information, and the determination includes: if any of the following conditions is met, the media form is determined to be an audio form: the call service man-machine interaction environment indication information indicates that the screen of the UE is off, or the call service man-machine interaction environment indication information indicates that the screen of the UE is on and the interface of the call program of the UE is invisible, or the call service man-machine interaction environment indication information indicates that the screen of the UE is on, the wired earphone of the UE is plugged in, and the user is not within the visual range of the UE, or the call service man-machine interaction environment indication information indicates that the screen of the UE is on, the wireless earphone of the UE is connected, and the user is not within the visual range of the UE.

[0265] As an example, if the man-machine interaction environment indicated by the call service man-machine interaction environment indication information is as shown in Table 3, the media delivery server determines that the media form is an audio form. As can be seen from Table 3, if the screen of the UE is not on, it indicates that the user may not want to watch the screen, so the call service man-machine interaction environment is suitable for the user to listen to the sound played by the UE, and the media delivery server can determine that the media form is an audio form. If the screen of the UE is on and the interface of the call program of the UE is invisible, it indicates that the user is operating other application programs, although the user may look at the screen, it is inconvenient to visually disturb the user, so the call service man-machine interaction environment is suitable for the user to listen to the sound played by the UE, and the media delivery server can determine that the media form is an audio form. If the screen of the UE is on, the wired earphone of the UE is plugged in (or the wireless earphone of the UE is connected), and the user is not within the visual range of the UE, the possibility of the user looking at the screen is small, so the call service man-machine interaction environment is suitable for the user to listen to the sound played by the UE, and the media delivery server can determine that the media form is an audio form.

[0266] Table 3

[0267]

[0268]

[0269] In a possible implementation, the media delivery server determines the media form according to the call service man-machine interactive environment indication information, and includes: if any of the following conditions is met, the media form is determined to be a sound video form: the call service man-machine interactive environment indication information indicates that the screen of the UE is on, the interface of the call program of the UE is visible, and the wired earphone of the UE is inserted; or the call service man-machine interactive environment indication information indicates that the screen of the UE is on, the interface of the call program of the UE is visible, and the wireless earphone of the UE is connected; or the call service man-machine interactive environment indication information indicates that the screen of the UE is on, the interface of the call program of the UE is visible, the wireless earphone of the UE is connected, and the user is within the visual range of the UE; or the call service man-machine interactive environment indication information indicates that the screen of the UE is on, the interface of the call program of the UE is visible, the wired earphone of the UE is inserted, and the user is within the visual range of the UE. Specifically, it can be as shown in Table 4.

[0270] Table 4

[0271]

[0272]

[0273] In a possible implementation, the media delivery server determines the media form according to the call service man-machine interactive environment indication information, and includes: if the call service man-machine interactive environment indication information indicates that the screen of the UE is on, the interface of the call program of the UE is visible, and the hands-free function of the UE is turned on, the media form is determined to be a soundless video form. Specifically, it can be as shown in Table 5.

[0274] Table 5

[0275]

[0276]

[0277] In a possible implementation, the media delivery server determines the media form according to the call service man-machine interactive environment indication information, and includes: if any of the following conditions is met, the media form is determined to be a low sound video form: the call service man-machine interactive environment indication information indicates that the wired earphone of the UE is inserted; or the call service man-machine interactive environment indication information indicates that the wireless earphone of the UE is connected; or the call service man-machine interactive environment indication information indicates that the screen of the UE is on, the interface of the call program of the UE is visible, the hands-free function of the UE is turned off, the wired earphone of the UE is not inserted, the wireless earphone of the UE is not connected, and the user is within the visual range of the UE. Specifically, it can be as shown in Table 6.

[0278] Table 6

[0279]

[0280]

[0281] Case 3: The media delivery server can determine the group type of the user according to the call service man-machine interactive environment indication information, and determine the media content to be delivered according to the group type.

[0282] In the embodiment of the application, the group type can be divided according to the age of the user. For example, the group type includes a first group, and the first group can be a youth group. The age of the youth group is greater than or equal to a first value and less than or equal to a second value. The first value and the second value are positive integers, and the first value is less than the second value. For example, the age of the youth group is greater than or equal to 18 years old and less than or equal to 40 years old.

[0283] It can be understood that the media delivery server can determine the group type corresponding to the call service man-machine interactive environment according to different call service man-machine interactive environments. For example, if the call service man-machine interactive environment is suitable for the youth group, the media delivery server can determine that the group type of the user is the youth group. Subsequently, the media delivery server can determine the media content conforming to the group type as the media content to be delivered. In this way, the media content suitable for the group to which the user belongs can be delivered to the UE, and the user experience and the delivery effect of the media content can be improved.

[0284] In a possible implementation, the media delivery server can determine the group type of the user according to the call service man-machine interactive environment indication information, including: if any of the following conditions is true, the group type of the user is determined to be a first group: the call service man-machine interactive environment indication information indicates that the wired earphone of the UE is inserted; or the call service man-machine interactive environment indication information indicates that the wireless earphone of the UE is connected. Specifically, it can be as shown in Table 7.

[0285] Table 7

[0286]

[0287] It can be understood that the above Tables 1-7 are only examples of the media delivery server determining the media content to be delivered according to the call service man-machine interactive environment indication information. In specific applications, the media delivery server can also have other conditions for determining the media content to be delivered according to the call service man-machine interactive environment indication information, and the embodiment of the application is not limited specifically.

[0288] It can be understood that in S503a, in addition to determining the media content to be delivered according to the call service man-machine interactive environment indication information, the media delivery server can also combine the call service man-machine interactive environment indication information with some other information (such as: current time, user tag attribute, etc.) to determine the media content to be delivered, so that the media content to be delivered is more suitable for the user.

[0289] For the above case 1-case 3, if the media delivery server is the media delivery server 303 in Figure 3A and the functions of the media delivery server are deployed in one physical device, the media decision module 3031 determines the to-be-delivered media content according to the call service human-computer interaction environment indication information. If the media delivery server is the media delivery server 303 in Figure 3B and the functions of the media delivery server are deployed in multiple physical devices, the media decision server determines the to-be-delivered media content according to the call service human-computer interaction environment indication information.

[0290] For the above case 1-case 3, if the media delivery server is the media delivery server 306 in Figure 3B and the functions of the media delivery server are deployed in one physical device, the media decision module 3061 determines the to-be-delivered media content according to the call service human-computer interaction environment indication information. If the media delivery server is the media delivery server 306 in Figure 3A and the functions of the media delivery server are deployed in multiple physical devices, the media decision server determines the to-be-delivered media content according to the call service human-computer interaction environment indication information.

[0291] S504a: The media delivery server delivers the to-be-delivered media content to the UE during the call service. Correspondingly, the UE receives the to-be-delivered media content sent by the media delivery server.

[0292] In a possible implementation, the media delivery server sends the to-be-delivered media content to the UE through a media channel during the call service. Wherein, the media channel can be referred to the description of the related technical terms in the above embodiments of the present application, and will not be repeated here.

[0293] It can be understood that the above media channel can be established before S503a or after S503a. If the media channel is established before S503a, the media delivery server can establish the media channel according to the call service before S503a. For example, if the call service is a voice call service, the media delivery server establishes an audio media channel, and if the call service is a video call service, the media delivery server establishes a video media channel. Subsequently, after the media delivery server determines the to-be-delivered media content (i.e. after S503a), if the media channel determined by the media delivery server can transmit the to-be-delivered media content, the media delivery server sends the to-be-delivered media content to the UE through the media channel. If the media channel determined by the media delivery server cannot transmit the to-be-delivered media content, the media delivery server switches the media channel, and sends the to-be-delivered media content to the UE through the switched media channel.

[0294] For example, if the media channel determined by the media delivery server is an audio media channel (or a video media channel), and the media form of the media content to be delivered is an audio form (or a video form) (i.e., the media channel determined by the media delivery server can transmit the media content to be delivered), the media delivery server sends the media content to be delivered to the UE through the media channel.

[0295] For example, if the media channel determined by the media delivery server is an audio media channel, and the media form of the media content to be delivered is not an audio form (i.e., the media channel determined by the media delivery server cannot transmit the media content to be delivered), the media delivery server switches the audio media channel to a video media channel, and sends the media content to be delivered to the UE through the video media channel.

[0296] For example, if the media channel determined by the media delivery server is a video media channel, and the media form of the media content to be delivered is not a video form (i.e., the media channel determined by the media delivery server cannot transmit the media content to be delivered), the media delivery server switches the video media channel to an audio media channel, and sends the media content to be delivered to the UE through the audio media channel.

[0297] It can be understood that if the media channel is established after S503a, the media delivery server can establish the media channel according to the media content to be delivered. For example, if the media form of the media content to be delivered is an audio form, the media delivery server establishes an audio media channel, and if the media form of the media content to be delivered is a video form, the media delivery server establishes a video media channel.

[0298] It can be understood that after the delivery of the media content to be delivered is completed, if the media channel used to transmit the media content to be delivered can be used for call services, the UE performs call services with other UEs through the media channel used to transmit the media content to be delivered. If the media channel used to transmit the media content to be delivered cannot be used for call services, the UE switches the media channel, and performs call services with other UEs through the switched media channel.

[0299] For example, if the media channel used to transmit the media content to be delivered is an audio media channel (or a video media channel), and the call services are voice call services (or video call services) (i.e., the media channel used to transmit the media content to be delivered can be used for call services), the UE performs call services with other UEs through the media channel used to transmit the media content to be delivered.

[0300] For example, if the media channel used to transmit the media content to be delivered is an audio media channel, and the call service is a video call service (i.e., the media channel used to transmit the media content to be delivered cannot be used for the call service), then the UE will switch the audio media channel to the video media channel and make a call service with other UEs through the video media channel.

[0301] For example, if the media channel used to transmit the media content to be delivered is a video media channel, and the call service is an audio call service (i.e., the media channel used to transmit the media content to be delivered cannot be used for the call service), then the UE will switch the video media channel to the audio media channel and make a call service with other UEs through the audio media channel.

[0302] One possible implementation, in S504a, is that if the media delivery server is... Figure 3A If the media delivery server 303 in the middle is centrally deployed on a physical device, then after the media decision module 3031 determines the media content to be delivered, it sends the information of the media content to be delivered to the media application module 3032. After receiving the information of the media content to be delivered, the media application module 3032 sends an info message to the media resource management module 3033 to control the media resource management module 3033 to deliver the media content to be delivered to the UE.

[0303] One possible implementation is if the media delivery server is Figure 1 In the media delivery server 303, and since the functions of the media delivery server are deployed on multiple physical devices, after the media decision server determines the media content to be delivered, it sends the information of the media content to be delivered to the Media AS. After receiving the information of the media content to be delivered, the Media AS sends an info message to the MRS to control the MRS to deliver the media content to be delivered to the UE. Figure 3B Taking the process shown as an example, S504a can correspond to S126-S127 above.

[0304] Understandably, in the two possible implementation methods mentioned above, the information of the media content to be delivered can indicate the media content to be delivered.

[0305] One possible implementation, in S504a, is that if the media delivery server is... Figure 3BThe media decision module 3061 determines the media content to be put, and sends the address of the media content to be put to the UE. The UE receives the address of the media content to be put, and requests the media resource management module 3062 for the media content to be put, so that the media resource management module 3062 puts the media content to be put to the UE. Alternatively, the media decision module 3061 determines the media content to be put, and controls the media resource management module 3062 to put the media content to be put to the UE. For example, the media decision module 3061 controls the media resource management module 3062 to send a response message of the request message for the media content to the UE, and the response message includes the media content to be put.

[0306] In a possible implementation, in S504a, if the media putting server is the media putting server 306 in the MRS 300, and the functions of the media putting server are deployed in one physical device, after the media decision module 3061 determines the media content to be put, the media decision module 3061 sends the address of the media content to be put to the UE. After the UE receives the address of the media content to be put, the UE requests the MRS for the media content to be put, so that the MRS puts the media content to be put to the UE. Figure 2 In a possible implementation, in S504a, if the media putting server is the media putting server 306 in the MRS 300, and the functions of the media putting server are deployed in one physical device, after the media decision module 3061 determines the media content to be put, the media decision module 3061 sends the address of the media content to be put to the UE. After the UE receives the address of the media content to be put, the UE requests the MRS for the media content to be put, so that the MRS puts the media content to be put to the UE. Figure 3A Taking the flow shown in FIG. 22 as an example, S504a can correspond to S224-S226.

[0307] S505a: The UE presents the media content to be put through the program unit related to the calling program.

[0308] In the embodiments of the present application, the program unit related to the calling program can be at least one process or at least one thread of the calling program. The program unit related to the calling program can have an interface or can not have an interface. If the program unit related to the calling program has an interface, the interface can occupy the entire screen of the UE (for example, the interface is a full-screen window), or the interface can not occupy the entire screen of the UE (for example, the interface is a floating window, which can be suspended on the main page of the UE or on the interface of the application program running in the foreground of the UE). The interface can be the interface of the calling program itself or can not be the interface of the calling program (for example, the interface is popped up by the UE after receiving the media content to be put and triggered by the related application program). If the program unit related to the calling program does not have an interface, the program unit related to the calling program can be a background process or a background thread.

[0309] In the embodiments of the present application, the UE presenting the media content to be put through the program unit related to the calling program can also be described as the UE playing the media content to be put through the program unit related to the calling program.

[0310] Based on the S501-S505a, the UE can send the call service human-computer interaction environment indication information to the media delivery server, so that the media delivery server can determine the to-be-delivered media content according to the indication information. The human-computer interaction environment indicated by the call service human-computer interaction environment indication information can reflect the current state of the user, for example, whether the user is looking at the screen of the UE, whether the user is suitable for watching or listening to the media content, and the like. Therefore, the to-be-delivered media content determined according to the call service human-computer interaction environment indication information is more in line with the needs of the user, and the user experience and the delivery effect of the media content can be improved.

[0311] In the embodiments of the present application, S503a-S505a can also be replaced by S503b.

[0312] S503b: The media delivery server determines not to deliver the media content to the UE during the call service according to the call service human-computer interaction environment indication information.

[0313] It can be understood that the media delivery server can determine whether to deliver the media content to the UE during the call service according to different call service human-computer interaction environments. For example, if the call service human-computer interaction environment is suitable for delivering the media content, the media delivery server can determine to deliver the media content to the UE during the call service. If the call service human-computer interaction environment is not suitable for delivering the media content, the media delivery server can determine not to deliver the media content to the UE during the call service. In this way, the media content can not be delivered to the UE in the case that the call service human-computer interaction environment is not suitable for delivering the media content, the user experience is improved, and the consumption of data flow of the UE and the saving of air interface resources can be reduced or avoided.

[0314] In a possible implementation, the media delivery server determines not to deliver the media content to the UE during the call service according to the call service human-computer interaction environment indication information, including: if any of the following conditions is met, it is determined that the media content is not delivered to the UE during the call service: the call service human-computer interaction environment indication information indicates that the screen of the UE is turned off; or the call service human-computer interaction environment indication information indicates that the screen of the UE is turned on and the interface of the call program of the UE is invisible; or the call service human-computer interaction environment indication information indicates that the screen of the UE is turned on, the wired earphone of the UE is inserted, and the user is not within the visible range of the UE; or the call service human-computer interaction environment indication information indicates that the screen of the UE is turned on, the wireless earphone of the UE is connected, and the user is not within the visible range of the UE. Specifically, it can be as shown in Table 8.

[0315] Table 8

[0316]

[0317]

[0318] It can be understood that, the above Table 8 is only an example that the media delivery server determines not to deliver media content to the UE during the call service according to the call service man-machine interactive environment indication information, and in a specific application, the media delivery server can also determine not to deliver media content to the UE during the call service according to the call service man-machine interactive environment indication information in other cases, which are not limited by the embodiments of the present application.

[0319] Optionally, after S503b, the media delivery server can send first indication information to the UE, the first indication information being used for indicating not to deliver media content to the UE during the call service. After the UE receives the first indication information, the UE determines not to present the media content according to the first indication information.

[0320] In a possible implementation, if the media delivery server is the media delivery server 303 in the media delivery server 300 in the above Table 8, and the functions of the media delivery server are deployed in one physical device, the media decision module 3031 can determine not to deliver media content to the UE during the call service. Subsequently, the media decision module 3031 can send the first indication information to the UE through the media application module 3032. Figure 3A Figure 3B In a possible implementation, if the media delivery server is the media delivery server 303 in the media delivery server 300 in the above Table 8, and the functions of the media delivery server are deployed in multiple physical devices, the media decision server can determine not to deliver media content to the UE during the call service. Subsequently, the media decision server can send the first indication information to the Media AS, and the Media AS sends the first indication information to the UE after receiving the first indication information.

[0321] In a possible implementation, if the media delivery server is the media delivery server 306 in the media delivery server 300 in the above Table 8, and the functions of the media delivery server are deployed in one physical device, the media decision module 3061 can determine not to deliver media content to the UE during the call service. Subsequently, the media decision module 3061 can send a response message of the request message for requesting the media content to the UE, and the response message includes the first indication information. Figure 3B Figure 4 In a possible implementation, if the media delivery server is the media delivery server 306 in the media delivery server 300 in the above Table 8, and the functions of the media delivery server are deployed in multiple physical devices, the media decision server can determine not to deliver media content to the UE during the call service. Subsequently, the media decision server can send a response message of the request message for requesting the media content to the UE, and the response message includes the first indication information.

[0322] ​​It can be understood that after S503b, the media delivery server can also not send the first indication information to the UE, that is, the media delivery server can not indicate the UE that the media content is not delivered to the UE during the call service. Alternatively, in this case, the UE does not receive the indication information about presenting the media content sent by the media delivery server within a preset time range, and the UE determines not to present the media content. For example, a timer can be configured for the UE, and the UE starts the timer when the UE sends the call service human-computer interaction environment indication information to the media delivery server, or after the UE sends the call service human-computer interaction environment indication information to the media delivery server, or after the UE calls the other UE. In the case that the UE has not received the indication information about presenting the media content sent by the media delivery server before the timer expires, the UE determines not to present the media content.

[0323] Alternatively, before S503b or after S503b, the media delivery server establishes a media channel according to the call service. For example, if the call service is a voice call service, the media delivery server establishes an audio media channel, and if the call service is a video call service, the media delivery server establishes a video media channel. Wherein the introduction of the media channel can refer to the explanation and description of the related technical terms in the above embodiments of the present application, which will not be repeated here.

[0324] Based on the above S501-S502 and S503b, the UE can send the call service human-computer interaction environment indication information to the media delivery server, so that the media delivery server can determine not to deliver the media content to the UE during the call service according to the indication information. The human-computer interaction environment indicated by the call service human-computer interaction environment indication information can reflect the current state of the user, for example, whether the user is looking at the screen of the UE, whether the user is suitable for watching or listening to the media content, etc. Therefore, in the case that it is not suitable to deliver the media content to the UE, for example, in the case that the user is not looking at the screen or the user is not suitable for watching and listening to the media content, the media content is not delivered to the UE, which improves the user experience, and also reduces or avoids the consumption of data flow of the UE, and saves the air interface resources.

[0325] Wherein the actions of the UE or the media delivery server in the above S501-S505a and S503b can be performed by the processor 401 in the device 40 shown in Figure 7 invoking the application program code stored in the memory 403, and the embodiments of the present application do not make any limitation in this regard.

[0326] Alternatively, as Figure 5 shown, in Figure 8A In a possible implementation of the method shown in

[0327] S701: The UE detects whether the screen of the UE is on.

[0328] For example, the UE can detect whether the screen of the UE is on through the capability of the PowerManager. For example, the UE can detect whether the screen of the UE is on through the following program code:

[0329] import android.os.PowerManager;

[0330] PowerManager pm = (PowerManager) getSystemService(Context. POWER_SERVICE ) ; / / If the application is not in the Activity, the calling service human-computer interaction environment indication information can be obtained, and context. getSystemService is used to obtain whether the screen of the UE is on in the calling service human-computer interaction environment indication information.

[0331] boolean isScreenOn = pm. isScreenOn () ;

[0332] In the case where the result of isScreenOn is "true", the screen of the UE is on, and in the case where the result of isScreenOn is "false", the screen of the UE is off.

[0333] S702: The UE detects whether the interface of the calling program of the UE is visible.

[0334] It can be understood that the calling program has multiple life cycle states, for example, active, paused, stopped, etc.

[0335] The active state of the calling program can refer to when the Activity corresponding to the calling program runs in the foreground of the screen (i.e., at the top of the current task activity stack), at this time it obtains the focus and can respond to the user's operation. At the same time, there will be an Activity in the active state.

[0336] The paused state of the calling program can refer to that the Activity corresponding to the calling program loses the focus, but is still visible to the user, i.e., there is another transparent Activity or a pop-up window such as Toast, AlertDialog, etc. above the Activity of the calling program. Generally, the paused Activity is still in the alive state, retains all state and member information and keeps the connection with the window manager, but when the system memory is extremely small, it can be killed by the system.

[0337] The stop state of the calling program can refer to a state in which the Activity corresponding to the calling program is blocked by another Activity, the Activity corresponding to the calling program still retains all state and member information in the memory, but is invisible to the user, and the Activity corresponding to the calling program is often killed by the system when memory is needed elsewhere.

[0338] In a possible implementation, the calling program in the UE can perceive the life cycle state of the calling program, and the UE determines whether the interface of the calling program of the UE is visible according to the life cycle state perceived by the calling program. For example, if the life cycle state of the calling program is the active state, the UE determines that the interface of the calling program is visible; if the life cycle state of the calling program is the pause state or the stop state, the UE determines that the interface of the calling program is invisible.

[0339] S703: The UE detects whether the hands-free function of the UE is enabled.

[0340] For example, the UE can detect whether the hands-free function of the UE is enabled through the following program code:

[0341] AudioManager audioManager =

[0342] (AudioManager) context.getSystemService(Context.AUDIO_SERVICE) ;

[0343] audioManager.isSpeakerphoneOn() ;

[0344] In the case where the result of isSpeakerphoneOn is "true", the hands-free function of the UE is enabled, and in the case where the result of isSpeakerphoneOn is "false", the hands-free function of the UE is disabled.

[0345] S704: The UE detects whether the wired earphone of the UE is inserted.

[0346] For example, the UE can detect whether the wired earphone of the UE is inserted through the following program code:

[0347] AudioManager audioManager =

[0348] (AudioManager) context. getSystemService(Context. AUDIO_SERVICE) ;

[0349] audioManager. isWiredHeadsetOn() ;

[0350] wherein, if the result of isWiredHeadsetOn is "true", the wired headset of the UE is plugged in, and if the result of isWiredHeadsetOn is "false", the wired headset of the UE is unplugged.

[0351] S705: The UE detects whether the wireless headset of the UE is connected.

[0352] For example, the UE can detect whether the wireless headset of the UE is connected through the following program code:

[0353] AudioManager audioManager = (AudioManager) context. getSystemService(Context. AUDIO_SERVICE) ;

[0354] (AudioManager) context. getSystemService(Context. AUDIO_SERVICE) ;

[0355] audioManager. isBluetoothScoOn() ;

[0356] wherein, if the result of isBluetoothScoOn is "true", the wireless headset of the UE is connected, and if the result of isBluetoothScoOn is "false", the wireless headset of the UE is not connected.

[0357] S706: The UE detects whether the user is within the visual range of the UE.

[0358] In one possible implementation, the UE detects whether the user is within the visual range of the UE through the camera of the UE. For example, the UE obtains image information through the front camera of the UE, and the UE identifies whether the eyes of the user are likely to gaze at the screen according to the image information. The image information can include at least one image or a sequence of continuous images (such as a video), and the like.

[0359] For example, the UE starts the camera and obtains image information by executing the following code through the camera management (CAMERA) of Android.

[0360]

[0361] In one possible implementation, the UE can start the front camera and acquire image information by taking pictures regularly through an API. After acquiring the image information, the UE can identify face information (e.g., whether a complete face, a partial face, or no face is included, and the size of the face if a face is included) in the image information based on a face detection technique. If the UE fails to detect a face or the detected face is too small, it can be determined that the user is likely far away from the screen of the UE and less likely to gaze at the screen. In this case, the UE determines that the user is not within the visual range of the UE. If the UE detects a face (or a partial face) and the detected face (or partial face) is large enough, it can be determined that the user is likely gazing at the screen of the UE. In this case, the UE determines that the user is within the visual range of the UE.

[0362] For example, as shown in Figure 8B , the user is outside the shooting range of the front camera of the UE, so the UE fails to detect a face, and the UE can determine that the user is not within the visual range of the UE. As shown in Figure 7 , the user is within the shooting range of the front camera of the UE and the user is close to the UE, so the UE can detect a face and the face is large enough, and the UE can determine that the user is within the visual range of the UE.

[0363] Based on the method shown in Figure 4 , the UE can detect any of the following: whether the screen of the UE is on, whether the interface of the calling program of the UE is visible, whether the hands-free function of the UE is enabled, whether the wired earphone of the UE is plugged in, whether the wireless earphone of the UE is connected, or whether the user is within the visual range of the UE, and thereby acquire the call service human-computer interaction environment indication information.

[0364] The actions of the UE in S701-S706 can be performed by the processor 401 in the device 40 invoking the application program code stored in the memory 403, and the embodiments of the present application do not make any limitation in this regard. Figure 5

[0365] In the method shown in Figure 9 , the UE can send the call service human-computer interaction environment indication information to the media delivery server, so that the media delivery server can determine the media content to be delivered according to the indication information, or so that the media delivery server can determine not to deliver media content to the UE during the call service. In specific applications, the UE can also determine the media form or determine not to present media content during the call service. In this way, the UE can not send the call service human-computer interaction environment indication information to the media delivery server, so as to protect the privacy of the user and improve information security. For details, reference can be made to the following Figure 10 or​Figure 9 The method shown.

[0366] As Figure 3A shown, another media content delivery method provided by the embodiments of the present application includes S901-S906a, or the media content delivery method includes S901 and S902b.

[0367] S901: The UE determines a call service human-computer interaction environment.

[0368] In this embodiment of the present application, the UE can be any one of the UEs in Figure 3B or Figure 3A For example, the UE can be the UE 301 or the UE 302 in Figure 3B , or the UE can be the UE 304 or the UE 305 in Figure 1 .

[0369] In this embodiment of the present application, the call service human-computer interaction environment is the human-computer interaction environment of the user corresponding to the UE during the call service. Specifically, reference can be made to the corresponding description in S501 described above, and details are not described herein.

[0370] In one possible implementation, the UE determines the call service human-computer interaction environment when the call service is about to start or when the call service has started. For example, in the call process shown in Figure 2 , S901 can be performed before S125. For example, in the call process shown in Figure 7 , S901 can be performed before S222.

[0371] In one possible implementation, the UE determines the call service human-computer interaction environment by at least one of the following: the UE detects whether the screen of the UE is on; or the UE detects whether the interface of the call program of the UE is visible; or the UE detects whether the hands-free function of the UE is turned on; or the UE detects whether the wired earphone of the UE is plugged in; or the UE detects whether the wireless earphone of the UE is connected; or the UE detects whether the user is within the visible range of the UE. Specifically, reference can be made to the method shown in Figure 3A , and details are not described herein.

[0372] S902a: The UE determines a media form according to the call service human-computer interaction environment.

[0373] In this embodiment of the present application, the introduction of the media form can refer to the explanation and description of the related technical terms involved in the embodiments of the present application described above, and details are not described herein.

[0374] It can be understood that the UE can determine the media form corresponding to the call service human-computer interaction environment according to different call service human-computer interaction environments. For example, if the call service human-computer interaction environment is suitable for the user to listen to the sound played by the UE, the UE can determine that the media form is an audio form. If the call service human-computer interaction environment is suitable for the user to watch the video played by the UE, the UE can determine that the media form is a video with sound form. If the call service human-computer interaction environment is suitable for the user to watch the video played by the UE, but the call service human-computer interaction environment is not suitable for the UE to play the sound, the UE can determine that the media form is a video without sound form. If the call service human-computer interaction environment is suitable for the user to watch the video played by the UE, but the call service human-computer interaction environment is not suitable for the UE to play the sound too loud, the UE can determine that the media form is a video with low sound form. Subsequently, the UE can request the media delivery server for the media content conforming to the media form, and present the media content. In this way, on the one hand, the UE can present the media content suitable for the user, improving the user experience and the delivery effect of the media content. On the other hand, in the case that the call service human-computer interaction environment is suitable for the user to listen to the sound played by the UE, the UE will not request the media delivery server for the media content in a video form, which can reduce or avoid the consumption of the data flow of the UE and save the air interface resources while improving the user experience.

[0375] In a possible implementation, the UE determines the media form according to the call service human-computer interaction environment, including: if any of the following environments is detected, determining that the media form is an audio form: detecting that the screen of the UE is turned off, or detecting that the screen of the UE is turned on and the interface of the call program of the UE is invisible, or detecting that the screen of the UE is turned on, the wired earphone of the UE is inserted, and the user is not within the visible range of the UE, or detecting that the screen of the UE is turned on, the wireless earphone of the UE is connected, and the user is not within the visible range of the UE. Specifically, reference can be made to the description in S503a above, which will not be repeated here.

[0376] In a possible implementation, the UE determines the media form according to the call service human-computer interaction environment, including: if any of the following environments is detected, determining that the media form is a video with sound form: detecting that the screen of the UE is turned on, the interface of the call program of the UE is visible, and the wired earphone of the UE is inserted; or detecting that the screen of the UE is turned on, the interface of the call program of the UE is visible, and the wireless earphone of the UE is connected; or detecting that the screen of the UE is turned on, the interface of the call program of the UE is visible, the wireless earphone of the UE is connected, and the user is within the visible range of the UE; or detecting that the screen of the UE is turned on, the interface of the call program of the UE is visible, the wired earphone of the UE is inserted, and the user is within the visible range of the UE. Specifically, reference can be made to the description in S503a above, which will not be repeated here.

[0377] In a possible implementation, the UE determines the media form according to a call service human-computer interaction environment, including: if it is detected that the screen of the UE is on, the interface of the call program of the UE is visible, and the hands-free function of the UE is on, it is determined that the media form is a mute video form. Specifically, refer to the description in S503a, and details are not described herein.

[0378] In a possible implementation, the UE determines the media form according to a call service human-computer interaction environment, including: if it is detected that any of the following environments, it is determined that the media form is a low sound video form: it is detected that the wired earphone of the UE is plugged in; or, it is detected that the wireless earphone of the UE is connected; or, it is detected that the screen of the UE is on, the interface of the call program of the UE is visible, the hands-free function of the UE is off, the wired earphone of the UE is not plugged in, the wireless earphone of the UE is not connected, and the user is within the visual range of the UE. Specifically, refer to the description in S503a, and details are not described herein.

[0379] S903a: The UE sends the indication information of the media form to the media delivery server. Correspondingly, the media delivery server receives the indication information of the media form sent by the UE.

[0380] In the embodiment of the present application, if the UE is the UE 301 or the UE 302 in the Figure 3A , the media delivery server can be the media delivery server 303 in the Figure 3B . If the UE is the UE 304 or the UE 305 in the Figure 3B , the media delivery server can be the media delivery server 306 in the Figure 3A .

[0381] In the embodiment of the present application, the indication information of the media form can include at least 1 bit. The at least 1 bit can indicate the media form determined by the UE.

[0382] As an example, if the media form includes an audio form or a video form, the indication information of the media form includes 1 bit. If the media form determined by the UE is the audio form, the value of the 1 bit is “0”, if the media form determined by the UE is the video form, the value of the 1 bit is “1”, and vice versa.

[0383] As another example, if the media form includes an audio form, a mute video form, a sound video form or a low sound video form, the indication information of the media form includes 2 bits. If the media form determined by the UE is the audio form, the value of the 2 bits is “00”, if the media form determined by the UE is the mute video form, the value of the 2 bits is “01”, if the media form determined by the UE is the sound video form, the value of the 2 bits is “10”, and if the media form determined by the UE is the low sound video form, the value of the 2 bits is “11”.

[0384] It can be understood that, as described previously, the functions possessed by the media delivery server can be deployed on one physical device or on multiple physical devices. Figure 1 Taking the communication system shown in FIG. 3 as an example, if the functions possessed by the media delivery server 303 are deployed on one physical device, the UE sends the media-form indication information to the media application module 3032. Correspondingly, the media application module 3032 receives the media-form indication information sent by the UE. Subsequently, the media application module 3032 can send the media-form indication information to the media decision module 3031. If the functions possessed by the media delivery server 303 are deployed on multiple physical devices, the UE sends the media-form indication information to the Media AS. Correspondingly, the Media AS receives the media-form indication information sent by the UE. Subsequently, the Media AS can send the media-form indication information to the media decision server. Taking the flow shown in FIG. 4 as an example, the Media AS can send the media-form indication information to the media decision server through the request message in S125, that is, the media-form indication information can be included in the request message in S125. Figure 3B

[0385] Taking the communication system shown in FIG. 6 as an example, if the functions possessed by the media delivery server 306 are deployed on one physical device, the UE sends the media-form indication information to the media decision module 3061. Correspondingly, the media decision module 3061 receives the media-form indication information sent by the UE. If the functions possessed by the media delivery server 306 are deployed on multiple physical devices, the UE sends the media-form indication information to the media decision server. Correspondingly, the media decision server receives the media-form indication information sent by the UE. Figure 2 Figure 3A Taking the flow shown in FIG. 8 as an example, the UE can send the media-form indication information to the media decision server through the request message in S222, that is, the media-form indication information can be included in the request message in S222.

[0386] S904a: The media delivery server determines the media content conforming to the media form according to the media-form indication information.

[0387] ​​For example, if the media format indication information indicates that the UE determines the media format to be audio, then the media delivery server determines that the audio format media content is media content conforming to the media format. If the media format indication information indicates that the UE determines the media format to be silent video, then the media delivery server determines that the silent video format media content is media content conforming to the media format. If the media format indication information indicates that the UE determines the media format to be audio video, then the media delivery server determines that the audio video format media content is media content conforming to the media format. If the media format indication information indicates that the UE determines the media format to be bass video, then the media delivery server determines that the bass video format media content is media content conforming to the media format.

[0388] S905a: The media delivery server sends media content conforming to the media format to the UE. Correspondingly, the UE receives the media content conforming to the media format sent by the media delivery server.

[0389] One possible implementation is that the media delivery server sends media content conforming to the media format to the UE through a media channel. The description of the media channel can be found in the explanations of the relevant technical terms used in the embodiments of this application above, and will not be repeated here.

[0390] Understandably, the aforementioned media channel can be established either before or after S904a. If the media channel is established before S904a, the media delivery server can establish the media channel based on the call service before S904a. For example, if the call service is a voice call, the media delivery server establishes an audio media channel; if the call service is a video call, the media delivery server establishes a video media channel. Subsequently, after the media delivery server determines the media content conforming to the media format (i.e., after S904a), if the media channel determined by the media delivery server can transmit the media content conforming to the media format, the media delivery server sends the media content conforming to the media format to the UE through that media channel. If the media channel determined by the media delivery server cannot transmit the media content conforming to the media format, the media delivery server switches the media channel and sends the media content conforming to the media format to the UE through the switched media channel.

[0391] Understandably, if the media channel is established after S904a, the media delivery server can establish the media channel according to the media format determined by the UE. For example, if the media format determined by the UE is audio, the media delivery server establishes an audio media channel; if the media format determined by the UE is video, the media delivery server establishes a video media channel.

[0392] It can be understood that after the end of the media content delivery conforming to the media form, if the media channel used for transmitting the media content conforming to the media form can be used for call service, the UE performs call service with other UEs through the media channel used for transmitting the media content conforming to the media form. If the media channel used for transmitting the media content conforming to the media form cannot be used for call service, the UE switches the media channel, and performs call service with other UEs through the switched media channel.

[0393] In a possible implementation, in S905a, if the media delivery server is the media delivery server 303 in Figure 3A and the functions of the media delivery server are deployed in one physical device, after the media decision module 3031 determines the media content conforming to the media form, the media decision module 3031 sends information of the media content conforming to the media form to the media application module 3032. After the media application module 3032 receives the information of the media content conforming to the media form, the media application module 3032 sends an info message to the media resource management module 3033, to control the media resource management module 3033 to deliver the media content conforming to the media form to the UE.

[0394] In a possible implementation, if the media delivery server is the media delivery server 303 in Figure 1 and the functions of the media delivery server are deployed in multiple physical devices, after the media decision module determines the media content conforming to the media form, the media decision module sends information of the media content conforming to the media form to the Media AS. After the Media AS receives the information of the media content conforming to the media form, the Media AS sends an info message to the MRS, to control the MRS to deliver the media content conforming to the media form to the UE. If the flow shown in Figure 3B is taken as an example, S905a can correspond to S126-S127.

[0395] It can be understood that in the above two possible implementations, the information of the media content conforming to the media form can indicate the media content to be delivered.

[0396] In a possible implementation, in S905a, if the media delivery server is the media delivery server 303 in Figure 3BIf the media placement server in the media placement server 306, and the functions of the media placement server are deployed in one physical device, after the media decision module 3061 determines the media content conforming to the media form, the media decision module 3061 sends the address of the media content conforming to the media form to the UE, after the UE receives the address of the media content conforming to the media form, the UE requests the media resource management module 3062 for the media content conforming to the media form, so that the media resource management module 3062 places the media content conforming to the media form to the UE. Or, after the media decision module 3061 determines the media content conforming to the media form, the media decision module 3061 controls the media resource management module 3062 to place the media content conforming to the media form to the UE, for example, the media decision module 3061 controls the media resource management module 3062 to send the response message of the request message for requesting the media content to the UE, and the response message includes the media content conforming to the media form.

[0397] In a possible implementation, in S905a, if the media placement server is the media placement server 306 in the media placement server 306, and the functions of the media placement server are deployed in multiple physical devices, after the media decision module 3061 determines the media content conforming to the media form, the media decision module 3061 sends the address of the media content conforming to the media form to the UE, after the UE receives the address of the media content conforming to the media form, the UE requests the MRS for the media content conforming to the media form, so that the MRS places the media content conforming to the media form to the UE. If the flow shown in FIG. 22 is taken as an example, S905a can correspond to S224-S226. Figure 2 Figure 4 In a possible implementation, in S905a, if the media placement server is the media placement server 306 in the media placement server 306, and the functions of the media placement server are deployed in multiple physical devices, after the media decision module 3061 determines the media content conforming to the media form, the media decision module 3061 sends the address of the media content conforming to the media form to the UE, after the UE receives the address of the media content conforming to the media form, the UE requests the MRS for the media content conforming to the media form, so that the MRS places the media content conforming to the media form to the UE. If the flow shown in FIG. 22 is taken as an example, S905a can correspond to S224-S226.

[0398] S906a: The UE presents the media content through the program unit related to the calling program.

[0399] The introduction of S906a can refer to the corresponding introduction in S505a, and details are not described herein.

[0400] Based on the above S901-S906a, the UE can determine the calling service human-computer interaction environment, determine the media form according to the calling service human-computer interaction environment, and indicate the media form to the media placement server, so that the media placement server can determine the media content conforming to the media form according to the media form, and send the media content to the UE. The calling service human-computer interaction environment can reflect the current state of the user, for example, whether the user is looking at the screen of the UE, whether the user is suitable for watching or listening to the media content, and the like. Therefore, the media form determined according to the calling service human-computer interaction environment is more in line with the needs of the user, and the user experience and the placement effect of the media content can be improved.

[0401] In the embodiments of the present application, S902a-S906a can also be replaced by S902b.

[0402] ​S902b: The UE determines not to present the media content during the call service according to the call service human-computer interaction environment.

[0403] It can be understood that the UE can determine whether to present the media content during the call service according to different call service human-computer interaction environments. For example, if the call service human-computer interaction environment is suitable for presenting the media content, the UE can determine to present the media content during the call service. If the call service human-computer interaction environment is not suitable for presenting the media content, the UE can determine not to present the media content during the call service. In this way, the UE can not present the media content when the call service human-computer interaction environment is not suitable for presenting the media content, thereby improving the user experience and reducing or avoiding the consumption of the data flow of the UE.

[0404] In a possible implementation, the UE determines not to present the media content during the call service according to the call service human-computer interaction environment, including: determining not to present the media content during the call service if any of the following conditions is detected: detecting that the screen of the UE is turned off; or detecting that the screen of the UE is turned on and the interface of the call program of the UE is invisible; or detecting that the screen of the UE is turned on, the wired earphone of the UE is plugged in, and the user is not within the visual range of the UE; or detecting that the screen of the UE is turned on, the wireless earphone of the UE is connected, and the user is not within the visual range of the UE. For details, refer to the description of S503b above, which will not be repeated here.

[0405] Optionally, before S902b or after S902b, the UE establishes a media channel according to the call service. For example, if the call service is a voice call service, the UE establishes an audio media channel, and if the call service is a video call service, the UE establishes a video media channel. For details, refer to the description of the related technical terms in the above embodiments of the present application, which will not be repeated here.

[0406] Based on S901 and S902b above, the UE can determine the call service human-computer interaction environment and determine not to present the media content during the call service according to the call service human-computer interaction environment. The call service human-computer interaction environment can reflect the current state of the user, for example, whether the user is looking at the screen of the UE, whether the user is suitable for watching or listening to the media content, and the like. Therefore, the UE can not present the media content when it is not suitable to present the media content, for example, when the user is not looking at the screen or the user is not suitable for watching and listening to the media content, thereby improving the user experience. In addition, the UE can not send the call service human-computer interaction environment indication information to the media delivery server, thereby protecting the privacy of the user and improving the information security.

[0407] The actions of the UE or the media delivery server in S901-S906a and S902b can be implemented by the processor 401 in the device 40 shown in FIG. 4 invoking the application code stored in the memory 403 to execute, and the embodiments of the present application do not make any limitation in this regard. Figure 10 The processor 401 in the device 40 shown in FIG. 4 invokes the application code stored in the memory 403 to execute, and the embodiments of the present application do not make any limitation in this regard.

[0408] As shown in FIG. 10, another media content delivery method is provided in the embodiments of the present application, which includes S1001-S1004a, or the media content delivery method includes S1001-S1002 and S1003b. Figure 4 As shown in FIG. 10, another media content delivery method is provided in the embodiments of the present application, which includes S1001-S1004a, or the media content delivery method includes S1001-S1002 and S1003b.

[0409] S1001: The UE acquires information of media content.

[0410] In S1001, the information of media content can include multiple media content. The media forms corresponding to the multiple media content include multiple forms. For example, the information of media content includes 6 media content, of which 2 media content is in the form of audio, 2 media content is in the form of voiced video, and 2 media content is in the form of unvoiced video.

[0411] In one possible implementation, the UE receives the information of media content sent by the media delivery server. That is, the media delivery server can send the information of media content to the UE in advance. In this way, after the UE determines the media form, the UE can present the media content conforming to the media form in the information of media content.

[0412] S1002: The UE determines the call service human-computer interaction environment.

[0413] S1003a: The UE determines the media form according to the call service human-computer interaction environment.

[0414] The above description of S1002-S1003a can refer to the corresponding description of S901-S902a, and will not be repeated here.

[0415] S1004a: The UE presents the media content conforming to the media form in the information of media content through the program unit related to the call program.

[0416] In a possible implementation, the UE can determine the media content conforming to the media form from the information of the media content. For example, if the UE determines that the media form is an audio form, the UE determines that the media content in the audio form in the information of the media content is the media content conforming to the media form. If the UE determines that the media form is a silent video form, the UE determines that the media content in the silent video form in the information of the media content is the media content conforming to the media form. If the UE determines that the media form is a voiced video form, the UE determines that the media content in the voiced video form in the information of the media content is the media content conforming to the media form. If the UE determines that the media form is a low-voiced video form, the UE determines that the media content in the low-voiced video form in the information of the media content is the media content conforming to the media form. Subsequently, the UE presents the media content conforming to the media form through the program unit related to the call program. Specifically, refer to the corresponding description in S505a above, which will not be repeated here.

[0417] Based on S1001-S1004a above, the UE can first acquire the information of the media content, determine the call service human-computer interaction environment, and then determine the media form according to the call service human-computer interaction environment. In this way, the UE can present the media content conforming to the media form in the information of the media content after determining the media form. On the one hand, the call service human-computer interaction environment can reflect the current state of the user, for example, whether the user is looking at the screen of the UE, whether the user is suitable for watching or listening to the media content, and the like. Therefore, the media form determined according to the call service human-computer interaction environment is more in line with the needs of the user, which can improve the user experience and the delivery effect of the media content. On the other hand, after determining the media form, the UE does not need to request the media delivery server for the media content, but directly determines the media content conforming to the media form locally, and presents the media content, which can present the media content in time and shorten the time from determining the media form to presenting the media content. Moreover, the UE can not send the call service human-computer interaction environment indication information to the media delivery server, which protects the privacy of the user and improves the information security.

[0418] In the embodiments of the present application, S1003a-S1004a can also be replaced by S1003b.

[0419] S1003b: The UE determines not to present the media content during the call service according to the call service human-computer interaction environment.

[0420] The introduction of S1003b can refer to the corresponding description in S902b above, which will not be repeated here.

[0421] Based on the above S1001-S1002 and S1003b, the UE can first acquire the information of the media content, determine the call service human-computer interaction environment, and determine not to present the media content during the call service according to the call service human-computer interaction environment. The call service human-computer interaction environment can reflect the current state of the user, for example, whether the user gazes at the screen of the UE, whether the user is suitable for watching or listening to the media content, and the like. Therefore, the media content can not be presented in the case that the UE is not suitable for presenting the media content, for example, the user does not gaze at the screen, or the user is not suitable for watching and listening to the media content, thereby improving the user experience, reducing or avoiding the consumption of the data flow of the UE, and saving the air interface resources. Moreover, the UE can not send the call service human-computer interaction environment indication information to the media delivery server, thereby protecting the privacy of the user and improving the information security.

[0422] The actions of the UE or the media delivery server in the above S1001-S1004a and S1003b can be performed by calling the application program code stored in the memory 403 by the processor 401 in the device 40 shown in the figure, and the embodiments of the present application do not make any limitation in this regard. Figure 11 The processor 401 in the device 40 shown in the figure can call the application program code stored in the memory 403 to perform the actions of the UE or the media delivery server in the above S1001-S1004a and S1003b, and the embodiments of the present application do not make any limitation in this regard.

[0423] The above mainly introduces the scheme provided by the embodiments of the present application from the perspective of the interaction between various devices. It can be understood that the media delivery server or the UE and the like contains the corresponding hardware structure and / or software module for executing various functions in order to implement the above functions. Those skilled in the art should easily realize that, in combination with the unit and algorithm operation of the examples described in the embodiments disclosed in the present application, the present application can be realized in the form of hardware or the combination of hardware and computer software. Whether a certain function is executed in the form of hardware or computer software driven hardware depends on the specific application and design constraints of the technical solution. The professional technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0424] The embodiments of the present application can divide the functional modules of the media delivery server or the UE according to the above method examples. For example, each functional module can be divided corresponding to each function, or two or more functions can be integrated in one processing module. The integrated module can be realized in the form of hardware or software functional module. It should be noted that the division of the modules in the embodiments of the present application is illustrative, and is only a logical function division. There can be another division manner in actual implementation.

[0425] For example, in the case of dividing each functional module in an integrated manner, Figure 5A structural diagram of a media delivery server 110 is shown. The media delivery server 110 includes a transceiver module 1101 and a processing module 1102. The transceiver module 1101, which can also be referred to as a transceiver unit, is configured to implement a transceiving function, for example, can be a transceiving circuit, a transceiver, a transceiver, or a communication interface.

[0426] Exemplarily, the media delivery server 110 is configured to implement the functions of the media delivery server in the above method embodiments. The media delivery server 110 is, for example, a media delivery server as described in the above Figure 7 embodiment or Figure 5 embodiment.

[0427] The transceiver module 1101 is configured to receive call service human-computer interaction environment indication information sent by a UE, the call service human-computer interaction environment indication information indicating a human-computer interaction environment of a user corresponding to the UE during a call service. The processing module 1102 is configured to determine to-be-delivered media content according to the call service human-computer interaction environment indication information. The transceiver module 1101 is further configured to deliver the to-be-delivered media content to the UE during the call service.

[0428] Alternatively, the transceiver module 1101 is configured to receive call service human-computer interaction environment indication information sent by a UE, the call service human-computer interaction environment indication information indicating a human-computer interaction environment of a user corresponding to the UE during a call service. The processing module 1102 is configured to determine not to deliver media content to the UE during the call service according to the call service human-computer interaction environment indication information.

[0429] When used to implement the functions of the media delivery server, other functions that the media delivery server 110 can implement can refer to the related descriptions of the media delivery server in the above Figure 7 embodiment or Figure 4 embodiment, and will not be described in detail.

[0430] In a simple embodiment, those skilled in the art can conceive that the media delivery server 110 can adopt the form as shown in Figure 4 For example, Figure 11 The processor 401 in the above

[0431] Exemplarily, Figure 4 The functions / implementation processes of the transceiver module 1101 and the processing module 1102 in the above Figure 11 may be implemented by the processor 401 in the above calling computer-executable instructions stored in the memory 403. Alternatively, Figure 4 The functions / implementation processes of the processing module 1102 in the aboveFigure 11 The processor 401 in the apparatus 100 invokes the computer-executable instructions stored in the memory 403 to implement the following functions / processes: Figure 4 The functions / implementation processes of the transceiver module 1101 in the apparatus 100 can be implemented through the communication interface 404. Figure 12 The functions / implementation processes of the transceiver module 1101 in the apparatus 100 can be implemented through the communication interface 404.

[0432] For example, in the case of dividing the various functional modules in an integrated manner, Figure 5 A structural diagram of a UE 120 is shown. The UE 120 includes a processing module 1201 and a transceiver module 1202. The transceiver module 1202, which can also be referred to as a transceiver unit, is configured to implement the transceiving function, for example, can be a transceiving circuit, a transceiver, a transceiver, or a communication interface.

[0433] Exemplarily, the UE 120 is configured to implement the functions of the UE in the method embodiments described above. The UE 120, for example, is the UE described in the embodiments shown in Figure 7 or the embodiments shown in Figure 5 .

[0434] The processing module 1201 is configured to obtain call service human-computer interaction environment indication information, the call service human-computer interaction environment indication information indicating a human-computer interaction environment of a user corresponding to the UE during a call service. The transceiver module 1202 is configured to send the call service human-computer interaction environment indication information to a media delivery server. The transceiver module 1202 is further configured to receive media content to be delivered sent by the media delivery server. The processing module 1201 is further configured to present the media content to be delivered through a program unit related to a call program.

[0435] Alternatively, the processing module 1201 is configured to obtain call service human-computer interaction environment indication information, the call service human-computer interaction environment indication information indicating a human-computer interaction environment of a user corresponding to the UE during a call service. The transceiver module 1202 is configured to send the call service human-computer interaction environment indication information to a media delivery server. The processing module 1201 is further configured to determine not to present the media content.

[0436] When used to implement the functions of the UE, other functions that the UE 120 can implement can be referred to the related descriptions of the embodiments shown in Figure 7 or the embodiments shown in Figure 9 .

[0437] Alternatively, exemplarily, the UE 120, for example, is the UE described in the embodiments shown in Figure 9 .

[0438] The processing module 1201 is configured to determine a call service human-computer interaction environment, which is a human-computer interaction environment of a user corresponding to the UE during call service performance. The processing module 1201 is further configured to determine a media form according to the call service human-computer interaction environment. The transceiver module 1202 is configured to send indication information of the media form to a media delivery server. The transceiver module 1202 is further configured to receive media content conforming to the media form sent by the media delivery server. The processing module 1201 is further configured to present the media content through a program unit related to a call program.

[0439] Alternatively, the processing module 1201 is configured to determine a call service human-computer interaction environment, which is a human-computer interaction environment of a user corresponding to the UE during call service performance. The processing module 1201 is further configured to determine that no media content is presented during call service performance according to the call service human-computer interaction environment.

[0440] When used to implement the functions of the UE, for other functions that the UE 120 can implement, reference can be made to the related descriptions of the embodiments shown in Figure 10 Without further elaboration, the related descriptions of the embodiments shown in

[0441] Alternatively, the UE 120, for example, is the UE described in the embodiments shown in Figure 10

[0442] The transceiver module 1202 is configured to obtain information of media content. The processing module 1201 is configured to determine a call service human-computer interaction environment, which is a human-computer interaction environment of a user corresponding to the UE during call service performance. The processing module 1201 is further configured to determine a media form according to the call service human-computer interaction environment, and present, through a program unit related to a call program, media content conforming to the media form in the information of the media content.

[0443] Alternatively, the transceiver module 1202 is configured to obtain information of media content. The processing module 1201 is configured to determine a call service human-computer interaction environment, which is a human-computer interaction environment of a user corresponding to the UE during call service performance. The processing module 1201 is further configured to determine that no media content is presented during call service performance according to the call service human-computer interaction environment.

[0444] When used to implement the functions of the UE, for other functions that the UE 120 can implement, reference can be made to the related descriptions of the embodiments shown in Figure 4 Without further elaboration, the related descriptions of the embodiments shown in

[0445] In a simple embodiment, those skilled in the art can conceive that the UE 120 can adopt the form shown in Figure 4 For example, Figure 12 ​The processor 401 can call the computer execution instructions stored in the memory 403 to cause the UE120 to execute the method described in the above method embodiment.

[0446] For example, Figure 4 The functions / implementation process of the processing module 1201 and the transceiver module 1202 can be obtained through Figure 12 The processor 401 in the memory calls computer execution instructions stored in the memory 403 to implement the function. Alternatively, Figure 4 The function / implementation process of the processing module 1201 can be achieved through... Figure 12 The processor 401 in the memory calls computer execution instructions stored in the memory 403 to implement this. Figure 4 The function / implementation process of the transceiver module 1202 can be obtained through ​ It is implemented using the communication interface 404.

[0447] It should be noted that one or more of the above modules or units can be implemented by software, hardware, or a combination of both. When any of the above modules or units are implemented by software, the software exists as computer program instructions and is stored in memory. The processor can be used to execute the program instructions and implement the above method flow. The processor can be built into a SoC (System-on-a-Chip) or ASIC, or it can be a separate semiconductor chip. In addition to the core that executes software instructions for computation or processing, the processor may further include necessary hardware accelerators, such as field-programmable gate arrays (FPGAs), PLDs (Programmable Logic Devices), or logic circuits that implement dedicated logic operations.

[0448] When the above modules or units are implemented in hardware, the hardware can be any one or any combination of a CPU, microprocessor, digital signal processing (DSP) chip, microcontroller unit (MCU), artificial intelligence processor, ASIC, SoC, FPGA, PLD, application-specific digital circuit, hardware accelerator, or non-integrated discrete device, which can run the necessary software or perform the above method flow independently of software.

[0449] Optionally, the embodiments of the present application further provide a chip system, comprising: at least one processor and an interface, the at least one processor is coupled with a memory through the interface, when the at least one processor executes a computer program or instructions in the memory, the method in any of the above method embodiments is executed. In a possible implementation, the chip system further comprises the memory. Optionally, the chip system can be composed of a chip, or can comprise a chip and other discrete devices, and the embodiments of the present application do not make a specific limitation hereon.

[0450] Optionally, the embodiments of the present application further provide a computer readable storage medium. All or part of the processes in the above method embodiments can be instructed by a computer program to relevant hardware to complete, the program can be stored in the above computer readable storage medium, and the program can include the processes of the above method embodiments when executed. The computer readable storage medium can be an internal storage unit of the media delivery server or the UE in any of the above embodiments, for example, a hard disk or a memory of the media delivery server or the UE. The above computer readable storage medium can also be an external storage device of the media delivery server or the UE, for example, a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card and the like equipped on the media delivery server or the UE. Further, the above computer readable storage medium can include both the internal storage unit and the external storage device of the media delivery server or the UE. The above computer readable storage medium is used to store the above computer program and other programs and data required by the media delivery server or the UE. The above computer readable storage medium can also be used to temporarily store data that has been output or will be output.

[0451] Optionally, the embodiments of the present application further provide a computer program product. All or part of the processes in the above method embodiments can be instructed by a computer program to relevant hardware to complete, the program can be stored in the above computer program product, and the program can include the processes of the above method embodiments when executed.

[0452] Optionally, the embodiments of the present application further provide a computer instruction. All or part of the processes in the above method embodiments can be instructed by a computer instruction to relevant hardware (such as a computer, a processor, an access network device, a mobility management network element or a session management network element, etc.) to complete. The program can be stored in the above computer readable storage medium or the above computer program product.

[0453] Those skilled in the art can clearly understand the above-mentioned technical solutions from the description of the above-mentioned embodiments. For the convenience and brevity of description, only the division of the above-mentioned functional modules is taken as an example. In actual application, the above-mentioned functions can be completed by different functional modules according to the needs, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above.

[0454] In several embodiments provided in the present application, it should be understood that the disclosed device and method can be implemented in other ways. For example, the above-described device embodiments are only illustrative. For example, the division of the modules or units is only a logical function division. In actual implementation, another division manner can be adopted. For example, a plurality of units or components can be combined or integrated into another device, or some features can be omitted or not executed. In addition, the coupling or direct coupling or communication connection between the units or components shown or discussed can be indirect coupling or communication connection through some interfaces. The coupling or communication connection can be electrical, mechanical or in other forms.

[0455] The units described as separate components can or can not be physically separate, and the components shown as units can be one physical unit or multiple physical units, that is, can be located in one place or can be distributed in multiple different places. Part or all of the units can be selected according to actual needs to achieve the purpose of the embodiment.

[0456] In addition, each functional unit in each embodiment of the present application can be integrated in one processing unit, or each unit can exist physically, or two or more units can be integrated in one unit. The integrated unit can be realized in the form of hardware or in the form of a software functional unit.

[0457] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any change or replacement within the technical scope disclosed in the present application should be covered in the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. A method for delivering media content, applied to a media delivery server, characterized in that, The method comprises: receiving call service human-computer interaction environment indication information sent by a user equipment, the call service human-computer interaction environment indication information indicating a human-computer interaction environment of a user corresponding to the user equipment during a call service; determining to-be-delivered media content according to the call service human-computer interaction environment indication information, and delivering the to-be-delivered media content to the user equipment during the call service; the determining to-be-delivered media content according to the call service human-computer interaction environment indication information comprises: determining a media form according to the call service human-computer interaction environment indication information, the media form comprising an audio form, a silent video form, a voiced video form or a low-volume video form, a default volume of media content in the low-volume video form being greater than 0 and less than a preset threshold; determining media content conforming to the media form as the to-be-delivered media content; wherein the human-computer interaction environment comprises any one or any combination of: whether a screen of the user equipment is lit up, whether an interface of a call program of the user equipment is visible, whether a hands-free function of the user equipment is turned on, whether a wired earphone of the user equipment is plugged in, whether a wireless earphone of the user equipment is connected, or whether the user is within a visual range of the user equipment.

2. The method of claim 1, wherein, the determining a media form according to the call service human-computer interaction environment indication information comprises: if any one of the following conditions is met, determining the media form to be an audio form: the call service human-computer interaction environment indication information indicates that the screen of the user equipment is turned off, or the call service human-computer interaction environment indication information indicates that the screen of the user equipment is lit up and the interface of the call program of the user equipment is invisible, or the call service human-computer interaction environment indication information indicates that the screen of the user equipment is lit up, the wired earphone of the user equipment is plugged in, and the user is not within the visual range of the user equipment, or the call service human-computer interaction environment indication information indicates that the screen of the user equipment is lit up, the wireless earphone of the user equipment is connected, and the user is not within the visual range of the user equipment.

3. The method of claim 1, wherein, the determining a media form according to the call service human-computer interaction environment indication information comprises: if any one of the following conditions is met, determining the media form to be a voiced video form: the call service human-computer interaction environment indication information indicates that the screen of the user equipment is lit up, the interface of the call program of the user equipment is visible, and the wired earphone of the user equipment is plugged in; or the call service human-computer interaction environment indication information indicates that the screen of the user equipment is lit up, the interface of the call program of the user equipment is visible, and the wireless earphone of the user equipment is connected; or the call service human-computer interaction environment indication information indicates that the screen of the user equipment is lit up, the interface of the call program of the user equipment is visible, the wireless earphone of the user equipment is connected, and the user is within the visual range of the user equipment; or the call service human-computer interaction environment indication information indicates that the screen of the user equipment is lit up, the interface of the call program of the user equipment is visible, the wireless earphone of the user equipment is connected, and the user is within the visual range of the user equipment. The call service man-machine interactive environment indication information indicates that the screen of the user equipment is on, the interface of the call program of the user equipment is visible, the wired earphone of the user equipment is plugged in, and the user is within the visual range of the user equipment.

4. The method of claim 1, wherein, The determining the media form according to the call service man-machine interactive environment indication information comprises: If the call service man-machine interactive environment indication information indicates that the screen of the user equipment is on, the interface of the call program of the user equipment is visible, and the hands-free function of the user equipment is turned on, the media form is determined as a silent video form.

5. The method of claim 1, wherein, The determining the media form according to the call service man-machine interactive environment indication information comprises: If any of the following conditions is met, the media form is determined as a low-pitch video form: The call service man-machine interactive environment indication information indicates that the wired earphone of the user equipment is plugged in; or The call service man-machine interactive environment indication information indicates that the wireless earphone of the user equipment is connected; or The call service man-machine interactive environment indication information indicates that the screen of the user equipment is on, the interface of the call program of the user equipment is visible, the hands-free function of the user equipment is turned off, the wired earphone of the user equipment is not plugged in, the wireless earphone of the user equipment is not connected, and the user is within the visual range of the user equipment.

6. The method of any of claims 1-5, wherein The receiving the call service man-machine interactive environment indication information sent by the user equipment comprises: Receiving a session initiation protocol (SIP) -info message sent by the user equipment, wherein the SIP-info message comprises the call service man-machine interactive environment indication information; or The receiving the call service man-machine interactive environment indication information sent by the user equipment comprises: Receiving a session initiation protocol (SIP) -Notifiication message sent by the user equipment, wherein the SIP-Notifiication message comprises the call service man-machine interactive environment indication information; and before receiving the call service man-machine interactive environment indication information sent by the user equipment, the method further comprises: sending a subscription message to the user equipment, wherein the subscription message is used to subscribe to the call service man-machine interactive environment indication information.

7. The method of any of claims 1-5, wherein The receiving the call service man-machine interactive environment indication information sent by the user equipment comprises: Receiving a request message for requesting media content sent by the user equipment, wherein the request message for requesting media content comprises the call service man-machine interactive environment indication information; The delivering the to-be-delivered media content to the user equipment during the call service comprises: Sending a response message to the request message to the user equipment during the call service, wherein the response message comprises the to-be-delivered media content.

8. The method according to any one of claims 1-5, characterized in that, After determining the to-be-delivered media content according to the call service man-machine interactive environment indication information, the method further comprises: establishing a media channel according to the to-be-delivered media content, the media channel being of a type including an audio media channel or a video media channel, the audio media channel being used to transmit media content in an audio form and / or being used to transmit voice information between user equipment corresponding to the call service during the call service, and the video media channel being used to transmit media content in a video form; delivering the to-be-delivered media content to the user equipment during the call service, including: delivering the to-be-delivered media content to the user equipment through the media channel during the call service. 9.A method for delivering media content, applied to a media delivery server, the method comprising: The method includes: receiving call service human-computer interaction environment indication information sent by the user equipment, the call service human-computer interaction environment indication information indicating a human-computer interaction environment of a user corresponding to the user equipment during the call service; determining to-be-delivered media content according to the call service human-computer interaction environment indication information and delivering the to-be-delivered media content to the user equipment during the call service; The determining to-be-delivered media content according to the call service human-computer interaction environment indication information includes: if any of the following conditions is met, the to-be-delivered media content is determined to be media content for delivering media information through voice: the call service human-computer interaction environment indication information indicates that a screen of the user equipment is turned off; or the call service human-computer interaction environment indication information indicates that the screen of the user equipment is turned on and an interface of a call program of the user equipment is invisible; or the call service human-computer interaction environment indication information indicates that the screen of the user equipment is turned on, a wired earphone of the user equipment is plugged in, and the user is not within a visual range of the user equipment; or the call service human-computer interaction environment indication information indicates that the screen of the user equipment is turned on, a wireless earphone of the user equipment is connected, and the user is not within the visual range of the user equipment; or, the determining to-be-delivered media content according to the call service human-computer interaction environment indication information includes: if any of the following conditions is met, the to-be-delivered media content is determined to be media content for delivering information through an image: the call service human-computer interaction environment indication information indicates that the screen of the user equipment is turned on, an interface of a call program of the user equipment is visible, and a hands-free function of the user equipment is turned off; or the call service human-computer interaction environment indication information indicates that the screen of the user equipment is turned on, the interface of the call program of the user equipment is visible, and the hands-free function of the user equipment is turned on.

10. The method of claim 9, wherein, The human-computer interaction environment includes any one or any combination of the following: whether the screen of the user equipment is turned on, whether an interface of a call program of the user equipment is visible, whether a hands-free function of the user equipment is turned on, whether a wired earphone of the user equipment is plugged in, whether a wireless earphone of the user equipment is connected, or whether the user is within a visual range of the user equipment.

11. The method of claim 9 or 10, wherein The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises:

13. The method of claim 9 or 10, wherein, The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises:

14. A method for delivering media content, applied to a user device, characterized in that, The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and the call service man-machine interaction environment indication information comprises: The call service man-machine interaction environment indication information sent by the user equipment is received, and receiving the media content to be played sent by the media playing server, and presenting the media content to be played by a program unit related to the calling program, wherein the media content to be played is media content conforming to the media form; and detecting whether the screen of the user equipment is lighted up; or detecting whether the interface of the calling program of the user equipment is visible; or detecting whether the hands-free function of the user equipment is turned on; or detecting whether the wired earphone of the user equipment is plugged in; or detecting whether the wireless earphone of the user equipment is connected; or detecting whether the user is within the visual range of the user equipment.

15. The method of claim 14, wherein, If any of the following conditions is met, the media form is an audio form: the calling service human-computer interaction environment indication information indicates that the screen of the user equipment is turned off, or the calling service human-computer interaction environment indication information indicates that the screen of the user equipment is lighted up and the interface of the calling program of the user equipment is invisible, or the calling service human-computer interaction environment indication information indicates that the screen of the user equipment is lighted up, the wired earphone of the user equipment is plugged in, and the user is not within the visual range of the user equipment, or the calling service human-computer interaction environment indication information indicates that the screen of the user equipment is lighted up, the wireless earphone of the user equipment is connected, and the user is not within the visual range of the user equipment.

16. The method of claim 14, wherein, If any of the following conditions is met, the media form is a sound video form: the calling service human-computer interaction environment indication information indicates that the screen of the user equipment is lighted up, the interface of the calling program of the user equipment is visible, and the wired earphone of the user equipment is plugged in; or the calling service human-computer interaction environment indication information indicates that the screen of the user equipment is lighted up, the interface of the calling program of the user equipment is visible, and the wireless earphone of the user equipment is connected; or the calling service human-computer interaction environment indication information indicates that the screen of the user equipment is lighted up, the interface of the calling program of the user equipment is visible, the wireless earphone of the user equipment is connected, and the user is within the visual range of the user equipment; or the calling service human-computer interaction environment indication information indicates that the screen of the user equipment is lighted up, the interface of the calling program of the user equipment is visible, the wired earphone of the user equipment is plugged in, and the user is within the visual range of the user equipment.

17. The method of claim 14, wherein, If the calling service human-computer interaction environment indication information indicates that the screen of the user equipment is lighted up, the interface of the calling program of the user equipment is visible, and the hands-free function of the user equipment is turned on, the media form is a silent video form.

18. The method of claim 14, wherein, If any of the following conditions is met, the media form is a low sound video form: the calling service human-computer interaction environment indication information indicates that the wired earphone of the user equipment is plugged in; or the calling service human-computer interaction environment indication information indicates that the wireless earphone of the user equipment is connected; or The call service man-machine interaction environment indication information indicates that a screen of the user equipment is on, an interface of a call program of the user equipment is visible, a hands-free function of the user equipment is off, a wired earphone of the user equipment is not plugged in, a wireless earphone of the user equipment is not connected, and the user is within a visual range of the user equipment.

19. The method of any of claims 14-18, wherein: the sending of the call service man-machine interaction environment indication information to the media delivery server comprises: sending, to the media delivery server, a session initiation protocol information reporting (SIP-info) message, the SIP-info message comprising the call service man-machine interaction environment indication information; or the sending of the call service man-machine interaction environment indication information to the media delivery server comprises: sending, to the media delivery server, a session initiation protocol notification (SIP-Notification) message, the SIP-Notification message comprising the call service man-machine interaction environment indication information; and the method further comprises, before the sending of the call service man-machine interaction environment indication information to the media delivery server, receiving a subscription message from the media delivery server, the subscription message being used to subscribe to the call service man-machine interaction environment indication information.

20. The method of any of claims 14-18, wherein: the sending of the call service man-machine interaction environment indication information to the media delivery server comprises: sending, to the media delivery server, a request message for requesting media content, the request message for requesting media content comprising the call service man-machine interaction environment indication information; the receiving of the to-be-delivered media content sent by the media delivery server comprises: 21.A method for delivering media content, applied to a user equipment, the method comprising: receiving, from the media delivery server, a response message to the request message, the response message comprising the to-be-delivered media content. The method comprises: obtaining call service man-machine interaction environment indication information, the call service man-machine interaction environment indication information indicating a man-machine interaction environment of a user corresponding to the user equipment during a call service; sending, to a media delivery server, the call service man-machine interaction environment indication information; receiving, from the media delivery server, to-be-delivered media content, and presenting the to-be-delivered media content through a program unit related to a call program; if any of the following conditions is met, the to-be-delivered media content is media content that delivers media information through voice: the call service man-machine interaction environment indication information indicates that a screen of the user equipment is off; or the call service man-machine interaction environment indication information indicates that a screen of the user equipment is on, and an interface of a call program of the user equipment is invisible; or the call service man-machine interaction environment indication information indicates that a screen of the user equipment is on, a wired earphone of the user equipment is plugged in, and the user is not within a visual range of the user equipment; or the call service man-machine interaction environment indication information indicates that a screen of the user equipment is on, a wired earphone of the user equipment is plugged in, and the user is not within a visual range of the user equipment; or The call service man-machine interactive environment indication information indicates that the screen of the user equipment is on, the wireless earphone of the user equipment is connected, and the user is not in the visual range of the user equipment; Or, if any of the following conditions is met, the to-be-launched media content is media content that transmits information through images: The call service man-machine interactive environment indication information indicates that the screen of the user equipment is on, the interface of the call program of the user equipment is visible, and the hands-free function of the user equipment is off; or, The call service man-machine interactive environment indication information indicates that the screen of the user equipment is on, the interface of the call program of the user equipment is visible, and the hands-free function of the user equipment is on.

22. The method of claim 21, wherein, The call service man-machine interactive environment indication information includes at least one of the following: Detect whether the screen of the user equipment is on; or, Detect whether the interface of the call program of the user equipment is visible; or, Detect whether the hands-free function of the user equipment is on; or, Detect whether the wired earphone of the user equipment is plugged in; or, Detect whether the wireless earphone of the user equipment is connected; or, Detect whether the user is in the visual range of the user equipment.

23. The method of claim 21 or 22, wherein The call service man-machine interactive environment indication information is sent to the media launching server, including: Sending a session initiation protocol information reporting SIP-info message to the media launching server, the SIP-info message including the call service man-machine interactive environment indication information; or, The call service man-machine interactive environment indication information is sent to the media launching server, including: Sending a session initiation protocol notification SIP-Notifiication message to the media launching server, the SIP-Notifiication message including the call service man-machine interactive environment indication information; before the call service man-machine interactive environment indication information is sent to the media launching server, the method further includes: receiving a subscription message from the media launching server, the subscription message being used to subscribe to the call service man-machine interactive environment indication information.

24. The method of claim 21 or 22, wherein The call service man-machine interactive environment indication information is sent to the media launching server, including: Sending a request message for requesting media content to the media launching server, the request message for requesting media content including the call service man-machine interactive environment indication information; Receiving the to-be-launched media content sent by the media launching server, including: Receiving a response message of the request message sent by the media launching server, the response message including the to-be-launched media content.

25. A media serving server, comprising: The media launching server includes units or modules for executing the method of any one of claims 1 to 8; or includes units or modules for executing the method of any one of claims 9 to 13.

26. A user equipment, comprising: The user equipment comprises units or modules for performing the method of any one of claims 14 to 20; or comprises units or modules for performing the method of any one of claims 21 to 24.

27. A communication system, characterized by Comprising: a media placement server and a user equipment, the media placement server for performing the method of any one of claims 1 to 8 and the user equipment for performing the method of any one of claims 14 to 20; or the media placement server for performing the method of any one of claims 9 to 13 and the user equipment for performing the method of any one of claims 21 to 24.

Citation Information

Patent Citations

  • Service information pushing method, service information pushing device and user equipment

    CN106713381A

  • Methods and Systems for Reducing Customer Service Calls

    US20200162612A1