Method and system for interacting position information of two parties of call based on new video call

Abstract

The invention discloses a new video call-based position information interaction method and system for both call parties, and the method comprises the steps: S1, enabling a user to initiate a call, and building a call; s2, after the call is established, synchronously acquiring position information of both parties of the call and drawing a map; s3, in the call process, waiting for a position information interaction starting instruction of the calling terminal and the called terminal, and if the position information interaction starting instruction of the calling terminal and the called terminal is received, putting the drawn map pictures on corresponding terminal screens of the calling terminal and the called terminal; and S4, after the position information interaction process is started, regularly refreshing the drawn map picture until the call is ended or a position information interaction ending instruction is received. According to the invention, by using a related technical framework of a new call service, real-time rapid interaction of the position information of the two parties is realized without depending on any social software, the positions of the two parties in the call can be displayed on mobile phone terminal screens of the two parties in real time, and interaction and sharing of the position information of the two parties in the call are realized.

Description

Technical Field

[0001] This invention relates to the field of wireless communication technology, and in particular to a method and system for exchanging location information between two parties in a video call. Background Technology

[0002] Currently, common location information exchange between two or more parties in a video call is mostly based on location sending and location sharing functions provided within apps (such as WeChat and Gaode Maps). For example, Chinese invention patent CN110022528A discloses a method and device for displaying location information based on video calls. During a video call with a wearable device, the method receives the wearable device's location information and corresponding time information in real time; it uses the location information to call an electronic map to mark the wearable device's location on the electronic map; and it displays the electronic map with the wearable device's location marked on it in real time on the video call interface based on the corresponding time information. The technical solution provided in this application marks the wearable device's real-time location on an electronic map and displays it on the video call interface, so that the mobile terminal can know the wearable device's location in real time during the video call. This also allows parents to better monitor their child's activities by knowing the location of their child's wearable device. In this solution, it is actually necessary to install the corresponding APP software on the user's terminal. That is, the user needs to install, launch, and operate the corresponding APP to complete the exchange of location information between the two parties. It can be seen that the existing video call location interaction operation is relatively cumbersome and relies on mobile APP software, which is not convenient enough. It cannot well meet the location information interaction needs of both parties in unexpected situations, and further design and improvement are needed. Summary of the Invention

[0003] To address the aforementioned problems, this invention provides a method for exchanging location information between two parties in a new video call, comprising the following steps:

[0004] S1, the user initiates a call, and the call is established;

[0005] S2, after the call is established, the location information of both parties in the call is obtained and the map is drawn simultaneously;

[0006] S3, during the call, wait for the location information interaction start command of the calling and called terminals. If the location information interaction start command is received from the calling and called terminals, the drawn map image will be projected onto the corresponding terminal screens of the calling and called terminals.

[0007] S4, after initiating the location information interaction process, periodically refreshes the drawn map image until the call ends or a location information interaction end command is received.

[0008] As a further explanation of the present invention, in step S2, a suitable map image is selected based on the real-time location and physical distance between the calling and called parties, and the real-time location of the calling and called parties is marked on the map image.

[0009] Furthermore, the location information interaction start command and location information interaction end command are mobile phone key commands and / or voice commands.

[0010] Furthermore, in step S3, key operation commands during the call between the calling and called terminals are detected in real time, and the location information interaction between the calling and called terminals is initiated by comparing preset key information to achieve key activation.

[0011] Alternatively, real-time detection of voice keywords during the call between the caller and the called party can be used to initiate location information interaction between the caller and the called party by capturing keywords in the voice data of both parties in real time, thereby achieving voice-activated communication.

[0012] Furthermore, in step S3, the map image is displayed in a floating map window on the display screens of the calling and called terminals.

[0013] Furthermore, when the map image is displayed in a floating window, a specific scale area map is displayed based on the physical distance between the calling and called parties, and the real-time location information of both parties in the call is marked on the map.

[0014] Furthermore, the voice command activation process in step S3 includes the following steps:

[0015] S301: A command word appears in the audio of the RTP media stream during a call between one of the calling or called parties;

[0016] S302: The speech recognition server captures keywords and triggers an event to be sent to the instruction processing module;

[0017] S303: The instruction processing module completes user authentication, confirms that the user has subscribed to the service, and sends a message to the RTP processing module to request confirmation from the other party in the call.

[0018] S304: Add subtitles to the media stream to the RTP processing module to prompt the other party in the call whether to enable location sharing;

[0019] S305: The other party in the call responded that a command word appeared in the audio of the RTP media stream;

[0020] S306: The real-time map for the call is activated. The location information acquisition module of both parties uses technologies such as cell positioning to locate both parties in the call and reports the location coordinates of both parties to the real-time map drawing module.

[0021] S307: The real-time map drawing module queries the database to match specific map images based on the position coordinates of both parties, marks the positions of both parties in the map images, generates new images, and sends them to the RTP processing module;

[0022] S308: The RTP processing module adds a map image with coordinates marked on both parties to the media streams of both parties in the call. The map image is displayed on the screens of both mobile terminals.

[0023] On the other hand, the present invention also provides a location information interaction system for both parties in a video call, including a user command processing module, a location information acquisition module for both parties in the call, a real-time map drawing module, a map database, a call media stream RTP processing module, and a voice recognition server.

[0024] The user instruction processing module is used to process user instructions to start or close the map;

[0025] The module for acquiring the location information of both parties in a call is used to periodically acquire the location information of both parties in a call when the real-time map is activated.

[0026] The real-time map drawing module is used to select a suitable map image based on the real-time location and physical distance between the calling and called parties, and mark the real-time location of the calling and called parties on the map image.

[0027] The map database is used to store map data;

[0028] The speech recognition server is used to capture keywords in the voice data of both parties in a call in real time and generate specific business control instructions to be sent to the instruction processing module.

[0029] The beneficial effects of this invention are:

[0030] This invention utilizes the technical framework of new calling services to incorporate the location information of both parties into video calls, enabling real-time and rapid interaction of their location information. Without relying on any social media software, the locations of both parties can be displayed on each other's mobile phone screens in real time, facilitating the exchange and sharing of location information. For end users, location information exchange between the two parties can be conveniently and quickly completed directly within a basic call, without the need for social media software, greatly enhancing the user experience. For operators, it provides a breakthrough channel to enter the internet location-based services market, satisfying their desire to leverage their absolute advantage in basic calling services to seek new business growth points. Attached Figure Description

[0031] Figure 1 This is a flowchart of the method for exchanging location information between two parties in a new video call based on the present invention. Detailed Implementation

[0032] The embodiments of the present invention will now be described in detail with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments.

[0033] In the description of this invention, it should be understood that the terms "upper", "lower", "front", "rear", "left", "right", "top", "bottom", "inner", "outer", "first", "second", etc., indicate the orientation, position or order relationship based on the orientation, position or order relationship shown in the drawings, and are only for the convenience of describing this invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation, and therefore should not be construed as a limitation of this invention.

[0034] A method for exchanging location information between two parties in a new video call, comprising the following steps:

[0035] S1, the user initiates a call, and the call is established;

[0036] S2, after the call is established, the location information of both parties in the call is obtained and the map is drawn simultaneously;

[0037] S3, during the call, wait for the location information interaction start command of the calling and called terminals. If the location information interaction start command of the calling and called terminals is received, the drawn map image will be projected onto the corresponding terminal screens of the calling and called terminals.

[0038] S4, after initiating the location information interaction process, periodically refreshes the drawn map image until the call ends or a location information interaction end command is received.

[0039] This invention utilizes the technical framework of new calling services to incorporate the location information of both parties into video calls, enabling real-time and rapid interaction of their location information. Without relying on any social media software, the locations of both parties can be displayed on each other's mobile phone screens in real time, facilitating the exchange and sharing of location information. For end users, location information exchange between the two parties can be conveniently and quickly completed directly within a basic call, without the need for social media software, greatly enhancing the user experience. For operators, it provides a breakthrough channel to enter the internet location-based services market, satisfying their desire to leverage their absolute advantage in basic calling services to seek new business growth points.

[0040] In a preferred embodiment, in step S2, a suitable map image is selected based on the real-time location and physical distance between the calling and called parties, and the real-time location of the calling and called parties is marked on the map image to create a map image required for the interaction of location information between the two parties.

[0041] In this embodiment, the location information interaction start command and location information interaction end command are mobile phone button commands and / or voice commands. Taking the voice command start method as an example, speech recognition is a mature existing language processing technology, mainly a technology that converts human speech signals into text or commands. In practical applications, it can detect voice keywords in the caller and called party's conversation in real time, and start the location information interaction of the caller and called party terminals by capturing keywords in the voice data of both parties in real time, thus realizing voice start. The application environment of the caller and called party in the actual application of this embodiment is described as follows:

[0042] Caller A: "Where are you?"

[0043] Caller B: "I'm in front of this building, the one with three flagpoles at the entrance."

[0044] Caller A: "Which building is it in front of? I can't see three flagpoles. Can we share our location during the call?"

[0045] Caller B: "Okay."

[0046] Caller B: "Start, where am I?" — This is a voice recognition command from the background system, which retrieves B's location information and displays a nearby map and B's location marker on both phones in real time.

[0047] Caller A: "Start, where am I?" — This is a voice recognition command from the background system. It retrieves A's location information and displays a nearby map and A's location marker on both phones in real time.

[0048] Caller B: "I see your location. I'm in front of this building, and you're behind it. Just walk around the building to the front and you'll see me."

[0049] The two parties in the call exchanged their respective location information.

[0050] Similarly, in step S3, the present invention can also detect key operation commands during the call between the calling and called terminals in real time, and start the location information interaction between the calling and called terminals by comparing preset key information to realize key activation. That is, the activation key for the location information interaction between the two parties in the call is set in advance. When the input operation of the predetermined activation key is detected during the call, the location information interaction process can be activated by key activation.

[0051] In step S3 of this embodiment, the map image is displayed as a floating map window on the screens of the calling and called terminals. Unlike existing video call systems where both parties can only see the view captured by each other's cameras, in the system described in this invention, both parties' mobile terminal screens display a floating map window above the view captured by the other party's camera. When the map image is displayed as a floating window, a map of a specific scale is displayed in this window according to the physical distance between the calling and called parties, and the real-time location information of both parties is marked on the map.

[0052] The voice command activation process steps in step S3 of this embodiment include:

[0053] S301: A command word appears in the audio of the RTP media stream during a call between one of the calling or called parties;

[0054] S302: The speech recognition server captures keywords and triggers an event to be sent to the instruction processing module;

[0055] S303: The instruction processing module completes user authentication, confirms that the user has subscribed to the service, and sends a message to the RTP processing module to request confirmation from the other party in the call.

[0056] S304: Add subtitles to the media stream to the RTP processing module to prompt the other party in the call whether to enable location sharing;

[0057] S305: The other party in the call responded that a command word appeared in the audio of the RTP media stream;

[0058] S306: The real-time map for the call is activated. The location information acquisition module of both parties uses technologies such as cell positioning to locate both parties in the call and reports the location coordinates of both parties to the real-time map drawing module.

[0059] S307: The real-time map drawing module queries the database to match specific map images based on the position coordinates of both parties, marks the positions of both parties in the map images, generates new images, and sends them to the RTP processing module;

[0060] S308: The RTP processing module adds a map image with coordinates marked on both parties to the media streams of both parties in the call. The map image is displayed on the screens of both mobile terminals.

[0061] To achieve the aforementioned location information interaction between the two parties in a new video call, the corresponding location information interaction system for the two parties in a new video call includes a user command processing module, a location information acquisition module for both parties, a real-time map drawing module, a map database, a call media stream RTP processing module, and a speech recognition server.

[0062] The user instruction processing module is used to process user instructions to start or close the map;

[0063] The module for acquiring the location information of both parties in a call is used to periodically acquire the location information of both parties in a call when the real-time map is activated.

[0064] The real-time map drawing module is used to select a suitable map image based on the real-time location and physical distance between the calling and called parties, and mark the real-time location of the calling and called parties on the map image.

[0065] The map database is used to store map data;

[0066] The speech recognition server is used to capture keywords in the voice data of both parties in a call in real time and generate specific business control instructions to be sent to the instruction processing module.

[0067] The above description only illustrates preferred embodiments of the present invention and should not be construed as limiting the scope of the claims. The present invention is not limited to the above embodiments, and variations in its specific structure are permitted. In short, all variations made within the scope of the independent claims of the present invention are within the scope of protection of the present invention.

Claims

1. A method for exchanging location information between two parties in a new video call, characterized in that, Includes the following steps: S1, the user initiates a call, and the call is established; S2, after the call is established, the location information of both parties in the call is obtained and the map is drawn simultaneously; S3, during the call, wait for the location information interaction start command of the calling and called terminals. If the location information interaction start command of the calling and called terminals is received, the drawn map image will be projected onto the corresponding terminal screens of the calling and called terminals. S4, after initiating the location information interaction process, periodically refreshes the drawn map image until the call ends or a location information interaction end command is received.

2. The method for exchanging location information between two parties in a new video call according to claim 1, characterized in that: In step S2, a suitable map image is selected based on the real-time location and physical distance between the calling and called parties, and the real-time location of the calling and called parties is marked on the map image.

3. The method for exchanging location information between two parties in a new video call according to claim 1, characterized in that: The location information interaction start command and location information interaction end command are mobile phone key commands and / or voice commands.

4. The method for exchanging location information between two parties in a new video call according to claim 3, characterized in that: In step S3, key operation commands during the call between the calling and called terminals are detected in real time, and the location information interaction between the calling and called terminals is initiated by comparing preset key information to achieve key activation. Alternatively, real-time detection of voice keywords during the call between the caller and the called party can be used to initiate location information interaction between the caller and the called party by capturing keywords in the voice data of both parties in real time, thereby achieving voice-activated communication.

5. The method for exchanging location information between two parties in a new video call according to claim 1, characterized in that: In step S3, the map image is displayed in a floating map window on the display screens of the calling and called terminals.

6. The method for exchanging location information between two parties in a new video call according to claim 5, characterized in that: When the map image is displayed in a floating window, a map of a specific scale is displayed based on the physical distance between the calling and called parties, and the real-time location information of the two parties in the call is marked on the map.

7. The method for exchanging location information between two parties in a new video call according to claim 3, characterized in that: The voice command activation process in step S3 includes the following steps: S301: A command word appears in the audio of the RTP media stream during a call between one of the calling or called parties; S302: The speech recognition server captures keywords and triggers an event to be sent to the instruction processing module; S303: The instruction processing module completes user authentication, confirms that the user has subscribed to the service, and sends a message to the RTP processing module to request confirmation from the other party in the call. S304: Add subtitles to the media stream to the RTP processing module to prompt the other party in the call whether to enable location sharing; S305: The other party in the call responded that a command word appeared in the audio of the RTP media stream; S306: The real-time map for the call is activated. The location information acquisition module of both parties uses technologies such as cell positioning to locate both parties in the call and reports the location coordinates of both parties to the real-time map drawing module. S307: The real-time map drawing module queries the database to match specific map images based on the position coordinates of both parties, marks the positions of both parties in the map images, generates new images, and sends them to the RTP processing module; S308: The RTP processing module adds a map image with coordinates marked on both parties to the media streams of both parties in the call, and the map image is displayed on the screens of both parties' mobile terminals.

8. A system for exchanging location information between two parties in a video call, characterized in that: It includes a user command processing module, a location information acquisition module for both parties in the call, a real-time map drawing module, a map database, a call media stream RTP processing module, and a voice recognition server; The user instruction processing module is used to process user instructions to start or close the map; The module for acquiring the location information of both parties in a call is used to periodically acquire the location information of both parties in a call when the real-time map is activated. The real-time map drawing module is used to select a suitable map image based on the real-time location and physical distance between the calling and called parties, and mark the real-time location of the calling and called parties on the map image. The map database is used to store map data; The speech recognition server is used to capture keywords in the voice data of both parties in a call in real time and generate specific business control instructions to be sent to the instruction processing module.

Images