Social communication application system based on mobile communication terminal

By designing a social communication application system based on mobile communication terminals, the inconvenience of strangers' friendship, difficulties in the lives of blind and deaf people in the existing technology, and embarrassing problems in the AA payment process, achieving more convenient friendship and help requests and consumer payment experience.

CN119444464APending Publication Date: 2025-02-14郑贤良
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202411452970.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-10-17
Publication Date
2025-02-14

AI Technical Summary

Technical Problem

The existing social communication tools are not friendly to strangers to make friends, especially for blind or deaf people who are inconvenient to seek help in life, and there are embarrassing and unnecessary troubles in realizing AA payment when two or more people who are not inviting to spend together. .

Method used

A social communication application system based on mobile communication terminal was designed, including search module, friend module, super friend module, deaf and dumb help module and blind help module. The portrait data of strangers is identified through the camera and automatically searches their social communication account. , and realize the function of adding friends or super friends; when blind or deaf people need help, the system can find volunteer accounts and provide help; in super friends relationships, the system automatically realizes AA payment, avoiding the hassle of transfer operations.

Benefits of technology

The system improves the convenience of making friends with strangers, especially for blind and deaf people, which can seek volunteer help more quickly, solving the inconvenience of travel and communication; at the same time, it realizes automatic AA payment during joint consumption , simplifies the payment process and avoids forgetfulness and embarrassment.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119444464A_ABST
    Figure CN119444464A_ABST
Patent Text Reader

Abstract

The invention provides a social communication application system based on a mobile communication terminal, and belongs to the technical field of electronics. The problem that an existing social communication tool cannot provide convenience for life is solved. The social communication application system based on the mobile communication terminal comprises a searching module used for starting a camera to search a social account of a volunteer or a social communication account of a designated person in a picture; the friend module is used for initiating a friend adding request and entering a communication interface after the request is agreed; the super friend module is used for initiating a super friend adding request, creating and generating an AA payment wallet when the request is agreed and entering a communication interface; the deaf-mute help seeking module is used for obtaining the help of the on-site volunteer or translating the on-site sound and correcting wrong translation under the assistance of the remote volunteer; and the blind person help seeking module is used for obtaining the help of the on-site volunteer or starting a navigation guidance function and arriving at the destination under the guidance of the remote volunteer. According to the invention, life convenience can be improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the field of electronic technology and relates to a social communication application system based on a mobile communication terminal. Background Art

[0002] With the advancement of the science and technology information age, social communication tools such as WeChat and DingTalk have become indispensable communication tools in people's lives, bringing considerable help to people's production activities and social activities.

[0003] At present, most social communication tools provide users with the function of searching for other users and adding them as contacts, but this search is mainly based on instant messaging accounts, user nicknames or user mobile phone numbers. If two strangers want to add each other as friends, they need to approach and chat to learn each other's communication accounts before they can become friends. It can be seen that the current social communication tools are not friendly to strangers making friends. For those who are embarrassed to approach and chat, they will miss the friends they want to make. For this reason, a communication method based on social communication tools with application number CN202011549752.5 solves this problem. It can establish communication between two strangers without knowing the social account, which provides convenience for people to make friends and avoids the embarrassing situation of making friends. However, the existing social communication tools are mainly used for normal people, and are not friendly to the blind or deaf-mute people. When the blind or deaf-mute people need help in life, it is difficult to seek help through social communication tools, which is very inconvenient.

[0004] In addition, although existing social communication tools also have payment functions, sometimes consumption is not done by one person. When two or more people consume together and are not in a treat state, in order to realize AA payment, usually one person pays the total amount, and then divides the total amount with the total number of people participating in the consumption. After the amount is divided, the other people participating in the consumption are reminded to pay. Sometimes they may forget to pay after a single reminder. If they are reminded frequently by humans, it will be a bit embarrassing and cause some unnecessary trouble, which is very inconvenient. Summary of the invention

[0005] The purpose of the present invention is to address the above-mentioned problems existing in the prior art and to propose a social communication application method based on a mobile communication terminal. The technical problem to be solved is: how to improve the convenience of life.

[0006] The object of the present invention can be achieved by the following technical solutions: A social communication application system based on a mobile communication terminal, the social communication application system comprising:

[0007] A search module is used to start the camera to search for the social accounts of volunteers in the camera screen range or to start the camera to search for the social communication accounts of designated persons in the camera screen and issue a prompt to add ordinary friends or super friends;

[0008] The friend module is used to initiate a friend request based on the social communication account found when adding ordinary friends, and enter the communication interface after the other party agrees to the request;

[0009] The super friend module is used to initiate a request to add a super friend based on the social communication account found or when applying to become a super friend through the friend module when choosing to add a super friend, and when the other party agrees to the request, create an AA payment wallet for AA payment when consuming together with the super friend and enter the super friend communication interface;

[0010] The help-seeking module for the deaf and mute is used to initiate a request for loving assistance based on the social accounts of the volunteers found, and obtain help from on-site volunteers when the other party agrees to the request, or to translate the on-site sound when there are no on-site volunteers and correct the wrong translation with the assistance of remote volunteers;

[0011] The blind help module is used to initiate a love help request based on the volunteer social account found, and obtain help from on-site volunteers when the other party agrees to the request, or to enable the navigation guidance function when there are no on-site volunteers and reach the destination under the guidance of remote volunteers;

[0012] The blind person help module, the deaf-mute person help module, the friend module and the super friend module are all connected to the search module, and the friend module is connected to the super friend module.

[0013] This social communication application system based on mobile communication terminal can automatically obtain the stranger's social account by starting the search module when the stranger's social account is unknown, and realize adding the stranger as an ordinary friend or super friend, which provides convenience for making friends. Moreover, when choosing to add as a super friend, the super friend module can also establish a common AA payment wallet with the other party while establishing communication and communication, so as to realize automatic AA payment when consuming together, without the need for operations such as transfer between two people, and consumption is more convenient. When the blind or deaf-mute person needs help, the search module is started to find whether there are on-site volunteers within the camera range and obtain the volunteer's social account. When there are on-site volunteers, the deaf-mute help module and the blind help module find on-site volunteers for help according to the volunteer's social account. When there are no volunteers on the scene, the help of remote volunteers outside the camera range can be sought. The remote volunteers can remotely correct the guidance errors or on-site sound translation errors in the system, help the blind to complete safe travel, and the deaf-mute to achieve normal communication, such as the problem of inconvenience caused by not being able to hear the sound in scenes such as queuing and calling. The operation is simple and convenient, which provides convenience for the lives of the blind and deaf-mute people. This system has various functions and can solve the problems that different people have in their lives, providing convenience for life and effectively improving the quality of life.

[0014] In the above-mentioned social communication application system based on the mobile communication terminal, the social communication application system further includes:

[0015] The back-check module is used to start the camera when receiving a request to add a friend, a request to add a super friend, a request for love assistance, or a request for love help, and indicate the location of the requester through the camera screen. The setting of the back-check module allows the party being added to know the portrait information of the other party, providing a first impression of friendship, making friendship more transparent, improving the success and stability of friendship, and avoiding the situation where the person is added at the time and then deleted later. In addition, this back-check function module can also help volunteers find the requester so as to provide on-site help as soon as possible.

[0016] In the above-mentioned social communication application system based on the mobile communication terminal, the social communication application system further includes:

[0017] The Xiuqiu module is used to obtain the social communication accounts of each user through the transmission of preset information between social users, and send a friend request or super friend request to the selected social communication account according to the user's choice. It provides another way for strangers to make friends and expands the friendship function.

[0018] In the above-mentioned social communication application system based on mobile communication terminal, the search module includes:

[0019] The friend search submodule is used to start the camera to search for the social communication account of the specified person in the camera image. The operations include:

[0020] Generate a camera start command to control the camera to start the camera function;

[0021] Click on the person pre-added as a friend in the camera image to identify and obtain the person's portrait data, which includes the person's physical feature information and the person's location information;

[0022] The location information of the person being searched is obtained by the terminal device through conversion based on the location information of the searcher, the distance data and the direction data between the searcher and the person being searched;

[0023] The corresponding social communication account is obtained by searching from the social data center through the physical feature information of the person being searched and / or the location information of the person being searched.

[0024] The location information of the person being searched is obtained by the terminal device using the Pythagorean theorem to convert the location information of the searcher, the distance data between the searcher and the person being searched, and the direction data. In addition to this method, the location information of the person being searched can also be obtained in other ways.

[0025] In the above-mentioned social communication application system based on mobile communication terminal, the physical characteristic information includes clothing characteristics, height characteristics, appearance characteristics and gender characteristics;

[0026] When searching for a social communication account based on the physical feature information, the corresponding social communication account is searched from the social data center according to the appearance and / or clothing features, height features, and gender features in the physical feature information.

[0027] The application of the friend search submodule provides convenience for strangers to make friends and solves the embarrassment of approaching and chatting. When searching, the latitude and longitude data of the person being searched can be obtained, and the social communication account of the person being searched can be accurately obtained based on the latitude and longitude data. When searching for the social communication account of the person being searched based on physical characteristics, in addition to searching by appearance, this system can also search based on clothing characteristics, height characteristics, and gender characteristics, that is, when the person being searched is a portrait of the back, the social communication account of the person being searched can also be obtained, and the social communication account is obtained more conveniently. In addition, the above search methods can be combined to achieve more accurate acquisition of the social communication account of the person being searched, improving the accuracy of making friends.

[0028] In the above-mentioned social communication application system based on mobile communication terminal, the search module also includes a volunteer search submodule and a volunteer setting module for selecting whether to become a volunteer, and the volunteer setting module is connected to the volunteer search submodule.

[0029] In the above-mentioned social communication application system based on the mobile communication terminal, the volunteer search submodule is also connected to a first preset love help button and a second preset love help button. The volunteer search submodule is used to start the camera to search for the volunteer social account in the camera screen range when receiving the signal of the first preset love help button or the second preset love help button being pressed.

[0030] The volunteer search submodule can find volunteers when help is needed. With the help of volunteers, problems such as unfamiliar road conditions or language communication barriers can be solved, which improves the convenience of daily travel for blind and deaf-mute people. The setting of the first preset love help button and the second preset love help button provides convenience for blind or deaf-mute people to seek help.

[0031] In the above-mentioned social communication application system based on the mobile communication terminal, the operation of starting the camera to search for the social account of the volunteer within the camera screen range includes:

[0032] Identify and obtain portrait data of each person in the camera image range, wherein the portrait data includes body feature information and position information, wherein the body feature information includes clothing features, height features, appearance features, and gender features;

[0033] The position information of each person is obtained by the terminal device through conversion based on the position information of the person requesting help and the distance data and direction data of each person in the camera screen range;

[0034] Based on the physical feature information and / or location information of each person, the social account of the volunteer is searched from the social data center, and the social account of the volunteer is output when the volunteer exists.

[0035] When searching based on physical feature information, the corresponding social communication account can be searched from the social data center according to the appearance and / or clothing features, height features, and gender features in the physical feature information.

[0036] The location information of the person requesting help is obtained through the terminal device. According to the distance data and orientation data between the person in the camera screen and the person requesting help, the distance data between the person requesting help and the person in the camera screen can be obtained through the terminal distance measurement technology. Specifically, it can be calculated by capturing the person in the camera screen, combining the terminal camera lens parameters, and measuring the image distance after focusing. The orientation data of the person in the camera screen of the terminal camera is identified by the terminal orientation recognition technology. The distance data and orientation data can also be obtained in other ways. After that, the distance data, orientation data and the location information of the person requesting help are converted using the Pythagorean theorem to obtain the location information of each person in the lens screen. According to the location information, the social account of the corresponding person is obtained from the social data center. The location information includes latitude and longitude data, altitude data, etc. When the user turns on the volunteer function through the volunteer setting module, the social account can be used to determine whether it is a volunteer, thereby obtaining the volunteer social account, and realizing the accurate search of the volunteer social account.

[0037] In the above-mentioned social communication application system based on mobile communication terminal, the super friend module includes:

[0038] The collaborative submodule is used for shopping, selecting products and placing orders during joint consumption;

[0039] The AA payment submodule is used to create an AA payment wallet for two super friends to consume together and set the same balance to be deposited; when one of the super friends initiates payment to the merchant after the super friends consume together, the corresponding AA amount is deducted and the distance value between the super friends is detected according to the terminal positioning function. When the distance value is less than or equal to the preset value, the same AA amount is directly deducted from the other party's AA payment wallet; when the distance value is greater than the preset value, the system platform advances the other half of the AA amount and sends a deduction reminder to the other party. If the payment is not made within the preset payment time value, the initiator pays the other half of the AA amount to the system platform.

[0040] The balances of people who add each other as super friends are set to be the same to ensure that AA payment is implemented more effectively. This AA payment is used for long-term AA payment between super friends. The number of people is limited to two people to avoid trouble and avoid the situation where too many people cannot meet AA consumption at the same time. When making AA payment through this system, when one person pays, only half of the amount needs to be deducted. When the distance value between super friends is greater than the preset value, the other half will be paid from the system platform first to ensure fast checkout. According to the terminal positioning function to detect the distance value between the super friend, it is decided whether to deduct money directly or send a reminder first according to the distance value. If the distance is within the preset value, it means that the other party is consuming together, then the money will be deducted directly to avoid trouble. When the distance is greater than the preset value, a payment reminder will be issued to ensure the safety of funds. After payment, the amount will be returned to the system platform. If the payment is not made within the preset time, the initiator will pay the other half of the AA amount to the system platform. Through the use of this AA payment function, the embarrassment of negotiating AA every time is reduced, and the embarrassment of asking the other party for AA or reminding AA repayment is eliminated, which provides convenience for life consumption.

[0041] In the above-mentioned social communication application system based on mobile communication terminal, the super friend module also includes:

[0042] The loan submodule is used to borrow the AA amount from the system platform; after the loan, the AA payment submodule transfers the same amount from the AA payment wallet to the personal balance wallet;

[0043] The super friend removal submodule is used to automatically remove the super friend association when the balances in the super friend's AA payment wallet are different and remain different within a preset time;

[0044] The payment password submodule is used to deduct the amount from the corresponding wallet according to the payment password when the payment password of the AA payment wallet is different from the payment password of the personal balance wallet; when the payment password of the AA payment wallet is the same as the payment password of the personal balance wallet, select the corresponding wallet for deduction;

[0045] The payment password submodule, super friend release submodule and loan payment submodule are all connected to the AA payment submodule.

[0046] The setting of the super friend release submodule ensures that AA consumption is carried out in an equal and friendly state to avoid inequality. The setting of the payment password submodule ensures that payment is more convenient and improves convenience. The setting of the loan payment submodule provides a variety of options for consumer payment. When completing AA payment through the loan payment submodule, in order to ensure that the balance of the super friend AA payment wallet is the same, the same amount as the AA payment amount is transferred from the AA payment wallet to the personal balance wallet.

[0047] In the above-mentioned social communication application system based on mobile communication terminal, the deaf-mute help module includes:

[0048] The on-site volunteer submodule is used to establish a chat communication when the on-site volunteer agrees to the request. When the sign language input function in the chat dialogue page is selected, the terminal camera is started, and the terminal camera captures the sign language action and displays the sign language camera image in the chat dialogue page in the form of picture-in-picture. At the same time, the sign language is translated into text according to the sign language information pre-stored in the system, and input into the chat dialogue page to send to the volunteer;

[0049] The output selection submodule is used to select the language of output text and browsing text and to select whether to enable the translated text browsing function;

[0050] The remote volunteer correction submodule is used to translate the received on-site broadcast content into text and sign language video when there are no on-site volunteers, and at the same time send a help message to the remote volunteers outside the camera screen range, and the remote volunteers will assist in correcting the translation errors.

[0051] The setting of the on-site volunteer submodule enables them to communicate directly through sign language, which makes communication more convenient. In addition, the system can also select the communication language. For example, if the deaf-mute chooses sign language, then no matter whether the text or sound is sent, the deaf-mute can receive both text and sign language through picture-in-picture, which improves the convenience of communication and avoids the communication barrier of language barrier. The setting of the remote volunteer correction submodule can provide help through remote volunteers when there is a lack of volunteers on site, further improving the convenience of deaf-mute travel.

[0052] In the above-mentioned social communication application system based on mobile communication terminal, the blind help module includes:

[0053] The on-site volunteer communication submodule is used to automatically connect the video call when the on-site volunteer agrees to the request and obtain help from the on-site volunteer;

[0054] The remote volunteer guidance submodule is used to ask whether help is needed when there are no volunteers on site, and to send a request for help to remote volunteers outside the camera's field of view. When help is needed, the terminal camera is started to capture the blind person's surrounding environment data, and a guidance image and guidance sound of the blind person's walking direction are generated based on the surrounding environment data and synchronously fed back to the terminal of the remote volunteer who agrees to the request for help. When there is a guidance error, the error correction prompt sent by the remote volunteer is received.

[0055] In addition to the help of on-site volunteers, remote help from remote volunteers can also be provided to the applicant to avoid errors during the system boot process without the applicant being aware of the error. Then, through the remote volunteer guidance sub-module, remote help from remote volunteers can be obtained to correct the error and help the applicant reach the destination safely, providing further convenience for people who have difficulty traveling.

[0056] Compared with the existing technology, this social communication application system based on mobile communication terminal has the following advantages:

[0057] 1. The present invention can enable strangers to make friends without knowing the strangers' social accounts, providing convenience for making friends. When the blind or deaf-mute people are in trouble, they can seek help from volunteers more quickly through this system. When there are no on-site volunteers, remote volunteers can provide remote guidance, so that the things sought can be executed or obtained more safely and accurately, solving the existing inconvenience of blind or deaf-mute people in traveling. Through the use of this system, the convenience of life is improved.

[0058] 2. The present invention also designs an AA payment function, which can establish a long-term AA payment relationship with another person, share the consumption in life, improve the quality of life, and avoid the impact of money on relationships. At the same time, it also solves the problem of existing AA payment, where one person pays the full amount and the others transfer the money, which is easy to forget and cause unnecessary troubles, thereby improving the convenience of life consumption. BRIEF DESCRIPTION OF THE DRAWINGS

[0059] Figure 1 It is a control structure schematic diagram of the present invention.

[0060] In the figure, 1. search module; 11. friend search submodule; 12. volunteer search submodule; 13. volunteer setting module; 2. friend module; 3. super friend module; 31. joint collaboration submodule; 32. AA payment submodule; 33. loan payment submodule; 34. super friend release submodule; 35. payment password submodule; 4. deaf-mute help module; 41. on-site volunteer submodule; 42. remote volunteer correction submodule; 43. output selection submodule; 5. blind help module; 51. on-site volunteer communication submodule; 52. remote volunteer guidance submodule; 6. review module; 7. hydrangea module; 8. first preset love help button; 9. second preset love help button. DETAILED DESCRIPTION

[0061] In order to make the purpose, technical scheme and advantages of the present invention clearer, the embodiments of the present invention will be further described in detail below in conjunction with the accompanying drawings. The following description of at least one exemplary embodiment is actually only illustrative and is by no means intended to limit the present invention and its application or use. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0062] like Figure 1 As shown, the social communication application system based on the mobile communication terminal includes: a search module 1, a friend module 2, a super friend module 3, a deaf-mute help module 4, a blind help module 5, a back-check module 6, a hydrangea module 7, a first preset love help button 8 and a second preset love help button 9. The friend module 2, the super friend module 3, the deaf-mute help module 4 and the blind help module 5 are all connected to the search module 1, the friend module 2 and the super friend module 3 are all connected to the hydrangea module 7, and the back-check module 6 is respectively connected to the friend module 2, the super friend module 3, the deaf-mute help module 4 and the blind help module 5. The search module 1 includes a friend search submodule 11, a volunteer search submodule 12 and a volunteer setting module 13. The first preset love help button 8 and the second preset love help button 9 are both connected to the volunteer search submodule 12, which is used to start the volunteer search submodule 12 when the first preset love help button 8 or the second preset love help button 9 is pressed, and obtain the volunteer social account through the volunteer search submodule 12. The volunteer setting module 13 allows the user to freely choose whether to become a volunteer. In addition, this system can also add a rating function module to score points for the good deeds done by volunteers. By accumulating points, different levels of honor can be obtained, providing motivation for volunteers to do good deeds. It can also be used to measure each person's personality and temperament based on whether the text words, voice expectations and other behaviors in daily chat content are gentle, so as to rate each social account. The rating results will be displayed for reference when adding friends through friend search in the future, in order to give certain recognition to the volunteers' loving help. Points can be exchanged for gifts, such as daily necessities or virtual items.

[0063] The super friend module 3 includes a joint collaboration submodule 31, an AA payment submodule 32, a loan payment submodule 33, a super friend release submodule 34 and a payment password submodule 35, and the loan payment submodule 33, the super friend release submodule 34 and the payment password submodule 35 are all connected to the AA payment submodule 32. The deaf-mute help module 4 includes an output selection submodule 43, an on-site volunteer submodule 41 and a remote volunteer correction submodule 42, and the output selection submodule 43 is connected to the on-site volunteer submodule 41. The blind help module 5 includes an on-site volunteer communication submodule 51 and a remote volunteer guidance submodule 52.

[0064] The application of this social communication application system based on mobile communication terminal is: if you find a stranger on the road who is very interesting and want to make friends with him, but it is awkward to ask for his account actively, then you can use the search module 1 in this system to identify the stranger, start the friend search submodule 11 in the search module 1, control the terminal camera to start the camera function, aim at the stranger you want to make friends with, so that the person appears in the camera screen, click on the corresponding person, and the friend search submodule 11 can obtain the portrait data of the person, the portrait data includes the physical feature information of the person being searched and the location information of the person being searched, the physical feature information includes clothing features, height features, appearance features and gender features, and the location information of the person being searched is obtained by the terminal device according to the location information of the searcher, the distance data between the searcher and the person being searched, and the direction data, and the conversion method can use the Pythagorean theorem. Among them, the distance data between the person being found and the person searching is obtained by processing the portrait of the person being found in the camera image through the terminal ranging technology. The terminal ranging technology can be specifically used: when the person searching clicks on the portrait of the person being found in the camera image, the portrait image of the person being found is captured, and the distance data is calculated by measuring the image distance after focusing in combination with the terminal camera lens parameters; when the terminal camera is single, the terminal ranging technology can be used to calculate the distance data between the person being found and the person searching. When the terminal has a binocular camera, the terminal ranging technology can use two cameras in different positions to simultaneously shoot the same person being found, and calculate the distance data between the person being found and the person searching by measuring the phase difference of the person being found in the two images. In addition, other ranging methods can also be used; the orientation information of the person being found relative to the person searching is obtained by identifying the portrait of the person being found in the camera image through the terminal orientation recognition technology. The terminal orientation recognition technology can be the orientation recognition function of a compass.

[0065] The social data center searches for the social communication account corresponding to the location information of the person being searched, and / or searches for the corresponding social communication account from the social data center based on the appearance and / or clothing features, height features, and gender features in the physical feature information, and issues a prompt to add as an ordinary friend or a super friend. When the user selects an ordinary friend, the friend module 2 initiates a friend add request to the other party based on the obtained social communication account, and enters the communication exchange interface after the other party agrees to the request. When selecting a super friend, the super friend module 3 initiates a super friend add request based on the social communication account found or the friend module 2 applies to become a super friend. When the other party agrees to the request, an AA payment wallet is created for AA payment when consuming together with the super friend and the communication exchange interface of the super friend is entered.

[0066] When two people become super friends, the AA payment submodule 32 creates an AA payment wallet for the two super friends to consume together and sets the same balance to be deposited, ensuring that the AA payment balance is the same value. After the first transfer from the personal balance wallet to the common payment balance, a monthly deposit plan can also be set, such as transferring the same amount from the personal balance wallet to each other's AA payment wallet at a fixed time every month. The common payment balance of both parties can be viewed by the other party. When consuming outside, shopping, selecting products and placing orders can be carried out through the joint collaboration submodule 31; after super friends consume together, one person initiates payment to the merchant through the AA payment submodule 32, deducts the corresponding AA amount and detects the distance value between the super friends according to the terminal positioning function. When the distance value is less than or equal to the preset value, in this embodiment, the preset value can be set to 10m or 8m, etc. When the distance is less than or equal to 10m or 8m, the same AA amount is directly deducted from the other party's AA payment wallet. When paying the AA consumption amount, the user can choose to deduct it directly from his own AA payment wallet, or borrow from the APP platform through the borrowing submodule 33. If you choose to borrow from the platform, after the borrowing, the AA payment submodule 32 transfers an equal amount from the AA payment wallet to the personal balance wallet, thereby keeping the joint payment balance of both parties consistent, and then the user can repay the platform.

[0067] When the terminal positioning function detects that the distance between two super friends is greater than the preset value, the system platform will advance the other half of the AA amount. The platform advance payment can complete the payment in time to avoid consumption disputes with merchants. At the same time, a deduction reminder will be sent to the other party. After the other party completes the payment, the payment will be returned to the APP platform. If the payment is not made within the preset payment time value, such as 12 hours, or other times, such as 10 hours, 15 hours, etc., the initiator will pay the other half of the AA amount to the system platform.

[0068] When making a payment, the payment password of the AA payment wallet and the payment password of the personal balance wallet can be set to be the same or different, and are managed by the payment password submodule 35, which is used to deduct the amount from the corresponding wallet according to the payment password when the payment password of the AA payment wallet is different from the payment password of the personal balance wallet; when the payment password of the AA payment wallet is the same as the payment password of the personal balance wallet, select the corresponding wallet for deduction;

[0069] When the balances in the two super friends' AA payment wallets are different and remain different within a preset time, the super friend removal submodule 34 automatically removes the super friend association; when the super friend relationship is removed, if one wants to apply for the super friend relationship again, in this embodiment, if the non-payer whose super friend relationship has been removed wants to reapply to add the other party as a super friend, then certain conditions must be met before becoming a super friend with the other party again, such as giving a red envelope or gift to the previous super friend, and the other party can also be prompted whether a red envelope or gift is needed. If the other party replies that no, then they can directly become super friends again and continue to realize AA payment after consumption.

[0070] In this embodiment, friends can also be added through the hydrangea module 7. The specific operation is as follows: the social communication account of each transmitting user is obtained through the transmission of preset information between social users. In order to select friends more specifically, the preset information is sent to a random user within the preset distance range on the scene through the hydrangea module 7. The preset distance range can be set to 3 square meters. The preset information can be a red envelope transmission, or other information, such as image information, language information, etc. After the first user receives the preset information, the user randomly forwards it to the next user through the hydrangea module. If the user does not forward it to the next user within a certain period of time, such as 2 minutes, then the system automatically forwards the preset information to the next user randomly, and in this way until there is no user to forward it, the social communication account of the user who participates in the forwarding of the preset information is displayed in the participant list. The user who initiates the preset information can select the user he wants to add as a friend in the participant list, and then send a friend request or a super friend request to the selected social communication account according to the user's choice. Among them, the users who can appear in the participant list are users who have been registered through face verification and the system has detected that the head portrait photo is the user himself. If the face authentication has not been passed or the head portrait is not the user himself, it will not be displayed in the participant list, and the preset information will not be received.

[0071] In this embodiment, if the party is added as a friend, the review module 6 of this system can also be activated to control the terminal camera to turn on, and the location of the requester can be indicated through the camera screen according to the location information of both parties, so as to help the person being added make accurate friendship decisions or assist volunteers to accurately and quickly find people in need of help.

[0072] When the social communication account corresponding to the portrait data is not obtained from the social data center, the portrait data of the person pre-added as a friend is stored, and when the relevant portrait data appears on the social data center, the person looking for it is prompted whether to request to add it.

[0073] When a blind person uses the system, he can press the first preset love help button 8 when he needs help, for example, long press the volume up and down button of the mobile terminal for 3 seconds at the same time, which means that he needs help from volunteers. Other operation modes can also be set to determine whether volunteer help is needed. After pressing the first preset love help button 8, the volunteer search submodule 12 is started, and the camera captures the person in the lens screen and searches for the volunteer social account within the camera screen. The specific operation is:

[0074] Identify and obtain portrait data of each person in the camera image range, the portrait data including body feature information and position information, the body feature information including clothing features, height features, appearance features and gender features; the position information of each person is obtained by the terminal device through conversion based on the position information of the person requesting help and the distance data and direction data from each person in the camera image range; then search for volunteer social accounts from the social data center based on the body feature information and / or position information of each person, and output the volunteer social accounts when volunteers exist, wherein, when searching based on the body feature information, the corresponding social communication account can be searched from the social data center based on the appearance and / or clothing features, height features, and gender characteristics in the body feature information. The location information may be longitude and latitude data, altitude, etc. When calculating the longitude and latitude data, the longitude and latitude distance between the person in the camera image and the person requesting love help in accordance with the distance data and orientation data between the person in the camera image and the person requesting love help is calculated using the Pythagorean theorem. At this time, the longitude and latitude data of each person in the camera image can be converted according to the longitude and latitude distances and the longitude and latitude data of the person requesting love help. The social account of the corresponding person is obtained according to the longitude and longitude data. When the user turns on the volunteer function through the volunteer setting module 13, it is possible to determine whether the person is a volunteer through the social account. When there are volunteers, the volunteer social account can be obtained. When there are on-site volunteers, the on-site volunteer communication submodule 51 sends a love help request to the volunteer social account. When the on-site volunteer accepts the love help request, the on-site volunteer establishes a video communication connection with the blind person and the check module 6 guides the volunteer to find the blind person and provide help through the video communication screen according to the positions of the two. For example, an arrow is used in the video communication screen to indicate the position of the requester, so as to help the blind person or the person in need to be found by the volunteer faster and get help from the volunteer faster.

[0075] When no volunteer social account is found in the camera image, the blind person is informed that there are no volunteers on site, and then asked if he needs help. At the same time, the remote volunteer guidance submodule 52 sends a loving help request to the remote volunteers outside the camera image range. When help is needed, the terminal navigation is started, and the terminal camera is started according to the needs of the blind person to capture the blind person's surrounding environment data, and a guiding picture and guiding sound in the blind person's walking direction are generated based on the surrounding environment data, such as prompts to move forward, backward, left and right and how to avoid obstacles. When the remote volunteer accepts the loving help request, the remote volunteer's terminal will also synchronously display the guiding picture and guiding sound in the blind person's walking direction, so that when the remote volunteer finds that the system guidance is wrong, the remote volunteer can make a voice assistance reminder in time to assist and guide the blind person to reach the destination safely, thereby improving the safety and convenience of the blind person's travel. This functional module can also provide help for people who are lost.

[0076] When the deaf-mute uses this system, he can press the second preset love help button 9, such as setting the second preset love help button 9 at the upper right corner of the camera screen under the search module 1, or continuously press the terminal volume up or down key 3 times to indicate that he needs volunteer help. When seeking help, the volunteer search submodule 12 is started, and the person in the lens screen is captured by the camera and the volunteer social account of the volunteer in the camera screen range is searched. The specific method of searching the volunteer social account is as described in the previous paragraph. When there are on-site volunteers in the camera screen, the volunteer social account is obtained and the on-site volunteer submodule 41 in the deaf-mute help module 4 sends a friend request, which is an ordinary friend request. When the volunteer receives the friend request, the terminal camera can be started by the back-check module 6, and the location of the requester can be indicated to the volunteer through the camera screen according to the location data of both parties, so as to help the volunteer find the help-seeking person faster to provide on-site help. When the volunteer agrees to the friend request, the deaf-mute can initiate a chat with the volunteer and enter the chat interface. In the chat interface, the content can be input in text, or the sign language input function can be turned on in the chat interface. When the sign language input function is turned on, the terminal camera is started, and the terminal camera captures the sign language movements. The sign language camera image and the chat interface present a picture-in-picture display. At the same time, the system translates the sign language into text input according to the pre-stored sign language information and sends it to the volunteer in the chat dialogue page. The system pre-stores the sign language data information to provide reliability and accuracy for the sign language to text conversion. The output text of this system defaults to Chinese, and the browsing text is not displayed. When modification is required, the output selection submodule 43 can select the language of the output text and the browsing text and select whether to turn on the translated text browsing function. If the text needs to be browsed, the language familiar to the user can be selected to realize browsing and judging whether the text converted by the sign language is accurate, thereby improving the accuracy of communication.

[0077] When there are no on-site volunteers, the remote volunteer correction submodule 42 will translate the received on-site broadcast content into text and sign language video, and send a help message to the remote volunteer outside the camera screen. When the remote volunteer accepts the request for help, a video communication connection is established, and the on-site sound and the converted text and sign language video are synchronously presented to the remote volunteer's terminal. When the remote volunteer finds that there is a translation error, the translation error is corrected in time to help the deaf-mute get more accurate information and avoid the inconvenience caused by not being able to hear the sound or not being able to understand. After completing the loving help, the volunteer can take the initiative to cancel the friend association. The system can also be set to remind the volunteer whether to cancel the friend after a certain time, such as 2 hours. If no operation is performed after receiving the cancellation message, the system will automatically delete the social account of the helper. If the volunteer cancels the cancellation, it will be kept in the address book. This system has various functions and can effectively solve the inconveniences in travel, communication and consumption in life, increase convenience for people's lives, and improve the quality of life.

[0078] The specific embodiments described herein are merely examples of the spirit of the present invention. Those skilled in the art may make various modifications or additions to the specific embodiments described or replace them in similar ways, but they will not deviate from the spirit of the present invention or exceed the scope defined by the appended claims.

Claims

1. A social communication application system based on a mobile communication terminal, characterized in that: The social communication application system includes: A search module (1) is used to start the camera to search for the social account of a volunteer in the camera screen range or to start the camera to search for the social communication account of a designated person in the camera screen and issue a prompt to add a common friend or a super friend; The friend module (2) is used to initiate a friend adding request based on the social communication account found when adding a common friend, and enter the communication exchange interface after the other party agrees to the request; The super friend module (3) is used to initiate a request to add a super friend based on the social communication account found or when applying to become a super friend through the friend module (2) when adding a super friend, and to create an AA payment wallet for AA payment when consuming together with the super friend and enter the super friend communication exchange interface when the other party agrees to the request; The deaf-mute help module (4) is used to initiate a love assistance request based on the volunteer social account found, and obtain help from on-site volunteers when the other party agrees to the request, or to translate on-site sounds when there are no on-site volunteers and correct incorrect translations with the assistance of remote volunteers; The blind help module (5) is used to initiate a love help request based on the volunteer social account found, and obtain help from on-site volunteers when the other party agrees to the request, or to activate the navigation guidance function when there are no on-site volunteers and reach the destination under the guidance of remote volunteers; The blind person help-seeking module (5), the deaf-mute person help-seeking module (4), the friend module (2) and the super friend module (3) are all connected to the search module (1), and the friend module (2) and the super friend module (3) are connected.

2. The social communication application system based on mobile communication terminal according to claim 1, characterized in that: The social communication application system also includes: The check module (6) is used to start the camera when receiving a request to add a friend, a request to add a super friend, a request for love assistance or a request for love help, and indicate the location of the requester through the camera image.

3. The social communication application system based on mobile communication terminal according to claim 1, characterized in that: The social communication application system also includes: The hydrangea module (7) is used to obtain the social communication accounts of each transmitting user by transmitting preset information between social users, and send a friend request or a super friend request to the selected social communication account according to the user's selection.

4. The social communication application system based on mobile communication terminal according to claim 1, 2 or 3, characterized in that: The search module (1) comprises: The friend search submodule (11) is used to start the camera to search for the social communication account of the designated person in the camera image. The operations include: Generate a camera start command to control the camera to start the camera function; Click on the person pre-added as a friend in the camera image to identify and obtain the person's portrait data, the portrait data includes the person's physical feature information and the person's location information, the physical feature information includes clothing features, height features, appearance features and gender features; The location information of the person being searched is obtained by the terminal device through conversion based on the location information of the searcher, the distance data and the direction data between the searcher and the person being searched; The corresponding social communication account is obtained by searching from the social data center through the physical feature information of the person being searched and / or the location information of the person being searched.

5. The social communication application system based on mobile communication terminal according to claim 4, characterized in that: The search module (1) further comprises a volunteer search submodule (12) and a volunteer setting module (13) for selecting whether to become a volunteer, wherein the volunteer setting module (13) is connected to the volunteer search submodule (12); The volunteer search submodule (12) is also connected to a first preset love help button (8) and a second preset love help button (9), and the volunteer search submodule (12) is used to start the camera to search for the volunteer social account within the camera screen range when receiving a signal that the first preset love help button (8) or the second preset love help button (9) is pressed.

6. The social communication application system based on mobile communication terminal according to claim 5, characterized in that: The operations of starting the camera to search for the social accounts of volunteers within the camera screen range include: Identify and obtain portrait data of each person in the camera image range, wherein the portrait data includes body feature information and position information, wherein the body feature information includes clothing features, height features, appearance features, and gender features; The position information of each person is obtained by the terminal device through conversion based on the position information of the person requesting help and the distance data and direction data of each person in the camera screen range; Based on the physical feature information and / or location information of each person, the social account of the volunteer is searched from the social data center, and the social account of the volunteer is output when the volunteer exists.

7. The social communication application system based on mobile communication terminal according to claim 1, 2 or 3, characterized in that: The super friend module (3) comprises: The collaborative submodule (31) is used for shopping, selecting products and placing orders during joint consumption; The AA payment submodule (32) is used to create an AA payment wallet for two super friends to consume together and set the same balance to be deposited therein; after the super friends consume together, when one of them initiates payment to the merchant, the corresponding AA amount is deducted and the distance value between the super friends is detected according to the terminal positioning function. When the distance value is less than or equal to a preset value, the same AA amount is directly deducted from the other party's AA payment wallet; when the distance value is greater than the preset value, the system platform prepays the other half of the AA amount and sends a deduction reminder to the other party. If the payment is not made within the preset payment time value, the initiator pays the other half of the AA amount to the system platform.

8. The social communication application system based on mobile communication terminal according to claim 7, characterized in that: The super friend module (3) further comprises: The loan payment submodule (33) is used to loan the AA amount to the system platform; after the loan payment, the AA payment submodule (32) transfers the same amount from the AA payment wallet to the personal balance wallet; A super friend disassociation submodule (34) is used to automatically disassociate the super friend when the balances in the super friend's AA payment wallet are different and remain different within a preset time; A payment password submodule (35) is used to deduct the amount from the corresponding wallet according to the payment password when the payment password of the AA payment wallet is different from the payment password of the personal balance wallet; when the payment password of the AA payment wallet is the same as the payment password of the personal balance wallet, select the corresponding wallet for deduction; The payment password submodule (35), the super friend release submodule (34) and the loan payment submodule (33) are all connected to the AA payment submodule (32).

9. The social communication application system based on mobile communication terminal according to claim 1, 2 or 3, characterized in that: The deaf-mute help module (4) comprises: The on-site volunteer submodule (41) is used to establish a chat communication when the on-site volunteer agrees to the request, and to start the terminal camera when the sign language input function in the chat dialogue page is selected, so that the terminal camera captures the sign language action and displays the sign language camera image in the chat dialogue page in the form of picture-in-picture, and at the same time translates the sign language into text according to the sign language information pre-stored in the system, inputs it into the chat dialogue page and sends it to the volunteer; An output selection submodule (43) is used to select the language of output text and text browsing and to select whether to enable the translation text browsing function; The remote volunteer correction submodule (42) is used to translate the received on-site broadcast content into text and sign language video when there are no on-site volunteers, and at the same time send a help message to the remote volunteers outside the camera screen range, so that the remote volunteers can assist in correcting the translation errors.

10. The social communication application system based on mobile communication terminal according to claim 1, characterized in that: The blind person help module (5) comprises: The on-site volunteer communication submodule (51) is used to automatically connect the video call when the on-site volunteer agrees to the request and obtain help from the on-site volunteer; The remote volunteer guidance submodule (52) is used to ask whether help is needed when there are no on-site volunteers, and to send a loving help request to the remote volunteers outside the camera screen range. When help is needed, the terminal camera is activated to capture the blind person's surrounding environment data, and a guiding image and guiding sound of the blind person's walking direction are generated based on the surrounding environment data and synchronously fed back to the terminal of the remote volunteer who agrees to the loving help request. When there is a guidance error, the remote volunteer receives an error correction prompt sent by the remote volunteer.

Citation Information

Patent Citations

  • Communication method based on social communication tool

    CN112667918A