Business handling method and device, storage medium and electronic equipment
Remote financial services are achieved through naked-eye 3D audio and video call technology, solving the problem of transferring complex business at offline branches, improving efficiency and customer experience, and optimizing resource allocation.
Patent Information
- Application Number
- CN202511140229.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-08-14
- Publication Date
- 2025-11-07
AI Technical Summary
When providing financial services, some complex transactions at offline branches need to be transferred to other branches, resulting in low efficiency, poor customer service experience, and uneven distribution of human resources.
By employing naked-eye 3D audio and video call technology, remote financial services can be realized through remote real-time processing across regions and institutions. The naked-eye 3D audio and video call system enables immersive interaction between customers and remote customer service representatives, and dynamically adjusts remote customer service resources.
It improved business processing efficiency, enhanced customer service experience, optimized branch operation efficiency and service level, and reduced waste of human resources.
Smart Images

Figure CN120915902A_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the field of financial technology, in particular to a service processing method and device, a storage medium and an electronic device. BACKGROUND
[0002] Currently, when offline outlets provide financial services, some complex businesses need to be transferred to other outlets for processing, the service processing efficiency is low, the customer service experience is poor, and for banks, the personnel scheduling of outlet clerks can only refer to historical experience. When the number of customers suddenly increases, the customers have to wait for a long time, and when the number of customers is small, it will cause waste of manpower in outlets. For example, there are more personnel in another outlet, and the clerks are too busy to cause uneven busy and idle states.
[0003] In view of the problem in the related art that when offline outlets provide financial services, some complex businesses need to be transferred to other outlets for processing, resulting in low service processing efficiency, no effective solution has been proposed so far. SUMMARY
[0004] The main purpose of the present application is to provide a service processing method and device, a storage medium and an electronic device to solve the problem in the related art that when offline outlets provide financial services, some complex businesses need to be transferred to other outlets for processing, resulting in low service processing efficiency.
[0005] In order to achieve the above purpose, according to one aspect of the present application, a service processing method is provided. The method comprises: receiving a service processing request sent by a first end and distributing the service processing request to a second end, wherein the second end is used to provide remote financial services for the first end; in the case that a first information issued by the second end is received, obtaining target communication information, wherein the first information is used to indicate that the second end starts to serve; sending the target communication information to the first end and the second end, wherein the first end and the second end conduct naked-eye three-dimensional audio and video calls based on the target communication information.
[0006] Further, before obtaining the target communication information, the method further comprises: sending a service request to a target call system, wherein the service request is used to apply for establishing real-time call services; receiving a call room number and a communication address allocated by the target call system, and determining the target communication information according to the call room number and the communication address.
[0007] Further, the first end and the second end conducting the naked-eye three-dimensional audio-video call based on the target communication information comprises: the first end and the second end entering a call room corresponding to a call room number based on a communication address; obtaining target audio-video data by the second end, and sending the target audio-video data to a target call system, wherein the target call system is configured to forward the target audio-video data to the first end; receiving the target audio-video data by the first end, generating three-dimensional image and sound data of the remote customer service according to the target audio-video data, and displaying the three-dimensional image and playing the sound data.
[0008] Further, the obtaining target audio-video data by the second end comprises: starting a double-screen camera and a sound pickup device by the second end, calibrating the double-screen camera to obtain calibration parameters, wherein the double-screen camera is configured to collect picture data of the remote customer service, and the sound pickup device is configured to collect audio data of the remote customer service; correcting the picture data according to the calibration parameters to obtain corrected picture data; and encoding the corrected picture data and the audio data to obtain the target audio-video data.
[0009] Further, the generating three-dimensional image and sound data of the remote customer service according to the target audio-video data comprises: decoding the target audio-video data to obtain the corrected picture data and the audio data; performing video synthesis and three-dimensional reconstruction on the corrected picture data to obtain picture information of the remote customer service; generating the three-dimensional image according to the picture information, and generating the sound data according to the audio data.
[0010] Further, after the first end and the second end enter the call room corresponding to the call room number based on the communication address, the target call system is further configured to record the naked-eye three-dimensional audio-video call and a service handling picture in the naked-eye three-dimensional audio-video call.
[0011] Further, the target call system is further configured to store the recorded audio-video stream and the service handling picture after the first end and the second end exit the call room.
[0012] To achieve the above object, according to another aspect of the present application, a service handling device is provided. The device comprises: a first processing unit configured to receive a service handling request sent by a first end, and distribute the service handling request to a second end, wherein the second end is configured to provide remote financial service for the first end; an obtaining unit configured to obtain target communication information in a case that first information sent by the second end is received, wherein the first information is used to indicate that the second end starts to serve; and a first sending unit configured to send the target communication information to the first end and the second end, wherein the first end and the second end conduct a naked-eye three-dimensional audio-video call based on the target communication information.
[0013] Further, the apparatus further comprises a second sending unit configured to send a service request to the target communication system before obtaining the target communication information, wherein the service request is used to apply for establishing a real-time communication service; and a determining unit configured to receive a communication room number and a communication address allocated by the target communication system, and determine the target communication information according to the communication room number and the communication address.
[0014] Further, the apparatus further comprises a second processing unit configured to enable the first terminal and the second terminal to enter a communication room corresponding to the communication room number based on the communication address; a third sending unit configured to obtain target audio and video data through the second terminal, and send the target audio and video data to the target communication system, wherein the target communication system is configured to forward the target audio and video data to the first terminal; and a third processing unit configured to receive the target audio and video data through the first terminal, generate three-dimensional image and sound data of the remote customer service according to the target audio and video data, and display the three-dimensional image and play the sound data.
[0015] Further, the third sending unit comprises a first processing sub-unit configured to start a double-screen camera and a sound pickup device through the second terminal, calibrate the double-screen camera to obtain calibration parameters, wherein the double-screen camera is configured to collect picture data of the remote customer service, and the sound pickup device is configured to collect audio data of the remote customer service; a second processing sub-unit configured to correct the picture data according to the calibration parameters to obtain corrected picture data; and a third processing sub-unit configured to perform encoding processing on the corrected picture data and the audio data to obtain the target audio and video data.
[0016] Further, the third processing unit comprises a fourth processing sub-unit configured to perform decoding processing on the target audio and video data to obtain the corrected picture data and the audio data; a fifth processing sub-unit configured to perform video synthesis and three-dimensional reconstruction on the corrected picture data to obtain picture information of the remote customer service; and a sixth processing sub-unit configured to generate the three-dimensional image according to the picture information, and generate sound data according to the audio data.
[0017] Further, after the first terminal and the second terminal enter the communication room corresponding to the communication room number based on the communication address, the target communication system is further configured to record the naked-eye three-dimensional audio and video communication and a business handling picture in the naked-eye three-dimensional audio and video communication.
[0018] Further, the target communication system is further configured to store the recorded audio and video stream and the business handling picture after the first terminal and the second terminal exit the communication room.
[0019] According to another aspect of the embodiment of the present application, an electronic device is provided, comprising a memory storing an executable program, and a processor configured to run the program, wherein the program is configured to execute any one of the above business handling methods when running.
[0020] According to another aspect of the embodiments of the present application, a computer readable storage medium is also provided, which stores a program, wherein the program controls a device where the storage medium is located to perform the service handling method of any of the above when the program is run.
[0021] In the embodiments of the present application, the following steps are adopted: receiving a service handling request sent by a first end, and distributing the service handling request to a second end, wherein the second end is configured to provide remote financial services for the first end; in the case that first information sent by the second end is received, obtaining target communication information, wherein the first information is configured to represent that the second end starts to serve; and sending the target communication information to the first end and the second end, wherein the first end and the second end perform naked-eye three-dimensional audio and video communication based on the target communication information. The technical problem that the service handling efficiency is low due to the fact that, in the related art, when an offline outlet provides financial services, some complex services need to be transferred to other outlets for handling is solved.
[0022] In the present solution, by constructing a naked-eye three-dimensional remote service handling service mode, an immersive experience of remote financial services is achieved, by cross-regional and cross-institutional real-time processing, the inconvenience that a customer needs to transfer to other outlets for handling complex services is avoided, the efficiency of service handling is improved, the service experience of the customer is enhanced, and the remote customer service resources can be dynamically adjusted according to the service volume, the waste of human resources is reduced, the service process is optimized, and the operation efficiency and service level of the outlet are improved. BRIEF DESCRIPTION OF DRAWINGS
[0023] The accompanying drawings, which form a part of the present application, are intended to provide further understanding of the present application, and the illustrative embodiments of the present application and their description serve the purpose of explaining the present application. In the drawings:
[0024] Figure 1 Fig. 1 shows a hardware structure block diagram of a computer terminal for implementing a service handling method;
[0025] Figure 2 Fig. 2 is a flowchart of a service handling method according to an embodiment of the present application;
[0026] Figure 3 Fig. 3 is a general structure block diagram according to an embodiment of the present application;
[0027] Figure 4 Fig. 4 is a schematic diagram of a hardware configuration of a remote counter of an outlet according to an embodiment of the present application;
[0028] Figure 5 Fig. 5 is a schematic diagram of a hardware configuration of a remote customer service according to an embodiment of the present application;
[0029] Figure 6 Fig. 6 is a structure schematic diagram of an outlet service handling system according to an embodiment of the present application;
[0030] Figure 7 is a structural schematic diagram of a naked three-dimensional video call system according to an embodiment of the present application;
[0031] Figure 8 is a flow chart of data processing according to an embodiment of the present application;
[0032] Figure 9 is a flow chart of naked three-dimensional video data processing according to an embodiment of the present application;
[0033] Figure 10 is a schematic diagram of a service handling device according to an embodiment of the present application;
[0034] Figure 11 is a structural block diagram of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION
[0035] In order to make the personnel in the art better understand the present application, the technical solutions in the embodiments of the present application will be described clearly and completely below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all the other embodiments obtained by the person of ordinary skill in the art without making any creative effort should belong to the scope of protection of the present application.
[0036] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and do not necessarily mean a specific order or sequence. It should be understood that the data thus used can be interchanged under appropriate circumstances, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion, for example, a process, method, system, product or device including a series of steps or units does not necessarily have to be limited to those steps or units clearly listed, but can include other steps or units not clearly listed or inherent to these processes, methods, products or devices.
[0037] It should be noted that the information (including but not limited to user equipment information, user personal information, etc.) and data (including but not limited to data for display, analyzed data, etc.) involved in the present application are information and data authorized by the user or authorized by all parties, and the collection, storage, use, processing, transmission, provision, disclosure and application of related data comply with relevant laws, regulations and standards, necessary security measures are taken, do not violate public order and good customs, and provide corresponding operation portal for user to choose authorization or refusal. For example, the system and the interface between the related users or institutions are provided with the corresponding operation portal for the user to choose to agree or refuse the automatic decision result; if the user chooses to refuse, the expert decision process is entered.
[0038] Embodiment 1
[0039] According to the embodiments of the present application, a business handling method embodiment is also provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a group of computer executable instructions, and although the logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from here.
[0040] The method embodiment provided by the embodiment of the present application can be executed in a mobile terminal, a computer terminal or a similar computing device. Figure 1 A hardware structure block diagram of a computer terminal (or mobile device) for implementing a business handling method is shown. As shown in Figure 1 The computer terminal 10 (or mobile device) can include one or more processors 102 (the processor 102 can include but is not limited to a processing device such as a microprocessor MCU or a programmable logic device FPGA), a memory 104 for storing data, and a transmission device 106 for communication function. In addition, it can also include a display, an input / output interface (I / O interface), a universal serial bus (USB) port (which can be included as one of the ports of the BUS bus), a network interface, a power supply and / or a camera. Those skilled in the art can understand that Figure 1 The structure shown is only schematic, which does not limit the structure of the above-mentioned electronic device. For example, the computer terminal 10 can include more or less components than those shown in Figure 1 or have a different configuration from Figure 1 that shown.
[0041] It should be noted that the one or more processors 102 and / or other data processing circuitry described above can be generally referred to herein as "data processing circuitry". The data processing circuitry can be embodied in whole or in part as software, hardware, firmware, or any combination thereof. In addition, the data processing circuitry can be a single standalone processing module, or incorporated in whole or in part within any of the other elements of the computer terminal 10 (or mobile device). As referred to in the embodiments of the present application, the data processing circuitry functions as a processor to control, for example, the selection of the variable resistance terminal path connected to the interface.
[0042] The memory 104 can be used to store software programs of application software and modules, such as program instructions / data storage means corresponding to the service handling method in the embodiments of the present application. The processor 102 executes various functional applications and data processing by running the software programs and modules stored in the memory 104, i.e. implements the service handling method described above. The memory 104 can include a high-speed random access memory, and can further include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 can further include a memory remotely arranged with respect to the processor 102, which can be connected to the computer terminal 10 through a network. Examples of the network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.
[0043] The transmission device 106 is used to receive or send data via a network. Specific examples of the network can include a wireless network provided by a communication provider of the computer terminal 10. In one example, the transmission device 106 includes a network adapter (NIC), which can be connected to other network devices through a base station so as to communicate with the Internet. In one example, the transmission device 106 can be a radio frequency (RF) module, which is used to communicate with the Internet in a wireless manner.
[0044] The display can be a touch screen liquid crystal display (LCD), which can enable the user to interact with the user interface of the computer terminal 10 (or mobile device).
[0045] Under the above operating environment, the present application provides a service handling method as shown in Figure 2 The flowchart of the service handling method according to the first embodiment of the present application is shown in Figure 2 The service handling method includes:
[0046] In step S201, a service handling request sent by a first end is received, and the service handling request is distributed to a second end, where the second end is configured to provide remote financial services for the first end.
[0047] Optionally, the first end can be a remote counter end of a network point, and the second end can be an idle remote customer service end. For example, taking a network point service handling system as an execution subject, after the network point service handling system receives a service handling request sent by a customer through the remote counter of the network point, the service handling request is routed to an idle remote customer service, and after the remote customer service receives the task distributed by the system, a start service button is clicked.
[0048] In step S202, target communication information is obtained in a case where first information sent by the second end is received, where the first information is used to represent that the second end starts to serve.
[0049] Optionally, the first information can be a notification that the remote customer service starts to serve, and the target communication information at least includes a call room number and a communication address. For example, after the network point service handling system receives the notification that the remote customer service starts to serve, the network point service handling system applies for the call room number, the communication address and the like information to a naked-eye three-dimensional video call system, the naked-eye three-dimensional video call system allocates the call room number, the communication address and the like information, and a point-to-point naked-eye three-dimensional real-time call service is built.
[0050] In step S203, the target communication information is sent to the first end and the second end, where the first end and the second end perform naked-eye three-dimensional audio and video call based on the target communication information.
[0051] Optionally, after the network point service handling system receives the call room number and the communication address, the network point service handling system sends the call room number and the communication address to the remote counter end of the network point and the remote customer service end, so that the customer and the remote customer service enter a room to perform naked-eye three-dimensional audio and video call.
[0052] In summary, by constructing a naked-eye three-dimensional remote service handling service mode, an immersive experience of remote financial services is realized, through cross-regional and cross-institutional remote real-time processing, the inconvenience of customers to transfer to other network points due to handling of complex services is avoided, the efficiency of service handling is improved, the service experience of customers is enhanced, remote customer service resources can be dynamically adjusted according to the service volume, human resource waste is reduced, service processes are optimized, and the operation efficiency and service level of the network point are improved.
[0053] In an optional embodiment, Figure 3 is a general structure block diagram provided by the embodiment of the application, like Figure 3As shown, the system is composed of three parts, namely, the network points, the data center, and the remote customer service manager center. The network points are a plurality of network points in a certain region of the bank, and each network point includes a plurality of remote counters. The data center deploys the network point business handling system and the naked-eye three-dimensional video call system of the bank, and provides the network point remote business handling function and the naked-eye three-dimensional video call service, respectively. The remote customer service manager center is a region where a plurality of tellers are concentrated, and is responsible for the handling and guidance of the remote counter business.
[0054] Optionally, in the business handling method provided in the embodiments of the present application, before the target communication information is acquired, the method further includes: sending a service request to the target call system, wherein the service request is used to apply for establishing a real-time call service; receiving a call room number and a communication address allocated by the target call system, and determining the target communication information according to the call room number and the communication address.
[0055] In an optional embodiment, after the network point business handling system receives the notification that the remote customer service starts the service, the network point business handling system applies for a call room number, a communication address, and the like information from the naked-eye three-dimensional video call system, and the naked-eye three-dimensional video call system allocates the call room number, the communication address, and the like information, and builds the point-to-point naked-eye three-dimensional real-time call service.
[0056] By sending the service request to the naked-eye three-dimensional video call system and receiving the corresponding call room number and communication address, it is ensured that the establishment of each naked-eye three-dimensional audio and video call is based on the explicit service demand and the safe communication channel, and the stability and safety of the data transmission are ensured.
[0057] Optionally, in the business handling method provided in the embodiments of the present application, the naked-eye three-dimensional audio and video call between the first end and the second end based on the target communication information includes: the first end and the second end enter a call room corresponding to the call room number based on the communication address; the target audio and video data is acquired by the second end, and the target audio and video data is sent to the target call system, wherein the target call system is used to forward the target audio and video data to the first end; the target audio and video data is received by the first end, the three-dimensional image and the sound data of the remote customer service are generated according to the target audio and video data, and the three-dimensional image is displayed and the sound data is played.
[0058] In an optional embodiment, the target audio and video data can be audio and picture data mixed stream encoding data. The customer and the remote customer service enter the room to perform the naked-eye three-dimensional audio and video call, the audio and picture data mixed stream encoding data is pushed to the naked-eye three-dimensional video call system through the remote customer service end, the naked-eye three-dimensional video call system forwards the data to the network point remote counter end after receiving the data, and the three-dimensional image and the sound data of the remote customer service are generated according to the received data, and the three-dimensional image is displayed and the sound data is played.
[0059] Through real-time interaction of three-dimensional audio and video, immersive experience of remote financial service is realized, and business handling efficiency and customer service experience can be improved.
[0060] In an optional embodiment, Figure 4 is a schematic diagram of hardware configuration of a remote counter of a network point provided by an embodiment of the present application, as shown in the figure, composed of a naked-eye three-dimensional display device 40, a general display screen 41, a loudspeaker 42, a computer host 43, a sound pickup 44, a binocular camera 45, a counter integrated peripheral 46, and a printer 47. Figure 4
[0061] The naked-eye three-dimensional display device 40: integrated eye movement tracker, after supporting content rendering processing in left-right format, respectively sends different views to the left and right eyes of the target user to form a three-dimensional effect, used for displaying the image of a remote customer service.
[0062] The general display screen 41: display device, used for displaying the business information handled by the user.
[0063] The loudspeaker 42: used for playing the audio information transmitted by the remote customer service.
[0064] The computer host 43: installed with a network point terminal program (integrated naked-eye three-dimensional video call software development kit), supporting self-service handling of network point customer business.
[0065] The sound pickup 44: used for collecting audio data of the network point customer.
[0066] The binocular camera 45: used for collecting picture data of the network point customer.
[0067] The counter integrated peripheral 46: integrated with commonly used peripherals of the network point such as ID card recognition, bank card recognition, and signature screen, supporting functions such as identity recognition, bank card recognition, and signature confirmation in the process of business handling.
[0068] The printer 47: used for printing information after the completion of business handling.
[0069] In an optional embodiment, Figure 5 is a schematic diagram of hardware configuration of a remote customer service provided by an embodiment of the present application, as shown in the figure, composed of a naked-eye three-dimensional display device 51, a general display screen 52, a loudspeaker 53, a computer host 54, a sound pickup 55, and a binocular camera 56. Figure 5
[0070] The naked-eye three-dimensional display device 51: integrated eye movement tracker, after supporting content rendering processing in left-right format, respectively sends different views to the left and right eyes of the target user to form a three-dimensional effect, used for displaying the image of a network point customer.
[0071] The general display screen 52: display device, used for displaying the business information handled by the customer service operation.
[0072] Speaker 53: used to play audio information transmitted by the network point client.
[0073] Computer host 54: installs a remote customer service program (integrates a naked-eye three-dimensional video call software development kit), and supports the customer service to help the customer to handle related businesses.
[0074] Microphone 55: used to collect audio data of the remote customer service.
[0075] Binocular camera 56: used to collect picture data of the remote customer service.
[0076] Optionally, in the business handling method provided in the embodiment of the application, the target audio and video data is acquired through the second end, including: the binocular camera and the microphone are opened through the second end, and the binocular camera is calibrated to obtain calibration parameters, wherein the binocular camera is used to collect picture data of the remote customer service, and the microphone is used to collect audio data of the remote customer service; the picture data is corrected according to the calibration parameters to obtain corrected picture data; and the corrected picture data and the audio data are encoded to obtain the target audio and video data.
[0077] In an optional embodiment, the remote customer service program opens the binocular camera and the microphone, calibrates the binocular camera to obtain calibration parameters, sets the resolution and frame rate of picture collection, collects audio and camera picture data, then corrects the picture data according to the calibration parameters to obtain corrected picture data, and encodes the corrected picture data and the audio data to obtain target audio and video data.
[0078] The picture correction eliminates lens distortion, realizes left and right image alignment, and thus ensures the accuracy of three-dimensional reconstruction.
[0079] Optionally, in the business handling method provided in the embodiment of the application, the three-dimensional image and the sound data of the remote customer service are generated according to the target audio and video data, including: the target audio and video data are decoded to obtain corrected picture data and audio data; the corrected picture data are video synthesized and three-dimensionally reconstructed to obtain picture information of the remote customer service; the three-dimensional image is generated according to the picture information, and the sound data is generated according to the audio data.
[0080] In an optional embodiment, after the web terminal program receives the audio and video data, the audio and picture data are decoded separately, that is, the target audio and video data are decoded to obtain corrected picture data and audio data, then the corrected picture data are subjected to video synthesis and three-dimensional reconstruction to obtain picture information of the remote customer service, a three-dimensional image is generated according to the picture information, and sound data are generated according to the audio data. For example, the picture data are subjected to left and right image video synthesis, then three-dimensional reconstruction is performed to obtain depth information, and the synthesized picture information is dynamically adjusted according to the customer's line of sight direction obtained by the eye movement tracker, so that the picture information is rendered and displayed on the naked-eye three-dimensional display screen in real time, and the audio data are played, so that the customer can hear the voice of the remote customer service and see the three-dimensional image of the remote customer service.
[0081] Through real-time presentation of three-dimensional audio and video, the professionalism and efficiency of the service are improved, and a brand-new immersive experience is brought to the customer, solving the problem of lack of realism and interactivity in traditional remote service.
[0082] Optionally, in the business handling method provided in the embodiments of the present application, after the first end and the second end enter the call room corresponding to the call room number based on the communication address, the target call system is further used for recording the naked-eye three-dimensional audio and video call and the business handling picture in the naked-eye three-dimensional audio and video call.
[0083] In an optional embodiment, after the customer and the remote customer service enter the room for naked-eye three-dimensional audio and video call, the naked-eye three-dimensional video call system starts recording the call video and the business handling picture (such as a business display page) of both parties.
[0084] By recording the naked-eye three-dimensional audio and video call and the business handling picture in the naked-eye three-dimensional audio and video call, the transparency and traceability of the service are increased, solving the problem of lack of records and backtracking in remote service, and ensuring the safety and compliance of the service.
[0085] Optionally, in the business handling method provided in the embodiments of the present application, the target call system is further used for storing the recorded audio and video streams and business handling pictures after the first end and the second end exit the call room.
[0086] In an optional embodiment, after the business handling is completed, the remote customer service clicks to end the service and exits the naked-eye three-dimensional video call, and the naked-eye three-dimensional video call system stores the recorded two-way audio and video streams and two-way business handling pictures.
[0087] By storing the recorded two-way audio and video streams and two-way business handling pictures through the naked-eye three-dimensional video call system, a data basis is provided for business review, dispute resolution, etc.
[0088] In an optional embodiment, Figure 6is a structural schematic diagram of a network point business handling system provided by an embodiment of the present application, as shown in Figure 6 The network point business handling system comprises a main control module 61, a number taking and calling module 62, a routing module 63, a business processing module 64, a data storage module 65, a network point terminal program, and a customer service terminal program.
[0089] The main control module 61 is a main control unit responsible for interaction with the outside and the inside.
[0090] The number taking and calling module 62 is responsible for the number taking and calling service of the remote counter, and supports two-dimensional code scanning for taking numbers.
[0091] The routing module 63 distributes the business handling requests of various network points.
[0092] The business processing module 64 is responsible for processing of the bank-related business system.
[0093] The data storage module 65 stores business data and video recording.
[0094] The network point terminal program integrates a naked-eye three-dimensional video call software development kit, supports the customer to call network point peripherals during business handling, and performs identity recognition, bank card reading, and other functions, drives binocular cameras and sound pickups to collect audio and video data, and plays the naked-eye three-dimensional video data.
[0095] The customer service terminal program integrates a naked-eye three-dimensional video call software development kit, supports the remote customer service to handle business, drives binocular cameras and sound pickups to collect audio and video data, and plays the naked-eye three-dimensional video data.
[0096] In an optional embodiment, Figure 7 is a structural schematic diagram of a naked-eye three-dimensional video call system provided by an embodiment of the present application, as shown in Figure 7 The naked-eye three-dimensional video call system comprises a main control module 61, a real-time communication module 72, a video recording module 73, a screen recording module 74, a data storage 75, and a naked-eye three-dimensional video call software development kit 76.
[0097] The real-time communication module 72 is responsible for creation of a real-time communication room number and a communication address, and audio and video real-time communication data push-pull stream service.
[0098] The video recording module 73 provides audio and video stream recording service.
[0099] The screen recording module 74 provides screen recording service.
[0100] The data storage 75 saves audio and video request data and stores recording data.
[0101] The naked-eye three-dimensional video call software development kit 76 drives a binocular camera and a sound pickup device to collect audio and video data, and plays the naked-eye three-dimensional video data.
[0102] In an optional embodiment, Figure 8 A flowchart of data processing is provided according to an embodiment of the application, as shown in the figure, comprising the following steps: Figure 8
[0103] Step S801: During working hours, a remote customer service logs in a network point business handling system, and waits for a system to assign a task.
[0104] Step S802: After a network point opens, a customer arriving at the network point is given a number, and a remote counter of the network point sequentially calls the numbers according to a queuing system.
[0105] Step S803: When the customer's number is called, the customer arrives at a corresponding remote counter and sits down, and clicks a start business handling button on a general display screen by using a mouse.
[0106] Step S804: After the network point business handling system receives a business handling request of the customer, the customer's business handling request is routed to an idle remote customer service.
[0107] Step S805: After the remote customer service receives a task assigned by the system, a start service button is clicked.
[0108] Step S806: After the network point business handling system receives that the remote customer service starts the service, a call room number, a call address and other information are applied to a naked-eye three-dimensional video call system, the naked-eye three-dimensional video call system assigns the call room number, the call address and other information, and a point-to-point naked-eye three-dimensional real-time call service is built.
[0109] Step S807: After the network point business handling system receives the call room and the address, the call room and the address information are sent to a business handling system program of the network point and the remote customer service end, then the customer and the remote customer service enter a room to perform a naked-eye three-dimensional audio and video call, and the naked-eye three-dimensional video call system starts to record a call video and a business display page of both parties.
[0110] Step S808: The remote customer service communicates with the customer through the naked-eye three-dimensional video call, and inquires about a business handling demand.
[0111] Step S809: The remote customer service handles the business according to a network point user demand, and guides the customer to perform an identity card recognition, a bank card swiping and other operations.
[0112] Step S810: After the business is handled, the remote customer service clicks an end service, and exits the naked-eye three-dimensional video call.
[0113] Step S811: The naked-eye three-dimensional video call system stores the recorded two-way audio and video streams and two-way service handling pictures.
[0114] In an optional embodiment, Figure 9 is a flowchart of naked-eye three-dimensional video data processing provided according to an embodiment of the application, as shown in the figure, comprising the following steps: Figure 9
[0115] Step S901: The remote customer service terminal program opens the dual-screen camera and calibrates the camera to obtain calibration parameters.
[0116] Step S902: The resolution and frame rate of picture acquisition are set.
[0117] Step S903: Audio and camera picture data are acquired, and then the picture is corrected according to the calibration parameters to eliminate lens distortion and realize left-right image alignment.
[0118] Step S904: The audio and picture data are mixed and encoded and pushed to the naked-eye three-dimensional video call system.
[0119] Step S905: After receiving the data, the naked-eye three-dimensional video call system forwards the data to the network point terminal program.
[0120] Step S906: After receiving the audio and video data, the network point terminal program decodes and separates the audio and picture data.
[0121] Step S907: The left and right image videos are synthesized, three-dimensional reconstruction is performed to obtain depth information, and according to the customer's line of sight direction obtained by the eye movement tracker, the synthesized picture information is dynamically adjusted, the picture information is real-time rendered and displayed on the naked-eye three-dimensional display screen, and the audio data is played.
[0122] Step S908: The customer hears the voice of the remote customer service and sees the three-dimensional image of the remote customer service.
[0123] The service handling method provided by the embodiment of the application realizes immersive experience of remote financial service by constructing a naked-eye three-dimensional remote service handling service mode, avoids the inconvenience of customers needing to go to other network points to handle complex services through remote real-time processing across regions and institutions, improves the efficiency of service handling, enhances the service experience of customers, and can dynamically adjust remote customer service resources according to the service volume, reduce waste of human resources, optimize service processes, and improve the operation efficiency and service level of network points.
[0124] It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that here.
[0125] Embodiment 2
[0126] The embodiment of the present application also provides a service handling device. It should be noted that the service handling device of the embodiment of the present application can be used to execute the service handling method provided by the embodiment of the present application. The service handling device provided by the embodiment of the present application is introduced as follows.
[0127] According to the embodiment of the present application, a service handling device for implementing the above service handling method is also provided, as shown in Figure 10 The device includes a first processing unit 1001, an acquisition unit 1002, and a first sending unit 1003.
[0128] The first processing unit 1001 is configured to receive a service handling request sent by a first end and distribute the service handling request to a second end, wherein the second end is configured to provide remote financial services for the first end.
[0129] The acquisition unit 1002 is configured to acquire target communication information in a case where first information sent by the second end is received, wherein the first information is used to indicate that the second end starts to serve.
[0130] The first sending unit 1003 is configured to send the target communication information to the first end and the second end, wherein the first end and the second end perform naked-eye three-dimensional audio and video calls based on the target communication information.
[0131] The service handling device provided by the embodiment of the present application receives a service handling request sent by a first end through the first processing unit 1001 and distributes the service handling request to a second end, wherein the second end is configured to provide remote financial services for the first end. The acquisition unit 1002 acquires target communication information in a case where first information sent by the second end is received, wherein the first information is used to indicate that the second end starts to serve. The first sending unit 1003 sends the target communication information to the first end and the second end, wherein the first end and the second end perform naked-eye three-dimensional audio and video calls based on the target communication information. The technical problem that the service handling efficiency is low because some complex services need to be transferred to other service sites for handling when a service site provides financial services in the related art is solved.
[0132] Optionally, in the service handling apparatus provided by the embodiment of the present application, the apparatus further comprises: a second sending unit, configured to send a service request to the target communication system before the target communication information is acquired, wherein the service request is used to apply for establishing a real-time communication service; and a determining unit, configured to receive a communication room number and a communication address allocated by the target communication system, and determine the target communication information according to the communication room number and the communication address.
[0133] Optionally, in the service handling apparatus provided by the embodiment of the present application, the apparatus further comprises: a second processing unit, configured to enable the first end and the second end to enter a communication room corresponding to the communication room number based on the communication address; a third sending unit, configured to acquire target audio and video data through the second end, and send the target audio and video data to the target communication system, wherein the target communication system is configured to forward the target audio and video data to the first end; and a third processing unit, configured to receive the target audio and video data through the first end, generate three-dimensional image and sound data of the remote customer service according to the target audio and video data, and display the three-dimensional image and play the sound data.
[0134] Optionally, in the service handling apparatus provided by the embodiment of the present application, the third sending unit comprises: a first processing subunit, configured to start a dual-screen camera and a sound pickup device through the second end, calibrate the dual-screen camera, and obtain calibration parameters, wherein the dual-screen camera is configured to collect picture data of the remote customer service, and the sound pickup device is configured to collect audio data of the remote customer service; a second processing subunit, configured to correct the picture data according to the calibration parameters to obtain corrected picture data; and a third processing subunit, configured to perform encoding processing on the corrected picture data and the audio data to obtain the target audio and video data.
[0135] Optionally, in the service handling apparatus provided by the embodiment of the present application, the third processing unit comprises: a fourth processing subunit, configured to perform decoding processing on the target audio and video data to obtain the corrected picture data and the audio data; a fifth processing subunit, configured to perform video synthesis and three-dimensional reconstruction on the corrected picture data to obtain picture information of the remote customer service; and a sixth processing subunit, configured to generate the three-dimensional image according to the picture information, and generate sound data according to the audio data.
[0136] Optionally, in the service handling apparatus provided by the embodiment of the present application, after the first end and the second end enter the communication room corresponding to the communication room number based on the communication address, the target communication system is further configured to record the naked-eye three-dimensional audio and video communication and a service handling picture in the naked-eye three-dimensional audio and video communication.
[0137] Optionally, in the service handling apparatus provided by the embodiment of the present application, the target communication system is further configured to store the recorded audio and video stream and the service handling picture after the first end and the second end exit the communication room.
[0138] It should be noted that the first processing unit 1001, the acquisition unit 1002 and the first sending unit 1003 correspond to steps S201 to S203 in Embodiment 1, and the three units have the same instances and application scenarios as the corresponding steps, but are not limited to the content disclosed in Embodiment 1. It should be noted that the above modules or units can be hardware components or software components stored in the memory (for example, the memory 104) and processed by one or more processors (for example, the processors 102a, 102b, …, 102n), and the above units can also be run in the computer terminal 10 provided in Embodiment 1 as part of the device.
[0139] Embodiment 3
[0140] Embodiments of the present application can provide an electronic device, Figure 11 is a structural block diagram of an electronic device according to an embodiment of the present application. As Figure 11 indicated, the electronic device can include one or more (only one is shown in the figure) processors 1102, a memory 1104, a storage controller, and a peripheral interface, wherein the peripheral interface is connected with a radio frequency module, an audio module and a display. Figure 11
[0141] The memory can be used to store software programs and modules, such as program instructions / modules corresponding to the methods and devices in the embodiments of the present application. The processor executes various functions and data processing by running the software programs and modules stored in the memory, that is, implements the above-mentioned method. The memory can include a high-speed random access memory, and can also include a non-volatile memory, such as one or more magnetic storage devices, flash memories, or other non-volatile solid-state memories. In some examples, the memory can further include a memory remotely arranged with respect to the processor, which can be connected to the terminal through a network. Examples of the above-mentioned network include but are not limited to the Internet, an intranet, a local area network, a mobile communication network, and a combination thereof.
[0142] The processor can call the information and application programs stored in the memory through the transmission device to perform the following steps: receiving a service handling request sent by a first end, and distributing the service handling request to a second end, wherein the second end is used to provide remote financial services for the first end; in the case that a first information sent by the second end is received, obtaining target communication information, wherein the first information is used to indicate that the second end starts to serve; sending the target communication information to the first end and the second end, wherein the first end and the second end perform naked-eye three-dimensional audio and video call based on the target communication information.
[0143] The processor can call information and application programs stored in the memory through the transmission device to perform the following steps: before obtaining the target communication information, sending a service request to the target communication system, wherein the service request is used to apply for establishing a real-time communication service; receiving a communication address and a communication room number allocated by the target communication system, and determining the target communication information according to the communication address and the communication room number.
[0144] The processor can call information and application programs stored in the memory through the transmission device to perform the following steps: the first end and the second end enter the communication room corresponding to the communication room number based on the communication address; obtaining target audio and video data through the second end, and sending the target audio and video data to the target communication system, wherein the target communication system is used to forward the target audio and video data to the first end; receiving the target audio and video data through the first end, generating three-dimensional image and sound data of the remote customer service according to the target audio and video data, and displaying the three-dimensional image and playing the sound data.
[0145] The processor can call information and application programs stored in the memory through the transmission device to perform the following steps: starting the double-screen camera and the sound pickup device through the second end, and calibrating the double-screen camera to obtain calibration parameters, wherein the double-screen camera is used to collect picture data of the remote customer service, and the sound pickup device is used to collect audio data of the remote customer service; correcting the picture data according to the calibration parameters to obtain corrected picture data; and encoding the corrected picture data and the audio data to obtain target audio and video data.
[0146] The processor can call information and application programs stored in the memory through the transmission device to perform the following steps: decoding the target audio and video data to obtain corrected picture data and audio data; video synthesizing and three-dimensional reconstructing the corrected picture data to obtain picture information of the remote customer service; generating a three-dimensional image according to the picture information, and generating sound data according to the audio data.
[0147] The processor can call information and application programs stored in the memory through the transmission device to perform the following steps: after the first end and the second end enter the communication room corresponding to the communication room number based on the communication address, the target communication system is also used to record the naked-eye three-dimensional audio and video communication and the business handling picture in the naked-eye three-dimensional audio and video communication.
[0148] The processor can call information and application programs stored in the memory through the transmission device to perform the following steps: the target communication system is also used to store the recorded audio and video stream and the business handling picture after the first end and the second end exit the communication room.
[0149] Those skilled in the art can understand that, Figure 11The structure shown is only schematic, and the electronic device can also be a smart phone, a tablet computer, a palm computer, a Mobile Internet Device (MID), a PAD, or the like terminal device. Figure 11 It does not limit the structure of the electronic device described above. For example, the electronic device can further include more or less components (such as a network interface, a display device, etc.) than those shown in the above embodiments, or have a different configuration from that shown in the above embodiments. Figure 11 Figure 11 The structure shown is only schematic, and the electronic device can also be a smart phone, a tablet computer, a palm computer, a Mobile Internet Device (MID), a PAD, or the like terminal device.
[0150] Those skilled in the art can understand that all or part of the steps of the various methods in the above embodiments can be instructed by a program to the hardware related to the terminal device, and the program can be stored in a computer readable storage medium, which can include a flash disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, etc.
[0151] Embodiment 4
[0152] The embodiments of the present application also provide a computer readable storage medium. Optionally, in the embodiment, the storage medium can be used to store the program code executed by the service handling method provided in Embodiment 1.
[0153] Optionally, in the embodiment, the storage medium can be located in any one of the computer terminals in the computer terminal group in the computer network, or in any one of the mobile terminals in the mobile terminal group.
[0154] The present application also provides a computer program product adapted to execute the steps of the service handling method when executed on a data processing device.
[0155] The above-mentioned serial numbers of the embodiments of the present application are only for description, and do not represent the advantages or disadvantages of the embodiments.
[0156] In the above embodiments of the present application, the description of each embodiment has its own focus, and the parts not described in detail in a certain embodiment can be referred to the relevant description of other embodiments.
[0157] In several embodiments provided in the present application, it should be understood that the disclosed technology can be implemented by other ways. Among them, the above-described device embodiments are only schematic, for example, the division of the units is only a logical function division, and actual implementation can have another division manner, for example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the displayed or discussed units can be indirect coupling or communication connection through some interfaces, units or modules, and can be electrical or other forms.
[0158] The units described as separate components can or can not be physically separate, and the components shown as units can or can not be physical units, that is, they can be located in one place, or they can be distributed on a plurality of network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the embodiment.
[0159] In addition, the functional units in each embodiment of the present application can be integrated in one processing unit, or each unit can be physically present separately, or two or more units can be integrated in one unit. The integrated unit can be realized in the form of hardware or in the form of a software functional unit.
[0160] The integrated unit, if realized in the form of a software functional unit and sold or used as an independent product, can be stored in a computer readable storage medium. Based on this understanding, the technical solutions of the present application essentially or the part that contributes to the prior art or the whole or part of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes a plurality of instructions for causing a computer device (which can be a personal computer, a server or a network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The foregoing storage medium includes: a U disk, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), a mobile hard disk, a magnetic disk or an optical disk, and various media that can store program codes.
[0161] The above is only the preferred embodiment of the present application, and it should be pointed out that for ordinary skilled in the art, without departing from the principles of the present application, a number of improvements and refinements can be made, and these improvements and refinements should be considered as the protection scope of the present application.
Claims
1. A service handling method characterized by, The method comprises the following steps: receiving a service request sent by a first terminal, and distributing the service request to a second terminal, wherein the second terminal is used to provide remote financial services for the first terminal; acquiring target communication information when receiving first information sent by the second terminal, wherein the first information is used to indicate that the second terminal starts to serve; sending the target communication information to the first terminal and the second terminal, wherein the first terminal and the second terminal perform naked-eye three-dimensional audio-video communication based on the target communication information.
2. The method of claim 1, wherein, Before acquiring the target communication information, the method further comprises the following steps: sending a service request to a target communication system, wherein the service request is used to apply for establishing real-time communication service; receiving a communication room number and a communication address allocated by the target communication system, and determining the target communication information according to the communication room number and the communication address.
3. The method of claim 2, wherein, The first terminal and the second terminal perform naked-eye three-dimensional audio-video communication based on the target communication information, which comprises the following steps: the first terminal and the second terminal enter a communication room corresponding to the communication room number based on the communication address; acquiring target audio-video data through the second terminal, and sending the target audio-video data to the target communication system, wherein the target communication system is used to forward the target audio-video data to the first terminal; receiving the target audio-video data through the first terminal, generating three-dimensional image and sound data of the remote customer service according to the target audio-video data, and displaying the three-dimensional image and playing the sound data.
4. The method of claim 3, wherein, The target audio-video data is acquired through the second terminal, which comprises the following steps: starting a double-screen camera and a sound pickup device through the second terminal, calibrating the double-screen camera to obtain calibration parameters, wherein the double-screen camera is used to collect picture data of the remote customer service, and the sound pickup device is used to collect audio data of the remote customer service; correcting the picture data according to the calibration parameters to obtain corrected picture data; encoding the corrected picture data and the audio data to obtain the target audio-video data.
5. The method of claim 4, wherein, The three-dimensional image and the sound data of the remote customer service are generated according to the target audio-video data, which comprises the following steps: decoding the target audio-video data to obtain the corrected picture data and the audio data; performing video synthesis and three-dimensional reconstruction on the corrected picture data to obtain picture information of the remote customer service; generating the three-dimensional image according to the picture information, and generating the sound data according to the audio data.
6. The method of claim 3, wherein after the first terminal and the second terminal enter the communication room corresponding to the communication room number based on the communication address, the target communication system is further used to record the naked-eye three-dimensional audio-video communication and a service handling picture in the naked-eye three-dimensional audio-video communication.
7. The method of claim 6, wherein the target communication system is further used to store the recorded audio-video stream and the service handling picture after the first terminal and the second terminal exit the communication room.
8. A service processing apparatus characterized by comprising: The method comprises the following steps: A first processing unit is configured to receive a service request sent by a first terminal and distribute the service request to a second terminal, wherein the second terminal is configured to provide remote financial service for the first terminal; An obtaining unit is configured to obtain target communication information when receiving first information sent by the second terminal, wherein the first information is used to indicate that the second terminal starts to serve; A first sending unit is configured to send the target communication information to the first terminal and the second terminal, wherein the first terminal and the second terminal perform naked-eye three-dimensional audio and video communication based on the target communication information.
9. A computer-readable storage medium, characterized in that, The computer readable storage medium comprises a stored executable program, wherein the executable program controls the device where the computer readable storage medium is located to perform the service method in any one of claims 1 to 7 when the executable program is running.
10. An electronic device, comprising: Comprise: A memory storing an executable program; A processor configured to run the program, wherein the program performs the service method in any one of claims 1 to 7 when the program is running.