Desktop type transparent display translation terminal

Abstract

The utility model relates to a desktop type transparent display translation terminal which comprises a central processing module, an interaction device, a desktop type placing base and a display screen which is fixed on the base and used for forming real-time translation, the interaction device is coupled with the central processing module, the display screen is configured to be a double-sided transparent screen, and the front face serves as a client use equipment end. The client use equipment end and the customer service operation equipment end are respectively provided with a voice recognition device used for collecting personnel-oriented audios of the display screen, the client use equipment end is at least provided with a human image recognition device, and the central processing module is respectively coupled with the display screen, the voice recognition device and the human image recognition device. The translation terminal adopts a front-back double-screen display design, double image and voice acquisition is realized, acquisition is accurate, duplex translation interaction is realized, and real-time translation of any two languages is supported.

Description

Technical Field

[0001] This utility model relates to the processing or conversion of natural language, and more particularly to a desktop transparent display translation terminal. Background Technology

[0002] With China's globalization, the number of foreign friends in China is increasing, distributed across various fields and locations nationwide. There are relatively few commercially available desktop translation devices in China. Existing translation devices on the market are mainly handheld or portable, with single-screen displays, and their screen sizes are unsuitable for use at service counters in hotels, tourist attractions, airports, etc. They also lack accurate recognition capabilities, leading to problems such as recognition errors when multiple people are speaking simultaneously.

[0003] CN117574923A discloses a real-time interactive AI voice translation transparent screen, which is a single-screen display. After the content entered by the foreign friend is translated, it is transmitted to the counter staff, and the foreign friend's side is not displayed. Similarly, after the content entered by the counter staff is translated, it is transmitted to the foreign friend's side, and the counter staff's side is not displayed. In order to solve this problem, a dual-screen solution is proposed. Summary of the Invention

[0004] To address the shortcomings of existing technologies, this invention provides a hardware structure for a desktop transparent display translation terminal.

[0005] To achieve the above objectives, this utility model provides the following technical solution:

[0006] A desktop transparent display translation terminal is provided, including a central processing module, an interactive device, a desktop base, and a display screen fixed on the base for real-time translation. The interactive device is coupled to the central processing module. The display screen is configured as a double-sided transparent screen, with the front serving as the user device and the back serving as the customer service operation device. Both the user device and the customer service operation device are equipped with a voice recognition device for collecting audio from the display screen facing people. The user device is equipped with at least one facial recognition device. The central processing module is coupled to the display screen, the voice recognition device, and the facial recognition device.

[0007] Furthermore, it includes a speaker sound-emitting device that couples to the central processing module.

[0008] Furthermore, the customer-side device and / or customer service-side device are equipped with touch devices, which serve as interactive devices.

[0009] Furthermore, the touch device on the customer's device is configured as a capacitive touch device integrated on a double-sided transparent screen for front-side touch operation.

[0010] Furthermore, the touch device on the customer service operation device is configured as a single-sided capacitive touch screen.

[0011] Furthermore, the front and back of the display screen each form an independent subsystem. Each subsystem includes at least a human face recognition device, a voice recognition device, a content display device, an interactive touch device, a speaker, a communication device, and a central processing module that couples the various electronic devices within the system to serve the corresponding side. The two subsystems communicate with each other through the communication device.

[0012] Furthermore, the communication device is a network and / or a TTL serial port. The menu configuration of the front and rear screens is communicated via TTL serial port, and functions such as translation are interacted via the network.

[0013] Furthermore, the speech recognition device is an array noise reduction pickup device.

[0014] Compared with the prior art, the hardware of this utility model, after being programmed, has the following beneficial effects:

[0015] 1. Solve the problem of commercial desktop placement with a front and rear dual-screen display design. The A-side uses a transparent OLED display screen for manual interactive operation; people on the B-side can see the A-side through the transparent display screen, with no visual or interactive obstacles.

[0016] 2. Front and rear dual-screen image and voice capture: the front screen is the client side, which uses an image recognition device in conjunction with a voice recognition device to achieve accurate image capture; the other side is the client side, and the front and rear voices can be recognized simultaneously and translated into text information and displayed on the screen. The front and rear dual screens support real-time mutual translation between any two languages. Attached Figure Description

[0017] Figure 1 A schematic diagram of the A-side structure of the desktop transparent display translation terminal of this utility model is provided;

[0018] Figure 2 A schematic diagram of the B-side structure of the desktop transparent display translation terminal of this utility model is provided; and

[0019] Figure 3 A system block diagram of the desktop transparent display translation terminal of this utility model is provided. Detailed Implementation

[0020] The technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments. For clarity, many practical details will be described in the following description. However, it should be understood that these practical details should not be used to limit the present application. That is, in some embodiments of the present application, these practical details are not necessary. In addition, for the sake of simplifying the drawings, some conventional structures and components will be shown in a simple schematic manner in the drawings.

[0021] It should be noted that all directional indications in the embodiments of this application, such as up, down, left, right, front, back, etc., are only used to explain the relative positional relationship and movement of the components in a specific posture as shown in the attached figure. If the specific posture changes, the directional indication will also change accordingly.

[0022] Furthermore, the use of terms such as "first" and "second" in this application is for descriptive purposes only and does not specifically refer to any order or sequence, nor is it intended to limit this application. They are merely used to distinguish components or operations described using the same technical terms and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Therefore, a feature defined with "first" or "second" may explicitly or implicitly include at least one of those features. Additionally, the technical solutions of various embodiments can be combined with each other, but only if they are feasible for those skilled in the art. If a combination of technical solutions is contradictory or impossible to implement, it should be considered that such a combination of technical solutions does not exist and is not within the scope of protection claimed in this application.

[0023] To further understand the invention's content, features, and effects, the following embodiments are provided, and detailed descriptions are given in conjunction with the accompanying drawings.

[0024] refer to Figures 1 to 3 The desktop transparent display translation terminal includes a rectangular desktop base with a transparent glass panel fixed on top. The display screen 1 is attached to the glass, and the glass is fixed to the base. The base has front and rear clamps for fixation, and a maintenance door at the bottom allows for disassembly and reassembly. The display screen 1 is a double-sided transparent screen used for real-time translation. The base has circuitry, including at least a central processing module 10 and an interactive device 20 coupled to the central processing module 10. The front (A-side) of the display screen 1 serves as the user device, and the back (B-side) serves as the customer service operation device. Both the user device and the customer service operation device are equipped with a voice recognition device 30 for collecting audio from the display screen 1 facing the user. The user device is equipped with at least a facial recognition device 40. The central processing module 10 is coupled to the display screen 1, the voice recognition device 30, and the facial recognition device 40.

[0025] Device A, designed for foreign visitors from different countries, can be equipped with position detection sensors to automatically recognize people within a 1-meter range. Device A supports 14 languages ​​and allows language selection via the dual-sided display screen 1 and interactive device 20. After selection, device A captures the person's image and audio. This capture includes lip-sync detection, converting lip movements into text using image lip-sync translation technology, and recognizing the audio using speech recognition technology. The two are compared and matched for accurate capture, ensuring that other people's voices are not captured. The audio captured by device A is converted into text information and simultaneously translated and displayed on device B in the selected language. The translation function of device B is identical to that of device A, automatically recognizing and translating the audio and displaying it on screen 1. Both functions operate in parallel, offering superior real-time performance and interactivity without interference. In this implementation, the image recognition device 40 is a camera, and the image lip-sync translation and speech recognition technologies employ traditional computer vision and speech conversion algorithms, which will not be elaborated upon here.

[0026] Furthermore, a speaker-emitting device 50, which couples to the central processing module 10, is installed inside the base. The speaker-emitting device is a speaker unit. In this solution, the device on side A can support intelligent digital human customer service. After configuration on side B, a digital human customer service appears on side A, allowing foreign visitors to interact with the digital human through voice question and answer.

[0027] Furthermore, the customer-side device and / or customer service-side device are equipped with touch devices, which serve as interactive devices 20, achieving a simplified structure, high integration, and high sensitivity. The touch devices can be capacitive or photoelectric. This embodiment preferably uses capacitive touch devices for ease of placement. Specifically, the touch device on the customer-side device is configured as a capacitive touch device 21 integrated into a double-sided transparent screen for front-side touch operation. In this case, the display screen 1 is a capacitive screen for touch operation on side A, which has a large input surface. To avoid capacitive interference, the capacitive touch input on the customer service side is not located on side B. The touch device on the customer service-side device is configured as an additional single-sided capacitive touch display screen 22. This single-sided capacitive touch display screen is a miniaturized 3-inch screen, gradually tilted downwards away from display screen 1 and placed beside the base on side B, avoiding view of foreign visitors.

[0028] To enhance translation timeliness and processing speed, each side of the display screen 1 forms an independent subsystem. Each subsystem includes at least a facial recognition device 40, a voice recognition device 30, a content display device 60 (the corresponding display hardware of the double-sided display screen 1, driven by the display driver module), an interactive touch device 20, a speaker device 50, a communication device, and a central processing module 10 coupling the various electronic devices within the system. The two subsystems communicate with each other through the communication device. Furthermore, the communication device is a network and / or a TTL serial port. Menu configurations for the front and rear screens are communicated via TTL serial port, while translation and other functions are exchanged via network, achieving high-speed communication.

[0029] Furthermore, the speech recognition device 30 is an array noise reduction pickup device, preferably with a four-array structure, to achieve directional speech acquisition and enhance acquisition accuracy.

[0030] The translation terminal in this embodiment can solve the translation function, unattended digital customer service function, and advertising function of commercial desktop translation terminals:

[0031] 1. The translation function supports 14 languages ​​and features a simple, visual module that enables real-time translation of the corresponding language. The selected language on side A will be recognized and the content in that language will be displayed. Similarly, other languages ​​on side B will be translated into the content in language A and displayed on the dialog window on side A. The recognition and display of side B are similar to those on side A.

[0032] 2. The unattended function can be configured with one click on the B-side device. A digital human will then appear on the A-side, allowing users to ask and answer questions. The digital human customer service will replace the human customer service representative in responding to questions.

[0033] 3. When there are no users on device A, the user can be directed to an advertising page where embedded advertisements will play in rotation. When a person is detected, the user will be redirected to the digital human customer service page or the translation function interface.

[0034] The above description is only a preferred embodiment of the present utility model, but the protection scope of the present utility model is not limited thereto. Any equivalent substitutions or changes made by those skilled in the art within the technical scope disclosed in the present utility model, based on the technical solution and the inventive concept of the present utility model, should be included within the protection scope of the present utility model.

Claims

1. A desktop transparent display translation terminal, comprising a central processing module, an interactive device, a desktop base, and a display screen fixed to the base for real-time translation, wherein the interactive device is coupled to the central processing module, characterized in that: The display screen is configured as a double-sided transparent screen, with the front side serving as the customer-use device and the back side serving as the customer service operation device. Both the customer-use device and the customer service operation device are equipped with a voice recognition device for collecting audio from the display screen when it is facing people. The customer-use device is equipped with at least one facial recognition device. The central processing module is coupled to the display screen, the voice recognition device, and the facial recognition device.

2. The desktop transparent display translation terminal according to claim 1, characterized in that: Includes a speaker sound-emitting device that couples to the central processing module.

3. The desktop transparent display translation terminal according to claim 1, characterized in that: The customer-operated device and / or customer service-operated device are equipped with touch devices, which serve as interactive devices.

4. The desktop transparent display translation terminal according to claim 3, characterized in that: The customer uses a device with a capacitive touchscreen integrated on a double-sided transparent screen for front-side touch operation.

5. The desktop transparent display translation terminal according to claim 3 or 4, characterized in that: The touch control device on the customer service operation device is configured as a single-sided capacitive touch screen.

6. The desktop transparent display translation terminal according to claim 1, characterized in that: The front and back of the display screen each form an independent subsystem. Each subsystem includes at least a human face recognition device, a voice recognition device, a content display device, an interactive touch device, a speaker, a communication device, and a central processing module that couples the various electronic devices within the system to serve the corresponding side. The two subsystems communicate with each other through the communication device.

7. The desktop transparent display translation terminal according to claim 6, characterized in that: The communication device is a network and / or a TTL serial port.

8. The desktop transparent display translation terminal according to claim 1, characterized in that: The speech recognition device is an array noise reduction pickup device.

Images