Wearable technologies and virtual reality supported training system and method

Abstract

A training system supported by wearable technologies and virtual reality to provide employee training, characterized in that, it comprises the following; a training area (10) where employees are free to roam and receive training using haptic gloves (40), jackets (50) and virtual reality goggles (60), haptic glove (40) that enables the detection of hand and finger movements of the employees by means of the sensors inside and the filtering and compilation of the data by means of the processor inside, a jacket (50) connected to the interface box (90) which transmits the data and energy provided by the interface box (90) to the left and right haptic glove (40), interface box (90) that allows communication with the server (70), base station (80) that allows the location of the haptic glove (40) to be determined, virtual reality goggles (60) that allow employees to see objects in a virtual reality environment), server (70) receiving location data from the base station (80, receiving sensor data via haptic gloves (40) and the interface box (90) over the jacket, providing the necessary data to the virtual reality goggles (60), triggering the necessary algorithms by communicating with the virtual reality environment structure, haptic glove (40) and jacket (50) software infrastructure, revealing the necessary data and transmitting the same to the interface box (90) connected to the computer, operator area (20) that allows employees to be given instructions or information, employees to be listened to, employees to be monitored through cameras, and operations to be followed through the eyes of trained employees on monitors.

Description

[0001] DESCRIPTION

[0002] Wearable technologies and virtual reality supported training system and method

[0003] Field of the Invention

[0004] The present invention relates to a training system and method supported by wearable technologies and virtual reality to provide employee training.

[0005] State of the Art

[0006] Today, various training methods are applied in workplaces, especially for the training of new employees or for existing employees to acquire new skills. Generally, the oldest method is for an experienced employee member to verbally convey the necessary information about the job to new employees. In addition, various videos are shown to the employees and orientation trainings are provided. There are difficulties in providing practical training to new employees, especially in jobs with high hazard or risk. Therefore, there is a need for systems that will enable the training of employee in a risk-free manner.

[0007] Summary of the application with the number 2022 / 001751 that emerged as a result of technical research is as follows; “The invention relates to the method used to provide training on hydraulic and pneumatic systems in a virtual reality environment. In particular, the invention relates to a vocational training method for learning hydraulic and pneumatic systems by using virtual reality goggles with motion and control devices, a receptacle in which virtual reality goggles can be placed, and a kiosk device that includes a screen that can transmit instant images to the outside while using the application.”

[0008] As can be seen, the system is related to the method used in the training of hydraulic and pneumatic systems in a VIRTUAL reality environment, as well as a structure that can provide a solution to the disadvantages mentioned above.

[0009] As a result, due to the above mentioned disadvantages and the insufficiency of the current solutions regarding the subject matter, a development is required to be made in the relevant technical field. Aim of the Invention

[0010] The invention aims to provide a structure having different technical features which brings a new development in this field different from the embodiments used in the state of the art.

[0011] The main aim of the present invention is to provide a training system and method supported by haptic gloves and virtual glasses to provide employee training.

[0012] One object of the invention is to provide hands-on training to employees in a risk-free manner using haptic gloves, jackets and VR goggles.

[0013] In order to fulfil the aims described above, the present invention is a training system supported by wearable technologies and virtual reality to provide employee training, characterized in that, it comprises the following;

[0014] • a training area where employees are free to roam and receive training using haptic gloves, jackets and virtual reality goggles,

[0015] • haptic glove that enables the detection of hand and finger movements of the employees by means of the sensors inside and the filtering and compilation of the data by means of the processor inside,

[0016] • a jacket connected to the interface box which transmits the data and energy provided by the interface box to the left and right haptic glove,

[0017] • interface box that allows communication with the server,

[0018] • base station that allows the location of the haptic glove to be determined,

[0019] • virtual reality goggles that allow employees to see objects in a virtual reality environment,

[0020] • o server receiving location data from the base station, o receiving sensor data through the interface box via haptic gloves and jacket, o providing the necessary data to the virtual reality goggles, o triggering the necessary algorithms by communicating with the virtual reality environment structure, haptic glove and jacket software infrastructure, o revealing the necessary data and transmitting the same to the interface box connected to the computer, • operator area that allows employees to be given instructions or information, employees to be listened to, employees to be monitored through cameras, and operations to be followed through the eyes of trained employees on monitors.

[0021] The structural and characteristic features of the present invention will be understood clearly by the following drawings and the detailed description made with reference to these drawings and therefore the evaluation shall be made by taking these figures and the detailed description into consideration.

[0022] Figures Clarifying the Invention

[0023] Figure 1 , is the representation of the elements used in the inventive system together.

[0024] Figure 2, is a perspective view of the inventive system.

[0025] Figure 3, is a representation of haptic gloves, jackets and virtual reality goggles.

[0026] Figure 4, is a representation of the free navigation training area.

[0027] Figure 5, is a representation of the operator area.

[0028] Figure 6, is a representation of the system cabinets.

[0029] The figures are not required to be scaled and the details which are not necessary for understanding the present invention may be neglected. Moreover, the elements that are at least substantially identical or have at least substantially identical functions are shown by the same number.

[0030] Description of the Part References

[0031] 10. Training area

[0032] 20. Operator area

[0033] 30. System cabinet

[0034] 40. Haptic gloves

[0035] 50. Jacket

[0036] 60. Virtual reality goggles

[0037] 70. Server

[0038] 80. Base station

[0039] 90. Interface box

[0040] Detailed Description of the Invention In this detailed description, the preferred embodiments of the invention are described only for clarifying the subject matter in a manner such that no limiting effect is created.

[0041] The present invention relates to a training system and method supported by wearable technologies and virtual reality to provide employee training.

[0042] In the inventive system, there is a training area (10) where the employees who will receive training are free to move around and receive training using haptic gloves (40), jackets (50) and virtual reality goggles (60).

[0043] The training area (10) is preferably 300 cm x 300 cm x 250 cm (width x depth x height) from outside to outside. In this area, there are four cameras with continuous recording, at least 2 base stations (80) that monitor the locations and positions of the virtual reality goggles (60) and haptic gloves (40), and equipment to illuminate the area when necessary. The location data received from the base stations (80) are transmitted to the server (70).

[0044] There is also a sound system so that sounds can be given to the environment when necessary, and a large screen so that the virtual reality operations of the trained employee can be monitored except for the operators. The set of virtual reality goggles (60) and haptic gloves (40) are connected to the computer system by a cable bundle coming from the top, which allows navigating the entire training area. There is a mechanism that adjusts the cable bundle in cases where the cable is stretched or loosened. Alternatively, a wireless configuration can be achieved by using wireless virtual reality goggles (60) and adding a wireless communication data transfer module to the haptic glove (40). For this purpose, (50) energy modules / batteries can be installed in the jacket.

[0045] The person entering the training area (10) can leave his / her belongings such as phone, wallet, keys, etc. in the locked safety deposit box located at the bottom next to the operator's desk.

[0046] Before starting the training, the employee who is being trained, puts on the carrier jacket (50) with the support of the operator, virtual reality goggles (60) and puts on the haptic gloves (40) that enable the system to track hand and finger movements and let the employee feel physical feedback in the virtual reality environment. Walks to the centre of the field and takes a forward position. Haptic glove (40) enables the detection of hand and finger movements of the employees by means of the sensors inside and the filtering and compilation of the data by means of the processor inside.

[0047] It is connected to the interface box (90) of the jacket (50). The interface box (90) is plugged in and also provides communication with the server (70). The data and energy provided by the interface box (90) is distributed and transmitted through the jacket (50) to the left and right haptic glove (40) to which it is connected. Alternatively, a battery can be added to the jacket (50) to provide the required energy.

[0048] The operator area (20) is preferably formed with a 220 cm x 60 cm table. It is equipped with two monitors, a microphone, headphones, mouse and keyboard. Up to three operators can be arranged to use this section. The operator can give instructions or information to the employee being trained with the microphone and headset on the operator's desk. The operator can monitor the employee from different angles through the built-in closed circuit camera system, and follow operations from the perspective of the employee receiving training through monitors.

[0049] The system cabinets (30) consist of three sections. Each section has an independent ventilation system. The lower section houses the electrical panel, electrical distribution system and UPS system. There are main fuse, residual current relay and section fuses in the electrical panel. Each independent unit is energised through separate single-phase fuses. The entire system fed by the online UPS system is protected against possible accidents with the residual current relay. The middle section is for storage purposes and contains the sets of haptic gloves (40), virtual reality goggles (60) and jackets (50). The upper section houses devices such as computers, computer additional components and networking products.

[0050] The process steps carried out with the inventive system is as follows;

[0051] • Measuring hand and finger movements by the sensors on the haptic glove (40) and filtering and compiling them with the processor structure on the haptic glove (40),

[0052] • Transferring the filtered and compiled data to the glove and jacket software infrastructure on the server (70) via the interface box (90) to which the jacket (50) is connected, by applying algorithms,

[0053] • Detecting the tracking structure on the haptic glove (40) by the base stations (80) and transferring the location data to the server (70) and passing this transferred data through algorithms for filtering and calculation depending on the active movements of the haptic glove (40),

[0054] • Transferring the state of movement of hands and fingers to the virtual reality environment together with the data coming to the server (70) and processed by the software, and transmitting the same to the virtual reality glasses (60),

[0055] • The employees’ seeing the objects in the virtual reality environment with virtual reality glasses (60), touching and holding objects in virtual reality environment with hands and fingers,

[0056] • Transmitting data such as touching, holding, grasping and moving to the server (70) when the virtual objects seen with the virtual reality glasses (60) are touched or held with the hand seen in the virtual reality environment,

[0057] • The server’s (70) communicating with the virtual reality environment structure, haptic gloves (40) and jacket (50) software infrastructure and triggering the necessary algorithms,

[0058] • The triggered algorithms' revealing the necessary data and transmitting the same to the interface box (90) connected to the computer,

[0059] • The interface box’s (90) transmitting the incoming data and the received energy to the jacket (50) to which it is connected to and from there to the haptic glove (40),

[0060] • Separating the data coming to the haptic glove (40) by the processor in the haptic glove (40), passing through certain algorithms and triggering the electronic and mechanical structures (vibration, tension, etc.) that need to operate,

[0061] • Transferring the data that the triggered structures have become active back to the server (70) and repeating the cycle.

Claims

CLAIMS1. A training system supported by wearable technologies and virtual reality to provide employee training, characterized in that, it comprises the following;• a training area (10) where employees are free to roam and receive training using haptic gloves (40), jackets (50) and virtual reality goggles (60),• haptic glove (40) that enables the detection of hand and finger movements of the employees by means of the sensors inside and the filtering and compilation of the data by means of the processor inside,• a jacket (50) connected to the interface box (90) which transmits the data and energy provided by the interface box (90) to the left and right haptic glove (40),• interface box (90) that allows communication with the server (70),• base station (80) that allows the location of the haptic glove (40) to be determined,• virtual reality goggles (60) that allow employees to see objects in a virtual reality environment,• o server (70) receiving location data from the base station (80), o receiving sensor data through the interface box (90) via haptic gloves (40) and jacket (50), o providing the necessary data to the virtual reality goggles (60), o triggering the necessary algorithms by communicating with the virtual reality environment structure, haptic glove (40) and jacket (50) software infrastructure, o revealing the necessary data and transmitting the same to the interface box (90) connected to the computer,• operator area (20) that allows employees to be given instructions or information, employees to be listened to, employees to be monitored through cameras, and operations to be followed through the eyes of trained employees on monitors.

2. System according to claim 1 , characterized in that; it comprises system cabinet (30), which houses the electrical distribution system and UPS system and comprises the main fuse, residual current relay and section fuses within the electrical panel.

3. System according to claim 1 , characterized in that; it comprises a system cabinet (30) that provides the storage of haptic glove (40) sets, virtual reality goggles (60) and jacket4. System according to claim 1 , characterized in that; it comprises system cabinet (30) housing the computer, computer additional components and network products.

5. System according to claim 1 , characterized in that; the training area (10) comprises four cameras.

6. System according to claim 1 , characterized in that; the training area (10) comprises two base stations (80).

7. System according to claim 1 , characterized in that; the training area (10) comprises equipment to illuminate the field when necessary.

8. System according to claim 1 , characterized in that; the training area (10) comprises a sound system that allows the sounds to be given to the environment, and a screen that allows the virtual reality operations of the trained employees to be monitored, apart from the operators.

9. System according to claim 1 , characterized in that; it comprises a cable bundle that connects the virtual reality goggles (60) and haptic glove (40) set to the computer system and allows to tour the entire training area (10).

10. System according to claim 1 or 9, characterized in that; it comprises a mechanism that adjusts the cable bundle in cases where the cable is stretched or loosened.

11. System according to claim 1 , characterized in that; it comprises an operator area (20) comprising two monitors, a microphone, a headset, a mouse and a keyboard.

12. A training method supported by wearable technologies and virtual reality to provide employee training, characterized in that, it comprises the following process steps;• Measuring hand and finger movements by the sensors on the haptic glove (40) and filtering and compiling them with the processor structure on the haptic glove (40),• Transferring the filtered and compiled data to the glove and jacket software infrastructure on the server (70) via the interface box (90) to which the jacket (50) is connected, by applying algorithms,• Detecting the tracking structure on the haptic glove (40) by the base stations (80) and transferring the location data to the server (70) and passing this transferred data through algorithms for filtering and calculation depending on the active movements of the haptic glove (40),• Transferring the state of movement of hands and fingers to the virtual reality environment together with the data coming to the server (70) and processed by the software, and transmitting the same to the virtual reality glasses (60),• Employees are seeing the objects in the virtual reality environment with virtual reality glasses (60), touching and holding objects in virtual reality environment with hands and fingers,• T ransmitting data such as touching, holding, grasping and moving to the server (70) when the virtual objects seen with the virtual reality glasses (60) are touched or held with the hand seen in the virtual reality environment,• Server’s (70) communicating with the virtual reality environment structure, haptic gloves (40) and jacket (50) software infrastructure and triggering the necessary algorithms,• Triggered algorithms' revealing the necessary data and transmitting the same to the interface box (90) connected to the computer,• Interface box’s (90) transmitting the incoming data and the received energy to the jacket (50) to which it is connected to and from there to the haptic glove (40),• Separating the data coming to the haptic glove (40) by the processor in the haptic glove (40), passing through certain algorithms and triggering the electronic and mechanical structures that need to operate,• Transferring the data that the triggered structures have become active back to the server (70) and repeating the cycle.

Images