Eye-controlled sheet music page turner (EyeScore)

Abstract

The invention relates to an eye-tracking device for automatically turning the pages of a musical score by tracking and fixing the gaze. The device is characterized in that it consists of: - an eye-tracking device, - a tablet or computer displaying a musical score on its screen. The eye-tracking device is coupled with the tablet or computer so that the page turner is triggered automatically using the gaze fixation detected by the eye-tracking device on a defined area of ​​the screen. [Fig 1]

Description

Title of invention: Eye-controlled music score page turner - EyeScore

[0001] The invention relates to an eye-controlled musical score page-turning device which consists of coupling an eye-tracking device with a tablet or a PC allowing the reading of a musical score and associating specific software integrating different functionalities that a musician can expect in the digital management of his score.

[0002] The device allows the page of the score to be turned automatically by using the gaze fixation detected by the eye tracker on a defined area of ​​the tablet or computer screen. This allows the musician to keep his hands on his instrument and not alter the speed of reading his score.

[0003] Eye tracking technology is a sensor technology capable of detecting the presence of a person and tracking what they are looking at in real time. The technology converts eye movements into a data stream containing information such as pupil position, gaze vector for each eye and gaze point on the screen, the technology decodes eye movements and translates them into information that can be used in a wide range of applications. An eye tracking system includes one or more cameras, some light sources and computing capabilities. Algorithms translate the camera feed into data points using machine learning and advanced image processing.

[0004] The device according to the invention is characterized in that it consists of: an eye tracking device, a tablet or a computer displaying a musical score on its screen. The eye tracking device is coupled with the tablet or the computer so that the page turning is triggered automatically using the fixation of the gaze detected by the eye tracking device on a defined area of ​​the screen as illustrated [Fig.l].

[0005] EyeScore is a computer application that characterizes the software implementation of the eye-controlled musical score page-turning device according to the invention. As illustrated in figure [Fig.2], this application is based on Tobii technology. Once the application is installed, the musician can start importing scores via a browser, email or by using cloud services or by transferring files via Bluetooth. EyeScore allows very rapid access to scores. The drawing [Fig.2] illustrates a simplified overview of the hardware and software stack of Tobii technology (registered trademark). The software package named Tobii Platform Development Kit (PDK) is included with the eye trackers Tobii. The PDK is the smallest collection of software that enables communication between the application and the Tobii Eye Tracker. It consists of two main components: Tobii Runtime and Tobii Stream Engine. The Tobii Runtime is a service that manages the connection to the device. Each Runtime is tied to a specific device type and will not work or interfere with other device types. Tobii Stream Engine includes the low-level C API and serves as the basis for all software that communicates with all types of Tobii Eye Trackers. The specific version of Stream Engine included in the PDK has been tested for that particular device type.

[0006] The device according to the invention has other characteristics, namely: a. Share a set of sheet music, making it perfect for a band, orchestra, or choir. b. Annotate quickly and accurately using the Eyetracker or a digital pen. c. Manage the score library using list set categories, filters, and sorting options. d. Adapt the layout to the musician's needs. e. Activate page scrolling manually or using the eye page turner. f. The application also has several programmed tools to facilitate the practice of music, such as a metronome, a tuning fork, a tuner, a learning method and functions to facilitate learning to read music such as the colorimetry of the scores [Fig.l] g. Zoom by head movement.

Claims

Claims

1. Eye-controlled device for automatically turning the pages of a musical score by tracking and fixing the gaze, the device is characterized in that it consists of: - an eye-tracking device, - a tablet or a computer displaying a musical score on its screen The eye tracking device is paired with the tablet or computer so that page turning is triggered automatically using gaze fixation detected by the eye tracking device on a defined area of ​​the screen.

Images