System and Related Methods for Automated Ball Detection and Game Management on a Lane

The system addresses the limitations of conventional mini golf systems by automating ball detection and game management with a camera, projector, and lighting control, providing flexible and immersive gameplay experiences with reduced maintenance.

US20260355575A1Pending Publication Date: 2026-11-12STUART ROWLANDS STUART +1
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
US19/216777
Authority / Receiving Office
US · United States
Patent Type
Applications(United States)
Current Assignee / Owner
Priority Date
2025-05-12
Filing Date
2025-05-23
Publication Date
2026-11-12

AI Technical Summary

Technical Problem

Conventional mini golf systems rely heavily on manual processes and mechanical components, leading to wear and tear, frequent maintenance, limited flexibility, and a lack of immersive and customizable gaming experiences, which restricts user engagement and adaptability.

Method used

A system utilizing a camera, processing unit, projector, and lighting control for automated ball detection and game management, employing image processing to track the ball's movement and interaction with holes, with dynamic projection and lighting effects, and communication with a remote server for data storage and updates.

Benefits of technology

Enables flexible, low-maintenance, and immersive gameplay with real-time customization, reducing hardware failures and enhancing user interaction through scalable and adaptive game experiences.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure US20260355575A1-D00000_ABST
    Figure US20260355575A1-D00000_ABST
Patent Text Reader

Abstract

A system for managing a ball-based game on a lane includes a camera configured to capture frames of the lane, which contains a plurality of holes. A processing unit receives the frames and executes computer-implemented instructions to detect a moving object, analyze its movement and size, and determine its position relative to predefined regions on the lane. The system further comprises a projector in communication with the processing unit, configured to display visual content onto the lane, and a user interface device that allows interaction with the system. A network interface transmits data between the processing unit and a remote server. The system also includes a lighting control unit connected to multiple lighting elements along the lane, which are controlled based on signals from the processing unit.
Need to check novelty before this filing date? Find Prior Art

Description

FIELD OF INVENTION

[0001] The present invention relates to systems and methods for detecting and tracking objects in a ball-based game. Specifically, it involves the automated detection of ball movement on a lane and the corresponding management of gameplay using image processing, projection, and lighting control.BACKGROUND

[0002] In the realm of entertainment and recreational activities, mini golf has long been a popular, accessible pastime. Traditional mini golf courses, however, rely heavily on manual processes, including player interaction and score tracking, often resulting in limitations with respect to convenience, engagement, and interactivity. Conventional mini golf systems typically lack integration with modern technology, limiting the scope of enhancing user experiences, offering diverse gameplay, and automating key aspects of the game.

[0003] Traditional mini golf setups often depend on physical sensor systems embedded within or around each hole to detect ball positioning, record scores, or determine outcomes of play. These systems, though functional, can suffer from wear and tear due to extensive wiring, mechanical components, and exposure to environmental conditions. Such mechanical or electronic failures necessitate frequent maintenance, leading to increased downtime and reduced customer satisfaction.

[0004] Additionally, standard mini golf systems fail to provide an immersive, dynamic environment that would encourage repeat participation or broader user engagement, particularly in entertainment venues that thrive on providing varied, interactive experiences. In a competitive entertainment market, there is a growing demand for systems that can enhance user involvement through digital integration, real-time analytics, and multi-game functionality, enabling operators to cater to diverse preferences without needing extensive physical modifications to the gaming setup.

[0005] Moreover, the static nature of conventional courses restricts the variety of games that can be played on the same course, thereby limiting the number of users and games that can be run concurrently. In contrast, the entertainment industry is trending toward systems that offer real-time customization, allowing for a wider range of gaming experiences without sacrificing the limited physical space available in venues such as bars and social clubs.

[0006] Thus, there is a need for an improved mini golf system that overcomes these technological and operational limitations, offering a more flexible, engaging, and low-maintenance solution that integrates well with modern digital platforms. Such a system would significantly reduce mechanical failure risks while providing users with enhanced interactivity and customizable gaming experiences, all within the confines of a single, dynamic mini golf lane.

[0007] It is within this context that the present invention is provided.SUMMARY

[0008] The present invention relates to a system for managing a ball-based game on a lane, employing a camera, processing unit, user interface device, projector, and lighting control. The system enables real-time detection of a moving object, such as a ball, on a lane with multiple holes, facilitating automatic detection of when the ball enters a hole. The processing unit executes a series of image processing steps to identify the ball's position and detect its interaction with the holes. The system further includes a projector for displaying game content on the lane and a user interface device for controlling the game and interacting with players. Additionally, the system incorporates lighting elements controlled by the processing unit.

[0009] The invention provides a modular and scalable approach to ball-based games, enabling automatic ball detection, score tracking, and game management. The processing unit performs real-time analysis of frames captured by the camera and is capable of controlling various components, such as a projector and lighting system, to provide dynamic feedback to players in response to the tracking. The system may also communicate with a remote server, allowing for the storage of game data and updates.

[0010] Thus, according to an aspect of the present invention, there is provided a system for managing a ball-based game on a lane. The system comprises a camera configured to capture frames of the lane, which includes a plurality of holes. A processing unit is configured to receive the frames from the camera and execute computer-implemented instructions to process the images.

[0011] For example, in some embodiments the processing unit converts the frames into grayscale images, apply a Gaussian blur to the grayscale images to generate blurred images, compute an absolute difference between consecutive blurred images to generate difference images, convert the difference images into binary images by applying a threshold value, and perform a dilation operation on the binary images. The processing unit is then further configured to detect contours within the binary images to identify a moving object within the frame, determine whether the detected moving object is of a predetermined size, and identify the position of the moving object within the frame.

[0012] The system further includes a projector configured to display visual content onto the lane, in communication with the processing unit. A user interface device is provided to communicate with the processing unit and allow user interaction with the system. Additionally, the system includes a network interface configured to transmit data between the processing unit and a remote server, and a lighting control unit connected to a plurality of lighting elements positioned along the lane, wherein the lighting control unit is configured to control the lighting elements based on signals from the processing unit.

[0013] In some embodiments, the camera captures frames under infrared illumination, which improves the system's ability to detect the ball in low-light conditions and minimizes interference from ambient lighting.

[0014] In further embodiments, the processing unit determines when the ball disappears from the frame and compares the last detected position of the ball to predefined hole regions on the lane. This feature allows for accurate identification of when the ball enters a hole.

[0015] In yet further embodiments, the system assigns a unique identifier to each of the holes and transmits the hole number to the user interface device, enabling automatic score tracking and game progression.

[0016] In some embodiments, the user interface device comprises a tablet that manages game services, player registration, and score tracking. This configuration allows for easy control of the game and interactions between players and the system.

[0017] In further embodiments, the user interface device communicates with the processing unit via a WebSocket connection, ensuring low-latency, real-time data exchange between the game management software and the processing unit.

[0018] In yet further embodiments, the system is programmed to cause the projector to display different game modes onto the lane, with the visual content dynamically updated based on the selected game, allowing it to support various game formats.

[0019] In some embodiments, the lighting control unit operates RGB LED strips positioned along the lane, providing visual feedback based on gameplay events and synchronizing lighting effects with specific actions during the game.

[0020] In further embodiments, the processing unit performs an initial calibration of the camera by detecting and mapping the positions of the holes on the lane to facilitate accurately tracking the ball's interaction with the holes during gameplay.

[0021] In yet further embodiments, the system is connected to a remote server, which stores game data and analytics, and allows for software updates to be pushed to the system. This enables long-term data analysis and continuous improvement of the gaming experience

[0022] In some embodiments, the system ignores objects below a certain size threshold, focusing only on valid game elements, such as the ball, thereby reducing false detections and improving overall accuracy.

[0023] In further embodiments, the processing unit and camera are implemented using a microprocessor unit such as a Raspberry Pi and a Raspberry Pi Camera Module, respectively, providing cost-effective and scalable hardware for running the ball detection and game management services.

[0024] In yet further embodiments, a second processing unit, controls the lighting elements and communicates with the primary processing unit over a network connection facilitating distributed control of the system components.

[0025] In some embodiments, the projector and user interface device are connected via HDMI, allowing the projector to display real-time game status and scores directly onto the lane surface.

[0026] In further embodiments, the system is configured to track multiple moving objects simultaneously, distinguishing between them based on size, speed, or trajectory, ensuring accurate detection even in multi-player settings.

[0027] In yet further embodiments, the user interface device is configured to receive game updates, including new game modes, from the remote server, allowing the system to evolve with new content over time.

[0028] In some embodiments, the lane is designed with a sloped surface to guide the ball toward the holes, improving gameplay consistency and reducing the likelihood of the ball becoming stuck.BRIEF DESCRIPTION OF THE DRAWINGS

[0029] Various embodiments of the invention are disclosed in the following detailed description and accompanying drawings.

[0030] FIG. 1 illustrates an example of the mini golf lane setup with multiple holes and a user interface device.

[0031] FIG. 2 illustrates an example hardware architecture of the mini golf system, showing how the various components are interconnected.

[0032] FIG. 3 illustrates an example software flow diagram for the ball detection method used in the mini golf system.

[0033] FIG. 4 illustrates an example of the image processing stages used to detect and track the ball in the mini golf system.

[0034] FIG. 5 illustrates an example user interface displaying the processed image and ball detection results.

[0035] FIG. 6 illustrates an example user interface for the initial setup and calibration of the mini golf ball detection system.

[0036] Common reference numerals are used throughout the figures and the detailed description to indicate like elements. One skilled in the art will readily recognize that the above figures are examples and that other architectures, modes of operation, orders of operation, and elements / functions can be provided and implemented without departing from the characteristics and features of the invention, as set forth in the claims.DETAILED DESCRIPTION AND PREFERRED EMBODIMENT

[0037] The following is a detailed description of exemplary embodiments to illustrate the principles of the invention. The embodiments are provided to illustrate aspects of the invention, but the invention is not limited to any embodiment. The scope of the invention encompasses numerous alternatives, modifications and equivalent; it is limited only by the claims.

[0038] Numerous specific details are set forth in the following description in order to provide a thorough understanding of the invention. However, the invention may be practiced according to the claims without some or all of these specific details. For the purpose of clarity, technical material that is known in the technical fields related to the invention has not been described in detail so that the invention is not unnecessarily obscured.Definitions

[0039] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention.

[0040] As used herein, the term “and / or” includes any combinations of one or more of the associated listed items.

[0041] As used herein, the singular forms “a,”“an,” and “the” are intended to include the plural forms as well as the singular forms, unless the context clearly indicates otherwise.

[0042] It will be further understood that the terms “comprises” and / or “comprising,” when used in this specification, specify the presence of stated features, steps, operations, elements, and / or components, but do not preclude the presence or addition of one or more other features, steps, operations, elements, components, and / or groups thereof.

[0043] The term “camera” refers to any image-capturing device configured to generate frames of the lane. This includes, but is not limited to, digital cameras, infrared cameras, and specialized camera modules with or without filters. In one example implementation, the camera is a Raspberry Pi Camera Module 3 NoIR Wide, which captures infrared-filtered frames for enhanced detection of the ball in low-light conditions.

[0044] The term “processing unit” refers to any hardware or software system capable of executing computer-implemented instructions to process images and control system components. This includes, but is not limited to, microcontrollers, single-board computers, cloud-based processing servers, or a combination thereof. In one example implementation, the processing unit is a Raspberry Pi 5, running image processing software to detect ball movement and communicate with the projector, lighting system, and user interface.

[0045] The term “projector” refers to any device configured to display visual content onto a surface, including but not limited to lane surfaces, walls, or other relevant display areas. The projector can be any commercially available projection device capable of interfacing with the processing unit. In one example implementation, the projector is connected to the processing unit via an HDMI cable and dynamically projects game modes and visual feedback onto the mini golf lane.

[0046] The term “user interface device” refers to any component, hardware or software, that allows users to interact with the system, control gameplay, and view status updates. This includes, but is not limited to, mobile devices, tablets, desktops, or other touchscreen devices. In one example implementation, the user interface device is an Android tablet running software that manages player registration, game mode selection, and real-time score tracking.

[0047] The term “lighting control unit” refers to any system capable of controlling one or more lighting elements based on signals from the processing unit. This may include, but is not limited to, general-purpose input / output (GPIO) controllers, microcontrollers, or integrated circuits specifically designed for lighting control. In one example implementation, the lighting control unit is a Raspberry Pi 4, which interfaces with RGB LED strips to provide visual feedback and lighting effects during gameplay.

[0048] The term “network interface” refers to any hardware or software component that enables communication between devices in the system or between the system and remote servers. This includes, but is not limited to, wired Ethernet connections, wireless modules such as Wi-Fi or Bluetooth, and software-based networking protocols. In one example implementation, the network interface is a wired Ethernet connection used to link the processing unit, user interface device, and remote server for data synchronization and software updates.

[0049] The term “ball detection service” refers to a software module or routine configured to analyze image frames captured by the camera, detect the presence and movement of a ball, and determine whether the ball has entered any predefined areas, such as a hole. This service can include various image processing techniques such as Gaussian blur, frame differencing, and contour detection. In one example implementation, the ball detection service runs on the Raspberry Pi 5, executing OpenCV-based image processing algorithms to detect and track the ball.Description of Drawings

[0050] The present invention relates to a system and method for automating the detection and tracking of a ball on a lane during a ball-based game, such as mini golf, and for managing various aspects of the game, including scoring, player interaction, and lighting control. The invention overcomes several limitations associated with conventional ball-based gaming systems, which rely heavily on manual interaction and mechanical components for score tracking and gameplay management.

[0051] In traditional systems, physical sensors are often embedded in the playing surface to detect when a ball enters a hole. These systems are prone to wear and tear due to wiring and mechanical parts, leading to frequent maintenance and possible disruptions in gameplay. Additionally, the static nature of these systems limits their flexibility and adaptability, as each game mode or course design often requires physical alterations or complex sensor reconfigurations.

[0052] The present invention addresses these shortcomings by leveraging computer vision technology to detect and track the ball without the need for physical sensors embedded in the playing surface. A camera captures real-time frames of the lane, which are processed using image processing techniques to determine the position and trajectory of the ball, as well as whether it enters a hole. This approach eliminates the need for mechanical sensors, reducing the likelihood of hardware failures and the associated maintenance costs.

[0053] Furthermore, the invention integrates a projector and dynamic lighting elements, enabling the lane to visually adapt to different game modes and provide real-time feedback during gameplay. The projector displays game content directly onto the lane, while the lighting elements enhance the overall experience by synchronizing with game events. The system is controlled through a user interface device, allowing players to interact with the game and receive live updates on their performance.

[0054] The system can also communicate with a remote server to store game data, receive updates, and generate analytics, offering greater scalability and adaptability compared to traditional systems. This allows for remote maintenance, game updates, and enhanced data collection for venue operators.

[0055] Referring now to the drawings, which show various example implementations of the system, FIG. 1 illustrates a physical lane environment 100 on which the ball-based game system has been implemented, including various components configured for automated detection, projection, and lighting control. The lane 100 is a defined play area upon which the game takes place, and it is designed with multiple holes 102 positioned at the end of the lane. In this embodiment, there are several holes 102, each capable of detecting a ball when it is putted into one of them.

[0056] At the front end of the lane, a user interface device 104 is mounted on a pedestal, allowing players to interact with the system, such as selecting game modes or viewing scores. The user interface device 104, in this embodiment, is a touchscreen tablet connected to the system via network communication, facilitating user interaction and control of the gameplay.

[0057] Positioned near the lane is a camera 106, which captures frames of the playing surface and the holes 102. The camera 106 is connected to a processing unit 116, which processes the captured frames using various image analysis techniques. A projector 108 is also positioned to project game-related visuals directly onto the lane's surface. The projector 108 is responsible for displaying different game modes, visual cues, and player feedback, dynamically altering the lane's visual layout depending on the gameplay. The projection changes in real-time as the game progresses, enhancing player immersion and interaction with the game.

[0058] The physical position of the camera, projector, and processing unit with respect to the lane can change, as long as the relevant portions of the lane are within the field of view (indicated by dashed lines for each) of the camera and projector.

[0059] In this example, the lane 100 is bordered by walls 110, which contain and guide the ball towards the holes 102, preventing it from rolling off the sides of the lane. The walls 110 also provide structural support and can house internal wiring or lighting components. Along the lane surface, lighting elements 112, which in this case are RGB LED strips, are installed. These lighting elements 112 are connected to a lighting control unit, which may be a part of the processing unit 116 or a separate device, and which synchronizes the lights with gameplay events. When certain actions occur, such as a ball entering a hole 102, the lighting elements 112 produce visual feedback, such as flashing patterns or colour changes. The lighting elements may be arranged in any desired pattern.

[0060] The playing surface of the lane 100 may be slightly sloped to help guide the ball towards the holes 102. The positioning of the user interface device 104 and projector 108 ensures that players can interact with the system without obstructing the projection or gameplay area.

[0061] FIG. 2 illustrates a more specific example hardware architecture of the mini golf system.

[0062] The system integrates a combination of computing hardware, a camera, projector, lighting elements, and network communication to manage the automated detection of a ball on a lane and dynamically update gameplay and visual effects. The projector 108 is configured to project visual content directly onto the lane surface. This content may include game modes, visual cues, and scoring updates.

[0063] The projector 108 is connected to the tablet 104 via an HDMI cable, ensuring that the graphics displayed are dynamically updated based on the game logic. The alignment and calibration of the projector 108 are critical for ensuring that the projected content corresponds accurately to the physical positions of the holes on the lane. The projector 108 enhances the gameplay experience by visually transforming the lane for different game modes, as well as providing visual feedback to the players.

[0064] The tablet 104 serves as the primary user interface device for the system, running the Games Service software responsible for game management, including player registration, game mode selection, and score tracking. It also communicates with other components of the system via a network connection, facilitated by the network switch 114. The tablet 104 plays a central role in managing gameplay and providing real-time feedback to players. Users can interact with the game via the tablet's touchscreen, which allows them to select different game modes, view scores, and track progress throughout the game.

[0065] The tablet 104 communicates with the network switch 114 over an Ethernet connection, ensuring low-latency and high-speed communication with other system components. The network switch 114 acts as a communication hub, facilitating data exchange between the tablet 104, First microprocessor 116, and Second microprocessor 118, as well as other potential devices in the system.

[0066] A First microprocessor 116 is a dedicated processing unit responsible for managing the Ball Detection Service. It processes the video frames captured by the camera module 117 to track the movement of the ball and determine when the ball enters a hole. The camera module 117, which is connected to the First microprocessor 116 via a camera interface, captures real-time video of the mini golf lane, including the positions of the holes 102. The camera module 117 is equipped with an infrared filter and is supported by infrared lighting to ensure optimal visibility of the ball even in low-light conditions.

[0067] Once the camera module 117 captures frames of the lane, the First microprocessor 116 applies a series of image processing steps, including grayscale conversion, Gaussian blur, frame differencing, and binary thresholding. This enables the system to detect the presence of the ball, track its movement, and identify when it disappears into one of the predefined hole regions. The First microprocessor 116 then sends the detected hole number to the tablet 104 via the network switch 114, updating the game logic and scores accordingly. The processing power of the First microprocessor 116 ensures that these operations are performed in real-time, allowing for smooth and responsive gameplay without lag or delays.

[0068] The Second microprocessor 118 is responsible for managing the Lighting Control Service, which operates the RGB LED light strips 112 positioned along the edges of the mini golf lane. The Second microprocessor 118 is connected to the LED strips 112 via its general-purpose input / output (GPIO) pins, and it controls the lighting effects in response to gameplay events, such as a ball entering a hole or the completion of a game mode. The lighting control service running on the Second microprocessor 118 is configured to trigger different visual effects based on the game state, further enhancing player engagement by providing dynamic visual feedback.

[0069] The RGB LED light strips 112 are installed along the lane, providing both functional and aesthetic lighting that synchronizes with the game's progress. These strips are designed to display various colours and patterns, creating immersive effects that respond to gameplay events, such as a player scoring a point or the end of a game round. The lighting effects are fully customizable, allowing the system to adjust the colours, brightness, and patterns based on the active game mode or specific player actions. The Second microprocessor 118 receives commands over the network to execute these lighting effects in real-time.

[0070] The camera module 117 captures frames in grayscale for further processing. During the initial setup, the camera is calibrated to map the exact positions of the holes 102 on the lane, enabling the First microprocessor 116 to accurately detect when the ball enters one of the holes. Throughout gameplay, the camera continuously captures frames, which are analysed by the First microprocessor 116 to track the movement of the ball and determine whether it enters a hole. The camera's infrared capability allows the system to function reliably in dimly lit environments, ensuring that the ball remains visible regardless of ambient lighting conditions.

[0071] All system components, including the tablet 104, First microprocessor 116, Second microprocessor 118, and network switch 114, are interconnected through Ethernet or suitable wireless connections ensuring high-speed communication between them. This network-based architecture allows the system to perform multiple tasks simultaneously, such as ball detection, score updates, and lighting control, without performance degradation. The network switch 114 also enables the system to scale easily by adding additional devices, such as extra lanes, cameras, or processing units, for multi-lane setups in larger venues.

[0072] In addition to real-time communication and control, the system is also configured with a router 119 that allows for interactions with a remote server via the network interface, allowing it to store game data, retrieve software updates, and perform system maintenance remotely. This ensures that the system remains up-to-date with the latest game modes, features, and security patches.

[0073] FIG. 3 illustrates a software flow diagram outlining the ball detection process in the mini golf system, where a camera module captures video frames, and a series of image processing steps are applied to detect the ball's presence, track its movement, and determine whether it has fallen into a hole. Each step in the process is carried out by the processor, which manages the ball detection service and communicates with the game service to update the game state.

[0074] In a first step 200, the processor receives a raw camera frame from the camera module 117, showing the mini golf lane and any objects present, including the moving ball. This raw frame is captured in real-time as the ball moves through the play environment.

[0075] In step 202, the processor converts the raw camera frame to a grayscale image. This transformation reduces the complexity of the data by focusing solely on light intensity, eliminating colour information that is not relevant to the detection process. In other examples, this step may be replaced or supplemented by alternative image preprocessing techniques. For instance, the system could employ a colour filter, particularly when balls of different colours are used, enabling colour-based tracking in environments where lighting conditions are varied

[0076] In step 204, the processor applies a Gaussian blur to the grayscale image. The purpose of the blur is to smooth the image and reduce the influence of noise, such as small lighting variations or minor background details. The Gaussian blur helps the system focus on significant changes, such as the movement of the ball. In other variations, the system could use alternative blurring techniques such as median filtering or bilateral filtering, depending on specific environmental conditions and processing requirements. Median filtering, for example, would be more effective in environments where sharp object edges need to be preserved.

[0077] If this is the first iteration of the image processing for the current tracking operation, the process then returns to step 200, capturing a raw camera frame for a later moment in time. Otherwise, in a concurrent step 205, the processor retrieves a previous Gaussian blur frame that was created during the last iteration from the last raw camera frame.

[0078] Next, in step 206, the processor compares the current blurred frame to the previous frame. The absolute difference between the two frames is calculated, producing a difference image that highlights any changes between the frames, such as the movement of the ball. Stationary objects will produce little or no difference.

[0079] In step 208, the difference image is subjected to binary thresholding. Pixels in the difference image that meet a certain brightness threshold are converted to white, representing areas of interest, such as the moving ball, while other pixels are converted to black, indicating the background. The resulting binary image isolates the moving object from the background. In some embodiments, adaptive thresholding techniques may be used, which can be beneficial when the lighting conditions vary across different regions of the frame. Adaptive thresholding would allow for more accurate detection of the ball in environments with uneven lighting.

[0080] In step 210, the binary image is processed through dilation. This morphological operation enlarges the white regions, helping to fill in any gaps in the detected object, which is the ball. The dilation ensures that the ball is represented as a contiguous shape, making it easier to track in subsequent steps. Depending on the expected ball speed and the processing power available, the dilation operation may be adjusted. For instance, larger or faster-moving balls may require more aggressive dilation to ensure that the system reliably tracks the ball in high-motion scenarios.

[0081] In step 212, a morphological closing operation is performed to smooth the edges of any detected objects. This operation eliminates small imperfections around the ball's contour and helps refine the detection to ensure that the ball is identified as a coherent object within the frame.

[0082] In step 214, the system extracts the contours of the detected objects in the binary image. These contours represent the boundaries of the objects, including the ball. The processor checks the size of each contour in relation to a predefined size threshold to determine whether it matches the expected size of a golf ball. If the detected object is too small or too large, it is ignored, as it is likely noise or an irrelevant object. In further embodiments, the system could integrate additional shape recognition algorithms to verify that the detected object conforms to both size and geometric characteristics expected of the ball. This would allow for improved filtering in environments where multiple objects or disturbances may appear.

[0083] In step 216, the system verifies whether the detected ball is larger than the predefined size threshold. If the ball is too small, the system skips the next steps and returns to frame acquisition. If the ball is determined to be of the correct size, the processor proceeds to track its position.

[0084] In step 218, the system calculates the position of the ball within the frame. The processor continues to track the ball's position as it moves across the mini golf lane, using the extracted contour data to follow the ball's trajectory. In alternative examples, more sophisticated tracking techniques, such as Kalman filters or optical flow analysis, could be used to predict the ball's movement across consecutive frames. This would be particularly useful in high-speed gameplay scenarios or environments where the camera may experience slight movement or vibration.

[0085] In step 220, the system monitors the ball's position to determine when it disappears from the frame. The processor checks whether the ball disappears near one of the predefined hole regions on the lane. These hole regions are mapped during the system's initial setup and correspond to the physical locations of the holes in the lane. In other embodiments, machine learning models could be employed to predict which hole the ball is likely to enter based on its trajectory, even before it disappears from the frame. This prediction could improve the accuracy of the ball tracking process and allow for faster score updates.

[0086] If the ball disappears inside one of the predefined hole regions, the system concludes that the ball has fallen into the hole. The processor then sends a signal to the game service, indicating the hole number into which the ball has fallen. This updates the game's scoring or triggers specific game events. If the ball disappears but is not near a predefined hole region, the system assumes that the ball has entered a non-hole area, such as a gutter, and sends a corresponding signal to the game service. The processor may send a “−1” value to indicate that the ball did not enter any valid hole, marking the ball as out of play or a missed shot.

[0087] FIG. 4 illustrates the results of the image processing method used by the ball detection system, depicting how raw camera frames are progressively transformed to detect and track the ball's movement across the mini golf lane. Each stage in this figure corresponds to one or more specific steps in the software flow described in FIG. 3, with the frames showing the visual results of the transformations applied to the raw image.

[0088] At the top of FIG. 4, a Raw Frame 300 is shown, representing the unprocessed image as captured by the camera module. This frame includes the mini golf lane surface, with bright areas corresponding to the holes and the ball appearing as a dark circular object moving across the lane.

[0089] Next, the system processes the raw frame into a Gaussian Blur Frame 302 by applying a Gaussian blur filter. This operation smooths the image, reducing the impact of noise and minor details that may otherwise interfere with the detection process. The Gaussian blur retains significant elements of the scene, such as the holes and the ball, but softens them to focus on larger changes in the image.

[0090] The system then converts the blurred image into a Gray Frame 304, in which all colour information is removed, and only brightness values are retained. This simplifies the data, enabling the system to focus solely on light intensity variations. In this frame, the ball and holes are now represented as regions of varying intensity.

[0091] At this stage, the system retrieves the Previous Step Gray Frame 305, which is a grayscale image of the lane captured in the previous image processing cycle and stored in memory. This previous gray frame is used as a reference for comparison with the current gray frame 304 to detect motion, specifically the movement of the ball.

[0092] The next operation produces a Difference Frame 306, which is generated by computing the absolute difference between the current gray frame 304 and the previous step gray frame 305. This difference frame highlights any changes between the two captured frames, particularly the movement of the ball, which appears as a prominent feature in the frame. Stationary objects, such as the holes, show little to no difference and remain minimally affected in this frame.

[0093] Finally, a Binary Frame 308 is generated by applying a binary threshold to the difference frame. In this binary frame, pixels corresponding to significant changes—such as the movement of the ball—are converted to white, while all other areas are converted to black. This isolates the moving object, allowing the system to easily detect and track the ball as it traverses the lane.

[0094] FIG. 5 illustrates an outline 400 of the processed image data and the results of the ball detection system, providing a visual representation of the ball's interaction with the mini golf lane and its detection relative to the holes. The system displays elements such as the detected holes 402 and the ball's position 404, within the context of the play area 406. The interface shows a display representing the golf lane, where each hole 402 is represented by a circular region. Each detected hole is labeled with a unique identifier (H1 to H9). For example, Hole 1 (H1), Hole 2 (H2), and so on, up to Hole 9 (H9).

[0095] The position of a ball 404 in the play area is highlighted and detected as a bright object near Hole 6 and Hole 8. The system actively tracks the ball's position as it moves across the lane. The ball's trajectory, size, and proximity to the holes are monitored in real-time. Additionally, a boundary line 408 near the bottom of the display represents the edge of the valid play area. A detected object 410 that has fallen outside of the play area is shown below the boundary line where it is considered in play or out of bounds. This assists with automated gameplay decisions, such as scoring or out-of-play determinations.

[0096] FIG. 6 illustrates the user interface for the Initial Setup and Calibration 412 of the mini golf ball detection system, accessible over an HTTP connection via a web browser. This calibration interface allows an administrator to define key areas of the lane and specify the positions of the holes before gameplay begins.

[0097] The interface displays a Live View 414, which shows the real-time camera feed of the mini golf lane that has the outline 400 of the tracked elements in FIG. 5 overlaid over it. The user can switch between different views of the live feed, such as an Original View or processed versions of the camera feed. This live view allows the operator to ensure the proper alignment of the camera and adjust any calibration settings as needed. The Calibration button 416 is located at the top right of the interface and enables the user to initiate the calibration process. Other UI tools such as “Reset Initial Frame”, a download button, and a stop button, are also provided.

[0098] The tracked elements are enclosed within the frame of outline 400 which is overlaid on the active playing area within the camera's field of view. Any ball movement outside of this frame may be considered out of play or irrelevant to the ball detection system. The operator can adjust the size and position of this frame during the initial setup to ensure it matches the physical dimensions of the lane.

[0099] A Reset Button 418 is positioned at the bottom right corner of the interface, allowing the operator to reset the calibration and start over if necessary. This ensures that any mistakes during the setup process can be corrected without having to exit the interface.Controller / Processor Components

[0100] A processor or controller as described herein may include any suitable type of computing device, such as a central processing unit (CPU), microcontroller, graphics processing unit (GPU), system on a chip (SoC), or digital signal processor (DSP). It may operate with one or more cores and may be configured to execute the functions described in this disclosure.

[0101] The processor may be operably connected to one or more memory devices, such as random access memory (RAM), read-only memory (ROM), flash storage, or solid-state drives (SSD). These memory devices store computer-readable instructions that, when executed by the processor, perform the methods described. The processor and memory communicate via data buses or other suitable communication pathways.

[0102] The computing device may also include input / output (I / O) devices, such as a touchscreen, mouse, keyboard, display, or speaker, to facilitate interaction with users or other systems. Additionally, it may include a network interface, such as a wired or wireless communication module, for connecting to networks.

[0103] Control logic or software instructions may be stored in memory and executed by the processor to implement specific functionalities. This logic may be modular, consisting of software components, processes, or functions that work together to perform the operations described herein.

[0104] The described computing operations involve the manipulation of data represented as electrical, optical, or magnetic signals stored or transferred within the system. These operations are machine-executed and do not require manual intervention, though they may interface with human operators through appropriate user interfaces.

[0105] The systems and methods described are not limited to any particular hardware configuration or programming language and may be implemented on general-purpose or specialized computing devices.Conclusion

[0106] Unless otherwise defined, all terms (including technical terms) used herein have the same meaning as commonly understood by one having ordinary skill in the art to which this invention belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the relevant art and the present disclosure and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.

[0107] The disclosed embodiments are illustrative, not restrictive. While specific configurations of the system and methods of the invention have been described in a specific manner referring to the illustrated embodiments, it is understood that the present invention can be applied to a wide variety of solutions which fit within the scope and spirit of the claims. There are many alternative ways of implementing the invention.

[0108] It is to be understood that the embodiments of the invention herein described are merely illustrative of the application of the principles of the invention. Reference herein to details of the illustrated embodiments is not intended to limit the scope of the claims, which themselves recite those features regarded as essential to the invention.

Claims

1. A system for managing a ball-based game on a lane, the system comprising:a camera configured to capture frames of the lane, the lane including a plurality of holes;a processing unit configured to receive the frames from the camera and execute computer-implemented instructions to:process the frames to detect a moving object,analyze the movement and size of the detected object,determine the position of the object relative to predefined regions on the lane;a projector configured to display visual content onto the lane, the projector in communication with the processing unit;a user interface device configured to communicate with the processing unit and allow user interaction with the system;a network interface configured to transmit data between the processing unit and a remote server;a lighting control unit connected to a plurality of lighting elements positioned along the lane, the lighting control unit configured to control the lighting elements based on signals from the processing unit.

2. The system of claim 1, wherein the processing unit is configured to convert the frames into grayscale images and apply image processing filters to reduce noise and enhance object detection.

3. The system of claim 2, wherein the image processing filters include a Gaussian blur applied to the grayscale images.

4. The system of claim 1, wherein the processing unit is configured to compute a difference between consecutive processed frames to detect changes representing movement of the object.

5. The system of claim 4, wherein the processing unit applies a binary threshold to the difference frames to generate binary images for object detection.

6. The system of claim 1, wherein the processing unit is configured to perform morphological operations on the binary images, including dilation, to refine the detection of the moving object.

7. The system of claim 1, wherein the processing unit analyzes the size of the detected moving object and disregards objects below a predetermined size threshold.

8. The system of claim 1, wherein the processing unit is further configured to track the position of the moving object until it disappears from the frame, and compare the last detected position to predefined hole regions to determine whether the object has entered a hole.

9. The system of claim 8, wherein the processing unit assigns a unique identifier to each of the plurality of holes and transmits the identifier of the hole into which the moving object has disappeared to the user interface device.

10. The system of claim 1, wherein the camera is configured to capture frames under infrared illumination, and the system further comprises one or more infrared light sources positioned to illuminate the lane.

11. The system of claim 1, wherein the user interface device comprises a tablet configured to manage game services, including player registration, score tracking, and game mode selection.

12. The system of claim 11, wherein the user interface device is configured to communicate with the processing unit via a WebSocket connection.

13. The system of claim 1, wherein the projector is configured to display different game modes onto the lane, with the visual content dynamically updated based on the game mode selected via the user interface device.

14. The system of claim 1, wherein the lighting control unit is connected to a plurality of RGB LED strips, and the processing unit is configured to send control signals to the lighting control unit to modify the colour or pattern of the lighting elements based on gameplay events.

15. The system of claim 1, wherein the processing unit is configured to perform an initial calibration by detecting and mapping the positions of the plurality of holes on the lane.

16. The system of claim 1, wherein the remote server is configured to store game data and analytics, and the processing unit is configured to synchronize the system's data with the remote server.

17. The system of claim 1, wherein the lighting control unit is configured to respond to specific gameplay events, such as when the moving object enters a hole, by triggering predefined lighting effects.

18. The system of claim 1, wherein the processing unit is configured to track multiple moving objects simultaneously within the lane, distinguishing between objects based on size, speed, and trajectory.

19. The system of claim 1, wherein the user interface device is further configured to receive game updates, including new game modes and software patches, from the remote server.

20. The system of claim 1, wherein the lane comprises a sloped surface leading towards the plurality of holes, the slope angle being predefined to ensure smooth rolling of the moving object.