Full-Scale Control Mechanism(I/O) for Virtual/Augmented Reality Bike Simulation

Abstract

The present invention describes a full-scale, immersive virtual reality (VR) bicycle simulator designed to provide users with a highly realistic biking experience. Leveraging standard bicycles mounted on stationary trainers, the simulator integrates advanced VR technologies to create a dynamic and interactive environment for biking within a VR world. According to the invention, there is provided a full-scale virtual reality (VR) cycling simulation system, including a stationary bicycle mounted on a training stand; one or more VR controllers attached to the bicycle; with the VR controllers configured to track at least steering and pedalling movements of the bicycle; and a processing unit configured to receive the orientation and rotation data from the one or more VR controllers and translate this data into corresponding movements within a VR environment.

Claims

1. A full-scale virtual reality (VR) cycling simulation system, comprising: a stationary bicycle mounted on a training stand; one or more VR controllers attached to the bicycle; the VR controllers configured to track at least steering and pedalling movements of the bicycle; and a processing unit configured to receive the orientation and rotation data from the one or more VR controllers and translate said data into corresponding movements within a VR environment.

2. The system of claim 1, wherein the bicycle is a home-based standard bicycle aiding in user customization.

3. The system of claim 1, wherein one of the VR controllers is mounted on a handlebar of the bicycle to track the steering movements; and the VR controller being calibrated to define an initial baseline position corresponding to the handlebar being in a straight alignment.

4. The system of claim 3, wherein the VR controller is mounted centrally on the handlebar of the bicycle.

5. The system of claim 1, further comprising a mechanism for attaching a device with one of the VR controllers to the bicycle's tyre to measure rotation; and a software module configured to convert the measured rotation into speed data within the VR simulation.

6. The system of claim 1, wherein the one or more VR controllers are standard VR controllers included with VR headsets, thereby enabling achieve full in-simulation low-latency tracking of both speed and steering, resulting in accurately replicating the experience of cycling in the virtual environment.

7. The system of claim 1, wherein the one or more VR controllers are Oculus controllers.

8. The system of claim 1, wherein a friction-reducing element is positioned between front tyre of the bicycle and the floor to minimize friction during rotational movements of the steering.

9. A method for simulating bicycle riding in a virtual reality (VR) environment, comprising the steps: capturing pedalling speed by a device using a VR controller as a mechanism to detect rotation of the bicycle tyre; capturing steering movements by another VR controller mounted on a handlebar of the bicycle; integrating the captured pedalling speed and steering movements into a VR simulation to replicate real-time riding experience.

10. The method of claim 9, wherein a speed translation mechanism is employed to step-down the rotational speed of the bicycle tyre.

11. The method of claims 9, wherein a speed replay mechanism is employed to convert the translated rotational speed of the bicycle tyre into mechanical movements of the VR controller.

12. The method of claim 11, wherein a moving average technique is employed to smooth out fluctuations in the pedalling speed data before it is used to control the virtual environment, thereby reducing discrepancies and maintaining high responsiveness.

13. A method for capturing and translating bicycle steering movements into a virtual reality (VR) environment, comprising the steps: mounting a VR controller on a handlebar of the bicycle; calibrating the VR controller to establish a baseline orientation; tracking changes in orientation of the VR controller; and processing the tracked orientation changes to simulate steering within a VR environment.

14. The method of claim 13, wherein the processing includes filtering noise from the tracked orientation changes to enhance accuracy of the simulated steering.

15. A software algorithm implemented within the system of claim 1, configured to minimize latency and synchronize real-world bicycle movements with virtual responses in the VR simulation.

Description

BRIEF DESCRIPTION OF FIGURES

[0069] The accompanying drawings are included to provide a further understanding of the present disclosure, and are incorporated in and constitute a part of this specification. The drawings illustrate exemplary embodiments of the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0070] In the figures, similar components and/or features may have the same reference label. Further, various components of the same type may be distinguished by following the reference label with a second label that distinguishes among the similar components. If only the first reference label is used in the specification, the description is applicable to any one of the similar components having the same first reference label irrespective of the second reference label.

[0071] The diagrams are for illustration only, which thus is not a limitation of the present disclosure, and wherein:

[0072] FIG. 1 is a perspective view of a bicycle and virtual controller's setup, in accordance with an embodiment of the present invention.

[0073] FIG. 2 is a schematic perspective view of a speed relay mechanism, in accordance with an embodiment of the present invention.

[0074] FIG. 3 is a perspective view of a steering capture mechanism, in accordance with an embodiment of the present invention.

[0075] FIG. 4 is a block diagram illustrating a software reconstruction of the bicycle in a virtual environment, in accordance with an embodiment of the present invention.

[0076] In the accompanying drawings, an underlined number is employed to represent an item over which the underlined number is positioned or an item to which the underlined number is adjacent. A non-underlined number relates to an item identified by a line linking the non-underlined number to the item. When a number is non-underlined and accompanied by an associated arrow, the non-underlined number is used to identify a general item at which the arrow is pointing.

DETAILED DESCRIPTION OF FIGURES

[0077] The accompanying drawings are included to provide a further understanding of the present disclosure, and are incorporated in and constitute a part of this specification. The drawings illustrate exemplary embodiments of the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0078] In the figures, similar components and/or features may have the same reference label. Further, various components of the same type may be distinguished by following the reference label with a second label that distinguishes among the similar components. If only the first reference label is used in the specification, the description is applicable to any one of the similar components having the same first reference label irrespective of the second reference label.

[0079] Embodiments of the present invention include various steps, which will be described below. The steps may be performed by hardware components or may be embodied in machine-executable instructions, which may be used to cause a general-purpose or special-purpose processor programmed with the instructions to perform the steps. Alternatively, steps may be performed by a combination of hardware, software, and firmware and/or by human operators.

[0080] Embodiments of the present invention may be provided as a computer program product, which may include a machine-readable storage medium tangibly embodying thereon instructions, which may be used to program a computer (or other electronic devices) to perform a process. The machine-readable medium may include, but is not limited to, fixed (hard) drives, magnetic tape, floppy diskettes, optical disks, compact disc read-only memories (CD-ROMs), and magneto-optical disks, semiconductor memories, such as ROMs, PROMs, random access memories (RAMs), programmable read-only memories (PROMs), erasable PROMs (EPROMs), electrically erasable PROMs (EEPROMs), flash memory, magnetic or optical cards, or other type of media/machine-readable medium suitable for storing electronic instructions (e.g., computer programming code, such as software or firmware).

[0081] Various methods described herein may be practiced by combining one or more machine-readable storage media containing the code according to the present invention with appropriate standard computer hardware to execute the code contained therein. An apparatus for practicing various embodiments of the present invention may involve one or more computers (or one or more processors within a single computer) and storage systems containing or having network access to computer program(s) coded in accordance with various methods described herein, and the method steps of the invention could be accomplished by modules, routines, subroutines, or subparts of a computer program product.

[0082] Exemplary embodiments will now be described more fully hereinafter with reference to the accompanying drawings, in which exemplary embodiments are shown. These exemplary embodiments are provided only for illustrative purposes and so that this disclosure will be thorough and complete and will fully convey the scope of the invention to those of ordinary skill in the art. The invention disclosed may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Various modifications will be readily apparent to persons skilled in the art.

[0083] The general principles defined herein may be applied to other embodiments and applications without departing from the spirit and scope of the invention. Moreover, all statements herein reciting embodiments of the invention, as well as specific examples thereof, are intended to encompass both structural and functional equivalents thereof. Additionally, it is intended that such equivalents include both currently known equivalents as well as equivalents developed in the future (i.e., any elements developed that perform the same function, regardless of structure). Also, the terminology and phraseology used is for the purpose of describing exemplary embodiments and should not be considered limiting. Thus, the present invention is to be accorded the widest scope encompassing numerous alternatives, modifications and equivalents consistent with the principles and features disclosed. For purpose of clarity, details relating to technical material that is known in the technical fields related to the invention have not been described in detail so as not to unnecessarily obscure the present invention.

[0084] The present invention pertains to a full-scale, immersive virtual reality (VR) bicycle simulator designed to provide users with a highly realistic biking experience. Leveraging standard bicycles mounted on stationary trainers, the simulator integrates advanced VR technologies to create a dynamic and interactive environment for biking within a VR World.

[0085] The virtual reality (VR) bicycle simulator as proposed herein and forming subject of the present invention distinguishes itself from the conventional VR and cycling products by employing actual bicycles and VR controllers to simulate real-world cycling dynamics within a virtual environment. Users can engage in a cycling experience that not only visually mimics real-life scenarios but also physically replicates the act of biking through precise tracking of bike speed and steering movements.

[0086] The system is primarily designed for VR applications, targeting both home and commercial use, offering an accessible and cost-effective solution for VR cycling. It serves a dual purpose of enhancing the entertainment value of VR gaming and providing a tool for serious fitness improvement in a controlled, yet engaging, virtual setting.

[0087] The present invention resides within the intersection of virtual reality technology, fitness equipment design, and interactive simulation systems. Specifically, it relates to the development of immersive virtual reality applications that utilize physical activity as a core component of the user experience. [0088] Virtual Reality (VR) Technology: VR involves the creation of a simulated environment that users can interact with in a seemingly real way through the use of specialized electronic equipment, such as headsets with screens or gloves fitted with sensors. The primary challenge in VR is achieving a high level of immersion and interactivity, which requires sophisticated tracking and rendering technologies. [0089] Fitness Equipment Design: This field focuses on the development of apparatuses that aid in physical exercise. The challenge here lies in designing equipment that not only supports effective workouts but also ensures user safety and comfort. For VR applications, the equipment must also integrate seamlessly with digital systems. [0090] Interactive Simulation Systems: These systems are designed to replicate real-world processes or activities in a virtual environment, allowing for user interaction. The core challenge is to create simulations that are both realistic and responsive, providing meaningful feedback to users based on their actions within the simulation.

[0091] The present invention harnesses advancements in these areas to create a virtual reality (VR) bike simulator that not only simulates the physical act of cycling but does so with a level of realism and responsiveness that closely mirrors actual biking. This involves intricate systems for tracking motion, interpreting user inputs, and rendering virtual environments in real time.

[0092] The diagrams are for illustration only, which thus is not a limitation of the present disclosure, and wherein:

[0093] Referring FIG. 1, there is depicted a bicycle and virtual reality (VR) controllers setup, in accordance with an embodiment of the present invention. The virtual reality (VR) bicycle simulator is designed to mimic real-life cycling as closely as possible. Users mount a standard physical bicycle that is secured on a stationary stand. This setup encourages the rider to engage with the bicycle just as they would on an outdoor ride, from pedalling to steering, thereby ensuring an intuitive and natural experience. There are two essential hardware components of the proposed system, namely, a speed relay mechanism and a steering relay mechanism, as described hereinbelow.

Speed Relay Mechanism

[0094] As is shown in FIG. 1, attached to the bicycle's rear tire is a designed speed relay mechanism, in accordance with an embodiment of the present invention. This mechanism consists of 4 primary components, such as, Speed Capture Mechanism, Speed Translation Mechanism, Speed Replay Mechanism and Software Processing of Speed Input Signal.

1. Speed Capture Mechanism

[0095] The Speed Capture Mechanism is a crucial component designed to accurately measure the speed of bicycle tires. This part can be likened to traditional components found in mechanical odometers. One method involves incorporating a device similar to those used in older wired odometers, where a part is placed in conjunction with the axle. As the axle rotates, this device captures the rotation directly.

[0096] However, as a way of continued innovation in contemplating the design and operation of the proposed system forming subject of the present invention, the speed capture mechanism includes a specially designed device that clips onto the bicycle and makes contact with the tire, in accordance with an exemplary embodiment of the present subject matter. This device leverages the friction between itself and the moving tire to track rotation. As the tire spins, the device rotates in tandem, effectively capturing the tire's speed through direct physical interaction. This method not only ensures accuracy but also allows for versatility in how the mechanism can be attached and used with different bicycles as well as allows for quick attach and release, thereby resulting in convenient and easy-to-use operability.

2. Speed Translation Mechanism

[0097] According to an embodiment of the present subject matter, the Speed Translation Mechanism serves two vital functions within the Speed Relay Mechanism. Firstly, it addresses safety concerns for virtual reality (VR) controller. Given the multitude of mechanical activities and components involved in the bicycle's operation, directly mounting the controller on the bicycle near these moving parts exposes it to potential damage. To mitigate this risk, the translation mechanism effectively relocates the controller away from the bicycle. This separation is achieved using components like an odometer wire, which allows the controller to operate safely without direct exposure to the bicycle's mechanical movements, as shown in FIG. 2.

[0098] Secondly, the speed translation mechanism manages the speed data by stepping down the rotation rate of the bicycle tire. The rotations captured from the bicycle's tyre or axle can be exceedingly rapid, that it can be dangerous for the VR controller. To accommodate this, the translation mechanism includes a step-down process, adjusting the high-speed rotations to a more manageable level. Additionally stepping-down is a process that is required even for higher-quality input signals. Further, this step already helps reduce some of the noise that can come out of the inertia of the VR controller in the Speed Replay Mechanism, as discussed in the next section. Accordingly, this process is important for both the safety of the VR controller and ensuring that the data fed into the virtual reality (VR) system is of high quality.

3. Speed Replay Mechanism

[0099] In accordance with an embodiment of the present subject matter, the Speed Replay Mechanism is integral to the seamless operation of the VR bicycle simulator. It is designed to take the translated inputs from the Speed Translation Mechanism and convert them into mechanical movements of the Oculus controller or any other kind of controller as can be envisaged by a person skilled in the art, which is continuously tracked by the Oculus headset. In an exemplary embodiment, the rotations of the Oculus controller are used as the primary movement that is tracked by the software, however, any other types of movements as can be envisioned by a person skilled in the art and falling within the scope of the present invention, can be used and tracked for the purposes of the conversion illustrated above.

[0100] This mechanism ensures that the movements of the Oculus controller are synchronized with the actions of the bicycle. As the translated movement input arrives, the Speed Replay Mechanism physically rotates the controller in real-time to mirror the speed dynamics of the actual bicycle, as represented in FIG. 2. This accurate synchronized movement helps replication of almost instantaneous speed and ensures that the virtual experience is as true to life as possible.

[0101] It is important to note in the current embodiment, the Speed Relay Mechanism employs purely mechanical components and mechanical linkages to achieve precise synchronization. Opting of the mechanical components in an exemplary embodiment is strategically aimed at minimizing latency and reducing noise that could be introduced by electronic processing of said components. This design choice ensures that the virtual reality (VR) experience is not only exceptionally responsive in terms of latency but also remarkably accurate in replicating the user's raw signal actions, thereby enhancing the real-time synchronization quality of speed input and consequently improving the control within the simulation. Furthermore, the resultant cost and ease of manufacturing of the components are also significant reasons for opting mechanical components, for the purposes of present illustration of an embodiment of the present invention. However, an electronic alternative for these components can be easily designed and accommodated in the present mechanism, within the scope of the present invention.

[0102] Further, while using mechanical components introduces some noise, notably from the inertia of the controller as it is mechanically moved, various strategies are employed to mitigate this mechanical noise. One key method involves appropriately stepping down the rotational motion. This step-down is carefully balanced to minimize erratic movements caused by inertia of the controller that is being moved, while still maintaining enough resolution to allow the software to detect and process the signal with high quality. In an exemplary embodiment, this stepping factor is manually calibrated and fixed for the prototype, however use of variable and tunable stepping factors is also within the scope of the present invention. These parameters can be calculated via software, allowing users to configure the hardware to suit their specific needs and preferences.

[0103] According to a further embodiment of the present subject matter, the Speed Replay Mechanism employs strategic measures to further mitigate noise, particularly from gravitational forces. By ensuring that the rotation of the controller is balanced around its center of mass and aligned along the y-axis (the upward axis), the system significantly minimizes the impact of gravity. This alignment is crucial because rotation along the y-axis is inherently unaffected by gravitational forces, regardless of any slight imperfections in the center of mass calibration. This carefully thought innovative configuration not only stabilizes the controller's movement but also enhances precision of the speed replication by reducing noise introduced by external forces.

[0104] The current mechanical real-time replication of movements contributes to a virtual reality (VR) experience where the only delays are those inherent to the VR controller and software processing, and not the hardware setup. This innovative and meticulously thought of design approach guarantees that the cycling simulation is as realistic and interactive as possible, thereby making the virtual reality (VR) experience highly engaging and true to life.

4. Software Processing of Speed Input Signal

[0105] According to an embodiment of the present subject matter, the software processing stage is essential for refining the input signals from the Speed Relay Mechanism, particularly focusing on noise cancellation and accurate signal interpretation.

[0106] The following are some of the key steps involved in the process:

Noise Cancellation from Projection

[0107] Identifying the Axis of Rotation: To ensure precise measurement, the system identifies the axis of rotation during operation. This can be pre-configured to align with a specific axis, such as the upward y-axis in Unity or detected as the rotation of the controller starts. By configuring the virtual reality (VR) controller to face upwards, the setup minimizes gravity-related errors and simplifies the detection of rotation around the intended axis. This orientation helps in accurately capturing the intended rotational motion while ignoring unintended jitters or other movements. However, even with these design decisions, there are enough jitters for the signal to be quite noisy due to random jitters.

[0108] Projection of Rotation: The software eliminates much of this noise from the jitters as it projects the rotation onto the identified axis, effectively filtering out any extraneous rotational movements. This method focuses on preserving the essential rotational data along the designated axis, thereby enhancing the accuracy of speed translation.

Noise Cancellation by Smoothing

[0109] Sliding Window-based Moving Average of Speed: To smooth out fluctuations in the speed data, the system employs a moving average technique at each update. However, the application of this technique needs careful calibration. The frequency and duration of the moving average calculations are critical; if the average is taken over too many frames, it can significantly increase latency and reduce the control responsiveness. The timing of each iteration and the interval at which the controller's position is tracked are meticulously adjusted to balance noise reduction with real-time response needs.

Steering Relay Mechanism

[0110] In addition to speed, steering control is critical for an immersive virtual reality (VR) cycling experience. This is achieved by mounting another VR controller centrally on the handlebars of the bicycle, as depicted in FIGS. 1 and 3. While the exact placement on the handlebars can vary and in no way limiting in nature, the central position is ideal for accurately capturing the direction and angle of steering inputs, according to an exemplary embodiment of the present invention. As the user steers the bicycle, the controller detects the orientation changes along the vertical axis, translating these into corresponding movements within the VR environment. This setup allows for precise control and enhances the realism of the cycling simulation by closely mimicking the physical actions of steering.

[0111] It is important to note one of the most critical aspects of creating a realistic and immersive virtual reality (VR) cycling experience is accurately capturing the rider's steering movements. The steering capture mechanism designed for the VR bicycle simulator of the present invention is not only innovative but also central to enhancing the user experience by providing precise and responsive control feedback.

[0112] Traditionally, high-precision steering tracking in VR applications has required the use of multiple specialized sensors, each contributing to a complex and often costly setup. The present invention streamlines the entire process by utilizing a single, commercially available virtual reality (VR) controller mounted directly onto the bicycle's handlebar's center. While the exact placement on the handlebars can vary, the central position is ideal for accurately capturing the direction and angle of steering inputs, and is a safer option away from the most dangerous parts of the handlebar. This controller is calibrated to set a baseline or zero position, which represents the handlebars being in a straight alignment. As the rider steers the bicycle, the controller detects even minute changes in orientation along the y-axis (vertical axis), which corresponds to the turning of the handlebars. This rotation is tracked, and seamlessly integrated into the VR environment, translating physical movements into virtual responses with an impressive degree of accuracy.

[0113] Further, the polling frequency of the angle should be as frequent as possible for the steering angle to maintain a good balance of simulation.

Software Reconstruction of the Virtual Bicycle

[0114] As shown in FIG. 4, the movements of the bicycle in virtual environment can be estimated based on the denoised speed and steering signals, as received from the speed relay mechanism and steering relay mechanism respectively, as illustrated above; and the bicycle's position changes relative to the environment can be reconstructed with some trigonometric calculations. Accordingly, the said position changes can then be used to move the world around or move the user around in the simulation to replicate the effect of movement for the user in the virtual environment that moves exactly as the bicycle in real life would.

Friction Reducer Mechanism

[0115] According to a further embodiment of the present invention, in addition to the core components of the virtual reality (VR) cycling simulator, the system incorporates an innovative friction-reducing element designed to enhance the steering experience, especially when the bicycle is used in a stationary position, as shown in FIG. 1. This element is strategically positioned between the front tyre of the bicycle and the floor. Made from a durable material such as fabric or plastic-like paper, it effectively minimizes the friction that typically occurs during rotational movements of the steering. While this friction-reducing element is optimized for hardwood floors, where it performs best due to hard, smooth surface, it also maintains functionality on carpeted areas. Recognizing the challenges posed by softer, more textured surfaces like carpet, the present invention further includes the option of adding a small, portable hardwood board. Placing this board under the front tyre of the bicycle, in conjunction with the friction-reducing element, provides a consistent and stable base that approximates the optimal conditions of hardwood flooring, thus ensuring smooth steering adjustments across a variety of indoor environments. This adaptability is crucial for users who may not have access to ideal flooring types, allowing them to experience high-fidelity VR cycling without compromise, thereby aiding in easy accessibility and customization to users and/or materials/components of varying kinds.

[0116] The following are some of the key advantages offered by the virtual reality (VR) bicycle simulator of the type described hereinabove by addressing several gaps in the current market: [0117] Integration of Physical Activity: While many VR systems focus on gaming and visual experiences, there is a rising demand for VR solutions that incorporate physical fitness. Our simulator meets this demand by combining the thrill of VR gaming with the health benefits of cycling [0118] Cost-Effectiveness: Most high-fidelity VR simulators on the market are either prohibitively expensive or designed for niche professional uses. Our invention utilizes existing bicycles and VR controllers, making it a more affordable option for the average consumer and small businesses [0119] Customization and Accessibility: The use of consumer bicycles and standard VR equipment allows users to customize their setup according to personal preference and comfort, something not often feasible with specialized, pre-built VR machines. This increases the accessibility and potential user base of our product [0120] Technological Synergy: The invention synergistically combines real-world physical hardware with sophisticated VR software, setting a precedent in the VR fitness technology space. This approach not only enhances the user experience but also pushes the boundaries of what's possible in VR simulations. It is beyond what exists in the market currently in terms of responsiveness control and fidelity [0121] By addressing these specific market needs, the VR bike simulator is well-positioned to capitalize on current trends in both the entertainment and fitness industries, providing a unique and versatile product that bridges the gap between fun and functional fitness solutions

[0122] Although the proposed system has been elaborated as above to include all the main modules, it is completely possible that actual implementations may include only a part of the proposed modules or a combination of those or a division of those into sub-modules in various combinations across multiple devices that can be operatively coupled with each other, including in the cloud. Further the modules can be configured in any sequence to achieve objectives elaborated. Also, it can be appreciated that proposed system can be configured in a computing device or across a plurality of computing devices operatively connected with each other, wherein the computing devices can be any of a computer, a laptop, a smartphone, an Internet enabled mobile device and the like. All such modifications and embodiments are completely within the scope of the present disclosure.

[0123] As used herein, and unless the context dictates otherwise, the term coupled to is intended to include both direct coupling (in which two elements that are coupled to each other or in contact each other) and indirect coupling (in which at least one additional element is located between the two elements). Therefore, the terms coupled to and coupled with are used synonymously. Within the context of this document terms coupled to and coupled with are also used euphemistically to mean communicatively coupled with over a network, where two or more devices are able to exchange data with each other over the network, possibly via one or more intermediary device. Moreover, in interpreting both the specification and the claims, all terms should be interpreted in the broadest possible manner consistent with the context. In particular, the terms comprises and comprising should be interpreted as referring to elements, components, or steps in a non-exclusive manner, indicating that the referenced elements, components, or steps may be present, or utilized, or combined with other elements, components, or steps that are not expressly referenced. Where the specification claims refers to at least one of something selected from the group consisting of A, B, C . . . and N, the text should be interpreted as requiring only one element from the group, not A plus N, or B plus N, etc.

[0124] While some embodiments of the present disclosure have been illustrated and described, those are completely exemplary in nature. The disclosure is not limited to the embodiments as elaborated herein only and it would be apparent to those skilled in the art that numerous modifications besides those already described are possible without departing from the inventive concepts herein. All such modifications, changes, variations, substitutions, and equivalents are completely within the scope of the present disclosure. The inventive subject matter, therefore, is not to be restricted except in the spirit of the appended claims.