Worldwide vision screening and visual field screening booth, kiosk, or exam room using artificial intelligence, screen sharing technology, and telemedicine video conferencing system to interconnect patient with eye doctor anywhere around the world via the internet using ethernet, 4G, 5G, 6G or Wifi for teleconsultation and to review results
20220354440 · 2022-11-10
Inventors
Cpc classification
A61L2202/14
HUMAN NECESSITIES
A61B3/024
HUMAN NECESSITIES
G06F3/011
PHYSICS
G16H80/00
PHYSICS
G16H50/30
PHYSICS
A61B3/032
HUMAN NECESSITIES
G06N7/01
PHYSICS
G16H40/20
PHYSICS
A61B5/7465
HUMAN NECESSITIES
A61G10/00
HUMAN NECESSITIES
A61L2202/11
HUMAN NECESSITIES
International classification
A61B5/00
HUMAN NECESSITIES
A61B3/024
HUMAN NECESSITIES
A61B3/032
HUMAN NECESSITIES
A61B3/06
HUMAN NECESSITIES
A61G10/00
HUMAN NECESSITIES
G16H50/30
PHYSICS
Abstract
The present disclosure describes the clinical workflow, method, apparatus and system of an on demand artificial intelligence visual screening and visual field screening system that incorporates a display simulator cockpit frame system inside a booth, kiosk, or exam room with machine learning and telemedicine capabilities. According to various embodiments, an artificial intelligent, physical or virtual assistant may help in the screening process of the patient, and an eye doctor via telemedicine may connect to the computers in display simulator cockpit system to perform necessary medical consultations, visual examination or screenings via the display simulator cockpit frame set-up display system. Where an on demand health care provider via remote administration tool technology, remote screen sharing and remote control software control the medical equipment, provide medical consultations and medical examination to a patient from anywhere in the world via cellphone wireless networks or wifi to interconnect both systems.
Claims
1. A method, system, apparatus and workflow of one or a plurality of (AI-VFTR) (Artificial intelligent visual field telemedicine rooms) systems that can be set all over the world and anywhere in the world. The (AI-VFTR) system providing an on demand neurological and visual health screening and vision screening system to any user including a booth, kiosk, and/or exam room with a display screen simulator cockpit set-up, automated large screen visual fields setup, virtual reality visual field testing, visual acuity testing, color vision testing, pupillary distance and medical data analysis and diagnosis using artificial intelligent-machine learning software and with the capabilities for providing an on-demand telemedicine consultation by a health care provider who can connect to the system via video audio, audio, audio phone call, remote administration tool technology, remote screen share and control access tool technology to computers systems inside the (AI-VFTR) to provide vision health service to patients (user) comprising: a room structure design that can be a booth, kiosk and/or exam room. a assistant that may be a physical person, virtual medical technician, physical technician, telepresence technician or may also be an artificial intelligent virtual assistant. a simulator cockpit or cockpit simulator frame has monitors or screens attached with an adjustable seat. a sign-in webpage on a browser on a laptop computer outside of the room. a remote connection to an on-demand health care provider that may provide a connection from a one or more network of health care providers to the patient in the room equipment for counseling, diagnosis, review of testing, screening results, medical device prescription and referrals. a computer system that will run visual field software, vision acuity software, color vision screening software, eye-tracking software, pupillary distance software, remote administration tool software, and artificial intelligence machine learning software. a speech to text software to a data collecting system where the patient can speak the letters, numbers or symbols, (optotypes) from the vision acuity and color vision screening chart, and the information via speech to text can be transferred to the database for machine learning software to compare to results. a visual field software and clicker to provide visual field testing via simulated confrontational field using a cockpit simulator frame with monitor screens and second via virtual reality headset both with a wireless or non-wireless clicker. a eye tracking device and software working with the visual field software and vision screening software to determine eye fixation, pupillary distance and eye movements, and to maintain desired fixation point. a vision chart and color vision software designated for analyzing person, patient, or customers vision acuity and color vision deficiencies a machine learning artificial intelligent software gathering data software and analyze data from the results of speech to text color vision, visual acuity, and visual field testing images results. a large and small screen monitor or television mounted on a (cockpit simulator frame) to perform vision screening and testing using a simulator cockpit frame. a printers used to print out screening results, referrals forms to a health care provider, medication prescriptions, medical device prescriptions, receipts for service, or any other medical intended paperwork needed. a internet connection used to connect all of the computer systems inside and outside the (AI-VFTR). a virtual reality headset to run a software to deliver visual field testing to both eyes independently. a remote administration tool used to secure remote control, remote access, remote screen share from a health care practitioner and any computer in the (AI-VFTR) a doors be made with or without (smart glass) using a (smart film) on the glass doors for privacy and reducing lighting in the room. a uv disinfecting system or disinfecting procedure to disinfect equipment after every session. a sample medical image dataset
2. The room of claim 1, wherein the room structure design including four walls, floor, vents, roof with one or multiple doors, curtains or smart glass technology, and/or window openings depending on design. The doors can open and close remotely or physically. Where the doors and windows may be locked remotely or physically. The room structure can have a roof with vent or not have a roof depending on design of the room and maybe powered by external power source with electric sockets and plugs. Where the room may be built to be a permanent or temporary booth, kiosk and/or exam room in a larger room or leasing space in a building. Where the room can be a room inside any building or structure. The (kiosk, booth, or exam rooms) can be installed in a plurality of location anywhere in the world. Where in the booth, kiosk or room may be inside or outside of any building, hospital, department of motor vehicles building, inside military bases, overseas military bases, government facilities, malls, shopping plazas, watercraft ships, trailer, kiosk, booth, or any location that include medical equipment of any specialty anywhere in the world. The (kiosk, booths or exam rooms) are similar but larger than photo-booths and can hold one to three people inside but can vary depending on design location. all equipment may or not be built into the room but built on a cockpit simulation frames, stands, and furniture inside the (kiosk booth or exam rooms). The designs of the rooms, booth and kiosk may vary depending on setting and models. Some kiosk or booth designs may fit almost side by side (modularly) depending on design.
3. The assistant of claim 1, wherein the assistant may be a physical person, virtual medical technician, physical technician, telepresence technician, or may also be an (artificial intelligent) virtual assistant. In some cases a (health care provider) (eye doctor) may be an assistant. Any of all the assistant types may speak, provides instruction, collects data results, sends and receives data and/or responds to questions.
4. The simulator cockpit or cockpit simulator frame of claim 1, wherein the cockpit simulator frame has monitors or screens attached with an adjustable seat. The cockpit simulator frame provides a proper working distance to evaluate all vision examinations. The televisions or monitors used to (screen share) the data to one or more monitors, screen, computer screen, computer tablet screen, or virtual reality headset. The cockpit simulation frame may have additional adapting frames or furniture to upgrade the with other ophthalmic or medical equipment in the future.
5. The sign-in website of claim 1, wherein the sign-in website runs on a browser on a laptops computers, tablet computer, webpage, or mobile application. The computers may be inside or outside of the room. The sign in website can be access via QR code to do it via patient or customers own cellphone via web portal or mobile application. The computers may also run kiosk software or a webpage with e-commerce payments. The sign in portal may be used to gather patient information (medical history information), chief complaint and payment information. This information is inputted by patient via the sign in computers or customers, any person, (patient own personal electronic device via webpage or mobile application). Payments for medical service and screenings can be made via sign in laptops, tablets or mobile application or weblink with credit card shopping cart, self-checkout, central bank digital currencies, or cryptocurrency address. The system can also gather data for health insurance information and bill patient if needed. The medical screening service to be rendered prices will be displayed on the website, mobile application and or kiosk software. In some cases the payment can be waived for no cost service in humanitarian missions or free vision or medical screenings.
6. The remote connection to an on-demand health care provider of claim 1, wherein the remote on-demand health care providers may provide counseling, diagnosis, medical device prescriptions, review of testing results, and referral's to patient via plurality of (AI-VFTR) systems around the world. That the health care provider can be anywhere in the world and can provide service from anywhere in the world to any (AI-VFTR) (Artificial intelligent visual field telemedicine room) (kiosk, booth or exam room) anywhere in the world. That the health care provider can connect to the system and provide telemedicine services to a person via the cockpit simulation frame system computer system, display or (patient personal portable electronic device). Where the patient can screen mirror his cellphone video and audio to any displays in the room or cockpit simulation display. The telemedicine connection can be via tele conference video audio, audio only, text messaging, email, personal cellphone voice call, cellphone application for telemedicine service and/or remote screen share and control, remote administration tool technology or combination of any of the following. That the remote control to the medical software can be controlled using any communications technology service provided by any companies or software that may provide video-telephony, online chat services, teleconferencing, telecommuting, and remote control screen distance control to all medical software that controls the medical equipment in the room. That all telemedicine service interconnections, remote control, and remote screen share connections are done with internet connections such as ethernet, wifi, 4G, 5G, 6G or better cellular wireless networks. All interconnection will be done using the doctors, (AI-VFTR) computers and patients portable electronic device. The remote control and remote screen share will are done with (remote administration tool technology, remote access and control and cloud computer technology). All patient information can be access and updated remotely. Where the connection from the health care provider and the (AI-VFTR) system can be achieved via a (remote administration tool technology), remote access software, remote control and screen access on the (AI-VFTR) computer systems to screen share to view patient data and results. Where in the health care provider can connect to the system via remote administration tool technology, remote access control screen share technology, telemedicine video audio technology, chat and audio phone call. Where the health care provider may achieve connections with the patient via the patient personal cellphone via a direct link QR code and where the health care provider may be any type of health care provider including medical doctor, optometrist, ophthalmologist, neurologist, nurse, physician assistant or any other types of health care providers with a valid license to practice as a health care provider. Wherein the health care provider may forward information, referral forms, prescriptions or visual screening results to any health care provider, medical device provider, optical stores provider, ophthalmic medical device provider, Department of motor vehicles office, medical specialist or patients (customers). Where the health care provider may be part of a network of health care providers that are assigned to provide on demand medical service.
7. The computer systems in claim 1, wherein said plurality of computers in the (AI-VFTR) may be running on any operating system linux, IOS, windows, chrome os, raspberry pi, android and/or Mac. Where in the some or all the computer may run multiple softwares, virtual boxes and/or emulators at a time. Where the computer systems be used with screen mirror software via wired HDMI, bluetooth or wifi. The screen mirror and control may be done via a screen mirroring software that allows control and view of all the computers software to be viewed on a secondary computer via that can be controlled from the background. The computers may run virtual boxes with different operating systems (OS) in some situation to run intended software needed to perform the examination. The computer systems may run visual field software, kiosk software, vision acuity software, color vision screening software and artificial intelligence machine learning software to interpret results and gather information for probable suspected neurological or ophthalmologic vision psychophysical diagnosis including contrast sensitivity testing. Where in all the computer systems in the (AI-VFTR) may be controlled remotely via a (RAT) remote administration tool technology and/or any remote access control tool technology from any open source software or company providing (RAT) technology service software. The computer remote control and visualization and connectivity may be achieved by any designated health care practitioner or technician (Assistant) in any remote or non remote location. The artificial intelligence and machine learning software may use (Bayes' theorem) to determine the percentage of probability of a brain and eye problem. Where sample dataset of information and patient diagnosis may or mayn't be gathered by machine learning software to learn for future deep learning and a future more precise diagnostic tool.
8. The speech to text software in claim 1, wherein the speech to text software can run on the computers systems on the (AI-VFTR) and are used to as data collecting system where the patient can speak the letters, numbers or symbols, (optotypes) from the vision acuity and color vision screening chart and the information via speech to text result data can be transferred to the artificial intelligence machine learning software to compare to results. If the patient passes all of the results, the machine learning (AI) software, health care practitioner, physical or remote assistant may designate a passing rate depending on results (percentage correct). Where the speech to text software may be of open source, commercial or non-commercial source and the machine learning (AI) software may be of open source, commercial or non commercial source. All data and information data may be stored on the computers, servers, and/or cloud computer technology.
9. The visual field software and clicker in claim 1, wherein said plurality of visual field softwares may be displayed via screen share to the cockpit simulator frame display screen from a computer. Where the visual field softwares can be an application from a tablet in some cases running a kiosk software. The clicker can be bluetooth, wifi, or wired connection to the (computer running the visual field software). The visual field software consists of two different or same software running on two different devices a tablet or computer screen mirroring to a large display screen (television or monitor) with high resolution and/or a virtual reality headset with two oculus. The virtual reality headset and its software can be of open source, commercial or non-commercial means. Where in the visual field software projected on the display screen can be of open source, commercial or non-commercial means. The visual field software may be two independent software running on two different devices and/or same software running on both devices. The visual field software may be a mobile application screen mirrored to the virtual reality head set or a visual field mobile application screen mirrored to the large display in-front of the person receiving the service. Where the visual field software is calibrated with the large screen display to provide accurate examination and distance for all degree of visual fields.
10. The eye tracking device and software systems in claim 1, wherein the eye tracking device and softwares work with the visual field software, color vision software and vision acuity software to determine eye fixation and eye movements away from the central fixation point. The eye tracking hardware and software may use infrared technology, cameras depending on the eye tracking software and hardware used. The eye-tracking devices and/or softwares may run inside the computer system. The eye-tracking device and software may be from an open source, commercial or non-commercial means. The eye-tracking software may also provide eye movement measurements (extra ocular muscle testing) and can also be configured to provide approximate or exact pupillary distance in some cases by using specific software, mobile applications, artificial intelligence and/or machine learning software. In the case of pupillary distance measurement the system may require an extra payment for the printout, email or text message for customers pupillary distance measurements.
11. The vision chart and color vision software in claim 1, wherein the vision chart software and color vision software designated for analyzing patient or customers vision acuity and color vision deficiencies. The vision chart and color vision software work with a speech-to-text (dictation) software, artificial intelligent and machine learning software to determine if the patient speaks the optotypes (letters, numbers, or symbols) correctly to gather optimal visual acuity screenings and color vision screenings. The system may be configured with a translator for multi language settings or recognition. Where the patient can read the lowest selected (optotypes) on the screen and the artificial intelligence computer can categorize the letter to determine the best corrected visual acuity measurements for both right and left eye. Where the patient can read the numbers or figures on the color vision chart and the artificial intelligence software inside the computer can determine visual screening results.
12. The machine learning-artificial intelligent softwares in claim 1, wherein the machine learning-artificial intelligent softwares may run on all computers (laptop, tablet, virtual reality headset) and to gather data from the results of speech to text software, color vision software, visual acuity software, pupillary distance software and visual field software testing images. There could be multiple AI machine learning software running inside the computers and used to gather data and sample dataset in different forms for future deep learning studies. The machine-learning artificial intelligence software will use the images of the visual field screening or vision screen test performed to determine if they are brain or eye-related via a black on white, 3 or more point to 4 quadrant system algorithm. The machine learning-artificial intelligent software will also compare the visual field defects with list of samples datasets based on diagnosis from past doctors and current health care practitioners assessment diagnosis. List of systems that may be used: TensorFlow, Keras, Scikit-learn, Microsoft Cognitive Toolkit, Theano, Caffe, Torch or any open-source, commercial, or non-commercial software.
13. The large and small screen monitors or television in claim 1, wherein the big screen monitors or television may be mounted on a (cockpit simulator frame) or wall. Where the screen can be high resolution (4K) or better flat screen and can be of Smart TV, 3D, QLED, HD, UHD, OLED, LED, LCD or any type of display device and technology. Where the screen monitor or television will be connected to all vision testing software via HDMI wire, bluetooth or wifi to screen mirror. Where the distance is calibrated to determine visual acuity measurement for optotypes to gather visual acuity, color vision and visual field testing. The screen may have adapters that can move the screen to desired position for calibration.
14. The printer of claim 1, wherein the printers may be of any of the different types of printers include inkjet printer, laser printer, thermal printer. The printer can be color black, solid ink, thermal printer, and white printer. The printers can used to print out visual screening results, pupillary distance measurement, referrals forms to health care providers, medication prescriptions, receipts for service or any other medical intended paperwork needed. The printers can be wireless or non-wireless (wired) to connect with the computers. The printers can be used physically or remotely by an assistant or by a health care practitioner to print out any document remotely by controlling the software via (RAT) remote administration tool technology and/or (RAS) remote access and control software.
15. The internet connection of claim 1, wherein internet connection is used to connect all computer systems inside the (AI-VFTR) to the remote health care practitioner via ethernet, hotspots, wifi, 4G, 5G 6G cellular networks, satellite internet, starlink satellite internet connection or more advanced cellular networks. All internet connection can be used to provide realtime or near realtime connection with the health care practitioner to the exam room computers. The tele medicine interconnection between the health care practitioner to the (kiosk, booth or exam room) or patient phone may be via phone audio call, Audio video call, Audio video application software, remote administration tool technology, remote desktop control technology to achieve by a remotely connected health care provider.
16. The virtual reality headset of claim 1, wherein the virtual reality headset runs software to deliver visual field testing 24-2, 10-2, 30-2, and/or central visual field testing. The virtual reality headset can be connected to a computer with can screen mirror the information and result on to it. The information can now be view from the remote health care practitioner via remote access or screen sharing tool if needed during or after the test is done. The virtual reality headset visual field software may be of open source, commercial or non-commercial source. The images gathered from the virtual reality headset visual field testing may be analyzed by a remotely or non remotely connected health care provider. The images gathered from can also be analyzed by the AI machine learning software running on the computers. The virtual reality headset may be commercial or non-commercial hardware. The virtual reality head set may also be a smartphone running software for visual fields testing attached to a virtual reality headset smartphone adapter. Some VR headsets also have eye-tracking sensors and gaming controllers. The current headsets may or may not also have eye-tracking sensors. The VR headset can also have a wired or bluetooth connected clicker or gaming controller for the person to click during the examination or screening.
17. The computer systems in the (AI-VFTR) of claim 7, Wherein all the computer systems in the (AI-VFTR) may be controlled remotely via a (remote administration tool) remote desktop control access tool by any designated health care practitioner or technician (Assistant). Where a database of information and patient diagnosis may or mayn't be gathered by machine learning software to learn for deep learning and a future more precise diagnostic tool. That video voice or voice calls can be done via the computers on the systems if needed. That video or voice calls can also be done via the health care practitioner and the customer (patients) personal electronic device (laptop, cellphone, smartphone, or tablet).
18. The remote administration tool of claim 1, wherein the remote administration tool (RAT), (remote desktop software) or (remote access and control software) application can be of open source, commercial or non-commercial source. The remote administration tool (RAT) can be used to secure a remote control, remote access, remote screen share to any computer in the (AI-VFTR). Remote administration refers to any method of controlling a computer from a remote location. The interconnection of both systems can be done from any assigned health care practitioner with a remote administration support tool software from anywhere in the world to the (AI-VFTR) computer system via a secure encrypted connection via ethernet, wifi, satellite internet, starlink satellite internet connection, 4G, 5G, 6G or more advance wireless or cellphone wireless networks. All computer with softwares, vision screening software and hardware may be control via remote administration tool (RAT), (remote desktop software) or (remote access and control software) technology by an (assistant) or (health care provider).
19. The visual field screenings of claim 9, clients requesting visual field screenings may be present in any building, hospital, Department of Motor Vehicles building, inside military bases, overseas military bases, government facilities, malls, optical shops, pharmacies, optometric offices, ophthalmology offices, watercraft ships, trailer, kiosk, booth or any location that include medical equipment of any specialty anywhere in the world. The visual field screenings system may relate to preventive medicine, neurological examination or ocular health examination, or any other medical field test. In certain embodiments, the vision field screenings system may also facilitate the treatment or diagnosis of medical condition by a remotely connected health care provider connected via a remote access control and sharing software to the system or receiving the results via email, paper, or secure file transfer.
20. The doors of claim 1, wherein the doors may be made of (smart glass) using a (smart film) on the glass doors to adjusting light transmission between transparent, opaque, or photochromic using AC power electrochromic. The smart glass can be activated automatically remotely to prevent glare during the screenings. Some room designs may or may not have smart glass door and smart windows depending on the design used for the type of booth, kiosk or exam room. The smart glass may be used UV protection.
21. The room of claim 1, wherein the room structure including a eye patch box or vending machine inside or outside of the room. The room has internal medical equipment such as multiple computers, vision screening chart software, color vision chart software, exam chair, chairs, eye tracking hardware, eye tracking hardware software, security cameras, infrared cameras, computer cameras, microphones, cockpit simulation frame, screen display monitors or televisions, eye examination equipment, artificial intelligence software. Where the rooms can be equipped or upgraded to have any medical equipment such as automatic digital phoropter, fully automatic lensmeter, fully auto keratometer, fully automatic non mydriatic retinal camera, fully automatic auto refractor, fully automatic eye pressure tonometer and/or any ophthalmologic, optometric and neurological examination equipment with its control software running on the computers systems that can be controlled remotely.
22. The sample medical image dataset softwares in claim 1, wherein the said plurality of softwares collect sample dataset of visual screening and visual field results that can be processed as a medical non-fungible token (NFT) where health care practitioner and patient may receive royalties or commission for sharing their medical information, diagnosis and images. These NFT medical sharing sample datasets option may be driven by a blockchain smart contract or contract between the health care practitioner, the company providing the service and the patient. A non-fungible token (NFT) is a unit of data stored on a digital ledger, called a blockchain, that certifies a digital asset to be unique and therefore not interchangeable. NFTs can be used to represent items such as photos, videos, audio, and other types of digital files. Access to any copy of the original file, however, is not restricted to the buyer of the NFT. While copies of these digital items are available for anyone to obtain, NFTs are tracked on blockchains to provide the owner with a proof of ownership that is separate from copyright.
Description
BRIEF DESCRIPTIONS OF THE DRAWINGS
[0040]
[0041]
[0042]
[0043]
[0044]
[0045]
[0046]
[0047]
[0048]
[0049]
[0050]
[0051]
[0052]
[0053]
[0054]
[0055]
[0056]
[0057]
[0058]
[0059]