JP2022000763A - System and method for medical examination guided by automatically and remotely trained person - Google Patents

Abstract

A handheld diagnostic device and method for performing remote medical examination of a patient using a workstation operatively connectable to the remote diagnostic device. A handheld diagnostic device (104) in a system includes diagnostic sensors and a processor (106). The processor provides instructions for performing at least one given medical examination based on predefined reference data indicating a desired spatial placement of the diagnostic device relative to the body of the patient 103 for the at least one given medical examination. Providing the user 102 with operating the diagnostic sensors to acquire medical data when the desired spatial configuration is reached and verifying that the acquired medical data meets predefined medical data quality parameters; enables data analysis of the acquired medical data by trained medical personnel and transmits the validated medical data to the medical personnel's remote workstation 122 . [Selection drawing] Fig. 1

Description

The present invention relates to the field of medical examination, and more particularly to the field of medical examination guided by automatic and remote trained persons.

The prior art documents that are considered to be relevant as background techniques for the subject matter of this disclosure are listed below. The list of prior art documents herein is not presumed to acknowledge that they have any relevance to the patentability of the subject matter of this disclosure disclosed herein. In addition, the prior art documents cited in this application are not necessarily recognized as prior art.

US Pat. No. 6,544,198 (Chong et al.), Issued April 8, 2003, by comparing characteristic sound waves classified by disease with sound waves generated from different parts of an individual's body. Disclose a stethoscope system for self-examination that can diagnose the health condition of a particular individual. The system also provides remote medical examinations in which sound waves generated from various parts of an individual's body are transmitted over the Internet to a medical professional, who receives virtual medical examinations over the Internet. ..

US Pat. No. 6,014,432 (Monday), issued January 11, 2000, is a first videophone, electronic imaging assembly for producing digital images and physiological audio signals of patients, respectively. , And a patient station comprising a hearing device assembly coupled to the first videophone, wherein the first videophone simultaneously transmits the digital signal over a public telecommunications network, and a second. A healthcare provider's station, including videophones, video displays, and voice players, where the second videophone receives digital signals from the first videophone over the public telecommunications network and is of the patient's. Disclosed is a home healthcare system with a healthcare provider's station that displays images on a display and reproduces the patient's physiological voice with a voice player.

U.S. Pat. No. 5,527,261 (Monroe et al.), Issued June 18, 1996, provides video capabilities configured for any one of a number of clinical or industrial applications. Disclose a handheld, fully remote diagnostic instrument. The device has a casing that includes a handheld body portion and a rear cover, a front cover, and a neck portion that extends to the head portion formed by a sealing gasket to form a fully waterproof device from the body portion. The circuit board assembly in the body portion includes a video processing circuit and a flexible neckboard extending forward from the body portion through the neck portion of the casing to the headboard located at the head portion of the casing. A solid state imager and a small lamp are placed on the headboard. The front cover includes an adjustable focusing lens cell for focusing the target image in the field of view of the lens cell on the imager. The device can be configured for a variety of applications by installing a front cover and a rear cover for a particular purpose. This instrument can therefore be used, for example, as an otoscope, a dental camera, or an episcope. This instrument provides monitor-compatible standard full-color video signals to remotely located monitors.

The inventors have found that in modern times people often need to perform medical examinations. Such medical examinations may be required as regular medical examinations at the request of the patient or as necessary (for example, when the patient is not in good physical condition). Usually, these examinations are face-to-face visits to people who are medically trained (eg, doctors, nurses, etc.) in the light of the fact that some knowledge and equipment is needed to perform these tests. It is done in the meantime. It is estimated that billions of medical tests are performed each year. It should be noted that the number of general tests is expected to increase in the future as life expectancy continues to rise and older people tend to use more medical services. It should also be noted that the number of medically trained people (eg doctors and nurses) who can carry the community is constantly declining, thus reducing availability and increasing service load. .. Each of these medical tests requires the patient to meet with the trained person at a location (eg, clinic, hospital, patient's home, etc.).

Therefore, there is a need for new systems and methods in the art that will reduce the burden and increase availability of trained personnel by performing automatic and remote trained personnel-guided medical examinations. Sex exists.

According to one aspect of the subject matter of the present disclosure, a workstation configured to perform at least one remote medical examination, the workstation can be operably connected to a remote diagnostic device and at least one remote. For each of the medical examinations, the following: receive data enabling navigation from at least one navigation sensor of the diagnostic device, display the received data on the display, and display the displayed navigation. At least configured to be able to provide data collection guidance for positioning and orienting diagnostic devices to enable the collection of patient medical data based on the data enabled. A workstation is provided with one processor.

According to an example of the subject matter of the present disclosure, the processor further positions and orients the diagnostic device for each of at least one remote medical examination and collects patient medical data on at least one diagnostic sensor of the diagnostic device. Further workstations are provided that are configured to instruct to do so.

According to one example of the subject matter of the present disclosure, it is further predefined to be able to provide data collection guidance for positioning and orienting a diagnostic device to be able to collect medical data of a patient. Workstations are also provided, which are based on reference data.

According to an example of the subject matter of the present disclosure, data collection guidance is received from the guide device to further connect to the guide device and position and orient the diagnostic device to allow medical data collection of the patient. , Workstations are also provided.

According to an example of the subject matter of the present disclosure, the navigation sensor is:
(A) Camera,
(B) Distance sensor,
(C) Pressure sensor,
(D) Microphone,
(E) INS sensor,
One of them, the workstation, is also offered.

According to one aspect of the subject matter of the present disclosure, a method of activating a workstation to perform at least one remote medical examination, the workstation being operably connected to a remote diagnostic device, at least one. For each of the remote medical examinations, the data that enables navigation is received from at least one navigation sensor of the diagnostic device, and the received data is displayed on the display, and the data that enables the displayed navigation. Based on this, methods are further provided, including being able to provide data collection guidance for positioning and orienting the diagnostic device to be able to collect medical data for the patient.

According to an example of the subject matter of the present disclosure, for each of at least one remote medical examination, the diagnostic device is instructed to position and orient the diagnostic device to collect medical data of the patient. Further methods are provided, including more to do

According to an example of the subject matter of the present disclosure, it is further predefined to be able to provide data collection guidance for positioning and orienting a diagnostic device to be able to collect medical data of a patient. Further methods are provided that are based on reference data.

According to one example of the subject matter of the present disclosure, the workstation can also be operably connected to a guide device and data for positioning and orienting the diagnostic device to allow medical data collection of the patient. Further provided is a method in which collection guidance is received from the guide device.

According to an example of the subject matter of the present disclosure, the navigation sensor is:
(A) Camera,
(B) Distance sensor,
(C) Pressure sensor,
(D) Microphone,
(E) IMU sensor,
One of these methods is also provided.

According to one aspect of the subject matter of the present disclosure, a handheld diagnostic device for performing at least one remote medical examination, operably connected to a remote workstation, with at least one navigation sensor and at least one. With one diagnostic sensor and at least one processor, the processor with respect to at least one remote medical examination is: transmitting data from at least one navigation sensor of the diagnostic device to the remote workstation, and: Further provided are handheld diagnostic devices configured to be configured to receive instructions to collect patient medical data.

According to an example of the subject matter of the present disclosure, the processor further works remotely from at least one diagnostic sensor in response to receiving instructions to collect patient medical data for each of at least one remote medical examination. Further provided are handheld diagnostic devices configured to transmit data to the station.

According to an example of the subject matter of the present disclosure, the second workstation can be operably connected to a second workstation, and the processor can further display data from the second workstation from at least one navigation sensor of the diagnostic device. Further provided are handheld diagnostic devices configured to transmit data to.

According to one aspect of the subject matter of the present disclosure, a method of activating a handheld diagnostic device for performing at least one remote medical examination, wherein the handheld diagnostic device can be operably connected to a remote workstation and at least. For each of the remote medical examinations, the method further comprises transmitting data from at least one navigation sensor of the diagnostic device to the remote workstation and receiving instructions to collect the patient's medical data. Also provided.

According to an example of the subject matter of the present disclosure, for each of at least one remote medical examination, data is transferred from at least one diagnostic sensor to the remote workstation in response to receiving instructions to collect the patient's medical data. Further methods are provided, further comprising transmitting.

According to an example of the subject matter of the present disclosure, the handheld diagnostic device can be operably connected to a second workstation and from at least one navigation sensor of the diagnostic device to the second workstation to display data. Further methods are provided, further comprising transmitting data to.

According to one aspect of the subject matter of the present disclosure, a workstation configured to perform one or more remote medical examinations of a patient, which can be operably connected to a remote diagnostic device, and a display. With at least one processor, the processor with respect to at least one of several remote medical examinations, ie,
Receiving navigation-enable data that is collected by at least one navigation sensor of the remote diagnostic device and indicates the spatial placement of the remote diagnostic device with respect to the patient's body.
Showing the data on the display that enables the received navigation,
Instructions for the desired spatial placement of the remote diagnostic device on the patient's body, from which the patient's medical data will be collected according to at least one medical examination, provided by a trained person activating the workstation. To receive instructions,
Sending the received instructions to a remote diagnostic device, thus allowing its navigation to the desired spatial arrangement for the patient's body,
A workstation is provided that is configured to do so.

According to an example of the subject matter of the present disclosure, a workstation is further configured to activate at least one diagnostic sensor in a remote diagnostic device to collect medical data when the processor reaches the desired spatial arrangement. Further provided.

According to an example of the subject matter of the present disclosure, a workstation is further provided in which the data enabling navigation is a body or body organ image.

According to an example of the subject matter of the present disclosure, a workstation is further provided in which the body organ image is an internal body organ image.

According to an example of the subject matter of the present disclosure, a workstation is further provided in which the data enabling navigation is inertial navigation system (INS) data received from at least one navigation sensor.

According to an example of the subject matter of the present disclosure, the workstation is further configured to display reference data indicating the desired spatial arrangement of the remote diagnostic device with respect to the patient's body for medical examination. Provided

An example of the subject matter of the present disclosure further provides a workstation from which reference data is collected during a calibration process performed by a trained person.

According to an example of the subject matter of the present disclosure, the processor further performs the following steps during the calibration process, i.e.
Steps to receive instructions for medical examinations to be performed, and
Steps to provide guidance for proofreading to trained people,
When the diagnostic device reaches the desired spatial arrangement, the step of recording reference data indicating the desired spatial arrangement of the remote diagnostic device with respect to the patient's body, and
Further workstations are provided that are configured to do so.

According to an example of the subject matter of the present disclosure, a workstation is further provided that further comprises a guide device configured to receive instructions from a trained person.

According to an example of the subject matter of the present disclosure, a workstation is further provided in which at least one navigation sensor is a camera.

According to an example of the subject matter of the present disclosure, a workstation is further provided in which at least one navigation sensor is an INS.

According to an example of the subject matter of the present disclosure, a workstation is further provided in which the processor is configured to receive medical data collected by a remote diagnostic device and display it on a display.

According to an example of the subject matter of the present disclosure, a workstation is further provided in which one or more medical examinations of a patient are defined by a predefined medical examination plan associated with the patient.

According to an example of the subject matter of the present disclosure, the processor further receives one or more questions relating to the patient and provides the remote diagnostic device with one or more questions to present them to the patient. Further workstations are provided that are configured to receive answers to one or more questions.

According to an example of the subject matter of the present disclosure, a workstation is further provided in which one or more questions are defined by a predefined health care plan.

According to an example of the subject matter of the present disclosure, a workstation is further provided in which one or more questions are received from a trained person.

According to an example of the subject matter of the present disclosure, a workstation is further provided in which the diagnostic sensor is an image based diagnostic sensor.

According to an example of the subject matter of the present disclosure, a workstation is further provided, wherein the diagnostic sensor is a voice-based diagnostic sensor.

According to an example of the subject matter of the present disclosure, a workstation is further provided in which the processor is further configured to allow a trained person to verify that the collected data meets predefined criteria.

According to an example of the subject matter of this disclosure, the predefined criteria are:
(A) Required reading length,
(B) Minimum recording volume,
(C) Minimum recording quality,
(D) Minimum pressure on the patient's body,
(E) Maximum pressure on the patient's body,
(F) Maximum allowed movement of the remote diagnostic device during the collection of readings,
(G) Image reading type,
(H) Required image reading zoom,
(I) Required image reading light,
(J) Required image reading matching with a predefined reference, and (k) Minimum image quality,
A workstation, which is at least one of them, is further provided.

According to one aspect of the subject matter of the present disclosure, a method of performing one or more remote medical examinations of a patient using a workstation that can be operably connected to a remote diagnostic device, wherein several remote medicines are performed. For at least one of the tests, a remote medical test
Receiving navigation-enable data that is collected by at least one navigation sensor of the remote diagnostic device and indicates the spatial placement of the diagnostic device with respect to the patient's body.
Displaying the data that enables the received navigation,
Instructions for the desired spatial placement of the remote diagnostic device on the patient's body, from which the patient's medical data will be collected according to at least one medical examination, provided by a trained person activating the workstation. To receive instructions,
Sending the received instructions to a remote diagnostic device, thus allowing its navigation to the desired spatial arrangement for the patient's body,
Methods including the above are also provided.

According to an example of the subject matter of the present disclosure, further methods are provided that further include collecting medical data once the desired spatial arrangement is reached.

According to an example of the subject matter of the present disclosure, a method is further provided in which the data enabling navigation is a body or body organ image.

According to an example of the subject matter of the present disclosure, a method is further provided in which the body organ image is an internal body organ image.

According to an example of the subject matter of the present disclosure, a method is further provided in which the data enabling navigation is inertial navigation system (INS) data received from at least one navigation sensor.

According to an example of the subject matter of the present disclosure, a method further comprising displaying reference data indicating the desired spatial arrangement of the remote diagnostic device with respect to the patient's body for performing a medical examination is further provided.

According to an example of the subject matter of the present disclosure, a method is further provided in which reference data is collected during a calibration process performed by a trained person.

According to an example of the subject matter of this disclosure, the calibration process is:
Steps to receive instructions for medical examinations to be performed, and
Steps to provide guidance for proofreading to trained people,
When the diagnostic device reaches the desired spatial arrangement, the step of recording reference data indicating the desired spatial arrangement of the remote diagnostic device with respect to the patient's body, and
Methods are also provided, including.

According to an example of the subject matter of the present disclosure, a method is further provided that further comprises receiving medical data collected from a remote diagnostic device and displaying it to a trained person.

According to an example of the subject matter of the present disclosure, a method is further provided in which one or more medical examinations of a patient are defined by a predefined health care plan associated with the patient.

According to an example of the subject matter of this disclosure
Receiving one or more questions related to the patient,
Providing one or more questions to the diagnostic device to present them to the patient, and receiving responses to one or more questions.
Further including, methods are also provided.

According to an example of the subject matter of the present disclosure, a method is further provided in which one or more questions are defined by a predefined health care plan.

According to an example of the subject matter of the present disclosure, a method is further provided in which one or more questions are received from a trained person.

According to an example of the subject matter of the present disclosure, methods are further provided that include allowing trained personnel to verify that the collected data meet predefined criteria.

According to an example of the subject matter of this disclosure, the predefined criteria are:
(A) Required reading length,
(B) Minimum recording volume,
(C) Minimum recording quality,
(D) Minimum pressure on the patient's body,
(E) Maximum pressure on the patient's body,
(F) Maximum allowed movement of the remote diagnostic device during the collection of readings,
(G) Image reading type,
(H) Required image reading zoom,
(I) Required image reading light,
(J) Required image reading matching with a predefined reference, and (k) Minimum image quality,
The method, which is at least one of them, is further provided.

According to one aspect of the subject matter of the present disclosure, a handheld diagnostic device configured to perform one or more remote medical examinations of a patient, which can be operably connected to a remote workstation and at least one. Equipped with one navigation sensor, at least one diagnostic sensor, and a processor, the processor with respect to at least one of the remote medical examinations, i.e.
Collecting data that enables navigation using at least one navigation sensor, which indicates the spatial placement of the diagnostic device with respect to the patient's body.
Sending the collected data that enables navigation to a remote workstation,
Receiving the desired spatial placement instructions for the patient's body, from which the patient's medical data will be collected according to at least one remote medical examination.
Using the collected navigation-enabling data and reference data to determine the spatial placement of the diagnostic device for the desired spatial placement,
To calculate the required movement correction from the determined spatial arrangement to the desired spatial arrangement in order to collect the patient's medical data according to at least one medical test, and to place the diagnostic device in the desired spatial arrangement according to the calculated route. Providing users with operational instructions to navigate,
Further provided are handheld diagnostic devices configured to do so.

According to an example of the subject matter of the present disclosure, a handheld diagnostic device is further configured to activate at least one diagnostic sensor of the diagnostic device to collect medical data when the processor reaches the desired spatial arrangement. Further provided.

According to an example of the subject matter of the present disclosure, a handheld diagnostic device that operates in response to a command received from a remote workstation is further provided.

According to an example of the subject matter of the present disclosure, a handheld diagnostic device is further provided in which the data enabling navigation is a body or body organ image.

According to an example of the subject matter of the present disclosure, a handheld diagnostic device is further provided in which the body organ image is an internal body organ image.

According to an example of the subject matter of the present disclosure, a handheld diagnostic device is further provided in which the data enabling navigation is inertial navigation system (INS) data received from at least one navigation sensor.

According to an example of the subject matter of the present disclosure, the processor further
Receive a command to collect reference data indicating the spatial placement of the desired diagnostic device with respect to the patient's body to perform a medical examination.
Collect reference data using at least one diagnostic sensor
Transmit reference data to a remote workstation,
Further provided are handheld diagnostic devices configured as such.

According to an example of the subject matter of the present disclosure, a handheld diagnostic device is further provided in which commands are received from a remote workstation during a calibration process performed by a trained person.

According to an example of the subject matter of the present disclosure, a handheld diagnostic device is further provided in which the at least one navigation sensor is a camera.

According to an example of the subject matter of the present disclosure, there is further provided a handheld diagnostic device in which at least one navigation sensor is an INS.

According to an example of the subject matter of the present disclosure, a handheld diagnostic device is further provided in which one or more medical examinations of a patient are defined by a predefined health care plan associated with the patient.

According to an example of the subject matter of the present disclosure, the processor further
Providing the user with one or more patient-related questions
Receive answers to one or more questions and
Send the reply to a remote workstation,
Further provided are handheld diagnostic devices configured as such.

According to an example of the subject matter of the present disclosure, a handheld diagnostic device is further provided in which one or more questions are defined by a predefined health care plan.

According to an example of the subject matter of the present disclosure, a handheld diagnostic device is further provided in which one or more questions are received from a trained person activating a workstation.

According to an example of the subject matter of the present disclosure, a handheld diagnostic device is further provided, wherein the diagnostic sensor is an image based diagnostic sensor.

According to an example of the subject matter of the present disclosure, a handheld diagnostic device is further provided, wherein the diagnostic sensor is a voice-based diagnostic sensor.

According to one aspect of the subject matter of the present disclosure, a method of activating a handheld diagnostic device to perform one or more remote medical examinations of a patient, wherein the handheld diagnostic device is operably connected to a remote workstation. And with respect to at least one of several remote medical tests
Collecting data that enables navigation using at least one navigation sensor of the handheld diagnostic device, which indicates the spatial placement of the diagnostic device with respect to the patient's body.
Sending the collected data that enables navigation to a remote workstation,
Receiving the desired spatial placement instructions for the patient's body, from which the patient's medical data will be collected according to at least one remote medical examination.
Using the collected navigation-enabling data and reference data to determine the spatial placement of the diagnostic device for the desired spatial placement,
To calculate the required movement correction from the determined spatial arrangement to the desired spatial arrangement in order to collect the patient's medical data according to at least one medical test, and to place the diagnostic device in the desired spatial arrangement according to the calculated route. Providing users with operational instructions to navigate,
Methods are also provided, including.

According to an example of the subject matter of the present disclosure, a method further comprising activating at least one diagnostic sensor of a diagnostic device to collect medical data when a desired spatial arrangement is reached is further provided.

An example of the subject matter of the present disclosure further provides a method in which an operation is performed in response to a command received from a remote workstation.

According to an example of the subject matter of the present disclosure, a method is further provided in which the data enabling navigation is a body or body organ image.

According to an example of the subject matter of the present disclosure, a method is further provided in which the body organ image is an internal body organ image.

According to an example of the subject matter of the present disclosure, a method is further provided in which the data enabling navigation is inertial navigation system (INS) data received from at least one navigation sensor.

According to an example of the subject matter of this disclosure
Receiving a command to collect reference data indicating the spatial placement of the desired diagnostic device with respect to the patient's body to perform a medical examination,
Collecting reference data,
Transmission of reference data to a remote workstation,
Further including, methods are also provided.

According to an example of the subject matter of this disclosure
Receiving a command to collect reference images showing the spatial placement of the desired diagnostic device on the patient's body to perform a medical examination,
Collecting reference images and transmitting reference images to remote workstations,
Further including, methods are also provided.

An example of the subject matter of the present disclosure further provides a method of receiving commands from a remote workstation during a calibration process performed by a trained person activating the workstation.

According to an example of the subject matter of the present disclosure, a method is further provided in which one or more medical examinations of a patient are defined by a predefined health care plan associated with the patient.

According to an example of the subject matter of the present disclosure, providing a user with one or more patient-related questions, receiving a response to one or more questions, and transmitting the response to a remote workstation. Further including that, methods are also provided.

According to an example of the subject matter of the present disclosure, a method is further provided in which one or more questions are defined by a predefined health care plan.

According to an example of the subject matter of the present disclosure, a method is further provided in which one or more questions are received from a trained person activating a workstation.

In order to understand the subject matter of the present disclosure and to see how this may actually be done, the subject matter is described herein as a non-limiting example with reference to the accompanying drawings.

FIG. 3 is a block diagram schematically illustrating an example of a system for performing automatic and self-guided medical examinations according to the subject matter of the present disclosure. FIG. 3 is a block diagram schematically illustrating an example of a diagnostic device configured to perform automatic and self-guided medical examinations according to the subject matter of the present disclosure. It is a block diagram schematically illustrating an example of a diagnostic sensor configured to collect medical data relating to the subject matter of the present disclosure. It is a block diagram schematically illustrating an example of a navigation module configured to calculate the spatial arrangement of a diagnostic device with respect to the patient's body (or a particular part thereof) according to the subject matter of the present disclosure. It is a block diagram schematically illustrating an example of a guide module configured to guide a user of a diagnostic device according to the subject matter of the present disclosure. It is a flowchart illustrating an example of a series of operations performed to perform an automatic and self-guided medical examination according to the subject matter of the present disclosure. It is a flowchart illustrating an example of a series of operations performed to perform a personalized calibration of a diagnostic device according to the subject matter of the present disclosure. It is a flowchart illustrating an example of a series of actions performed to record reference data during personalized calibration of a diagnostic device using an imaging sensor and an orientation sensor according to the subject matter of the present disclosure. It is a flowchart illustrating an example of a series of actions performed to record reference data during personalized calibration of an INS sensor and a diagnostic device using body points according to the subject matter of the present disclosure. It is a flowchart illustrating an example of a series of actions performed to record reference data during personalized calibration of a diagnostic device using reference points and pointing objects according to the subject matter of the present disclosure. It is a schematic diagram of a reference pattern based on an exemplary image relating to the subject matter of the present disclosure. It is a schematic diagram of the reference point based on an image and the reference point based on INS which concerns on the subject of this disclosure. It is a flowchart illustrating an example of a series of actions performed for the calculation of the spatial arrangement of the diagnostic device with respect to the body (or a specific part thereof) of the patient 103 according to the subject matter of the present disclosure. It is a flowchart illustrating an example of a series of actions performed to navigate a diagnostic device according to the subject matter of the present disclosure and thus guide a user of the diagnostic device. It is a flowchart illustrating another example of a series of actions performed to navigate a diagnostic device according to the subject matter of the present disclosure and thus guide a user of the diagnostic device. It is a schematic of an exemplary pointing object used to navigate the diagnostic device according to the subject matter of the present disclosure and thus guide the user of the diagnostic device. It is a schematic diagram of an exemplary presentation of a navigation instruction to a user of a diagnostic device according to the subject matter of the present disclosure. It is a flowchart illustrating an example of a series of operations performed for the collection and verification of readings by a diagnostic device according to the subject matter of the present disclosure. It is a block diagram schematically illustrating an example of a system for performing an automated and remote trained person-guided medical examination according to the subject matter of the present disclosure. FIG. 3 is a schematic representation of some exemplary guide devices that can be used to provide navigation instructions to users of diagnostic devices according to the subject matter of the present disclosure. It is a flowchart illustrating an example of a series of actions performed to perform an automatic and remote trained person-guided medical examination according to the subject matter of the present disclosure. It is a flowchart illustrating an example of a series of actions performed to navigate a diagnostic device and thus guide a user of the diagnostic device in a medical examination guided by a remote trained person according to the subject matter of the present disclosure. .. It is a schematic of an exemplary navigation and guide presentation to a trained person on the subject of the present disclosure. It is a flowchart illustrating an example of a series of actions performed for the collection and verification of readings by a diagnostic device in a medical examination guided by a remote trained person according to the subject matter of the present disclosure.

In the drawings and description of the description, the same reference numerals indicate components that are common to different embodiments or configurations.

Unless otherwise specified, as will be apparent from the following description, "receive", "use", "transmit", "determine", "determine" throughout the description of the specification. The use of terms such as "send", "record", "display", "calculate", "provide", "collect", "verify" is data. Containing computer actions and / or processes of manipulating and / or converting to other data, the data being represented as a physical quantity, such as an electronic quantity, and / or the data representing a physical object. I understand. The term "computer" is not limited to personal computers, servers, computing systems, communication devices, processors (eg, digital signal processors (DSPs), microcontrollers, field programmable gate arrays (FPGA)). ), Specific Integrated Circuits (ASICs), etc.), any other electronic computing device, and / or any combination thereof, should be broadly interpreted to include all types of electronic devices with data processing capabilities. Is.

The operation according to the teachings of the present specification may be performed by a computer specially constructed for a desired purpose, or by a general-purpose computer specially configured for a desired purpose by a computer program stored in a computer-readable storage medium. be.

As used herein, the phrases "eg," "like," "as an example," and variations thereof, describe embodiments without limitation of the subject matter of the present disclosure. References herein to "one case," "some cases," "other cases," or variants thereof are specific features, described in connection with embodiments (s). It is meant that the structure, or feature, is included in at least one embodiment of the subject matter of the present disclosure. Therefore, the appearance of the phrases "one case", "some cases", "other cases", or variants thereof does not necessarily refer to the same embodiment (singular or plural).

It can be seen that certain features of the subject matter of the present disclosure, described in the context of separate embodiments for clarity, may also be provided in combination with a single embodiment. Conversely, the various features of the subject matter of the present disclosure, described in the context of a single embodiment for brevity, may also be provided separately or in any suitable partial combination.

In some embodiments of the subject matter of the present disclosure, one or more steps illustrated in the figure may be performed in different order, and / or one or more groups of steps may be performed simultaneously and vice versa. May be done. The drawings illustrate a general outline of the system architecture for some examples of the subject matter of this disclosure. Each module in the figure can be configured with any combination of software, hardware, and / or firmware that performs the functions as defined and described herein. The modules in the figure may be concentrated in one place or distributed in more than one place.

With this in mind, focus on FIG. 1, which is a block diagram schematically illustrating an example of a system for performing automatic and self-guided medical examinations according to the subject matter of the present disclosure. It can be seen that the user 102 and the patient 103 are located at the patient's location 100. User 102 may in some cases be patient 103 requiring medical examination (in such cases, even though user 102 and patient 103 are shown in the drawing as separate entities, they are actually Is the same entity). In other cases, the user 102 may be the person who will perform the medical examination of the patient 103.

For the purpose of performing a medical examination, the user 102 activates the diagnostic device 104 as described in more detail below. In some cases, the user 102 also activates the patient's workstation 114, as described in more detail below. The patient's workstation 114 may be any computer, including a personal computer, a portable computer, a cellular handset, or, for example, a device having appropriate processing power, including a computer and / or device that can be specifically configured for that purpose. Can be done. It should be noted that in some cases the patient's workstation 114 can be integrated within the diagnostic device 104. The diagnostic device 104 includes at least one processor 106 (eg, a digital signal processor (DSP), a microcontroller, a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), etc.), and a memory unit. It comprises (or is otherwise associated with) 110 (eg ROM, hard disk, etc.). The processor 106 is configured to receive instructions and control the components and operations of the diagnostic device 104.

In some cases, the diagnostic device 104 can be configured to communicate with the patient's workstation 114. Communication between the diagnostic device 104 and the patient's workstation 114 can be achieved by any means of communication, for example via wiring or wireless communication. It can be noted that the user 102, the patient 103, the diagnostic device 104, and the patient workstation 114 are located at the patient location 100.

The diagnostic device 104 can be configured to collect various data, as will be described in more detail below. The collected data can be transmitted to the trained person's workstation 122 and / or to the central system 130 located at the trained person's location 120 (either directly from the diagnostic device 104 or through the patient's workstation 114). .. The central system 130 and the trained person's workstation 122 are devices with appropriate processing power, including personal computers, portable computers, cellular handsets, or, for example, computers and / or devices that can be specifically configured for that purpose. Can be any computer, including. The collected data can be transmitted, for example, via the Internet 116. It should be noted that the data can be transmitted using other known alternative communication means such as cellular networks, VPNs, LANs and the like.

The central system 130 comprises a patient and health care plan repository 136 in which various patient-related data are maintained. Such data may include, for example, patient identification numbers, patient names, patient ages, patient contact details, patient medical data (eg, illness, susceptibility to medications, etc.), health care plan data (more on this later). If) etc. can be included. The central system 130 may further comprise a medical examination repository 134 in which the data collected by the diagnostic device 104 and the patient's workstation 114 is maintained. Such data can include, for example, the results of medical examinations performed using a diagnostic device (eg, ear readings, recorded lung or heart sounds, blood pressure, body temperature, etc., as described in more detail below). .. The central system 130 transfers the received data to the selected trained person's workstation 122 (eg, the available trained person's workstation 122 or the trained person's workstation 122 with the shortest queue). It further comprises a management system 132 configured to do so. The central system 130 provides a central system as it allows for a decentralized approach in which data can be received by the central system 130 from multiple patient locations and transmitted to multiple trained person locations. It should be noted that there may be more than one trained person location 120 and trained person 124 when doing so. Thus, if the transmitted data is received by the central system 130, the data is stored in the medical examination repository 134 and the management system 132 can transmit the received data to the trained person's location 120 (eg,). It should be noted that the data can be transmitted over the Internet 116 using other known alternatives such as cellular networks, DLLs, LANs, etc.). In some cases, the management system 132 can also manage other processes such as the patient signing process, the process of planning the patient's scheduling to a responsive trained person, and so on.

It should be noted that the central system 130 is optional for the solution and that the central system 130 can be part of the trained person's system 120. In addition, communication between the patient's location 100 and the trained person's location 120 can be implemented directly without the use or need of a central system 130.

When the transmitted data is received on the trained person's workstation 122, the data can be stored in the trained person's data repository 123 connectable to the trained person's workstation 122. The trained person 124 at the trained person's location 120 (eg, doctors, nurses, medical practitioners, etc., including any other person with the know-how and skills to collect and / or analyze medical data) For example, the data collected using the trained person's workstation 122 can be searched and reviewed. It should be noted that the patient workstation 114, the trained person workstation 122, and the central system 130 can include a display (eg, an LCD screen) and a keyboard or any other suitable input / output device. Is. In some cases, the trained person 124 can provide feedback to the user 102, for example by transmitting data back to the patient's workstation 114. Such feedback can include, for example, analysis of received data, a request to receive more data, medical procedure instructions, guidance for further testing, and the like. Alternatively or additionally, the trained person 124 can transmit the feedback data to the central system 130, which in turn can then transmit the feedback data to the patient's workstation 114 (eg,). , Via the internet, cellular networks, etc.).

FIG. 2 is a block diagram schematically illustrating an example of a diagnostic device configured to perform automatic and self-guided medical examinations according to the subject matter of the present disclosure. The diagnostic device 104 may include, among other things, a diagnostic sensor module 202, a guide module 206, a test logic module 208, a health care plan repository 210, and a data repository 216. The diagnostic device may further include a navigation module 204, a read and verify logic module 212, and a calibration logic module 214.

The test logic module 208 can be responsible for activating the diagnostic device 104 to perform a medical test on the patient 103. The diagnostic device 104 can be started by, for example, the user 102. Upon activation, the user 102 can optionally instruct the patient to be examined. Such instructions may be in the form of inputting the identification details of the patient 103 (eg, patient id, patient name, etc.) into, for example, the patient's workstation 114. In other cases, such instructions may be in the form of selecting a particular patient 103, for example from a list of known patients. A list of such known patients can be displayed on the patient's workstation 114. In some cases, such a list of known patients can be displayed on a display connected to the diagnostic device 104. Details of known patients that will be presented on such a list of known patients may be described, for example, in Data Repository 216, Health Plan Repository 210, Trained Person Data Repository 123, Patients and Health Plan Repository 136. Or it can be searched from one or more of any other location operatively connected to the diagnostic device 104, on which patient data is stored. In still other cases, the diagnostic device 104 can automatically identify the patient 103 by using a body identification method such as face recognition, fingerprint reading, or any other biometric identification means. Such auto-identification is, for example, a navigation camera 420 or any other peripheral device, reader, or sensor connected to the diagnostic device 104 or to the patient's workstation 114, which makes it possible to collect data related to auto-identification. Can be used. It should be noted that other methods of indicating or identifying the patient to be examined can be used as well.

In some cases, after receiving the details of patient 103, the test logic module 208 can be configured to retrieve data related to the health care plan. Such health care plan data can store patient-specific health care plan data on the health care plan repository 210, patient and health care plan repository 136, trained person data repository 123, or on it. It can be stored in one or more of any other location operatively connected to the diagnostic device 104. The health care plan can define a set of medical tests and data that will be collected by the diagnostic device 104. The collection of such medical data can be performed by the user 102 with respect to the patient 103. Medical data can include, for example, body temperature, blood pressure, pulse, respiratory rate, pharyngeal image, nevus image, ear image and the like. The medical examination plan can, in some cases, be a general medical examination plan (eg, a series of medical examinations that can be standard predetermined medical examinations). In other cases, the health care plan can be defined according to certain medical conditions of patient 103 (eg, a health care plan for a patient with cancer can include a series of cancer-specific necessary medical tests. , Medical examination plans for hypertensive patients can include the necessary medical tests specific to a series of hypertension, etc.). In yet other cases, the health care plan can be specifically defined for patient 103, eg, according to the judgment of the trained person 124 (eg, a physician interested in monitoring specific medical data for a particular patient). Can negotiate a patient-specific medical examination plan). The health care plan needs to be represented, among other things, information about the examination process, steps, and logic, as well as predefined reading parameters, such as the type of sensor to be used (still image vs. video), time (eg, seconds). It can include definitions of read (recording or recording) lengths and read data thresholds (eg, acceptable minimum and / or maximum read limits that should be used as quality parameters for readings.

Upon searching for a health plan to be performed, the test logic module 208 should use the navigation module 204 to be able to determine the spatial placement of the current diagnostic device with respect to the body (or particular part thereof) of patient 103. Can be configured.

Spatial arrangements or similar terms are spatial distances, spatial angles (including orientations), or spatially between two objects, such as between the diagnostic device 104 and the patient 103's body (or certain parts thereof). It should be noted that it may be related to any other spatial criterion used to characterize the relationship.

The navigation module 204 can be responsible for the operation of various sensors used for that purpose, as will be described in more detail with reference to FIG. The navigation module 204 can use pre-stored reference data to establish data regarding the current and desired spatial arrangement of the diagnostic device 104 for the body (or particular part thereof) of the patient 103. The pre-stored reference data is image-based reference data and / or reference data based on the spatial arrangement of the diagnostic device 104, or diagnostics, as will be described in more detail with respect to FIGS. 6, 9, and 10-13. It can consist of any other relevant reference data, including data that can be read by the navigation module 204 of device 104 or the diagnostic sensor 202. Reference data may be, for example, between images of patient 103 (external patient images and / or internal patient images of internal parts), general organ images, device coordinates, spatial arrangements of patient 103 with respect to the body (or specific parts thereof). It can be relativity data or the like. Such pre-stored reference data is operatively connected to a patient and health plan repository 136, a trained person data repository 123, or a diagnostic device 104 on which image-based reference data is stored. It can be stored anywhere else. Establishing the current spatial arrangement of the diagnostic device 104 for the patient 103's body (or a particular portion thereof), the navigation module can be defined, for example, by a patient-specific health care plan for the patient 103's body (or its particular portion). The route to the desired diagnostic device 104 spatial arrangement for a particular part) can be calculated. The route calculation is continuous, for example, until the desired diagnostic device 104 spatial arrangement for the body (or a particular part thereof) of the patient 103 is reached, as will be described in more detail with reference to FIGS. 6 and 11-13. It can be done periodically or periodically (eg, at predetermined time intervals).

In some cases, the test logic module 208 will instruct the user 102 how to operate the diagnostic device 104 into the desired diagnostic device 104 spatial arrangement for the patient 103's body (or a particular portion thereof). The guide module 206 can be configured to be used to provide the data. Such guidance data may include, among other things, voice commands, image displays, vibrations of the diagnostic device 104, and the like, as will be described in more detail with reference to FIGS. 5, 6 and 11-13. Such guidance data is continuously or periodically to the user 102 until the diagnostic device 104 reaches the desired spatial arrangement for the body (or a particular part thereof) of the patient 103 from which the medical examination can be performed. It can be presented (eg, at predetermined time intervals). Such guidance data can be calculated according to each calculation of the route to the desired diagnostic device 104 spatial arrangement for the body (or particular part thereof) of the patient 103 as calculated by the navigation module 204.

When the diagnostic device 104 reaches the desired spatial arrangement for the body (or a particular part thereof) of the patient 103, eg, as indicated by a patient-specific health care plan, the test logic module 208 will perform the medical examination of the patient 103. It can be configured to use the read and verify logic module 212 to collect data. When the diagnostic device 104 reaches the desired spatial arrangement of the patient 103 with respect to the body (or a particular portion thereof), the reading and verification module 212 will, in particular, refer to FIG. 14 for more detailed medical description of the patient 103. When collecting data, the diagnostic device 104 can be configured to verify that it is located in the desired spatial arrangement with respect to the body (or particular portion thereof) of the patient 103. The reading and verification module 212 further prepares the diagnostic sensor module 202 to collect medical data of the patient 103 and collects such medical data, as will be described in more detail with reference to FIG. 14, among others. It can be configured to indicate that. After collection of the patient's medical data, the read and validate module 212 will use predefined criteria (eg, required read length, read data) for the collected data, as will be described in more detail, especially with reference to FIG. It can be configured to verify that it meets (threshold, etc.). If the data collected does not meet the predefined criteria, the diagnostic device 104 will, in some cases, bring the diagnostic device 104 to the desired spatial arrangement with respect to the body (or particular part thereof) of the patient 103. It can be configured to instruct the user 102 to perform the necessary repositioning and reorientation. After repositioning and reorientation of the diagnostic device 104, the read and verify logic module 212 is configured to retry the collection of medical data for patient 103, especially as described in more detail with reference to FIG. Can be done.

The diagnostic device 104 can also be configured to use a diagnostic sensor module 202 that can be configured to collect medical data for the patient 103. The diagnostic sensor module 202 can be responsible for the activation of various sensors used to collect various medical data for patient 103. The medical data of such patient 103 can be used, for example, for diagnosis by a trained person 124. The diagnostic sensor module 202 is further described below with reference to FIG. 3, among other things.

In some cases, the diagnostic device 104 may further include a calibration logic module 214. The calibration logic module 214 can be configured to collect reference data relating to the medical examination of patient 103, among other things, as will be described in more detail with reference to FIG. 7, for example. In some cases, reference data is collected by the diagnostic device 104 during the initial calibration performed by the trained person 124. For example, a doctor can perform a medical examination of patient 103, and the diagnostic device 104 is performed by a trained person 124 containing, for example, collected medical data, eg, as described in more detail with reference to FIG. It is possible to record the medical examinations that are carried out. Recorded data, including collected medical data, may store, for example, health care plan repository 210, patient and health care plan repository 136, trained person data repository 123, or data relating to patient 103 on it. Can be stored in one or more of any other location operatively connected to the diagnostic device 104.

It should be noted that the diagnostic device 104 can further include a data repository 216. The data repository 216 contains various data, including data relating to one or more patients and various medical data thereof (eg, data collected during a patient's medical examination), as will be described in more detail below. Can be configured to store.

In some cases, the diagnostic device may further comprise a health care plan repository 210. The health care plan repository 210 can be configured to store a variety of data, including, among other things, data related to patient-specific health care plans, as will be described in more detail below.

FIG. 3 is a block diagram schematically illustrating an example of a diagnostic sensor configured to collect medical data relating to the subject matter of the present disclosure. The diagnostic sensor module 202 may include, among other things, an image-based sensor 310, an audio-based sensor 320, and other sensors not shown in the drawings. The diagnostic sensor 202 is designed for reading specific organs (eg, reading an ear image (eg, otoscope)) and reading common organs (eg, reading external skin, reading eyes, etc.). can do. The diagnostic sensor 202 can be modular, eg, some sensor that can be attached / detached to / from the diagnostic device 104 according to the required medical examination.

The image-based sensor 310 may include one or more light sources 318. The light source 318 can be a light emitting diode or any other light source known in the art. The light source 318 is used, for example, to illuminate the area where the image will be collected in order to provide sufficient image quality (eg, quality that will allow image analysis by the trained person 124). be able to.

The image-based sensor 310 may further include an image inspection peripheral device 312. Imaging peripherals 312 can include, among other things, various components that allow secure access to various body parts such as the human ear, pharynx, and the like. These components can be made of, for example, plastic and can be attached to the diagnostic device 104. These components can have general physical structures that fit different body parts, for example, regardless of the fact that different people of different ages have different body parts (eg children are smaller than adults). Having ears, the imaging peripheral device 312 can be designed to fit virtually any ear structure, etc.). The imaging peripheral device 312 positions the diagnostic device 104 in a desired spatial arrangement with respect to the patient 103's body (or a particular portion thereof) so that the user 102 can collect image-based medical data. Can help.

The image-based sensor 310 may further include an image acquisition sensor 316. The image acquisition sensor 316 can be, among other things, a camera (eg, a still camera, a video camera, etc.), or any other device capable of collecting images. The image acquisition sensor 316 can be based on a standard sensor such as CMOS or CCD or any other applicable sensor known in the art. The image acquisition sensor 316 can be designed to accommodate image acquisition of multiple body parts or organs regardless of size or distance (eg, it is compatible with reading multiple body parts or organs). Can have the required resolution and / or size and / or photosensitivity). It should be noted that the image acquisition sensor 316 can be the same sensor as the navigation image acquisition sensor and vice versa.

The image-based sensor 310 may further include an inspection optical system 314. The inspection optical system 314 can be, for example, a camera lens. The inspection optics 314 can be designed to accommodate different wavelengths, depths of field, wide or narrow lens angles, etc., and thus for different types of image reading and different types of organ sizes and structures. Can be adapted. The inspection optical system 314 allows the image acquisition sensor 316 to collect image-based medical data having the required characteristics (eg, the inspection optical system 314 is required for analysis by a trained person 124 or the like. It should be possible to collect images over the entire area). In some cases, the data collected from the inspection optical system 314 and the image acquisition sensor 316 may be analyzed later and / or converted and / or aligned to fit the specific required organ region reading. Can (eg, in order to adapt to quality analysis by a trained person 124, certain necessary image areas can be crops of the entire image, or image analysis and / or image conversion known in the art. Alignment can be done using manipulation techniques and / or algorithms).

The voice-based sensor 320 may include one or more voice acquisition sensors 324. The voice acquisition sensor 324 can be, for example, a microphone, or any other device capable of collecting voice data. The voice acquisition sensor 324 can be adapted to multiple voice frequencies that can be adjusted to fit the recording of a particular organ sound (eg, because the heart sound frequency is different from the lung sound frequency). The voice acquisition sensor 324 can also include various capabilities to assist in the collection of good quality voice, such as noise canceling filters.

The voice-based sensor 320 may further include a voice inspection peripheral device 322. Audio test peripherals 322 can include, among other things, various components that allow easy adaptation, comfortable adjustment, and safe access to various body parts such as the human chest, abdomen, lungs, etc. .. These components can be made of, for example, plastic, rubber, etc. and can be attached to the diagnostic device 104. These components can have general physical structures that fit different body parts, for example, regardless of the fact that different people of different ages have different body parts (eg children are smaller than adults). Having a chest, the voice test peripheral device 322 can be designed to fit virtually any chest structure, etc.). The voice test peripheral device 322 helps the user 102 position the diagnostic device 104 in the desired spatial arrangement with respect to the body (or particular part thereof) of the patient 103 in a state that allows the collection of voice-based medical data. Can (eg, enable minimization of any external noise that can interfere with audio acquisition).

FIG. 4 is a block diagram schematically illustrating an example of a navigation module configured to calculate the spatial arrangement of a diagnostic device with respect to a patient's body (or a particular portion thereof) according to the subject matter of the present disclosure. The navigation module 204 can include a navigation logic module 400. The navigation logic module 400 determines the current spatial arrangement of the diagnostic device 104 with respect to the body of the patient 103 and the body of the patient 103 (or its body), as will be described in more detail with respect to FIGS. It can be configured to calculate the route to the desired diagnostic device 104 spatial arrangement for a particular part). For that purpose, the navigation logic module 400 uses a navigation sensor such as an Inertial Navigation System (INS) sensor 410 (eg, IMU-Inertial Measurement Unit) and / or a navigation camera 420. These navigation sensors can be configured to collect data that enables navigation. The INS sensor 410 collects data related to the orientation of the diagnostic device 104 and a mobile sensor 412 (eg, an accelerometer sensor) that can collect data that enables navigation related to the movement of the diagnostic device 104. It can include an orientation sensor 414 (eg, a gyroscope sensor) that can. The navigation logic module 400 can use the raw INS sensor data to calculate the exact movement and orientation of the device with respect to the body of the patient 103, and also using techniques and algorithms known in the art of the sensor. Includes the logic needed to eliminate calibration errors. Therefore, in some cases, navigation can be based solely on INS data. Navigation based solely on INS data does not substantially require the movement of patient 103 during a medical examination, as such movements can result in deviations that would prevent accurate collection of medical data. It should be noted that.

The navigation module 204 may further include a navigation camera 420. The navigation camera 420 may include a navigation image acquisition sensor 422 configured to collect images of the body of the patient 103, and may further include an optical system 424. The optical system 424 can be, for example, a camera lens. The optical system 424 can have various wavelengths, depth of field, wide or narrow lens angles, and the like. The optical system 424 allows the navigation camera 420 to collect image data that enables navigation with the characteristics necessary to enable navigation of the diagnostic device 104. The navigation camera 420 collects relevant body and / or organ images available in the navigation logic module 400 to identify the current spatial arrangement of the diagnostic device 104 with respect to the body (or particular portion thereof) of the patient 103. Can be used for. This calculation can be done, for example, by comparing the images collected from the navigation camera 420 (eg, in real time or near real time) with a set of reference images that can be stored, for example, on the health care plan repository 210. When a particular image element is found in one of the reference images (especially as further described with respect to FIG. 9), the navigation logic module 400 is used to analyze the relative position of the diagnostic device 104 from there. It can be configured to perform image matching (eg, by using known techniques), eg, the required route to the desired diagnostic device 104 spatial arrangement as described in more detail with reference to FIGS. 9 and 10. The match is used to define the current diagnostic device 104 spatial arrangement as a temporary "starting point" that will be used as a synchronization point for calculating. The diagnostic device 104 uses images collected by the navigation camera 420 continuously or periodically (eg, at predetermined time intervals) with reference images (eg, reference images stored on the health care plan repository 210). It can be configured to be compared, and when a match is found, the diagnostic device 104 compares the image collected by the navigation camera 420 with the stored reference image to allow the body (or particular portion thereof) of the patient 103. It should be noted that in some cases the navigation can be based solely on the image data that enables the navigation, as it can be configured to calculate the spatial placement of the current device with respect to). .. This calculation can be performed, for example, by using an image and image pattern comparison and conversion technique known in the art. Based on the calculation of the spatial arrangement of the diagnostic device 104 with respect to the body of the patient 103 (or a specific portion thereof), the diagnostic device 104 is the body of the patient 103, as will be described in more detail with reference to, for example, FIGS. 9 and 10. It can be configured to calculate the required route to the desired diagnostic device 104 spatial arrangement for (or a particular portion thereof). When the diagnostic device 104 identifies that the diagnostic device 104 has reached the desired spatial arrangement for the patient 103's body (or a particular portion thereof), the diagnostic device 104 is prevented from moving until the required images have been collected. Can be warned.

The navigation module 204 may further include one or more navigation light sources 426. The navigation light source 426 can be a light emitting diode or any other light source known in the art.

The navigation module 204 may further include a distance sensor 430. The distance sensor 430 is, for example, a laser distance sensor known in the art, or any other sensor capable of determining the distance of the diagnostic device 104 from an object (eg, the body of patient 103 or a particular part thereof). be able to. The navigation logic module 400 can use the data received from the distance sensor 430 to calculate the spatial arrangement of the diagnostic device with respect to the body (or a particular part thereof) of the patient 103.

The navigation module 204 may further include a pressure sensor 440. In the art, the pressure sensor 430 can determine the amount of pressure exerted on the diagnostic device 104 when the diagnostic device 104 is pressed against an object (eg, the body of the patient 103 or a particular portion thereof). It can be a known pressure sensor. The navigation logic module 400 can use the data received from the pressure sensor 440 to calculate the spatial arrangement of the diagnostic device with respect to the body (or a particular part thereof) of the patient 103.

It should be noted that any data collected by the various components of the navigation module 204 can be considered as data that enables navigation.

FIG. 5 is a block diagram schematically illustrating an example of a guide module configured to guide a user of a diagnostic device according to the subject of the present disclosure. The guide module 206 can include a guide logic module 500. As described above, the guide logic module 500 directs the user 102 how to operate the diagnostic device 104 into the desired diagnostic device 104 spatial arrangement for the patient 103's body (or a particular portion thereof). It can be configured to provide data. Such guidance data can include, among other things, voice commands, image displays, vibrations of the diagnostic device 104, and the like. Such guidance data can be presented continuously or periodically to the user 102 until the diagnostic device 104 reaches the desired diagnostic device 104 spatial arrangement for the patient 103's body (or a particular portion thereof). Such guidance data can be calculated according to each calculation of the route to the desired diagnostic device 104 spatial arrangement for the body (or particular part thereof) of the patient 103 as calculated by the navigation module 204.

For that purpose, the guide module 206 may include one or more output sources such as, for example, a display 502, a speaker 510, a vibrating element 508, a guide light source 506, a keypad 504, and the like. The display 502 is to present visual data that provides the user 102 with information about how to operate the diagnostic device 104 into the desired diagnostic device 104 spatial arrangement for the patient 103's body (or a particular portion thereof). Can be configured. Such information may in some cases be the current spatial arrangement of the diagnostic device 104 for the patient 103's body (or specific part thereof) and the desired diagnostic device 104 space for the patient 103's body (or specific part thereof). It can include a visual representation of the placement.

Returning to FIG. 13, a schematic representation of an exemplary presentation of navigation instructions to the user of the diagnostic device according to the subject matter of the present disclosure is shown. Objects 950A, 950B, 950C representing the current spatial arrangement of the diagnostic device 104 with respect to the body (or specific parts thereof) of patient 103, and the desired spatial arrangement of diagnostic device 104 with respect to the body (or specific parts thereof) of patient 103. It can be noted that it can be presented on the display 502 along with the target mark 952 to be represented. The three-dimensional smiley objects 950A, 950B, 950C representations on the display 502 are updated continuously or periodically to reflect changes to the spatial arrangement of the diagnostic device 104 for the body (or particular part thereof) of the patient 103. It can be noted that the object 950A is initially positioned relatively far from the target mark 952 (which can be seen to be located in the upper right corner of the target mark 952). In addition, the diagnostic device is not oriented as needed (it can be seen that it does not face directly in front). The user 102 rearranges and reorients the diagnostic device 104 according to the feedback presented on the display 502. Repositioning can be performed by moving the diagnostic device 104 forward / backward, up / down, left / right. The reorientation can be done by rolling, pitching and yawing the diagnostic device 104. Such repositioning and reorientation of the diagnostic device 104 is reflected, for example, continuously or periodically on the display 502. After repositioning and reorientation of object 950A, the diagnostic device 104 approaches the desired spatial arrangement of patient 103 with respect to the body (or a particular portion thereof) at object 950B, as is understood, closer to target mark 952. Can be understood. After further repositioning and reorientation of the object 950B, the diagnostic device 104 will, as will be understood, the desired space for the body (or particular part thereof) of the patient 103 at the object 950C, which is closer to the target mark 952 than the object 950B. Get closer to the placement. Finally, after further repositioning and reorientation of the object 950C, the diagnostic device 104 is at the target mark 952, i.e. the desired spatial arrangement with respect to the body (or particular part thereof) of the patient 103. Object 950 can include visual representations and hints about the navigation process, such representations exemplifying, for example, the proximity of the diagnostic device 104 to the desired spatial arrangement of the patient 103 with respect to the body (or a particular part thereof). Color changes (eg, red for bad, green for good) and / or face marks (eg, object 950 is a sad face smiley mark at first, and a sad face smiley mark as it approaches target mark 952. It can be noted that it can include (becomes a smiley face).

Returning to FIG. 5, the speaker 510 gives the user 102 a voice instruction indicating the necessary movement that the user 102 should make in order to bring the diagnostic device into the desired spatial arrangement with respect to the body (or a particular part thereof) of the patient 103. Can be provided. In addition, the speaker 510 can provide voice feedback regarding the proximity of the diagnostic device 104 to the desired spatial arrangement of the patient 103's body (or particular portion thereof) (eg, voice feedback is the desired space). A series of short beeps and changes in their speed according to the proximity of the diagnostic device 104 to the placement).

The vibration element 508 can provide vibration feedback, for example, to indicate to the user 102 that the movement he is making is incorrect (eg, the diagnostic device 104 should be moved to the right and the user 102 should. If you move it to the left, you can start the vibration). It is also possible to provide a vibration indicating that the diagnostic device has reached the desired spatial arrangement for the patient 103's body (or a particular portion thereof). In some cases, these vibrations will be different from the vibrations that indicate the wrong movement.

The guide light source 506 can provide the user 102 with optical feedback regarding the required movement of the diagnostic device 104 and / or the proximity of the diagnostic device 104 to the desired spatial arrangement of the patient 103 with respect to the body (or a particular portion thereof). .. For example, a combination of LED elements (eg, a matrix of LED elements located on the diagnostic device 104) can provide optical feedback to the user 102 with respect to the required direction of travel (eg, right, left, up, down, etc.). .. In such cases, the guide light source 506 calculates and calculates the correct light source (eg, a particular LED) associated with the current movement based on the current diagnostic device 104 spatial arrangement for the patient 103's body (or a particular part thereof). It can be configured to use a mobile sensor 612 and an orientation sensor 614 for use (eg, the same LED may sometimes point up and sometimes down according to device orientation). In addition, the LED element can also provide proximity feedback with light that turns on and off at a particular speed.

The keypad 504, or in some cases, the guide process using the guide logic module 500, may also require feedback from the user 102, such as confirmation of the end of a particular medical examination. For that purpose, the guide module 206 may include one or more input sources, such as the keypad 504.

FIG. 6 is a flow chart illustrating an example of a series of actions performed to perform automatic and self-guided medical examinations according to the subject matter of the present disclosure. First, a check is made to see if the initiated medical examination is the first medical examination of the patient 103 on the diagnostic device 104. If the answer is yes, a personalized organ / physical calibration is performed, as described in more detail with respect to FIG. 7 (step 600). If the response is no, or after performing a personalized organ / physical calibration 600, a medical examination is initiated (step 602). During initiation, the diagnostic device 104 (eg, by using the test logic module 208) can receive instructions for the patient 103 to be checked. Such instructions can be received, for example, as input from user 102 or by using an automated patient identification method, as detailed with respect to FIG. The diagnostic device 104 can also be configured to retrieve various data related to the patient 103. Such data is operatively connected to a data repository 216, a health care plan repository 210, a trained person data repository 123, a patient and health care plan repository 136, or a diagnostic device 104 on which patient data is stored. You can search from one or more of any other location where it is done. Such data can include, among other things, data related to patient-specific health care plans, reading references, communication parameters, and the like.

The diagnostic device 104 can be further configured to display a questionnaire (step 604) to which the user 102 and / or the patient 103 will respond, for example by using the test logic module 208. The questionnaire can be displayed, for example, on the patient's workstation 114 or played as a voice-based questionnaire. Questionnaires are the data needed to enable analysis of the medical data collected during a medical examination (eg, "whether the patient has a fever, when?", "How expensive?", "Patients." Designed to provide trained person 124 with a variety of data (eg, data related to the medical condition of patient 103), including "is it in pain?", "Where is the pain?", Etc. It can include general questions asked and / or questions specific to patient 103. User 102 or patient 103 can answer an electronic questionnaire that can be displayed, for example, using a diagnostic device 104 or using voice recording with the patient's workstation 114, or, for example, on the patient's workstation 114. You can respond to the questionnaire. It should be noted that other methods can be used to provide responses to the questionnaire.

The diagnostic device 104 can also be configured to select and initiate a medical examination, for example by using the examination logic module 208 (step 606). For that purpose, the diagnostic device 104 can allow the user 102 to select the medical examination to be performed manually or from the list of medical examinations to be performed as defined in the patient 103 medical examination plan. Alternatively, the diagnostic device 104 can select and initiate a medical examination according to a predefined order set by a patient 103 specific medical examination plan without input from the user 102. The initiation of a medical examination can consist, for example, by retrieving reference medical examination data from a medical examination plan or related repository (similar to the medical examination initiation step 602).

After selection of a medical examination, the diagnostic device 104 can be configured to perform device orientation, for example by using the navigation module 204 (step 608). For example, the diagnostic device 104 can instruct the user 102 to move it to a position and orientation in the vicinity of a known reference point (eg, patient 103's nose, ears, eyes, etc.). While positioning the diagnostic device in the vicinity of these known reference points, the diagnostic device 104 can instruct the navigation camera to continuously or periodically collect images of the patient's body. The diagnostic device 104 is trained with the collected images as known reference images of the patient 103 (eg, health care plan repository 210, data repository 216, patient and health care plan repository 136, as further detailed with respect to FIG. 4 in particular. Consecutive with the person's data repository 123, or stored in one or more of any other location operatively connected to the diagnostic device 104, where patient data is stored, eg, reference image). Can be compared. When a match is found, the diagnostic device 104 can be configured to notify the user 102 of the match and determine its spatial arrangement with respect to the body (or a particular portion thereof) of the patient 103.

After the orientation of the diagnostic device 104 with respect to the body (or particular part thereof) of the patient 103, the diagnostic device 104 will allow the diagnostic device 104 to collect medical data, for example by using the navigation module 204. It can be configured to navigate and guide (step 610) the diagnostic device 104 to the desired spatial arrangement for the body (or particular part thereof) of 103. The diagnostic device 104 can be configured to calculate the route to the desired spatial arrangement for the patient 103's body (or a particular portion thereof). The desired spatial arrangement of such patient 103 for the body (or a particular part thereof) is, for example, by a patient-specific health care plan (eg, according to a personalized organ / physical calibration performed for patient 103). Can be defined. The route calculation is performed, for example, continuously or periodically until the desired diagnostic device 104 spatial arrangement for the patient 103's body (or a particular part thereof) is reached. It should be noted that the navigation and route calculation process is further described below, especially with respect to FIGS. 11 and 12. In parallel, until the diagnostic device 104 reaches the desired spatial arrangement for the patient 103's body (or a particular portion thereof), the diagnostic device 104 diagnoses according to the navigation calculation described above, for example by using the guide module 206. It is possible to provide various guidance data instructing the user 102 how to operate the device 104 on the desired diagnostic device 104 spatial arrangement for the body (or a specific part thereof) of the patient 103. As described above, such guidance data can be transmitted to the user 102 using various output means such as image display, voice command, vibration of diagnostic device 104, and the like. Throughout the navigation and guidance of the diagnostic device 104, the diagnostic device 104 may be configured to check if the navigation quality is sufficient and if the diagnostic device 104 needs to be reoriented. can. Such checks can be performed, for example, by searching for additional reference images at pre-defined locations along the way, while the images collected by the navigation camera 420 are expected reference images (eg, patient 103 health). If it does not match (as defined by the diagnostic plan), there is a need to reorient the navigation device 104. In addition, for example, the navigation module logic 400 also has a spatial arrangement of the diagnostic device 104 with respect to the body (or a specific part thereof) of the patient 103 and a desired spatial arrangement of the target with respect to the body (or a specific part thereof) of the patient 103. Navigation quality can be calculated by calculating the distance between and checking for the presence of route convergence (ie, distance is decreasing) or route divergence (distance is increasing). can.

It should be noted that in some cases the navigation of the diagnostic device 104 can be performed without any patient-specific reference data, but with only general reference data. In such cases, the diagnostic device 104 collects the patient's medical data continuously or periodically, and the collected medical data is a criterion indicating that the collected data is the requested data. It can be configured to monitor to see if it meets the requirements. For example, the diagnostic device 104 can use a predefined general image of a typical organ, such as the eardrum (not patient-specific), as a reference. In this case, for example, the diagnostic device 104 can be configured to continuously analyze the collected patient inner ear images and attempt to match the readings with a general reference image. The matching criteria can be, for example, an organ-specific image feature, such as the circular structure of the eardrum, and its image contrast compared to the surrounding image. Another example of a general organ reading reference could be the general sound wave of the human heart, in which case, for example, the matching criteria would be a sound wave specific structure such as pace, amplitude, volume, etc. And can be a special feature.

In yet another case, navigation of the diagnostic device 104 can be performed using only INS readings using, for example, a mobile sensor 412 and an orientation sensor 414. In such cases, the diagnostic device 104 can be initiated, for example, by touching the two papillae of patient 103 and the three identifiable body points such as the navel of patient 103. Using a triangulation calculation method known in the art, the diagnostic device 104 can then use only the mobile sensor 412 and the orientation sensor 414 to navigate to various body points.

When the diagnostic device 104 reaches the desired spatial arrangement for the body (or a particular part thereof) of the patient 103, the diagnostic device 104 is to perform read and read verification, eg, by using a read and verify logic module 212. It can be configured (step 612). The diagnostic device 104 can be configured to verify that it is located in the desired spatial arrangement with respect to the body (or a particular part thereof) of the patient 103 when collecting medical data of the patient 103. The diagnostic device 104 can also be configured to prepare for and collect medical data for patient 103. After collecting the patient's medical data, the diagnostic device 104 will use predefined criteria (eg, required read length, recorded volume) for the collected data, as will be described in more detail, especially with reference to FIG. , Read parameters, thresholds, etc.) can be configured to be verified. If the data collected does not meet the predefined criteria, the diagnostic device 104 will, in some cases, bring the diagnostic device 104 to the desired spatial arrangement with respect to the body (or particular part thereof) of the patient 103. It can be configured to instruct the user 102 to perform the necessary repositioning and reorientation. After repositioning and reorientation of the diagnostic device 104, the read and verify logic module 212 is configured to retry the collection of medical data for patient 103, especially as described in more detail with reference to FIG. Can be done.

After collecting and validating the readings of the medical data of patient 103, the diagnostic device 104 checks whether the medical examination has been completed (eg, all medical examinations defined by the medical examination plan of patient 103). Can be configured to. If the medical examination has not been completed, the diagnostic device 104 can be configured to move on to the next medical examination indicated by the patient 103 medical examination plan. If all necessary medical examinations have been performed, the diagnostic device 104 can be configured to complete the medical examination (step 614). At the end of the medical examination 614, as well as at any other step in the process described, the diagnostic device 104 can be configured to perform any action necessary to collect medical data for the patient 103. These actions include, for example, updating the repository status, embedding patient or health care data in read data, encrypting the data, compressing the data, and training the collected data in different locations (eg, trained). It may include transmission to a person's workstation 122 and / or central system 130).

FIG. 7 is a flow chart illustrating an example of a series of actions performed to perform a personalized calibration of a diagnostic device according to the subject matter of the present disclosure. The diagnostic device 104 can be configured to initiate a calibration check, for example by using the calibration logic module 214 (step 702). The first calibration can be performed by a trained person 124. During calibration, the trained person 124 activates the diagnostic device 104 on behalf of the user 102. This may require the arrival of the patient 103 at the location 120 of the trained person for calibration of the diagnostic device or the arrival of the trained person 124 at the location 100 of the patient. It should be noted that the diagnostic device 104 can be configured to allow the user 102 to perform the calibration process with remote guidance and assistance of the trained person 124.

After the initiation of calibration, the trained person 124 can select a particular medical examination (eg, a medical examination required for a particular patient 103 and initiate the calibration mode of the diagnostic device 104 (step 704)). Optionally, a particular medical examination is selected from a list of medical examinations (eg, which can be displayed on the diagnostic device 104 or on the workstation 122 of the trained person). After initiation of calibration mode. The diagnostic device 104 can be configured to guide the trained person 124 during calibration (step 706). Such guidance for the trained person 124 is performed according to the selected medical examination and calibration method.

The diagnostic device 104 further records reference data (according to the calibration method as detailed below) during a medical examination by a trained person 124 and optionally trains the recorded data, for example. It can be configured to be presented on the person's workstation 122 (step 708). The recorded reference data is, for example, a medical examination plan repository 210, a data repository 216, a patient and medical examination plan repository 136, a trained person's data repository 123, or a diagnostic device 104 on which patient data is stored. It can be stored in one or more of any other location operatively connected to.

Returning to FIG. 8a, a flow chart illustrating an example of a series of actions performed to record reference data during personalized calibration of diagnostic devices using imaging and orientation sensors according to the subject matter of the present disclosure is shown. .. According to this calibration method, the diagnostic device 104 includes various data including a body image of the patient 103 using the navigation camera 420 and INS data of the diagnostic device 104 using the INS sensor 410 (six-axis movement using an accelerometer and a gyroscope). A trained person 124 performs a medical examination in a state of recording (step 740). In some cases, the diagnostic device 104 can also be configured to use the distance sensor 430 to record data related to the distance of the diagnostic sensor from the body of the patient 103. In some cases, the diagnostic device 104 can also be configured to use the pressure sensor 440 to record data related to the pressure exerted on the diagnostic device in contact with the body of the patient 103. After positioning and orienting the diagnostic device 104 (as determined by the trained person 124) in the desired spatial arrangement with respect to the body (or particular part thereof) of the patient 103, the trained person collects medical data. On the other hand, the diagnostic device 104 can be configured to record medical data collected by the image-based sensor 310 and / or the voice-based sensor 320. All recorded data is operational to the diagnostic device 104, which can store patient data in the Health Plan Repository 210, Data Repository 216, Patient and Health Plan Repository 136, Medical Examination Repository 134, or on it. It can be stored in one or more of any other location connected to.

Returning to FIG. 8b, a flowchart illustrating an example of a series of actions performed to record reference data during personalized calibration of an INS sensor and body point diagnostic device according to the subject matter of the present disclosure is shown. .. Further, according to this calibration method, the diagnostic device 104 includes a body image of the patient 103 using the navigation camera 420 and INS data of the diagnostic device 104 using the INS sensor 410 (six-axis movement using an accelerometer and a gyroscope). A trained person 124 performs a medical examination while recording the data of. The diagnostic device 104 presents data indicating a reference point to be reached and the next reference to be reached from the first reference point to the trained person 124 (eg, on the trained person's workstation 122). (Step 750). The trained person 124 moves the diagnostic device 104 to the first reference point he should reach, touches the reference point with the diagnostic device 104, and from there to the next reference point he should reach and touch as well. It is possible to be instructed to move. During the movement of the diagnostic device 104 to and between reference points, the diagnostic device uses a body image of the patient 103 using the navigation camera 420 and a diagnostic using the INS sensor 410 (six-axis movement using an accelerometer and gyroscope). Record the data including the INS data of the device 104 (step 752). In some cases, the diagnostic device 104 can also be configured to use the distance sensor 430 to record data related to the distance of the diagnostic sensor from the body of the patient 103. In some cases, the diagnostic device 104 can also be configured to use the pressure sensor 440 to record data related to the pressure exerted on the diagnostic device in contact with the body of the patient 103. When the diagnostic device reaches the reference point, as described above, the diagnostic device therefore touches a point indicating that its current location is the location of the reference point (step 754). In some cases, the trained person 124 can also be found to have reached the desired reference point by using the device keypad 504 or any other verification method. The process repeats until enough reference points are selected. It should be noted that in some cases the three reference points are sufficient as they form the basis of the use of known triangulation techniques that can be used to navigate the diagnostic device 104. .. After collecting the reference point data, the diagnostic device 104 can be configured to alert the trained person 124 that the collection of medical data can be initiated (step 756). The trained person 124 then collects medical data from the diagnostic device, with the diagnostic device continuing to record reference data, including, among other things, the body image of patient 103 and the INS data of the diagnostic device 104. The diagnostic device 104 can be moved to the desired spatial arrangement with respect to the body (or particular part thereof) of the patient 103 capable (step 758). After collecting all reference data, including reference points, the diagnostic device 104 can be configured to calculate the relative spatial arrangement of the diagnostic device 104 with respect to the collected reference points (step 759).

Returning to FIG. 8c, a flowchart illustrating an example of a series of actions performed to record reference data during personalized calibration of a diagnostic device using reference points and pointing objects according to the subject matter of the present disclosure is shown. Is done. According to this calibration method, a trained person 124 performs a medical examination with the diagnostic device 104 recording various data including body images of the patient 103 using the navigation camera 420. The diagnostic device 104 directs the trained person 124 to point the diagnostic device 104 towards the relevant body part (eg, chest, back, head, etc.) and collects images by using, for example, a navigation camera 420. (Step 770).

After image collection, the diagnostic device 104 can be configured to attempt to extract reference points from the collected images. To this end, the diagnostic device is configured to use pre-stored data related to the expected points within the area of the collected image in order to attempt and find matching it within the collected image. (For example, if the collected image is of the patient 103's head, the expected reference points can be eyes, nose, mouth, eyebrows, etc., and the collected image is of the patient's chest. If so, the expected reference point can be a papilla, navel, etc.) (step 772). For example, if breast images are collected, the diagnostic device 104 can be configured to look for the nipple in the collected images (eg, the diagnostic device 104 is pre-stored to indicate that the appearance of the nipple is round. The data can be used and its size can have a range, which is uniformly darker than its surrounding area). The diagnostic device 104 can be configured to instruct the trained person 124 to recognize the calculated reference point.

If the diagnostic device 104 fails to find a match with the expected reference point in the collected image, the diagnostic device 104 may optionally be configured to notify the trained person 124 of the failure. can. The diagnostic device 104 is further configured to allow the trained person 124 to manually mark a reference point on a collected image that can optionally be displayed on the workstation 122 of the trained person for that purpose. Can be done (step 773). Marking of such reference points can be made, for example, by using an indicator presented on the trained person's workstation 122, where the aforementioned indicator is, for example, a computer mouse or any other suitable input. It can be moved by a device (eg keypad, trackpad, etc.). Alternatively or additionally, the diagnostic device 104 can be configured to allow such marking by the trained person 124, for example by touching the reference point with his finger, in such cases. The diagnostic device 104 can be configured to identify the trained person 124's finger in the image collected by the navigation camera 420.

After marking the reference point, the diagnostic device 104 is configured to instruct the trained person 124 to mark the desired location of the diagnostic device 104 for the collection of medical data on the collected images. Can be done (step 774). In some cases, the diagnostic device 104 can be further configured to mark the next desired location of the diagnostic device 104 for the collection of medical data on the collected images (step 775), the process. Repeat until all desired locations on the diagnostic device 104 are marked on the collected images for the collection of medical data.

In some cases, each of the calibration methods detailed above can be performed virtually instead of an actual physical meeting between the trained person 124 and the patient 103, and the trained person 124 It should be noted that, for example, it is possible to have a virtual meeting that can guide the user 102 on how to calibrate. In such cases, the user 102 can activate the diagnostic device through calibration according to the instructions of the trained person 124. For such virtual meetings, known methods and techniques such as video conferences can be used.

Returning to FIG. 7, after reaching the desired diagnostic device 104 spatial arrangement for the body (or particular part thereof) of the patient 103 while recording reference data, the diagnostic device 104 is further described by the trained person 124. It can be configured to allow the collection of medical data (step 710). The diagnostic device 104 can also be configured to store the collected medical data as reference data (step 712) (as described above, the recorded reference data can be, for example, the health care plan repository 210, data. One of repository 216, patient and health plan repository 136, trained person data repository 123, or any other location operatively connected to the diagnostic device 104 on which patient data is stored. Or it can be stored in multiple).

The diagnostic device 104 can also be configured to repeat the process until calibration is complete (eg, as directed by the trained person 124).

The diagnostic device 104 was further trained in the entire testing process (eg, a series of medical tests performed by a trained person 124), eg, a health care plan repository 210, a data repository 216, a patient and a health care plan repository 136. It can be configured to store in one or more of the person's data repository 123, or any other location operatively connected to the diagnostic device 104 on which patient data is stored (step). 730).

It should be noted that in some cases it is not necessary to perform any calibration of the diagnostic device 104. In such cases, the diagnostic device 104 uses only general reference data and a general health plan or modified individual without using any personal reference data that requires a calibration process to the diagnostic device 104. It can be configured to have a medical examination plan. In such cases, when performing certain health examinations (eg, pharyngeal health, ear health, etc.), the diagnostic device 104 may refer to known reference points (eg, patient 103's nose, ears, eyes, etc.). It is further noted that the user 102 can be instructed to move to a spatial arrangement with respect to the body (or a particular part thereof) of the patient 103 in the vicinity of. During positioning, the diagnostic device 104 may instruct a sensor 310 based on the relevant image (such as a related organ camera sensor such as an ear reading sensor) to continuously or periodically collect the organ image. can. The diagnostic device 104 may continuously or periodically compare the collected images with known general reference images of the organs that need to be read (eg, reference images such as "tympanic membrane", pharyngeal tonsils, etc.). can. The reference image is activated in, for example, a diagnostic plan repository 210, a data repository 216, a patient and health plan repository 136, a trained person's data repository 123, or a diagnostic device 104 in which patient data is stored. Can be saved anywhere else connected to. The user 102 then identifies the diagnostic device 104 until the diagnostic device 104 identifies at least one matching reference point, the reference point can also be a reference pattern, as will be described in more detail with respect to FIGS. 9 and 10. The 104 can be moved towards the spatial arrangement of the patient 103 with respect to the body (or its specific part) that is close to the desired spatial arrangement of the patient 103 with respect to the body (or its specific part). When the diagnostic device 104 reaches the desired spatial arrangement for the patient 103's body (or a particular part thereof), it generates an alert to user 102, as defined in the health care plan and the data collection and validation described above. It can be performed.

FIG. 9 is a schematic diagram of reference points and patterns based on exemplary images relating to the subject matter of the present disclosure. It can be noted that each patient organ can be associated with one or more reference points. The reference point can also be in some cases a pattern, such as a linear shape formed by the patient's organ structure. For example, a patient's nose 900 can have multiple reference points, including 910A-910C associated with it. Such reference points can be located, for example, at the edges of the nose (eg 910A and 910C), in the center of the nose (eg 910B), or anywhere else associated with the patient's nose (not shown). The patient's ear 905 can have multiple reference points, including 920A-920D associated with it. These reference points are located, for example, at the edges of the ear (eg, 920A-920B), the curves formed by the ear structures (eg, 920B and 920D), or anywhere else associated with the patient's ear (not shown). can do. The reference point can also be a pattern, such as a linear shape formed by the patient's organ structure. These types of reference points are illustrated in the figure with reference numerals 915, 925A, 925B, and 925C. These types of reference points reflect the relevant organ structure of a particular patient, and by its use, in particular the determination of the spatial placement of the diagnostic device 104 relative to the body (or particular part thereof) of the patient 103 and the patient 103. It can be seen that the diagnostic device 104 can be navigated to the desired spatial arrangement for the body (or a particular part thereof).

FIG. 10 is a schematic diagram of an exemplary image-based reference point and INS-based reference point relating to the subject matter of the present disclosure. It can be noted that reference points 764A-764C can be used, for example, to enable navigation based on triangulation using the INS sensor 410. As described above (especially with reference to FIG. 8b), the diagnostic device 104 is configured to collect reference data for three reference points (eg, left teat 764C, right teat 764B, and navel 764A). Can be done. The diagnostic device 104 further provides reference data and an INS sensor to determine the location of the desired spatial arrangement (eg, position and orientation 762A, 762B, etc.) of the diagnostic device 104 with respect to the body (or particular portion thereof) of the patient 103. It can be configured to use 410 data. The diagnostic device 104 also allows image-based calculations and user guidance to the desired spatial arrangement (eg, 762A, 762B) for the body (or particular part thereof) of the patient 103 (eg, to collect medical data). It should be noted that reference points 764A-764C can be used to achieve this.

FIG. 11 is a flow chart illustrating an example of a series of actions performed for the calculation of the spatial arrangement of the diagnostic device with respect to the body (or particular portion thereof) of the patient 103 according to the subject matter of the present disclosure. The diagnostic device 104 is configured to instruct the user 102 to move the diagnostic device 104 close to a known reference point associated with a particular selected medical examination, for example by using the navigation module 204. Can be done (step 802). For example, if the selected medical examination is an ear medical examination, the diagnostic device 104 can be configured to instruct the user 102 to move the diagnostic device 104 closer to the ear of the patient 103.

After positioning the diagnostic device 104 in the vicinity of a known reference point associated with a particular selected medical examination, the diagnostic device 104 includes an INS sensor 410, a navigation camera 420, a navigation light source 426, a pressure sensor 440, a distance sensor 430. It can be configured to activate one or more navigation sensors such as (step 804).

The diagnostic device 104 can be configured to use data received from one or more navigation sensors to initiate a search for known reference points, and accordingly the body (or particular part thereof) of patient 103. The current spatial arrangement of the diagnostic device 104 can be calculated for the desired position and orientation with respect to (step 806). The current spatial arrangement of the diagnostic device 104 with respect to the body (or particular part thereof) of patient 103 is one or more known reference points (health care plan repository 210) in the data received from one or more navigation sensors. , Data repository 216, patient and health care plan repository 136, trained person data repository 123, or any other location operatively connected to the diagnostic device 104 on which patient data is stored. It can be calculated by using the identification (stored in one or more). For example, when a medical examination of the pharynx is required, the diagnostic device activates one or more navigation sensors, such as the navigation camera 420, and the received data related to the pharynx of patient 103 is stored in the health plan repository. Of 210, data repository 216, patient and medical plan repository 136, trained person data repository 123, or any other location operatively connected to the diagnostic device 104 on which patient data is stored. Compare with related reference data (eg, patient's pharyngeal image, nasal image, etc.) stored in one or more of the. When a match is found, the diagnostic device 104 can calculate its relative spatial arrangement to the desired spatial arrangement. Such a calculated spatial arrangement is for performing a navigation process to enable the collection of medical data (eg, medical data relating to the pharynx of patient 103) using known methods and techniques. It can be used as a starting point. One non-exemplary method is to compare an image collected by a navigation sensor (eg, a navigation camera 420) with a known reference image. An approximate spatial arrangement can be calculated when a match is found. Images may appear at different positions, orientations, and scaling factors, such as Lowe, David G. et al. Published by (1999), "Object recognition from local scale-invariant features", doi: 10.1109 / ICCV. 1999.790410, or David Rowe's patent on the SIFT algorithm, "Method and apparatus for identifing scale invariant features in an image and image, the first and second patents in an image, an image, the first, the second, and the third." It can be seen that there are several algorithms that can be used to compensate for these differences, such as using scale-invariant feature transitions (SIFT algorithms).

After calculating the relative spatial arrangement of the diagnostic device 104 for the desired spatial arrangement, the diagnostic device 104 can be configured to initiate the navigation and guide process (step 818).

If a match is found and the diagnostic device 104 successfully calculates its current spatial arrangement for the desired spatial arrangement, the diagnostic device 104 notifies user 102 (step 812) of the current spatial arrangement for the navigation process. It can be configured to lock as a starting point for (step 814). If no match is found, eg after a predefined time (eg 15 seconds), the diagnostic device 104 checks for errors (eg, verifies that the navigation sensor is operational, reference data is available. It can be configured to notify the user 102 that the match has failed to be found (eg, verifying that it is possible) (step 808). If the diagnostic device 104 does not find any error associated with it, the diagnostic device 104 can be configured to return to step 806 and search for known reference points again. If the diagnostic device 104 finds an error associated with it, the diagnostic device 104 can be configured to notify the user 102 of the error, and if the error is being dealt with, the diagnostic device 104 will allow the user 102 to do so. It can be configured to return to step 806 and search for known reference points again (step 810).

FIG. 12 is a flow chart illustrating an example of a series of actions performed to navigate a diagnostic device according to the subject matter of the present disclosure and thus guide a user of the diagnostic device. The diagnostic device 104 from a known reference point found (eg, see FIG. 11) to the desired diagnostic device 104 spatial arrangement for the body (or particular portion thereof) of the patient 103, eg, by using the navigation module 204. It can be configured to calculate the route (step 901). The route calculation can be performed, for example, by using known methods and techniques. The route calculation is, for example, the current position (X1, Y1, Z1) of the diagnostic device 104 when identified by using reference data (see FIG. 11) and the target position of the diagnostic device 104 when defined by the reference data. It can be done by calculating the distance to (X2, Y2, Z2) and the required movement correction. The distance can be calculated using known techniques such as subtraction of values for each axis (eg, Xd = X1-X2, etc.). The result value for each axis can be defined as the required correction of the position of the diagnostic device 104. In addition, the system can calculate the rotation correction required for the orientation of the diagnostic device 104 using yaw, pitch, and roll rotation calculation techniques known in the art. After route calculation, the diagnostic device 104 manipulates how the diagnostic device 104 manipulates the diagnostic device 104 into the desired spatial arrangement of the diagnostic device 104 with respect to the body (or a particular part thereof) of the patient 103, for example by using the guide module 206. It can be configured to provide the guidance data instructed to 102 to the user 102 (step 916). For this purpose, the diagnostic device is to present to the user 102 the current spatial arrangement of the diagnostic device 104 with respect to the body (or particular portion thereof) of the patient 103, eg, as detailed above with respect to FIG. Can be configured in. The diagnostic device can also be configured to provide the user 102 with a voice instruction instructing the user 102 how to operate the diagnostic device 104. It should be noted that, as mentioned above, other instructional methods (eg, vibration of the diagnostic device 104, etc.) can be used as well.

The diagnostic device 104 can also be configured to continuously calculate its current spatial arrangement for the desired spatial arrangement (step 902). During continuous or periodic position and orientation calculations, the diagnostic device 104 continuously captures data from one or more navigation sensors such as the INS sensor 410, navigation camera 420, pressure sensor 440, distance sensor 430 and the like. (Step 906), eg, by comparison of data received from one or more navigation sensors by using known methods and techniques with reference data (eg, reference image, reference INS data, etc.), patient 103. Can be configured to continuously calculate its current spatial arrangement for a body (or a particular part thereof) (step 908). One non-limiting method is to use the data of the INS sensor 410 to calculate the trajectory of the diagnostic device 104 according to the gyro and accelerometer information. Mathematics is based on the solution of a six-DOF equation as described in various papers and books (eg, "Strapdown International Navigation Technology", D. Titterton and J. Weston, ISBN1563476932). To overcome the accumulation of errors, which can occur over time and affect accuracy, the spatial arrangement of the diagnostic device 104 with respect to the body (or particular part thereof) of patient 103 is further detailed above. It can be calculated according to the image comparison when it is done. Therefore, the spatial arrangement of the diagnostic device 104 for the body (or a particular part thereof) of the patient 103 is by using the data of the INS sensor 410 while using image comparison (eg, by matching with a reference point) to eliminate errors. It can be calculated constantly or periodically (by determining the speed and position of the diagnostic device). The data of the INS sensor 410 and the image comparison data can be merged, for example, by using Kalman filtering, which is an exemplary algorithm for information fusion.

If the current spatial arrangement of the diagnostic device 104 with respect to the body (or specific part thereof) of the patient 103 is the desired spatial arrangement of the diagnostic device 104 with respect to the body (or specific part thereof) of the patient 103, the diagnostic device is particularly illustrated. As further elaborated with respect to 14, it can be configured to collect medical data for patient 103. However, if the current spatial arrangement of the diagnostic device 104 for the patient 103's body (or its specific part) is not the desired diagnostic device 104 spatial arrangement for the patient 103's body (or its specific part), the diagnostic device 104 will , Can be configured to perform movement correction calculations (step 910). During the movement correction calculation, the diagnostic device 104 has its current spatial arrangement with respect to the body (or specific part thereof) of the patient 103 and the desired spatial arrangement with respect to the body (or specific part thereof) of the patient 103, and / or the calculation. It can be configured to calculate the delta between the route and the route. The movement correction calculation can be based on, for example, data received from one or more navigation sensors and the calculated route. In such cases, after the route has been calculated, the diagnostic device 104 shall be configured to check whether the actual travel made thereby does not match the expected travel calculated during the route calculation. Can be done. Alternatively, the movement correction calculation can be based on a recomparison of data received from one or more navigation sensors with their respective reference data.

The diagnostic device 104 can also be further configured to perform navigation quality calculations (step 912). The diagnostic device 104 can be configured to check various parameters indicating navigation quality such as convergence (checking that the distance from the desired spatial arrangement is getting smaller). If the navigation quality meets the requirements (eg, the distance to the desired spatial arrangement is getting smaller), the diagnostic device returns to step 916 to continue the navigation and guidance process. However, if the navigation quality does not meet the requirements, the diagnostic device 104 can be configured to return to step 608 and reorient the device.

FIG. 12a is a flow chart illustrating another example of a series of actions performed to navigate a diagnostic device according to the subject matter of the present disclosure and thus guide a user of the diagnostic device. Also in this example, the diagnostic device 104 is the desired diagnostic device for the body (or particular part thereof) of the patient 103 from a known reference point found (eg, see FIG. 11), eg, by using the navigation module 204. It can be configured to calculate the route to 104 spatial arrangements. However, in the current example, the user 102 first points to a location on the body of the patient 103 with a pointing object 935 (eg, the finger of the user 102), with the first location of the pointing object 935 as the starting point. The route is calculated using it. FIG. 12b provides a schematic representation of an exemplary pointing object used to navigate the diagnostic device according to the subject matter of the present disclosure and thus guide the user of the diagnostic device. The diagnostic device 104 is 1 as described in more detail below to calculate the route from the location of the pointing object and the location of the pointing object to the desired diagnostic device 104 spatial arrangement for the patient 103's body (or a particular part thereof). While using one or more navigation sensors, it can be seen that the pointing object 935 points to a location on the body of patient 103.

Returning to FIG. 12a, after route calculation, the diagnostic device 104 uses, for example, a guide module 206 to place the pointing object 935 into the desired diagnostic device 104 spatial arrangement for the patient 103's body (or a particular portion thereof). It can be configured to provide the user 102 with guidance data instructing the user 102 to operate in the same manner (step 936). To this end, the diagnostic device can be configured to present the user 102 with the current location of the pointing object 935. The diagnostic device can also be configured to provide the user with voice instructions instructing the user 102 how to operate the pointing object 935. It should be noted that, as mentioned above, other instructional methods (eg, vibration of the diagnostic device 104, etc.) can be used as well.

The diagnostic device 104 can also be configured to continuously calculate the current location of the pointing object 935 for its desired location (step 920). During the calculation of the location of the continuous pointing object 935, the diagnostic device 104 continuously receives data from one or more navigation sensors such as the navigation camera 420, distance sensor 430, etc. (step 922). The current pointing object 935 by comparison of data received from one or more navigation sensors with reference data (eg, reference image, etc.), eg, by using known methods and techniques detailed above. The location can be configured to be calculated continuously (step 924).

If the current location of the pointing object 935 is the desired diagnostic device 104 spatial arrangement for the body (or particular part thereof) of the patient 103, the diagnostic device will be the diagnostic device 104, as described in more detail with respect to FIG. 14, among other things. Can be configured to move to the location indicated by the pointing object 935 (step 928) and instruct the user 102 to collect medical data for the patient 103. However, if the current location of the pointing object 935 is not the desired spatial arrangement of the diagnostic device 104 with respect to the body (or particular part thereof) of the patient 103, the diagnostic device 104 will perform a movement correction calculation (step 930). Can be configured. During the movement correction calculation, the diagnostic device 104 can be configured to calculate the delta between the current location of the pointing object 935 and its desired location and / or the calculated route. The movement correction calculation can be based on, for example, data received from one or more navigation sensors and the calculated route. In such cases, after the route has been calculated, the diagnostic device 104 will check if the actual movement made by the pointing object 935 does not match the expected movement calculated during the route calculation. Can be configured. Alternatively, the movement correction calculation can be based on a recomparison of data received from one or more navigation sensors with their respective reference data.

The diagnostic device 104 can also be further configured to perform navigation quality calculations (step 932). The diagnostic device 104 is configured to check various parameters indicating navigation quality such as convergence (check that the pointing object 935 is getting smaller and smaller from its desired location) and the like. be able to. If the navigation quality meets the requirements (eg, the distance of the pointing object 935 from its desired location is decreasing), the diagnostic device returns to step 936 to continue the navigation and guidance process. However, if the navigation quality does not meet the requirements, the diagnostic device 104 can be configured to return to step 608 and reorient the device.

It should be noted that other navigation methods for navigating the diagnostic device 104 can be used as well.

FIG. 14 is a flowchart illustrating an example of a series of operations performed for the collection and verification of readings by the diagnostic device according to the subject of the present disclosure. The diagnostic device 104 is described in detail above, for example, by using a read and verify logic module 212, for example, where the diagnostic device 104 is a desired diagnostic device 104 spatial arrangement (eg, above) with respect to the body (or particular portion thereof) of the patient 103. When the spatial arrangement for the body (or specific part thereof) of the patient 103 that enables the collection of medical data is reached, it becomes the desired spatial arrangement for the body (or specific part thereof) of the patient 103. It can be configured to notify the user 102 that it is located and that it is about to take a reading (step 1002). The diagnostic device 104 can also be configured to instruct the diagnostic sensor module 202 to be ready to collect medical data for the patient 103 (step 1004). Such preparation can include preparing the diagnostic sensor 202 to collect medical data according to a patient-specific health care plan. Exemplary preparations include setting the zoom of the image acquisition sensor 316, starting the light source 318 with proper power, starting the audio acquisition sensor 324, and the like. In addition, the diagnostic device 104 is configured to search for relevant reading parameters and thresholds from, for example, a patient-specific health care plan (eg, required reading length, reference threshold such as minimum volume, etc.). be able to.

The diagnostic device 104 is also configured to recalculate its current spatial arrangement with respect to the body (or particular part thereof) of the patient 103 and verify that it has not been moved and is still located in the desired spatial arrangement. Can be done (step 902). If there is a change in the spatial arrangement of the diagnostic device 104 with respect to the body (or particular part thereof) of the patient 103, the diagnostic device 104 can be configured to return to the navigation and guide process (610). Alternatively, the diagnostic device 104 can be configured to collect medical data (step 1006). The medical data, as described above, is, among other things, information about the examination process, steps, and logic, as well as predefined reading parameters, such as the type of sensor to be used (still image vs. video), time (eg, seconds). According to a medical examination plan that can include the required read length (recording or recording) represented by, and the definition of a read data threshold (eg, an acceptable minimum and / or maximum read limit that should be used as a quality parameter for the reading. Therefore, for example, if the heart is examined, the examination plan should use a voice-based sensor 320 and read length from 3 seconds or 2.5 to 5 seconds. It can be defined that it should be between).

After collection of medical data, the diagnostic device 104 can be configured to verify that the collected medical data meets predefined criteria (eg, required read length, read data threshold, etc.). (Step 1008). For example, if the heart is examined and the examination plan defines that the read length should be between 2.5 and 5 seconds, then the diagnostic device 104 satisfies the read length requirement. Can be configured to check. If the medical data collected does not meet the predefined criteria, the diagnostic device 104 can be configured to check if the reading collection process was OK (step 1010) (eg, diagnostics). The sensor 202 is operable, the medical examination plan data and reference data are successfully searched, the navigation process and the guidance process are successful, etc.). If the process is OK, the diagnostic device 104 can be configured to return to step 902 (to retry the collection of medical data). If the process was not OK, the diagnostic device 104 can be configured to issue a notification to the user 102 (eg, by presenting a message on the diagnostic device 104 or the patient's workstation 114). Allow the user to review the collected medical data, if any (step 1012). The diagnostic device 104 can also be configured to allow the user 102 to determine whether to store the collected medical data.

If the user 102 chooses to save the collected medical data or the reading collection process is OK, the diagnostic device 104 will transfer the collected medical data (eg, data repository 216, patient and health care plan). Store in one or more of the repository 136, the trained person's data repository 123, or any other location operatively connected to the diagnostic device 104 on which patient data is stored. It can be configured (step 1014).

Optionally, if the reading collection process is OK, the diagnostic device 104 can be configured to update the reference data with the collected medical data (step 1016). This can be done to keep the reference data up-to-date as changes can occur in the human body (eg, in the light of growth, aging, medical procedures, etc.).

We will now move on to the description of another embodiment of the system, as performed by the diagnostic device 104, performed by a trained person 124 in part of the above functions. It should be noted that the relevant changes to the diagnostic device 104 compared to the above embodiments are described below. It should be noted that, as mentioned above, the same reference numerals indicate components that are common to their different embodiments or configurations.

FIG. 15 is a block diagram schematically illustrating an example of a system for performing automatic and remote trained person-guided medical examinations according to the subject matter of the present disclosure. As detailed above, it can be seen that the user 102 and the patient 103 are located at the patient's location 100. User 102 may in some cases be patient 103 requiring medical examination (in such cases, even though user 102 and patient 103 are shown in the drawing as separate entities, they are actually Same entity). In other cases, the user 102 may be the person who will perform the medical examination of the patient 103.

As detailed above, for the purpose of performing a medical examination, the user 102 activates the diagnostic device 104 as described in more detail below. In some cases, the user 102 also activates the patient's workstation 114, as described in more detail below. The patient's workstation 114 may be any computer, including a personal computer, a portable computer, a cellular handset, or, for example, a device having appropriate processing power, including a computer and / or device that can be specifically configured for that purpose. Can be done. The patient workstation 114 may further comprise, among other things, a patient location camera 1114a and a patient location microphone 1114b that can be used to collect images (including video) and audio data of the patient 103. Such data were trained, for example, to allow the trained person 124 to see and hear the patient 103 and / or the user 102 and / or the diagnostic device 104 and video conferencing, as will be described in more detail below. Can be used by person 124. It should be noted that in some cases the patient's workstation 114 can be integrated within the diagnostic device 104. The diagnostic device 104 includes at least one processor 106 (eg, a digital signal processor (DSP), a microcontroller, a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), etc.), and a memory unit. It comprises (or is otherwise associated with) 110 (eg ROM, hard disk, etc.). The processor 106 is configured to receive instructions and control the components and operations of the diagnostic device 104.

As detailed above, in some cases the diagnostic device 104 can be configured to communicate with the patient's workstation 114. Communication between the diagnostic device 104 and the patient's workstation 114 can be achieved by any means of communication, for example via wiring or wireless communication. It can be noted that the user 102, the patient 103, the diagnostic device 104, and the patient workstation 114 are located at the patient location 100.

The diagnostic device 104 can be configured to allow the collection of various data, as will be described in more detail below. The collected data can be transmitted to the trained person's workstation 122 located at the trained person's location 120 (either directly from the diagnostic device 104 or through the patient's workstation 114) and / or to the central system 130. .. The central system 130 and the trained person's workstation 120 are devices with appropriate processing power, including personal computers, portable computers, cellular handsets, or, for example, computers and / or devices that can be specifically configured for that purpose. Can be any computer, including. The collected data can be transmitted, for example, via the Internet 116. It should be noted that the data can be transmitted using other known alternative communications such as cellular networks, VPNs, LANs and the like.

As detailed above, the central system 130 comprises a patient and health care plan repository 136 in which various patient-related data are maintained. Such data may include, for example, patient identification numbers, patient names, patient ages, patient contact details, patient medical data (eg, illness, susceptibility to medications, etc.), health care plan data (more on this later). As) and so on. The central system 130 may further comprise a diagnostic device 104, a patient workstation 114, and a medical examination repository 134 in which the data collected by the trained person's workstation 122 is maintained. Such data can be obtained, for example, from the results of medical examinations performed using the diagnostic device 104 (eg, recorded images and video readings of the ears, recorded sounds of the lungs or heart, blood pressure, body temperature, as described in more detail below). Etc.) can be included. The central system 130 includes a selected trained person workstation 122 (eg, an available trained person workstation 122 or a trained person workstation 122 with the shortest queue) and a diagnostic device 104 and /. Alternatively, a management system 132 that can be configured to establish a connection to the patient's workstation 114 can be further provided. The central system 130 receives data from a plurality of patient locations on the central system 130 and multiple, eg, to establish a connection between the trained person's workstation and the patient's workstation and / or diagnostic device. There are more than one trained person location 120 and trained person 124 when providing a central system, as a decentralized approach that can be transmitted to the trained person location is possible. It should be noted that there is a possibility of doing so. The connection can be a direct connection or a connection via the central system 130, which can be established, for example, via the internet 116. It should be noted that other known alternative connections such as cellular networks, VPNs, LANs, etc. can be used). In some cases, the management system 132 also includes a process for the patient to sign, a process for planning the patient's scheduling to a trained person who can respond, a process for managing the patient and health care plan repository 136, and a medical examination repository 134. You can manage other processes such as the process of viewing and analyzing.

It should be noted that the central system 130 is optional for the solution and that the central system 130 can be part of the system 120 of any trained person. In addition, communication between the trained person workstation 122 and the diagnostic device 104 and / or the patient's workstation 114 (hereinafter also referred to as "tp-patient connection") is the use of the central system 130. Or it can be implemented directly without need. It is also noted that the tp-patient connection can be implemented using a decentralized approach, i.e., one trained person can serve multiple patients and / or one patient. Multiple trained people can respond.
In such cases, the patient's workstation 114 may include, for example, a local repository containing one or more connection information to and vice versa the associated trained person's workstation 122.

When the transmitted data (including the image and voice data of the patient 103) is received on the trained person's workstation 122, the data can be displayed on the trained person's workstation 122. For that purpose, the trained person's workstation 122 can include, among other things, a display (eg, an LCD screen). It should be noted that the image and voice data of patient 103 can be streamed to the trained person's workstation 122. The trained person 124 can view the received data on a display from which the diagnostic device is placed in the desired spatial arrangement with respect to the body (or particular part thereof) of the patient 103 from which medical data will be collected. Providing navigation instructions to user 102 to navigate 104. To this end, the trained person's workstation 122 is trained with the trained person's camera 1122a which can be used to collect image (including video) and audio data of the trained person 124. It can be equipped with a human microphone 1122b. Note that video conferences can be conducted during a tp-patient connection using, for example, a camera at the patient's location 1114a, a microphone at the patient's location 1114b, a trained person's camera 1122a, and a trained person's microphone 1122b. Should. In such cases, the data received from the trained person's camera 1122a and the trained person's microphone 1122b, for example using video conference software, for example using the display and speaker of the patient's workstation 114, user 102. Can be presented to.

The trained person's workstation 122 may be further connected to the guide device 1124 (eg, via wiring or wireless connection) for the purpose of providing navigation instructions to the user 102. The guide device 1124 allows the trained person 124 to provide the user 102 with six axis movement instructions (up / down, left / right, front / back, pitch, roll, yaw), as will be described in more detail with respect to FIG. It can be any input means that it will do. When the trained person 124 uses the guide device 1124 to provide navigation instructions to the user 102, the instructions are transmitted to the patient's workstation 114 or to the diagnostic device 104. The patient workstation 114 or diagnostic device 104 can be configured to visually present instructions to the user 102, eg, on a display (eg, an LCD screen included in the patient workstation 114 or diagnostic device 104). .. Another exemplary alternative is to verbally present instructions to the user 102 while converting the received data (using known methods and techniques) into voice commands.

When the diagnostic device 104 reaches the desired spatial arrangement for the body (or particular part thereof) of the patient 103, the trained person 124 instructs the user 102 to collect medical data using the diagnostic device 104. be able to. In addition, the trained person's workstation 122 and / or the guide device 1124 can allow the trained person 124 to collect the necessary medical data on their own. In such a case, the trained person's workstation 122 and / or the guide device 1124 would transmit the trained person 124's instructions to the diagnostic device 104, which would be required based on the received instructions. Readings will be collected automatically. The trained person's workstation 122 and / or the guide device 1124 and / or the diagnostic device 104 is also the health care plan repository 210 and / or the patient and health care plan repository 136, or the trained person's workstation 122 and /. Or configured to use predetermined reading collection parameters as defined elsewhere that are operatively connected to the diagnostic device 104, where patient data is stored in the guide device 1124 and / or on it. It should be noted that can be done. After the medical data has been collected, the diagnostic device can be configured to transmit the collected data to the trained person's workstation 122 and / or to the central system 130. When the transmitted data is received on the trained person's workstation 122, the data may be stored in the trained person's data repository 123 which can be connected to the trained person's workstation 122. can. A trained person 124 (eg, a doctor, a nurse, a medical person including any other person skilled in the art who analyzes transmitted data, etc.) located at the trained person's location 120 and / or at the central system 130. For example, the data collected using the trained person's workstation 122 can be searched and reviewed. It should be noted that the patient workstation 114, the trained person workstation 122, and the central system 130 can include a display (eg, an LCD screen) and a keyboard or any other suitable input / output device. be. In some cases, the trained person 124 can provide feedback to the user 102, for example by transmitting data back to the patient's workstation 114. Such feedback can include, for example, analysis of received data, a request to receive more data, medical procedure instructions, guidance for further testing, and the like. Alternatively or additionally, the trained person 124 can transmit the feedback data to the central system 130, which in turn can transmit the feedback data to the patient's workstation 114 (eg, the internet). , Via cellular networks, etc.).

FIG. 16 is a schematic representation of some exemplary guide devices that can be used to provide navigation instructions to users of diagnostic devices according to the subject matter of the present disclosure. The guide device 1124 can be, for example, a keyboard 1522, a mouse 1524, a navigation device 1526, etc., and the keyboard 1522 allows the trained person 124 to provide the 6-axis movement data 1520 to the user 102 as described above. Understand that it can be made possible. For example, the keyboard 1522 may include, for example, a trackball that allows pitch, yaw, and roll movements, such as arrow keys that allow up and down and left and right movements, and one or more other that allow back and forth movements. Can have a key. It should be noted that this is just an example, as other keys can be used and other functions related to trackballs and keys can be defined. In some cases, the trackball is optional and keyboard keys can perform its function. As another example, mouse 1524 can be used. In such cases, mouse movement may allow, for example, up and down and left and right movements, with the mouse 1524 having, for example, pitch, yaw, and additional trackballs to allow roll movement. Back and forth movements can be represented, for example, by pressing the mouse keys and moving the mouse back and forth. It should be noted that this is just an example, as other keys can be used and other functions related to trackballs, mice, and mouse keys can be defined. As a further example, the navigation device 1526 can be used. The navigation device 1526 can be equipped with, for example, an INS sensor or any other means that allows the movement of the navigation device 1526 with six degrees of freedom to be identified.

FIG. 17 is a flow chart illustrating an example of a series of actions performed to perform an automated and remote trained person-guided medical examination according to the subject matter of the present disclosure. The process begins with the initiation of a physical examination (step 1602). The initiation of the physical examination can include the establishment and verification of the tp-patient connection, and the following initiations, i.e., the training initiation 1602a, the patient initiation 1602b, and the device. It can include one or more of the medical examination initiation 1602c. The trained person's medical examination start 1602a activates the trained person's workstation 122, including a display, a trained person's camera 1122a, a trained person's microphone 1122b, and optionally a guide device 1124. Can include that. The trained person's health check start 1602a provides relevant details related to patient 103 (eg, data repository 216, health care plan repository 210, trained person's data repository 123, patient and health care plan repository 136, Searching (from one or more of any other location that is operationally connected to the trained person's workstation 122, on which patient data is stored), and all or more of the searched details. It can further include displaying a portion on the trained person's workstation 122 (eg, on a display). The retrieved data can include data related to patient-specific health care plans, reading references, communication parameters, and the like. The initiation of the medical examination of the trained person was received from one or more of the camera 1114a at the patient's location, the microphone 1114b at the patient's location, the diagnostic sensor 202 at the diagnostic device 104, the navigation camera 420 at the diagnostic device 104, and the like. It may further include displaying data received from the patient's workstation 114 or diagnostic device 104, including (eg, streamed) image and voice data. A trained person's medical examination initiation 1602a relates to patient 103 from an external system such as a visit scheduling system, an electronic medical record (EMR) system, or any other system or repository related to patient examination. It can further include searching for relevant details.

The patient initiation 1602b can include the activation of the patient's workstation 114, including the display, the patient's location camera 1114a, the patient's location microphone 1114b, and the establishment and verification of the tp-patient connection. The patient medical examination start 1602b is a workstation of the trained person, for example, to display the collected data to the trained person 124, the data collected by the camera 1114a at the patient's location and the microphone 1114b at the patient's location. It can further include the start of transmission (eg, stream) to 122. Patient health start 1602b provides relevant details related to patient 103 (eg, data repository 216, health care plan repository 210, patient and health care plan repository 136, or a patient whose patient data is stored on it. Searching (from one or more of any other location operatively connected to the workstation 114), and all or part of the searched details on the patient's workstation 114 (eg, on the display). It can further include displaying. The retrieved data can include data related to patient-specific health care plans, reading references, communication parameters, etc., and the patient health care start 1602b is a visit scheduling system, electronic medical record (EMR) system. , Or searching for relevant details relating to patient 103 from any other system or external system such as a repository related to patient examination can further be included.

The device health check start 1602c is one of a communication and diagnostic device 104 module or sensor (eg, diagnostic sensor 202 and / or navigation module 204 and / or guide module and / or test module) with the patient's workstation 114. It may include starting the diagnostic device 104 and checking its condition, including starting one or more. The device health check start 1602c, for example, to display the collected data to the trained person's workstation 122 of the data collected by the diagnostic sensor 202 and / or the navigation camera 420 to display the collected data to the trained person 124. It can further include initiating a transmission (eg, a stream). It should be noted that the device health check initiation 1602c can be done, for example, by the test logic module 208.

As mentioned above, the patient's workstation 114 and diagnostic device 104 periodically to the trained person's workstation 122 with data such as images, video, and audio for the purpose of displaying the data to the trained person 124. An exemplary presentation on a trained person's workstation 122 display that can be configured to transmit (eg, stream, eg, using the Internet 116, cellular network, etc.) to or continuously (step 1603). Is provided with respect to FIG. The trained person's workstation 122 and the patient's workstation 114 transmit both bidirectional video and audio from the patient's workstation 114 to the trained person's workstation 122 and vice versa continuously or periodically. It should be noted that it can be configured to transmit to (step 1603). This data transmission can be used, for example, for general patient views, device orientations, video conferences, and the like.

The trained person's workstation 124 can be further configured to instruct the trained person 124 to perform a questionnaire regarding the patient 103 (step 1604). The questionnaire can be a predefined questionnaire or a questionnaire defined in progress by a trained person. The questionnaire was conducted by the trained person (eg, using the trained person's camera 1122a, the trained person's microphone 1122b) on the patient's workstation 114 (eg, the patient's workstation 114's display). It can be presented to the user 102 by display) or by any other means. The user 102 can provide a response to the questionnaire using the camera 1114a at the patient's location and the microphone 1114b at the patient's location, in which case the trained person 124 is the trained person to respond to the questionnaire. You will type into your workstation (using a keyboard, for example). Alternatively, the user 102 can provide a response to the questionnaire by typing the response into the patient's workstation 114 (eg, using a keyboard). It should be noted that other methods such as voice recording can be used to provide a response to the questionnaire. The response to the questionnaire is, for example, a data repository 216, a health care plan repository 210, a trained person's data repository 123, a patient and health care plan repository 136, or a person whose patient data is stored and trained on it. It can be stored in one or more of any other location operatively connected to the workstation 122.

Questionnaires are the data needed to make the medical data collected during a medical examination analyzable (eg, "whether the patient has a fever, when?", "How expensive?", "Patients Provide patient medical data (eg, data related to the medical condition of patient 103) to trained person 124, including "Do you feel pain?", "Where is the pain?", Etc.) Can include general and / or patient 103-specific questions designed.

The trained person's workstation 122 can be configured to further select and initiate a medical examination (step 1606). For that purpose, the trained person's workstation 122 can select the medical examination to be performed by the trained person 124 manually or from the list of medical examinations to be performed as defined in the patient 103 medical examination plan. Can be done. Alternatively, the trained person's workstation 122 selects and initiates a medical examination according to a predefined order set by the patient 103 specific medical examination plan without input from the trained person 124. can do. Initiation of a medical examination can consist, for example, by retrieving reference medical examination data from a medical examination plan or related repository. The retrieved data can be displayed on the display to the trained person 124. An exemplary presentation on the display of the trained person's workstation 122 is provided with respect to FIG. Initiation of a medical examination (step 1606) can also consist of transmitting relevant data to the patient's workstation 114 and / or diagnostic device 104. Such data can include, for example, user instructions and general guide information, patient instructions and general guide information, diagnostic device parameters (eg, what health care is currently being performed, required reading parameters, etc.).

After selecting a medical examination, the trained person's workstation 122 installs the diagnostic device 104 in the desired spatial arrangement for the body (or specific part thereof) of the patient 103 required to collect medical data. It can be configured so that the trained person 124 can provide the user 102 with navigation instructions as to how to navigate (step 1610). The desired spatial arrangement of such patient 103 with respect to the body (or a particular part thereof) can be defined, for example, manually or by a patient-specific health care plan. The trained person 124 is one or more of the data presented on the trained person's workstation 122 (patient location camera 1114a, patient location microphone 1114b, diagnostic sensor 202, navigation module 204). The diagnostic device 104 is placed in the desired spatial arrangement with respect to the patient 103's body (or certain parts thereof) to view medical data of the patient 103 (including real-time or near-real-time streaming of data received from). It is possible to instruct the workstation 122 of a person trained to provide instructions for navigating to the user 102. For the purpose of providing data to be presented on the trained person's workstation 122, the diagnostic device 104 initiates, among other things, an INS sensor 410, a navigation light source 426, a navigation camera 420, a distance sensor 430, a pressure sensor 440, and the like. The navigation module 204 may be used and configured to transmit (eg, stream) all or part of the data collected by any of them.

As mentioned above, navigation instructions can be provided by voice commands (eg, by transmitting the data collected by the trained person's microphone 1122b to the patient's workstation 114 or to the diagnostic device 104). Navigation instructions can also be provided by using a guide device 1124 that allows the trained person 124 to virtually perform navigation and device spatial alignment correction at the trained person's location 120. In such cases, the navigation performed by the trained person 124 using the guide device 1124 is analyzed and converted into voice commands that can be displayed to the user 102. Alternatively or additionally, the navigation performed by the trained person 124 using the guide device 1124 is visually presented to the user 102 on the patient's workstation 114 (eg, on the display of the patient's workstation 114). .. When the data is presented visually, the movements made by the trained person 124 using the guide device 1124 can be presented to the user 102 using, for example, the representation of the diagnostic device 104 as shown in FIG. .. It should be noted that voice and / or visual navigation instructions can be managed by the guide module 206 of the diagnostic device 104 (eg, speaker 510, display 502, etc.) or by the patient's workstation 114.

In some cases, the diagnostic device 104 is to use the INS sensor 410 to verify that the movement of the diagnostic device 104 made by the user 102 is consistent with the navigation instructions provided by the trained person 124. It should be noted that it can be configured. In such a case, if there is a mismatch between the movement of the diagnostic device 104 made by the user 102 and the navigation instructions provided by the trained person 124, the diagnostic device 104 notifies the user 102 of the mismatch. It can be configured to present the required movement correction to the user. Such notifications may be voice notifications (eg using speaker 510), vibration notifications (eg using vibration element 508), or image notifications displayed on or on the display of workstation 114 at the patient's location (eg, using display 502). Navigation guide presentation can be used (as shown in FIG. 13).

When the diagnostic device 104 reaches the desired spatial arrangement for the body (or particular part thereof) of the patient 103, the trained person's workstation 122 is the trained person that the diagnostic device 104 is in the required spatial arrangement. The 124 can be configured to notify the user 102. Such notifications can be voice notifications (eg, using a trained person's microphone 1122b). Alternatively or additionally, vibration notifications can be provided by a diagnostic device 104 (eg, using a vibration element 508) and / or visual notifications (eg, a trained person 124 using, for example, a keyboard). On the patient's workstation 114 or on the display 502 (after receiving instructions from the trained person 124 that the diagnostic device 104 is in the required spatial arrangement), which can be provided to the trained person's workstation 122. Can be presented to. It should be noted that other notification methods can be used as well.

When the diagnostic device 104 reaches the desired spatial arrangement for the body (or particular part thereof) of the patient 103, the trained person's workstation 122 is for the trained person 124 to perform remote reading and reading verification 1612. Can be configured to enable. For that purpose, the trained person's workstation 122 has the trained person 124 (eg, using manual instructions and / or especially with respect to FIGS. 2 and 3 reading and verifying the logic module 212 as described above. It can be configured to be able to instruct the diagnostic device 104 to collect medical data for the patient 103 (using and using the diagnostic sensor 202). In response to receiving instructions to collect medical data, the diagnostic device 104 was trained to collect such medical data and to display the collected data to, for example, a trained person 124. It can be configured to be prepared to collect medical data for patient 103 for transmission to a person's workstation 122. The trained person's workstation 122 can be configured so that the trained person 124 can verify that the collected data is of sufficient quality (eg, regarding quality, threshold, length, etc.). .. If the data collected is not of sufficient quality, the trained person's workstation 122 will bring the diagnostic device 104 to the desired spatial arrangement for the patient 103's body (or a particular part thereof). The data required to reposition and reorient the 104 can be configured so that the trained person 124 can recollect or, if necessary, direct the user 102 and provide navigation instructions to the user 102. .. After repositioning and reorientation of the diagnostic device 104, reading and verification can be performed again.

After collecting and validating readings of medical data for patient 103, the trained person's workstation 122 is subjected to all medical examinations as defined by the patient 103 medical examination plan, for example, whether the medical examination has been completed. Can be configured to check). The check can be done either automatically by the trained person's workstation 122 using a predefined health care plan or manually by the trained person 124. If the medical examination has not been completed, the trained person's workstation 122 may move on to the next medical examination indicated by the patient 103 medical examination plan or allow the trained person 124 to do so manually. Can be configured in. If all necessary medical examinations are performed, the trained person's workstation 122 can be configured to complete the medical examination or allow the trained person 124 to perform it manually ( Step 1614).

FIG. 18 illustrates an example of a series of actions performed to navigate a diagnostic device and thus guide a user of the diagnostic device in a remote trained person-guided medical examination according to the subject matter of the present disclosure. It is a flowchart to be performed. The diagnostic device 104 is driven by the user 102 to activate various diagnostic and navigation sensors (eg, patient location camera 1114a, patient location microphone 1114b, diagnostic sensor 202, navigation module 204, etc.). Can be configured in (step 1902). The diagnostic device 104 continuously transmits data collected by various diagnostic and navigation sensors, among other things, to the patient's workstation 114 and / or to the trained person's workstation 122 (eg, in real time or near real time). , For example, to stream).

The patient workstation 114 can use the data collected by various navigation sensors to present the movement data of the diagnostic device 104 to the user 102 (eg, on the display) (step 1903). This allows the user 102 to receive immediate feedback relating to the movement of the diagnostic device 104 (before receiving delayed movement correction feedback from the trained person 124) and thus the navigation process. Make it easier. The data of the movement of the diagnostic device 104 can be presented to the user 102 by using, for example, the representation of the diagnostic device 104 as shown in FIG.

The trained person's workstation 122 can use the data collected by various navigation sensors to present the movement data of the diagnostic device 104 to the trained person 124 (eg, on the display) (step). 1904). Data on the movement of the diagnostic device 104 can be presented to a trained person 124 using, for example, the representation of the diagnostic device 104 as shown in FIG. 19 (see index 1940 in FIG. 19). The trained person's workstation 122 can further use the data collected by various diagnostic sensors to present the data to the trained person 124 (eg, on the display) (step 1906). The data collected by the various diagnostic sensors can be presented to the trained person 124, eg, as shown in FIG. 19 (see index 1942 in FIG. 19).

The trained person 124 then uses the data presented to him (eg, on the display) to have the diagnostic device 104 against the body (or particular part thereof) of the patient 103 in order to collect the required readings. It can be determined whether it is located in the desired spatial arrangement and whether the current reading received from the diagnostic sensor is of sufficient quality (step 1908). If the diagnostic device 104 is located in the desired spatial arrangement with respect to the body (or particular part thereof) of the patient 103 and the readings received from the diagnostic sensor are of sufficient quality, the trained person's workstation 122 , The trained person 124 can be configured to instruct it to continue the step of collecting medical data (step 1612).

If the diagnostic device 104 is not in the desired spatial arrangement with respect to the body (or particular part thereof) of the patient 103 and / or the readings received from the diagnostic sensor are not of sufficient quality, the trained person's workstation 122. Can be configured such that the trained person 124 can provide the user 102 with instructions for navigating the diagnostic device 104 to the desired spatial arrangement for the patient 103's body (or a particular portion thereof) (step). 1912). As detailed above, especially with reference to FIG. 17, the instructions can be voice instructions and / or visual instructions. In addition, if necessary, the trained person's workstation 122 allows the trained person 124 to remotely change or adjust various parameters of the diagnostic device 104 (eg, light intensity, camera's). It can be configured to allow manual control of the sensors of the diagnostic device 104 such as focus, camera zoom, microphone sensitivity, etc.

As mentioned above, the visual instructions can be based on the use of the guide device 1124. In such cases, the trained person's workstation 122 can be configured to display the movements made by the guide device 1124 (eg, on the display). The display can present the movement, for example, as shown in FIG. 19 (see index 1940 in FIG. 19), eg, using the representation of the diagnostic device 104 (step 1914). This presentation allows the trained person 124 to receive immediate feedback related to his guided movement before receiving the delayed feedback of the user 102 corresponding to the movement with the diagnostic device 104. There will be.

The trained person's workstation 122 transmits instructions to the patient's workstation 114 or to the diagnostic device 104 to correct the navigation of the diagnostic device 104 to the required spatial arrangement for the body (or particular part thereof) of the patient 103. Can be configured to (eg, stream in real time or near real time) (step 1916). The patient's workstation 114 can be configured to provide the user 102 with voice and / or visual instructions provided by the trained person 124 (step 1918). Instructions can be provided, for example, by using a display (eg, display 502) and / or a speaker (eg, speaker 510). Visual instructions can be presented, for example, as illustrated and described above with reference to FIG. The diagnostic device 104 follows the process detailed above until the diagnostic device 104 is positioned and oriented in the desired spatial arrangement with respect to the body (or particular portion thereof) of the patient 103 for the collection of medical data. The user 102 can further operate while repeating (step 1920).

FIG. 19 is a schematic of an exemplary navigation and guide presentation to a trained person in the subject matter of the present disclosure. The trained person's workstation 122 can be configured to display the online visit screen 1930. The online visit screen can be divided into several areas that can store various data related to performing a medical examination guided by a remote trained person. Such data can include, for example, patient and general information 1932, patient view 1936, organ reading-actual reading 1944, navigation and guide presentation 1940, organ view-active sensor 1942, and application menu 1934.

Patient and general information 1932 includes, for example, patient name, patient age, patient address, patient language, data related to illness and / or susceptibility to medication, online visit date, time, duration, etc. And various data and information regarding the status of online visits can be included.

The patient view 1936 was received from, for example, a camera 1114a at the patient's location or a microphone 1114b at the patient's location to allow the trained person 124 to see and hear the patient 103 and / or the user 102 (eg, real-time). Can present data (streamed in). This information can enable, for example, the orientation of the general patient 103 and the diagnostic device 104, as well as the video conference between the trained person 124 and the user 102 and / or the patient 103.

Organ Readings-The actual readings 1944 can present, for example, data regarding reference readings and / or past readings of the organ to be examined. When the readings of the organ of the patient 103 (eg, organ image, video, or audio) are collected, the readings transmitted from the diagnostic device 104 can be presented in the area. In addition, organ reading-actual reading 1944 can enable video presentation, zooming, scaling and so on. It should be noted that the read data presented in this area does not require real-time updates.

Navigation and Guided Presentation 1940 includes the current diagnostic device 104 spatial arrangement for the patient 103's body (or specific parts thereof), the desired diagnostic device 104 spatial arrangement for the patient 103's body (or specific parts thereof), and the like. Can present the necessary corrective movements to be made to the diagnostic device 104 to move the patient 103 to the desired spatial arrangement with respect to the body (or a particular part thereof). In addition, the area can also present the position and orientation of the trained person's guide device 1124 based on the movement of the trained person 124. Navigation and Guided Presentation 1940 can also be configured to allow real-time presentation of the corresponding movement made by the user 103 using the diagnostic device 104 for the guided / corrected movement made by the trained person 124. Thus, it allows a visual presentation of the movement tracking of the user 103 based on the guide and navigation correction of the trained person 124.

The organ view-active sensor 1942 can present data (eg, streamed in real time or near real time) received from a diagnostic sensor (eg, image-based sensor 310). The trained person 124 specifically determines whether medical data can be collected (eg, the diagnostic device 104 is positioned and oriented as desired, the image quality is good, etc.). This data can be used for. The trained person's workstation 122 uses higher quality readings in the organ reading-actual reading area 1944 (eg, higher quality sensor readings such as high definition images and voices that are not transmitted in real time). (Used), configured to use lower quality real-time (or near real-time) data streaming in the organ view-active sensor area 1942 (eg, to increase performance and enable common device locations). It should be noted that can be done.

The application menu 1934 may, for example, initiate a medical examination, store a medical examination, collect medical data, insert various written data into a system (eg, diagnostic data, comments, etc.), and the like. Various operating options for operating such systems can be presented. In addition, the application menu 1934 can be configured to allow remote control of the sensor of the diagnostic device 104 (eg, light intensity, zoom, focus, audio filter, etc.). The application menu 1934 can also be configured as a context sensitive menu, for example, the menu adds / removes features related to the particular window area currently focused or manipulated (eg to a particular window area). It should be noted that certain features of interest can be added / removed, for example.

FIG. 20 is a flow chart illustrating an example of a series of actions performed for the collection and verification of readings by a diagnostic device in a remote trained person-guided medical examination according to the subject matter of the present disclosure. The trained person's workstation 122 is configured so that the trained person 124 can provide the user 102 with notification that the diagnostic device 104 is in the desired spatial arrangement with respect to the body (or a particular part thereof) of the patient 103. Can be done (step 2002). The notification is collected by a voice notification, eg, a trained person's microphone 1122b, and transmitted to the patient's workstation 114, which can be configured to play it to the user 102 (eg, using the speaker 510). It can be a voice recording (eg streamed). Alternatively or additionally, the notification was trained to instruct the trained person 124 to display the notification, for example, on the display of the patient's workstation 114 or the diagnostic device 104. It can be a visual notification so that it can be directed to a person's workstation 122. The notification can, for example, instruct the user 102 not to move the diagnostic device.

The trained person's workstation 122 can be configured to instruct the trained person 124 to prepare the diagnostic device 104 and the diagnostic sensor to collect medical data of the patient 103 (step 2004). .. Preparation can be defined according to the instructions provided by the patient-specific health care plan or by the trained person 124. Such preparation can include preparing the diagnostic sensor 202 to collect medical data according to a patient-specific health care plan. Exemplary preparations include setting the zoom and / or focus of the image acquisition sensor 316, starting the light source 318 with proper power, starting the audio acquisition sensor 324, and the like. In addition, the diagnostic device 104 can be configured to retrieve relevant read parameters and thresholds, eg, from patient-specific health care plans (eg, reference thresholds such as required read length, minimum volume). Such). It should be noted that the trained person 124 can manually adjust or change the associated reading parameters and thresholds (eg, invalidate the patient-specific health care plan).

The trained person's workstation 122 is reassessed by the trained person 124 with respect to the current spatial arrangement of the diagnostic device 104 with respect to the body (or particular part thereof) of the patient 103, as well as being unmoved. It can be configured to be able to verify that the patient 103 is still located in the desired spatial arrangement with respect to the body (or a particular part thereof) (step 2005). If there is a change in the position and / or orientation of the diagnostic device 104, the trained person's workstation 122 can be configured to allow the trained person 124 to return to the navigation and guidance process ( 1610). Alternatively, the trained person's workstation 122 can be configured to allow the trained person 124 to perform medical data collection using the diagnostic device 104 (step 2006). .. The medical data, as described above, is, among other things, information about the examination process, steps, and logic, as well as predefined reading parameters, such as the type of sensor to be used (still image vs. video), time (eg, seconds). According to a medical examination plan that can include the required read length (recording or recording) represented by, and the definition of a read data threshold (eg, an acceptable minimum and / or maximum read limit that should be used as a quality parameter for the reading. Therefore, for example, when the heart is examined, the examination plan should use a voice-based sensor 320 and read length from 3 seconds or 2.5 to 5 seconds. It is possible to define what should be between). It should be noted that the trained person 124 can manually adjust or change the associated reading parameters and thresholds (eg, invalidate the patient-specific health care plan).

For example, as shown in FIG. 19 (see index 1944 in FIG. 19), after collection of medical data, the data can be transmitted (eg streamed) to the trained person's workstation 122, which then , The collected data can be displayed to the trained person 124 (step 2007).

The trained person's workstation 122 is configured to allow the trained person 124 to verify that the collected medical data meets predefined criteria (eg, required read length, read data threshold, etc.). Can be done (step 2008). For example, if the heart is examined and the examination plan defines that the read length should be between 2.5 and 5 seconds, the trained person's workstation 122 has a read length. Can be configured to be checked by a trained person 124 to meet the requirements. If the collected medical data does not meet the predefined criteria, the trained person's workstation 122 will ask if the collected medical data is OK (eg, the collected medical data is of sufficient quality). It can be configured so that the trained person 124 can check (such as being a thing).

If the medical data collected is not OK (eg, the medical data collected is not of sufficient quality), the trained person's workstation 122 will allow the trained person 124 to perform a manual reading. It can be configured to allow (step 2009). As mentioned above, the trained person workstation 122 has different diagnostic devices 104 parameters such as light intensity, camera focus, camera zoom, read duration, voice filtering, etc. Can be configured to be manually adjusted or controlled.

After manual reading 2009, if the collected medical data is still not OK but the process is OK (eg, the diagnostic device 104 did not report any error and the guiding process was done properly), it was trained. The human workstation 122 can be configured to allow the trained person 124 (to retry the collection of medical data) to return to step 2004. If the process was not OK, the trained person's workstation 122 may have an error in the trained person 124 (eg, by presenting a message at the trained person's workstation 122, etc.). It can be configured to issue a notice and allow him to decide whether to save the collected medical data. If the user 102 chooses to save the collected medical data or the collected medical data is OK, the trained person's workstation 122 displays the medical data collected by the trained person 124. For example, data repository 216, patient and health care plan repository 136, trained person data repository 123, or any other location operatively connected to the diagnostic device 104 on which patient data is stored. It can be configured to be stored (in one or more of the above) (step 2014).

Optionally, if the reading collection process is OK, the trained person's workstation 122 can be configured to update the reference data with the collected medical data (step 2016). This can be done to keep the reference data up-to-date as changes can occur in the human body (eg, in the light of growth, aging, medical procedures, etc.).

It is noted that each of the above components and modules can be combined with one or more of the other components and modules described above.

Alternatively or additionally, the workstation 122 of a person who has been or trained by any one of the patient's workstations 114, when referring to the part of the function described as performed by the diagnostic device 104. It should be noted that this can be done by any other suitable device, including but not limited to the central system 130.

With reference to FIGS. 6, 7, 8a, 8b, 8c, 11, 12, 12, 12a, 14, 14, 17, 18, and 20, some of the blocks / steps are aggregated. It should be noted that it can be integrated into blocks / steps that have been created, or can be decomposed into several blocks / steps, and / or added to other blocks / steps. Moreover, in some cases, the blocks / steps may be performed in a different order than that described herein. Flowcharts are also described with reference to the system elements that implement them, but it is also noted that this is by no means binding and that blocks / steps can be performed by elements other than those described herein. Should.

It is understood that the subject matter of this disclosure is not limited in its use in the details described in the description contained herein or in the drawings. The subject matter of the present disclosure is possible in other embodiments and can be implemented and implemented in various ways. It is therefore understood that the phrases and terms used herein are for illustration purposes and should not be considered limiting. Accordingly, those skilled in the art may appreciate that the concepts on which this disclosure is based may be readily used as the basis for designing other structures, methods, and systems for carrying out some of the purposes of the subject matter of this disclosure. You will understand.

It will also be appreciated that the system according to the subject matter of this disclosure may be a properly programmed computer. Similarly, the subject matter of the present disclosure considers a computer-readable computer program to perform the methods of the subject matter of the present disclosure. The subject matter of the present disclosure further contemplates a machine-readable memory that explicitly embodies a program of machine-executable instructions for performing the methods of the subject matter of the present disclosure.

Claims (20)

A handheld diagnostic device configured to perform one or more medical examinations of a patient.
With at least one diagnostic sensor
Equipped with a processor,
For a given medical test of at least one of the plurality of medical tests, the processor
To give the user instructions to perform the at least one given medical examination based on predefined reference data indicating the desired spatial arrangement of the handheld diagnostic device with respect to the patient's body.
Manipulating the at least one diagnostic sensor to obtain medical data when the desired spatial arrangement is reached.
Data analysis of the acquired medical data by trained medical personnel by verifying that the acquired medical data meets one or more predefined medical data quality parameters. What is possible and
A handheld diagnostic device configured to transmit the validated medical data to the remote workstation of the trained healthcare professional. The handheld diagnostic device of claim 1, wherein the processor is configured to make the transmission via a central system. The handheld diagnostic device of claim 2, wherein the central system transfers the verified medical data to the remote workstation of the trained healthcare professional. The processor further
A process of providing one or more questions about the patient to the user, wherein at least some of the questions are designed to provide data about the medical condition of the patient.
The process of receiving answers to one or more of the above questions, and
The handheld diagnostic device according to claim 1, wherein the steps of transmitting the answer to the remote workstation are performed. The handheld diagnostic device of claim 1, wherein a predefined check plan associated with the patient defines a list of said one or more medical tests to be performed on the patient. The handheld diagnostic device according to claim 1, wherein the diagnostic sensor is an image-based diagnostic sensor. The handheld diagnostic device according to claim 1, wherein the diagnostic sensor is a sound-based diagnostic sensor. The handheld diagnostic device of claim 2, further comprising at least one navigation sensor for acquiring data that enables navigation, wherein the at least one navigation sensor is a camera. The predefined medical data quality parameters are
(A) Required reading length,
(B) Minimum recording volume,
(C) Minimum recording quality,
(D) Minimum pressure on the patient's body,
(E) Maximum pressure on the patient's body,
(F) Maximum allowed movement of the remote diagnostic device during the collection of readings,
(G) Image reading type,
(H) Required image reading zoom,
(I) Required image reading light,
(J) Required image reading matching with a predefined reference, and (k) Minimum image quality,
The handheld diagnostic device according to claim 1, which is at least one of. The handheld diagnostic device of claim 1, wherein the processor is further configured to automatically identify the patient. A method of performing one or more medical examinations of a patient using a handheld diagnostic device.
For at least one given medical test among the plurality of medical tests
To give the user instructions to perform the at least one given medical examination based on predefined reference data indicating the desired spatial arrangement of the handheld diagnostic device with respect to the patient's body.
Using at least one diagnostic sensor of the handheld diagnostic device to acquire medical data when the desired spatial arrangement is reached.
Data analysis of the acquired medical data by trained medical personnel by verifying that the acquired medical data meets one or more predefined medical data quality parameters. What is possible and
A method comprising transmitting the validated medical data to a remote workstation of the trained healthcare professional. 11. The method of claim 11, wherein the transmission is via a central system. 12. The method of claim 12, wherein the central system transfers the verified medical data to the remote workstation of the trained healthcare professional. A process of providing one or more questions about the patient to the user, wherein at least some of the questions are designed to provide data about the medical condition of the patient.
The process of receiving answers to one or more of the above questions, and
11. The method of claim 11, further comprising sending the answer to the remote workstation. 11. The method of claim 11, wherein a predefined check plan associated with the patient defines a list of said one or more medical tests to be performed on the patient. The method according to claim 11, wherein the diagnostic sensor is an image-based diagnostic sensor. The method according to claim 11, wherein the diagnostic sensor is a sound-based diagnostic sensor. The predefined medical data quality parameters are
(A) Required reading length,
(B) Minimum recording volume,
(C) Minimum recording quality,
(D) Minimum pressure on the patient's body,
(E) Maximum pressure on the patient's body,
(F) Maximum allowed movement of the remote diagnostic device during the collection of readings,
(G) Image reading type,
(H) Required image reading zoom,
(I) Required image reading light,
(J) Required image reading matching with a predefined reference, and (k) Minimum image quality,
The method of claim 11, which is at least one of. 11. The method of claim 11, further comprising automatically identifying the patient. A computer storage device that stores computer-executable instructions.
A computer storage device that, when executed in a processing circuit, causes the processing circuit to execute the method according to any one of claims 11 to 19.

Images