TWI909215B - Simulation training system for microscope and simulation training method for microscope - Google Patents

Abstract

A simulation training system for a microscope is proposed. The simulation training system for the microscope includes a sensor, a database, a data processing device and a displaying device. The sensor detects a gesture of a user to generate a gesture sensing information. The data processing device includes an analyzing module and an image outputting module. The analyzing module analyzes a rotation and a relative position information corresponding to the gesture, and transforms the rotation and the relative position into an image magnification. The image outputting module outputs a virtual scene. The displaying device displays the virtual scene. The analyzing module lets a virtual hand move, and drives a virtual nosepiece and a virtual adjustment knob to rotate in the virtual scene. Therefore, the analyzing module enlarges an image of a glass slide to generate a zoomed image, and the zoomed image is displayed in the virtual scene. Thus, the simulation training system for the microscope of the present disclosure can help the user to train and simulate the operating process of the microscope.

Description

Microscope Simulation Training System and Method

This invention relates to a simulation training system and a simulation training method, and more particularly to a microscope simulation training system and a microscope simulation training method.

Interpreting blood smears, bone marrow smears, and bacterial stained smears are all important methods for accurate diagnosis in clinical medicine. They require blood or other samples to be collected by hematologists, stained, placed on a glass slide, and then observed under a microscope to correctly interpret the blood cells, bone marrow cells, or bacteria on the slide.

However, due to the difficulty in accumulating smear data for various disease cases, the limited resources of microscope equipment, and the high risk of infection due to exposure for personnel with insufficient experience in preparing stained smears, it is extremely time-consuming and inefficient for relevant personnel to learn to operate a microscope proficiently and to identify interpretable areas in smears.

In view of this, the development of a microscope simulation training system and method that is not limited by microscope equipment and the number of slide samples has become the goal pursued by relevant academics and industry professionals.

Therefore, the purpose of this invention is to provide a microscope simulation training system and a microscope simulation training method, which simulates microscope operation and slide interpretation through a virtual reality system to conduct microscope simulation training.

According to one embodiment of the present invention, a microscope simulation training system is provided, comprising a sensor, a database, an information processing device, and a display device. The sensor is used to sense a user's hand posture and convert it into gesture sensing information. The database stores multiple slide images. The information processing device is signal-connected to the sensor and the database, and includes an analysis module and an image output module. The analysis module receives the gesture sensing information, analyzes the rotation amount and relative position information corresponding to the hand posture based on the gesture sensing information, and converts it into an image magnification. The image output module is signal-connected to the analysis module and is used to output a virtual scene. The virtual scene comprises a virtual hand, a virtual microscope, and one of these slide images; the virtual hand corresponds to the user's hand posture. A display device is connected to an image output module and used to display the virtual scene from the image output module. An analysis module moves the virtual hand within the virtual scene based on rotation and relative position information. The virtual hand rotates one of the virtual microscope's virtual objective lens converters and one of its virtual adjustment knobs within the virtual scene based on gesture sensing information. The analysis module scales down these slide images according to the image magnification to generate a magnified virtual slide image, which is then displayed in the virtual scene.

Therefore, the microscope simulation training system of this invention generates virtual scenarios through data processing devices, allowing users to simulate microscope operation and providing a large amount of slide data for users to interpret and train.

Other embodiments of the aforementioned implementation method are as follows: The aforementioned microscope simulation training system may further include a head sensor. The head sensor is connected to an information processing device. The head sensor is positioned on the user's head and is used to sense distance information between the head and the virtual microscope. An analysis module drives the image output module to switch between a first screen and a second screen based on whether the distance information is greater than a preset distance. The first screen is a full-screen display of the slide images on the display device. The second screen is a simultaneous display of the virtual microscope and a virtual hand on the display device.

Other implementations of the aforementioned implementation method are as follows: the aforementioned slide image is selected from a specific case in the database as a test subject.

Other embodiments of the aforementioned implementation are as follows: The aforementioned microscope simulation training system may further include another display device. The other display device is signal-connected to an image output module. The display device and the other display device synchronously display the virtual scene. The display device includes a mixed reality processing module. The mixed reality processing module is used to capture an image of the actual scene and process the actual scene image and the virtual scene to display a mixed reality image.

Other embodiments of the aforementioned implementation method are as follows: the aforementioned virtual hand can change one of the virtual slides of the virtual microscope in the virtual scene based on the gesture sensing information, and the analysis module obtains another of these slide images from the database and displays it in the virtual scene.

According to another embodiment of the present invention, a microscope simulation training method is provided, comprising an image acquisition step, a virtual scene display step, a sensing step, an analysis step, and a display step. The image acquisition step includes driving an information processing device to acquire one of a plurality of slide images from a database. The virtual scene display step includes driving an image output module of the information processing device to output a virtual scene. The virtual scene includes a virtual hand, a virtual microscope, and one of the slide images. The sensing step includes driving a sensor to sense the hand posture of a user and converting it into gesture sensing information. The user's hand gestures correspond to the virtual hand. The analysis process includes an analysis module of the driving information processing device analyzing the rotation amount and relative position information of the corresponding hand gesture based on the hand gesture sensing information, and converting it into an image magnification. The analysis module moves the virtual hand in the virtual scene based on the rotation amount and relative position information. The virtual hand, based on gesture sensing information, rotates one of the virtual microscope's virtual objective lens converters and one of its virtual adjustment knobs within a virtual scene. The analysis module scales these slide images according to the image magnification to generate a magnified virtual slide image, which is then displayed in the virtual scene. The display process includes driving a display device to receive and display the virtual scene. The information processing device is connected to the sensor, database, and display device.

Therefore, the microscope simulation training method of this invention generates virtual scenarios through a data processing device, allowing users to simulate microscope operation and providing a large amount of slide data for users to interpret and train.

Other embodiments of the aforementioned implementation are as follows: The aforementioned microscope simulation training method may further include a mode switching step. The mode switching step includes driving a head sensor to sense distance information between a head and a virtual microscope, and driving the image output module to switch the output between a first screen and a second screen based on whether the distance information is greater than a preset distance. The first screen is a full-screen display of these slide images on the display device, and the second screen is a simultaneous display of the virtual microscope and a virtual hand on the display device. The head sensor is positioned on the user's head and is signal-connected to an information processing device.

Other embodiments of the aforementioned implementation are as follows: The aforementioned microscope simulation training method may further include a mixed reality processing step and a synchronous display step. The mixed reality processing step includes driving a mixed reality processing module of the display device to capture a real-world scene image, and processing the real-world scene image and the virtual scene to display a mixed reality image. The synchronous display step includes driving the display device and another display device to synchronously display the virtual scene. The other display device is signal-connected to an image output module.

Other implementations of the aforementioned implementation method are as follows: the aforementioned slide image is selected from a specific case in the database as a test subject.

Other embodiments of the aforementioned implementation method are as follows: The aforementioned analysis steps may further include driving the analysis module to obtain another of these slide images from the database, the virtual hand further changing one of the virtual slides of the virtual microscope in the virtual scene based on gesture sensing information, and displaying the other of these slide images in the virtual scene.

Several embodiments of the present invention will be described below with reference to the drawings. For clarity, many practical details will be described in the following description. However, it should be understood that these practical details should not be used to limit the present invention. That is, these practical details are not essential in some embodiments of the present invention. Furthermore, for the sake of simplicity, some conventional structures and components will be shown in the drawings in a simple schematic manner; and repeated components may be represented by the same designation.

Furthermore, in this document, when a component (or unit or module, etc.) is "connected" to another component, it can mean that the component is directly connected to the other component, or that the component is indirectly connected to the other component, meaning that there is another component between the component and the other component. Only when it is explicitly stated that a component is "directly connected" to another component does it mean that there is no other component between the component and the other component. The terms "first," "second," and "third" are only used to describe different components and do not limit the components themselves; therefore, the first component can also be referred to as the second component. Moreover, the combinations of components/units/circuits in this document are not combinations that are generally known, conventional, or customary in this field. Whether the components/units/circuits themselves are customary cannot be used to determine whether their combination relationship is easily performed by someone with ordinary knowledge in the technical field.

Please refer to Figures 1 through 4. Figure 1 is a block diagram illustrating the microscope simulation training system 100 of the first embodiment of the present invention; Figure 2 is a scenario diagram illustrating the microscope simulation training system 100 according to Figure 1; Figure 3 is a schematic diagram illustrating the virtual scene 20 of the microscope simulation training system 100 according to Figure 1; and Figure 4 is another schematic diagram illustrating the virtual scene 20 of the microscope simulation training system 100 according to Figure 1. The microscope simulation training system 100 includes a sensor 110, a database 120, an information processing device 130, and a display device 140. Sensor 110 is used to sense the hand posture of a user 10 and convert it into gesture sensing information D1. Database 120 stores multiple slide images Im. Information processing device 130 is signal-connected to sensor 110 and database 120, and includes an analysis module 132 and an image output module 134. Analysis module 132 receives gesture sensing information D1, analyzes the rotation amount and relative position information of the corresponding hand posture based on gesture sensing information D1, and converts it into an image magnification. Image output module 134 is signal-connected to analysis module 132 and is used to output a virtual scene 20. The virtual scene 20 includes a virtual hand 21, a virtual microscope 22, and one of these slide images Im. The virtual hand 21 corresponds to the hand posture of the user 10. The display device 140 is signal-connected to the image output module 134 and is used to display the virtual scene 20 from the image output module 134. The analysis module 132 moves the virtual hand 21 within the virtual scene 20 based on rotation and relative position information. The virtual hand 21 rotates one of the virtual objective lens converters 221 and one of the virtual adjustment knobs 222 of the virtual microscope 22 within the virtual scene 20 based on the gesture sensing information D1. The analysis module 132 scales down these slide images Im according to the image magnification to generate a magnified virtual slide image Iv (see Figure 8), and displays the magnified virtual slide image Iv in the virtual scene 20.

Therefore, the microscope simulation training system 100 of this invention generates a virtual scene 20 through the information processing device 130, allowing the user 10 to simulate microscope operation and providing a large amount of slide data for the user 10 to interpret and train.

Specifically, sensor 110 may be an image sensing device or other non-wearable motion sensing device; database 120 may include random access memory (RAM) or other types of dynamic storage devices capable of storing information and instructions for execution by information processing device 130; information processing device 130 may include any type of processor, microprocessor, or smart device with virtual reality processor or mixed reality processor; display device 140 may include wearable virtual reality display, wearable mixed reality display, and projection display; slide image Im may be an image of bacterial staining smear, blood smear, or bone marrow smear corresponding to patients with different diseases, captured by high-magnification continuous microscopic digital photography, but the present invention is not limited thereto. Furthermore, the database 120 may include diagnostic reports and analytical test reports corresponding to the aforementioned slide image Im. Thus, the microscope simulation training system 100 of this invention, through a non-wearable sensor 110, senses the user 10's hand posture, simulating the microscope operation process without requiring a handheld sensor, thereby increasing the realism of the simulation. In one embodiment, the slide image Im and the magnified virtual slide image Iv may be displayed on a virtual display or in other areas of the virtual scene 20; this invention is not limited thereto.

Specifically, when user 10 trains using the microscope simulation training system 100, they can wear a wearable virtual helmet with a display device 140 on their head. The image output module 134 of the information processing device 130 outputs the virtual scene 20, as shown in Figure 3, to the display device 140, and the display device 140 displays the virtual scene 20. The virtual microscope 22 in the virtual scene 20 includes a virtual objective lens converter 221 and a virtual adjustment knob 222. The virtual objective lens converter 221 can be used to change the magnification of the objective lens for observing the slide image Im; the virtual adjustment knob 222 can be used to magnify the slide image Im. The virtual hand 21 can correspond to the hand movements of the user 10. When the user 10 moves their hand, the sensor 110 senses the hand movement of the user 10 and generates gesture sensing information D1, and transmits the gesture sensing information D1 to the analysis module 132 of the information processing device 130. The analysis module 132 adjusts the virtual hand 21 in the virtual scene 20 according to the hand posture of the user 10, so that the movement, displacement and rotation angle of the virtual hand 21 correspond to the hand posture of the user 10. Therefore, the user 10 can change the hand posture to correspond to the virtual hand 21 in the moving virtual scene 20 to the virtual objective lens converter 221 or the virtual adjustment knob 222, and make a hand rotation action to drive the virtual hand 21 to rotate the virtual objective lens converter 221 or the virtual adjustment knob 222, and display the magnified virtual slide image Iv in the virtual scene 20.

Therefore, the microscope simulation training system 100 of this invention simulates the actions of changing objectives, focusing, adjusting knobs, and searching for cell regions to be interpreted by the slide image Im through the virtual scene 20 displayed in the display device 140, thereby increasing the realism of the simulation training.

Please refer to Figures 1 through 5. Figure 5 is a flowchart illustrating the microscope simulation training method 300 of the second embodiment of the present invention. The microscope simulation training method 300 includes an image acquisition step S01, a virtual scene display step S02, a sensing step S03, an analysis step S04, and a display step S05. The details of the microscope simulation training method 300 will be described below in conjunction with the microscope simulation training system 100 shown in Figures 1 through 4.

The image acquisition step S01 includes the driving information processing device 130 acquiring one of a plurality of slide images Im from the database 120. The virtual scene display step S02 includes the image output module 134 of the driving information processing device 130 outputting a virtual scene 20. The sensing step S03 includes the driving sensor 110 sensing the user 10's hand posture and converting it into hand posture sensing information D1. The analysis step S04 includes the analysis module 132 of the driving information processing device 130 analyzing the rotation amount and relative position information of the corresponding hand posture based on the hand posture sensing information D1 and converting it into image magnification. Analysis module 132 moves the virtual hand 21 within the virtual scene 20 based on rotation and relative position information. The virtual hand 21 rotates either the virtual objective lens converter 221 or the virtual adjustment knob 222 of the virtual microscope 22 within the virtual scene 20 based on gesture sensing information D1. Analysis module 132 scales these slide images Im according to the image magnification to generate a magnified virtual slide image Iv, and displays the magnified virtual slide image Iv in the virtual scene 20. Display step S05 includes driving display device 140 to receive and display the virtual scene 20.

Please refer to Figures 1 through 4 and Figure 6. Figure 6 is a block diagram illustrating the microscope simulation training system 100a according to the third embodiment of the present invention. The microscope simulation training system 100a includes a sensor 110, a database 120, an information processing device 130, and a display device 140. In the third embodiment, the sensor 110, database 120, and information processing device 130 operate in the same manner as those in the first embodiment, and will not be described again. Notably, the microscope simulation training system 100a may further include a head sensor 150 and another display device 160. The display device 140 may further include a mixed reality processing module 141.

Please refer to Figures 2, 3, 6, and 7. Figure 7 is a flowchart illustrating the microscope simulation training method 300a of the fourth embodiment of the present invention. The microscope simulation training method 300a includes an image acquisition step S11, a virtual scene display step S12, a sensing step S13, an analysis step S14, a mixed reality processing step S15, a display step S16, a synchronous display step S17, and a mode switching step S18. In the fourth embodiment, the image acquisition step S11, virtual scene display step S12, sensing step S13, analysis step S14, and display step S16 of the microscope simulation training method 300a operate identically to the image acquisition step S01, virtual scene display step S02, sensing step S03, analysis step S04, and display step S05 of the microscope simulation training method 300 of the second embodiment, and will not be described in detail. Notably, the microscope simulation training method 300a may further include a mixed reality processing step S15, a synchronous display step S17, and a mode switching step S18.

Specifically, a head sensor 150 is connected to an information processing device 130. The head sensor 150 is disposed on the head of the user 10. A display device 160 is connected to an image output module 134. Another display device 160 is connected to the image output module 134.

Please refer to Figures 6 through 8. Figure 8 is a schematic diagram illustrating the first screen of the virtual scene 20 according to the microscope simulation training method 300a in Figure 7. The mode switching step S18 includes driving the head sensor 150 to sense a distance information D2 between the head and the virtual microscope 22, and driving the image output module 134 to switch the output between a first screen and a second screen based on whether the distance information D2 is greater than a preset distance. The first screen is the slide image Im displayed in full screen on the display device 140, and the second screen is the virtual microscope 22 and the virtual hand 21 displayed simultaneously on the display device 140. In Figure 8, the first screen may further include a virtual hand 21 manipulating a cursor 23 to move within the first screen. When the cursor 23 points to a specific cell in the magnified virtual slide image Iv, the relevant information of the specific cell and the zoom level operation instructions are displayed in the first screen.

The mixed reality processing step S15 includes driving a mixed reality processing module 141 of the display device 140 to capture a real-world scene image and processing the real-world scene image and the virtual scene 20 to display a mixed reality image. Specifically, the real-world scene image is a spatial image of the actual space where the user 10 is located, and the display device 140 presents objects other than the background in the virtual scene 20 (such as the virtual hand 21 and the virtual microscope 22) located in the actual scene where the user 10 is located through the mixed reality processing module 141.

The synchronized display step S17 includes driving the display device 140 and the display device 160 to simultaneously display the virtual scene 20. In this way, the virtual scene 20 can be displayed on both the wearable virtual reality display and the projection display at the same time, which makes it convenient for other personnel to observe the training status of the user 10.

Please refer to Figures 2, 3, 6 through 9. Figure 9 is a flowchart illustrating the microscope simulation training method 300b of the fifth embodiment of the present invention. In Figure 9, the microscope simulation training method 300b includes image acquisition step S11, virtual scene display step S12, steps S212, S213, S214, S215, S216, S217, S218, S219, and S220. In the fifth embodiment, the image acquisition step S11 and the virtual scene display step S12 operate identically to those of the image acquisition step S11 and the virtual scene display step S12 of the fourth embodiment, and will not be described again. After the image acquisition step S11 and virtual scene display step S12 are completed, and the virtual scene 20 is output through the image output module 134, step S212 drives the sensor 110 to sense the user 10's hand. Step S213 is used to determine whether the virtual objective lens converter 221 needs to be adjusted. When the user 10 moves his hand so that the virtual hand 21 in the virtual scene 20 moves closer to and rotates the virtual objective lens converter 221, step S214 is executed. When user 10 moves their hand, but the virtual hand 21 in the virtual scene 20 does not correspond to the virtual object mirror converter 221, step S215 is executed.

Step S214 adjusts the image magnification to match the magnification of the objective lens below the virtual objective lens converter 221.

Steps S215, S216, S217, and S218 correspond to the mode switching step S18 in Figure 7. Step S215 drives the head sensor 150 to detect the distance information D2 between the head and the virtual microscope 22. Steps S216, S217, and S218 drive the image output module 134 to switch between a first screen and a second screen based on whether the distance information D2 is greater than a preset distance. Step S216 determines whether the distance information D2 is less than the preset distance. When the distance information D2 is less than the preset distance, step S217 is executed. When the distance information D2 is greater than or equal to the preset distance, step S218 is executed. Step S217 drives the image output module 134 to output the first image and display it through the display device 140. Step S218 drives the image output module 134 to output the second image and display it through the display device 140.

In other words, when the user 10 approaches the virtual microscope 22 in the virtual scene 20 to a preset distance, the display device 140 automatically displays the slide image Im in full screen. In other embodiments of the invention, the user may also manually switch between the first and second images without using a head sensor, but the invention is not limited to this.

Step S219 involves the driver sensor 110 detecting the movement of the user 10's hand as it approaches the virtual adjustment knob 222. Step S220 involves adjusting the image magnification when the virtual hand 21 approaches and rotates the virtual adjustment knob 222, and outputting the magnified virtual slide image Iv, magnified according to the image magnification, in the virtual scene 20.

Please refer to Figures 10 and 11. Figure 10 is a schematic diagram of the virtual scene 20 according to the microscope simulation training method 300b in Figure 7; Figure 11 is another schematic diagram of the virtual scene 20 according to the microscope simulation training method 300b in Figure 7. The microscope simulation training method 300b may further include a driving analysis module 132 that obtains another of these slide images Im from the database 120, and the virtual hand 21 further changes the virtual slide 25 of the virtual microscope 22 in the virtual scene 20 according to the gesture sensing information D1, and displays another of these slide images Im corresponding to another virtual slide 25a in the virtual scene 20. As shown in Figure 10, when the user 10 wants to change the virtual slide 25 on the virtual microscope 22 in the virtual scene 20, they can bring the virtual hand 21 close to the virtual slide 25a in the virtual drawer 24 so that the virtual hand 21 can pick up the virtual slide 25a. In Figure 11, when the virtual hand 21 that picks up the virtual slide 25a is brought close to the virtual microscope 22, the virtual slide 25 on the virtual microscope 22 will be replaced with the virtual slide 25a.

In other embodiments of the present invention, the user may also issue voice commands to the sensor to change the virtual slide placed on the virtual microscope in the virtual scene. In addition, the user may also specify the disease category and cell type corresponding to the virtual slide to be replaced through voice commands, but the present invention is not limited thereto.

In other embodiments of this invention, the microscope simulation training method can also be used for testing. Therefore, a specific case from a database can be selected as a test topic; that is, the aforementioned slide image is selected from a specific case in the database, and this is used as the test topic for testing. For example, the examiner can select the test topic in an electronic device. The test topic could be, for example, microscope operation, symptom interpretation, disease identification, etc. The examiner can observe the user's operation or judge whether it is correct through a projection display. If the data processing device is a smartphone, the virtual scene can also be displayed on a computer screen, and this is not a limitation.

In other embodiments of the present invention, the user may also hold the handle, and the sensor may detect the user's hand posture through the handle and convert it into gesture sensing information, but the present invention is not limited to this.

As can be seen from the above embodiments, the present invention has the following advantages: First, the microscope simulation training system of the present invention generates virtual scenarios through a data processing device, allowing users to simulate microscope operation and providing a large amount of smear data for users to interpret and train; Second, the microscope simulation training system of the present invention uses non-wearable sensors to sense the user's hand posture, eliminating the need to hold a grip-type sensor to simulate microscope operation. The simulation process enhances realism; thirdly, the microscope simulation training system of this invention simulates the actions of changing objectives, focusing, adjusting knobs, and searching for cell regions to be interpreted by using a virtual scene displayed on the display device, thereby increasing the realism of the simulation training; fourthly, the virtual scene can be simultaneously displayed on a wearable virtual reality display and a projection display, which facilitates other personnel to observe the user's training status.

Although the invention has been disclosed above by way of implementation, it is not intended to limit the invention. Anyone skilled in the art may make various modifications and alterations without departing from the spirit and scope of the invention. Therefore, the scope of protection of the invention shall be determined by the appended patent application.

10: User 100, 100a: Microscope Simulation Training System 110: Sensor 120: Database 130: Information Processing Device 132: Analysis Module 134: Image Output Module 140, 160: Display Device 141: Mixed Reality Processing Module 150: Head Sensor 20: Virtual Scene 21: Virtual Hand 22: Virtual Microscope 221: Virtual Objective Converter 222: Virtual Adjustment Knob 23: Cursor 24: Virtual Drawer 25, 25a: Virtual Slide 300, 300a, 300b: Microscope Simulation Training Methods S01, S11: Image Acquisition Steps S02, S12: Virtual Scene Display Steps S03, S13: Sensing Steps S04, S14: Analysis Steps S05, S16: Display Steps S15: Mixed Reality Processing Steps S17: Synchronous Display Steps S18: Mode Switching Steps S212, S213, S214, S215, S216, S217, S218, S219, S220: Steps D1: Gesture Sensing Information D2: Distance Information Im: Slide Image IV: Magnified Virtual Slide Image

Figure 1 is a block diagram illustrating a microscope simulation training system according to a first embodiment of the present invention; Figure 2 is a schematic diagram illustrating a scenario of the microscope simulation training system according to Figure 1; Figure 3 is a schematic diagram illustrating a virtual scene of the microscope simulation training system according to Figure 1; Figure 4 is another schematic diagram illustrating a virtual scene of the microscope simulation training system according to Figure 1; Figure 5 is a flowchart illustrating a microscope simulation training method according to a second embodiment of the present invention; Figure 6 is a block diagram illustrating a microscope simulation training system according to a third embodiment of the present invention; Figure 7 is a flowchart illustrating the microscope simulation training method of the fourth embodiment of the present invention; Figure 8 is a schematic diagram illustrating the first view of the virtual scene of the microscope simulation training method according to Figure 7; Figure 9 is a flowchart illustrating the microscope simulation training method of the fifth embodiment of the present invention; Figure 10 is a schematic diagram illustrating the virtual scene of the microscope simulation training method according to Figure 7; and Figure 11 is another schematic diagram illustrating the virtual scene of the microscope simulation training method according to Figure 7.

100: Microscope Simulation Training System

110: Sensor

120:Database

130: Information processing device

132: Analysis Module

134: Image Output Module

140: Display device

D1: Gesture Sensing Information

Im: Slide Image

Claims (10)

A microscope simulation training system includes: a sensor for sensing a user's hand posture and converting it into hand gesture sensing information; a database for storing multiple slide images; an information processing device, signal-connected to the sensor and the database, and including: an analysis module for receiving the hand gesture sensing information, analyzing the hand posture's rotation and relative position information based on the hand gesture sensing information, and converting it into an image magnification; and An image output module, signal-connected to the analysis module, for outputting a virtual scene including one of a virtual hand, a virtual microscope, and images of glass slides, the virtual hand corresponding to the user's hand gesture; and a display device, signal-connected to the image output module, for displaying the virtual scene from the image output module; The analysis module moves the virtual hand within the virtual scene based on the rotation amount and relative position information. The virtual hand rotates one of the virtual objective lens converter and one of the virtual adjustment knobs of the virtual microscope within the virtual scene based on gesture sensing information. The analysis module scales one of the slide images according to the image magnification to generate a magnified virtual slide image, and displays the magnified virtual slide image in the virtual scene. The microscope simulation training system as described in claim 1 further comprises: a head sensor, signal-connected to the information processing device, the head sensor being disposed on one of the user's heads and used to sense distance information between the head and the virtual microscope; wherein, the analysis module drives the image output module to switch between a first screen and a second screen output based on whether the distance information is greater than the preset distance; wherein, the first screen is a full-screen display of one of the slide images on the display device, and the second screen is a simultaneous display of the virtual microscope and the virtual hand on the display device. The microscope simulation training system as described in claim 1, wherein the slide images are selected from a specific case in the database as a test subject. The microscope simulation training system as described in claim 1 further comprises: another display device, signal-connected to the image output module; wherein, the display device and the other display device synchronously display the virtual scene; wherein, the display device comprises: a mixed reality processing module for capturing an actual scene image and processing the actual scene image and the virtual scene to display a mixed reality image. As described in claim 1, in the microscope simulation training system, the virtual hand further changes one of the virtual slides of the virtual microscope in the virtual scene based on the gesture sensing information, and the analysis module obtains another of the slide images from the database and displays it in the virtual scene. A microscope simulation training method includes: An image acquisition step, comprising driving an information processing device to acquire one of a plurality of slide images from a database; A virtual scene display step, comprising driving an image output module of the information processing device to output a virtual scene, the virtual scene including a virtual hand, a virtual microscope, and one of the slide images; A sensing step, comprising driving a sensor to sense a hand gesture of a user and converting it into hand gesture sensing information, wherein the user's hand gesture corresponds to the virtual hand; One analysis step includes driving an analysis module of the information processing device to analyze a rotation amount and a relative position information corresponding to the hand posture based on the gesture sensing information, and converting it into an image magnification. The analysis module then moves the virtual hand within the virtual scene based on the rotation amount and the relative position information. Based on the gesture sensing information, the analysis module rotates one of the virtual objective lens converters and one of the virtual adjustment knobs of the virtual microscope within the virtual scene. The analysis module then scales one of the slide images according to the image magnification to generate a magnified virtual slide image, and displays the magnified virtual slide image in the virtual scene; A display step includes driving a display device to receive and display the virtual scene; Wherein, the information processing device is signal-connected to the sensor, the database, and the display device. The microscope simulation training method as described in claim 6 further includes: A mode switching step, comprising driving a head sensor to sense distance information between a head and the virtual microscope, and driving the image output module to switch output between a first screen and a second screen based on whether the distance information is greater than the preset distance; Wherein the first screen is a full-screen display of one of the slide images on the display device, and the second screen is a simultaneous display of the virtual microscope and the virtual hand on the display device; Wherein the head sensor is disposed on the user's head and signal-connected to the information processing device. The microscope simulation training method as described in claim 6 further comprises: a mixed reality processing step, comprising driving a mixed reality processing module of the display device to capture a real-world scene image, and processing the real-world scene image and the virtual scene to display a mixed reality image; a synchronous display step, comprising driving the display device and another display device to synchronously display the virtual scene; wherein, the other display device is signal-connected to the image output module. The microscope simulation training method as described in claim 6, wherein the slide images are selected from a specific case of the database as a test subject. The microscope simulation training method as described in claim 6, wherein the analysis step further includes: driving the analysis module to retrieve another of the slide images from the database, wherein the virtual hand further replaces one of the virtual slides of the virtual microscope in the virtual scene based on the gesture sensing information, and displays the other of the slide images in the virtual scene.