[go: up one dir, main page]

CN116616814B - A device and method for realizing ultrasonic imaging control and display - Google Patents

A device and method for realizing ultrasonic imaging control and display Download PDF

Info

Publication number
CN116616814B
CN116616814B CN202310560795.0A CN202310560795A CN116616814B CN 116616814 B CN116616814 B CN 116616814B CN 202310560795 A CN202310560795 A CN 202310560795A CN 116616814 B CN116616814 B CN 116616814B
Authority
CN
China
Prior art keywords
interest
region
ultrasound
user
display screen
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202310560795.0A
Other languages
Chinese (zh)
Other versions
CN116616814A (en
Inventor
张伟光
高明伟
雅克·苏凯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Yi Chao Medical Technology (Beijing) Co., Ltd.
Original Assignee
Yichao Medical Technology Beijing Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Yichao Medical Technology Beijing Co ltd filed Critical Yichao Medical Technology Beijing Co ltd
Priority to CN202310560795.0A priority Critical patent/CN116616814B/en
Publication of CN116616814A publication Critical patent/CN116616814A/en
Application granted granted Critical
Publication of CN116616814B publication Critical patent/CN116616814B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/54—Control of the diagnostic device
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/113—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for determining or recording eye movement
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/46—Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient
    • A61B8/461—Displaying means of special interest
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/46—Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient
    • A61B8/461—Displaying means of special interest
    • A61B8/462—Displaying means of special interest characterised by constructional features of the display
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/46—Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient
    • A61B8/461—Displaying means of special interest
    • A61B8/463—Displaying means of special interest characterised by displaying multiple images or images and diagnostic data on one display
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/46—Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient
    • A61B8/467—Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient characterised by special input means
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/46—Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient
    • A61B8/467—Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient characterised by special input means
    • A61B8/469—Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient characterised by special input means for selection of a region of interest
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/52—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Molecular Biology (AREA)
  • Animal Behavior & Ethology (AREA)
  • Biophysics (AREA)
  • Veterinary Medicine (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Public Health (AREA)
  • Surgery (AREA)
  • Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Pathology (AREA)
  • Radiology & Medical Imaging (AREA)
  • Human Computer Interaction (AREA)
  • Ophthalmology & Optometry (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Ultra Sonic Daignosis Equipment (AREA)

Abstract

The invention provides a device and a method for realizing ultrasonic imaging control and display, wherein the device comprises an ultrasonic probe which is placed at a corresponding part of a body of a checked person, transmits ultrasonic waves and receives echo signals, an ultrasonic control and imaging unit which calculates and processes the echo signals, converts the echo signals into ultrasonic images and transmits the ultrasonic images to an ultrasonic display screen for display, an eye movement tracking device which collects eye movement information of a user when the user views the ultrasonic images, an eye movement tracking unit which calculates the eye movement information to obtain a visual focus of the user, a region of interest of the user in the ultrasonic images is determined according to the visual focus, and an ultrasonic control and imaging unit which is used for determining a first adjusting parameter according to the region of interest of the user, generating a first target ultrasonic image and transmitting the first target ultrasonic image to the ultrasonic display screen for display. The method is convenient for realizing control and display of the corresponding ultrasonic image based on the eye movement information of the user, provides effective assistance for medical diagnosis, and is beneficial to improving diagnosis efficiency and accuracy.

Description

Device and method for realizing ultrasonic imaging control and display
Technical Field
The invention relates to the technical field of display control, in particular to a device and a method for realizing ultrasonic imaging control and display.
Background
At present, the scanning flow of an ultrasonic doctor is as follows, 1. Equipment is prepared, namely the ultrasonic doctor needs to prepare the ultrasonic equipment firstly, and the ultrasonic equipment comprises the steps of connecting a probe, opening the equipment, adjusting image parameters and the like. 2. The preparation of the patient comprises the steps that an ultrasonic doctor needs to inquire and check the patient, confirm the information of medical history, complaints, symptoms and the like of the patient, and enable the patient to take corresponding body positions (such as supine position, lateral position and the like). 3. Gel application-the sonographer will apply a layer of gel to the probe to create intimate contact between the probe and the patient's skin to better deliver the ultrasound. 4. Scanning images, namely, an ultrasonic doctor places a probe on a corresponding part of a patient body, gradually scans the parts of internal organs, tissues, blood vessels and the like of the patient by controlling operation buttons of the ultrasonic equipment, and simultaneously observes and records the scanned images and data. 5. Interpretation and diagnosis, namely, according to the scanning result, an ultrasonic doctor can interpret and diagnose the illness state of a patient and give treatment suggestions and schemes according to requirements. 6. The data is arranged, that is, the ultrasonic doctor needs to arrange the scanning result and the diagnosis record and store the scanning result and the diagnosis record in the medical record data of the patient for later reference and tracking. In step 5, the sonographer diagnoses the patient by image, step 1. Observe image features that the sonographer needs to observe scanned image features such as size, morphology, structure, texture, etc. of the organ, and whether abnormal signals, echoes, flow signals, etc. are present. 2. And comparing the normal images, wherein an ultrasonic doctor needs to compare the normal images to judge whether abnormal changes exist in organs or tissues, such as whether nodules, tumors, liquid accumulation and the like exist. 3. Analyzing the image data, the sonographer needs to analyze the scanned image data, such as measuring the size, morphology, location, etc. of organs or tissues, and analyzing the blood flow velocity, degree of vascular lesions, etc. 4. And comprehensively judging the observed image characteristics, the comparison result and the data analysis result by an ultrasonic doctor to obtain a final diagnosis conclusion and a treatment suggestion. It should be noted that the diagnosis and judgment of an sonographer is primarily dependent on his experience and expertise, and thus requires a high medical background and expertise, while maintaining constant learning and updated knowledge.
In the prior art, when an ultrasonic doctor diagnoses through images, the ultrasonic doctor needs to mark the region of interest and corresponding parameters, the operation is extremely troublesome, the operation is inconvenient, and an eye tracking technology is provided for automatically sensing the region of interest of the ultrasonic doctor. Eye tracking technology is a technology that reflects the human visual cognitive process by tracking eye movements. The eye movement track can be recorded to analyze the gazing position and gazing time of people when watching the media such as images, characters, videos and the like and the process of attention distribution, so that the visual cognition process of the people is known. When the eye movement tracking technology is applied to medical diagnosis, the eye movement track of a patient in a visual task is recorded to diagnose and treat diseases such as eye movement disorder, cognitive disorder and the like. There are two main implementations of eye tracking technology, contact and non-contact. The contact type eye movement tracking needs to use special equipment, such as an eye movement instrument, and the eye movement track is recorded through a contact type probe, while the non-contact type eye movement tracking can directly use equipment such as a computer or a camera to record the eye movement track through detection of the characteristics of the position of an eye ball, the pupil size and the like. With the continuous development of the motion tracking technology, the motion tracking technology has become a widely applied research field, and brings more convenience and benefit for life and work of people.
Patent CN 112578903A describes a detailed implementation of an eye tracking technique, which calculates whether the observer is saccadic or not, and the position of the eye gaze point, by observing the movement and tracking of the pupil position of the subject's eye.
Patent CN114817021a uses eye tracking technology to evaluate man-machine interface. By combining the time of capturing the user behavior, thermodynamic diagrams and track diagrams can be generated according to eye movement data after the experiment is finished, and data such as first fixation time, residence time, first fixation duration time and the like of elements are counted, the evaluation of accessing an HMI system can be supported without additional development of an HMI end, additional development workload is reduced, and quick test and iteration of an HMI prototype are facilitated.
The CN115116303a patent uses eye tracking technology to track the vision position of the reading impaired child and attracts the vision of the reading child reader to assist the reading, training the reading concentration of the child reader.
In the prior art, the region of interest cannot be automatically acquired through the eye movement information of the user, and corresponding image optimization, marking, analysis and recording are performed, so that effective assistance is provided for medical diagnosis, and the improvement of diagnosis efficiency and accuracy is not facilitated.
Disclosure of Invention
The present invention aims to solve, at least to some extent, one of the technical problems in the above-described technology. To this end, a first object of the present invention is to propose a device for implementing ultrasound imaging control and display, which acquires in real time the user's point of interest on the ultrasound display screen and the line-of-sight movement during the user diagnosis and scanning process. The method has the advantages that the region of interest is automatically acquired through the eye movement information of the user, and corresponding image optimization, marking, analysis and recording are performed, so that the corresponding ultrasonic image can be conveniently controlled and displayed based on the eye movement information of the user, effective assistance is provided for medical diagnosis, and the diagnosis efficiency and accuracy are improved.
A second object of the invention is to propose a method for implementing ultrasound imaging control and display.
To achieve the above object, an embodiment of a first aspect of the present invention provides an apparatus for implementing ultrasound imaging control and display, including:
the ultrasonic probe is used for being placed at the corresponding part of the body of the checked person, transmitting ultrasonic waves, receiving echo signals and transmitting the echo signals to the ultrasonic control and imaging unit;
the ultrasonic control and imaging unit is used for calculating and processing the echo signals, converting the echo signals into ultrasonic images and transmitting the ultrasonic images to an ultrasonic display screen for display;
the eye movement tracking device is used for collecting eyeball movement information of a user when the user views the ultrasonic image;
the eye movement tracking unit is used for calculating the eyeball movement information to obtain a visual focus of a user, determining an interesting region of the user in the ultrasonic image according to the visual focus and sending the interesting region to the ultrasonic control and imaging unit;
And the ultrasonic control and imaging unit is used for determining a first adjusting parameter according to the region of interest of the user, generating a first target ultrasonic image and transmitting the first target ultrasonic image to the ultrasonic display screen for display.
According to some embodiments of the invention, further comprising:
the device input unit is used for receiving an input instruction of a user, correcting the region of interest according to the input instruction, obtaining a corrected region of interest and sending the corrected region of interest to the ultrasonic control and imaging unit;
and the ultrasonic control and imaging unit is used for determining a second adjusting parameter according to the corrected region of interest, generating a second target ultrasonic image and transmitting the second target ultrasonic image to the ultrasonic display screen for display.
According to some embodiments of the invention, the ultrasound display screen includes an ultrasound image area, a parameter area, and an information area when displaying an ultrasound image.
According to some embodiments of the invention, the eye tracking unit comprises:
The acquisition module is used for acquiring the position P (t) of the visual focus of the user under the coordinate system of the ultrasonic display screen according to the eyeball movement information;
the conversion module is used for converting the position P (t) under the coordinate system of the ultrasonic display screen into a region of interest (ROI (t);
The calculation module is used for calculating the position ROI , (t) of the region of interest in the ultrasonic probe coordinate system according to the coordinate correspondence between the ultrasonic image displayed on the ultrasonic display screen and the position P (t) of the visual focus in the ultrasonic display screen coordinate system;
a determining module for:
Performing image optimization, multi-mode display, parameter measurement and calculation on a position ROI , (t) of the region of interest in an ultrasonic probe coordinate system, and determining a position ROI , (t) of the processed region of interest in the ultrasonic probe coordinate system;
And determining the region of interest of the user in the ultrasonic image according to the region of interest ROI (t) in the ultrasonic display screen coordinate system and the processed position ROI , (t) in the ultrasonic probe coordinate system.
According to some embodiments of the present invention, an ultrasound display screen, when displaying a region of interest of a user, includes determining an image, parameters, and information of the region of interest and displaying the image, parameters, and information on the ultrasound display screen.
According to some embodiments of the invention, the eye tracking unit further comprises:
The judging module is used for counting time-varying parameters of the position P (t) of the visual focus of the user under the ultrasonic display screen coordinate system before the converting module converts the position P (t) under the ultrasonic display screen coordinate system into the region of interest (ROI (t);
Comparing the change parameter with a preset threshold value, and when the change parameter is determined to be smaller than the preset threshold value, indicating that the sight focus position of the user is not large in the dt time period, considering that the region of interest of the user is in the t moment Wherein, the preset area of the pattern is defined,Is the mean coordinate of P (t) during the dt period.
According to some embodiments of the invention, the variation parameter may be described by a covariance coefficient of the P (t) location sequence over the dt period;
wherein DP (t) is the covariance coefficient of the P (t) position sequence.
According to some embodiments of the invention, the conversion module comprises:
A first converter sub-module for:
according to the position P (t) under the ultrasonic display screen coordinate system, a center point CP (t) is determined, the variance sigma (t) is used as the origin of Gaussian distribution, range information is determined, and then a region of interest ROI (t) described by a Gaussian model is determined;
Or (b)
A second conversion sub-module for:
Determining a mean of the sequence of sampling positions P (t 1), P (t 2), P (t 3.) over a period of dt As a center point CP (t);
estimating a range of the region of interest based on a distribution range of the sequence of sample locations;
From the center point CP (t) and the range, a region of interest ROI (t) is determined.
To achieve the above object, an embodiment of a second aspect of the present invention provides a method for implementing ultrasound imaging control and display, including:
Transmitting ultrasonic waves and receiving echo signals based on an ultrasonic probe placed at a corresponding part of the body of the inspected person, and transmitting the echo signals to an ultrasonic control and imaging unit;
calculating and processing the echo signals based on an ultrasonic control and imaging unit, converting the echo signals into ultrasonic images, and transmitting the ultrasonic images to an ultrasonic display screen for display;
Acquiring eyeball movement information of a user when the user views an ultrasonic image based on the eye movement tracking device;
The eye movement tracking unit calculates the eyeball movement information to obtain a visual focus of a user, determines an interesting region of the user in the ultrasonic image according to the visual focus and sends the interesting region to the ultrasonic control and imaging unit;
the ultrasonic control and imaging unit determines a first adjustment parameter according to the region of interest of the user, generates a first target ultrasonic image, and transmits the first target ultrasonic image to the ultrasonic display screen for display.
According to some embodiments of the present invention, the eye movement tracking unit calculates the eye movement information to obtain a visual focus of a user, and determines a region of interest of the user in the ultrasound image according to the visual focus, including:
Acquiring the position P (t) of a visual focus of a user under an ultrasonic display screen coordinate system according to eyeball movement information;
Converting the position P (t) under the coordinate system of the ultrasonic display screen into a region of interest (ROI (t);
calculating a position ROI , (t) of the region of interest in an ultrasonic probe coordinate system according to the coordinate correspondence between the displayed ultrasonic image on the ultrasonic display screen and the position P (t) of the visual focus in the ultrasonic display screen coordinate system;
Performing image optimization, multi-mode display, parameter measurement and calculation on a position ROI , (t) of the region of interest in an ultrasonic probe coordinate system, and determining a position ROI , (t) of the processed region of interest in the ultrasonic probe coordinate system;
And determining the region of interest of the user in the ultrasonic image according to the region of interest ROI (t) in the ultrasonic display screen coordinate system and the processed position ROI , (t) in the ultrasonic probe coordinate system.
The beneficial effects are that:
(1) The invention utilizes the eye movement tracking equipment to automatically acquire the attention point of the sight line of the user on the ultrasonic display screen as the interested area in the scanning process of the ultrasonic doctor. Compared with the existing manual marking method, the manual marking method can greatly save physical strength and time of doctors and improve scanning efficiency.
(2) Based on the automatic labeling of the region of interest, the image of the region of interest can be automatically optimized, such as focal position, sound velocity, high-definition amplification and the like, so that the operation flow of doctors is simplified, and more energy is used for patient communication and diagnosis.
The automatic image optimization strategy of the region of interest can be executed according to a pre-configured strategy, and can also be combined with a statistical method to carry out individual identification on the operation habit of a doctor so as to configure different strategies for different users.
(3) In combination with other user input methods such as voice input and the like, automatic region of interest labeling can improve the use efficiency of the user in more aspects.
(4) The corresponding relation between the visual focus and the image is very important diagnosis information in the ultrasonic inspection process of the user, and can be used for demonstration, teaching and communication.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention may be realized and attained by the structure particularly pointed out in the written description and drawings.
The technical scheme of the invention is further described in detail through the drawings and the embodiments.
Drawings
The accompanying drawings are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate the invention and together with the embodiments of the invention, serve to explain the invention. In the drawings:
FIG. 1 is a schematic diagram of an apparatus for implementing ultrasound imaging control and display in accordance with one embodiment of the present invention;
FIG. 2 is a flow chart of determining a region of interest of a user in an ultrasound image in accordance with one embodiment of the present invention;
FIG. 3 is a display schematic of an ultrasound display screen according to one embodiment of the invention;
fig. 4 is a flow chart of a method of implementing ultrasound imaging control and display in accordance with one embodiment of the present invention.
Reference numerals:
An ultrasound display screen 101, an ultrasound image area 201, an information area 202, a parameter area 203, a region of interest 208, an ultrasound control and imaging unit 102, a device input unit 103, an ultrasound probe 104, an eye-tracking unit 108, an eye-tracking apparatus 110, a user 120, an examinee 121.
Detailed Description
The preferred embodiments of the present invention will be described below with reference to the accompanying drawings, it being understood that the preferred embodiments described herein are for illustration and explanation of the present invention only, and are not intended to limit the present invention.
As shown in fig. 1, an embodiment of a first aspect of the present invention proposes an apparatus for implementing ultrasound imaging control and display, including:
an ultrasonic probe 104 for being placed at a corresponding part of the body of the subject 121, transmitting ultrasonic waves and receiving echo signals, and transmitting the echo signals to the ultrasonic control and imaging unit 102;
the ultrasonic control and imaging unit 102 is used for calculating and processing the echo signals, converting the echo signals into ultrasonic images, and transmitting the ultrasonic images to the ultrasonic display screen 101 for display;
An eye tracking device 110 for acquiring eye movement information of a user 120 while viewing an ultrasound image;
an eye movement tracking unit 108, configured to calculate the eye movement information to obtain a visual focus of the user, determine a region of interest 208 of the user in the ultrasound image according to the visual focus, and send the region of interest 208 to the ultrasound control and imaging unit 102;
The ultrasound control and imaging unit 102 is configured to determine a first adjustment parameter according to a region of interest 208 of a user, generate a first target ultrasound image, and transmit the first target ultrasound image to the ultrasound display screen 101 for display.
The working principle of the technical scheme is that in the embodiment, the corresponding parts comprise internal organs, tissues, blood vessels and the like.
In this embodiment, the eye tracking device 110 is at least one of an eye tracker, a computer, or a camera. The eye movement track is recorded by a contact probe based on an eye movement instrument, and the eye movement track is recorded by detecting the characteristics of the position of an eye ball, the pupil size and the like by using equipment such as a computer or a camera.
In this embodiment, the region of interest 208 is a region of interest that is of greater interest to the user and is of great interest to view. The user, typically an sonographer or an examination technician.
In this embodiment, the first adjustment parameters include a display parameter, sharpness, etc. that enlarges the region of interest 208. The first target ultrasound image is an adjusted ultrasound image that displays the corresponding region of interest 208.
Specifically, the user (typically an sonographer or an inspection technician) operates the ultrasound probe 104 to scan and diagnose the inspected person 121. The ultrasonic probe 104 transmits ultrasonic waves to the subject 121, receives echo signals, transmits to the ultrasonic control and imaging unit 102 for calculation and processing, converts the echo signals into images, and displays them on the ultrasonic display screen 101.
The eye movement information of the user is collected through the eye movement tracking device 110, the eye movement tracking unit 108 calculates the eye movement information to obtain the visual focus attention point of the user, the region of interest 208 of the user is obtained through calculation, the ultrasonic control and imaging unit 102 performs feedback control on the ultrasonic system, and the finally obtained image or other information is displayed on the ultrasonic display screen 101.
One very important interaction in the process of a physician diagnosing a patient by ultrasound imaging is to mark the region of interest 208. The primary purpose of marking the region of interest 208 is (1) to make a comprehensive, deep view of the image of the region of interest 208, thereby better diagnosing the disease. Such as manually demarcating the region of interest 208 via an input device such as a mouse or a trackball, further optimizing or magnifying the image within the region of interest, or observing other tissue features within the region of interest 208, such as blood flow conditions, tissue stiffness information, etc. within the region of interest 208. (2) The image of the region of interest 208 is marked and analyzed. Such as outlining the region of interest 208, marking the region of interest 208 with text descriptions as critical information for the case, or measuring certain parameters within the region of interest 208, etc. (3) For recording the position and change information of the region of interest 208 of interest to the sonographer during scanning and diagnosis, for presentation and teaching purposes, etc.
The technical scheme has the beneficial effects that the device for realizing ultrasonic imaging control and display is provided, and the attention point and the sight line moving process of a user on the ultrasonic display screen 101 are acquired in real time in the diagnosis and scanning processes of the user. The region of interest 208 is automatically acquired through the eye movement information of the user, and corresponding image optimization, marking, analysis and recording are performed, so that the corresponding ultrasonic image is conveniently controlled and displayed based on the eye movement information of the user, effective assistance is provided for medical diagnosis, and the diagnosis efficiency and accuracy are improved. (1) The present invention utilizes an eye tracking device to automatically acquire the point of interest of the user's line of sight on the ultrasound display screen 101 as the region of interest 208 during the ultrasound physician's scanning. Compared with the existing manual marking method, the manual marking method can greatly save physical strength and time of doctors and improve scanning efficiency. (2) Based on the automatic labeling of the region of interest 208, the image of the region of interest 208 may be automatically optimized, such as focal position, sound velocity, high definition magnification, etc., simplifying the doctor's procedure, thereby applying more effort to patient communication and diagnosis. The automatic image optimization strategy of the region of interest 208 can be executed according to a pre-configured strategy, or can be combined with a statistical method to perform individual identification on the operation habit of a doctor, so as to configure different strategies for different users. (3) Automatic labeling of the region of interest 208 in combination with other user input methods, such as voice input, may improve the efficiency of use for the user in more respects. (4) The corresponding relation between the visual focus and the image is very important diagnosis information in the ultrasonic inspection process of the user, and can be used for demonstration, teaching and communication.
According to some embodiments of the invention, further comprising:
The device input unit 103 is configured to receive an input instruction of a user, correct the region of interest 208 according to the input instruction, obtain a corrected region of interest 208, and send the corrected region of interest 208 to the ultrasound control and imaging unit 102;
the ultrasound control and imaging unit 102 is configured to determine a second adjustment parameter according to the corrected region of interest 208, generate a second target ultrasound image, and transmit the second target ultrasound image to the ultrasound display screen 101 for display.
In this embodiment, the corrected region of interest 208 is the region of interest 208 obtained by correcting the region of interest 208 based on the input instruction of the user.
In this embodiment, the second adjustment parameters include display parameters, sharpness, etc. of the region of interest 208 for the enlarged correction. The second target ultrasound image is an adjusted ultrasound image that displays the corresponding modified region of interest 208.
The technical scheme has the beneficial effects that the region of interest 208 determined according to the eyeball motion information and based on the input instruction is corrected, so that a mode of combining machine identification and manual input is realized, the region of interest 208 can be accurately corrected conveniently, the display can be further carried out, and the diagnosis accuracy can be improved conveniently.
As shown in fig. 3, according to some embodiments of the present invention, the ultrasound display screen 101 includes an ultrasound image area 201, a parameter area 203, and an information area 202 when displaying an ultrasound image.
The working principle of the above technical solution is that in this embodiment, the information Area 202;ultrasound image Area represents the ultrasound image Area 201;parameter Area represents the parameter Area 203. The region of interest ROI is located in the ultrasound image region 201.
The technical scheme has the beneficial effects that different information is displayed in different areas when the ultrasonic image is displayed on the ultrasonic display screen 101, so that the accuracy of image display is improved, and the user can conveniently check the image.
As shown in fig. 2, the eye tracking unit 108, according to some embodiments of the invention, includes:
The acquisition module is used for acquiring the position P (t) of the visual focus of the user under the coordinate system of the ultrasonic display screen 101 according to the eyeball movement information;
The conversion module is used for converting the position P (t) under the coordinate system of the ultrasonic display screen 101 into a region of interest (ROI (t);
A calculating module, configured to calculate a position ROI , (t) of the region of interest 208 in the coordinate system of the ultrasound probe 104 according to the coordinate correspondence between the displayed ultrasound image on the ultrasound display screen 101 and the position P (t) of the visual focus in the coordinate system of the ultrasound display screen 101;
a determining module for:
Performing image optimization, multi-mode display, parameter measurement and calculation on the position ROI , (t) of the region of interest 208 in the coordinate system of the ultrasonic probe 104, and determining the position ROI , (t) of the processed region of interest 208 in the coordinate system of the ultrasonic probe 104;
the region of interest 208 of the user in the ultrasound image is determined from the region of interest ROI (t) in the ultrasound display screen 101 coordinate system and the processed location ROI , (t) in the ultrasound probe 104 coordinate system.
In this embodiment, one feature of the region of interest ROI (t) is a region where the user's visual focus stays and focuses, which is determined by the visual focus P (t) of the eye tracker in the screen coordinate system.
The technical scheme has the beneficial effects that the region of interest 208 of the user in the ultrasonic image is determined according to the region of interest ROI (t) in the coordinate system of the ultrasonic display screen 101 and the processed position ROI (t) in the coordinate system of the ultrasonic probe 104. The region of interest 208 in different coordinate systems is determined, which is convenient to view and adjust, and improves the diagnostic rate.
According to some embodiments of the present invention, the ultrasound display screen 101, when displaying the region of interest 208 of the user, includes determining images, parameters, and information of the region of interest 208 and displaying on the ultrasound display screen 101.
The technical scheme has the beneficial effects that the user can check conveniently, and diagnosis is facilitated.
According to some embodiments of the invention, the eye tracking unit 108 further comprises:
The judging module is used for counting time-varying parameters of the position P (t) of the visual focus of the user under the coordinate system of the ultrasonic display screen 101 before the converting module converts the position P (t) under the coordinate system of the ultrasonic display screen 101 into the region of interest ROI (t);
Comparing the change parameter with a preset threshold value, and when the change parameter is determined to be smaller than the preset threshold value, indicating that the sight focus position of the user is not large in the dt time period, considering that the user interested area 208 is in the t time point Wherein, the preset area of the pattern is defined,Is the mean coordinate of P (t) during the dt period.
According to some embodiments of the invention, the variation parameter may be described by a covariance coefficient of the P (t) location sequence over the dt period;
wherein DP (t) is the covariance coefficient of the P (t) position sequence.
The working principle of the technical scheme is that the judging module is used for counting time-varying parameters of the position P (t) of the visual focus of the user under the coordinate system of the ultrasonic display screen 101 before the converting module converts the position P (t) under the coordinate system of the ultrasonic display screen 101 into the region of interest 208ROI (t), a time window dt is set, the time-varying condition of the P (t) along with time in a time period from t to t+dt, namely the varying parameters, can be described by using covariance of a P (t) position sequence in the time period dt to describe the coefficient DP (t). Comparing the change parameter with a preset threshold, and when the change parameter is determined to be smaller than the preset threshold, indicating that the focus position of the sight line of the user is not large in the dt time period, considering that the sight line of the user is in the sight line of the user at the moment tNearby stay, thereby determining the presence of the user region of interest 208The preset area is defined byThe center is a circular area with a preset distance being a radius, and is not particularly limited herein.
The above technical solution has the advantage of facilitating accurate determination of the user's region of interest 208 at a certain time.
According to some embodiments of the invention, the conversion module comprises:
A first converter sub-module for:
According to the position P (t) under the coordinate system of the ultrasonic display screen 101, a center point CP (t) is determined, the variance sigma (t) is used as the origin of Gaussian distribution, range information is determined, and then a region of interest ROI (t) described by a Gaussian model is determined;
Or (b)
A second conversion sub-module for:
Determining a mean of the sequence of sampling positions P (t 1), P (t 2), P (t 3.) over a period of dt As a center point CP (t);
estimating a range of the region of interest 208 based on a distribution range of the sequence of sample locations;
From the center point CP (t) and the range, a region of interest ROI (t) is determined.
The working principle of the above technical solution is that, according to the characteristics of the human visual area, the region of interest 208 at which the user looks should be a region that spreads around with the visual focus as the center. The resolution of the central region of the region of interest ROI (t) is highest and the resolution of the peripheral region gradually decreases. The ROI (t) region location can be described by a gaussian model, the center point CP (t) is the origin of the gaussian distribution, and the variance σ (t) determines the range of the ROI. It may also be represented by a set of screen coordinates { P1, P2, P3 }. The center point CP (t) and the range of the ROI (t) may be calculated with a P (t) sequence over a period of time, and the sampling position sequence P (t 1), P (t 2), P (t 3) & average-P (t) may be used as an implementation of the center point CP (t). While the distribution range of the sequence of sample positions can be used to estimate the range of the region of interest 208.
The beneficial effect of the above technical solution is that the ROI (t) of the region of interest 208 is accurately determined based on the two modes.
As shown in fig. 4, an embodiment of the second aspect of the present invention proposes a method for implementing ultrasound imaging control and display, including steps S1 to S5:
S1, transmitting ultrasonic waves and receiving echo signals based on an ultrasonic probe 104 placed at a corresponding part of the body of a checked person 121, and transmitting the echo signals to an ultrasonic control and imaging unit 102;
S2, calculating and processing the echo signals based on the ultrasonic control and imaging unit 102, converting the echo signals into ultrasonic images, and transmitting the ultrasonic images to the ultrasonic display screen 101 for display;
S3, acquiring eyeball movement information of a user based on the eye movement tracking device 110 when the user views the ultrasonic image;
S4, the eye movement information is calculated by the eye movement tracking unit 108 to obtain a visual focus of a user, a region of interest 208 of the user in the ultrasonic image is determined according to the visual focus, and the region of interest 208 is sent to the ultrasonic control and imaging unit 102;
S5, the ultrasonic control and imaging unit 102 determines a first adjustment parameter according to the region of interest 208 of the user, generates a first target ultrasonic image, and transmits the first target ultrasonic image to the ultrasonic display screen 101 for display.
The technical scheme has the beneficial effects that the method for realizing ultrasonic imaging control and display is provided, and the attention point and the sight line moving process of the user on the ultrasonic display screen 101 are acquired in real time in the diagnosis and scanning process of the user. The region of interest 208 is automatically acquired through the eye movement information of the user, and corresponding image optimization, marking, analysis and recording are performed, so that the corresponding ultrasonic image is conveniently controlled and displayed based on the eye movement information of the user, effective assistance is provided for medical diagnosis, and the diagnosis efficiency and accuracy are improved. (1) The present invention utilizes an eye tracking device to automatically acquire the point of interest of the user's line of sight on the ultrasound display screen 101 as the region of interest 208 during the ultrasound physician's scanning. Compared with the existing manual marking method, the manual marking method can greatly save physical strength and time of doctors and improve scanning efficiency. (2) Based on the automatic labeling of the region of interest 208, the image of the region of interest 208 may be automatically optimized, such as focal position, sound velocity, high definition magnification, etc., simplifying the doctor's procedure, thereby applying more effort to patient communication and diagnosis. The automatic image optimization strategy of the region of interest 208 can be executed according to a pre-configured strategy, or can be combined with a statistical method to perform individual identification on the operation habit of a doctor, so as to configure different strategies for different users. (3) Automatic labeling of the region of interest 208 in combination with other user input methods, such as voice input, may improve the efficiency of use for the user in more respects. (4) The corresponding relation between the visual focus and the image is very important diagnosis information in the ultrasonic inspection process of the user, and can be used for demonstration, teaching and communication.
According to some embodiments of the present invention, the eye movement tracking unit 108 calculates the eye movement information to obtain a visual focus of the user, and determines a region of interest 208 of the user in the ultrasound image according to the visual focus, including:
Acquiring the position P (t) of the visual focus of the user under the coordinate system of the ultrasonic display screen 101 according to the eyeball movement information;
converting the position P (t) under the coordinate system of the ultrasonic display screen 101 into a region of interest ROI (t);
Calculating a position ROI , (t) of the region of interest 208 in the coordinate system of the ultrasonic probe 104 according to the coordinate correspondence relation between the ultrasonic image displayed on the ultrasonic display screen 101 and the position P (t) of the visual focus in the coordinate system of the ultrasonic display screen 101;
Performing image optimization, multi-mode display, parameter measurement and calculation on the position ROI , (t) of the region of interest 208 in the coordinate system of the ultrasonic probe 104, and determining the position ROI , (t) of the processed region of interest 208 in the coordinate system of the ultrasonic probe 104;
the region of interest 208 of the user in the ultrasound image is determined from the region of interest ROI (t) in the ultrasound display screen 101 coordinate system and the processed location ROI , (t) in the ultrasound probe 104 coordinate system.
The technical scheme has the beneficial effects that the region of interest 208 of the user in the ultrasonic image is determined according to the region of interest ROI (t) in the coordinate system of the ultrasonic display screen 101 and the processed position ROI (t) in the coordinate system of the ultrasonic probe 104. The region of interest 208 in different coordinate systems is determined, which is convenient to view and adjust, and improves the diagnostic rate.
It will be apparent to those skilled in the art that various modifications and variations can be made to the present invention without departing from the spirit or scope of the invention. Thus, it is intended that the present invention also include such modifications and alterations insofar as they come within the scope of the appended claims or the equivalents thereof.

Claims (4)

1.一种实现超声成像控制和显示的装置，其特征在于，包括：1. A device for realizing ultrasonic imaging control and display, characterized in that it comprises: 超声探头，用于放置在被检查者身体相应部位，发射超声波及接收回波信号，并将回波信号传输至超声控制和成像单元；An ultrasonic probe is used to be placed at a corresponding part of the body of the person being examined, emit ultrasonic waves and receive echo signals, and transmit the echo signals to an ultrasonic control and imaging unit; 超声控制和成像单元，用于对所述回波信号进行计算和处理，将回波信号转化为超声图像，并传输至超声显示屏幕进行显示；An ultrasound control and imaging unit, used to calculate and process the echo signal, convert the echo signal into an ultrasound image, and transmit it to an ultrasound display screen for display; 眼动跟踪装置，用于在用户查看超声图像时，采集用户的眼球运动信息；An eye tracking device, used to collect eye movement information of the user when the user views the ultrasound image; 眼动跟踪单元，用于对所述眼球运动信息进行计算，得到用户的视觉焦点，根据视觉焦点确定超声图像中用户的感兴趣区域，并发送至超声控制和成像单元；An eye tracking unit, used to calculate the eye movement information to obtain the user's visual focus, determine the user's area of interest in the ultrasound image according to the visual focus, and send the area to the ultrasound control and imaging unit; 超声控制和成像单元，用于根据用户的感兴趣区域，确定第一调节参数，生成第一目标超声图像，并传输至超声显示屏幕进行显示；An ultrasound control and imaging unit, used to determine a first adjustment parameter according to a region of interest of a user, generate a first target ultrasound image, and transmit the image to an ultrasound display screen for display; 超声显示屏幕在对用户的感兴趣区域进行显示时，包括：确定感兴趣区域的图像、参数和信息并显示在超声显示屏幕上；When the ultrasound display screen displays the region of interest of the user, the steps include: determining the image, parameters and information of the region of interest and displaying them on the ultrasound display screen; 对感兴趣区域进行标记，对感兴趣区域内的图像进行进一步的优化或者放大；在感兴趣区域内对组织特征进行观察；对感兴趣区域的图像进行标记和分析，勾勒感兴趣区域的范围，对感兴趣区域标记文字说明，作为病例的关键信息；或者对感兴趣区域内的参数进行测量；记录超声医生在扫查和诊断过程中，关注的感兴趣区域的位置和变化信息；Mark the region of interest, further optimize or magnify the image in the region of interest; observe tissue characteristics in the region of interest; mark and analyze the image of the region of interest, outline the scope of the region of interest, mark the region of interest with text descriptions as key information of the case; or measure the parameters in the region of interest; record the location and change information of the region of interest that the ultrasound doctor pays attention to during the scanning and diagnosis process; 所述眼动跟踪单元，还包括：The eye tracking unit further comprises: 判断模块，用于在转化模块将超声显示屏幕坐标系下的位置P（t）转化为感兴趣区域ROI（t）前，统计用户视觉焦点在超声显示屏幕坐标系下的位置P（t）随时间变化参数；A judgment module, used for counting the time-varying parameters of the position P(t) of the user's visual focus in the ultrasound display screen coordinate system before the conversion module converts the position P(t) in the ultrasound display screen coordinate system into the region of interest ROI(t); 将所述变化参数与预设阈值进行比较，在确定变化参数小于预设阈值时，表示dt时间段内用户的视线焦点位置不大，那么认为t时刻，用户感兴趣区域的在的预设区域；其中，为dt时间段内P（t）的均值坐标；The change parameter is compared with a preset threshold. When it is determined that the change parameter is less than the preset threshold, it means that the user's sight focus position is not large during the time period dt. Then it is considered that at time t, the user's area of interest is The preset area of is the mean coordinate of P(t) in the time period dt; 所述变化参数用dt时间段内，P(t)位置序列的协方差系数来描述；The variation parameter is described by the covariance coefficient of the P(t) position sequence within the time period dt; 其中，DP(t)为 P(t)位置序列的协方差系数；Where DP(t) is the covariance coefficient of the P(t) position sequence; 所述眼动跟踪单元，包括：The eye tracking unit comprises: 获取模块，用于根据眼球运动信息，获取用户视觉焦点在超声显示屏幕坐标系下的位置P（t）；An acquisition module, used to acquire the position P(t) of the user's visual focus in the ultrasound display screen coordinate system according to the eye movement information; 转化模块，用于将超声显示屏幕坐标系下的位置P（t）转化为感兴趣区域ROI（t）；A conversion module, used for converting the position P(t) in the ultrasound display screen coordinate system into a region of interest ROI(t); 计算模块，用于根据超声显示屏幕上显示超声图像与视觉焦点在超声显示屏幕坐标系下的位置P（t）的坐标对应关系，计算感兴趣区域在超声探头坐标系的位置；A calculation module is used to calculate the position of the region of interest in the ultrasound probe coordinate system according to the coordinate correspondence between the ultrasound image displayed on the ultrasound display screen and the position P(t) of the visual focus in the ultrasound display screen coordinate system. ; 确定模块，用于：Identify modules for: 对感兴趣区域在超声探头坐标系的位置进行图像优化、多模式显示、参数测量和计算，确定处理后的感兴趣区域在超声探头坐标系的位置；The position of the region of interest in the ultrasound probe coordinate system Perform image optimization, multi-mode display, parameter measurement and calculation to determine the position of the processed region of interest in the ultrasound probe coordinate system ; 根据在超声显示屏幕坐标系下的感兴趣区域ROI（t）及处理后的在超声探头坐标系的位置，确定超声图像中用户的感兴趣区域；According to the region of interest ROI (t) in the ultrasound display screen coordinate system and the processed position in the ultrasound probe coordinate system , determining a region of interest of a user in an ultrasound image; 所述转化模块，包括：The conversion module comprises: 第一转化子模块，用于：The first conversion submodule is used for: 根据超声显示屏幕坐标系下的位置P（t），确定中心点CP(t)，作为高斯分布的原点，方差σ(t)确定范围信息，进而确定以高斯模型描述的感兴趣区域ROI（t）；According to the position P(t) in the coordinate system of the ultrasound display screen, the center point CP(t) is determined as the origin of the Gaussian distribution, and the variance σ(t) determines the range information, and then the region of interest ROI(t) described by the Gaussian model is determined; 或or 第二转化子模块，用于：The second conversion submodule is used for: 确定dt时间段内采样位置序列P(t1), P(t2),P(t3)…的均值作为中心点CP(t)；Determine the mean of the sampling position sequence P(t1), P(t2), P(t3)… within the time period dt As the center point CP(t); 基于采样位置序列的分布范围估计感兴趣区域的范围；Estimate the extent of the region of interest based on the distribution range of the sampling position sequence; 根据中心点CP(t)和范围，确定感兴趣区域ROI（t）。According to the center point CP(t) and range, the region of interest ROI(t) is determined. 2.如权利要求1所述的实现超声成像控制和显示的装置，其特征在于，还包括：2. The device for realizing ultrasonic imaging control and display according to claim 1, characterized in that it also comprises: 设备输入单元，用于接收用户的输入指令，根据输入指令对感兴趣区域进行修正，得到修正感兴趣区域，并发送至超声控制和成像单元；The device input unit is used to receive the user's input instruction, modify the region of interest according to the input instruction, obtain the modified region of interest, and send it to the ultrasound control and imaging unit; 超声控制和成像单元，用于根据修正感兴趣区域，确定第二调节参数，生成第二目标超声图像，并传输至超声显示屏幕进行显示。The ultrasound control and imaging unit is used to determine the second adjustment parameter according to the modified region of interest, generate a second target ultrasound image, and transmit it to the ultrasound display screen for display. 3.如权利要求1所述的实现超声成像控制和显示的装置，其特征在于，所述超声显示屏幕显示超声图像时，包括超声图像区域、参数区域及信息区域。3. The device for realizing ultrasound imaging control and display as claimed in claim 1, characterized in that when the ultrasound display screen displays the ultrasound image, it includes an ultrasound image area, a parameter area and an information area. 4.如权利要求1-3任一项所述的实现超声成像控制和显示的装置的控制和显示的方法，其特征在于，包括：4. The method for controlling and displaying an apparatus for controlling and displaying ultrasonic imaging according to any one of claims 1 to 3, characterized in that it comprises: 基于放置在被检查者身体相应部位的超声探头，发射超声波及接收回波信号，并将回波信号传输至超声控制和成像单元；Based on the ultrasound probe placed at the corresponding part of the body of the person being examined, ultrasound waves are emitted and echo signals are received, and the echo signals are transmitted to the ultrasound control and imaging unit; 基于超声控制和成像单元对所述回波信号进行计算和处理，将回波信号转化为超声图像，并传输至超声显示屏幕进行显示；The echo signal is calculated and processed based on the ultrasound control and imaging unit, the echo signal is converted into an ultrasound image, and transmitted to an ultrasound display screen for display; 基于眼动跟踪装置在用户查看超声图像时，采集用户的眼球运动信息；Based on the eye tracking device, when the user views the ultrasound image, the user's eye movement information is collected; 眼动跟踪单元对所述眼球运动信息进行计算，得到用户的视觉焦点，根据视觉焦点确定超声图像中用户的感兴趣区域，并发送至超声控制和成像单元；The eye tracking unit calculates the eye movement information to obtain the user's visual focus, determines the user's area of interest in the ultrasound image according to the visual focus, and sends the area to the ultrasound control and imaging unit; 超声控制和成像单元根据用户的感兴趣区域，确定第一调节参数，生成第一目标超声图像，并传输至超声显示屏幕进行显示；The ultrasound control and imaging unit determines a first adjustment parameter according to the user's region of interest, generates a first target ultrasound image, and transmits the image to the ultrasound display screen for display; 超声显示屏幕在对用户的感兴趣区域进行显示时，包括：确定感兴趣区域的图像、参数和信息并显示在超声显示屏幕上；When the ultrasound display screen displays the region of interest of the user, the steps include: determining the image, parameters and information of the region of interest and displaying them on the ultrasound display screen; 对感兴趣区域进行标记，对感兴趣区域内的图像进行进一步的优化或者放大；在感兴趣区域内对组织特征进行观察；对感兴趣区域的图像进行标记和分析，勾勒感兴趣区域的范围，对感兴趣区域标记文字说明，作为病例的关键信息；或者对感兴趣区域内的参数进行测量；记录超声医生在扫查和诊断过程中，关注的感兴趣区域的位置和变化信息；Mark the region of interest, further optimize or magnify the image in the region of interest; observe tissue characteristics in the region of interest; mark and analyze the image of the region of interest, outline the scope of the region of interest, mark the region of interest with text descriptions as key information of the case; or measure the parameters in the region of interest; record the location and change information of the region of interest that the ultrasound doctor pays attention to during the scanning and diagnosis process; 所述眼动跟踪单元，还包括：The eye tracking unit further comprises: 判断模块，用于在转化模块将超声显示屏幕坐标系下的位置P（t）转化为感兴趣区域ROI（t）前，统计用户视觉焦点在超声显示屏幕坐标系下的位置P（t）随时间变化参数；A judgment module, used for counting the time-varying parameters of the position P(t) of the user's visual focus in the ultrasound display screen coordinate system before the conversion module converts the position P(t) in the ultrasound display screen coordinate system into the region of interest ROI(t); 将所述变化参数与预设阈值进行比较，在确定变化参数小于预设阈值时，表示dt时间段内用户的视线焦点位置不大，那么认为t时刻，用户感兴趣区域的在的预设区域；其中，为dt时间段内P（t）的均值坐标；The change parameter is compared with a preset threshold. When it is determined that the change parameter is less than the preset threshold, it means that the user's sight focus position is not large during the time period dt. Then it is considered that at time t, the user's area of interest is The preset area of is the mean coordinate of P(t) in the time period dt; 所述变化参数用dt时间段内，P(t)位置序列的协方差系数来描述；The variation parameter is described by the covariance coefficient of the P(t) position sequence within the time period dt; 其中，DP(t)为 P(t)位置序列的协方差系数；Where DP(t) is the covariance coefficient of the P(t) position sequence; 眼动跟踪单元对所述眼球运动信息进行计算，得到用户的视觉焦点，根据视觉焦点确定超声图像中用户的感兴趣区域，包括：The eye tracking unit calculates the eye movement information to obtain the user's visual focus, and determines the user's area of interest in the ultrasound image according to the visual focus, including: 根据眼球运动信息，获取用户视觉焦点在超声显示屏幕坐标系下的位置P（t）；According to the eye movement information, the position P(t) of the user's visual focus in the ultrasound display screen coordinate system is obtained; 将超声显示屏幕坐标系下的位置P（t）转化为感兴趣区域ROI（t）；Convert the position P(t) in the ultrasound display screen coordinate system into the region of interest ROI(t); 根据超声显示屏幕上显示超声图像与视觉焦点在超声显示屏幕坐标系下的位置P（t）的坐标对应关系，计算感兴趣区域在超声探头坐标系的位置；According to the coordinate correspondence between the ultrasound image displayed on the ultrasound display screen and the position P(t) of the visual focus in the ultrasound display screen coordinate system, the position of the region of interest in the ultrasound probe coordinate system is calculated. ; 对感兴趣区域在超声探头坐标系的位置进行图像优化、多模式显示、参数测量和计算，确定处理后的感兴趣区域在超声探头坐标系的位置；The position of the region of interest in the ultrasound probe coordinate system Perform image optimization, multi-mode display, parameter measurement and calculation to determine the position of the processed region of interest in the ultrasound probe coordinate system ; 根据在超声显示屏幕坐标系下的感兴趣区域ROI（t）及处理后的在超声探头坐标系的位置，确定超声图像中用户的感兴趣区域。According to the region of interest ROI (t) in the ultrasound display screen coordinate system and the processed position in the ultrasound probe coordinate system , determine the user's region of interest in the ultrasound image.
CN202310560795.0A 2023-05-18 2023-05-18 A device and method for realizing ultrasonic imaging control and display Active CN116616814B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310560795.0A CN116616814B (en) 2023-05-18 2023-05-18 A device and method for realizing ultrasonic imaging control and display

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310560795.0A CN116616814B (en) 2023-05-18 2023-05-18 A device and method for realizing ultrasonic imaging control and display

Publications (2)

Publication Number Publication Date
CN116616814A CN116616814A (en) 2023-08-22
CN116616814B true CN116616814B (en) 2025-01-24

Family

ID=87620654

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310560795.0A Active CN116616814B (en) 2023-05-18 2023-05-18 A device and method for realizing ultrasonic imaging control and display

Country Status (1)

Country Link
CN (1) CN116616814B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN119908749A (en) * 2023-10-30 2025-05-02 通用电气精准医疗有限责任公司 Ultrasonic imaging method, ultrasonic imaging system, and non-transitory computer-readable medium
CN119366854B (en) * 2024-12-27 2025-05-02 视微影像(河南)科技有限公司 OCT (optical coherence tomography) equipment, scanning method thereof, ophthalmic imaging device and system

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111506195A (en) * 2020-04-17 2020-08-07 南京巨鲨显示科技有限公司 Focal region highlighting system based on eyeball tracking equipment
CN116095258A (en) * 2021-11-05 2023-05-09 佳能株式会社 Electronic device, control method of electronic device, and computer-readable medium

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20160071242A (en) * 2014-12-11 2016-06-21 삼성전자주식회사 Apparatus and method for computer aided diagnosis based on eye movement
JP6925824B2 (en) * 2017-02-28 2021-08-25 キヤノンメディカルシステムズ株式会社 Ultrasound diagnostic equipment, image processing equipment, and image processing programs
US12144675B2 (en) * 2017-12-04 2024-11-19 Bard Access Systems, Inc. Systems and methods for visualizing anatomy, locating medical devices, or placing medical devices
WO2022203713A2 (en) * 2020-09-18 2022-09-29 Bard Access Systems, Inc. Ultrasound probe with pointer remote control capability

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111506195A (en) * 2020-04-17 2020-08-07 南京巨鲨显示科技有限公司 Focal region highlighting system based on eyeball tracking equipment
CN116095258A (en) * 2021-11-05 2023-05-09 佳能株式会社 Electronic device, control method of electronic device, and computer-readable medium

Also Published As

Publication number Publication date
CN116616814A (en) 2023-08-22

Similar Documents

Publication Publication Date Title
CN114246611B (en) System and method for an adaptive interface for an ultrasound imaging system
CN112386278B (en) Method and system for camera assisted ultrasound scan setup and control
US20150327838A1 (en) Echocardiography
CN109770943B (en) An Ultrasound Automatic Optimization Method Using Computer Vision Positioning
US20230330507A1 (en) Muscle training method and system for providing visual feedback by using ultrasonic imaging
CN103584884B (en) Muscle force assessment method and device and muscle rehabilitation training tracking and assessment method and system
CN116616814B (en) A device and method for realizing ultrasonic imaging control and display
CN103260526B (en) There is ultrasonic image-forming system and the method for peak strength measuring ability
CN113208646B (en) Method and device for evaluating contact state of ultrasonic probe based on soft tissue morphology
US20140004488A1 (en) Training, skill assessment and monitoring users of an ultrasound system
US20210052253A1 (en) Mid-procedure view change for ultrasound diagnostics
US20160000401A1 (en) Method and systems for adjusting an imaging protocol
US20210065882A1 (en) Method and system for prompting data donation for artificial intelligence tool development
CN111938699B (en) System and method for guiding use of ultrasonic equipment
EP4017371A1 (en) Ultrasound guidance dynamic mode switching
CN113288044A (en) Dynamic vision testing system and method
CN116458925B (en) Portable non-blind area multi-mode ultrasonic electrocardio system
CN112137643A (en) Region of interest localization for longitudinal monitoring in quantitative ultrasound
CN120549612A (en) A real-time monitoring device for puncture path of intrathecal anesthesia under ultrasound guidance
CN118982080A (en) A training method and device for a multimodal large model to assist traditional Chinese medicine diagnosis
CN118402813A (en) Ultrasonic scanning guiding method and system and ultrasonic diagnosis system
US20230017173A1 (en) Breast ultrasound screening and diagnostics system and method
EP1250889A1 (en) Ultrasonic diagnostic device and method of measuring index for indicating vascular status
KR20170098481A (en) Parameter auto setting for portable ultrasound device
CN118873166A (en) A portable ultrasound imaging system and method integrating AI and motion sensor

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CP03 Change of name, title or address
CP03 Change of name, title or address

Address after: 100000 No. 1, Building 1, 4th Floor, Unit 405, Energy East Road, Changping District, Beijing

Patentee after: Yi Chao Medical Technology (Beijing) Co., Ltd.

Country or region after: China

Address before: 100000 No. 1, Building 1, 4th Floor, Unit 405, Energy East Road, Changping District, Beijing

Patentee before: Yichao Medical Technology (Beijing) Co.,Ltd.

Country or region before: China