Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.
Example one
Fig. 1 is a flowchart of a compression method for a breast examination according to an embodiment of the present invention, where the present embodiment is applicable to a situation where a user performs a compressive examination, and the method may be executed by a compression device for a breast examination, and specifically includes the following steps:
and S110, applying gradually increased examination compression force to the mammary gland of the current user through a compression mechanism of the mammary gland machine.
In some medical examinations, some compression examinations may be involved, i.e. examination compression forces need to be applied to the user during the examination. Illustratively, in performing a molybdenum-targeted examination of breast cancer, a user compresses the breast and then takes a medical image. Generally, the greater the pressing force, the better the shooting effect, and the more in line with clinical needs, but the strength of the examination pressing force that the user can bear is limited, and when the examination pressing force applied exceeds the bearing range of the user, the user can feel painful, and even endanger life safety. Therefore, when the examination pressing force is applied to the current user, it is necessary to gradually increase the pressing force.
And S120, acquiring a face image of the current user in the pressing process in real time through an image capturing device.
Considering that the emotion of a person can be expressed by facial expressions, when gradually increased examination oppression force is applied to a user, the facial image of the user is acquired in real time, the bearing degree of the user on the examination oppression force is judged according to the expressions in the facial image of the user, and the examination oppression force suitable for the user is finally determined.
The facial image of the user when bearing the inspection oppression power that gradually increases is obtained in real time, carries out feature extraction to the facial image and obtains the expression of user when bearing the inspection oppression power, and the mode of exemplarily, carrying out expression feature extraction to the facial image includes: local analysis and identification method, deformation extraction method, geometric characteristic method and the like. The local analysis and recognition method is to separate five sense organs of a human face and recognize the five sense organs according to the related importance difference of each five sense organ, for example, the five sense organs such as eyes, mouth and nose of a person form the expression of the person under the drive of facial expression muscles, wherein the difference of the nose of the person in the expression is smaller than that of the eyes and the mouth, the importance of the nose in the expression analysis can be reduced, and the facial image of a user can be locally analyzed and recognized through a neural network method or a facial motion coding method. The deformation extraction method is to extract the characteristics according to the deformation conditions of the five sense organs under different expressions, and can be realized by a motion template method or a point distribution model. The geometric feature method is to extract the expression features of the human face according to the shape and position transformation of facial features of the human face, and the extraction of the geometric features of the human face can be realized through a local phase change method.
S130, acquiring the thickness of the compressed mammary gland.
The bearing capacity of each user to the examination oppression force is different, the determined target examination oppression force is different, the current user is examined according to the determined target examination oppression force, the accuracy of an examination result can be guaranteed, and meanwhile, the pain of a patient is prevented from being increased.
The method comprises the steps of acquiring a face image of a user in the current pressing process in real time, and acquiring the thickness of the user when the user mammary gland is pressed in real time to judge whether the pressing on the user mammary gland is in place.
And S140, automatically stopping pressing based on the face image, the pressed thickness and a preset constraint condition.
And judging whether to stop pressing according to the face image of the user, the thickness of the pressed mammary gland of the user and a preset constraint condition. Optionally, the automatically stopping compression based on the facial image, the compressed thickness and a predetermined constraint condition includes: training an inspection model based on facial images of a historical user when the user receives a breast compression inspection and historical marking results of whether a critical point of the endurance pain is reached; inputting the facial image of the current user into a trained inspection model, and determining whether the current user reaches a critical point of tolerance; stopping compression when the result output by the inspection model indicates that the current user reaches a critical point of tolerance; or stopping pressing when the result output by the checking model indicates that the current user does not reach the pain-tolerance critical point but the pressing meets the preset constraint condition.
Training a face image when a historical user receives breast compression examination and a historical marking result of whether the face image reaches a critical point of the tolerance or not to train an examination model; the facial image of the user to be detected is input into the trained inspection model, and whether the user reaches the critical point of tolerance is judged. The trained examination model can classify the expression characteristics of the user, the facial image of the current user when the user receives the mammary gland compression examination is input into the examination model, and the facial image of the current user can be divided into the facial image reaching the critical point of the lingering pain and the facial image not reaching the critical point of the lingering pain. And if the output result of the current user check model reaches the critical point of the tolerance, stopping pressing. And if the output result of the current user check model is that the pain tolerance critical point is not reached, judging whether to stop pressing according to a preset constraint condition. Screening is carried out to user's facial image through the inspection model, and then whether confirm to increase the inspection oppression power, under the circumstances of guaranteeing user's comfort level, makes the thickness that end user's mammary gland was oppressed more be close to optimum oppression thickness to it is more accurate to make the inspection result.
Optionally, the predetermined constraint condition includes a preset breast thickness variation threshold, a preset compression force threshold and/or a preset compressed breast thickness threshold. Optionally, when the result output by the inspection model indicates that the current user does not reach the critical point of tolerance but the compression satisfies the predetermined constraint condition, stopping the compression, including: when the mammary gland of the current user is compressed, the mammary gland thickness change of the current user meets a preset mammary gland thickness change threshold, or the compression force of the compression mechanism meets a preset compression force threshold, or when the mammary gland thickness of the compressed mammary gland of the current user meets a preset compressed mammary gland thickness threshold, the compression is stopped. Illustratively, when the expression detection result of the user is that the pain-tolerance critical point is not reached, if the change value of the breast thickness is very small and meets a preset breast thickness change threshold value, and/or the applied compression force is within a preset compression force threshold value range, and/or the compressed breast thickness is within a preset compressed breast thickness threshold value range, the compression is stopped, and the medical image is acquired by using the current compression thickness of the breast. Compared with the breast thickness change at the beginning of pressing, the preset breast thickness change threshold is smaller, which means that once the preset breast thickness change threshold is smaller, the pain of the user is greater when the breast is continuously pressed; too much applied compression force, e.g., exceeding a preset compression force threshold, can cause user intolerance; too thin a breast thickness after compression also causes a sense of pain to the user. Therefore, the above conditions are satisfied in order to obtain a better image while ensuring the comfort of the user when the user is pressed as much as possible.
On the basis of the above embodiment, the compression method for breast examination further includes: and acquiring a breast examination item corresponding to the current user based on the face image of the current user. Before the user checks, the information system of the hospital acquires the personal information of the user, wherein the personal information comprises: the name, sex, face image, past medical history of the patient, and items to be examined, etc. of the user. When the current user is checking, the checking equipment acquires the facial image of the current user, matches with facial information in a hospital information system, and the matching is successful, so that the current breast checking item corresponding to the user can be obtained, the user is not required to carry a medical card or a bar code, the problem that the user cannot check due to the medical card or the bar code is avoided, and the checking efficiency of the user is improved.
On the basis of the above embodiment, the compression method for breast examination further includes: determining a target examination process according to the breast examination items; and prompting the target inspection flow. The examination equipment determines the examination process of the examination item according to the determined breast examination item, and prompts the user about the examination process of the examination item.
On the basis of the above embodiment, the compression method for breast examination further includes: acquiring a positioning image of the current user through the image capturing device; judging whether the position of the current user accords with a preset protocol or not based on the position image; and when the positioning does not accord with the protocol, prompting. The method comprises the steps that an inspection device obtains a positioning image of a current user, determines the body positioning of the current user according to the positioning image, judges whether the current body positioning of the user accords with a protocol, if so, proves that the positioning of the current user is correct, the inspection device is allowed to apply inspection pressure to the current user, if not, the positioning of the current user is incorrect, prompts the correct positioning for the user, and obtains the positioning image of the user in real time until the positioning of the user accords with the protocol. The full-self-service or semi-self-service inspection of the user can be realized, and the manpower is saved.
In one embodiment, the image capturing device is a camera; in particular, the camera may be a 2D camera, a 3D camera, or a combination of a 2D camera and a depth sensor.
According to the technical scheme of the embodiment, the gradually increased examination compression force is applied to the mammary gland of the current user through the compression mechanism of the mammary gland machine; acquiring a face image of the current user in a compression process in real time through an image capturing device; the face image of the current user is acquired in real time, so that the condition that the face image is missed in acquisition can be avoided. Obtaining the thickness of the pressed mammary gland; automatically stopping the pressing based on the face image, the pressed thickness, and a predetermined constraint condition. The comfort level and the examination result of the current user can be considered, the problem that the doctor relies on experience operation completely in the examination process of a patient, the burden of the doctor is large, the obtained examination result cannot meet the clinical requirement is solved, and the effect of improving the accuracy and the efficiency of disease examination is realized.
Example two
Fig. 2 is a flowchart of a compression method for breast examination according to a second embodiment of the present invention, which is further optimized based on the second embodiment, and optionally, the compression method for breast examination further includes: comparing a current frame of the facial image of the current user with at least one frame acquired before the current frame; judging whether the image changes within a preset time; if no change occurs, the pressing is stopped. The method avoids the occurrence of accidents in the checking process of the user, and protects the safety of the user. As shown in fig. 2, the method specifically includes the following steps:
s210, applying gradually increased examination compression force to the mammary gland of the current user through a compression mechanism of the mammary gland machine.
And S220, acquiring a face image of the current user in the pressing process in real time through an image capturing device.
And S230, acquiring the thickness of the pressed mammary gland.
And S240, automatically stopping pressing based on the face image, the pressed thickness and a preset constraint condition.
S250, comparing the current frame of the face image of the current user with at least one frame collected before the current frame; judging whether the image changes within a preset time; if no change occurs, the pressing is stopped.
In one example, the steps of S250 and S240 may be performed in parallel. In another example, S250 may be performed before S240. In still another example, because S240 may be a step of repeating the judgment, the judgment of S250 may be performed after every judgment of S240.
When a current user carries out examination, the facial image of the current user can be collected in real time, the current frame image is compared with one frame image before the current frame image, and also can be compared with a plurality of frames of images before the current frame image, whether the facial image of the current user changes along with the lapse of time is determined, if the facial image of the current user does not change all the time after exceeding the preset time, the examination is stopped at the moment, the state of the current user is checked, and the occurrence of an unexpected situation when the user bears examination oppression is avoided.
Optionally, the face image information of the current user includes binocular information, and the binocular information of the user is extracted from the face image of the current user. For determining the status of the user. And the current user is prevented from generating an unexpected condition.
On the basis of the above embodiment, the compression of the breast examination further includes: and prompting information of emergency possibility. When the user has an emergency, the information that the user needs first aid needs to be sent so as not to delay the state of illness of the user. Illustratively, judging whether the eyes of the current user are in an open state or a closed state according to binocular information extracted from a face image of the current user, if the eyes of the current user are closed for more than preset time, the current user may be faint, stopping checking, sending a rescue notification, and timely treating the current user to avoid accidents of the current user.
According to the technical scheme of the embodiment, the gradually increased examination compression force is applied to the mammary gland of the current user through the compression mechanism of the mammary gland machine; acquiring a face image of the current user in a compression process in real time through an image capturing device; the face image of the current user is acquired in real time, so that the condition that the face image is missed in acquisition can be avoided. Obtaining the thickness of the pressed mammary gland; automatically stopping the pressing based on the face image, the pressed thickness, and a predetermined constraint condition. Comparing a current frame of a face image of a current user with at least one frame acquired before the current frame; judging whether the image changes within a preset time; if the user does not change, the compression is stopped, and the current user is prevented from having accidents. The comfort level of the current user and even the safety and the examination result can be considered, the problem that the doctor relies on experience operation completely in the examination process of a patient, the burden of the doctor is large, the obtained examination result cannot meet the clinical requirement is solved, and the effect of improving the accuracy and the efficiency of disease examination is realized.
EXAMPLE III
Fig. 3 is a structural diagram of a compression apparatus 30 for breast examination according to a third embodiment of the present invention, the apparatus including: compression mechanism 310, camera 320, and controller 330.
The compression mechanism 310 is configured to apply a gradually increasing examination compression force to the breast of the current user, and the compression mechanism generally includes a compression plate and a driving mechanism for driving the compression plate to move; the camera 320 is used for acquiring a facial image of the current user in a compression process in real time; a controller 330 for automatically stopping the compression based on the face image, the compressed thickness, and a predetermined constraint condition. The thickness of the compressed mammary gland can be directly acquired through a camera or a mammary machine system.
Optionally, the predetermined constraint condition includes a preset breast thickness variation threshold, a preset compression force threshold and/or a preset compressed breast thickness threshold.
In the solution of the above embodiment, the controller 330 is controlled based on the tolerance threshold determination module in the memory and the pre-stored constraint conditions.
The tolerance critical point determining module comprises a trained checking model, wherein the checking model is used for inputting the face image of the current user and outputting the determination information whether the current user reaches the tolerance critical point. Further, the inspection model is trained by an inspection model training unit.
Specifically, the examination model training unit is used for training the examination model based on the face images when the historical user receives the breast compression examination and the historical marking result of whether the critical point of the tolerance is reached.
The constraint conditions comprise that the breast thickness change of the breast of the current user meets a preset breast thickness change threshold value when the breast is pressed, or the pressing force of the pressing mechanism meets a preset pressing force threshold value, or the breast thickness of the breast of the current user after being pressed meets a preset pressed breast thickness threshold value.
In the technical solution of the above embodiment, the compression apparatus 30 for breast examination further includes:
a facial image comparison module for comparing a current frame of the facial image of the current user with at least one frame collected before the current frame;
the image change judging module is used for judging whether the image changes within the preset time; if no change occurs, the pressing is stopped.
In the technical solution of the above embodiment, the compression apparatus 30 for breast examination further includes:
and the information prompting module is used for prompting the information of the emergency possibility.
In the technical solution of the above embodiment, the compression apparatus 30 for breast examination further includes:
and the breast examination item determining module is used for acquiring a breast examination item corresponding to the current user based on the face image of the current user.
In the technical solution of the above embodiment, the compression apparatus 30 for breast examination further includes:
and the target examination process determining module is used for determining a target examination process according to the breast examination items.
In the technical solution of the above embodiment, the compression apparatus 30 for breast examination further includes: and the target inspection flow prompting module is used for prompting the target inspection flow.
In the technical solution of the above embodiment, the compression apparatus 30 for breast examination further includes:
the positioning image acquisition module is used for acquiring the positioning image of the current user through the camera;
the preset protocol judging module is used for judging whether the position of the current user accords with a preset protocol or not based on the position image;
and the positioning prompt module is used for prompting when the positioning does not accord with the protocol.
According to the technical scheme of the embodiment, the gradually increased examination compression force is applied to the mammary gland of the current user through the compression mechanism of the mammary gland machine; acquiring a face image of the current user in a compression process in real time through an image capturing device; the face image of the current user is acquired in real time, so that the condition that the face image is missed in acquisition can be avoided. Obtaining the thickness of the pressed mammary gland; automatically stopping the pressing based on the face image, the pressed thickness, and a predetermined constraint condition. The comfort level, the safety and the image quality of a current user can be considered, the problem that the doctor relies on experience operation completely in the examination process of a patient, the burden of the doctor is large, and the obtained examination result cannot meet the clinical requirement is solved, and the effect of improving the accuracy and the efficiency of disease examination is realized.
The pressing device for the breast examination provided by the embodiment of the invention can execute the pressing method for the breast examination provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method.
Example four
Fig. 4 is a schematic structural diagram of an electronic device according to a fourth embodiment of the present invention, as shown in fig. 4, the electronic device includes a processor 410, a memory 420, an input device 430, and an output device 440; the number of the processors 410 in the electronic device may be one or more, and one processor 410 is taken as an example in fig. 4; the processor 410, the memory 420, the input device 430 and the output device 440 in the electronic apparatus may be connected by a bus or other means, and the bus connection is exemplified in fig. 4.
The memory 420 serves as a computer-readable storage medium for storing software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to the compression method of breast examination in the embodiment of the present invention. The processor 410 executes various functional applications and data processing of the electronic device by running software programs, instructions and modules stored in the memory 420, so as to implement the compression method of the breast examination.
The memory 420 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function; the storage data area may store data created according to the use of the terminal, and the like. Further, the memory 420 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some examples, memory 420 may further include memory located remotely from processor 410, which may be connected to an electronic device over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The input device 430 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the electronic apparatus. The output device 440 may include a display device such as a display screen.
EXAMPLE five
Embodiments of the present invention also provide a storage medium containing computer-executable instructions which, when executed by a computer processor, perform a compression method for breast examination, the method comprising:
applying gradually increased examination compression force to the mammary gland of the current user through a compression mechanism of the mammary gland machine;
acquiring a face image of the current user in a compression process in real time through an image capturing device;
obtaining the thickness of the pressed mammary gland;
automatically stopping the pressing based on the face image, the pressed thickness, and a predetermined constraint condition.
Of course, the storage medium provided by the embodiments of the present invention contains computer executable instructions, and the computer executable instructions are not limited to the method operations described above, and may also perform related operations in the compression method for breast examination provided by any embodiments of the present invention.
From the above description of the embodiments, it is obvious for those skilled in the art that the present invention can be implemented by software and necessary general hardware, and certainly, can also be implemented by hardware, but the former is a better embodiment in many cases. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which can be stored in a computer-readable storage medium, such as a floppy disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a FLASH Memory (FLASH), a hard disk or an optical disk of a computer, and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device) to execute the methods according to the embodiments of the present invention.
It should be noted that, in the embodiment of the compression apparatus for breast examination, the units and modules included in the compression apparatus are only divided according to the functional logic, but are not limited to the above division, as long as the corresponding functions can be realized; in addition, specific names of the functional units are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present invention.
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.