US20130090560A1 - Ultrasound image reconstruction method, device therefor, and ultrasound diagnostic device - Google Patents

Ultrasound image reconstruction method, device therefor, and ultrasound diagnostic device Download PDF

Info

Publication number
US20130090560A1
US20130090560A1 US13/703,961 US201113703961A US2013090560A1 US 20130090560 A1 US20130090560 A1 US 20130090560A1 US 201113703961 A US201113703961 A US 201113703961A US 2013090560 A1 US2013090560 A1 US 2013090560A1
Authority
US
United States
Prior art keywords
ultrasound
time point
image
certain time
frame image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US13/703,961
Other languages
English (en)
Inventor
Go Kotaki
Atsushi Miyamoto
Kenji Nakahira
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hitachi Healthcare Manufacturing Ltd
Original Assignee
Hitachi Medical Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hitachi Medical Corp filed Critical Hitachi Medical Corp
Assigned to HITACHI MEDICAL CORPORATION reassignment HITACHI MEDICAL CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: KOTAKI, GO, MIYAMOTO, ATSUSHI, NAKAHIRA, KENJI
Publication of US20130090560A1 publication Critical patent/US20130090560A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/52—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/5215—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data
    • A61B8/5238—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data for combining image data of patient, e.g. merging several images from different acquisition modes into one image
    • A61B8/5246—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data for combining image data of patient, e.g. merging several images from different acquisition modes into one image combining images from the same or different imaging techniques, e.g. color Doppler and B-mode
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4053—Scaling of whole images or parts thereof, e.g. expanding or contracting based on super-resolution, i.e. the output image resolution being higher than the sensor resolution
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/13—Tomography
    • A61B8/14—Echo-tomography
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/46—Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient
    • A61B8/461—Displaying means of special interest
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/46—Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient
    • A61B8/461—Displaying means of special interest
    • A61B8/462—Displaying means of special interest characterised by constructional features of the display
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/52—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/5207—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of raw data to produce diagnostic data, e.g. for generating an image
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/54—Control of the diagnostic device
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10132—Ultrasound image
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing

Definitions

  • the present invention relates to an ultrasound diagnostic device which acquires images by transmitting and receiving an ultrasonic wave to/from a test object.
  • the present invention relates to an ultrasound image reconstruction method, an ultrasound image reconstruction device and an ultrasound diagnostic device for conducting a process for enhancing the spatial resolution or the temporal resolution to the acquired images by means of image processing.
  • Ultrasound diagnostic devices are used for the inspection of various parts in the body such as the abdomen and the heart.
  • the ultrasound diagnostic devices having advantages like harmlessness to living tissues in contrast to X-ray inspection, simple and easy operation, and possibility of video observation in real time, are widely used today.
  • an ultrasound probe emits an ultrasonic wave toward the test object and receives a reflected wave from a tissue inside the test object. Based on the received reflected wave, an ultrasound image of the tissue (test object) is displayed on a monitor.
  • a converged ultrasonic wave ultrasound beam converged in a particular direction
  • Non-patent Literature 1 A technique described in Non-patent Literature 1 is known as an example of the deconvolution process, in which an ideal ultrasound image with no deterioration is estimated from an acquired ultrasound image through the modeling of image blurring caused by the aberration of the ultrasound beam and image deterioration caused by the sampling.
  • the body motion of the object under consideration (considered object) in the imaging plane is measured by using ultrasound images.
  • Information varying with time (the shape of the considered object, tissue degradation, etc.) is visualized and displayed by adding up or subtracting time-line images while compensating for the measured body motion.
  • the method involves a problem of decreasing the display frame rate since the time necessary for acquiring one frame image increases due to an increase in the propagation time of the ultrasonic wave. This leads to an insufficient frame rate and a hitch in the diagnosis especially in the observation of fast-moving parts (e.g., heart).
  • some problems have been known in regard to the aforementioned deconvolution process, such as occurrence of unnatural artifacts to images having much noise. Therefore, the resolution enhancement effect cannot be expected so much when the acquired ultrasound image includes much noise.
  • the method described in the Patent Literature 2 is capable of extracting and visualizing information varying with time from time-line images.
  • the Patent Literature 2 has not described a method for acquiring high-resolution ultrasound images.
  • the present invention provides an ultrasound image reconstruction method for reconstructing an ultrasound image of a sample by processing ultrasound images acquired from a signal generated by scanning the sample with an ultrasound signal by use of an ultrasound probe and receiving a reflected wave from the sample, comprising the steps of: extracting an ultrasound frame image at a certain time point and an ultrasound frame image at a time point before the certain time point from a series of ultrasound frame images constituting the ultrasound images acquired by the imaging; calculating magnitudes of positional shifts between the extracted ultrasound frame image at the certain time point and the extracted ultrasound frame image at the time point before the certain time point; and reconstructing a composite ultrasound image for one frame by compensating for the positional shifts between the extracted ultrasound frame image at the certain time point and the extracted ultrasound frame image at the time point before the certain time point by use of information on the calculated magnitudes of positional shifts and merging the extracted ultrasound frame image at the certain time point and the extracted ultrasound frame image at the time point before the certain time point after undergoing the positional shift compensation together.
  • an ultrasound image reconstruction device in accordance with the present invention is configured to comprise: reception circuit means which receives a reflected wave signal generated by scanning a sample with an ultrasound probe and receiving a reflected wave from the sample; image generating means which generates ultrasound images from the reflected wave signal received by the reception circuit means; image processing means which executes a reconstruction process to the ultrasound images generated by the image generating means; and display means which displays an ultrasound image obtained by the reconstruction process by the image processing means on a screen.
  • the image processing means extracts an ultrasound frame image at a certain time point and an ultrasound frame image at a time point before the certain time point from a series of ultrasound frame images constituting the ultrasound images generated by the image generating means, calculates magnitudes of positional shifts between the extracted ultrasound frame image at the certain time point and the extracted ultrasound frame image at the time point before the certain time point, and reconstructs a composite ultrasound image for one frame by compensating for the positional shifts between the extracted ultrasound frame image at the certain time point and the extracted ultrasound frame image at the time point before the certain time point by use of information on the calculated magnitudes of positional shifts and merging the extracted ultrasound frame image at the certain time point and the extracted ultrasound frame image at the time point before the certain time point after undergoing the positional shift compensation together.
  • an ultrasound diagnostic device in accordance with the present invention is configured to comprise: an ultrasound probe which scans a sample with an ultrasound signal and receives a reflected wave from the sample; a drive circuit unit which generates a high-frequency signal for driving the ultrasound probe; an ultrasound image reconstruction processing unit which generates ultrasound images by processing the reflected wave received by the ultrasound probe and executes a reconstruction process to the generated ultrasound images; and a control/storage/processing unit which controls the entire device while storing and processing data.
  • the ultrasound image reconstruction processing unit includes reception circuit means which receives the reflected wave signal received by the ultrasound probe, image generating means which generates ultrasound images from the reflected wave signal received by the reception circuit means, image processing means which executes the reconstruction process to the ultrasound image generated by the image generating means, and display means which displays an ultrasound image obtained by the reconstruction process by the image processing means on a screen.
  • the image processing means extracts an ultrasound frame image at a certain time point and an ultrasound frame image at a time point before the certain time point from a series of ultrasound frame images constituting the ultrasound images generated by the image generating means, calculates magnitudes of positional shifts between the extracted ultrasound frame image at the certain time point and the extracted ultrasound frame image at the time point before the certain time point, and reconstructs a composite ultrasound image for one frame by compensating for the positional shifts between the extracted ultrasound frame image at the certain time point and the extracted ultrasound frame image at the time point before the certain time point by use of information on the calculated magnitudes of positional shifts and merging the extracted ultrasound frame image at the certain time point and the extracted ultrasound frame image at the time point before the certain time point after undergoing the positional shift compensation together.
  • the resolution enhancement of the ultrasound images is realized without decreasing the frame rate. Further, the resolution enhancement effect can be increased by employing a suitable ultrasound probe scanning method for the image reconstruction process. Consequently, high-resolution ultrasound images can be acquired while maintaining an appropriate frame rate. Especially, improvement in the visibility of lesions moving fast can be expected.
  • FIG. 1 is a block diagram showing the configuration of an ultrasound diagnostic device for implementing the present invention.
  • FIG. 2 is a block diagram showing the configuration of another ultrasound diagnostic device for implementing the present invention.
  • FIG. 3 is a flow chart for executing an image reconstruction process by using multiple frame images and magnitudes of positional shifts.
  • FIG. 4 is a flow chart showing a case where the flow of FIG. 3 is equipped with a storage device.
  • FIG. 5A is a front view of ultrasound images that are obtained by converting ultrasound images acquired at times t ⁇ 3, t ⁇ 2, t ⁇ 1 and t into fan-shaped images with a scan converter by employing the configuration shown in FIG. 2 .
  • FIG. 5B is a front view of an ultrasound image showing an example of the result of the image reconstruction process executed to the ultrasound image 502 - 505 shown in FIG. 5A .
  • FIG. 5C is a schematic diagram showing an example of the result of the image reconstruction process (before the scan converter) executed to ultrasound images acquired at times t ⁇ 3, t ⁇ 2, t ⁇ 1 and t by employing the configuration shown in FIG. 1 .
  • FIG. 5D is a front view of an ultrasound image showing an example of the result of the image reconstruction process executed to the ultrasound image 507 - 510 shown in FIG. 5C .
  • FIG. 6A is a front view of ultrasound images that are obtained by converting ultrasound images acquired at times t ⁇ 2, t ⁇ 1 and t into fan-shaped images with the scan converter by employing the configuration shown in FIG. 2 .
  • FIG. 6B is a schematic diagram showing a state in which region splitting has been performed based on the magnitudes of positional shifts and weighting parameters of the image reconstruction process have been set in an ultrasound image 602 acquired at time t ⁇ 2.
  • FIG. 6C is a schematic diagram showing a state in which the region splitting has been performed based on the magnitudes of positional shifts and the weighting parameters of the image reconstruction process have been set in an ultrasound image 603 acquired at time t ⁇ 1.
  • FIG. 6D is a schematic diagram showing a state in which the region splitting has been performed based on the magnitudes of positional shifts and the weighting parameters of the image reconstruction process have been set in an ultrasound image 604 acquired at time t.
  • FIG. 6E is a schematic diagram showing the result of the calculation of the magnitudes of positional shifts between the ultrasound image 604 and 603 .
  • FIG. 7 is a flow chart for estimating an image of an intermediate frame on the temporal axis from captured images.
  • FIG. 8A is a schematic diagram showing the result of the calculation of the magnitudes of positional shifts between an ultrasound image 802 at time t ⁇ 1 and an ultrasound image 803 at time t.
  • FIG. 8B shows front views of ultrasound images 802 and 803 obtained by converting ultrasound images acquired at times t ⁇ 1 and t into fan-shaped images with the scan converter and an ultrasound image 804 of the intermediate frame estimated by the flow of FIG. 7 .
  • FIG. 8C is a schematic diagram showing the magnitudes of positional shifts at time t ⁇ t estimated from the ultrasound images acquired at times t ⁇ 1 and t.
  • FIG. 9 is a flow chart for executing the image reconstruction process by using ultrasound images captured by changing the scan condition frame by frame.
  • FIG. 10A is a cross-sectional view of the ultrasound probe showing the changing of the scan orientation frame by frame.
  • FIG. 10B is a front view of an ultrasound image after the scan converter, showing an example of merging images captured by changing the scan orientation frame by frame in the flow of FIG. 9 .
  • FIG. 10C is a front view of an ultrasound image before the scan converter, showing an example of merging images captured by changing the scan orientation frame by frame in the flow of FIG. 9 .
  • FIG. 11 is a cross-sectional view of the ultrasound probe showing an example of changing the scan orientation for three frames.
  • FIG. 12A is a cross-sectional view of the ultrasound probe showing a state in which the scan range is changed frame by frame.
  • FIG. 12B is a front view of an ultrasound image showing an example of merging images captured by changing the scan range frame by frame.
  • FIG. 13A is a cross-sectional view of the ultrasound probe showing a state in which the scan focal length is changed frame by frame.
  • FIG. 13B is a front view of an ultrasound image showing an example of merging images captured by changing the scan focal length frame by frame.
  • FIG. 14A is a front view of an ultrasound image showing an example of a region to be scanned densely specified by the user on the ultrasound image.
  • FIG. 14B is a cross-sectional view of the ultrasound probe showing an example of densely scanning the region specified by the user.
  • FIG. 15 is a flow chart for executing the image reconstruction process by using ultrasound images captured by changing the scan condition frame by frame by taking advantage of periodicity of the movement of the test object.
  • FIG. 16 is a front view of ultrasound images showing an example of capturing iso-phase frame images (frame images having the same temporal phase in cycles) under different scan conditions.
  • FIG. 17 is a schematic diagram showing a GUI used for executing the image reconstruction process to the ultrasound images (acquired by changing the scan condition from frame by frame) and for setting parameters of the image reconstruction process.
  • FIG. 18 is a schematic diagram showing a GUI used for a process for enhancing the resolution of a region specified by the user and for setting parameters.
  • FIG. 19 is a schematic diagram showing a GUI used for a process for estimating an intermediate frame image on the temporal axis from captured images and for setting parameters.
  • FIG. 20 is a schematic diagram showing a GUI used for executing the image reconstruction process to ultrasound images captured by changing the scan condition by taking advantage of the cycle of the movement of the test object and for setting parameters.
  • FIG. 21 is a block diagram showing the configuration of an image reconstruction processing device for implementing the present invention.
  • FIG. 22 is a block diagram showing the configuration of another image reconstruction processing device for implementing the present invention.
  • FIG. 23 is a flow chart of the image reconstruction process using multiple frame images.
  • FIG. 24 is a flow chart for generating the intermediate frame image on the temporal axis from acquired ultrasound images.
  • the present invention resolves the aforementioned problem by employing an ultrasound image reconstruction method including the processes described below, an ultrasound image reconstruction device equipped with the image reconstruction process, and an ultrasound diagnostic device equipped with the image reconstruction process.
  • the first case of this invention is that one high-resolution ultrasound image is generated from a plurality of ultrasound images acquired along a time series (ultrasound image group) by employing an image reconstruction process.
  • an image reconstruction process suppressing the effect of noise is realized by generating one high-resolution ultrasound image by using multiple frames of ultrasound images (multiple ultrasound frame images) without executing the image reconstruction process by using one frame of ultrasound image (one ultrasound frame image).
  • multiple frame images for the image reconstruction process complementary synthesis of the image information on each frame becomes possible, achieving excellent effect in the resolution enhancement.
  • an ultrasound image at a particular temporal phase as the object of the processing (processing object image) and ultrasound images to be inputted to the image reconstruction process (input images) are extracted first.
  • magnitudes of positional shifts are calculated for the processing object image and each of the input images.
  • a high-resolution processing object image is generated from the input ultrasound images and the magnitudes of positional shifts by employing the image reconstruction process. Specifically, by previously calculating the magnitudes of positional shifts between frames and using the calculated magnitudes of positional shifts for the image reconstruction process, influence of image blurring that is caused by positional shifts occurring in the simple frame averaging (arithmetic mean) can be suppressed. Further, region splitting is conducted to the processing object image and a weighting parameter of the image reconstruction process is set for each of the regions acquired by the splitting.
  • the region splitting can either be conducted in a manually given region or performed automatically based on the magnitudes of positional shifts.
  • this processing is characterized in that an image in a region (regional image) having a larger weighting parameter is incorporated more into the result of the image reconstruction process.
  • a point where the magnitude of positional shift is large has a high probability that parts around the point have deformed significantly, and thus there are cases where executing the image reconstruction process by compensating for the deformation is difficult.
  • regions in which the positional shift compensation is difficult are assigned small weighting parameters according to the present invention.
  • the image data of the processing object image becomes dominant.
  • regions in which the image reconstruction process is highly effective can be extracted automatically and the resolution enhancement can be performed on such regions even in the observation of a part moving fast (e.g., heart).
  • the second case of this invention is that by using ultrasound images acquired by conducting the image capturing at the image acquisition intervals and the magnitudes of positional shifts between images calculated by a method similar to the above case (1), estimating an ultrasound image that is supposed to be acquired by conducting the image capturing with timing shifted from the capturing timing of the processing object image (ultrasound image as the object of the image reconstruction process) by a time shorter than the image acquisition interval (time interval specified along the time series).
  • the above case (1) is a process for increasing the spatial resolution
  • this case (2) is a process for increasing the resolution in the temporal direction by estimating frame images between the acquired frame images. According to this case, the frame rate can be increased without decreasing the number of scans per frame (i.e., without deteriorating the spatial resolution of images).
  • the third case of this invention is that since the image reconstruction process using multiple frames is a process of complementarily synthesizing the image information on each frame as mentioned in the explanation of the above case (1), the resolution enhancement effect is weak if substantially identical images are inputted to the image reconstruction process.
  • an aspect of the present case is characterized in that ultrasound images differing in the scan condition are acquired by controlling the ultrasound probe and the image reconstruction process is executed by using the ultrasound images acquired under different scan conditions. Specifically, changing the scan condition allows the ultrasound images to contain a substantial amount of complementary information, by which the resolution enhancement effect by the image reconstruction process can be increased.
  • Usable scan conditions may include the interlace method which alternately switches between image acquisition exclusively in even-numbered scan orientations and image acquisition exclusively in odd-numbered scan orientations frame by frame. In regions in which the movement is small, the resolution enhancement can be achieved just by simply overlaying images acquired by the interlace method.
  • jitter an image shift called “jitter” can occur at the interfaces between images. Also for such jitter, a process of synthesizing seamless frame images can be realized by conducting a compensation process by using the magnitudes of positional shifts. This method can be implemented also for three or more frames in a similar manner.
  • a method switching the scan focal length frame by frame can also be employed as another scan method. Specifically, if the focal point of the ultrasound beam during the scan is restricted to a particular position, the images of the other parts are blurred even though a sharp and clear image can be acquired for the particular position where the beam is converged. Therefore, the tight-focused image area can be increased by merging (combining) multiple ultrasound images acquired by changing the scan focal length frame by frame. Incidentally, this method is capable of increasing the spatial resolution of images without deteriorating the frame rate since the number of scans per frame is not increased in this method.
  • the fourth case of this invention is that the cycle of the movement of the part as the observation object is acquired, the image reconstruction process is employed for ultrasound images (ultrasound image group) acquired by executing the image capturing for a time range (image capturing time range) longer than or equal to twice the cycle, and ultrasound images within a time range shorter than the image capturing time range are generated by the image reconstruction process.
  • the ultrasound probe is controlled so that each image in the ultrasound image group (object image) and an image captured substantially the cycle before the capturing time of the object image (past object image) are captured under different scan conditions. Since a part like the heart repeats periodical movement, ultrasound images of such a part captured at times at the same temporal phase in the repeated cycles become substantially identical with each other. Thus, for the same reason as that described in the explanation of the above case (3), the resolution enhancement effect cannot be expected so much even if a lot of substantially identical images are inputted to the image reconstruction process.
  • the image capturing of the aforementioned object image and that of the aforementioned past object image in the present case are carried out under different scan conditions by changing the scan condition, by which the ultrasound images are allowed to contain a substantial amount of complementary information and the resolution enhancement effect by the image reconstruction process can be increased.
  • the scan orientation, the scan range, the scan focal length, etc. may be changed as the scan condition.
  • FIG. 1 is a block diagram showing an example of the configuration of the ultrasound diagnostic device 101 .
  • the ultrasound diagnostic device 101 comprises an ultrasound probe 103 which transmits and receives ultrasound signals, a driving circuit 102 which generates a driving signal to be inputted to the ultrasound probe 103 , a reception circuit 104 which conducts amplification and A/D conversion to received signals, an image generating unit 105 which generates an image in which a scan line signal sequence of the ultrasound scan is arranged in a two-dimensional array, an image processing unit 106 which performs image processing such as the image reconstruction process, a scan converter 112 which conducts a coordinate transformation process and an interpolation process to images represented by the scan line signal sequences, a display unit 113 which displays images generated by the scan converter, and a control/storage/processing unit 120 which controls all the above components while storing and processing data.
  • the ultrasound probe 103 transmits an ultrasound signal based on the driving signal toward a test object 100 .
  • the ultrasound probe 103 also receives a reflected wave from the test object 100 in response to the signal transmission and converts the received reflected wave into an electric reception signal.
  • There are various types of ultrasound probes 103 such as the so-called linear type, convex type, sector type and radial type.
  • an image in a rectangular shape is converted by the scan converter 112 into an image in a fan-like shape.
  • the control/storage/processing unit 120 includes an input unit 121 , a control unit 122 , a storage unit 123 and a processing unit 124 . From the input unit 121 , information on the timing for starting the image generation, parameters regarding the image generation, etc. are inputted.
  • the control unit 122 controls the operations of the driving circuit 102 , the ultrasound probe 103 , the reception circuit 104 , the image processing unit 106 , and so forth.
  • the storage unit 123 stores the received signals (reception signals), the images generated by the image generating unit 105 , images generated by calculation by the image processing unit 106 , display images outputted by the scan converter 112 , etc.
  • the processing unit 124 performs a shaping process on the electric signal to be inputted to the ultrasound probe 103 , a process of adjusting the brightness and the contrast in the displaying of the images, etc.
  • the ultrasound probe 103 transmits the ultrasound signal based on the driving signal controlled by the control unit 122 of the control/storage/processing unit 120 to the test object 100 , receives the reflected wave from the test object 100 in response to the signal transmission, and converts the received reflected wave into the electric reception signal. Subsequently, the reception circuit 104 conducts amplification and A/D conversion to the reception signal converted to the electric signal.
  • the image generating unit 105 generates images by processing the digital signal acquired by the A/D conversion and inputs the generated images to the image processing unit 106 .
  • the image processing unit 106 executes the image reconstruction process to the inputted images, by which a high-resolution output image is acquired.
  • the scan converter 112 conducts the image coordinate transformation process and the interpolation process to the output image and thereby generates an image.
  • the configuration of the ultrasound diagnostic device 101 is not restricted to this example.
  • the image processing unit 106 may also be arranged after the scan converter 112 as illustrated in the configuration of an ultrasound diagnostic device 201 in FIG. 2 .
  • FIGS. 21 and 22 are block diagrams showing the internal processing by the image processing unit 106 .
  • the image data outputted from the image generating unit 105 is first inputted to an ultrasound image group acquiring unit 2101 , by which a frame image of the inputted image data is stored in the storage unit 123 of the control/storage/processing unit 120 and is also transmitted to a positional shift calculation unit 2102 .
  • the frame image transmitted from the ultrasound image group acquiring unit 2101 and a past frame image group (past frame images) stored in the storage unit 123 are inputted to the positional shift calculation unit 2102 , by which the magnitudes of positional shifts are calculated.
  • FIG. 22 shows another example of the internal processing by the image processing unit 106 .
  • the scan orientation or the focal length of the ultrasound beam is set by a scan condition selecting unit 2201 and the ultrasound images are captured according to the scan condition.
  • the image reconstruction process is executed similarly to the processing shown in FIG. 21 .
  • an ultrasonic wave is emitted toward the test object 100 by use of the ultrasound probe 103 and a reflected wave from a tissue inside the test object 100 is detected by the ultrasound probe 103 .
  • the detected signal is sent to the image generating unit 105 via the reception circuit 104 and processed by the image generating unit 105 , by which ultrasound images (ultrasound image group) X[t], X[t ⁇ 1], X[t ⁇ 2], . . . captured along a time series are acquired (S 301 ).
  • X[t] represents an ultrasound image captured last, and X[t ⁇ 1], X[t ⁇ 2], . . . represent ultrasound images captured before the ultrasound image X[t].
  • the ultrasound images acquired along the time series are sent to the image processing unit 106 and inputted to the ultrasound image group acquiring unit 2101 of the image processing unit 106 , by which each of the frame images is stored in the storage unit 123 of the control/storage/processing unit 120 .
  • the positional shift calculation unit 2102 extracts an ultrasound image as the object of the image reconstruction process (processing object image) from the ultrasound images outputted from the ultrasound image group acquiring unit 2101 and also extracts ultrasound images to be inputted to the image reconstruction process (input images (input image group)) from the frame images stored in the storage unit 123 of the control/storage/processing unit 120 .
  • the ultrasound image X[t] outputted from the ultrasound image group acquiring unit 2101 is extracted as the processing object image, and the ultrasound images X[t], X[t ⁇ 1] and X[t ⁇ 2] stored in the storage unit 123 are extracted as the input image group.
  • the positional shift calculation unit 2102 calculates the magnitudes of positional shifts between the processing object image and each image in the input image group (S 302 ).
  • the magnitudes of positional shifts can be calculated by employing common algorithm for the positional shift calculation such as the optical flow method and the block matching method.
  • a high-resolution processing object image Y[t] is generated by the image reconstruction processing unit 2103 from the input image group and the calculated magnitudes of positional shifts (S 303 ) and displayed on the screen of the display unit 113 (S 304 ).
  • Xi denotes the i-th image in the input image group (including N images)
  • Y denotes the high-resolution image generated by the image reconstruction process
  • Si denotes an operation (effect) representing the positional shifts of the i-th image
  • Fi denotes an operation (effect) representing the blurring of the i-th image
  • D denotes an operation (effect) due to the quantization
  • Tx denotes an operation (effect) shifting the image in the X direction by 1 pixel
  • Ty denotes an operation (effect) shifting the image in the Y direction by 1 pixel.
  • the first term in the expression (1) is a term representing the error between the high-resolution image Y observed while being affected by various image deteriorating factors and each image Xi.
  • the second term is a term stabilizing the reconstructed high-resolution image Y to have smooth luminance values.
  • the stabilization term is adjusted by the parameter ⁇ .
  • the reference character 2301 represents the high-resolution ultrasound image Y which should be estimated by the image reconstruction process.
  • the reference characters 2306 - 1 and 2306 - 2 represent the acquired first and second frames of ultrasound images (first and second ultrasound frame images), respectively.
  • the positional shift operation is performed on the image 2301 (S 2302 - 1 , S 2302 - 2 ).
  • the image blurring operation due to the image capturing is performed (S 2303 - 1 , S 2303 - 2 ) and the image quantization operation is performed (S 2304 - 1 , S 2304 - 2 ).
  • each image DFiSiY acquired by the above process and each captured image Xi is calculated (S 2305 - 1 , S 2305 - 2 ) and the sum Ln(Y) of the differences is calculated (S 2308 ). Then, the image Y is updated so as to reduce the value of Ln(Y) (S 2310 ).
  • the process flow shown in FIG. 3 can also be performed as shown in FIG. 4 in the actual processing.
  • the ultrasound images of the test object 100 generated by the image generating unit 105 are previously stored in the storage unit 123 of the control/storage/processing unit 120 and the stored ultrasound images X[t], X[t ⁇ 1] and X[t ⁇ 2] are used for the image reconstruction process, for example. It is also possible to generate high-resolution video (motion video) data by conducting the resolution enhancement offline to the images accumulated in the storage unit 123 all at once.
  • an ultrasonic wave is emitted toward the test object 100 by use of the ultrasound probe 103 and a reflected wave from a tissue inside the test object 100 is detected by the ultrasound probe 103 .
  • the detected signal is sent to the image generating unit 105 via the reception circuit 104 and processed by the image generating unit 105 , by which ultrasound images X[t], X[t ⁇ 1], X[t ⁇ 2], . . . are acquired (S 401 ).
  • the acquired ultrasound images X[t], X[t ⁇ 1], X[t ⁇ 2], . . . are stored in the storage unit 123 of the control/storage/processing unit 120 .
  • the ultrasound image group acquiring unit 2101 of the image processing unit 106 acquires the processing object image and the input image group (input images) from the ultrasound images X[t], X[t ⁇ 1], X[t ⁇ 2], . . . stored in the storage unit 123 , and the positional shift calculation unit 2102 calculates the magnitudes of positional shifts between the acquired processing object image and each image in the acquired input image group (S 402 ).
  • a high-resolution processing object image Y[t] is generated by the image reconstruction processing unit 2103 from the input image group and the calculated magnitudes of positional shifts (S 403 ) and displayed on the screen of the display unit 113 (S 404 ).
  • FIGS. 5A-5D An examples of the resolution enhancement of an ultrasound images according to the process flow of FIG. 4 is shown in FIGS. 5A-5D .
  • the images 502 - 505 are the ultrasound images acquired at times t ⁇ 3, t ⁇ 2, t ⁇ 1 and t along the temporal axis 501 , respectively.
  • the reference character 506 in FIG. 5B represents the image obtained by performing the resolution enhancement on the ultrasound image 505 (acquired at the time t) by the image reconstruction process by using the images 502 - 505 shown in FIG. 5A .
  • the image data acquired from the ultrasound probe 103 are converted by the scan converter 112 into fan-shaped images and the process is executed by using the fan-shaped images (obtained by the conversion) as the ultrasound images (an example of the process in the device configuration shown in FIG. 2 ).
  • a high-resolution ultrasound image 511 (before the scan converter) shown in FIG. 5D is generated from ultrasound images 507 - 510 (before the scan converter) shown in FIG. 5C .
  • the images 507 - 510 in FIG. 5C are ultrasound images acquired at times t ⁇ 3, t ⁇ 2, t ⁇ 1 and t along the temporal axis 501 , respectively, and the reference character 511 in FIG. 5D represents the image obtained by performing the resolution enhancement on the ultrasound image 510 (acquired at the time t) by the image reconstruction process by using the images 507 - 510 shown in FIG.
  • the high-resolution ultrasound image 511 obtained by the resolution enhancement can be converted into the fan-shaped image shown in FIG. 5B and displayed on the screen of the display unit 113 .
  • FIGS. 6A-6E An example of conducting region splitting to the ultrasound images based on the magnitudes of positional shifts between images and setting a weighting parameter of the image reconstruction process for each of the split regions is shown in FIGS. 6A-6E .
  • This example is characterized in that an image in a region (regional image) having a larger weighting parameter is reflected more into the result of the image reconstruction process.
  • a point where the magnitude of positional shift is large has a high probability that parts around the point have deformed significantly, and thus there are cases where executing the image reconstruction process by compensating for the deformation is difficult.
  • regions in which the positional shift compensation is difficult are assigned small weighting parameters according to the present embodiment.
  • the image data of the processing object image becomes dominant.
  • regions in which the image reconstruction process is highly effective can be extracted automatically and the resolution enhancement can be performed on such regions even in the observation of a part moving fast (e.g., heart).
  • the reference characters 602 - 604 in FIG. 6A represent ultrasound images captured along the temporal axis 601 .
  • the ultrasound image 604 is assumed to be the processing object image.
  • the reference character 605 in FIG. 6E represents the result of the calculation of the magnitudes of positional shifts between the ultrasound images 604 and 603 .
  • Each arrow 615 indicates the direction and the magnitude of the positional shift.
  • the reference characters 606 - 608 in FIG. 6E represent the result of the splitting into three regions based on the magnitudes of positional shifts.
  • the region 607 is the region in which the positional shift is the largest, while the region 606 is the region in which the positional shift is the smallest.
  • the reference characters 609 in FIG. 6B , 610 in FIGS. 6C and 611 in FIG. 6D represent the result of setting the weighting parameters of the image reconstruction process based on the region splitting results 606 - 608 shown in FIG. 6E .
  • regions 612 - 614 in which the positional shift is small have been assigned weighting parameters 0.3, 0.3 and 0.4, respectively. This means that the images of the regions 612 - 614 shown in FIGS. 6B-6D are almost equally incorporated into the image reconstruction result in the image reconstruction process.
  • the weighting parameter has been set at 0 except for the region 617 in FIG. 6D . This means that only the image of the region 617 in FIG. 6D is reflected into the image reconstruction result in the image reconstruction process in regard to the region 607 in FIG. 6 E.
  • Regions 618 - 620 in FIGS. 6B-6D have also been assigned the weighting parameters in a similar manner.
  • the image reconstruction process taking the weighting parameters in consideration can be executed by minimizing the value of the following expression (2):
  • “Wi” in the above expression represents an operation (effect) of multiplying by the weighting parameter of the i-th image.
  • the region splitting may either be performed automatically based on the magnitudes of positional shifts as explained above or performed by use of regions specified by the user on a GUI.
  • FIG. 17 shows an example of a GUI used in this example for generating the high-resolution ultrasound image from the ultrasound image group (acquired by changing the scan condition frame by frame) by the image reconstruction process, displaying the generated high-resolution ultrasound image in real time, and setting the scan condition and the image reconstruction process parameters.
  • the window 1701 is displaying the ultrasound images captured by the ultrasound probe in real time.
  • the image capturing frame rate is set by using the box 1702 .
  • the actual image capturing frame rate is displayed in the window 1701 as indicated by the reference character 1703 .
  • the parameters of the image reconstruction process are set by using the boxes 1704 - 1706 .
  • the size of the output image after the image reconstruction process is set by using the box 1704 .
  • the number of frame images to be used for the image reconstruction process is specified by using the box 1705 .
  • the scan method is selected by using the box 1706 .
  • the check box 1707 is selected, the image capturing is carried out by switching the scan orientation frame by frame by the interlace method.
  • the check box 1708 is selected, the image capturing is carried out while changing the focal length of the ultrasound beam frame by frame.
  • the image reconstruction process is carried out.
  • the high-resolution image obtained by the resolution enhancement by the image reconstruction process is displayed in real time in the window 1710 .
  • the display frame rate is displayed in real time as indicated by the reference character 1711 .
  • the frame rate is increased by estimating and displaying intermediate frame images between the acquired ultrasound images on the temporal axis.
  • this example 2 increases the resolution in the temporal direction by estimating frame images between the acquired frame images.
  • the frame rate can be increased without decreasing the number of scans per frame (i.e., without deteriorating the spatial resolution of images).
  • the capturing time interval H of the ultrasound images is acquired (S 701 ).
  • the image acquisition interval H may either be given manually or figured out from the value of the requested frame rate.
  • ultrasound images X[t], X[t ⁇ 1], X[t ⁇ 2], . . . are acquired by imaging the test object 100 with the ultrasound probe 103 along a time series at the image acquisition intervals (S 702 ).
  • the acquired frame images are stored in the storage unit 123 .
  • the magnitudes of positional shifts between images are calculated similarly to the example 1 (S 704 ).
  • an ultrasound image that is supposed to be acquired by imaging the test object 100 with timing shifted from the capturing timing of the processing object image by a time shorter than the image acquisition interval (intermediate frame image) is estimated (S 705 ) and outputted to the screen (S 706 ).
  • the sequence of steps S 702 -S 706 is repeated depending on the result of a termination judgment (S 707 ).
  • FIG. 24 shows a flow in a case where the output frame rate is specified in this process.
  • the shift width ⁇ t of the intermediate frame image (the image to be estimated) on the temporal axis is initialized to 0 (S 2400 ).
  • the capturing time interval H of the ultrasound images is acquired (S 2401 ).
  • the capturing time interval H may either be set by use of a manually inputted value or figured out from an inputted frame rate.
  • a time interval K of output images is acquired (S 2402 ).
  • the output image time interval K may either be set by use of a manually inputted value or figured out from the requested frame rate.
  • the acquired image is stored in the storage unit 123 .
  • the magnitudes of positional shifts between images are calculated similarly to the flow of FIG. 7 (S 2404 ), and the intermediate frame image X[t ⁇ t] is estimated based on the magnitudes of positional shifts and the ultrasound images stored in the storage unit 123 (S 2405 ).
  • the shift width ⁇ t on the temporal axis is updated as ⁇ t ⁇ t ⁇ K/H (S 2406 ).
  • FIGS. 8A-80 An example of the result of the processing according to this flow is shown in FIGS. 8A-80 .
  • the ultrasound images 802 and 803 in FIG. 8B are those captured at the image acquisition interval H along the temporal axis 801 .
  • the ultrasound image 804 is an image as the result of the estimation of the ultrasound image captured at time t ⁇ t ( ⁇ t ⁇ 1) from the ultrasound images 802 and 803 .
  • the linear-shaped part that can be seen in the region 805 in the ultrasound image 804 has moved from the upper left toward the lower right between the ultrasound images 802 and 803 .
  • the ultrasound image 804 has been estimated so that the linear-shaped part is situated at an intermediate position between the two positions in the ultrasound images 802 and 803 .
  • the magnitudes of positional shifts between the time t and the time t ⁇ 1 are calculated first as shown in FIG. 8A ( 806 ). Subsequently, the magnitudes of positional shifts at the time of the intermediate frame image (like the magnitudes of positional shifts shown in FIG. 8C ) are estimated from the magnitudes 806 of positional shifts ( 807 ). This estimation can be performed simply by executing linear interpolation to the calculated magnitudes 806 of positional shifts. Finally, the intermediate frame image 804 can be generated by conducting the merging or weighted addition to the pixels of the acquired ultrasound images 802 and 803 shown in FIG. 8B based on the estimated magnitudes of positional shifts.
  • FIG. 19 shows an example of a GUI used in this example for estimating the intermediate frame image on the temporal axis from the captured ultrasound images and thereby displaying ultrasound images at an increased frame rate.
  • the window 1901 is displaying the ultrasound images captured by the ultrasound probe in real time.
  • the image capturing frame rate is set by using the box 1902 .
  • the actual image capturing frame rate is displayed in the window 1901 as indicated by the reference character 1903 .
  • the frame rate of the output images is set by using the box 1904 .
  • This process is started when the button 1910 is pressed.
  • the reference character 1905 represents a frame image acquired last (frame t).
  • the reference character 1906 represents a frame image (frame t ⁇ 1) acquired just before the frame image 1905 .
  • the reference character 1907 represents the image of the exactly intermediate frame on the temporal axis (frame t ⁇ 0.5) estimated from the frame images 1905 and 1906 .
  • the images obtained by increasing the frame rate by the above process are displayed in the window 1908 together with the frame rate 1909 .
  • a third example of the image reconstruction process in the present invention will be described below referring to a flow chart of FIG. 9 .
  • the image reconstruction process is executed more effectively by switching the scan condition of the ultrasound probe frame by frame. Since the image reconstruction process is a process of complementarily interpolating image information between frames, the resolution enhancement effect is weak if substantially identical images are inputted to the image reconstruction process.
  • this example is characterized in that ultrasound images differing in the scan condition are acquired by controlling the ultrasound probe and the image reconstruction process is executed by using the ultrasound images acquired under different scan conditions.
  • changing the scan condition allows the ultrasound images to contain a substantial amount of complementary information, by which the resolution enhancement effect by the image reconstruction process can be increased.
  • the scan condition of the ultrasound probe is set by selecting one from previously prepared scan conditions (S 901 ).
  • Selectable scan conditions may include the interlace method which alternately switches between image acquisition exclusively in even-numbered scan orientations and image acquisition exclusively in odd-numbered scan orientations frame by frame. In regions in which the movement is small, the resolution enhancement can be achieved just by simply overlaying two frame images acquired by the interlace method.
  • jitter a positional shift called “jitter” can occur at the interfaces between frames. Also for such jitter, a compensation process can be conducted by using the magnitudes of positional shifts. In this method, the scan orientation switching and the image synthesis are possible also for three or more frames in a similar manner.
  • a method switching the scan focal length frame by frame can also be employed as another scan method. Specifically, if the focal point of the ultrasound beam during the scan is restricted to a particular position, the image of the other parts are blurred even though a sharp and clear image can be acquired for the particular position. Therefore, the tight-focused image area can be increased by merging (combining) multiple ultrasound images acquired by changing the scan focal length frame by frame.
  • an ultrasound image X[t] is acquired by imaging the test object 100 with the ultrasound probe 103 under the selected scan condition along a time series (S 902 ).
  • the acquired ultrasound images X[t], X[t ⁇ 1], . . . are stored in the storage unit 123 .
  • the high-resolution ultrasound image Y[t] of the ultrasound image X[t] is generated from the ultrasound images by the image reconstruction process (S 904 ) and displayed (S 905 ).
  • this example is capable of increasing the spatial resolution of images without deteriorating the frame rate since the number of scans per frame is not increased in this example.
  • FIGS. 10A-10C An example of the scan orientation switching and the result of this process flow are shown in FIGS. 10A-10C .
  • one frame image is generated from two frame images differing in the scan orientation.
  • the scan orientations 1001 - 1 - 1001 - 5 are those of ultrasound beams emitted from the ultrasound probe 103 for the first frame
  • the scan orientations 1002 - 1 - 1002 - 4 are those of ultrasound beams emitted from the ultrasound probe 103 for the second frame.
  • the partial images 1003 - 1 - 1003 - 5 represent image data acquired by the scan for the first frame
  • the partial images 1004 - 1 - 1004 - 4 represent image data acquired by the scan for the second frame.
  • an ultrasound image 1007 with an improved resolution with respect to the azimuth direction can be obtained by complementarily synthesizing image information on each frame by integrating the image data of two frames.
  • the ultrasound image 1007 can be generated either by use of the image reconstruction process by determining the magnitudes of positional shifts between images similarly to the example 1 or by simply conducting averaging (arithmetic mean).
  • an ultrasound image with an enhanced resolution can be generated similarly to the case of the first frame, by emitting ultrasound beams in the scan orientations 1001 - 1 - 1001 - 5 shown in FIG. 10A and integrating image data acquired in the second frame and the third frame.
  • the ultrasound image 1007 shown in FIG. 10B is obtained by executing this process by use of ultrasound images after the scan converter in the system configuration shown in FIG. 2
  • this process may also be executed by use of ultrasound images before the scan converter by employing the system configuration shown in FIG. 1 .
  • the reference character 1008 in FIG. 10C represents an example of applying this process to ultrasound images before the scan converter.
  • the high-resolution ultrasound image 1008 is obtained by acquiring image data of the partial images 1005 - 1 - 1005 - 5 in the first frame, acquiring image data of the partial images 1006 - 1 - 1006 - 4 in the second frame, and merging the image data acquired in the first frame and the image data acquired in the second frame. While this explanation has been given for two frames, this process can also be executed for three or more frames in a similar manner.
  • FIG. 11 shows an example of the process for three frames.
  • the scan orientations 1101 - 1 - 1101 - 3 are those for the first frame
  • the scan orientations 1102 - 1 - 1102 - 3 are those for the second frame
  • the scan orientations 1103 - 1 - 1103 - 3 are those for the third frame.
  • FIGS. 13A and 13B an example of acquiring ultrasound images by changing the focal length of the ultrasound beam frame by frame in the scan is shown in FIGS. 13A and 13B .
  • ultrasound images are acquired in the first frame by focusing the ultrasound beam on the positions of the circles 1302 - 1 - 1302 - 5 , and in the second frame by focusing the ultrasound beam on the positions of the circles 1303 - 1 - 1303 - 5 .
  • the ultrasound beam has a characteristic in that focusing the ultrasound beam on one point leads to the blurring of the other parts in the acquired image.
  • the focal point of the ultrasound beam is generally set substantially at the center of the image so that the whole image becomes sharp and clear on the average.
  • ultrasound images are acquired by actively changing the focal position and the acquired ultrasound images are integrated together. This makes it possible to acquire a sharp and clear ultrasound image that is tight-focused throughout the whole image.
  • This process can also be applied exclusively to a region specified by the user as shown in FIGS. 14A and 14B .
  • the reference character 1402 represents the region (ROI) specified by the user.
  • This process can also be employed together with the multi-beam method in which signals are received by simultaneously emitting ultrasound beams in two orientations or an ultrasound beam is emitted in another orientation before a signal is received by emitting an ultrasound beam in one orientation.
  • FIG. 18 shows an example of a GUI used in this example for enhancing the resolution of a region specified by the user (ROI) and displaying the resolution-enhanced image.
  • the window 1801 is displaying the ultrasound images captured by the ultrasound probe in real time.
  • the image capturing frame rate is set by using the box 1802 .
  • the actual image capturing frame rate is displayed in the window 1801 as indicated by the reference character 1803 .
  • the reference character 1804 represents the region ROI specified by the user by the mouse clicking, etc.
  • the parameters of the image reconstruction process are set by using the boxes 1805 - 1807 .
  • the image magnification factor by the image reconstruction process is set by using the box 1805 .
  • the number of frame images to be used for the image reconstruction process is specified by using the box 1806 .
  • the scan method is selected by using the box 1807 .
  • the button 1808 is pressed, the image reconstruction process is executed exclusively to the inside of the ROI 1804 and an image with an enhanced resolution is displayed in the window 1809 .
  • ultrasound images of a test object that moves periodically are acquired by controlling the ultrasound probe by using cycle information on the periodically moving test object.
  • high-resolution ultrasound images for a shorter time range e.g., one cycle
  • ultrasound images of such a part captured at times at the same temporal phase in the repeated cycles become substantially identical with each other.
  • the resolution enhancement effect cannot be expected so much even if a lot of substantially identical images are inputted to the image reconstruction process.
  • the image capturing of the aforementioned object image and that of the aforementioned past object image in the present example are carried out under different scan conditions by changing the scan condition, by which the ultrasound images are allowed to contain a substantial amount of complementary information and the resolution enhancement effect by the image reconstruction process can be increased.
  • the cycle T of the movement of the test object 100 is acquired (S 1501 ).
  • the cycle T may either be given manually or calculated automatically from ultrasound images acquired by imaging the test object 100 for a certain time range.
  • the scan condition of the ultrasound probe is set by selecting one from previously prepared scan conditions (S 1502 ).
  • the scan orientation, the scan range, the scan focal length, etc. can be changed as the selectable scan condition similarly to the example 3.
  • ultrasound images of the test object 100 are acquired along a time series by using the ultrasound probe 103 for two cycles or longer by changing the scan condition frame by frame (S 1503 ).
  • the scan orientation, the scan range, the scan focal length, etc. can be changed as the scan condition.
  • the acquired images are stored in the storage unit 123 .
  • the scan condition may either be changed cycle by cycle or frame by frame as long as the scan condition differs between two ultrasound images that are one cycle apart from each other.
  • a termination judgment step (S 1505 ) judges that the image capturing has not finished
  • the scan condition selecting step (S 1502 ) and the ultrasound image acquiring step (S 1503 ) are repeated as a loop.
  • the ultrasound images are inputted to the image reconstruction process, by which high-resolution ultrasound images are generated (S 1506 ) and displayed (S 1507 ).
  • FIG. 16 shows an example of periodically changing the scan orientation for a periodically moving test object according to the flow of FIG. 15 .
  • the ultrasound image 1601 - 1 is a frame image acquired at time t.
  • the ultrasound image 1601 - 4 is a frame image acquired one cycle T before the ultrasound image 1601 - 1 .
  • the ultrasound image 1601 - 3 is a frame image acquired at time t ⁇ T+1.
  • the ultrasound image 1601 - 2 is a frame image acquired at time t ⁇ T+2.
  • the reference characters 1602 - 1 - 1602 - 4 represent the scan orientations at the times of acquisition of the ultrasound images 1601 - 1 - 1601 - 4 , respectively.
  • FIG. 12A shows an example of acquiring and synthesizing images of a periodically moving test object by changing the scan range cycle by cycle according to the flow of FIG. 15 .
  • the scan orientations 1201 - 1 - 1201 - 3 are those at time t.
  • the scan orientations 1202 - 1 - 1202 - 3 are those one cycle before the scan orientations 1201 - 1 - 1201 - 3 .
  • the scan orientations 1203 - 1 - 1203 - 3 are those two cycles before the scan orientations 1201 - 1 - 1201 - 3 .
  • the partial image 1204 - 1 is an ultrasound image acquired with the scan orientations 1201 - 1 - 1201 - 3
  • the partial image 1204 - 2 is an ultrasound image acquired with the scan orientations 1202 - 1 - 1202 - 3
  • the partial image 1204 - 3 is an ultrasound image acquired with the scan orientations 1203 - 1 - 1203 - 3 .
  • One high-resolution ultrasound image 1204 can be generated by coupling the partial images 1204 - 1 - 1204 - 3 together.
  • image coupling it is possible to calculate the average (arithmetic mean) for parts where images overlap with each other or to execute a correction process to the interfacial parts (where images are coupled together) with a diffusing filter (blurring filter) or the like so that the images are connected seamlessly at the interface.
  • FIG. 20 shows an example of a GUI used in this example for executing the image reconstruction process by using ultrasound images captured by changing the scan condition by taking advantage of the cycle of the movement of the test object.
  • the process in this example is not a real-time process like those explained in the examples 1-3 but a process of generating a high-resolution ultrasound video offline from ultrasound images (input ultrasound video) acquired by imaging the test object for a certain time range.
  • the reference character 2001 represents the ultrasound video as the object of the processing.
  • the user can preview the ultrasound video 2001 by using the tool bar 2002 for starting/stopping the playback, changing the playback position, etc.
  • the reference characters 2003 - 2007 represent parameter setting items of the image reconstruction process.
  • the size of the output image (video) is set by using the box 2003 .
  • the cycle of the movement of the test object is set by using the box 2004 .
  • the cycle may either be given manually or calculated automatically from the input ultrasound video in response to the pressing of the button 2008 by the user.
  • the time range of the output video of the image reconstruction process is set by using the box 2005 .
  • the number of frame images to be used for the image reconstruction process is set by using the box 2006 .
  • the scan method is selected by using the box 2007 .
  • the check box 2008 the image capturing is carried out by switching the scan orientation frame by frame by the interlace method.
  • the check box 2009 the image capturing is carried out while changing the scan range frame by frame.
  • the check box 2010 the image capturing is carried out while changing the focal length of the ultrasound beam frame by frame.
  • the button 2011 is pressed by the user after setting the parameters of the image reconstruction process, the image reconstruction process is carried out.
  • the reference character 2010 represents the high-resolution ultrasound video outputted by the image reconstruction process.
  • the user can preview the video by using the tool bar 2012 for starting/stopping the playback, changing the playback position, etc.
  • the images 2013 - 2015 are input ultrasound images that are inputted to the image reconstruction process in regard to the currently displayed output image (video) 2010 .
  • the image 2014 is a frame image one cycle before the currently displayed output image 2010 .
  • the image 2015 is a frame image two cycles before the currently displayed output image 2010 .
  • the present invention provides an ultrasound image reconstruction method for reconstructing an ultrasound image of a sample by processing ultrasound images acquired from a signal generated by scanning the sample with an ultrasound signal by use of an ultrasound probe and receiving a reflected wave from the sample, comprising the steps of: extracting an ultrasound frame image at a certain time point and an ultrasound frame image at a time point before the certain time point from a series of ultrasound frame images constituting the ultrasound images acquired by the imaging; calculating magnitudes of positional shifts between the extracted ultrasound frame image at the certain time point and the extracted ultrasound frame image at the time point before the certain time point; and reconstructing a composite ultrasound image for one frame by compensating for the positional shifts between the extracted ultrasound frame image at the certain time point and the extracted ultrasound frame image at the time point before the certain time point by use of information on the calculated magnitudes of positional shifts and merging the extracted ultrasound frame image at the certain time point and the extracted ultrasound frame image at the time point before the certain time point together.
  • the present invention also provides the ultrasound image reconstruction method as written in the appendix 1, wherein the ultrasound frame image at the certain time point and the ultrasound frame image at the time point before the certain time point are ultrasound images acquired in states differing in the scan condition for the scanning of the sample with the ultrasound signal by use of the ultrasound probe.
  • the present invention also provides the ultrasound image reconstruction method as written in the appendix 1, wherein the ultrasound frame image at the certain time point and the ultrasound frame image at the time point before the certain time point are ultrasound images acquired by performing the scan in states differing in at least one of the scan orientation and the scan focal length for the scanning of the sample with the ultrasound signal by use of the ultrasound probe.
  • the present invention also provides the ultrasound image reconstruction method as written in the appendix 1, wherein the merging of the ultrasound frame image at the certain time point and the ultrasound frame image at the time point before the certain time point after undergoing the positional shift compensation is executed by splitting each of the ultrasound frame image at the certain time point and the ultrasound frame image at the time point before the certain time point into local regions, setting a weighting parameter varying from region to region for each of the locally split regions, and incorporating each region into the image reconstruction process so that a region having a greater weight is incorporated more into the result of the image reconstruction process.
  • the present invention also provides the ultrasound image reconstruction method as written in the appendix 1, wherein a composite ultrasound image for one frame at a time point between the certain time point and the time point before the certain time point is estimated and generated by merging the extracted ultrasound frame image at the certain time point and the extracted ultrasound frame image at the time point before the certain time point after undergoing the positional shift compensation together.
  • the present invention also provides the ultrasound image reconstruction method as written in the appendix 1, wherein: the sample is one that moves periodically, and the images acquired by the imaging are ultrasound images acquired by scanning the sample for a time longer than or equal to twice the cycle of the periodical movement of the sample under scan conditions varying cycle by cycle, and the extraction of the ultrasound frame image at the certain time point and the ultrasound frame image at the time point before the certain time point is extraction of the ultrasound frame image at the certain time point and an ultrasound frame image at a time point one cycle before the certain time point.
  • the present invention can be employed for ultrasound diagnostic devices which acquire images by transmitting and receiving an ultrasonic wave to/from a test object.
  • the present invention can be employed for ultrasound diagnostic devices equipped with an ultrasound image reconstruction method for executing a process for enhancing the spatial resolution or the temporal resolution to acquired images by means of image processing.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Biomedical Technology (AREA)
  • Molecular Biology (AREA)
  • Biophysics (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Pathology (AREA)
  • Radiology & Medical Imaging (AREA)
  • Veterinary Medicine (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Public Health (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Ultra Sonic Daignosis Equipment (AREA)
US13/703,961 2010-07-14 2011-05-18 Ultrasound image reconstruction method, device therefor, and ultrasound diagnostic device Abandoned US20130090560A1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2010159771 2010-07-14
JP2010-159771 2010-07-14
PCT/JP2011/061436 WO2012008217A1 (ja) 2010-07-14 2011-05-18 超音波画像の画像復元方法およびその装置並びに超音波診断装置

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2011/061436 A-371-Of-International WO2012008217A1 (ja) 2010-07-14 2011-05-18 超音波画像の画像復元方法およびその装置並びに超音波診断装置

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US14/739,387 Continuation US9408591B2 (en) 2010-07-14 2015-06-15 Ultrasound diagnostic device and method of generating an intermediary image of ultrasound image

Publications (1)

Publication Number Publication Date
US20130090560A1 true US20130090560A1 (en) 2013-04-11

Family

ID=45469228

Family Applications (2)

Application Number Title Priority Date Filing Date
US13/703,961 Abandoned US20130090560A1 (en) 2010-07-14 2011-05-18 Ultrasound image reconstruction method, device therefor, and ultrasound diagnostic device
US14/739,387 Active US9408591B2 (en) 2010-07-14 2015-06-15 Ultrasound diagnostic device and method of generating an intermediary image of ultrasound image

Family Applications After (1)

Application Number Title Priority Date Filing Date
US14/739,387 Active US9408591B2 (en) 2010-07-14 2015-06-15 Ultrasound diagnostic device and method of generating an intermediary image of ultrasound image

Country Status (3)

Country Link
US (2) US20130090560A1 (ja)
JP (3) JP5649083B2 (ja)
WO (1) WO2012008217A1 (ja)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105451662A (zh) * 2013-08-09 2016-03-30 皇家飞利浦有限公司 用于医学成像与信息显示的方法和***
US20170053396A1 (en) * 2015-08-20 2017-02-23 Siemens Medical Solutions Usa, Inc. View direction adaptive volume Ultrasound imaging
US20170224307A1 (en) * 2016-02-10 2017-08-10 Toshiba Medical Systems Corporation Ultrasound diagnostic apparatus
EP3235437A4 (en) * 2014-12-19 2018-09-12 Olympus Corporation Ultrasonic observation device
CN113538665A (zh) * 2021-07-21 2021-10-22 无锡艾米特智能医疗科技有限公司 一种器官三维图像重建补偿方法
CN113616945A (zh) * 2021-08-13 2021-11-09 湖北美睦恩医疗设备有限公司 一种基于聚焦超声图像识别的检测方法及美容美体装置
US11813117B2 (en) * 2018-04-13 2023-11-14 Shenzhen Mindray Bio-Medical Electronics Co., Ltd. Ultrasound imaging method and ultrasound imaging device

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103813752B (zh) * 2012-01-27 2017-11-10 东芝医疗***株式会社 医用图像处理装置
WO2013150917A1 (ja) * 2012-04-02 2013-10-10 日立アロカメディカル株式会社 超音波診断装置及び超音波画像の超解像生成方法
JP6507731B2 (ja) * 2015-03-10 2019-05-08 富士通株式会社 補間画像生成装置、補間画像生成方法及び補間画像生成用コンピュータプログラム
JP5985007B1 (ja) * 2015-06-02 2016-09-06 株式会社日立製作所 超音波診断装置
JP6597070B2 (ja) * 2015-09-02 2019-10-30 セイコーエプソン株式会社 濃度むら補正方法、及び印刷装置
JP6667649B2 (ja) 2016-09-14 2020-03-18 富士フイルム株式会社 光音響画像生成装置
KR102493717B1 (ko) * 2018-03-13 2023-01-30 베라톤 인코포레이티드 초음파 프로브를 사용한 일반화된 인터레이스 스캔 방법
CN111182219B (zh) * 2020-01-08 2023-04-07 腾讯科技（深圳）有限公司 一种图像处理方法、装置、服务器及存储介质
US11497479B2 (en) 2020-05-09 2022-11-15 Clarius Mobile Health Corp. Method and system for controlling settings of an ultrasound scanner
WO2022114131A1 (ja) * 2020-11-30 2022-06-02 株式会社Lily MedTech 画像診断装置、画像診断方法、プログラム及び機械学習用訓練データの生成方法
WO2023149515A1 (ja) * 2022-02-04 2023-08-10 アイメジャー株式会社 立体物イメージスキャナ
CN117503203B (zh) * 2024-01-03 2024-03-22 之江实验室 一种用于超声环阵成像的相位畸变校正方法和***

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040225221A1 (en) * 2003-05-06 2004-11-11 Olsson Lars Jonas Diagnostic ultrasound imaging system with adaptive persistence
US20120041312A1 (en) * 2009-04-28 2012-02-16 Hitachi Medical Corporation Method for Improving Image Quality of Ultrasonic Image, Ultrasonic Diagnosis Device, and Program for Improving Image Quality

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3094238B2 (ja) 1991-02-21 2000-10-03 株式会社日立メディコ 超音波診断装置
JP3264963B2 (ja) 1992-02-12 2002-03-11 ジーイー横河メディカルシステム株式会社 超音波診断装置
JPH08307771A (ja) 1995-05-02 1996-11-22 Toshiba Corp 動き領域検出回路並びにこの動き領域検出回路を用いたノイズ低減フィルタ及びｘ線透視装置
US6210328B1 (en) 1998-10-01 2001-04-03 Atl Ultrasound Ultrasonic diagnostic imaging system with variable spatial compounding
US6117081A (en) * 1998-10-01 2000-09-12 Atl Ultrasound, Inc. Method for correcting blurring of spatially compounded ultrasonic diagnostic images
US6283917B1 (en) * 1998-10-01 2001-09-04 Atl Ultrasound Ultrasonic diagnostic imaging system with blurring corrected spatial compounding
JP3730147B2 (ja) * 2001-08-30 2005-12-21 アロカ株式会社 超音波診断装置
JP4519434B2 (ja) 2003-09-24 2010-08-04 株式会社東芝 超解像処理装置及び医用画像診断装置
US7492967B2 (en) 2003-09-24 2009-02-17 Kabushiki Kaisha Toshiba Super-resolution processor and medical diagnostic imaging apparatus
WO2006123742A1 (ja) 2005-05-20 2006-11-23 Hitachi Medical Corporation 画像診断装置
JP4473779B2 (ja) * 2005-05-23 2010-06-02 株式会社東芝 超音波診断装置及びその画像処理方法
WO2007097108A1 (ja) * 2006-02-22 2007-08-30 Hitachi Medical Corporation 超音波診断装置
JP5331313B2 (ja) * 2007-05-24 2013-10-30 株式会社日立メディコ 超音波診断装置
JP2009039428A (ja) * 2007-08-10 2009-02-26 Panasonic Corp 超音波診断装置
JP2010057010A (ja) 2008-08-29 2010-03-11 Sharp Corp 画像表示装置

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040225221A1 (en) * 2003-05-06 2004-11-11 Olsson Lars Jonas Diagnostic ultrasound imaging system with adaptive persistence
US20120041312A1 (en) * 2009-04-28 2012-02-16 Hitachi Medical Corporation Method for Improving Image Quality of Ultrasonic Image, Ultrasonic Diagnosis Device, and Program for Improving Image Quality

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105451662A (zh) * 2013-08-09 2016-03-30 皇家飞利浦有限公司 用于医学成像与信息显示的方法和***
EP3235437A4 (en) * 2014-12-19 2018-09-12 Olympus Corporation Ultrasonic observation device
US20170053396A1 (en) * 2015-08-20 2017-02-23 Siemens Medical Solutions Usa, Inc. View direction adaptive volume Ultrasound imaging
CN106469461A (zh) * 2015-08-20 2017-03-01 美国西门子医疗解决公司 视图方向自适应体积超声成像
US9824442B2 (en) * 2015-08-20 2017-11-21 Siemens Medical Solutions Usa, Inc. View direction adaptive volume ultrasound imaging
US20170224307A1 (en) * 2016-02-10 2017-08-10 Toshiba Medical Systems Corporation Ultrasound diagnostic apparatus
US10709421B2 (en) * 2016-02-10 2020-07-14 Canon Medical Systems Corporation Ultrasound diagnostic apparatus
US11813117B2 (en) * 2018-04-13 2023-11-14 Shenzhen Mindray Bio-Medical Electronics Co., Ltd. Ultrasound imaging method and ultrasound imaging device
CN113538665A (zh) * 2021-07-21 2021-10-22 无锡艾米特智能医疗科技有限公司 一种器官三维图像重建补偿方法
CN113616945A (zh) * 2021-08-13 2021-11-09 湖北美睦恩医疗设备有限公司 一种基于聚焦超声图像识别的检测方法及美容美体装置

Also Published As

Publication number Publication date
JP2014131777A (ja) 2014-07-17
US20150272552A1 (en) 2015-10-01
JPWO2012008217A1 (ja) 2013-09-05
JP5649083B2 (ja) 2015-01-07
JP5954806B2 (ja) 2016-07-20
US9408591B2 (en) 2016-08-09
WO2012008217A1 (ja) 2012-01-19
JP5859595B2 (ja) 2016-02-10
JP2015142832A (ja) 2015-08-06

Similar Documents

Publication Publication Date Title
US9408591B2 (en) Ultrasound diagnostic device and method of generating an intermediary image of ultrasound image
JP4730125B2 (ja) 血流画像表示装置
US6659953B1 (en) Morphing diagnostic ultrasound images for perfusion assessment
JP6033701B2 (ja) 超音波診断装置及びその制御プログラム
JP4789854B2 (ja) 超音波診断装置および超音波診断装置の画質改善方法
JP5065629B2 (ja) 超音波診断装置および超音波診断装置の制御プログラム
KR101468418B1 (ko) 초음파 영상 처리 방법 및 장치
US20070016036A1 (en) Ultrasonic diagnostic apparatus and image processing method
JP7313902B2 (ja) 超音波診断装置
EP2598907B1 (en) Motion-compensated processing
WO2007142255A1 (ja) 超音波診断装置
CN102727255A (zh) 一种超声图像空间复合成像的方法及装置
CN104114094B (zh) 超声波诊断装置
US20160063742A1 (en) Method and system for enhanced frame rate upconversion in ultrasound imaging
US10667792B2 (en) Ultrasonic diagnostic apparatus, ultrasonic image processing apparatus and ultrasonic diagnostic apparatus control method
KR20140070436A (ko) 초음파 진단 장치 및 그 제어 프로그램
JP5159480B2 (ja) 超音波診断装置および超音波診断装置の制御プログラム
US20090177087A1 (en) Ultrasonic imaging apparatus
US20160074013A1 (en) Image enlargement method and ultrasound medical device for same
CN111012379A (zh) 用于执行超声成像的方法和***
CN113301854A (zh) 图像解析装置
JP5595988B2 (ja) 超音波診断装置および超音波診断装置の画質改善方法
JP2002113001A (ja) 超音波診断装置および超音波信号処理方法
CN117148364A (zh) 一种超声成像***和方法
CN114795277A (zh) 超声波诊断装置及其控制方法

Legal Events

Date Code Title Description
AS Assignment

Owner name: HITACHI MEDICAL CORPORATION, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KOTAKI, GO;MIYAMOTO, ATSUSHI;NAKAHIRA, KENJI;SIGNING DATES FROM 20121123 TO 20121129;REEL/FRAME:029460/0507

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION