CN108836406A - A kind of single laparoscopic surgical system and method based on speech recognition - Google Patents
A kind of single laparoscopic surgical system and method based on speech recognition Download PDFInfo
- Publication number
- CN108836406A CN108836406A CN201810558196.4A CN201810558196A CN108836406A CN 108836406 A CN108836406 A CN 108836406A CN 201810558196 A CN201810558196 A CN 201810558196A CN 108836406 A CN108836406 A CN 108836406A
- Authority
- CN
- China
- Prior art keywords
- module
- speech recognition
- laparoscope
- lens
- operational order
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B17/00—Surgical instruments, devices or methods, e.g. tourniquets
- A61B17/00234—Surgical instruments, devices or methods, e.g. tourniquets for minimally invasive surgery
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/06—Measuring instruments not otherwise provided for
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/08—Accessories or related features not otherwise provided for
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/06—Measuring instruments not otherwise provided for
- A61B2090/061—Measuring instruments not otherwise provided for for measuring dimensions, e.g. length
Landscapes
- Health & Medical Sciences (AREA)
- Surgery (AREA)
- Life Sciences & Earth Sciences (AREA)
- Heart & Thoracic Surgery (AREA)
- Engineering & Computer Science (AREA)
- Biomedical Technology (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Pathology (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Endoscopes (AREA)
Abstract
The invention discloses a kind of single laparoscopic surgical system and method based on speech recognition, wherein system include：Lens of laparoscope, for obtaining video image；Display module, the video image obtained for showing lens of laparoscope；Mechanical Moving module, for driving lens of laparoscope to be moved；Speech recognition module, for converting voice signals into operational order；Drive module, for receiving operational order and mechanical mobile module being driven to make corresponding sports.System and method of the present invention pass through the combination of speech recognition system and Mechanical Moving module, realize one control to laparoscopic surgical system, and adjustment speed is fast, control is accurate, and previous assistant is avoided to help mirror bring target visual field error and Operation delay；Simultaneously may also be combined with range finder module can avoid adjustment speed it is too fast when camera lens advance injury tissue, guarantee safety.The present invention can be widely applied to medical instruments field as a kind of single laparoscopic surgical system based on speech recognition and method.
Description
Technical field
The present invention relates to medical instruments field, especially a kind of single laparoscopic surgical system and side based on speech recognition
Method.
Background technique
Laparoscopic technique is increasingly mature, has in art that notch is small, wound is small, bleeding is few, and post-operation inflammatory is light, restores fast, scar
Trace is small, the advantages such as short of being hospitalized, and has become mainstream modus operandi.In conventional laparoscopic Surgery for Gastric Carcinoma, mainly by operating doctor, one
Help and help mirror hand to cooperate progress, and " single-hole laparoscopic " of rising in recent years due to that can save medical treatment manpower resources costs
And it receives great attention and studies.However, only one assistant of reduction that laparoscope system can be accomplished at present --- this is mainly
The exercise of operation skill depending on operating doctor without the research and development and improvement of too big surgical instrument, thus is carried out very fast.Together
When due to needing to be related to the research and development and improvement of laparoscopic instrument to the substitution for helping mirror hand, difficulty is larger, does not further investigate.Only
Only as " eyes " of operative doctor, mirror hand is helped to help operating doctor to be accurately positioned by the orientation of intense adjustment lens of laparoscope
Good surgical field of view, but " eyes " of operating doctor are no longer controlled by oneself after all, but assistant controls, and will have one among this
Set the goal the error and lag in the visual field.Therefore, that helps mirror hand helps mirror technology, writing from memory to the comprehension of operation and between patient
Contract degree can all influence progress, fluency, stability and the safety of operation.
In the prior art, the Design of Mechanical Structure of the fixed shank of laparoscope is quite mature, as patent CN203303162U,
CN206138352U, a laparoscope fixator (application number that can be matched with the system：201721394836.X), it can
It is suitble to demand of the laparoscope system circuit signal to the movement of camera lens in Mechanical Moving module；However existing laparoscopic surgery system
There is still a need for more people operations for system, to the more demanding of operator, help mirror hand usually due to having to the comprehension of operation when manually helping mirror
Limit, it is asynchronous with operating doctor to the understanding of surgical scene and for a long time help mirror operation easily lead to hand tremble, Gastric Carcinoma
The reasons such as the complexity of middle anatomical position are easy to appear pedestal skew, picture offset, do not catch up with situations such as operator operation rhythm,
Cause clinically many Surgery for Gastric Carcinoma can not obtain best operation visual area and angle, may influence whether operative doctor operation
Levels of precision and operation fluency and quality, in some instances it may even be possible to which will increase the risk of tissue damage in art, (some researches show that abdomens
The clear and stable safety that operation can be improved of visual area in endoscope-assistant surgery)；Meanwhile when helping mirror quality bad, corresponding hand
Art video recording quality just declines, and cannot maximize the advantage that laparoscopic surgery is conducive to teaching that plays, and is unfavorable for young doctor and carries out abdomen
Endoscope-assistant surgery study and same operation in the ranks exchange and use for reference raising.
Summary of the invention
In order to solve the above-mentioned technical problem, the purpose of the present invention is：A kind of realize based on speech recognition is provided quickly to adjust
With the single laparoscopic surgical system of high security.
In order to solve the above-mentioned technical problem, it is another object of the present invention to：It provides a kind of quick based on speech recognition realization
Adjust the single laparoscopic operation method with high security.
The technical scheme adopted by the invention is that：A kind of single laparoscopic surgical system based on speech recognition includes
Lens of laparoscope, for obtaining video image；
Display module, the video image obtained for showing lens of laparoscope；
Mechanical Moving module, for driving lens of laparoscope to be moved；
Speech recognition module, for converting voice signals into operational order；
Drive module, for receiving operational order and mechanical mobile module being driven to make corresponding sports.
It further, further include having the range finder module for being set to lens of laparoscope, for detecting obstacle during the motion
When to drive module issue halt instruction.
Further, when range finder module detects during the motion is less than given threshold apart from object, judgement is detected
Obstacle, and halt instruction is issued to drive module.
Further, the priority of the halt instruction is higher than the priority of operational order.
Further, the speech recognition module represents the voice signal in direction for identification and converts thereof into corresponding sports
The operational order in direction.
Another technical solution of the present invention is：A kind of single laparoscopic operation method based on speech recognition, packet
Following steps are included：
A, display module shows the video image that lens of laparoscope obtains；
B, speech recognition module acquires voice signal and converts thereof into operational order；
C, drive module receives operational order and mechanical mobile module is driven to make corresponding sports, to drive lens of laparoscope
It is moved.
It further, further include having step D：During Mechanical Moving module drives lens of laparoscope to carry out movement, use
The range finder module for being set to lens of laparoscope issues halt instruction to drive module when detecting obstacle.
Further, in the step D, when range finder module, which is detected, is less than given threshold apart from object, judgement is detected
Obstacle, and halt instruction is issued to drive module.
Further, the priority of the halt instruction is higher than the priority of operational order.
Further, the step B is specially：Speech recognition module identification represents the voice signal in direction and by its turn
Change the operational order in corresponding sports direction into.
The beneficial effect of system and method for the present invention is：It is real by the combination of speech recognition system and Mechanical Moving module
One existing control to laparoscopic surgical system, adjustment speed is fast, control precisely, avoid previous assistant that mirror bring target is helped to regard
Wild error and Operation delay；Simultaneously may also be combined with range finder module can avoid adjustment speed it is too fast when camera lens advance injury tissue,
Guarantee safety.
Detailed description of the invention
Fig. 1 is the structural block diagram of present system；
Fig. 2 is the step flow chart of the method for the present invention.
Specific embodiment
Specific embodiments of the present invention will be further explained with reference to the accompanying drawing：
Referring to Fig.1, a kind of single laparoscopic surgical system based on speech recognition includes
Lens of laparoscope, for obtaining video image；
Display module, the video image obtained for showing lens of laparoscope；
Mechanical Moving module, for driving lens of laparoscope to be moved；
Speech recognition module, for converting voice signals into operational order；
Drive module, for receiving operational order and mechanical mobile module being driven to make corresponding sports.
Speech recognition module can acquire the voice signal of operating doctor, and the syllable of its voice signal is identified and turned
It changes, such as issues the voice "above" or "below" " into " " moving back " " left side " " right side ", speech recognition in operating doctor art as needed in real time
Module is identified and is converted to it, is converted into corresponding operation instruction, such as recognize the syllable of one " moving back ", then original
Zooming parameter λ 1 on reduce by a unit, the i.e. control Mechanical Moving module of corresponding movement drives lens of laparoscope to retreat one
The distance of unit correspondingly increases a unit, phase if recognizing one " into " syllable on original zooming parameter λ 1
The movement answered i.e. control Mechanical Moving module drives the distance of lens of laparoscope one unit of advance.Similarly, to recognizing
" left side " " right side ", "upper" "lower" voice, does corresponding adjusting to horizontal axis parameter lambda 2, longitudinal axis parameter lambda 3 respectively.
Since present system can realize one man operation, adjustment speed is very fast, therefore in order to avoid operating doctor voice life
Enable it is too fast cause camera lens to be continuously advanced injury tissue, be further used as preferred embodiment, further include being set to laparoscope
The range finder module of camera lens issues halt instruction to drive module when for detecting obstacle during the motion.
It is further used as preferred embodiment, is less than setting apart from object when range finder module detects during the motion
When threshold value, judgement detects obstacle, and issues halt instruction to drive module, and the threshold value is typically set at 1cm.
It is further used as preferred embodiment, the priority of the halt instruction is higher than the priority of operational order.
It is further used as preferred embodiment, the speech recognition module represents the voice signal in direction simultaneously for identification
Convert thereof into the operational order in corresponding sports direction.
Referring to Fig. 2, a kind of single laparoscopic operation method based on speech recognition, includes following steps：
A, display module shows the video image that lens of laparoscope obtains；
B, speech recognition module acquires voice signal and converts thereof into operational order；
C, drive module receives operational order and mechanical mobile module is driven to make corresponding sports, to drive lens of laparoscope
It is moved.
It is further used as preferred embodiment, further includes having step D：Mechanical Moving module drives lens of laparoscope to carry out
In mobile process, is issued when detecting obstacle to drive module using the range finder module for being set to lens of laparoscope and stop referring to
It enables.
It is further used as preferred embodiment, in the step D, is less than setting apart from object when range finder module is detected
When threshold value, judgement detects obstacle, and issues halt instruction to drive module.
It is further used as preferred embodiment, the priority of the halt instruction is higher than the priority of operational order.
It is further used as preferred embodiment, the step B is specially：The speech recognition module identification represents direction
Voice signal and convert thereof into the operational order in corresponding sports direction.
It is to be illustrated to preferable implementation of the invention, but the invention is not limited to the implementation above
Example, those skilled in the art can also make various equivalents on the premise of without prejudice to spirit of the invention or replace
It changes, these equivalent deformations or replacement are all included in the scope defined by the claims of the present application.
Claims (10)
1. a kind of single laparoscopic surgical system based on speech recognition, it is characterised in that：It include lens of laparoscope, for obtaining
Take video image；
Display module, the video image obtained for showing lens of laparoscope；
Mechanical Moving module, for driving lens of laparoscope to be moved；
Speech recognition module, for converting voice signals into operational order；
Drive module, for receiving operational order and mechanical mobile module being driven to make corresponding sports.
2. a kind of single laparoscopic surgical system based on speech recognition according to claim 1, it is characterised in that：Also wrap
The range finder module for being set to lens of laparoscope is included, issues and stops to drive module when for detecting obstacle during the motion
Instruction.
3. a kind of single laparoscopic surgical system based on speech recognition according to claim 2, it is characterised in that：Work as survey
Detect that judgement detects obstacle, and sends out to drive module when being less than given threshold apart from object during the motion away from module
Halt instruction out.
4. a kind of single laparoscopic surgical system based on speech recognition according to claim 1 or 2, it is characterised in that：
The priority of the halt instruction is higher than the priority of operational order.
5. a kind of single laparoscopic surgical system based on speech recognition according to claim 1, it is characterised in that：It is described
Speech recognition module represents the voice signal in direction for identification and converts thereof into the operational order in corresponding sports direction.
6. a kind of single laparoscopic operation method based on speech recognition, which is characterized in that include following steps：
A, display module shows the video image that lens of laparoscope obtains；
B, speech recognition module acquires voice signal and converts thereof into operational order；
C, drive module receives operational order and mechanical mobile module is driven to make corresponding sports, so that lens of laparoscope be driven to carry out
It is mobile.
7. a kind of single laparoscopic operation method based on speech recognition according to claim 6, which is characterized in that also wrap
Step D is included：During Mechanical Moving module drives lens of laparoscope to carry out movement, using the survey for being set to lens of laparoscope
Halt instruction is issued to drive module when detecting obstacle away from module.
8. a kind of single laparoscopic operation method based on speech recognition according to claim 7, it is characterised in that：It is described
In step D, when range finder module, which is detected, is less than given threshold apart from object, judgement detects obstacle, and sends out to drive module
Halt instruction out.
9. a kind of single laparoscopic operation method based on speech recognition according to claim 6 or 7, it is characterised in that：
The priority of the halt instruction is higher than the priority of operational order.
10. a kind of single laparoscopic operation method based on speech recognition according to claim 6, which is characterized in that institute
Stating step B is specially：The speech recognition module identification represents the voice signal in direction and converts thereof into corresponding sports direction
Operational order.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810558196.4A CN108836406A (en) | 2018-06-01 | 2018-06-01 | A kind of single laparoscopic surgical system and method based on speech recognition |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810558196.4A CN108836406A (en) | 2018-06-01 | 2018-06-01 | A kind of single laparoscopic surgical system and method based on speech recognition |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108836406A true CN108836406A (en) | 2018-11-20 |
Family
ID=64211247
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810558196.4A Pending CN108836406A (en) | 2018-06-01 | 2018-06-01 | A kind of single laparoscopic surgical system and method based on speech recognition |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108836406A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113679324A (en) * | 2021-07-02 | 2021-11-23 | 福建中医药大学附属人民医院（福建省人民医院） | Laparoscope holding fixator and using method thereof |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101193603A (en) * | 2005-06-06 | 2008-06-04 | 直观外科手术公司 | Laparoscopic ultrasound robotic surgical system |
| WO2009010980A1 (en) * | 2007-07-17 | 2009-01-22 | M.S.T. Medical Surgery Technologies Ltd | Interface between a surgeon and an automated assistant and method thereof |
| CN102341046A (en) * | 2009-03-24 | 2012-02-01 | 伊顿株式会社 | Surgical robot system using augmented reality, and method for controlling same |
| CN102438795A (en) * | 2009-02-11 | 2012-05-02 | 来宝株式会社 | Surgical robot system, and method for controlling same |
| CN102595998A (en) * | 2009-11-04 | 2012-07-18 | 皇家飞利浦电子股份有限公司 | Collision avoidance and detection using distance sensors |
| CN103188987A (en) * | 2010-11-02 | 2013-07-03 | 伊顿株式会社 | Surgical robot system, and a laparoscope manipulation method and a body-sensing surgical image processing device and method therefor |
| CN103815972A (en) * | 2014-02-26 | 2014-05-28 | 上海齐正微电子有限公司 | Automatic tracking system for operative region of laparothoracoscope and method |
| CN203970548U (en) * | 2013-01-10 | 2014-12-03 | M.S.T.医学外科技术有限公司 | Surgical operation control system |
| CN104363850A (en) * | 2012-06-01 | 2015-02-18 | 直观外科手术操作公司 | Systems and methods for avoiding collisions between manipulator arms using a null-space |
| DE102015101018A1 (en) * | 2015-01-23 | 2016-07-28 | MAQUET GmbH | Device for holding and moving a laparoscope during an operation |
-
2018
- 2018-06-01 CN CN201810558196.4A patent/CN108836406A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101193603A (en) * | 2005-06-06 | 2008-06-04 | 直观外科手术公司 | Laparoscopic ultrasound robotic surgical system |
| WO2009010980A1 (en) * | 2007-07-17 | 2009-01-22 | M.S.T. Medical Surgery Technologies Ltd | Interface between a surgeon and an automated assistant and method thereof |
| CN102438795A (en) * | 2009-02-11 | 2012-05-02 | 来宝株式会社 | Surgical robot system, and method for controlling same |
| CN102341046A (en) * | 2009-03-24 | 2012-02-01 | 伊顿株式会社 | Surgical robot system using augmented reality, and method for controlling same |
| CN102595998A (en) * | 2009-11-04 | 2012-07-18 | 皇家飞利浦电子股份有限公司 | Collision avoidance and detection using distance sensors |
| CN103188987A (en) * | 2010-11-02 | 2013-07-03 | 伊顿株式会社 | Surgical robot system, and a laparoscope manipulation method and a body-sensing surgical image processing device and method therefor |
| CN104363850A (en) * | 2012-06-01 | 2015-02-18 | 直观外科手术操作公司 | Systems and methods for avoiding collisions between manipulator arms using a null-space |
| CN203970548U (en) * | 2013-01-10 | 2014-12-03 | M.S.T.医学外科技术有限公司 | Surgical operation control system |
| CN103815972A (en) * | 2014-02-26 | 2014-05-28 | 上海齐正微电子有限公司 | Automatic tracking system for operative region of laparothoracoscope and method |
| DE102015101018A1 (en) * | 2015-01-23 | 2016-07-28 | MAQUET GmbH | Device for holding and moving a laparoscope during an operation |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113679324A (en) * | 2021-07-02 | 2021-11-23 | 福建中医药大学附属人民医院（福建省人民医院） | Laparoscope holding fixator and using method thereof |
| CN113679324B (en) * | 2021-07-02 | 2024-01-26 | 福建中医药大学附属人民医院（福建省人民医院） | Laparoscope supporting fixer and using method thereof |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11642004B2 (en) | Image processing device, image processing method and recording medium | |
| JP4697810B2 (en) | Automatic tracking device and automatic tracking method | |
| JP5965596B2 (en) | Image processing system, information processing apparatus, and program | |
| CN108881724B (en) | Image acquisition method, device, equipment and storage medium | |
| US10682040B2 (en) | Endoscope apparatus and focus control method for endoscope apparatus | |
| US20170068081A1 (en) | Surgical control device, control method, and imaging control system | |
| US10666852B2 (en) | Focus control device, endoscope apparatus, and method for operating focus control device | |
| US20200260014A1 (en) | Focus detection device and method and program | |
| KR20100057983A (en) | Method for providing multi image scan in biometrics system | |
| CN107440748A (en) | A kind of intelligent automatic tracking cavity mirror system of operating field | |
| US6511420B1 (en) | Video opto-diagnostic instrument with single-adjustment focus | |
| JP6574448B2 (en) | Endoscope apparatus and focus control method for endoscope apparatus | |
| JPH11177873A (en) | High-speed focusing electronic camera | |
| CN108836406A (en) | A kind of single laparoscopic surgical system and method based on speech recognition | |
| CN104280852A (en) | Optical system and method | |
| WO2018235608A1 (en) | Surgery system and surgical image capture device | |
| US20120050678A1 (en) | Photographing apparatus, and control method and program for the same | |
| CN115471552B (en) | Shooting positioning method and system for portable mydriasis-free fundus camera | |
| Maamari et al. | A modified action sports camera for high-quality and cost–effective oculofacial surgical videography | |
| CN215305700U (en) | Automatic positioning mechanical arm oral cavity lamp | |
| CN112353503A (en) | A intelligent glasses that is arranged in art real-time illumination to shoot and make a video recording | |
| JP7207296B2 (en) | IMAGING DEVICE, FOCUS CONTROL METHOD, AND FOCUS DETERMINATION METHOD | |
| US20200410665A1 (en) | Control of an image-capturing device allowing the comparison of two videos | |
| WO2021261236A1 (en) | Medical observation system, image processing method, and program | |
| CN115589531B (en) | Shooting method, shooting system and storage medium of target scene |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181120 |
|
| RJ01 | Rejection of invention patent application after publication |