CN113257385B - Drug injection system based on image and voice recognition - Google Patents
Drug injection system based on image and voice recognition Download PDFInfo
- Publication number
- CN113257385B CN113257385B CN202110517838.8A CN202110517838A CN113257385B CN 113257385 B CN113257385 B CN 113257385B CN 202110517838 A CN202110517838 A CN 202110517838A CN 113257385 B CN113257385 B CN 113257385B
- Authority
- CN
- China
- Prior art keywords
- injection
- module
- pumping
- image
- instruction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
- G16H20/10—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to drugs or medications, e.g. for ensuring correct administration to patients
- G16H20/17—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to drugs or medications, e.g. for ensuring correct administration to patients delivered via infusion or injection
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
- A61M5/00—Devices for bringing media into the body in a subcutaneous, intra-vascular or intramuscular way; Accessories therefor, e.g. filling or cleaning devices, arm-rests
- A61M5/178—Syringes
- A61M5/20—Automatic syringes, e.g. with automatically actuated piston rod, with automatic needle injection, filling automatically
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
- A61M5/00—Devices for bringing media into the body in a subcutaneous, intra-vascular or intramuscular way; Accessories therefor, e.g. filling or cleaning devices, arm-rests
- A61M5/178—Syringes
- A61M5/31—Details
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
- A61M5/00—Devices for bringing media into the body in a subcutaneous, intra-vascular or intramuscular way; Accessories therefor, e.g. filling or cleaning devices, arm-rests
- A61M5/178—Syringes
- A61M5/31—Details
- A61M5/3148—Means for causing or aiding aspiration or plunger retraction
Landscapes
- Health & Medical Sciences (AREA)
- Engineering & Computer Science (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Biomedical Technology (AREA)
- Veterinary Medicine (AREA)
- Animal Behavior & Ethology (AREA)
- Life Sciences & Earth Sciences (AREA)
- Hematology (AREA)
- Heart & Thoracic Surgery (AREA)
- Vascular Medicine (AREA)
- Anesthesiology (AREA)
- Medicinal Chemistry (AREA)
- Primary Health Care (AREA)
- Medical Informatics (AREA)
- Epidemiology (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Chemical & Material Sciences (AREA)
- Infusion, Injection, And Reservoir Apparatuses (AREA)
Abstract
The invention provides a drug injection system based on image and voice recognition, comprising: the voice recognition module is used for recognizing voice instructions, wherein the voice instructions comprise a back-pumping instruction, a medicine injection instruction and an injection stopping instruction; the image acquisition module is used for acquiring an image of the injection part; the image recognition module is used for recognizing the image of the injection part acquired by the image acquisition module, judging whether the back-pumping effect is achieved, and sending a back-pumping completion instruction if the back-pumping effect is achieved; and the back-pumping injection module is used for receiving the medicine injection instruction of the voice recognition module, performing medicine injection at the injection position, receiving the back-pumping instruction of the voice recognition module, executing back-pumping operation, receiving the back-pumping completion instruction of the image recognition module, judging that the back-pumping is effective, performing medicine injection, and stopping injection of the medicine at the injection position after receiving the injection stopping instruction of the voice recognition module. The drug injection system has the back suction function, and can automatically confirm the back suction effect and perform drug injection.
Description
Technical Field
The invention relates to the technical field of medical instruments, in particular to a medicine injection system based on image and voice recognition.
Background
Along with the increasingly wide clinical application of local anesthesia techniques such as nerve block, the advantages of accurate, safe and comfortable personalized anesthesia scheme are increasingly highlighted. In this technique, the anesthetic must be precisely injected around the target nerve without accessing the blood vessels, which would otherwise lead to local anesthetic poisoning in the patient. Therefore, each drug injection in the anesthesia process needs to be firstly pumped back and then administered, so that the drug is ensured to be fully infiltrated around the target nerve, and the injection into the blood vessel is avoided.
The medical injection pump system mainly comprises a controller, a stepping motor, a driver, liquid crystal, a keyboard and the like. The conventional injection pump generally has the functions of flow speed and flow rate setting, injection start and stop, problem alarm and the like, can ensure the accuracy, stability and safety of the injection dosage of the medicine, and has wide application in the medical field. However, the syringe pump does not have the back-pumping function and the voice command function, and when back-pumping and drug-reinjection are carried out in the anesthesia operation process, the syringe still needs to be taken down from the syringe pump for manual back-pumping, and the operation must be configured by a medical staff for special execution. This causes inconvenience to the anesthesia procedure and also increases the difficulty of collaboration between medical staff.
Disclosure of Invention
In view of the above technical problems, the present invention provides an image and voice-based drug injection system with a back-pumping function, which can automatically confirm the back-pumping effect and perform drug injection.
In order to achieve the above object, the present invention provides a drug injection system based on image and voice recognition, comprising:
the voice recognition module is used for recognizing voice instructions, wherein the voice instructions comprise a back-pumping instruction, a medicine injection instruction and an injection stopping instruction;
the image acquisition module is used for acquiring an image of the injection part;
the image recognition module is used for recognizing the image of the injection part acquired by the image acquisition module, judging whether the back-pumping effect is achieved, and sending a back-pumping completion instruction if the back-pumping effect is achieved;
and the back-pumping injection module is used for receiving the medicine injection instruction of the voice recognition module, performing medicine injection at the injection position, receiving the back-pumping instruction of the voice recognition module, executing back-pumping operation, receiving the back-pumping completion instruction of the image recognition module, judging that the back-pumping is effective, performing medicine injection, and stopping injection of the medicine at the injection position after receiving the injection stopping instruction of the voice recognition module.
Optionally, the image acquisition module comprises an image capturing device for capturing an image of the injection site.
Optionally, the back-drawing injection module comprises a syringe and a driving unit, wherein the syringe comprises a piston, an outer barrel and a needle, and the driving unit drives the piston to move in the outer barrel.
Optionally, the driving unit comprises a stepping motor, a screw rod structure and a motor driver, the motor driver drives the stepping motor to rotate, the screw rod structure converts the rotation motion of the stepping motor into linear motion and drives the piston to push and pull back and forth, and injection and back pumping operations are performed.
Optionally, the device further comprises a main controller, wherein the main controller is connected with the image recognition module, the voice recognition module and the back-pumping injection module, receives a voice instruction of the voice recognition module and a back-pumping completion instruction of the image recognition module, and sends a control instruction to the back-pumping injection module, wherein the control instruction comprises an injection speed and a back-pumping speed.
Optionally, the device further comprises an input module for inputting injection data, wherein the injection data comprises a withdrawal speed, a dosage of the medicine and an injection speed.
Optionally, a storage module is also included for recording and storing images and data during injection and withdrawal.
Optionally, the device further comprises an indication module, wherein the indication module is used for indicating working states of the voice recognition module and the back-pumping injection module, and the working states comprise: waiting for voice command input, failing to recognize voice command, recognized voice command, normal back-pumping injection module and failure of back-pumping injection module.
Optionally, the indication module displays different working states through lights with different colors.
Optionally, the image recognition module judges the back-pumping effect according to the color change, and recognizes that the red color in the back-pumping injection module exceeds the set range in the image after back-pumping of the back-pumping injection module, and sends out an instruction that the injection cannot be performed, otherwise, sends out a back-pumping completion instruction.
The drug injection system based on the image and the voice has the following beneficial effects:
the injection device not only has an injection function, can control the start and stop of an injection process, but also can execute the back-pumping operation, does not need to manually operate the injector for back-pumping, and simplifies the actual operation flow of back-pumping and injection;
the back suction effect can be confirmed through image recognition, the system can complete the back suction operation, the back suction effect confirmation and the injection operation, and the automation of the whole process of drug injection can be realized;
the input module is used for setting injection data (speed, medicine amount and the like), the voice recognition module is used for giving target actions (start/stop and back pumping of injection) of the injection device, and the image acquisition module and the image recognition module are used for confirming the back pumping effect (whether injection operation can be executed or not), so that the functions of the existing injection pumps in the market are perfected, and meanwhile, the use and operation steps of the injection pumps are simplified;
by using the drug injection system provided by the invention, medical staff can directly control the injection device through the voice password, communication coordination in operation is reduced, and the possibility is provided for a single person to finish anesthesia operation.
Drawings
Other objects and results of the present invention will become more apparent and readily appreciated by reference to the following detailed description taken in conjunction with the accompanying drawings. In the drawings:
FIG. 1 is a schematic diagram of a block diagram of an image and voice based drug injection system according to the present invention;
FIG. 2 is a schematic diagram of one embodiment of an image and voice based drug injection system according to the present invention;
FIG. 3 is a schematic diagram of a flow chart of a main controller executing a main program according to the present invention;
fig. 4 is a schematic diagram of a flowchart of a voice recognition module according to the present invention executing a voice recognition procedure.
In the drawings, like reference numerals designate similar or corresponding features or functions.
Detailed Description
In the following description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of one or more embodiments. It may be evident, however, that such embodiment(s) may be practiced without these specific details. In other instances, well-known structures and devices are shown in block diagram form in order to facilitate describing one or more embodiments.
Various embodiments according to the present invention will be described in detail below with reference to the accompanying drawings.
Fig. 1 is a block diagram illustrating a configuration of an image and voice recognition-based drug injection system according to the present invention, and fig. 2 is a schematic diagram illustrating an embodiment of an image and voice recognition-based drug injection system according to the present invention, as shown in fig. 1 and 2, comprising:
the voice recognition module 1 is used for recognizing voice instructions, wherein the voice instructions comprise a back-pumping instruction, a medicine injection instruction and an injection stopping instruction;
an image acquisition module 2 for acquiring an image of an injection site;
the image recognition module 3 is used for recognizing the image of the injection part acquired by the image acquisition module, judging whether the back-pumping effect is achieved, and sending a back-pumping completion instruction if the back-pumping effect is achieved;
and the back-pumping injection module 4 receives the medicine injection instruction of the voice recognition module, performs medicine injection at the injection site, receives the back-pumping instruction of the voice recognition module, performs back-pumping operation, receives the back-pumping completion instruction of the image recognition module (judges that the back-pumping is effective), performs medicine injection, and receives the injection stopping instruction of the voice recognition module to stop medicine injection at the injection site.
In one embodiment, the voice recognition module 1 includes a voice sensor 11, a voice recognition chip 12 and a controller 13, the voice sensor 11 collects voice signals, the voice recognition chip 12 generates voice instructions from the voice signals collected by the voice sensor, and the controller 13 sends the voice instructions to the back injection module.
In one embodiment, the image acquisition module 2 includes an imaging device 21 to capture images of the injection site.
In one embodiment, the image recognition module 3 includes a processor 31 for processing the injection site image to determine the withdrawal effect.
In one embodiment, the back-drawing injection module 4 comprises a syringe 41 comprising a piston, an outer barrel and a needle, and a drive unit 42 driving the piston to move within the outer barrel.
Alternatively, as shown in fig. 2, the driving unit 42 includes a stepper motor 421, a screw structure 422, and a motor driver 423, where the motor driver drives the stepper motor to rotate, and the screw structure converts the rotational motion of the stepper motor into linear motion, and drives the piston to push and pull reciprocally, so as to perform injection and withdrawal operations. Optionally, the screw rod structure comprises a screw rod and a sliding block, the sliding block is connected with the piston, the stepping motor drives the screw rod to rotate, and the sliding block moves on the screw rod in a linear manner to drive the piston to move in a linear manner.
Optionally, the back-pumping injection module 4 further comprises an injection pump, the injector further comprises an extension tube, the extension tube is in sealing connection with the outer cylinder, and the driving unit drives the injection pump to inject the medicine into the extension tube.
The drug injection system is improved and perfected based on the existing injection pumps on the market, replaces limb operation with voice instructions, replaces manual withdrawal with mechanical actions, replaces human eye judgment with machine vision, simplifies the anesthesia operation flow in operation, realizes automatic injection, and simultaneously ensures anesthesia quality and operation safety.
In one embodiment, the drug injection system based on image and voice recognition further comprises a main controller 5, wherein the main controller is connected with the image recognition module, the voice recognition module and the back-pumping injection module, receives a voice command of the voice recognition module and a back-pumping completion command of the image recognition module, and sends a control command to the back-pumping injection module, and the control command comprises an injection speed and a back-pumping speed.
Optionally, the controller 13 of the voice recognition module sends a voice command to the main controller, and a pull-back completion command of the image recognition module is also sent to the main controller.
In one embodiment, the image and voice recognition based drug injection system further comprises an input module 6 for inputting injection data including withdrawal speed, amount of drug and injection speed.
Alternatively, the input module 6 includes a display unit 61 (e.g., a display) and an input unit 62 (e.g., a keyboard), the input unit 62 inputting the injection data, the display unit 61 displaying the injection data, and the input unit 62 and the display unit 61 may be integral, such as a touch screen.
In one embodiment, the image and voice recognition based drug injection system further comprises a storage module for recording and storing images and data during injection and withdrawal.
In one embodiment, the image and voice based drug injection system further comprises an indication module 7 for indicating the working states of the voice recognition module and the back-pumping injection module, wherein the working states comprise: waiting for voice command input, failing to recognize voice command, recognized voice command, normal back-pumping injection module and failure of back-pumping injection module.
Optionally, the indication module displays different working states through lights with different colors. In addition, the indication module can also display different working states through different flashing states of the light, wherein the flashing states comprise non-flashing and flashing frequency. The indication module can also display different working states through combination of different colors and different flashing states.
In one embodiment, the image recognition module judges the back-pumping effect according to the color change, and recognizes that the red color in the back-pumping injection module exceeds the set range in the image after the back-pumping injection module is back-pumped, and sends out an instruction that the injection cannot be performed, otherwise, sends out a back-pumping completion instruction.
Optionally, the image recognition module determines whether the retracting effect is achieved according to whether the syringe has red color after retracting, and whether the syringe has red color is determined whether the syringe has red color according to gray level change in the image.
In one embodiment, a drug injection system based on image voice recognition includes: the device comprises a voice recognition module, an image acquisition module, an image recognition module, an input module, a main controller, a power supply module and a back-pumping injection module. The voice recognition module is connected with the main controller, can record voice instructions of medical staff, recognizes voice instruction contents and transmits corresponding instruction signals to the main controller. The image acquisition module comprises an image pickup device (such as a camera), the image recognition module comprises a processor 31, the image pickup device acquires an injection site image in real time and transmits the injection site image to the processor, and the processor is connected with a main controller and can confirm a back-pumping effect, judge whether injection operation can be executed or not and transmit the result to the main controller. The main controller communicates with the voice recognition module through a serial port, and can analyze the acquired instruction signals to obtain target action signals to be executed by the back suction injection module; the method comprises the steps of communicating with an image recognition module through Bluetooth to obtain a back-pumping effect; the back suction injection module comprises an injector and a driving unit, and the driving unit comprises a stepping motor, a screw rod structure and a motor driver; the device also comprises a storage module for recording and storing relevant injection data in real time; the main controller is connected with a motor driver in the back-pumping injection module, outputs pulse signals to control the motor driver, and the motor driver receives the pulse signals sent by the main controller and controls the stepping motor to rotate, wherein the motor driver specifically comprises a rotating direction and a rotating speed; the screw rod structure converts the rotation motion of the stepping motor into linear motion and can drive the injector piston to push and pull reciprocally to execute injection and back-pumping operations. The system also comprises an indication module, wherein the indication module is connected with the voice recognition module and the main controller and is used for indicating the working states of the voice recognition module and the drug injection system, and the indication module mainly comprises indication modes of waiting for voice instruction input, failing to recognize the voice instruction, recognizing and recording the voice instruction, normal operation of the system, system fault state and the like; the power supply module comprises a power converter and a voltage stabilizer, and is used for stably supplying power to the main controller and other modules.
In one embodiment, the drug injection system has two working modes of full-automatic and semi-automatic, in the full-automatic working mode, medical staff sends out a voice command 'start', and the drug injection system automatically executes the procedures of back suction, judging the back suction effect and injecting; in the semi-automatic mode of operation, the healthcare worker can perform withdrawal and injection by sending out voice instructions "withdraw", "start", "stop".
In one embodiment, the image acquisition module and the image recognition module are integrated and comprise the camera device 21, the support column 22 and the processor 31, and can acquire an injection site image, confirm the back extraction effect and transmit the recognition result to the main controller through Bluetooth. The raspberry pie is selected as a processor which is provided with components such as a system on chip, a memory and the like, supports the operation of a deep learning framework, and deploys a trained target recognition model (recognizing gray scale changes in an injector). The position of the camera equipment can be changed by adjusting the support column, so that the camera equipment can acquire the injection site image in real time and transmit the injection site image to the processor. Confirmation of the pumpback effect is done on the processor. The processor transmits the image recognition result to the main controller through Bluetooth, and short-distance wireless transmission is carried out between the image recognition result and the main controller.
The voice recognition module comprises a voice sensor, a voice recognition chip, a controller and a serial communication unit, can recognize and record voice instructions of medical staff, and transmits the voice instructions to the main controller through the serial communication unit. The sound sensor receives a voice command sent by medical staff, specifically a voice command of 'start', 'stop', 'draw back' or 'start', and outputs a voltage signal. The voice recognition chip based on the keyword list technology receives the voltage signal and recognizes the voltage signal, and the recognition result is transmitted to the controller. The controller is connected with the voice recognition chip, acquires and analyzes the voice recognition result in real time, obtains a target action signal to be executed by the injector, and transmits the target action signal to the main controller through the serial communication unit. The indicating module includes two pilot lamps (e.g., LED pilot lamps), first pilot lamp and second pilot lamp promptly, connects on main control unit, and four kinds of operating condition of real-time instruction speech recognition module include: the first indicator lights are normally on to indicate that the voice recognition module is working, the first indicator lights are normally off to indicate that the voice recognition module is faulty, the second indicator lights are normally off to indicate that voice instructions are waiting for input, and the second indicator lights flash once to indicate that the voice instructions are recognized. The power supply module is composed of a power supply circuit and comprises a voltage stabilizer and a power converter, and is used for stably supplying power to the main controller and other modules in the voice recognition module. The serial communication unit is connected with the controller and the main controller, and is used for connecting the voice recognition module with the back-pumping injection module and transmitting voice recognition control signals in real time to control the action of the injector. The "start" and "stop" instructions correspond to the start and stop of the injection operation, respectively, and the "draw back" instruction corresponds to the draw back operation. In the full-automatic working mode, the start command corresponds to the whole injection process of executing the back-pumping operation, automatically identifying the back-pumping result and executing the injection operation.
The input module comprises a display unit (liquid crystal display, light indicator lamp) and an input unit (keyboard), the injection data such as dosage, speed and the like can be set through the input unit, and the display unit displays the working state of the injector and various parameters such as preset injection dosage, injection speed, accumulated injection quantity, residual electric quantity and the like in real time.
The main controller is connected with the voice recognition module, the image acquisition module, the image recognition module, the input module, the power supply module and the back-pumping injection module, processes the obtained target action information and action specific data, and comprises three actions of back pumping, starting injection and stopping injection, injection dosage, injection speed, whether injection is carried out or not and the like, and outputs pulse signals to control the driving unit. The storage module is contained in the main controller and records and stores information such as data time, voice recognition result, image recognition result, target action and the like in real time. The indicating module still includes four pilot lamps (third pilot lamp, fourth pilot lamp, fifth pilot lamp and sixth pilot lamp), connects on main control unit, and wherein, the two kinds of operating condition of the real-time instruction medicine injection system of third pilot lamp include: the normal on of the third indicator light represents the normal operation of the system, and the normal off of the third indicator light represents the fault state of the system; the fourth indicator light, the fifth indicator light and the sixth indicator light indicate the action state of the injector, and the method comprises the following steps: the fourth indicator light indicates that injection is started, the fifth indicator light indicates that injection is stopped, and the sixth indicator light indicates that withdrawal is started.
The back-pumping injection module comprises a stepping driving unit, a screw rod structure and a stepping motor. The driving unit receives a pulse signal sent by the main controller and drives the stepping motor to rotate; the screw rod structure converts the rotary motion of the motor into linear motion. The stepping motor rotates forward to drive the piston of the injector to push forward, so as to complete the injection action; and otherwise, the piston is pulled back to execute the back drawing action.
The main controller includes a main program, the controller includes a voice recognition program, and the processor includes an image recognition program. The main program is used for controlling the whole system, and the flow chart is shown in fig. 3, and specifically described as follows: the main control program comprises an initialization program, an interrupt function program and a motor driver. The initialization program comprises display initialization, flag bit initialization, interface initialization and global variable initialization. The interrupt function program comprises an external interrupt function, a serial interrupt function and a timer interrupt function, wherein the serial interrupt function is used for obtaining different instructions from a serial port and executing corresponding operations by the driving motor, and the timer interrupt function is used for realizing the rotation of the driving motor at a desired speed. The main control program calls the display function to display the working process of the injection system in real time. In a full-automatic working mode, after power-on, firstly, initializing a system, and waiting for an input module to set the working mode and injection data; after the input module inputs the determination (after the virtual 'confirm' key is pressed on the display unit), the serial port is opened, the recognition result of the voice recognition module is waited and the corresponding action is executed.
The voice program of the voice recognition module mainly comprises a main program, a serial communication program, a chip program and the like of the controller, and a main control flow chart is shown in fig. 4: firstly, initializing module zone bits and the like, then circularly reading voice recognition results, executing a user function and transmitting the results to a main controller. The chip program is a relevant program used in the operation of the voice recognition chip, and comprises the steps of resetting the chip, starting/stopping recognition, acquiring a recognition result from the chip and the like.
The image recognition program of the image recognition module mainly comprises a main program of a processor, a communication program, a target recognition model and the like, wherein the main program mainly comprises the following steps: firstly, initializing, then waiting for a command of a main controller, and starting image acquisition and identification; capturing an image frame from a video stream, and identifying by taking the image as an input operation model; and transmitting the identification result to the main controller.
In actual use operation, the working modes of the medicine injection system of the invention are full-automatic and semi-automatic. The specific using steps of the device in the full-automatic mode are as follows: firstly, finishing preoperative preparation, fixing an image acquisition module near an injection part, adjusting a support column to enable a camera to acquire images with definition and size meeting requirements, confirming that wiring is perfect and signal connection is normal, placing an injector filled with medicine on an injector support frame, inputting injection dosage and speed on an input module, and setting a working mode; in the operation process, medical staff just send a start instruction to the sound sensor, the device firstly executes a back drawing action, then the image acquisition module and the image recognition module confirm the back drawing effect, if the back drawing does not have blood, the injection action is executed, otherwise, the injection is stopped and an alarm is given on the input module; after the operation is completed, the injector is taken down, and the power supply of the injection pump is turned off.
The use steps of the semi-automatic mode drug injection system are as follows: firstly, finishing preoperative preparation, namely, placing an injector with medicine on a supporting frame, and inputting injection dosage and speed on an input module, wherein the wiring is well confirmed and the signal connection is normal; in the operation process, if the back suction is needed, medical staff just faces the sound sensor to send a back suction instruction, the back suction phenomenon is observed, and the syringe extension tube has no blood, so that the next injection can be carried out; the medical staff just faces the sound sensor to send an injection command, the injection pump starts to inject the medicine, and sends a stop command, and the injection pump stops injecting; after the operation is completed, the injector is taken down, and the power supply of the injection pump is turned off.
The foregoing is only a preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art, who is within the scope of the present invention, should make equivalent substitutions or modifications according to the technical scheme of the present invention and the inventive concept thereof, and should be covered by the scope of the present invention.
Claims (7)
1. A drug injection system based on image and speech recognition, comprising:
the voice recognition module is used for recognizing voice instructions, wherein the voice instructions comprise a back-pumping instruction, a medicine injection instruction and an injection stopping instruction;
the image acquisition module is used for acquiring an image of the injection part;
the image recognition module is used for recognizing the image of the injection part acquired by the image acquisition module, judging whether the back-pumping effect is achieved, and sending a back-pumping completion instruction if the back-pumping effect is achieved;
the back-pumping injection module receives the medicine injection instruction of the voice recognition module, performs medicine injection at the injection position, receives the back-pumping instruction of the voice recognition module, executes back-pumping operation, receives the back-pumping completion instruction of the image recognition module, judges that the back-pumping is effective, performs medicine injection, and receives the injection stopping instruction of the voice recognition module to stop medicine injection;
the main controller is connected with the image recognition module, the voice recognition module and the back-pumping injection module, receives a voice instruction of the voice recognition module and a back-pumping completion instruction of the image recognition module, and sends a control instruction to the back-pumping injection module, wherein the control instruction comprises an injection speed and a back-pumping speed;
the input module is used for inputting injection data, wherein the injection data comprises withdrawal speed, the dosage of the medicine and injection speed;
the image recognition module judges the back-drawing effect according to the color change, recognizes that the red color in the back-drawing injection module exceeds a set range in the image after back-drawing of the back-drawing injection module, and sends out an instruction that the injection cannot be performed, otherwise, sends out a back-drawing completion instruction.
2. The drug injection system based on image and speech recognition according to claim 1, wherein the image acquisition module comprises an imaging device to capture an image of the injection site.
3. The drug injection system based on image and voice recognition according to claim 1, wherein the back-pumping injection module comprises a syringe and a drive unit, the syringe comprising a plunger, an outer barrel and a needle, the drive unit driving the plunger to move within the outer barrel.
4. A drug injection system based on image and voice recognition according to claim 3, wherein the driving unit comprises a stepping motor, a screw rod structure and a motor driver, the motor driver drives the stepping motor to rotate, the screw rod structure converts the rotation motion of the stepping motor into linear motion, and the piston is driven to push and pull back to perform injection and back-pumping operations.
5. The drug injection system based on image and voice recognition of claim 1, further comprising a memory module for recording and storing images and data during injection and withdrawal.
6. The drug injection system based on image and voice recognition of claim 1, further comprising an indication module for indicating the operating states of the voice recognition module and the flashback injection module, the operating states comprising: waiting for voice command input, failing to recognize voice command, recognized voice command, normal back-pumping injection module and failure of back-pumping injection module.
7. The drug injection system based on image and voice recognition according to claim 6, wherein the indication module displays different working states by different colored lights.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110517838.8A CN113257385B (en) | 2021-05-12 | 2021-05-12 | Drug injection system based on image and voice recognition |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110517838.8A CN113257385B (en) | 2021-05-12 | 2021-05-12 | Drug injection system based on image and voice recognition |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113257385A CN113257385A (en) | 2021-08-13 |
| CN113257385B true CN113257385B (en) | 2023-10-20 |
Family
ID=77224106
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110517838.8A Active CN113257385B (en) | 2021-05-12 | 2021-05-12 | Drug injection system based on image and voice recognition |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113257385B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114711913A (en) * | 2022-03-22 | 2022-07-08 | 浙江大学 | Voice-operated medicine syringe |
| CN115212379A (en) * | 2022-05-25 | 2022-10-21 | 山东石油化工学院 | Intelligent infusion control device and intelligent infusion tube control method thereof |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103316403A (en) * | 2006-06-30 | 2013-09-25 | 艾伯维生物技术有限公司 | Automatic injection device |
| CN105833422A (en) * | 2016-03-18 | 2016-08-10 | 程大彦 | Semi-automatic preparing and injecting system of radioactive medicine |
| CN108577945A (en) * | 2018-05-16 | 2018-09-28 | 张拴军 | Nerve block anesthesia intelligent robot auxiliary system |
| CN110232961A (en) * | 2019-06-10 | 2019-09-13 | 上海电机学院 | A kind of speech recognition intelligent anesthesia system based on big data |
| CN110538371A (en) * | 2019-09-19 | 2019-12-06 | 贵州医科大学附属医院 | Automatic medicine injection device for nerve block |
| CN110812589A (en) * | 2019-11-28 | 2020-02-21 | 徐州医科大学附属医院 | Sound control children vein puncture device |
| CN110957028A (en) * | 2019-10-31 | 2020-04-03 | 上海长海医院 | Medical injection diagnosis and treatment system |
| CN111110195A (en) * | 2019-12-31 | 2020-05-08 | 广州永士达医疗科技有限责任公司 | OCT probe driving device with manual and automatic pumpback function |
| CN111430000A (en) * | 2020-05-28 | 2020-07-17 | 领先医疗科技(广州)有限责任公司 | Intelligent injection pump system, control method and medium thereof |
| CN211906968U (en) * | 2020-05-28 | 2020-11-10 | 领先医疗科技(广州)有限责任公司 | Intelligent injection pump system |
| CN112354047A (en) * | 2020-11-02 | 2021-02-12 | 华中科技大学同济医学院附属协和医院 | Detection device and method for automatically identifying blood backflow of needle tube |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7740612B2 (en) * | 2007-07-27 | 2010-06-22 | Milestone Scientific, Inc | Self-administration injection system |
| KR101019583B1 (en) * | 2009-02-16 | 2011-03-07 | 신동아 | Auto examination apparatus for disc |
| WO2012014210A2 (en) * | 2010-07-27 | 2012-02-02 | B.R. Industries Carmiel Ltd. | Sheet-material dispenser |
-
2021
- 2021-05-12 CN CN202110517838.8A patent/CN113257385B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103316403A (en) * | 2006-06-30 | 2013-09-25 | 艾伯维生物技术有限公司 | Automatic injection device |
| CN105833422A (en) * | 2016-03-18 | 2016-08-10 | 程大彦 | Semi-automatic preparing and injecting system of radioactive medicine |
| CN108577945A (en) * | 2018-05-16 | 2018-09-28 | 张拴军 | Nerve block anesthesia intelligent robot auxiliary system |
| CN110232961A (en) * | 2019-06-10 | 2019-09-13 | 上海电机学院 | A kind of speech recognition intelligent anesthesia system based on big data |
| CN110538371A (en) * | 2019-09-19 | 2019-12-06 | 贵州医科大学附属医院 | Automatic medicine injection device for nerve block |
| CN110957028A (en) * | 2019-10-31 | 2020-04-03 | 上海长海医院 | Medical injection diagnosis and treatment system |
| CN110812589A (en) * | 2019-11-28 | 2020-02-21 | 徐州医科大学附属医院 | Sound control children vein puncture device |
| CN111110195A (en) * | 2019-12-31 | 2020-05-08 | 广州永士达医疗科技有限责任公司 | OCT probe driving device with manual and automatic pumpback function |
| CN111430000A (en) * | 2020-05-28 | 2020-07-17 | 领先医疗科技(广州)有限责任公司 | Intelligent injection pump system, control method and medium thereof |
| CN211906968U (en) * | 2020-05-28 | 2020-11-10 | 领先医疗科技(广州)有限责任公司 | Intelligent injection pump system |
| CN112354047A (en) * | 2020-11-02 | 2021-02-12 | 华中科技大学同济医学院附属协和医院 | Detection device and method for automatically identifying blood backflow of needle tube |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113257385A (en) | 2021-08-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113257385B (en) | Drug injection system based on image and voice recognition | |
| CA2583726C (en) | Improvements to powerhead control in a power injection system | |
| EP2316507B1 (en) | Power injector with status messaging | |
| JP5997229B2 (en) | Power head control in power injection system | |
| WO2010062931A1 (en) | Workflow driven user interface for medical fluid delivery systems | |
| US20230173172A1 (en) | System and method utilizing an integrated camera with a fluid injector | |
| CN113144327A (en) | Medical intelligent auxiliary infusion device and infusion method based on machine vision | |
| JP4808213B2 (en) | Chemical injection device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |