CN114157913B - Video training method, terminal, server and system based on picture identification - Google Patents

Video training method, terminal, server and system based on picture identification Download PDF

Info

Publication number
CN114157913B
CN114157913B CN202111593212.1A CN202111593212A CN114157913B CN 114157913 B CN114157913 B CN 114157913B CN 202111593212 A CN202111593212 A CN 202111593212A CN 114157913 B CN114157913 B CN 114157913B
Authority
CN
China
Prior art keywords
training
video
target
terminal
medical instrument
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202111593212.1A
Other languages
Chinese (zh)
Other versions
CN114157913A (en
Inventor
段小霞
赵郑
刘德恒
于言言
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Zeqiao Medical Technology Co ltd
Original Assignee
Beijing Zeqiao Medical Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Zeqiao Medical Technology Co ltd filed Critical Beijing Zeqiao Medical Technology Co ltd
Priority to CN202111593212.1A priority Critical patent/CN114157913B/en
Publication of CN114157913A publication Critical patent/CN114157913A/en
Application granted granted Critical
Publication of CN114157913B publication Critical patent/CN114157913B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/441Acquiring end-user identification, e.g. using personal code sent by the remote control or by inserting a card

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Image Analysis (AREA)

Abstract

The invention provides a video training method, a training terminal, a server and a system based on picture identification, wherein the video training method applied to the training terminal comprises the following steps: acquiring first image information of a target medical instrument; transmitting the first image information to a server; receiving playing indication information sent by a server according to the first image information; determining a target training video which is stored on the training terminal and used for demonstrating the target medical instrument according to the playing indication information; and controlling the playing device to play the target training video. Therefore, even if the person to be trained compares unfamiliar with the target medical machinery, the training terminal can accurately determine the target training video, so that the person to be trained can be accurately and timely trained in the video.

Description

Video training method, terminal, server and system based on picture identification
Technical Field
The invention relates to the field of medical training, in particular to a video training method, a training terminal, a server and a system based on picture identification.
Background
In the related art, when video training of a medical instrument is performed on a customer, the customer is required to select a training video corresponding to the medical instrument. In the case where the customer is not familiar with the medical instrument, it is difficult for the customer to accurately find the corresponding training video.
Disclosure of Invention
Accordingly, an object of the present invention is to provide a video training method, training terminal, server and system based on image recognition, so as to at least solve the problems in the prior art.
In order to achieve the above object, a technical solution of a first aspect of the present invention provides a video training method based on picture recognition, applied to a training terminal, the method comprising:
Acquiring first image information of a target medical instrument;
Transmitting the first image information to a server;
receiving playing indication information sent by the server according to the first image information;
determining a target training video which is stored on the training terminal and used for demonstrating the target medical instrument according to the play indication information;
and controlling a playing device to play the target training video.
Optionally, in the case that at least two training videos for demonstrating the target medical instrument are stored on the training terminal, the determining, according to the play indication information, the target training video for demonstrating the target medical instrument stored on the training terminal includes:
According to the play indication information, determining all training videos used for demonstrating the target medical instrument on the training terminal;
Controlling a display device to display the whole training video;
and receiving a video selection instruction, and determining a training video corresponding to the video selection instruction as the target training video.
Optionally, the acquiring the first image information of the target area includes:
And receiving first image information of the target medical instrument, which is sent by the user terminal.
Optionally, the method further comprises:
acquiring second image information of a user in the process of playing the target training video;
And under the condition that the second image information characterizes that the user does not watch the training terminal, pausing playing the target training video.
Optionally, after pausing playing the target training video, the method further comprises:
And continuously playing the target training video under the condition that the second image information characterizes that the user is watching the training terminal.
The second aspect of the invention provides a video training method based on picture identification, which is applied to a server and comprises the following steps:
receiving first image information of a target medical instrument, which is sent by a training terminal;
identifying the target medical instrument from the first image information;
and sending playing indication information corresponding to the target medical instrument to the training terminal.
A third aspect of the present invention provides a training terminal comprising:
a memory having a computer program stored thereon;
And a processor for executing the program, the program when executed by the processor implementing the method provided in the first aspect of the present invention.
A fourth aspect of the present invention provides a server comprising:
a memory having a computer program stored thereon;
and a processor for executing the program, the program when executed by the processor implementing the method provided by the second aspect of the present invention.
A fifth aspect of the present invention provides a training system based on picture recognition, including:
The training terminal provided by the third aspect of the present invention, and the server provided by the fourth aspect of the present invention.
Through the technical scheme, the target training video stored on the training terminal and corresponding to the target medical instrument can be determined according to the first image information of the target medical instrument. Therefore, even if the person to be trained compares unfamiliar with the target medical machinery, the training terminal can accurately determine the target training video, so that the person to be trained can be accurately and timely trained in the video.
Additional aspects and advantages of the invention will be set forth in part in the description which follows, or may be learned by practice of the invention.
Drawings
FIG. 1 is a flowchart of a video training method based on picture recognition provided by an exemplary embodiment of the present invention;
FIG. 2 is a flow chart of a video training method based on picture recognition provided by another exemplary embodiment of the present invention;
FIG. 3 is a block diagram of a training terminal provided by an exemplary embodiment of the present invention;
Fig. 4 is a block diagram of a server provided in an exemplary embodiment of the present invention.
Detailed Description
In order that the above-recited objects, features and advantages of the present application will be more clearly understood, a more particular description of the application will be rendered by reference to the appended drawings and appended detailed description. It should be noted that, without conflict, the embodiments of the present application and features in the embodiments may be combined with each other.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention, but the present invention may be practiced in other ways than those described herein, and therefore the scope of the present invention is not limited to the specific embodiments disclosed below.
First, possible application scenarios of the present invention will be described.
During use of the medical device, training of the user is required. For example, when the medical apparatus is used facing the caregivers, the caregivers can be trained to know the working mode of the medical apparatus. However, in daily work, it is difficult for caregivers to have time to perform centralized training, and meanwhile, different caregivers have different knowledge of medical instruments, so that the caregivers have difficulty in operating independently.
In view of the above, the invention provides a video training method, a training terminal, a server and a system based on picture identification.
Referring to fig. 1, a first aspect of the present invention provides a video training method based on picture recognition, which is applied to a training terminal, and the method may include steps S11 to S15.
In step S11, first image information of a target medical instrument is acquired. It is understood that the target medical instrument is included in the first image information.
In step S12, the first image information is transmitted to the server. In one possible implementation, the training terminal may send the first image information to the server through 4G communication.
In step S13, play instruction information transmitted from the server according to the first image information is received.
The training terminal may have a training video stored thereon, and the training video may correspond to a plurality of medical instruments. In step S14, the target training video for the target medical instrument presentation stored on the training terminal is determined based on the play instruction information, and thus, the target training video corresponding to the target medical instrument can be accurately determined.
In step S15, the playback device is controlled to play the target training video.
Therefore, even if the person to be trained compares unfamiliar with the target medical machinery, the training terminal can accurately determine the target training video, so that the person to be trained can be accurately and timely trained in the video.
Meanwhile, the target medical instrument is identified through the server, so that an image identification algorithm at the server side can conveniently obtain enough samples for feedback, and the identification accuracy can be improved.
In an exemplary case that at least two training videos for demonstrating the target medical instrument may be stored on the training terminal, determining the target training video for demonstrating the target medical instrument stored on the training terminal according to the playing indication information may include:
according to the play indication information, determining all training videos for demonstrating the target medical instrument on the training terminal;
Controlling the display device to display all training videos;
and receiving the video selection instruction, and determining the training video corresponding to the video selection instruction as a target training video.
In this solution, after receiving the first image information, the server may identify the first image information to determine the target medical device. In this way, the playing indication information sent by the server to the training terminal can be the training video corresponding to the playing target medical instrument. While the target medical device may have multiple functions, the target medical device may correspond to multiple training videos. Therefore, in this case, the training terminal determines all the training videos for the target medical instrument presentation on the training terminal based on the play instruction information, and controls the display device to display all the training videos (for example, all the training videos may be displayed through the display screen). The entire training video may be displayed, for example, in the form of a file list, or a thumbnail of each training video may be displayed.
The user can determine the training video to be watched according to all the displayed training videos, and can select the training video (for example, click a touch screen), the training terminal receives a video selection instruction, and the training video corresponding to the video selection instruction is determined as a target training video.
Therefore, under the condition that the target medical instrument corresponds to a plurality of training videos, a user can select the required training videos by himself.
In another possible implementation manner, in a case that the plurality of training videos of the target medical apparatus have a fixed sequence relationship, the training terminal may acquire a history play record of the current user, and determine the target training video according to the training video of the target medical apparatus, which is recently watched by the current user in the history play record, and the sequence relationship.
Therefore, the target training video can be more conveniently determined, and the user can be accurately trained under the condition that the user does not know the target medical equipment.
The order relation of the target medical instruments can be, for example, ordered from simple to difficult according to the operation difficulty, or ordered from less to more according to the operation procedures, so that the user can be systematically trained.
Illustratively, acquiring first image information of a target region includes: and receiving first image information of the target medical instrument, which is sent by the user terminal.
In this scheme, the user may capture first image information of the target medical instrument through the user terminal and transmit the image information to the training terminal (for example, may be transmitted through bluetooth). The target medical instrument can be acquired more conveniently.
Illustratively, the method further comprises: acquiring second image information of a user in the process of playing the target training video; and under the condition that the second image information characterizes that the user does not watch the training terminal, pausing playing the target training video.
For example, the gesture of the user may be identified from the second image information, and in a case where the gesture of the user characterizes that the user is not currently facing the training terminal, it may be determined that the user is not viewing the training terminal. Playing of the target training video may be paused at this point. Therefore, the playing can be paused when the user interrupts training due to other things, the user is not required to pause manually, the convenience is improved, and meanwhile, the risk of cross infection can be reduced during epidemic situations.
The gesture recognition of the user may be implemented by a deep learning algorithm such as a convolutional neural network, which is not described herein.
Illustratively, after pausing the playing of the target training video, the method further comprises: and continuously playing the target training video under the condition that the second image information characterizes that the user is watching the training terminal.
Referring to fig. 2, a second aspect of the present invention provides a video training method based on picture recognition, applied to a server, the method comprising:
Step S21, receiving first image information of a target medical instrument, which is sent by a training terminal; step S22, identifying a target medical instrument according to the first image information; step S23, sending playing indication information corresponding to the target medical instrument to the training terminal.
Therefore, even if the person to be trained compares unfamiliar with the target medical machinery, the training terminal can accurately determine the target training video, so that the person to be trained can be accurately and timely trained in the video.
Meanwhile, the target medical instrument is identified through the server, so that an image identification algorithm at the server side can conveniently obtain enough samples for feedback, and the identification accuracy can be improved.
Fig. 3 is a block diagram of a training terminal 700, shown according to an exemplary embodiment. As shown in fig. 3, the training terminal 700 may include: a processor 701, a memory 702. The training terminal 700 may also include one or more of a multimedia component 703, an input/output (I/O) interface 704, and a communication component 705.
The processor 701 is configured to control the overall operation of the training terminal 700 to complete all or part of the steps in the video training method based on picture recognition applied to the training terminal. The memory 702 is used to store various types of data to support operation at the training terminal 700, which may include, for example, instructions for any application or method operating on the training terminal 700, as well as application-related data, such as contact data, messages sent and received, pictures, audio, video, and so forth. The Memory 702 may be implemented by any type or combination of volatile or non-volatile Memory devices, such as static random access Memory (Static Random Access Memory, SRAM for short), electrically erasable programmable Read-Only Memory (ELECTRICALLY ERASABLE PROGRAMMABLE READ-Only Memory, EEPROM for short), erasable programmable Read-Only Memory (Erasable Programmable Read-Only Memory, EPROM for short), programmable Read-Only Memory (Programmable Read-Only Memory, PROM for short), read-Only Memory (ROM for short), magnetic Memory, flash Memory, magnetic disk, or optical disk. The multimedia component 703 can include a screen and an audio component. Wherein the screen may be, for example, a touch screen, the audio component being for outputting and/or inputting audio signals. For example, the audio component may include a microphone for receiving external audio signals. The received audio signals may be further stored in the memory 702 or transmitted through the communication component 705. The audio assembly further comprises at least one speaker for outputting audio signals. The I/O interface 704 provides an interface between the processor 701 and other interface modules, which may be a keyboard, mouse, buttons, etc. These buttons may be virtual buttons or physical buttons. The communication component 705 is used for wired or wireless communication between the training terminal 700 and other devices. Wireless Communication, such as Wi-Fi, bluetooth, near Field Communication (NFC) for short, 2G, 3G, 4G, NB-IOT, eMTC, or other 5G, etc., or one or a combination of more of them, is not limited herein. The corresponding communication component 705 may thus comprise: wi-Fi module, bluetooth module, NFC module, etc.
In an exemplary embodiment, the training terminal 700 may be implemented by one or more Application-specific integrated circuits (ASIC), digital signal Processor (DIGITAL SIGNAL Processor, DSP), digital signal processing device (DIGITAL SIGNAL Processing Device, DSPD), programmable logic device (Programmable Logic Device, PLD), field programmable gate array (Field Programmable GATE ARRAY, FPGA), controller, microcontroller, microprocessor, or other electronic component for performing the above-described video training method based on picture recognition applied to the training terminal.
In another exemplary embodiment, a computer readable storage medium is also provided that includes program instructions that when executed by a processor implement the steps of the above-described video training method based on picture recognition applied to a training terminal. For example, the computer readable storage medium may be the memory 702 including program instructions described above that are executable by the processor 701 of the training terminal 700 to perform the video training method based on screen recognition described above.
Fig. 4 is a block diagram illustrating a server 1900 according to an example embodiment. Referring to fig. 4, the server 1900 includes a processor 1922, which may be one or more in number, and a memory 1932 for storing computer programs executable by the processor 1922. The computer program stored in memory 1932 may include one or more modules each corresponding to a set of instructions. Further, the processor 1922 may be configured to execute the computer program to perform the above-described video training method based on picture recognition applied to a server.
In addition, the server 1900 may further include a power component 1926 and a communication component 1950, the power component 1926 may be configured to perform power management of the server 1900, and the communication component 1950 may be configured to enable communication of the server 1900, e.g., wired or wireless communication. In addition, the server 1900 may also include an input/output (I/O) interface 1958. The Server 1900 may operate based on an operating system stored in memory 1932, such as Windows Server TM,Mac OS XTM,UnixTM,LinuxTM or the like.
In another exemplary embodiment, a computer readable storage medium is also provided that includes program instructions that when executed by a processor implement the steps of the above-described video training method based on picture recognition applied to a server. For example, the non-transitory computer readable storage medium may be the memory 1932 comprising program instructions that are executable by the processor 1922 of the server 1900 to perform the server-based video training method for picture recognition as described above.
In another exemplary embodiment, a computer program product is also provided, the computer program product comprising a computer program executable by a programmable apparatus, the computer program having code portions for performing the above-described picture recognition based video training method applied to a server when executed by the programmable apparatus.
The invention also provides a training system based on picture identification, which comprises: the training terminal and the server provided by the lock in the embodiment are provided.
It will be appreciated by those skilled in the art that embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It should be noted that in the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The use of the words first, second, third, etc. do not denote any order. These words may be interpreted as names.

Claims (2)

1. A video training method based on picture recognition, characterized by being applied to a training terminal, the method comprising: acquiring first image information of a target medical instrument; transmitting the first image information to a server; receiving playing indication information sent by the server according to the first image information; determining a target training video which is stored on the training terminal and used for demonstrating the target medical instrument according to the play indication information; controlling a playing device to play the target training video;
under the condition that at least two training videos for demonstrating the target medical instrument are stored on the training terminal, determining the target training videos for demonstrating the target medical instrument stored on the training terminal according to the playing indication information, wherein the method comprises the following steps: according to the play indication information, determining all training videos used for demonstrating the target medical instrument on the training terminal; controlling a display device to display the whole training video; receiving a video selection instruction, and determining a training video corresponding to the video selection instruction as the target training video;
The training terminal can acquire a history play record of the current user under the condition that a plurality of training videos of the target medical instrument have a fixed sequence relationship, and determines the target training video according to the training videos of the target medical instrument, which are watched by the current user, in the history play record and the sequence relationship;
The method further comprises the steps of: acquiring second image information of a user in the process of playing the target training video; under the condition that the second image information characterizes that the user does not watch the training terminal, the playing of the target training video is paused;
After pausing playing the target training video, the method further comprises: and continuously playing the target training video under the condition that the second image information characterizes that the user is watching the training terminal.
2. A training terminal, comprising:
a memory having a computer program stored thereon;
a processor for executing said program, said program being capable of implementing the method of claim 1 when executed by said processor.
CN202111593212.1A 2021-12-24 2021-12-24 Video training method, terminal, server and system based on picture identification Active CN114157913B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111593212.1A CN114157913B (en) 2021-12-24 2021-12-24 Video training method, terminal, server and system based on picture identification

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111593212.1A CN114157913B (en) 2021-12-24 2021-12-24 Video training method, terminal, server and system based on picture identification

Publications (2)

Publication Number Publication Date
CN114157913A CN114157913A (en) 2022-03-08
CN114157913B true CN114157913B (en) 2024-06-18

Family

ID=80452206

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111593212.1A Active CN114157913B (en) 2021-12-24 2021-12-24 Video training method, terminal, server and system based on picture identification

Country Status (1)

Country Link
CN (1) CN114157913B (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107809665A (en) * 2017-09-27 2018-03-16 镇江博格信息科技有限公司 Online training monitoring method based on acoustic image
CN113614847A (en) * 2019-01-25 2021-11-05 费森尤斯医疗保健控股公司 Augmented reality based training and troubleshooting for medical devices

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030223411A1 (en) * 2002-05-30 2003-12-04 De La Fuente Ramon Streaming audio/video guidance in a consumer appliance
CN102968915B (en) * 2012-10-23 2015-07-01 中国石油化工股份有限公司 Chemical device training management device, device knowledge base and training management system
CN106657851A (en) * 2016-12-13 2017-05-10 深圳创维-Rgb电子有限公司 Method, device and system for dynamic demonstration of instructions for use
CN111225172A (en) * 2020-03-02 2020-06-02 携隐信息咨询(上海)有限公司 Training terminal based on cloud service
CN111508285A (en) * 2020-04-24 2020-08-07 中国人民解放军总医院 Medical emergency training method and system based on mixed reality

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107809665A (en) * 2017-09-27 2018-03-16 镇江博格信息科技有限公司 Online training monitoring method based on acoustic image
CN113614847A (en) * 2019-01-25 2021-11-05 费森尤斯医疗保健控股公司 Augmented reality based training and troubleshooting for medical devices

Also Published As

Publication number Publication date
CN114157913A (en) 2022-03-08

Similar Documents

Publication Publication Date Title
WO2019237657A1 (en) Method and device for generating model
KR20200022329A (en) Method and device for determining response time
CN112419693B (en) Device control method, device, display device and computer readable storage medium
CN110688169B (en) Application program acceleration method and device, storage medium and electronic equipment
CN110781408B (en) Information display method and device
CN107172502B (en) Virtual reality video playing control method and device
CN110084317B (en) Method and device for recognizing images
CN110472558B (en) Image processing method and device
CN107329659B (en) Permission setting method and device, electronic equipment and storage medium
WO2020006004A1 (en) Video subtitle display method and apparatus
US20150199058A1 (en) Information processing method and electronic device
US20210058488A1 (en) Methods, systems, and media for pairing devices to complete a task using an application request
US8139757B2 (en) Electronic device capable of recording conference information, computer system, conference information processing method, and program product therefor
CN113190106A (en) Gesture recognition method and device and electronic equipment
CN114157913B (en) Video training method, terminal, server and system based on picture identification
US10133408B2 (en) Method, system and computer program product
US20170046177A1 (en) Screen generating apparatus
CN110333903B (en) Method and device for determining page loading duration
CN111784772B (en) Attitude estimation model training method and device based on domain randomization
CN111324244B (en) Method and device for switching picture display types
CN107566471B (en) Remote control method and device and mobile terminal
EP3570187A1 (en) Display control apparatus, display control method, and display control server
CN113453048A (en) Audio and video tactile feedback setting method, audio and video playing method and computer equipment
JP2016029543A (en) Information processing apparatus and program
CN113126865B (en) Note generation method and device in video learning process, electronic equipment and medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant