CN107909022A - A kind of method for processing video frequency, device, terminal device and storage medium - Google Patents
A kind of method for processing video frequency, device, terminal device and storage medium Download PDFInfo
- Publication number
- CN107909022A CN107909022A CN201711103557.8A CN201711103557A CN107909022A CN 107909022 A CN107909022 A CN 107909022A CN 201711103557 A CN201711103557 A CN 201711103557A CN 107909022 A CN107909022 A CN 107909022A
- Authority
- CN
- China
- Prior art keywords
- display screen
- touch display
- written image
- handwriting trace
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/10—Character recognition
- G06V30/32—Digital ink
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/62—Control of parameters via user interfaces
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/2621—Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a kind of method for processing video frequency, device, terminal device and storage medium.This method includes：The written image corresponding to the touch display screen region is obtained in the video data photographed from the camera towards touch display screen；The handwriting trace produced in the camera shooting process in touch display screen is gathered, and the collection moment of the handwriting trace is mapped to the time shaft of the written image；The handwriting trace is added to the written image by the relative position based on the time shaft and the handwriting trace in the touch display screen.The problem of present invention is solved during video teaching, and written contents are blocked by the hand of user, improves the notice of the efficiency and student of video teaching in learning process.
Description
Technical field
The present embodiments relate to image processing techniques, more particularly to a kind of method for processing video frequency, device, terminal device and
Storage medium.
Background technology
With the continuous development of network, educational reform plan also improves therewith.In the 21st century, is with PC machine, notebook
The continuous popularization of equipment, Web education are constantly risen also with the development of network technology.
In the prior art, the teaching process of teacher can be recorded into multimedia file, can help student easily from
Learn, review and preview, resource-sharing can also be formed between teacher, school, improve qualified teachers' teaching strength.It is also possible to
Long-distance video teaching is carried out to the learner of different regions by network.
And during field research, for teacher when carrying out writing explanation on clipboard, attention of student is in teacher institute book
In the content write, but the partial content or content written write may be sheltered from by the hand of teacher, such as Fig. 1 institutes
Showing, teacher is P (C)=0.01=1% in the content that the first row is write, but since teacher is when writing the content of the second row,
" 0.01=1% " partial content of the first row is sheltered from hand, it is necessary to after teacher moves hand, the writing of this part
Content could be received by student, so as to have impact on notice of the student in learning process.
The content of the invention
The present invention provides a kind of method for processing video frequency, device, terminal device and storage medium, to realize raising video teaching
Notice in learning process of efficiency and student.
In a first aspect, an embodiment of the present invention provides a kind of method for processing video frequency, this method includes：
Obtained in the video data photographed from the camera towards touch display screen and correspond to the touch display screen institute
Written image in region；
Gather the handwriting trace produced in the camera shooting process in touch display screen, and by the handwriting trace
The collection moment is mapped to the time shaft of the written image；
Relative position based on the time shaft and the handwriting trace in the touch display screen is by the writing rail
Mark is added to the written image.
Second aspect, the embodiment of the present invention additionally provide a kind of video process apparatus, which includes：
Written image module is obtained, for the acquisition pair from the video data that the camera towards touch display screen photographs
The written image of touch display screen region described in Ying Yu；
Handwriting trace module is gathered, for gathering the writing rail produced in the camera shooting process in touch display screen
Mark, and the collection moment of the handwriting trace is mapped to the time shaft of the written image；
Add handwriting trace module, for based on the time shaft and the handwriting trace in the touch display screen
The handwriting trace is added to the written image by relative position.
The third aspect, the embodiment of the present invention additionally provide a kind of terminal device, and the equipment includes：
One or more processors；
Memory, for storing one or more programs；
When one or more of programs are performed by one or more of processors so that one or more of processing
Device realizes the method for processing video frequency as described in any of the above-described.
Fourth aspect, the embodiment of the present invention additionally provide a kind of computer-readable recording medium, are stored thereon with computer
Program, realizes the method for processing video frequency as described in any of the above-described when which is executed by processor.
The technical solution of the present invention from the video data that the camera towards touch display screen photographs by obtaining
Take the written image corresponding to touch display screen region；The book produced in acquisition camera shooting process in touch display screen
Track is write, and the collection moment of handwriting trace is mapped to the time shaft of written image；Touched based on time shaft and handwriting trace
The technological means that handwriting trace is added to written image by the relative position in display screen is touched, is solved in video teaching process
In, the problem of written contents are blocked by hand, improve the notice of the efficiency and student of video teaching in learning process
Effect.
Brief description of the drawings
Fig. 1 is the view that written contents are blocked by hand in the prior art.
Fig. 2 is a kind of flow chart of method for processing video frequency in the embodiment of the present invention one.
Fig. 3 is a kind of structure diagram of video recording system in the embodiment of the present invention one.
Fig. 4 is a kind of flow chart of method for processing video frequency in the embodiment of the present invention two.
Fig. 5 is the view that written contents are shown on hand in the embodiment of the present invention two.
Fig. 6 is a kind of structure diagram of video process apparatus in the embodiment of the present invention three.
Fig. 7 is a kind of structure diagram of terminal device in the embodiment of the present invention four.
Embodiment
The present invention is described in further detail with reference to the accompanying drawings and examples.It is understood that this place is retouched
The specific embodiment stated is used only for explaining the present invention, rather than limitation of the invention.It also should be noted that in order to just
It illustrate only part related to the present invention rather than entire infrastructure in description, attached drawing.
Embodiment one
Fig. 2 is the flow chart for the method for processing video frequency that the embodiment of the present invention one provides, and the present embodiment is applicable to recording
The situation for avoiding written contents to be blocked or avoided during remote teaching by hand written contents to be blocked by hand during course, should
Method can be performed by video process apparatus provided in an embodiment of the present invention, which can use the side of software and/or hardware
Formula is realized, and can be generally integrated in terminal device.The method for processing video frequency specifically comprises the following steps：
S110, acquisition corresponds to touch display screen institute from the video data that the camera towards touch display screen photographs
Written image in region.
In a specific embodiment of the present invention, video record is carried out to the teaching process of user by camera, such as Fig. 3 institutes
Show, be a kind of structure diagram of video recording system.In this embodiment, it will be carried by USB connecting lines 13 and touch display
The tablet computer 14 and camera 11 of screen 10 are attached, and camera 11 is installed on to the surface of touch display screen 10, i.e.,
The shooting direction of camera 11 is directed towards the side of the touch display screen 10 of platform computer 14.Wherein, touch display screen and not only
Tablet computer is only defined in, can also use other electronic equipments with touch display screen, such as, the intelligence with touch display screen
Can mobile phone and laptop etc..
It is non-limiting as example, will be flat after camera and tablet computer are attached by user by USB connecting lines
Writing software in plate computer is opened, into write mode, i.e. lettering pen is enterprising in the screen of the touch display screen of tablet computer
Running hand is write, and when showing that the pattern of person's handwriting is analogous to the pen mode in drawing board, will adjust the side of camera and tablet computer
To making the screen of its tablet computer try one's best the underface in camera, and open camera and start to record, user will be at this time
The content to be explained is write on the screen of touch display screen, meanwhile, user will be obtained by camera in touch display screen institute
The image write in region.
The handwriting trace produced in S120, acquisition camera shooting process in touch display screen, and adopting handwriting trace
The collection moment is mapped to the time shaft of written image.
Wherein, time shaft is as camera is opened, and starts the content write to user in touch display screen and carries out
Record and start, generate the recording until completing course or remote teaching over time and terminate, it is used to remember
Record written image and the time state in handwriting trace gatherer process and association in time therebetween.Handwriting trace is by nothing
It is several to write point sets and form, when user's (can be teacher, or the other staff recorded to video) is aobvious in touch
When being write in display screen, touch display screen will gather writing point set in real time, and all writing point sets are combined, with shape
Be stored in into handwriting trace, and by handwriting trace in the memory of tablet computer, meanwhile, by gather handwriting trace at the time of with obtaining
Corresponded at the time of taking written image.
In a specific embodiment of the present invention, when user starts carrying out content writing in touch display screen, it will touch
The touch event of writing software system is sent out, the touch event that the writing software in tablet computer will be provided by system, obtains and touch
The handwriting trace produced on display screen is touched, and the collection moment of handwriting trace is mapped on the time shaft of written image.
Handwriting trace is added to writing by S130, the relative position based on time shaft and handwriting trace in touch display screen
Image.
In the present solution, written image since it is desired that continuously acquired, but over time, user utilizes writing
During pen carries out written contents in touch display screen, relative position of the handwriting trace in touch display screen is to exist always
Change.According to the relative position of the time sequencing and handwriting trace of written image in touch display screen is obtained, rail will be write
Mark and written image are corresponded, and handwriting trace is added in written image.
In general, in user carries out writing process, comparatively the refresh rate of written image is than handwriting trace
Refresh rate is very fast, i.e. at least corresponding frame written image of handwriting trace, and be a sheet by a sheet static figure per frame written image
Picture, also, relative position of the handwriting trace in touch display screen is also change.It is opposite in touch display screen according to it
Position and a corresponding at least frame written image, the handwriting trace collected are covered in written image, i.e. will write point set
Cover in corresponding written image on corresponding pixel, so that writing point set and corresponding pixel merge, so that, book
Write point set to be shown as the video pictures of a frame frame on a display screen, sheltered from so as to avoid the hand of user in writing
Hold, make the learner of viewing video content from the influence of user, and reduce the learning efficiency of its own.
Specifically, when user is carrying out content writing in touch display screen, written contents are followed successively by the first row
" P (C)=0.01=1% ", the written contents on the second row are followed successively by " P (Pos | C)=0.9=90% ", if by user institute book
The content write is added in written image, when user again explains the content of the first row, and hand is placed on the first row
During position, the learner of video content is watched, it can be seen that the content of the second row, so as to improve the effect that user explains content
Rate, and the learning efficiency of learner.
The technical solution of the present embodiment, by being obtained from the video data that the camera towards touch display screen photographs
Corresponding to the written image of touch display screen region；The writing produced in acquisition camera shooting process in touch display screen
Track, and the collection moment of handwriting trace is mapped to the time shaft of written image；Touched based on time shaft and handwriting trace
Handwriting trace is added to the technological means of written image by the relative position in display screen, is solved during video teaching,
The problem of written contents are blocked by hand, improves the effect of the notice of the efficiency and student of video teaching in learning process
Fruit.
Further, based on the above technical solutions, based on time shaft and handwriting trace in touch display screen
Relative position handwriting trace is added to written image after, the method for processing video frequency, further includes：Based on the same stepping of time shaft
Row audio collection obtains voice data, and voice data is associated to generation video data with written image.
Certainly, in the video data that camera photographs, on the one hand contain during video record, user is touching
The content write on display screen is touched, on the other hand, user in screen recording process is additionally included in and written contents is said
The voice data of solution.
In the present solution, the time sequencing based on acquisition written image, corresponding by the acquisition moment with written image
Voice data is associated preservation, to generate the video data of Internet video course, and associated video data information is saved in
With in the associated terminal device of camera, in the present solution, being the memory that is saved in video data information in tablet computer
In, and the video image of collection is played out by display by tablet computer.
Certainly, the video pictures that the learner of video is seen by display screen are watched, actually according to certain refreshing
Frequency is shown a series of with the static video image necessarily contacted, usually by the unit of " frame " as video image.By
There is " persistence of vision " in the eyes of people, therefore, multiple discrete video images are shown according to certain frequency, so that it may
To see continuous video pictures.Correspondingly, during camera recorded video, and the video figure obtained one by one
Picture.
The technical solution of the present embodiment, further, audio number is obtained by synchronously carrying out audio collection based on time shaft
According to voice data to be associated with written image to the technological means of generation video data, the video image of voice data will be associated with
Display is played out in terminal device, so that learner carries out viewing study to the content of courses.
Embodiment two
Fig. 4 is the flow chart of method for processing video frequency provided by Embodiment 2 of the present invention, and the present embodiment is applicable to micro- class
Recording or remote teaching in written contents situation about being blocked by hand, the present embodiment be on the basis of embodiment one, to from
The writing figure corresponding to touch display screen region is obtained in the video data photographed towards the camera of touch display screen
Handwriting trace is added to written image by picture, and relative position based on time shaft and handwriting trace in touch display screen,
Further optimize, specifically comprise the following steps：
S210, read the initial graph for including touch display screen region photographed towards the camera of touch display screen
Picture.
In a specific embodiment of the present invention, camera is installed on to the surface of touch display screen, but is specifically being recorded
During, the video image that camera can be shot is not just for the video image of touch display screen region, Ke Nengye
Include the video image outside touch display screen.
Meanwhile content writing is carried out using the writing software in tablet computer, most writing software can be all provided with
One frame specified, makes user carry out content writing in specified frame, therefore, in the initial pictures that camera obtains,
Also include the associated video image outside the frame specified at the same time.
S220, carry out initial pictures the initial written image that image recognition extracts touch display screen region.
Specifically, in order to which the video image that the handwriting trace and camera of subsequently being write user are collected carries out
Correspond, initial pictures need to be pre-processed, the initial written image of touch display screen region is extracted with identification.
Exemplarily, the contour detecting algorithm increased income by Opencv in storehouse, detects touch display screen institute in initial pictures
Image recognition extraction is carried out to initial pictures on the border in region, and according to border, to obtain touch display screen region
Initial written image.Specifically, contour detecting algorithm, can be divided into still image contour detecting and dynamic video contour detecting,
Wherein, the first kind in dynamic video contour detecting obtains movement clue using optical flow method.Optical flow method is based on spatio-temporal gradient model
The brightness of object is calculated with time and the change field in space.The transient change speed of optical flow computation pixel, its principle assume that
Pixel is moved to other positions from a position, its gray value remains unchanged, therefore can calculate certain according to light stream estimation
One pixel moves transient change speed.Second class obtains movement clue using frame difference method, and frame difference method is also moving object detection
In one of common method.Its basic principle is the pixel difference that two frames subtract each other before and after first calculating, and two-value is carried out using fixed value of closing
Change is handled, and obtains foreground moving object.If target is not moved, then the pixel difference that two frames subtract each other is zero；If target has bright
Aobvious movement, then the pixel difference that two frames subtract each other, which is more than, closes value, and binary conversion treatment can obtain the moving target position in video frame.
In the present solution, can be by still image contour detecting, the initial pictures that camera is got, which are identified, to be carried
Take, to realize the written image for only retaining touch display screen region, in order to subsequently to handwriting trace and written image into
Row merging treatment.
S230, carry out initial written image distortion correction acquisition and the corresponding writing of display shape of touch display screen
Image.
Specifically, camera is installed on to the surface of touch display screen, but during specific video record, lettering pen
Motion state is constantly in touch display screen region.Similarly, lettering pen is in the enterprising running hand of touch display screen
Relative position of the track write in touch display screen is also change, i.e., for camera, lettering pen is touching display
The relative position for the track write on screen is not in the underface of camera, correspondingly, the written image that camera collects
It there are certain angle, will cause the video pictures distortion got with the position of camera, such as, the display to rectangle
Screen is shot, and what is obtained is probably trapezoidal picture, then needs to carry out distortion correction to initial written image, to obtain and touch
Touch the corresponding written image of display shape of display screen.
It is non-limiting as example, in the technical solution of the present embodiment, using Opencv built-in functions, to initial written figure
As carrying out distortion correction, such as, (function is used for duplicating image content to IcvCloneImage, and need not open up memory.
During programming, artwork is copied into a new position using this function, to facilitate distortion correction below),
2cvGetPerspectiveTransform (calculates projection conversion by 4 points.Need to obtain four vertex of artwork in programming
The left side and four apex coordinates of standard rectangular, the numerical computations that then thus function is changed between the two), and
(function is used for carrying out perspective transform to image 34cvWarpPerspective.Four apex coordinates of artwork are transformed into
Four new vertex), three above-mentioned function pair initial written images can be used to carry out distortion correction, to obtain touch display screen
The corresponding written image of display shape.
Certainly, distortion correction is carried out to initial written image using Opencv built-in functions in the present embodiment, so as to obtain
The written image arrived is corresponding with the display shape of touch display screen.Specifically, the screen shape of touch display screen is rectangle,
By carrying out distortion correction to initial written image, so that the shape of the written image obtained after correction is also rectangle, from
And avoid the distortion phenomenon that camera obtains video image.
The handwriting trace produced in S240, acquisition camera shooting process in touch display screen, and adopting handwriting trace
The collection moment is mapped to the time shaft of written image.
S250, according to the proportionate relationship of the size of written image and the size of touch display screen carry out handwriting trace grade ratio
The scaling of example.
Specifically, if it is 3 that the screen of the touch display screen of tablet computer, which is ratio,:4 rectangle, but because using writing
When software writes content, it need to be write in specified frame, then the size of written image compares touch display screen
Screen size for, the size of its written image is smaller, such as, the size using the writing frame specified in writing software is
2.7:3.6, then when carrying out distortion correction to initial written image by Opencv built-in functions, make the display shape of written image
It can be changed into ratio as 2.7:3.6 rectangle, then be adjusted the size of handwriting trace by Image Zooming Algorithm, make its writing
The dimension scale of track also transitions into 2.7:3.6.
Exemplarily, if the size of the touch display screen of tablet computer is 18cm*24cm, then the writing in tablet computer
The size for the writing frame that software is specified is 16.2cm*21.6cm, and correspondingly, the size of written image is also 16.2cm*
21.6cm, will be by Image Zooming Algorithm to writing rail in order to make written image and handwriting trace realize and preferably merge effect
Mark zooms in and out, and its size is also changed into 16.2cm*21.6cm.
Certainly, when user habitually proceeds by content writing on the left of the specified frame of writing software, such as,
In the first row written contents be followed successively by " P (C)=0.01=1% ", the written contents on the second row be followed successively by " P (Pos | C)=
0.9=90% ", if from initial pictures only identification extraction with P (C)=0.01=1% and P (Pos | C)=0.9=90% etc.
The image of written contents, during as initial written image, obtained writing after distortion correction is carried out to initial written image
The size of image can also diminish accordingly, i.e. the size of the size ratio touch display screen of written image is small, it is also desirable to according to writing
The proportionate relationship of the size of image and the size of touch display screen, zooms in and out handwriting trace by Image Zooming Algorithm, with
So that the size of the size of handwriting trace and touch display screen is to corresponding, so that handwriting trace and the synthetic effect of written image
More preferably.
Wherein, image scaling is the process being adjusted to the size of digital picture.When the size of an image increases it
Afterwards, higher will be become by forming the visibility of the pixel of image, so that image appearance obtains " soft ".On the contrary, reduce one
Image will strengthen its smoothness and clarity.In general, image magnification is all to use interpolated value method, i.e., in original figure
As being inserted into new element on the basis of pixel using suitable interpolation algorithm between pixel.In the present solution, because writing rail
Mark is write on the screen of tablet computer, and the size of its handwriting trace and the screen size of tablet computer are adapted,
But the size for the written image that distortion correction obtains not is identical with the screen size of tablet computer, for guaranty
Write the synthetic effect of image and handwriting trace, need to according to written image size and touch display screen size proportionate relationship pair
Handwriting trace carries out the scaling of equal proportion.
The writing point set of handwriting trace after S260, the first pixel coordinate for obtaining written image, and scaling.
Specifically, each frame written image is all made of several pixels.Meanwhile handwriting trace is by some
What a writing point set was formed.Due to being zoomed in and out to written image and handwriting trace, the first pixel coordinate of its written image with
And the writing point set of handwriting trace also changes accordingly.
S270, confirm the corresponding at least frame written image of handwriting trace based on time shaft, will based on the first pixel coordinate
Write point set and cover corresponding pixel in corresponding written image.
It should be noted that the time span that camera records a frame video image is determined by the frame per second of camera,
For example the frame per second of camera is 30 frames/second, then, the time span that camera records a frame video image is 1/30 second；Or
Person, the frame per second of camera is 60 frames/second, then, the time span that camera records a frame video image is 1/60 second.
And in actual recording process, for normal writing speed, within the period of a frame written image,
Written contents in touch display screen do not have much changes, i.e. write in the time of a letter, numeral, Chinese character at least
Contain a frame written image.Therefore, during a letter is write, there may be multiframe written image, similarly, a word
The corresponding multiple pixel coordinates of mother, i.e., the corresponding different pixel of one letter.
Pass through the technical program, when user is carrying out content writing in touch display screen, the written contents in the first row
It is followed successively by that " P (C)=0.01=1% ", the written contents on the second row are followed successively by that " P (Pos | C)=0.9=90% ", then obtain
The first pixel coordinate be to be obtained when the P for starting to write the first row is alphabetical, similarly, by it is above-mentioned to writing point set into
The method of row scaling zooms in and out the handwriting trace of the first row and the second row, to obtain the writing of the handwriting trace after scaling
Point set, and the first row and the corresponding time shaft of the second row are write based on obtaining, and corresponded to based on writing the first row and the second row
The first pixel coordinate, by the first row and the second row it is corresponding writing point set cover corresponding pixel in corresponding written image
On point, so that the content of writing point set is correspondingly added in corresponding written image, i.e. when user is in touch display screen
When carrying out content writing, other contents in touch display screen are correspondingly presented on the hand of user, so as to watch in video
The learner of appearance can see the content in whole touch display screen, without blocking written contents because of the hand of user, influence
To the effect of user's explanation, and the learning efficiency of learner.
It is non-limiting as example, as shown in figure 5, when user carries out content writing (specific book in touch display screen
The lettering pen that can be finger or corresponding touch detection scheme is write, is lettering pen in Fig. 5) when, the writing point of its written contents
Collection profit is acquired with the aforedescribed process, and is merged into written image, i.e. the content for being write the first row user：“P(C)
The writing point set of the contents such as=0.01=1% " is covered in the pixel of the written image corresponding to it, so that user exists
Carry out the second row content：" during the writing of P (Pos | C)=0.9=90% ", " P (C)=0.01=1% " is equal for the content of the first row
Shown in written image, i.e. written contents on the hand of user, so as to avoid viewing video learner because with
The hand at family is blocked, and can't see the content write in touch display screen, and then improves user and content is explained
Effect, and viewing video learner learning efficiency.
Similarly, due to the writing style of different user, user may be caused during written contents, its book
The content write is blocked by the hand of user itself, be will also result in user when explaining content, is watched the effect of the learner of video
It is bad, equally handwriting trace can be also merged into written image using the above method, to improve the explanation effect of user and
The learning efficiency of habit person.
The technical solution of the present embodiment, is shown by what the camera read towards touch display screen photographed comprising touch
Shield the initial pictures of region；Image recognition is carried out to initial pictures and extracts the initial of the touch display screen region
Written image；Distortion correction is carried out to initial written image to obtain and the corresponding writing figure of the display shape of touch display screen
Picture；The handwriting trace produced in acquisition camera shooting process in touch display screen, and the collection moment of handwriting trace is mapped
To the time shaft of written image；According to the proportionate relationship of the size of written image and the size of touch display screen to handwriting trace into
The scaling of row equal proportion；Obtain the writing point set of the handwriting trace after the first pixel coordinate of written image, and scaling；It is based on
Time shaft confirms the corresponding at least frame written image of handwriting trace, and it is corresponding to write point set covering based on the first pixel coordinate
The technological means of corresponding pixel, solves during video teaching in written image, and written contents are by the hand institute of user
The problem of blocking, improves the effect that user explains content, and the learning efficiency of the learner of viewing video.
Embodiment three
Fig. 6 is a kind of structure diagram for video process apparatus that the embodiment of the present invention three provides.The present embodiment is applicable
In being recorded to video or the situation of remote teaching, the device can be realized by the way of software and/or hardware, such as
Shown in Fig. 6, which specifically includes：Obtain written image module 310, collection handwriting trace module 320 and addition
Handwriting trace module 330.
Wherein, written image module 310 is obtained, for the video data photographed from the camera towards touch display screen
The middle written image obtained corresponding to touch display screen region；
Gather handwriting trace module 320, the writing rail produced in touch display screen in acquisition camera shooting process
Mark, and the collection moment of handwriting trace is mapped to the time shaft of written image；
Handwriting trace module 330 is added, for the relative position based on time shaft and handwriting trace in touch display screen
Handwriting trace is added to written image.
The technical solution of the present embodiment, by being obtained from the video data that the camera towards touch display screen photographs
Corresponding to the written image of touch display screen region；The writing produced in acquisition camera shooting process in touch display screen
Track, and the collection moment of handwriting trace is mapped to the time shaft of written image；Touched based on time shaft and handwriting trace
Handwriting trace is added to the technological means of written image by the relative position in display screen, is solved during video teaching,
The problem of written contents are blocked by hand, improves the effect of the notice of the efficiency and student of video teaching in learning process
Fruit.
Further, written image module 310 is obtained, including：
Initial pictures unit 311 is read, the camera for reading towards touch display screen photographs aobvious comprising touching
The initial pictures of display screen region；
Initial written elementary area 312 is extracted, touch display screen institute is extracted for carrying out image recognition to initial pictures
Initial written image in region；
Written image unit 313 is obtained, is obtained and touch display screen for carrying out distortion correction to initial written image
Show the corresponding written image of shape.
Further, handwriting trace module 330 is added, including：
Handwriting trace unit 331 is scaled, is closed for the ratio of the size according to written image and the size of touch display screen
It is the scaling that equal proportion is carried out to handwriting trace；
Acquiring unit 332, for obtaining the first pixel coordinate of written image, and the writing of the handwriting trace after scaling
Point set；
Capping unit 333, for confirming the corresponding at least frame written image of handwriting trace based on time shaft, based on first
Pixel coordinate will write point set and cover corresponding pixel in corresponding written image.
Further, the video process apparatus, further includes：Video data module 340 is generated, for synchronous based on time shaft
Carry out audio collection and obtain voice data, voice data is associated to generation video data with written image.
Above-mentioned video process apparatus can perform the method for processing video frequency that any embodiment of the present invention is provided, and possess the side of execution
The corresponding function module of method and beneficial effect.
Example IV
Fig. 7 is a kind of structure diagram for terminal device that the embodiment of the present invention four provides.Fig. 7 shows real suitable for being used for
The block diagram of the exemplary computer device 412 of existing embodiment of the present invention.The computer equipment 412 that Fig. 7 is shown is only one
Example, should not bring any restrictions to the function and use scope of the embodiment of the present invention.
As shown in fig. 7, computer equipment 412 is showed in the form of universal computing device.The component of computer equipment 412 can
To include but not limited to：One or more processor or processing unit 416, system storage 428, connects different system group
The bus 418 of part (including system storage 428 and processing unit 416).
Bus 418 represents the one or more in a few class bus structures, including memory bus or Memory Controller,
Peripheral bus, graphics acceleration port, processor or the local bus using any bus structures in a variety of bus structures.Lift
For example, these architectures include but not limited to industry standard architecture (ISA) bus, microchannel architecture (MAC)
Bus, enhanced isa bus, Video Electronics Standards Association (VESA) local bus and periphery component interconnection (PCI) bus.
Computer equipment 412 typically comprises various computing systems computer-readable recording medium.These media can be it is any can
The usable medium accessed by computer equipment 412, including volatile and non-volatile medium, moveable and immovable Jie
Matter.
System storage 428 can include the computer system readable media of form of volatile memory, such as deposit at random
Access to memory (RAM) 430 and/or cache memory 432.Computer equipment 412 may further include it is other it is removable/
Immovable, volatile/non-volatile computer system storage medium.Only as an example, storage system 434 can be used for reading
Write immovable, non-volatile magnetic media (Fig. 7 is not shown, is commonly referred to as " hard disk drive ").Although not shown in Fig. 7,
It can provide for the disc driver to moving non-volatile magnetic disk (such as " floppy disk ") read-write, and to removable non-easy
The CD drive of the property lost CD (such as CD-ROM, DVD-ROM or other optical mediums) read-write.In these cases, each
Driver can be connected by one or more data media interfaces with bus 418.System storage 428 can be included at least
One program product, the program product have one group of (for example, at least one) program module, these program modules are configured to hold
The function of row various embodiments of the present invention.
Program/utility 440 with one group of (at least one) program module 442, can be stored in such as system and deposit
In reservoir 428, such program module 442 include --- but being not limited to --- operating system, one or more application program,
Other program modules and routine data, may include the reality of network environment in each or certain combination in these examples
It is existing.Program module 442 usually performs function and/or method in embodiment described in the invention.
Computer equipment 412 can also be with one or more external equipments 414 (such as keyboard, sensing equipment, display
424 etc.) communicate, the equipment communication interacted with the computer equipment 412 can be also enabled a user to one or more, and/or
(such as network interface card is adjusted with enabling any equipment that the computer equipment 412 communicates with one or more of the other computing device
Modulator-demodulator etc.) communication.This communication can be carried out by input/output (I/O) interface 422.Also, computer equipment
412 can also by network adapter 420 and one or more network (such as LAN (LAN), wide area network (WAN) and/or
Public network, such as internet) communication.As shown in the figure, network adapter 420 passes through its of bus 418 and computer equipment 412
Its module communicates.It should be understood that although not shown in the drawings, can combine computer equipment 412 uses other hardware and/or software
Module, includes but not limited to：Microcode, device driver, redundant processing unit, external disk drive array, RAID system, magnetic
Tape drive and data backup storage system etc..
Processing unit 416 is stored in program in system storage 428 by operation, thus perform various functions using with
And data processing, such as realize the method for processing video frequency that the embodiment of the present invention is provided：
Obtained in the video data photographed from the camera towards touch display screen and correspond to touch display screen location
The written image in domain；
The handwriting trace produced in acquisition camera shooting process in touch display screen, and by the collection moment of handwriting trace
It is mapped to the time shaft of written image；
Handwriting trace is added to written image by the relative position based on time shaft and handwriting trace in touch display screen.
Further, obtain to correspond to from the video data that the camera towards touch display screen photographs and touch display
Shield the written image of region, including：
Read the initial pictures for including touch display screen region photographed towards the camera of touch display screen；
Initial pictures are carried out with the initial written image that image recognition extracts touch display screen region；
Distortion correction acquisition and the corresponding written image of display shape of touch display screen are carried out to initial written image.
Further, handwriting trace is added to by the relative position based on time shaft and handwriting trace in touch display screen
Written image, including：
Equal proportion is carried out to handwriting trace according to the proportionate relationship of the size of written image and the size of touch display screen
Scaling；
Obtain the writing point set of the handwriting trace after the first pixel coordinate of written image, and scaling；
The corresponding at least frame written image of handwriting trace is confirmed based on time shaft, will be write a little based on the first pixel coordinate
Collection covers corresponding pixel in corresponding written image.
Further, method for processing video frequency further includes：
Audio collection is synchronously carried out based on time shaft and obtains voice data, voice data is associated into generation with written image and is regarded
Frequency evidence.
Embodiment five
The embodiment of the present invention five additionally provides a kind of computer-readable recording medium, is stored thereon with computer program, should
The method for processing video frequency provided such as all inventive embodiments of the application is provided when program is executed by processor：
Obtained in the video data photographed from the camera towards touch display screen and correspond to touch display screen location
The written image in domain；
The handwriting trace produced in acquisition camera shooting process in touch display screen, and by the collection moment of handwriting trace
It is mapped to the time shaft of written image；
Handwriting trace is added to written image by the relative position based on time shaft and handwriting trace in touch display screen.
The computer-readable storage medium of the embodiment of the present invention, can use any of one or more computer-readable media
Combination.Computer-readable medium can be computer-readable signal media or computer-readable recording medium.It is computer-readable
Storage medium for example can be system, device or the device of -- but being not limited to -- electricity, magnetic, optical, electromagnetic, infrared ray or semiconductor,
Or any combination above.The more specifically example (non exhaustive list) of computer-readable recording medium includes：With one
The electrical connection of a or multiple conducting wires, portable computer diskette, hard disk, random access memory (RAM), read-only storage
(ROM), erasable programmable read only memory (EPROM or flash memory), optical fiber, portable compact disc read-only storage (CD-
ROM), light storage device, magnetic memory device or above-mentioned any appropriate combination.In this document, computer-readable storage
Medium can be any includes or the tangible medium of storage program, the program can be commanded execution system, device or device
Using or it is in connection.
Computer-readable signal media can include in a base band or as carrier wave a part propagation data-signal,
Wherein carry computer-readable program code.The data-signal of this propagation can take various forms, including but unlimited
In electromagnetic signal, optical signal or above-mentioned any appropriate combination.Computer-readable signal media can also be that computer can
Any computer-readable medium beyond storage medium is read, which, which can send, propagates or transmit, is used for
By instruction execution system, device either device use or program in connection.
The program code included on computer-readable medium can be transmitted with any appropriate medium, including --- but it is unlimited
In wireless, electric wire, optical cable, RF etc., or above-mentioned any appropriate combination.
It can be write with one or more programming languages or its combination for performing the computer that operates of the present invention
Program code, described program design language include object oriented program language-such as Java, Smalltalk, C++,
Further include conventional procedural programming language-such as " C " language or similar programming language.Program code can be with
Fully perform, partly perform on the user computer on the user computer, the software kit independent as one performs, portion
Divide and partly perform or performed completely on remote computer or server on the remote computer on the user computer.
Be related in the situation of remote computer, remote computer can pass through the network of any kind --- including LAN (LAN) or
Wide area network (WAN)-be connected to subscriber computer, or, it may be connected to outer computer (such as carried using Internet service
Pass through Internet connection for business).
Note that it above are only presently preferred embodiments of the present invention and institute's application technology principle.It will be appreciated by those skilled in the art that
The invention is not restricted to specific embodiment described here, can carry out for a person skilled in the art various obvious changes,
Readjust and substitute without departing from protection scope of the present invention.Therefore, although being carried out by above example to the present invention
It is described in further detail, but the present invention is not limited only to above example, without departing from the inventive concept, also
It can include other more equivalent embodiments, and the scope of the present invention is determined by scope of the appended claims.
Claims (10)
- A kind of 1. method for processing video frequency, it is characterised in that including：Obtained in the video data photographed from the camera towards touch display screen and correspond to the touch display screen location The written image in domain；Gather the handwriting trace produced in the camera shooting process in touch display screen, and by the collection of the handwriting trace Moment is mapped to the time shaft of the written image；Relative position based on the time shaft and the handwriting trace in the touch display screen adds the handwriting trace It is added to the written image.
- 2. according to the method described in claim 1, it is characterized in that, described photograph from the camera towards touch display screen The written image corresponding to the touch display screen region is obtained in video data, including：Read the initial pictures for including touch display screen region photographed towards the camera of touch display screen；The initial pictures are carried out with the initial written image that image recognition extracts the touch display screen region；Distortion correction acquisition and the corresponding writing of display shape of the touch display screen are carried out to the initial written image Image.
- 3. according to the method described in claim 1, it is characterized in that, the time shaft and the handwriting trace of being based on is in institute The handwriting trace is added to the written image by the relative position stated in touch display screen, including：The handwriting trace is carried out according to the proportionate relationship of the size of the written image and the size of the touch display screen The scaling of equal proportion；Obtain the writing point set of the handwriting trace after the first pixel coordinate of the written image, and scaling；The corresponding at least frame written image of the handwriting trace is confirmed based on the time shaft, based on first pixel coordinate The writing point set is covered into corresponding pixel in corresponding written image.
- 4. according to the method described in claim 1, it is characterized in that, the method further includes：Audio collection is synchronously carried out based on the time shaft and obtains voice data, the voice data and the written image are closed Connection generation video data.
- 5. according to the method described in claim 1, it is characterized in that, the camera be installed on the touch display screen just on Side.
- A kind of 6. video process apparatus, it is characterised in that including：Written image module is obtained, is corresponded to for being obtained from the video data that the camera towards touch display screen photographs The written image of the touch display screen region；Handwriting trace module is gathered, for gathering the handwriting trace produced in the camera shooting process in touch display screen, And be mapped to the time shaft of the written image collection moment of the handwriting trace；Handwriting trace module is added, for opposite in the touch display screen based on the time shaft and the handwriting trace The handwriting trace is added to the written image by position.
- 7. device according to claim 6, it is characterised in that the acquisition written image module, including：Initial pictures unit is read, what the camera for reading towards touch display screen photographed includes touch display screen place The initial pictures in region；Initial written elementary area is extracted, the touch display screen institute is extracted for carrying out image recognition to the initial pictures Initial written image in region；Written image unit is obtained, is obtained and the touch display screen for carrying out distortion correction to the initial written image Show the corresponding written image of shape.
- 8. device according to claim 6, it is characterised in that the addition handwriting trace module, including：Handwriting trace unit is scaled, is closed for the ratio of the size according to the written image and the size of the touch display screen It is the scaling that equal proportion is carried out to the handwriting trace；Acquiring unit, for obtaining the first pixel coordinate of the written image, and the writing point of the handwriting trace after scaling Collection；Capping unit, for confirming the corresponding at least frame written image of the handwriting trace based on the time shaft, based on institute State the first pixel coordinate and the writing point set is covered into corresponding pixel in corresponding written image.
- 9. a kind of terminal device, it is characterised in that the equipment includes：One or more processors；Memory, for storing one or more programs；When one or more of programs are performed by one or more of processors so that one or more of processors are real The now method for processing video frequency as described in any in claim 1~6.
- 10. a kind of computer-readable recording medium, is stored thereon with computer program, it is characterised in that the program is by processor The method for processing video frequency as described in any in claim 1~6 is realized during execution.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711103557.8A CN107909022B (en) | 2017-11-10 | 2017-11-10 | Video processing method and device, terminal equipment and storage medium |
| PCT/CN2017/116748 WO2019090903A1 (en) | 2017-11-10 | 2017-12-17 | Video processing method and apparatus, terminal device, and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711103557.8A CN107909022B (en) | 2017-11-10 | 2017-11-10 | Video processing method and device, terminal equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107909022A true CN107909022A (en) | 2018-04-13 |
| CN107909022B CN107909022B (en) | 2020-06-16 |
Family
ID=61844613
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711103557.8A Active CN107909022B (en) | 2017-11-10 | 2017-11-10 | Video processing method and device, terminal equipment and storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN107909022B (en) |
| WO (1) | WO2019090903A1 (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109905733A (en) * | 2019-01-21 | 2019-06-18 | 侯力宇 | A kind of novel video purchase system |
| CN110708502A (en) * | 2018-07-10 | 2020-01-17 | 富士施乐株式会社 | System, method, and medium for automatically detecting and inserting digital streams into 360 degree video |
| CN112580574A (en) * | 2020-12-28 | 2021-03-30 | 北京翰立教育科技有限公司 | Intelligent learning method and device based on handwritten character recognition |
| CN112770160A (en) * | 2020-12-24 | 2021-05-07 | 沈阳麟龙科技股份有限公司 | Stock analysis video creation system and method |
| CN113014846A (en) * | 2019-12-19 | 2021-06-22 | 华为技术有限公司 | Video acquisition control method, electronic equipment and computer readable storage medium |
| CN113168675A (en) * | 2018-12-17 | 2021-07-23 | 索尼集团公司 | Image processing apparatus, image processing method, and image processing program |
| CN113554904A (en) * | 2021-07-12 | 2021-10-26 | 江苏欧帝电子科技有限公司 | Intelligent processing method and system for multi-mode collaborative education |
| CN114120337A (en) * | 2021-10-15 | 2022-03-01 | 华南理工大学 | Real-time paper handwriting recovery method, system, equipment and storage medium |
| CN116844166A (en) * | 2023-08-24 | 2023-10-03 | 青岛罗博数码科技有限公司 | Video positioning device and method based on learning behavior |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114527922A (en) * | 2022-01-13 | 2022-05-24 | 珠海视熙科技有限公司 | Method for realizing touch control based on screen identification and screen control equipment |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100693343B1 (en) * | 2005-12-29 | 2007-03-12 | 이코리아시스템 (주) | A cyber eletronic-board |
| CN101105895A (en) * | 2007-08-10 | 2008-01-16 | 上海迈辉信息技术有限公司 | Audio and video frequency multi-stream combination teaching training system and realization method |
| CN101436353A (en) * | 2007-11-16 | 2009-05-20 | 北京新学堂网络科技有限公司 | Preparation method for remote schoolteaching video simulating true teaching room schoolteaching effect |
| CN102929387A (en) * | 2012-09-25 | 2013-02-13 | 长安大学 | Man-machine interaction method and man-machine interaction system based on common paper and pen |
| CN103945160A (en) * | 2014-02-27 | 2014-07-23 | 广州视睿电子科技有限公司 | Method and device for realizing remote video conversation in Android system |
| CN104575137A (en) * | 2015-01-19 | 2015-04-29 | 肖龙英 | Split-type scene interaction multimedia intelligent terminal |
| CN104575120A (en) * | 2015-01-09 | 2015-04-29 | 代四广 | Display system for aided teaching |
| CN105120195A (en) * | 2015-09-18 | 2015-12-02 | 谷鸿林 | Content recording and reproducing system and method |
| CN105451065A (en) * | 2014-08-26 | 2016-03-30 | 天脉聚源（北京）教育科技有限公司 | Simultaneous recording method for a variety of media |
| CN105513438A (en) * | 2016-01-21 | 2016-04-20 | 郑尚勤 | Teaching demonstration instrument |
| CN105635783A (en) * | 2015-12-31 | 2016-06-01 | 田雪松 | Manufacturing method for multimedia file |
| CN106970681A (en) * | 2017-02-21 | 2017-07-21 | 广州视源电子科技股份有限公司 | Write display methods and its system |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103177611A (en) * | 2011-12-23 | 2013-06-26 | 李云峰 | Method for realizing multimedia courseware on E-ink book |
| CN102903265A (en) * | 2012-09-19 | 2013-01-30 | 河南智游网络技术有限公司 | Method for automatically recording classroom teaching |
-
2017
- 2017-11-10 CN CN201711103557.8A patent/CN107909022B/en active Active
- 2017-12-17 WO PCT/CN2017/116748 patent/WO2019090903A1/en active Application Filing
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100693343B1 (en) * | 2005-12-29 | 2007-03-12 | 이코리아시스템 (주) | A cyber eletronic-board |
| CN101105895A (en) * | 2007-08-10 | 2008-01-16 | 上海迈辉信息技术有限公司 | Audio and video frequency multi-stream combination teaching training system and realization method |
| CN101436353A (en) * | 2007-11-16 | 2009-05-20 | 北京新学堂网络科技有限公司 | Preparation method for remote schoolteaching video simulating true teaching room schoolteaching effect |
| CN102929387A (en) * | 2012-09-25 | 2013-02-13 | 长安大学 | Man-machine interaction method and man-machine interaction system based on common paper and pen |
| CN103945160A (en) * | 2014-02-27 | 2014-07-23 | 广州视睿电子科技有限公司 | Method and device for realizing remote video conversation in Android system |
| CN105451065A (en) * | 2014-08-26 | 2016-03-30 | 天脉聚源（北京）教育科技有限公司 | Simultaneous recording method for a variety of media |
| CN104575120A (en) * | 2015-01-09 | 2015-04-29 | 代四广 | Display system for aided teaching |
| CN104575137A (en) * | 2015-01-19 | 2015-04-29 | 肖龙英 | Split-type scene interaction multimedia intelligent terminal |
| CN105120195A (en) * | 2015-09-18 | 2015-12-02 | 谷鸿林 | Content recording and reproducing system and method |
| CN105635783A (en) * | 2015-12-31 | 2016-06-01 | 田雪松 | Manufacturing method for multimedia file |
| CN105513438A (en) * | 2016-01-21 | 2016-04-20 | 郑尚勤 | Teaching demonstration instrument |
| CN106970681A (en) * | 2017-02-21 | 2017-07-21 | 广州视源电子科技股份有限公司 | Write display methods and its system |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110708502A (en) * | 2018-07-10 | 2020-01-17 | 富士施乐株式会社 | System, method, and medium for automatically detecting and inserting digital streams into 360 degree video |
| CN113168675A (en) * | 2018-12-17 | 2021-07-23 | 索尼集团公司 | Image processing apparatus, image processing method, and image processing program |
| CN113168675B (en) * | 2018-12-17 | 2023-12-05 | 索尼集团公司 | Image processing device, image processing method, and image processing program |
| CN109905733A (en) * | 2019-01-21 | 2019-06-18 | 侯力宇 | A kind of novel video purchase system |
| CN113014846A (en) * | 2019-12-19 | 2021-06-22 | 华为技术有限公司 | Video acquisition control method, electronic equipment and computer readable storage medium |
| CN112770160A (en) * | 2020-12-24 | 2021-05-07 | 沈阳麟龙科技股份有限公司 | Stock analysis video creation system and method |
| CN112580574A (en) * | 2020-12-28 | 2021-03-30 | 北京翰立教育科技有限公司 | Intelligent learning method and device based on handwritten character recognition |
| CN113554904A (en) * | 2021-07-12 | 2021-10-26 | 江苏欧帝电子科技有限公司 | Intelligent processing method and system for multi-mode collaborative education |
| CN114120337A (en) * | 2021-10-15 | 2022-03-01 | 华南理工大学 | Real-time paper handwriting recovery method, system, equipment and storage medium |
| CN114120337B (en) * | 2021-10-15 | 2024-04-09 | 华南理工大学 | Method, system, device and storage medium for recovering paper writing in real time |
| CN116844166A (en) * | 2023-08-24 | 2023-10-03 | 青岛罗博数码科技有限公司 | Video positioning device and method based on learning behavior |
| CN116844166B (en) * | 2023-08-24 | 2023-11-24 | 青岛罗博数码科技有限公司 | Video positioning device and method based on learning behavior |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2019090903A1 (en) | 2019-05-16 |
| CN107909022B (en) | 2020-06-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107909022A (en) | A kind of method for processing video frequency, device, terminal device and storage medium | |
| US11849196B2 (en) | Automatic data extraction and conversion of video/images/sound information from a slide presentation into an editable notetaking resource with optional overlay of the presenter | |
| US20210056251A1 (en) | Automatic Data Extraction and Conversion of Video/Images/Sound Information from a Board-Presented Lecture into an Editable Notetaking Resource | |
| Karambakhsh et al. | Deep gesture interaction for augmented anatomy learning | |
| CN110321054B (en) | Writing brush handwriting drawing method, device, equipment and readable storage medium | |
| CN112733795B (en) | Method, device and equipment for correcting sight of face image and storage medium | |
| Lee et al. | Robust handwriting extraction and lecture video summarization | |
| CN105930464B (en) | Web rich media cross-screen adaptation method and device | |
| TWI794905B (en) | Method and apparatus for controlling video frame image in live classroom | |
| CN111639527A (en) | English handwritten text recognition method and device, electronic equipment and storage medium | |
| CN111325853B (en) | Remote coaching system and method based on augmented reality glasses | |
| US20180268864A1 (en) | Detecting and correcting whiteboard images while enabling the removal of the speaker | |
| CN111079588B (en) | Image processing method, device and storage medium | |
| CN113436222A (en) | Image processing method, image processing apparatus, electronic device, and storage medium | |
| WO2022218042A1 (en) | Video processing method and apparatus, and video player, electronic device and readable medium | |
| US20230353702A1 (en) | Processing device, system and method for board writing display | |
| WO2023130966A1 (en) | Image processing method, image processing apparatus, electronic device and storage medium | |
| CN110059576A (en) | Screening technique, device and the electronic equipment of picture | |
| CN112291445B (en) | Image processing method, device, equipment and storage medium | |
| CN116434253A (en) | Image processing method, device, equipment, storage medium and product | |
| CN116453131B (en) | Document image correction method, electronic device and storage medium | |
| US20240169625A1 (en) | Image display format conversion method | |
| CN116311520A (en) | Air handwriting man-machine interaction technology based on monocular camera | |
| TWI796108B (en) | Method and system for obtaining font trajectory | |
| CN111126105B (en) | Human body key point detection method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |