CN112068748A - Audio information processing method based on dot matrix - Google Patents

Audio information processing method based on dot matrix Download PDF

Info

Publication number
CN112068748A
CN112068748A CN202011275144.XA CN202011275144A CN112068748A CN 112068748 A CN112068748 A CN 112068748A CN 202011275144 A CN202011275144 A CN 202011275144A CN 112068748 A CN112068748 A CN 112068748A
Authority
CN
China
Prior art keywords
information
stroke
page
audio information
handwriting
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011275144.XA
Other languages
Chinese (zh)
Inventor
俞雷
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nanjing Zibohui Information Technology Co ltd
Original Assignee
Nanjing Zibohui Information Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanjing Zibohui Information Technology Co ltd filed Critical Nanjing Zibohui Information Technology Co ltd
Priority to CN202011275144.XA priority Critical patent/CN112068748A/en
Publication of CN112068748A publication Critical patent/CN112068748A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04817Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16Sound input; Sound output
    • G06F3/167Audio in a user interface, e.g. using voice commands for navigating, audio feedback

Abstract

The invention relates to an audio information processing method based on a dot matrix, which comprises the following steps: acquiring handwriting information sent by a writing acquisition device; the handwriting information comprises each stroke, a generation time stamp of each stroke and position information of each stroke; acquiring audio information of a user sent by a writing acquisition device, wherein the audio information comprises a timestamp for acquiring the audio information; and synchronously displaying each stroke and the audio information according to the generation time stamp of each stroke and the time stamp of the acquired audio information and the position information of each stroke. Therefore, by applying the audio information processing method based on the dot matrix provided by the embodiment of the invention, the terminal can play the audio information according to the acquired time stamp of the audio information while displaying the written handwriting information. Therefore, the synchronization of the conference and the conversation is realized, and the user can more comprehensively and quickly know the content of the conference or the conversation, so that the user experience is improved.

Description

Audio information processing method based on dot matrix
Technical Field
The invention relates to the technical field of data processing, in particular to an audio information processing method based on a dot matrix.
Background
In the conversation interview process, often need record the conversation main points through the conversation record, the participant need record on the notebook fast, still need record sometimes, the participant generally can record through recording equipment, and is follow-up, and the matching that conversation main points and recording can not be fine is not known which conversation record corresponds the recording of which department, leads to user experience not high.
Disclosure of Invention
The invention aims to provide an audio information processing method based on a dot matrix, which aims to solve the problem that conversation content and recording cannot be well matched in the prior art.
In order to solve the above problem, the present invention provides a method for processing audio information based on a lattice, wherein the method comprises:
acquiring handwriting information sent by a writing acquisition device; the handwriting information comprises each stroke, a generation time stamp of each stroke and position information of each stroke;
acquiring audio information of a user sent by a writing acquisition device, wherein the audio information comprises a time stamp for acquiring the audio information;
and synchronously displaying each stroke and the audio information according to the generating time stamp of each stroke and the time stamp of the acquired audio information and the position information of each stroke.
In a possible implementation manner, before the obtaining of the audio information of the user sent by the writing acquisition device, the method further includes:
acquiring audio information of a user acquired after a recording key on the writing acquisition device is pressed; alternatively, the first and second electrodes may be,
and acquiring a dot matrix coordinate when the writing acquisition device clicks the notebook, comparing the dot matrix coordinate with the attribute value of the area, and starting the recording according to the attribute value of the target area when the dot matrix coordinate belongs to the target area.
In one possible implementation, the attribute values include a number, a position, a height, a width, a field name, and an extension.
In one possible implementation, the method further includes:
determining whether the writing acquisition device strides pages during writing according to the position information of each stroke;
when the page is not spanned, if a plurality of audio information recorded for a plurality of times exist, aligning the plurality of audio information with the generation time stamp of each stroke according to the time stamp of the audio information acquired by each recording so as to display the handwriting information and the plurality of audio information;
and when the page is crossed, displaying each stroke and the audio information according to the time stamp for acquiring the audio information.
In a possible implementation manner, before acquiring the handwriting information sent by the writing acquisition device, the method further includes:
and the writing acquisition device processes the handwriting information to obtain processed handwriting information.
In a possible implementation manner, the writing acquisition device processes the handwriting information, and obtaining the processed handwriting information specifically includes:
the writing acquisition device receives selection information, wherein the selection information comprises at least one of color selection information, stroke weight selection information, style selection information and position selection information;
and updating at least one of the color, the stroke thickness, the style and the position of the handwriting information according to the color selection information, the stroke thickness selection information, the style selection information and the position selection information.
In one possible implementation, the method further includes, after the step of:
processing the processed handwriting information corresponding to the page ID according to the processed handwriting information and the page ID of the dot matrix resource to obtain page information with multimedia information;
and displaying the page information with the multimedia information.
In one possible implementation, the method further includes, after the step of:
processing the page information to generate link information corresponding to the page information;
and sending the link information to a user terminal so that the user terminal displays the page information through the link information.
In one possible implementation, the method further includes, after the step of:
when the icon of the book has the configured input information bar, receiving the structured data input in the input information bar; associating the structured data with the attribute values of the icons;
and storing the associated structured data and attribute values.
In one possible implementation, the method further includes, after the step of:
receiving a search request message, wherein the search request message comprises words in the structured data;
determining corresponding attribute values according to words in the structured data;
determining a corresponding page ID according to the attribute value;
and displaying the page with the structured data according to the page ID.
By applying the audio information processing method based on the dot matrix provided by the embodiment of the invention, the terminal can play the audio information according to the acquired time stamp of the audio information while displaying the written handwriting information. Therefore, the synchronization of the conference and the conversation is realized, and the user can more comprehensively and quickly know the content of the conference or the conversation, so that the user experience is improved.
Drawings
Fig. 1 is a schematic flowchart of a method for processing audio information based on a lattice according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention clearer, the present invention will be described in further detail with reference to the accompanying drawings, and it is apparent that the described embodiments are only a part of the embodiments of the present invention, not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Fig. 1 is a schematic flowchart of a method for processing audio information based on a lattice according to an embodiment of the present invention. The application scene of the method is that the key points and the key points of the conversation content are recorded and the conversation is recorded at the same time. The execution main body of the application is equipment with an operation function, such as a terminal and a server, and the terminal is equipment with a calculation processing function, such as a computer and a mobile phone. As shown in fig. 1, the method comprises the steps of:
and step 110, acquiring handwriting information sent by the writing acquisition device.
The handwriting information comprises each stroke, a generation time stamp of each stroke and position information of each stroke.
The writing acquisition device writes on the notebook, which is a lattice notebook with lattice resource codes. Compared with the common notebook, the dot matrix notebook is laid with dot matrix pages. For a common paper document, a layer of dot matrix page formed by dot matrix is laid on the common paper document, the paper page has page numbers of the paper page, the dot matrix page has dot matrix page number ID, and the two have one-to-one correspondence. Thereby, a lattice book can be generated.
The writing acquisition device can be a dot matrix digital pen. The dot matrix digital pen is a dot matrix digital pen with a dot matrix identification function, which is called a digital pen for short, and a pressure sensor, a processor, a camera, a memory, a communication module and the like are arranged in the digital pen. Similarly, the coordinate unit output by the dot matrix digital pen is AU.
After the pressure sensor receives the pressure signal, the camera is started, the camera is a high-speed camera, the dot matrix through which the pen point passes can be photographed at the speed of about 100 sheets per second, the X and Y coordinate values of the pen point in the writing process are recorded, and the position coordinate of each pen point is obtained, so that the accurate acquisition of the handwriting is realized. The processor will record a time stamp of the pen tip movement, the writing sequence and writing speed of each stroke point. Meanwhile, a pressure sensor arranged in the dot matrix digital pen can record the pressing force of a pen point to obtain pressure-sensitive data, and the pressure-sensitive data can be converted into the weight and thickness of the written strokes to be displayed in the subsequent process. Namely: acquiring and recording the writing structure and the stroke accurate position of the Chinese character based on micron-sized X and Y coordinates; acquiring and recording stroke sequence and speed of Chinese character writing based on coordinate points of the timestamp; and acquiring and recording the weight and thickness of the Chinese character stroke writing based on the pen point pressure sensor to obtain pressure sensing data.
The data is sent to the server or the terminal through the data interface in two modes, one mode is real-time sending, a processor arranged in the dot matrix digital pen codes track information into a standard transmission data packet in real time, a Media Access Control (MAC) address of the dot matrix digital pen is added to a packet head of the standard transmission data packet, and then the data interface transmits the transmission data packet to the terminal in real time through a wired or wireless mode.
The other is non-real time transmission, the processor encodes the track information into a standard transmission data packet in real time, adds the MAC address of the dot matrix digital pen to the packet head of the data packet, then stores the packet head in a memory, and transmits the transmission data packet stored in the memory to the server or the terminal through a data interface at set time or when the writing acquisition device is connected with the server or the terminal or in other non-real time modes. The data interface is a wired data interface or a wireless data interface; the wired data interface is a Universal Serial Bus (USB) interface, a MiniUSB interface, a MicroUSB interface, a parallel port and a Serial port; the wireless data interface is a Bluetooth interface, an infrared interface, a Wifi interface, a 2.4-5.0GHz band interface or a wireless communication interface.
Specifically, the dot matrix digital pen writes on a book with dot matrix resource codes and obtains written writing information, and each dot matrix coordinate in the writing information has a timestamp. The book comprises two types, wherein one type is that a plurality of books have the same lattice resource code, and when the writing acquisition device sends the books in real time or off-line, the server needs to select the books so as to determine a target book from the plurality of books for synchronization. At this time, the server may determine the target book by selecting the state of the book, which has two states, by way of example and not limitation, a current valid state and a historical filing state, and sets the current valid state for the book that has been completed and no longer written, for example, G1 and G2, G1, G2 and G2 are the same, and G2 is the target book.
The other method is that a plurality of books have different lattice resource codes, each page of each book has different lattice resource codes, when the writing acquisition device writes on different pages, because the lattice resource codes of each page are different, the lattice coordinates of pen points in the writing information acquired by the writing acquisition device are also different, and therefore different books can be determined through different lattice coordinates.
The following describes the lattice resource page of this document in detail.
The lattice resource page comprises a plurality of lattices, and the lattices are composed of a plurality of very fine points which are regularly arranged according to a special algorithm. The dot matrix is used for providing coordinate parameter information for the writing acquisition device, and the certificate-preserving writing acquisition device can accurately record written handwriting when writing.
An Anoto lattice principle is taken as an example, and the lattice principle is as follows: the size of the dot matrix resource page takes the upper left corner as the origin of coordinates, and the unit is AU, 1AU =0.3/8mm (millimeter), and for a standard A4PDF electronic auxiliary paper file (width =210mm, height =297mm), the size of the corresponding dot matrix resource page can be found as follows: width =210/0.3 × 8=5600AU, height =297/0.3 × 8=7920 AU. Every 6 × 6=36 dots, a minimum data unit is formed. The area was 1.8mm =3.24 square millimeters. 36 dots are distributed, each dot has a diameter of 0.050mm (50 μm) and a dot pitch of 0.300mm (300 μm), and each dot can have 4 different offset positions, up, down, left and right. There are 4 36 square arrangement modes for 36 points, namely 47 trillion arrangement modes, namely one dot matrix can represent any number between 0 and 47 trillion. The total area of 47 trillion 6X6 lattices covered almost the entire continental europe, and the absolute coordinates of any point did not overlap.
The page of the dot matrix resource has a page ID, the page ID of the dot matrix resource has a corresponding relation with the writing information, and the writing information can also include the page ID, so that after the terminal or the server obtains the writing information sent by the writing acquisition device, the terminal or the server can be positioned to the specific position of the specific page of the specific book according to the writing information. The page ID has two expressions of a character string type or a numerical type.
The character string type, such as 1536.323.0.90, is similar to the representation method of the IP address, and the number of each part represents that: region, bookshelf, book and page.
The value type, such as 168884986023936.
The two representations of the page IDs of the lattice resource can be converted into each other, and it should be noted that the page IDs of the lattice resource are not continuous values, and the number of the resource pages existing between the two page IDs needs to be determined by a specific function.
And step 120, acquiring the audio information of the user sent by the writing acquisition device, wherein the audio information comprises a time stamp for acquiring the audio information.
In one example, the writing acquisition device is provided with a driving software for recording, when a recording button on the writing acquisition device is started, the recording function can be started, and the writing acquisition device records a time stamp for starting the recording function.
In another example, some areas may be preset on the lattice resource page on this son, and the areas have attribute values, and the attribute values may include a number, a position x, a position y, a width w, a height h, an order 1, a field name, an extension, and the like.
The item number is a serial number of the region, for example, 6 regions are provided on the lattice page ID, and the number is sequentially numbered, and the number is associated with the page ID of the lattice resource, for example, the page ID of the lattice resource is izform-18122, the lattice page ID of the first region is izform-1812201, and the lattice page ID of the first region is obtained by expanding on the basis of the page ID of the lattice resource, that is, "01" is added after the page ID of the lattice resource, and the lattice page ID of the region "izform-1812201" is generated.
The position x and the position y can be embodied by lattice coordinates. The width w and the height h can be embodied by specific numerical values, so that the specific positions of the areas in the lattice resource page can be described by the position x, the position y, the width w and the height h.
The field name may be a name of the area, and the name may be set according to the use of the area, for example, but not limited to, for example, if a certain area is provided with recording start and stop selection information, the field name may be a recording key.
The expansion item may be an associated service, for example, if the area is provided with an icon, the expansion item may be the names of check boxes within the icon and the position coordinates of each check box. For example, recording start and stop selection information is set in a certain area, one check box in the recording start selection information may correspond to a recording start key, and another check box in the recording stop selection information may correspond to a recording stop key.
The attribute values may be stored in the form of a table in which the number, position x, position y, height h, width w, field name, extension, and the like are stored. The terminal can inquire according to the acquired handwriting information of the pen point, and determine whether the handwriting information of the pen point is in the attribute value by inquiring the relation between the handwriting information of the pen point and the position x, the position y, the width w and the height h in the attribute value. And when the handwriting information of the pen point is in the attribute value, starting recording, and recording the timestamp for starting recording, so that the conversation of the conversation participant can be recorded. It is understood that the recording process can be exited by the recording stop key.
And step 130, synchronously displaying each stroke and the audio information according to the generating time stamp of each stroke and the time stamp of the acquired audio information and the position information of each stroke.
Specifically, the handwriting information has a time stamp, the audio information also has a time stamp, and after the time stamps of the handwriting information and the audio information are aligned, the written handwriting information can be displayed on the terminal, and when a certain time stamp is coincident with the time stamp of the audio information, the audio information is played simultaneously.
When writing and the collection of handwriting information are carried out through the writing collection device, if recording of audio session information is required, selection information can be started through recording, recording is started, and recording is stopped through stopping the selection information.
Specifically, when the confirmation information of the recording start and stop selection information is the recording start, the audio session information of one or more users is acquired; the audio session information includes an audio session open timestamp; and displaying the handwriting information and simultaneously playing the audio conversation information according to the audio starting time stamp and the time stamp corresponding to the dot matrix coordinate of the pen point.
When the confirmation information corresponds to the icon for starting or stopping the audio information, the icon for starting or stopping the audio information corresponding to the confirmation information can be determined according to the dot matrix data when the confirmation information is confirmed, so that the function of starting the acquisition of the audio information of the writing acquisition device or the function of stopping the acquisition of the audio information of the writing acquisition device can be started.
Simultaneously, the audio information of collection can be given the terminal by writing collection system transmission to this audio information has the time stamp, thereby corresponds with the time stamp of writing collection system when writing, so that the terminal can be according to the time stamp, shows handwriting information and broadcast audio information.
It will be appreciated that there may be multiple associated audio information on a page of the dot matrix text, or that one audio information may correspond to multiple pages.
When there are a plurality of associated audio information on one page, each audio information has a time stamp, so that the audio information is displayed and played according to the time stamp of each audio information and the time stamp of the track information, and the playing of the audio information is performed according to the order of the time stamps.
When one piece of audio information is associated with a plurality of pages, namely, the pages are written across pages but the recording is not interrupted, when the audio information is played, page skipping and handwriting information are displayed again on the terminal by taking the time stamp of the audio information as the standard.
Further, the present application may further include: the writing acquisition device or the terminal can determine the area corresponding to the attribute value through modes such as a query table and the like according to the attribute value. The area may include two types of areas, the first being an area where control function key icons are defined, and the second being an area where a range of positions is customized. For the first area, the user-defined control function key icons include, but are not limited to, a handwriting color selection icon, a handwriting thickness switching icon, the recording start and stop icon, the collection icon, and the sharing icon, which are described previously. In each icon, at least one piece of selection information is corresponded, for example, two colors of red and black are selected under the handwriting color selection icon, each selectable color can be arranged in a color selection frame in the icon, when the color selection frame is clicked through a pen point of the writing acquisition device, confirmation information can be generated, and the confirmation information comprises dot matrix coordinates of the selected color, so that the color switching during the writing of the writing acquisition device is realized. Therefore, the terminal displays the handwriting information in the same color on the display interface of the terminal through the query table.
For the second type of zone, the zone may be associated with a multimedia file, such as an audio file, a video file, or an audio-visual file.
Specifically, when the area has an associated icon, corresponding function control may be performed according to the icon. When the icon has the configured selection information, receiving confirmation information of the writing acquisition device aiming at the selection information; processing the handwriting information according to the confirmation information; or starting or stopping the collection of the audio information according to the confirmation information.
The selection information comprises color selection information, handwriting thickness selection information, recording start and stop selection information, collection selection information and sharing selection information. Namely, whether the icon is a handwriting color selection icon, a handwriting thickness switching icon, a recording start and stop icon, a collection icon and a sharing icon is judged.
When writing the collection system and selecting on the icon, write the identifying information that the collection system can generate, this identifying information can include the dot matrix data when confirming, dot matrix data when will confirming and the attribute value of this icon carry out the comparison, thereby write the collection system and can confirm the concrete content that this identifying information corresponds, for example, the concrete colour that corresponds, concrete handwriting thickness, thereby according to the colour or the handwriting thickness that identifying information corresponds on the terminal, show handwriting information, thereby write the collection system and realized writing the selection of colour, the selection of handwriting thickness etc. of writing the content.
Further, the present application may further include: processing the page ID where the sharing selection information is located into link information according to the confirmation information of the sharing selection information; and sending the link information to the user terminal.
Specifically, when the confirmation information of the writing acquisition device corresponds to the sharing button, the terminal can generate link information for the handwriting information and/or the audio session information received before according to the time stamp when the sharing button is clicked, the handwriting information and/or the audio session information before the sharing button is clicked, and the link information is sent to user terminals of other users, so that the other users can display the content before the sharing button according to the time stamp of the handwriting information and the time stamp of the clicking information. The display here includes, but is not limited to, handwriting information and audio session information.
Further, the present application may further include: receiving structured data input at an input information bar when the icon has the configured input information bar; associating the structured data with the attribute values of the icons; and storing the associated structured data and attribute values.
Specifically, the area may be configured in a structured manner, for example, the year, month, day, and the like, several weather icons are selected, and a time option box and a weather option box may be configured on the icons. The writing acquisition device selects and inputs the time option frame and the weather option frame, for example, x years, x months and x days, the terminal judges whether the area has the icon according to the pen point lattice coordinate, and determines whether the area has the icon, and determines the structured data of the area, such as time data and weather data, by combining the attribute value of the area, so that the page structured data can be stored through the identification of the written structured data, further extended applications are provided, such as the query date and the query weather are page records in sunny days, and the like.
The extended application is further described below.
Since structured data consists of well-defined data types, which can be easily searched, the present application may further include:
firstly, receiving a search request message, wherein the search request message comprises words in structured data; secondly, determining corresponding attribute values according to words in the structured data; thirdly, determining a corresponding page ID according to the attribute value; and finally, displaying the page with the structured data according to the page ID. Therefore, searching can be carried out on the terminal, for example, all pages with sunny days are displayed when sunny days are input, and data statistics or retrieval is achieved.
By applying the audio information processing method based on the dot matrix provided by the embodiment of the invention, the terminal can play the audio information according to the acquired time stamp of the audio information while displaying the written handwriting information. Therefore, the synchronization of the conference and the conversation is realized, and the user can more comprehensively and quickly know the content of the conference or the conversation, so that the user experience is improved.
Those of skill would further appreciate that the various illustrative components and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied in hardware, a software module executed by a processor, or a combination of the two. A software module may reside in Random Access Memory (RAM), memory, Read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
The above embodiments are provided to further explain the objects, technical solutions and advantages of the present invention in detail, it should be understood that the above embodiments are merely exemplary embodiments of the present invention and are not intended to limit the scope of the present invention, and any modifications, equivalents, improvements and the like made within the spirit and principle of the present invention should be included in the scope of the present invention.

Claims (9)

1. A method for processing audio information based on a lattice, the method comprising:
acquiring handwriting information sent by a writing acquisition device; the handwriting information comprises each stroke, a generation time stamp of each stroke and position information of each stroke;
acquiring audio information of a user sent by a writing acquisition device, wherein the audio information comprises a time stamp for acquiring the audio information;
according to the time stamp for generating each stroke and the time stamp for acquiring the audio information, synchronously displaying each stroke and the audio information according to the position information of each stroke;
determining whether the writing acquisition device strides pages during writing according to the position information of each stroke;
when the page is not spanned, if a plurality of audio information recorded for a plurality of times exist, aligning the plurality of audio information with the generation time stamp of each stroke according to the time stamp of the audio information acquired by each recording so as to display the handwriting information and the plurality of audio information;
and when the page is crossed, displaying each stroke and the audio information according to the time stamp for acquiring the audio information.
2. The method of claim 1, wherein before obtaining the audio information of the user sent by the writing capture device, the method further comprises:
acquiring audio information of a user acquired after a recording key on the writing acquisition device is pressed; alternatively, the first and second electrodes may be,
and acquiring a dot matrix coordinate when the writing acquisition device clicks the notebook, comparing the dot matrix coordinate with the attribute value of the area, and starting the recording according to the attribute value of the target area when the dot matrix coordinate belongs to the target area.
3. The method of claim 2, wherein the attribute values include a number, a position, a height, a width, a field name, and an extension.
4. The method according to claim 1, wherein before obtaining the handwriting information sent by the writing acquisition device, the method further comprises:
and the writing acquisition device processes the handwriting information to obtain processed handwriting information.
5. The method according to claim 4, wherein the writing acquisition device processes the handwriting information, and obtaining the processed handwriting information specifically comprises:
the writing acquisition device receives selection information, wherein the selection information comprises at least one of color selection information, stroke weight selection information, style selection information and position selection information;
and updating at least one of the color, the stroke thickness, the style and the position of the handwriting information according to the color selection information, the stroke thickness selection information, the style selection information and the position selection information.
6. The method of claim 5, further comprising, after the method:
processing the processed handwriting information corresponding to the page ID according to the processed handwriting information and the page ID of the dot matrix resource to obtain page information with multimedia information;
and displaying the page information with the multimedia information.
7. The method of claim 6, further comprising, after the method:
processing the page information to generate link information corresponding to the page information;
and sending the link information to a user terminal so that the user terminal displays the page information through the link information.
8. The method of claim 1, further comprising, after the method:
when the icon of the book has the configured input information bar, receiving the structured data input in the input information bar; associating the structured data with the attribute values of the icons;
and storing the associated structured data and attribute values.
9. The method of claim 8, further comprising, after the method:
receiving a search request message, wherein the search request message comprises words in the structured data;
determining corresponding attribute values according to words in the structured data;
determining a corresponding page ID according to the attribute value;
and displaying the page with the structured data according to the page ID.
CN202011275144.XA 2020-11-16 2020-11-16 Audio information processing method based on dot matrix Pending CN112068748A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011275144.XA CN112068748A (en) 2020-11-16 2020-11-16 Audio information processing method based on dot matrix

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011275144.XA CN112068748A (en) 2020-11-16 2020-11-16 Audio information processing method based on dot matrix

Publications (1)

Publication Number Publication Date
CN112068748A true CN112068748A (en) 2020-12-11

Family

ID=73656009

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011275144.XA Pending CN112068748A (en) 2020-11-16 2020-11-16 Audio information processing method based on dot matrix

Country Status (1)

Country Link
CN (1) CN112068748A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116600176A (en) * 2023-06-15 2023-08-15 深圳市方直科技股份有限公司 Stroke order audio/video generation method and device, computer equipment and storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105677273A (en) * 2015-12-31 2016-06-15 田雪松 Lattice-based display method and system
CN108073913A (en) * 2018-01-05 2018-05-25 赵琳娜 The collecting method of handwriting data
CN111274836A (en) * 2020-01-19 2020-06-12 深圳市锦上科技有限公司 Handwriting board set and system
CN111309163A (en) * 2020-01-19 2020-06-19 深圳市锦上科技有限公司 Intelligent pen, using method thereof and handwriting suit system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105677273A (en) * 2015-12-31 2016-06-15 田雪松 Lattice-based display method and system
CN108073913A (en) * 2018-01-05 2018-05-25 赵琳娜 The collecting method of handwriting data
CN111274836A (en) * 2020-01-19 2020-06-12 深圳市锦上科技有限公司 Handwriting board set and system
CN111309163A (en) * 2020-01-19 2020-06-19 深圳市锦上科技有限公司 Intelligent pen, using method thereof and handwriting suit system

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116600176A (en) * 2023-06-15 2023-08-15 深圳市方直科技股份有限公司 Stroke order audio/video generation method and device, computer equipment and storage medium
CN116600176B (en) * 2023-06-15 2024-04-09 深圳市方直科技股份有限公司 Stroke order audio/video generation method and device, computer equipment and storage medium

Similar Documents

Publication Publication Date Title
CN112068747B (en) Processing method of dictation information
US7920159B2 (en) Electronic conference system, electronic conference controller, information terminal device, and electronic conference support method
CN110263041B (en) Single-interface display method and system of motion trail information
CN108712665B (en) Live broadcast list generation method and device, server and storage medium
US20150091940A1 (en) Image processing apparatus
US20050281437A1 (en) Talking paper
US20100153887A1 (en) Presentation system, data management apparatus, and computer-readable recording medium
CN106168870A (en) A kind of split screen window display method and terminal
CN110794984A (en) Note recording and storing method, device, terminal, storage medium and system
CN111273850B (en) Terminal control method and device, computer equipment and storage medium
CN108536638B (en) Intelligent bookmark setting method, mobile terminal, system and readable storage medium
JP4660537B2 (en) Information management system and document information management method
JP6485935B1 (en) Online communication review system, method, and computer program
CN110290413B (en) Multimedia data recording method, playing method and recording sharing system
CN105376419A (en) Method and equipment for performing telephone communication in electronic terminal
CN112069333B (en) Method for sharing handwriting writing content
US20070097098A1 (en) Terminal device, display system, display method, program, and recording medium
WO2017010469A1 (en) Handwriting device and voice/handwriting communication system
CN111352599A (en) Data processing method and device for remote whiteboard and electronic equipment
CN112068748A (en) Audio information processing method based on dot matrix
US6710791B1 (en) Portable information gathering apparatus and information management method
CN112099698B (en) Icon processing method for dot matrix page
CN110659006B (en) Cross-screen display method and device, electronic equipment and readable storage medium
CN101431550A (en) Information recording method, apparatus and mobile terminal
CN110910291A (en) Dot matrix paper pen technology application method combined with kannel or Dongda writing method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20201211