CN110929709B - Method and device for converting point-reading content into sketch finger-reading content based on OID - Google Patents

Method and device for converting point-reading content into sketch finger-reading content based on OID Download PDF

Info

Publication number
CN110929709B
CN110929709B CN201911021080.8A CN201911021080A CN110929709B CN 110929709 B CN110929709 B CN 110929709B CN 201911021080 A CN201911021080 A CN 201911021080A CN 110929709 B CN110929709 B CN 110929709B
Authority
CN
China
Prior art keywords
reading
oid
point
read
printed matter
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201911021080.8A
Other languages
Chinese (zh)
Other versions
CN110929709A (en
Inventor
贾志强
俞晓君
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Guangnian Infinite Technology Co ltd
Original Assignee
Beijing Guangnian Infinite Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Guangnian Infinite Technology Co ltd filed Critical Beijing Guangnian Infinite Technology Co ltd
Priority to CN201911021080.8A priority Critical patent/CN110929709B/en
Publication of CN110929709A publication Critical patent/CN110929709A/en
Application granted granted Critical
Publication of CN110929709B publication Critical patent/CN110929709B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • G06V10/22Image preprocessing by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • User Interface Of Digital Computer (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention provides a method for converting point reading content into sketch finger reading content based on OID, which comprises the following steps: reading resolution information of the OID point-reading printed matter, and importing point-reading data contained in the OID point-reading printed matter; establishing a position coordinate system corresponding to the OID point-reading printed matter based on the OID point-reading printed matter; determining the position information of the point reading identification area in the position coordinate system in the OID point reading printed matter, and converting the position information into a corresponding pixel coordinate position; and recording and deriving a pixel coordinate position corresponding to each page of point reading identification area in the OID point reading printed matter, and binding the pixel coordinate position with the point reading data to obtain a point reading hot area position in the OID point reading printed matter so as to complete the content conversion process. The invention can convert the content which can be read by using the OID point-reading pen into the content which can be read by finger reading on the basis of the existing OID point-reading printed matter, overcomes the defect that the OID coding space only has limited points, and can support finger reading for all books.

Description

Method and device for converting point-reading content into sketch finger-reading content based on OID
Technical Field
The invention relates to the field of artificial intelligence, in particular to a method and a device for converting point-reading content into point-reading content based on OID (object identification).
Background
With the continuous development of scientific technology, the OID touch reading technology has been developed greatly, and a plurality of children-specific OID touch reading prints are emerging in the market at present and are generally matched with a touch reading pen for use. When the point reading is carried out, the OID codes hidden in the printed matter can be identified through the point reading pen, and the point reading data corresponding to the OID codes are played.
However, the number of OID codes is limited, and currently, only 6 thousands of different codes greatly restrict the development of content richness, and the OID codes cannot be used for unique coding of all printed matters.
Therefore, the invention provides a method and a device for converting point-reading content into script-reading content based on OID.
Disclosure of Invention
In order to solve the above problems, the present invention provides a method for converting point-reading content into sketch-reading content based on OID, and the method comprises the following steps:
reading resolution information of the OID point-reading printed matter, and importing point-reading data contained in the OID point-reading printed matter;
establishing a position coordinate system corresponding to the OID point-reading printed matter based on the OID point-reading printed matter;
determining the position information of the point reading identification area in the OID point reading printed matter in the position coordinate system, and converting the position information into a corresponding pixel coordinate position;
and recording and deriving a pixel coordinate position corresponding to each page read-on identification area in the OID read-on printed matter, and binding the pixel coordinate position with the read-on data to obtain a read-on hot area position in the OID read-on printed matter so as to complete a content conversion process.
According to one embodiment of the invention, the reading data corresponds to reading identification areas in the OID reading printed matter one by one, wherein the reading data comprises voice data.
According to one embodiment of the invention, the boundaries of the OID point-reading prints are scanned and determined, and the position coordinate system comprising the x and y axes is established based on the boundaries of the OID point-reading prints.
According to one embodiment of the invention, a click-to-read identification area in the OID click-to-read printed matter is identified, and the identified click-to-read identification area is brought into the position coordinate system containing x and y axes to obtain the position information, wherein the position information contains vertex position coordinates of the click-to-read identification area.
According to one embodiment of the present invention, the pixel coordinate position corresponding to the vertex position coordinate is determined based on the resolution information.
According to one embodiment of the invention, when the finger of the user is read, the OID is scanned to read the printed matter, the reading hot zone position in the current page is read, and the reading data bound with the reading hot zone position is played.
According to an embodiment of the present invention, before performing the finger reading of the user, the method further comprises the following steps:
acquiring identity characteristic information of a current user, judging user attributes of the current user, and determining the category of the current user, wherein the category of the user comprises: children user
According to another aspect of the invention, there is also provided a program product containing a series of instructions for carrying out the steps of the method as claimed in any one of the above.
According to another aspect of the present invention, there is also provided a contents converting and finger reading apparatus for reading a printed matter based on OID point reading, the apparatus including:
a first module, configured to read resolution information of the OID click-to-read printed matter, and import click-to-read data included in the OID click-to-read printed matter;
a second module for establishing a position coordinate system corresponding to the OID point-reading printed matter based on the OID point-reading printed matter;
a third module, configured to determine location information of a point reading identification area in the position coordinate system in the OID point reading print, and convert the location information into a corresponding pixel coordinate location;
and the fourth module is used for recording and exporting the pixel coordinate position corresponding to each page read-on identification area in the OID read-on printed matter, and binding the pixel coordinate position with the read-on data to obtain the position of a read-on hot area in the OID read-on printed matter so as to finish the content conversion process.
According to another aspect of the present invention, there is also provided a child-specific smart device for supporting finger reading by a user based on the OID point-reading printings completing the content conversion process as described in any one of the above.
The method and the device for converting the OID point-reading content into the drawing book point-reading content can convert the content which can be read by using the OID point-reading pen into the content which can be read by a finger point-reading mode on the basis of the conventional OID point-reading printed matter, overcome the defect that an OID coding space only has a limited point, can be used for finger point-reading support for all books, reduce the cost of content manufacturing due to the use of the conventional OID point-reading printed matter, and can also support children to perform finger point-reading.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention and not to limit the invention. In the drawings:
FIG. 1 is a flow diagram illustrating a method for converting OID-based click-to-read content to copybook-to-read content according to an embodiment of the present invention;
FIG. 2 is a flow diagram illustrating a method for converting OID-based point-reading content into sketch finger-reading content according to another embodiment of the present invention;
fig. 3 is a block diagram illustrating a structure of an OID read-on-demand print-based content conversion and finger reading apparatus according to an embodiment of the present invention;
FIG. 4 shows a block diagram of a child-specific smart device, in accordance with one embodiment of the present invention;
FIG. 5 is a finger-reading diagram illustrating a method for converting OID-based point-reading content into sketch finger-reading content according to an embodiment of the present invention;
FIG. 6 is a schematic diagram of three-party communications among a user, a child-specific smart device, and a cloud according to one embodiment of the invention; and
fig. 7 shows a flowchart of a method for performing a finger reading operation according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, embodiments of the present invention are described in further detail below with reference to the accompanying drawings.
For clarity, the following description is required before the examples:
the intelligent equipment special for children supports multi-mode man-machine interaction, and has AI capabilities of natural language understanding, visual perception, language voice output, emotion expression action output and the like; the social attributes, personality attributes, character skills and the like can be configured, so that the user can enjoy intelligent and personalized smooth experience. In a specific embodiment, the intelligent device dedicated for children is specifically a drawing and reading accompanying intelligent device, which may be a drawing robot, a child (reading accompanying) watch, an intelligent tablet, and the like.
The children special intelligent device acquires multi-modal data (including a finger reading instruction) of a user, and performs semantic understanding, visual recognition, cognitive computation and emotion computation on the multi-modal data under the support of the cloud capability to complete a decision output process.
The cloud terminal is a terminal which provides processing capability of semantic understanding (language semantic understanding, action semantic understanding, visual recognition, emotion calculation and cognitive calculation) of interaction requirements (including finger reading intentions) of the children special intelligent device to the user, interaction with the user is achieved, and the children special intelligent device is made to output multi-mode data (including click reading data).
Various embodiments of the present invention will be described in detail below with reference to the accompanying drawings.
In the prior art, there are OID touch-reading printed matters for the OID touch-reading identification method, and when the OID touch-reading printed matters are printed, a touch-reading identification area needs to be hidden and printed under the content, and when a touch-reading pen is used for touch-reading, the touch-reading pen can identify the hidden and printed touch-reading identification area.
In actual use, the contents in the printed matter need to be read by the reading pen through or pointing to the OID, and when the reading pen points to the reading identification area, the reading pen can identify the reading data corresponding to the reading identification area one by one and then play the reading data.
However, limitations of the OID coding technique itself limit its further development. OID (Object Identifier, also called internet of things domain name), and the OID-Info system is responsible for providing global OID registration management, which is currently maintained by france telecom companies. Up to now, 643087 top-level OID identifiers are registered in an international OID database, and the international OID database relates to the fields of logistics, information security, RFID, 3GPP, biological identification, network management, medical imaging and the like. Corresponding research and development work of the OID analysis system is also smoothly carried out, a root analysis mechanism is maintained by korea, and analysis service functions such as OID root directory, OID (2.27.
It can be known that the OID coding space is only 6 ten thousand points, which is far from the unique coding for all books, and thus, one device cannot be used to read all books.
Fig. 1 is a flowchart illustrating a method for converting an OID-based click-to-read content into a sketch-to-read content according to an embodiment of the present invention.
As shown in fig. 1, in step S101, resolution information of the OID-read print is read, and read data included in the OID-read print is imported. Generally, the reading data corresponds to the reading identification area in the OID reading printed matter one by one, wherein the reading data includes voice data.
In one embodiment, the resolution information of the OID read-on-demand prints, which generally contain respective resolution information, may be represented by the number of horizontal pixels × the number of vertical pixels or the image size or image size.
Generally, the click-to-read data includes voice data, for example, the click-to-read data may be voice story data corresponding to a certain click-to-read identification area in a story book (tadpole mom voice data).
As shown in fig. 1, in step S102, a position coordinate system corresponding to the OID-read printed matter is established based on the OID-read printed matter. Specifically, the position coordinate system may be established by step S201 in fig. 2. In step S201, the boundary of the OID-read printed matter is scanned and determined, and a position coordinate system including x and y axes is established based on the boundary of the OID-read printed matter.
Generally, books in the market are all rectangular, specific positions in the books can be calibrated through the horizontal and vertical coordinate axes, and other position coordinate systems capable of calibrating the books can also be applied to the embodiment of the invention, which is not limited in this respect.
Specifically, the horizontal plane of the book may be taken as the x-axis, the vertical plane as the y-axis, and the bottom point of the book flipping axis as the midpoint. Thus, all positions in the book can be represented by position coordinates [ x, y ], x including [ - ∞, + ∞ ], and y including [0, + ∞ ].
As shown in fig. 1, in step S103, position information of the spot reading identification area in the position coordinate system in the OID spot reading printed matter is determined, and the position information is converted into a corresponding pixel coordinate position. Specifically, the reading identification area in the reading printed matter can be determined by the reading pen, and then the position information of the reading identification area in the coordinate system is calibrated.
In one embodiment, the position information may be converted into corresponding pixel coordinate positions through steps S202-S203 in fig. 2, and in step S202, a reading identification area in the OID reading printed matter is identified, and the identified reading identification area is brought into a coordinate position system including x and y axes to obtain the position information, where the position information includes vertex position coordinates of the reading identification area.
Specifically, the reading identification area is generally rectangular and has four vertices, and it is necessary to first identify the range of the reading identification area and then determine the position information of the four vertices of the reading identification area in the coordinate system, so as to complete the calibration of the reading identification area.
In step S203, the pixel coordinate position corresponding to the vertex position coordinate is determined based on the resolution information. In particular, the pixel information is an attribute of the OID itself, and it is necessary to convert the established coordinate system position information into pixel coordinate positions in order to be more reliable, accurate and rapid in the subsequent identification.
As shown in fig. 1, in step S104, the pixel coordinate position corresponding to the click-to-read identification area of each page in the OID click-to-read printed matter is recorded and derived, and the click-to-read hot area position in the OID click-to-read printed matter is obtained after the binding with the click-to-read data, so as to complete the content conversion process. In this step, the pixel coordinate position corresponding to the read-on identification area of the whole read-on printed matter needs to be recorded and bound with the read-on data, so as to complete the content conversion process.
After the content conversion process is completed, the printed matter (similar to books, drawing books and the like) can be read by pointing with fingers under the support of the intelligent equipment special for children, and the printed matter OID which can be read only by using a reading pen before reading. As shown in step S204 in fig. 2, when the finger of the user is pointed, the OID is scanned to read the printed matter, the reading hot zone position in the current page is read, and the reading data bound to the reading hot zone position is played.
In the invention, the intelligent equipment special for children is provided with image acquisition (scanning) equipment which can acquire image information under the current visual field. Particularly, the special intelligent equipment for children can be provided with a camera, after a user instructs to read by entering a finger, the current image information is collected through the camera, the current image information can be a storybook which the user is looking at, the user aims the camera at an area which the user wants to read by the finger, and the camera takes a picture (scans) of the storybook to obtain the image information.
Then, the image information is analyzed, the position of the click-to-read hot area is determined, click-to-read data matched with the position of the click-to-read hot area is requested from the cloud, and the click-to-read data is played through a special intelligent device for children (specifically, the special intelligent device for children displays the click-to-read data through a loudspeaker, a display screen and the like). In addition, the click-to-read data can also be stored in the intelligent device special for children or the local storage device, and the storage position of the click-to-read data can be adjusted according to the actual application condition, which is not limited by the invention.
According to one embodiment of the present invention, identity characteristic information of a current user is acquired, a user attribute of the current user is judged, and a category of the current user is determined, wherein the category of the user includes: a child user. The user group to which the invention is directed is mainly a child user, so the identity attribute of the user needs to be determined. There are many ways to determine the identity of a user, and generally, the identity of the user can be identified through a facial recognition function or a fingerprint recognition method. Other ways of determining the identity of the user may be applied to the present invention, and the present invention is not limited thereto.
The invention improves the defect of limited OID coding mode by converting the contents of point reading identification into the contents of finger reading, is unlimited in the support of point reading data, and can support the finger reading of all diagrams. In addition, conversion is performed on the basis of reading the content, so that the cost for making the content is saved.
Fig. 3 is a block diagram illustrating a structure of an OID read-by-point print-based content conversion and finger reading apparatus according to an embodiment of the present invention.
As shown in fig. 3, the apparatus comprises a first module 301, a second module 302, a third module 303 and a fourth module 304. The first module 301 includes a reading unit 3011 and an importing unit 3012. The second module 302 includes a boundary unit 3021 and a coordinate system unit 3022. The third module 303 comprises a determination unit 3031 and a conversion unit 3032. The fourth module 304 includes a recording unit 3041, a deriving unit 3042, and a binding unit 3043.
The first module 301 is configured to read resolution information of the OID click-to-read printed matter and import click-to-read data included in the OID click-to-read printed matter. The reading unit 3011 is configured to read resolution information of the OID dot-read printed matter. The import unit 3012 is configured to import point reading data included in the OID point reading print.
The second module 302 is configured to establish a position coordinate system corresponding to the OID touch-reading printed matter based on the OID touch-reading printed matter. Therein, border element 3021 is used to determine and frame the border of the OID click-through print. The coordinate system unit 3022 is configured to generate a coordinate system for reading the printed object with respect to the OID based on the determined boundary, and in one embodiment, the coordinate system may use a horizontal coordinate and a vertical coordinate including x and y axes.
The third module 303 is configured to determine position information of the spot reading identification area in the position coordinate system in the OID spot reading printed matter, and convert the position information into a corresponding pixel coordinate position. The determining unit 3031 is configured to determine the position information of the spot reading identification area in the position coordinate system in the OID spot reading print. The conversion unit 3032 is used to convert the position information into corresponding pixel coordinate positions.
The fourth module 304 is configured to record and derive a pixel coordinate position corresponding to each page of the reading identification area in the OID reading print, and bind the pixel coordinate position with the reading data to obtain a reading hot area position in the OID reading print, so as to complete a content conversion process. The recording unit 3041 is configured to record a pixel coordinate position corresponding to a touch identification area of each page in the OID touch printed matter. The deriving unit 3042 is configured to derive a pixel coordinate position corresponding to the click-to-read identification area of each page in the OID click-to-read printed matter recorded by the recording unit 3041. The binding unit 3043 is configured to bind the data exported by the exporting unit 3042 with the read-only data.
Fig. 4 shows a block diagram of a child-specific smart device in accordance with an embodiment of the invention. As shown in fig. 4, the child-specific smart device 400 includes a signal acquisition device 401, a display screen 402, a signal output device 403, and a central processor 404.
The smart device 400 for children includes a smart device supporting input/output modules such as vision, perception, and control, and can access the internet, for example, a robot, a watch for children (which can be read with the accompanying person), a smart tablet, and the like, and has a finger reading interaction function, and can receive a finger reading instruction input by a user and output point reading data on the smart device for children.
The special intelligent device for children 400 can comprise a client dedicated for the finger reading interaction process, the client can be loaded in an android system environment, and the special intelligent device for children can be an android system child watch with 4G or even 5G communication capacity.
The signal acquisition device 401 is used to acquire image information and instructions of a user. Examples of signal acquisition devices 401 include microphones, scanners, cameras, sensory devices for voice operation, such as with visible or invisible wavelengths of radiation, signals, environmental data, and so forth. Data of multiple modalities (including image information and instructions of a user) can be acquired through the above-mentioned input device. The multimodal data may include one or more of text, audio, visual, and perceptual data, and the invention is not limited thereto.
The display 402 may show the content pointed by the current user's finger (content contained in the book) and may also display the corresponding matching data (corresponding illustration when playing a story) when playing the content data.
The signal output device 403 is used to output audio data. The signal output device 403 may be a device capable of outputting audio data, such as a power amplifier and a speaker. The signal output device 403 may also be a device supporting other types of data, and the invention is not limited thereto.
The central processor 404 is used to process the data generated during the finger-read interaction. The Processor used may be a data Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic, discrete hardware components, etc. The general-purpose processor may be a microprocessor or the processor may be any conventional processor or the like, the processor being the control center of the terminal and various interfaces and lines connecting the various parts of the overall terminal.
The child-specific smart device 400 includes a memory, which mainly includes a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program (such as a sound playing function, an image playing function, etc.) required by at least one function, and the like; the storage data area may store data (such as audio data, browsing history, and the like) created according to the use of the child-specific smart device 400, and may also store click-to-read data corresponding to a click-to-read printed matter, and the like. In addition, the memory may include high speed random access memory, and may also include non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), at least one magnetic disk storage device, a Flash memory device, or other volatile solid state storage device.
In addition, the content conversion and reading system based on OID point-reading printed matter provided by the invention can also be matched with a program product, which comprises a series of instructions for executing the steps of the method for converting the content into the script reading content based on OID point-reading. The program product is capable of executing computer instructions comprising computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc.
The program product may include: any entity or device capable of carrying computer program code, recording medium, U.S. disk, removable hard disk, magnetic diskette, optical disk, computer Memory, read-Only Memory (ROM), random Access Memory (RAM), electrical carrier wave signal, telecommunications signal, software distribution medium, etc.
It should be noted that the program product may include content that is appropriately increased or decreased as required by legislation and patent practice in jurisdictions, for example, in some jurisdictions, the program product may not include electrical carrier signals and telecommunications signals in accordance with legislation and patent practice.
Fig. 5 is a finger reading diagram illustrating a method for converting an OID-based point reading content into a sketch finger reading content according to an embodiment of the present invention. Referring to fig. 5, a schematic diagram of a finger reading process of a user is shown, a child-specific smart device adopts a child-specific read-accompanying watch, and the OID reads printed matter 502 to form a storybook.
As shown in fig. 5, a user 501 may start a dedicated reading client in a smart device dedicated for children in a voice manner, start a finger reading process, at this time, the user may align a camera of a watch with a storybook, slide a finger on the storybook, acquire image data at a current viewing angle in real time by the watch, analyze whether the image data includes a reading hot area position in real time, and play reading data bound to the reading hot area position when the reading hot area position is identified. For example, the click-to-read data bound to the current click-to-read hot zone position is story "crow drinks water", at this time, the watch starts to play the crow water story through a loudspeaker, and the user can control pause and play of the story through a touchable virtual key on the watch. The process of playing the crow drinking story is as follows:
and (3) watch playing: one crow is thirst and is drunk in a low altitude with water searching. After a long time, a water bottle is found in a short distance, so that the water bottle is happy and is stably stopped at the water bottle mouth to prepare for drinking water quickly. However, water in the water bottle is too little, the bottle mouth is small, the bottle neck is long, and the mouth of the crow does not reach water at all. How can this be done?
And (4) watch playing: the crow thinks that, hit the water-jug and fall down, just can drink water. Thus, it is flung down from the air and violently hits the bottle. However, the water bottle is too heavy, the crow uses up the strength of the whole body, and the water bottle still has the thread.
(at this point, the user clicks the "pause" button, the watch pauses playing, and continues playing after the user clicks the "start" button.)
And (4) watch playing: under the same atmosphere, a piece of stone is held by the gripper from a different distance and is smashed down towards the water bottle. The water bottle is broken and then the user drinks water, the situation that stones are not biased is not thought, and the user can put the stones through the water bottle.
And (3) watch playing: after flying, the crow can see that the water bottle is not broken at all. The careful crow discovers that the stones sink into the bottom of the bottle, and the water in the stones seems to be higher than the original water.
( At this point the user clicks the "next" button, the watch prompts "determine play next? The user clicks the "no" button and the watch continues to play. )
And (4) watch playing: ' there is a process, and I can drink water. "WUYA" is very happy, and its "Wawa" is called to start moving. It holds a plurality of stones and throws them into the water bottle one by one. With the increase of stones, the water in the water bottle slowly rises up at a little by a little \8230, 8230
And (3) watch playing: finally, the water in the water bottle quickly rises to the bottle mouth, and the crow can drink the water. He stands at the mouth of the water bottle and drinks sweet and delicious water, so that the pain is fast and smooth in mind.
Fig. 6 shows a three-party communication diagram of a user, a child-specific smart device, and a cloud according to an embodiment of the invention.
In order to enable the child-specific smart device 400 to support the user 501 to perform finger reading, a communication connection needs to be established between the user 501, the child-specific smart device 400, and the cloud 601. The communication connection should be real-time and unobstructed to ensure that the interaction is not affected.
In order to complete the interaction, some conditions or preconditions need to be met. These conditions or preconditions include the presence of a client in the child-specific smart device 400 and the hardware facilities of the child-specific smart device 400 with vision, perception and control functions.
After the preliminary preparation is completed, the child-specific smart device 400 starts to interact with the user 501, and first, the child-specific smart device 400 receives a finger reading instruction input by the user 501.
The instruction may be voice data, visual data, tactile data, or may be a user pressing a physical button. The child-specific smart device 400 is configured with a corresponding device for receiving a finger reading command, and is configured to receive the finger reading command sent by the user 501. At this time, the child-specific smart device 400 and the user 501 are both parties of the communication, and the direction of data transfer is from the user 501 to the child-specific smart device 502.
Then, the child-dedicated smart device 400 scans the OID point-reading printings that have completed the content conversion process, and reads the point-reading data bound to the point-reading hot area position, that is, requests the cloud 601 for the bound content (point-reading data), where the point-reading data may be stored in the cloud 601 or in the child-dedicated smart device 400, and when the point-reading data is stored in the cloud 601, the child-dedicated smart device 400 needs to request the cloud 601 for the bound content of the point where the user's finger is located on the printings. The click-to-read data generally includes voice data, but may include other types of data. At this time, two parties for data transmission are the child-dedicated smart device 400 and the cloud 601, and the data transmission direction is from the child-dedicated smart device 400 to the cloud 601.
Cloud 601 then returns content data to child-specific smart device 400. The cloud 601 returns corresponding content data according to the request of the child-specific smart device 400. At this time, the cloud 601 and the child-specific smart device 400 are two parties of the communication, and the data is transmitted from the cloud 601 to the child-specific smart device 601.
The child-specific smart device 400 then returns the content data to the user 501, and in general the child-specific smart device 400 may play the voice data through a speaker.
Fig. 7 is a flowchart illustrating a read operation in a method for reading content based on OID point reading content converted into script read content according to an embodiment of the present invention.
As shown in fig. 7, in step S701, the child-dedicated smart device 400 issues a request to the cloud 601. Thereafter, in step S702, the child-dedicated smart device 400 is in a state of waiting for the cloud 601 to reply. During the waiting period, the child-specific smart device 400 times the time it takes to return data.
In step S703, if the returned response data is not obtained for a long time, for example, the predetermined time period is longer than 5S, the child-specific smart device 400 may choose to perform local reply, and generate local general response data. Then, in step S704, the local common response is output, and the voice playing device is called to perform voice playing.
In summary, the method and the device for converting the OID point-reading content into the sketch point-reading content provided by the invention can convert the content which can be read by using the OID point-reading pen into the content which can be read by using a finger point-reading mode on the basis of the existing OID point-reading printed matter, overcome the defect that the OID coding space only has limited points, and can support finger point-reading for all books.
It is to be understood that the disclosed embodiments of the invention are not limited to the particular structures, process steps, or materials disclosed herein but are extended to equivalents thereof as would be understood by those ordinarily skilled in the relevant arts. It is also to be understood that the terminology used herein is for the purpose of describing particular embodiments only, and is not intended to be limiting.
Reference in the specification to "one embodiment" or "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the invention. Thus, the appearances of the phrase "one embodiment" or "an embodiment" in various places throughout this specification are not necessarily all referring to the same embodiment.
Although the embodiments of the present invention have been described above, the above description is only for the convenience of understanding the present invention, and is not intended to limit the present invention. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.

Claims (10)

1. A method for converting point-reading content into script-pointing-reading content based on OID is characterized by comprising the following steps:
reading resolution information of an OID point-reading printed matter, and importing point-reading data contained in the OID point-reading printed matter;
establishing a position coordinate system corresponding to the OID point-reading printed matter based on the OID point-reading printed matter;
determining the position information of the point reading identification area in the OID point reading printed matter in the position coordinate system, and converting the position information into a corresponding pixel coordinate position;
and recording and deriving a pixel coordinate position corresponding to each page read-on identification area in the OID read-on printed matter, and binding the pixel coordinate position with the read-on data to obtain a read-on hot area position in the OID read-on printed matter so as to complete a content conversion process.
2. The method of claim 1, wherein the point-reading data corresponds to a point-reading identification area in the OID point-reading print in a one-to-one manner, wherein the point-reading data comprises voice data.
3. The method of claim 1, wherein the boundaries of the OID-click print are scanned and determined, and wherein the positional coordinate system comprising x and y axes is established based on the boundaries of the OID-click print.
4. The method of claim 3, wherein the click-to-read identification area in the OID click-to-read print is identified, and the identified click-to-read identification area is substituted into the position coordinate system comprising x and y axes to obtain the position information, wherein the position information comprises vertex position coordinates of the click-to-read identification area.
5. The method of claim 4, wherein the pixel coordinate location corresponding to the vertex location coordinate is determined based on the resolution information.
6. The method according to any one of claims 1-5, wherein when a user finger is reading, the OID is scanned to read the printed matter, the reading hot zone position in the current page is read, and the reading data bound with the reading hot zone position is played.
7. The method of claim 6, further comprising, prior to performing the user finger reading, the steps of:
acquiring identity characteristic information of a current user, judging user attributes of the current user, and determining the category of the current user, wherein the category of the user comprises: a child user.
8. A storage medium containing a series of instructions for performing the method steps of any one of claims 1-7.
9. A content conversion and finger reading apparatus based on OID point reading prints, characterized in that the method according to any one of claims 1-7 is performed, said apparatus comprising:
a first module, configured to read resolution information of the OID click-to-read print, and import click-to-read data included in the OID click-to-read print;
a second module for establishing a position coordinate system corresponding to the OID point-reading printed matter based on the OID point-reading printed matter;
a third module, configured to determine location information of a point reading identification area in the position coordinate system in the OID point reading print, and convert the location information into a corresponding pixel coordinate location;
and the fourth module is used for recording and exporting the pixel coordinate position corresponding to each page read-on identification area in the OID read-on printed matter, and binding the pixel coordinate position with the read-on data to obtain the read-on hot area position in the OID read-on printed matter so as to complete the content conversion process.
10. A child-specific smart device, wherein the OID click-to-read printout that completes a content conversion process based on the method of any one of claims 1-7, supports finger-pointing by a user.
CN201911021080.8A 2019-10-25 2019-10-25 Method and device for converting point-reading content into sketch finger-reading content based on OID Active CN110929709B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911021080.8A CN110929709B (en) 2019-10-25 2019-10-25 Method and device for converting point-reading content into sketch finger-reading content based on OID

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911021080.8A CN110929709B (en) 2019-10-25 2019-10-25 Method and device for converting point-reading content into sketch finger-reading content based on OID

Publications (2)

Publication Number Publication Date
CN110929709A CN110929709A (en) 2020-03-27
CN110929709B true CN110929709B (en) 2022-11-22

Family

ID=69849724

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911021080.8A Active CN110929709B (en) 2019-10-25 2019-10-25 Method and device for converting point-reading content into sketch finger-reading content based on OID

Country Status (1)

Country Link
CN (1) CN110929709B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111639581A (en) * 2020-05-26 2020-09-08 厦门市思芯微科技有限公司 Finger reading child robot system

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109214379A (en) * 2018-10-23 2019-01-15 北京快乐认知科技有限公司 Multi-functional point reading based on image recognition tracer technique gives directions part and reading method
CN109255346A (en) * 2018-08-31 2019-01-22 深圳闳宸科技有限公司 Reading method, device and electronic equipment
CN110222671A (en) * 2019-06-19 2019-09-10 南京孜博汇信息科技有限公司 The method and system that point reading based on dot matrix is write

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101149812A (en) * 2006-09-22 2008-03-26 北京清华同方思科***技术有限公司 Interactive information service method based on paper writing, service system and interactive reading matter
CN201449670U (en) * 2009-07-03 2010-05-05 中山市启雅电子有限公司 Point reading machine
KR101491476B1 (en) * 2013-11-27 2015-02-10 주식회사 바니랜드 Learning system using with OID pen or its method
CN104217197B (en) * 2014-08-27 2018-04-13 华南理工大学 A kind of reading method and device of view-based access control model gesture
CN108806692A (en) * 2018-05-29 2018-11-13 深圳市云凌泰泽网络科技有限公司 A kind of audio content is searched and visualization playback method
CN109003476A (en) * 2018-07-18 2018-12-14 深圳市本牛科技有限责任公司 A kind of finger point-of-reading system and its operating method and device using the system
CN109710748B (en) * 2019-01-17 2021-04-27 北京光年无限科技有限公司 Intelligent robot-oriented picture book reading interaction method and system
CN110060524A (en) * 2019-04-30 2019-07-26 广东小天才科技有限公司 Robot-assisted reading method and reading robot

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109255346A (en) * 2018-08-31 2019-01-22 深圳闳宸科技有限公司 Reading method, device and electronic equipment
CN109214379A (en) * 2018-10-23 2019-01-15 北京快乐认知科技有限公司 Multi-functional point reading based on image recognition tracer technique gives directions part and reading method
CN110222671A (en) * 2019-06-19 2019-09-10 南京孜博汇信息科技有限公司 The method and system that point reading based on dot matrix is write

Also Published As

Publication number Publication date
CN110929709A (en) 2020-03-27

Similar Documents

Publication Publication Date Title
KR101710050B1 (en) Image identification systems and method
CN108847214B (en) Voice processing method, client, device, terminal, server and storage medium
CN109979430B (en) Robot story telling method and device, robot and storage medium
JP2018501588A (en) Four-dimensional code, image identification system and image identification method based on four-dimensional code, four-dimensional code retrieval system, and four-dimensional code retrieval method
WO2022022704A1 (en) Sequence recognition method and apparatus, image processing device, and storage medium
CN107885430A (en) A kind of audio frequency playing method, device, storage medium and electronic equipment
CN109871843A (en) Character identifying method and device, the device for character recognition
WO2022001600A1 (en) Information analysis method, apparatus, and device, and storage medium
CN111950570B (en) Target image extraction method, neural network training method and device
CN110825164A (en) Interaction method and system based on wearable intelligent equipment special for children
CN112330533A (en) Mixed blood face image generation method, model training method, device and equipment
CN109918005A (en) A kind of displaying control system and method based on mobile terminal
CN110929709B (en) Method and device for converting point-reading content into sketch finger-reading content based on OID
CN116841393A (en) Meta-universe scene control system and method and virtual scene interaction system
CN111309212A (en) Split-screen comparison fitting method, device, equipment and storage medium
CN114063784A (en) Simulated virtual XR BOX somatosensory interaction system and method
CN109947239A (en) A kind of air imaging system and its implementation
CN117995184A (en) Man-machine interaction method, device and equipment under low attention and storage medium
CN114443938A (en) Multimedia information processing method and device, storage medium and processor
CN113780370B (en) Visual question-answering method, device, equipment and storage medium
KR102156054B1 (en) Electronic pen system interlocked with artificial intelligent speaker
CN111291758B (en) Method and device for recognizing seal characters
CN112381709B (en) Image processing method, model training method, device, equipment and medium
KR102164773B1 (en) Electronic pen system interlocked with artificial intelligent speaker with microphone
CN114398858A (en) Document display method, related device, equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant