CN103761893B - A kind of book reader - Google Patents

A kind of book reader Download PDF

Info

Publication number
CN103761893B
CN103761893B CN201410028668.7A CN201410028668A CN103761893B CN 103761893 B CN103761893 B CN 103761893B CN 201410028668 A CN201410028668 A CN 201410028668A CN 103761893 B CN103761893 B CN 103761893B
Authority
CN
China
Prior art keywords
information
book
module
camera
page
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201410028668.7A
Other languages
Chinese (zh)
Other versions
CN103761893A (en
Inventor
陈旭
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN201811229624.5A priority Critical patent/CN109300343A/en
Priority to CN201710960784.6A priority patent/CN107742446A/en
Priority to CN201711303666.4A priority patent/CN107967824A/en
Priority to CN201410028668.7A priority patent/CN103761893B/en
Publication of CN103761893A publication Critical patent/CN103761893A/en
Application granted granted Critical
Publication of CN103761893B publication Critical patent/CN103761893B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/04Scanning arrangements, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06KGRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K7/00Methods or arrangements for sensing record carriers, e.g. for reading patterns
    • G06K7/10Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
    • G06K7/10544Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation by scanning of the records by radiation in the optical part of the electromagnetic spectrum
    • G06K7/10821Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation by scanning of the records by radiation in the optical part of the electromagnetic spectrum further details of bar or optical code scanning devices
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/60Type of objects
    • G06V20/62Text, e.g. of license plates, overlay texts or captions on TV images
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10Character recognition

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Electromagnetism (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Artificial Intelligence (AREA)
  • Toxicology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • User Interface Of Digital Computer (AREA)
  • Studio Devices (AREA)
  • Image Analysis (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a kind of book readers, including:First information acquisition unit, first information recognition unit and audio unit, the first information acquisition unit includes that the Bibliographical Information of books and the information of page number information pass to the first information recognition unit by acquisition, the first information recognition unit includes the Bibliographical Information of books according to and the information of page number information determines corresponding audio-frequency information and notifies the audio unit, and the audio unit exports the corresponding audio-frequency information with audio form.The embodiment of the present invention can provide a kind of easy to read equipment to be not easy to the crowd of direct reading general book, so that it be facilitated to carry out the reading of a large amount of general book.

Description

Book reader
Technical Field
The invention relates to the technical field of electronics, in particular to a book reader.
Background
With the improvement of living standard of substances, the pursuit psychology of mental life is increasingly enhanced. To meet the demand of people, great development has been made in the publication of common books, and the publication and release amount of the current books is very large. However, there are some people, such as children, blind people, the elderly, etc., who are inconvenient to read books directly, and there is no auxiliary reading sound-generating device for ordinary books.
Disclosure of Invention
The invention aims to provide a book reader, so that people who are inconvenient to directly read books can read common books.
The purpose of the invention is realized by the following technical scheme:
a book reader comprising:
the book reading device comprises a first information acquisition unit, a first information identification unit and an audio unit, wherein the first information acquisition unit transmits acquired information containing book information and page number information of books to the first information identification unit, the first information identification unit determines audio information corresponding to a current reading page according to the information containing the book information and the page number information of the books and informs the audio unit, and the audio unit outputs the corresponding audio information in an audio form;
or,
the second information acquisition unit transmits the acquired information including the bibliographic information, the page number information and the user reading position information of the books to the second information recognition unit, the second information recognition unit determines the audio information corresponding to the current reading position of the user according to the bibliographic information, the page number information and the user reading position information of the books and informs the audio unit, and the audio unit outputs the corresponding audio information in an audio form.
The first information acquisition unit comprises a book information acquisition module and a page information acquisition module, the second information acquisition unit comprises a book information acquisition module, a page information acquisition module and a reading position information acquisition module, the book information acquisition module comprises a camera module and/or a weight detection module and/or a radio frequency signal acquisition module, the page information acquisition module comprises a camera module and/or a weight detection module and/or a radio frequency signal acquisition module and/or an ultrasonic detection module and/or an infrared detection module, and the reading position information acquisition module comprises a camera module and/or an ultrasonic detection module and/or an infrared detection module.
The camera module obtains information by adopting a photographing mode, the camera module comprises at least one movable camera, the photographing angle and/or position of the movable camera are adjustable, and the movable camera controls the movable camera to move based on a preset control mode or received control information so as to perform multi-angle and/or multi-position multi-point image photographing on the book; or, the camera module comprises a plurality of cameras, namely two or three or four or more than four cameras, the plurality of cameras are used for completing multi-angle and/or multi-position multi-point image shooting, each camera is a fixed camera or a movable camera, the shooting angle and/or position of the movable camera is adjustable, and the movable camera is controlled to move manually or based on a preset control mode or based on received control information so as to shoot the multi-angle and/or multi-position multi-point images of the book; or, the camera module comprises a fixed camera, the fixed camera comprises a plurality of lenses, and each lens contained in the plurality of lenses is controlled to acquire the image-text content information based on a preset control mode or received control information.
The movable camera comprises a rotatable camera and/or a movable camera, namely, the movable camera can rotate or move or can move and rotate; or the movable camera comprises one or more movable lenses, and the photographing angle and/or position of the movable lenses are adjustable; if the movable cameras comprise a plurality of cameras, each camera contained in the movable cameras is used for collecting image-text content information of all or part of scenes; the movable camera is arranged in the position of the region where the image information needs to be collected, and comprises: above the edges of the area and/or obliquely above and/or directly above.
The fixed camera comprises one or more lenses, if the fixed camera comprises a plurality of lenses, each lens is controlled to collect the image-text content information based on a preset control mode or received control information, and each camera contained in the plurality of cameras is used for collecting the image-text content information of all or part of scenes; the camera is arranged at the position of the area needing to collect the image information and comprises: above the edges of the area and/or obliquely above and/or directly above.
In the book-reader, in the book reader,
the book information acquisition module acquires image information of a book cover through the camera module as information containing the book information of the book, the first information identification unit or the second information identification unit comprises a character identification module or an image identification module or a label identification module, the character identification module determines a book name through identifying characters in the image information of the book cover, the image identification module determines the book name through identifying the image information of the book cover, and the label identification module determines the book name through identifying a label in the image information of the book cover;
or the bibliographic information acquisition module acquires weight information of the books as information containing the bibliographic information of the books through the weight detection module, the first information identification unit or the second information identification unit comprises a weight identification module, and the weight identification module determines corresponding book names according to the weight information of the books;
or the bibliographic information acquisition module acquires electronic tag information arranged in books through the radio frequency signal acquisition module as information containing the bibliographic information of the books, the first information identification unit or the second information identification unit contains an electronic tag identification module, and the electronic tag identification module determines corresponding book names according to the acquired electronic tag information arranged in the books.
In the book-reader, in the book reader,
the page number information acquisition module acquires image information of an inner page of a book as information containing the page number information through the camera module, the first information identification unit or the second information identification unit comprises an image identification module, a character identification module or a label identification module, the image identification module determines the page number of current reading through identifying the image information of the inner page of the book, the character identification module determines the page number of current reading through identifying characters or digital page numbers in the image information of the inner page of the book, and the label identification module determines the page number of current reading through identifying label information contained in the image information of the inner page of the book;
or the page number information acquisition module acquires image information of a page turning action of a user through the camera module to serve as information containing the page number information or the ultrasonic detection module or the infrared detection module acquires reflection or blocking of ultrasonic waves or infrared rays of the page turning action of the user to serve as information containing the page number information, the first information identification unit or the second information identification unit comprises a page turning action identification module, and the page turning action identification module determines a currently read page number according to the image information of the page turning action of the user and current page information determined before page turning;
or the page information acquisition module acquires weight distribution information of the opened book as information containing the page information through the weight detection module, the first information identification unit or the second information identification unit comprises a weight identification module, and the weight identification module determines the page number of the current reading according to the weight distribution information of the opened book;
or the page number information acquisition module acquires electronic tag information arranged in a page as information containing the page number information through the radio frequency signal acquisition module, the first information identification unit or the second information identification unit contains an electronic tag identification module, and the electronic tag identification module determines the page number read currently according to the acquired electronic tag information arranged in the page.
In the book-reader, in the book reader,
the reading position information acquisition module acquires image information of reading operation of a user as the reading position information of the user through the camera module, the second information identification unit comprises a position identification module, and the position identification module determines the current reading position through identifying the image information of the reading operation of the user;
or the reading position information acquisition module acquires the character image information of the user reading operation position as the user reading position information through the camera module, the second information identification unit comprises a character identification module and a position identification module, the character identification module is used for identifying the character content of the character image information of the user reading operation position, and the position identification module determines the current reading position according to the character content identified by the character identification module;
or the reading position information acquisition module acquires the activity position information of the hands or the objects in the book pages as the user reading position information through the ultrasonic detection module or the infrared detection module, the second information identification unit comprises a position identification module, and the position identification module determines the current reading position by identifying the activity position information of the hands or the objects in the book pages.
In the book-reader, in the book reader,
the first information identification unit comprises a first reading content identification module, and the first reading content identification module identifies audio information corresponding to a current reading page of a user according to the book name and the current reading page number and informs the audio unit; or the second information identification unit further comprises a second reading content identification module, and the second reading content identification module identifies the audio information corresponding to the current reading position of the user from the pre-stored book content information according to the book name, the current reading page number and the current reading position, and notifies the audio unit; or the reading position information acquisition module acquires the character image information of the user reading operation position through the camera, and the second information identification unit comprises a character identification module for identifying the character content contained in the character image information of the user reading operation position and informing the audio unit of the identified audio information corresponding to the character content or the audio information obtained by converting the character content;
and/or the presence of a gas in the gas,
and after determining the name of the book and the current reading page number according to the bibliographic information and the page number information of the book, the first information identification unit or the second information identification unit also transmits the audio information corresponding to the name of the book and/or the current reading page number to the audio unit, and the audio unit outputs the audio information corresponding to the name of the book and/or the current reading page number in an audio mode.
In the book-reader, in the book reader,
the audio unit also comprises a recording module used for acquiring audio information;
and/or the presence of a gas in the gas,
the book reader also comprises a storage unit, a reading unit and a processing unit, wherein the storage unit is used for storing audio information and/or storing image and character information obtained in the acquisition and identification process and/or storing externally obtained content information;
and/or the presence of a gas in the gas,
the book reader also comprises a display unit for displaying set content information and/or image and character information acquired in the acquisition and identification process and/or externally acquired content information;
and/or the presence of a gas in the gas,
the book reader also comprises a communication unit used for communicating with a computer;
and/or the presence of a gas in the gas,
the book reader also comprises an interactive processing module which is used for acquiring interactive operation control information of a reading user and executing preset interactive operation according to the interactive operation control information, wherein the interactive operation control information comprises at least one of limb actions, actions of operating objects, voice information, screen input or operation keys.
According to the technical scheme provided by the invention, the book reader provided by the embodiment of the invention can assist in making a sound when a common book is browsed naturally and read, so that people who cannot read the book directly can read the common book conveniently. Furthermore, the book reader can interact with the reading user after recognizing the limb action of the reading user or the action of an operation object, so that the reading experience of the reading user is improved, and books become audio media and interactive media. Furthermore, a multi-point image information acquisition unit (i.e. a camera module) can be arranged in the book reader, compared with a common camera, the required image photographing and acquisition can be completed in a practical close range without distortion, the image can be acquired and identified from the angle or the position of the book which does not influence the reading, such as the oblique upper side, and the reading of a user is not influenced, a plurality of focal lengths are provided for a corresponding movable camera or a plurality of cameras, so that all parts of the acquired object can be in the best focal length to ensure that the images of all parts are clear, and the proper photographing angle and position can be always provided for a curved surface (such as a large curved surface in the middle of the book), so that the object can be effectively photographed and identified, in addition, the corresponding multi-point image information acquisition unit can ensure that the requirement on the resolution of the camera is lower, or the photographed object can be photographed by the camera with the same resolution to achieve higher resolution (more beneficial to the, therefore, the collected image information can be more real and accurate, the accuracy of the identification process is further ensured, the corresponding book reading process can be smoothly carried out, and the reading user is further ensured to have better reading experience.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on the drawings without creative efforts.
FIG. 1 is a schematic structural diagram of a first book reader according to an embodiment of the present invention;
FIG. 2 is a schematic structural diagram of a second book reader according to an embodiment of the present invention;
FIG. 3 is a first diagram illustrating a specific implementation structure of the book reader according to an embodiment of the present invention;
FIG. 4 is a second diagram illustrating a specific implementation structure of the book reader according to an embodiment of the present invention;
FIG. 5 is a third schematic diagram of a specific implementation structure of the book reader according to the embodiment of the present invention;
FIG. 6 is a first schematic view of an application structure of the book reader according to the embodiment of the present invention;
FIG. 7 is a schematic diagram of a second application structure of the book reader according to the embodiment of the present invention;
FIG. 8 is a third schematic view of an application structure of the book reader according to the embodiment of the present invention;
FIG. 9 is a first schematic structural diagram of a book reader including a single camera according to an embodiment of the present invention;
FIG. 10 is a second schematic structural diagram of a book reader including a single camera according to an embodiment of the present invention;
FIG. 11 is a third schematic structural diagram of a book reader including a single camera according to an embodiment of the present invention;
FIG. 12 is a first schematic structural diagram of a book reader including multiple cameras according to an embodiment of the present invention;
FIG. 13 is a second schematic structural diagram of a book reader including multiple cameras according to an embodiment of the present invention;
FIG. 14 is a third schematic structural diagram of a book reader including multiple cameras according to an embodiment of the present invention;
FIG. 15 is a schematic view of a book including a bar code in an embodiment of the present invention;
FIG. 16 is a diagram illustrating a book including page numbers according to an embodiment of the present invention;
fig. 17 is a schematic structural diagram of a camera disposed above an edge according to an embodiment of the present invention;
fig. 18 is a first schematic structural diagram of a camera disposed obliquely above according to an embodiment of the present invention;
fig. 19 is a second schematic structural diagram of a camera disposed obliquely above according to an embodiment of the present invention;
fig. 20 is a schematic structural diagram of a camera disposed right above according to an embodiment of the present invention;
fig. 21 is a first schematic diagram illustrating a plurality of cameras shooting a curved surface on a book according to an embodiment of the present invention;
FIG. 22 is a second schematic diagram of a plurality of cameras for photographing a curved surface on a book according to an embodiment of the present invention;
fig. 23 is a third schematic view of a plurality of cameras provided in the embodiment of the present invention for photographing a curved surface on a book;
FIG. 24 is a schematic diagram of a rotatable camera for taking a photograph of a curved surface of a book before rotation according to an embodiment of the present invention;
fig. 25 is a schematic diagram illustrating the rotatable camera provided by the embodiment of the present invention rotating to photograph the upper curved surface of the book.
Detailed Description
The technical solutions in the embodiments of the present invention are clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the present invention without making any creative effort, shall fall within the protection scope of the present invention.
The book reader provided by the embodiment of the invention is an electronic product which can identify the book, the current reading page or content, the action of a hand or a handheld object on the book and send out corresponding sound when the book is browsed naturally, and can be used for common books, so that the book reader can be popularized in a large quantity, and common books can be changed into audio media and interactive media from silent media.
Embodiments of the present invention will be described in further detail below with reference to the accompanying drawings.
As shown in fig. 1, a first book reader provided in an embodiment of the present invention includes: the book reading device comprises a first information acquisition unit, a first information identification unit and an audio unit, wherein the first information acquisition unit transmits acquired information including book information and page number information of books to the first information identification unit, the first information identification unit determines audio information corresponding to a current reading page according to the information including the book information and the page number information of the books and informs the audio unit, and the audio unit outputs the corresponding audio information in an audio form.
As shown in fig. 2, a second book reader provided in an embodiment of the present invention includes: the second information acquisition unit transmits the acquired information including the bibliographic information, the page number information and the user reading position information of the books to the second information recognition unit, the second information recognition unit determines the audio information corresponding to the current reading position of the user according to the bibliographic information, the page number information and the user reading position information of the books and informs the audio unit, and the audio unit outputs the corresponding audio information in an audio form.
In the book reader, the first information acquisition unit comprises a book information acquisition module and a page information acquisition module, the second information acquisition unit comprises a book information acquisition module, a page information acquisition module and a reading position information acquisition module, the book information acquisition module comprises a camera module and/or a weight detection module and/or a radio frequency signal acquisition module, the page information acquisition module comprises a camera module and/or a weight detection module and/or a radio frequency signal acquisition module and/or an ultrasonic detection module and/or an infrared detection module, and the reading position information acquisition module comprises a camera module and/or an ultrasonic detection module and/or an infrared detection module.
Specifically, as shown in fig. 3 and 4, the second information acquisition unit transmits the acquired information including the bibliographic information, the page number information, and the user reading position information of the book to the second information identification unit, the second information identification unit determines the audio information corresponding to the current reading position of the user according to the bibliographic information, the page number information, and the user reading position information and notifies the audio unit, and the audio unit outputs the corresponding audio information in an audio form, so that the reading process is completed, and the reading type reading for the book is realized. Specifically, the audio information corresponding to the corresponding current reading page or the audio information corresponding to the position in each page of the book that can be read by the user may be audio information pre-stored in a memory, or audio information obtained by text conversion after character recognition, and when the current reading position or the current reading page of the user is determined, the audio information corresponding to the current reading position or the current reading page is sent to an audio unit, and the audio unit plays the audio information through a speaker, so that the reading of the reading position or the reading page content in the book is realized. Further, the corresponding audio information may be information directly corresponding to the text content (i.e. directly reading the text content), or may also be interpretation information, background music, background sound, etc. for the text content, for example, the audio information may be audio information for interpreting a current reading page or audio information for interpreting the text content at a current reading position, or audio information of a book name or a page number, or may also be any sound for the current reading position, for example, the current reading position is a key, and a click sends a corresponding musical instrument sound, for example, the current reading position is an animal, and a click sends a corresponding animal sound, etc.
And relative to the second information acquisition unit and the second information identification unit, the processing functions of the corresponding first information acquisition unit and the corresponding first information identification unit only omit the processes of acquiring the reading position information of the user and identifying the reading position information of the user, but directly identify the current reading page and determine the audio information corresponding to the current reading page. Therefore, the implementation of the first book reader provided by the embodiment of the present invention will not be separately described in detail in the following description.
In the process of identifying the current reading position of the user, the information (i.e. the information collected by the information collection unit) to be used as the basis can be image-text information, infrared information or ultrasonic information. And the reading user can transmit the reading requirement information of the reading user to the book reader through the operation action of the object (such as a stick-shaped object) or the limb action (such as the pointing direction and the sliding of a hand) in the reading process, such as the appointed reading position or the instruction of interacting with the book reader, and at the moment, the information acquisition unit can acquire the object operation action information or the limb action information of the reading user to assist the realization of the corresponding reading process.
In the book reader, the corresponding information collecting unit may specifically include a bibliographic information collecting module for collecting bibliographic information of a book, a page number information collecting module for collecting page number information corresponding to a current reading position, and a reading position information collecting module for collecting reading position information of a user, and the corresponding information collecting module may be disposed in the same processing chip or in different processing chips. Further, as shown in fig. 4, the bibliographic information collecting module may include, but is not limited to, a camera module or a radio frequency signal collecting module or a weight detecting module for collecting image information, radio frequency signals or weight information, the page number information collecting module includes a camera module or a weight detecting module or a radio frequency signal collecting module or an ultrasonic wave detecting module or an infrared detecting module for collecting image information, weight information, radio frequency signals, ultrasonic waves or infrared rays, and the reading position information collecting module includes a camera module or an ultrasonic wave detecting module or an infrared detecting module for collecting image information, ultrasonic waves or infrared rays. If the book information acquisition module, the page number information acquisition module and the reading position information acquisition module adopt cameras to acquire image information, the acquisition of the image information for each module can be respectively carried out through one or a group of cameras uniformly arranged in a book reader; similarly, if the book information collection module, the page number information collection module and the reading position information collection module need other modules with the same function to collect the same type of information, the modules with the corresponding functions uniformly arranged in the book reader can collect the information, such as collecting object operation action information or limb action information of a reading user to assist in realizing the corresponding reading process.
In the book reader, the corresponding camera module may adopt a multi-point image information collecting unit capable of taking multi-angle and/or multi-position multi-point images of the book, and for this purpose, the corresponding camera module may be implemented in any one of the following ways:
(1) the camera module comprises at least one movable camera, and the movable camera controls the movable camera to move based on a preset control mode or received control information so as to shoot multi-angle and/or multi-position multi-point images of the book. For example, the angle and/or position of the movable camera may be automatically adjusted according to feedback automatic control (e.g., automatic adjustment according to feedback after recognition of the captured image), such as when the finger position is out of range or part of the text is out of range or the page number is out of range, so that the product requires no or little manual intervention during the work process, or the camera may be controlled to rotate or move according to control information input by the user (e.g., specific actions performed by the user or predetermined control information input by the user through operating keys, etc.), or the camera may be automatically controlled to rotate or move according to a preset time interval, so as to perform multi-angle and/or multi-position multi-point capturing for the book.
Specifically, the movable camera comprises a rotatable camera and/or a movable camera, that is, the movable camera is rotatable or movable and rotatable; or the movable camera comprises one or more movable lenses; if the movable cameras comprise a plurality of cameras, each camera contained in the movable cameras is used for collecting image-text content information of all or part of scenes; the movable camera can set up in needs gather the position in image information's region includes: above the edges of the area and/or obliquely above and/or directly above.
(2) The camera module comprises a plurality of cameras, namely two or three or four or more than four cameras, the cameras are used for completing multi-angle and/or multi-position multi-point image shooting, each camera is a fixed camera or a movable camera, and the movable camera is used for performing multi-angle and/or multi-position multi-point image shooting on a book based on a preset control mode or based on received control information or manually controlling the movement of the movable camera. For example, the camera is controlled to rotate or move according to control information input by the user (such as specific actions performed by the user or predetermined control information input by the user through operating keys, etc.), or the camera can be automatically controlled to rotate or move according to a preset time interval to perform multi-angle and/or multi-position multi-point shooting for the book.
Specifically, the fixed camera includes one or more lenses, and if the fixed camera includes multiple lenses, the fixed camera controls each lens to acquire the image-text content information based on a predetermined control manner or received control information, and the predetermined control manner includes controlling all or part of the multiple lenses to perform multi-angle and/or multi-position multi-point image shooting to acquire the image-text content information;
each camera included in the plurality of cameras is used for collecting image-text content information of all or part of scenes;
in the scheme (2), the position where the camera module can be arranged in the area where the image information needs to be acquired includes: the cameras may be fixed or movable above and/or diagonally above and/or directly above the edge of the area where the book is located, and the position of the cameras need not affect the reader in reading the book, which is shown in fig. 17, 18, 19 and 20. Meanwhile, due to the fact that the multiple cameras are adopted, shooting coverage required for each camera is greatly reduced, the multiple cameras can shoot respectively to conduct respective recognition work, and shooting results can be integrated for recognition.
(3) The camera module comprises a fixed camera, the fixed camera comprises a plurality of lenses, each lens contained in the plurality of lenses is controlled to collect the image-text content information based on a preset control mode or received control information, so that multi-angle and/or multi-position multi-point image shooting can be carried out on a book through the plurality of lenses, and the preset control mode comprises the step of controlling all the lenses or part of the lenses in the plurality of lenses to carry out multi-angle and/or multi-position multi-point image shooting so as to collect the image-text content information. For example, according to feedback automatic control (e.g. automatic adjustment according to feedback after recognition of the taken images), such as when the finger position exceeds the range or part of the characters exceeds the range or the page number exceeds the range, the angle and/or position of the movable camera is automatically adjusted, so that the product requires no or little manual intervention during the work process, or according to control information input by the user (e.g. fixed actions performed by the user or predetermined control information input by the user through operating keys, etc.), the various lenses are controlled to take multiple angles and/or multiple positions of the book, or the various lenses are controlled to take according to a preset manner that the various lenses acquire image information of multiple angles and/or multiple positions of the book (e.g. the various lenses can be set to take the book in sequence to obtain corresponding image information, it is also possible to set each lens to photograph the book at the same time to obtain corresponding image information, or it is also possible to set a part of the lens to photograph the book to obtain corresponding image information, etc.).
Specifically, in the scheme (3), the position where the fixed camera may be disposed in the area where the image information needs to be acquired includes: above the edges of the area and/or obliquely above and/or directly above, as can be seen in particular with reference to fig. 17, 18, 19 and 20.
The fixed camera usually has a fixed view, but a plurality of cameras can form comprehensive coverage, and the movable camera has a fixed view in a certain angular position, but it changes the view through the activity, therefore can also form comprehensive coverage, in the concrete implementation, if the fixed camera is not flexible, can not regard as the movable camera, likewise, even if the camera is movable, but if the work process does not depend on the activity to obtain the required special effect, such as comprehensive coverage, etc., then still belong to the fixed camera scheme in fact. For example, if the movable camera is adjusted to a proper angle position in advance, but the movable camera does not need to be moved in actual use, or the effect of the movable camera on special effects such as overall coverage is small, the movable camera still belongs to a fixed camera solution in practice.
Specifically, according to different implementation manners of the bibliographic information acquisition module, the specific implementation structures of the corresponding information identification units may also be different, that is, the structures of the information identification units need to be set according to the specific implementation manners of the structure of the bibliographic information acquisition module, as shown in fig. 4, the implementation manners of the corresponding information identification units under different bibliographic information acquisition module structures will be further described below:
(1) if the corresponding book information acquisition module comprises a camera module, the book information acquisition module acquires image information of a book cover (comprising a front cover, a back cover and the like) as book information through the camera module, at the moment, the first information identification unit or the second information identification unit comprises a character identification module or an image identification module or a label identification module, the character identification module identifies characters in the image information of the book cover to determine the book information, namely, the corresponding book name, the image identification module identifies the book name through the image information of the book cover, and the label identification module identifies the book name through a label contained in the image information of the book cover.
Because the front cover image and the back cover image of each book are different, the book can be identified by comparing the shot image information or by extracting characteristic comparison, and the specific book is identified, so that the corresponding book name is determined. In addition, for the convenience of identification, a corresponding label convenient for identification can be further arranged in the book, so that the specific book name of the current book can be determined according to the label, the corresponding label can be a label printed on the book or a label pasted on the book, and the corresponding label can be content information such as pictures, codes or characters. Since the specific image recognition technology is already the prior art, it will not be described in detail here.
Corresponding character recognition has already gradually entered the practical stage, and the corresponding recognition processing procedure may include: firstly, preprocessing a photographed image, wherein the preprocessing mainly comprises binarization, noise removal, inclination correction and the like, and then extracting character features, namely thinning a character image, obtaining the number and the positions of stroke end points and cross points of characters or taking stroke segments as features, and matching a comparison method for comparison so as to recognize the characters. Since the text recognition technology is already the prior art, it will not be described in detail here.
(2) If the corresponding book information acquisition module comprises a weight detection module, the book information acquisition module acquires weight information of the book as book information through the weight detection module, at the moment, the first information identification unit or the second information identification unit comprises a weight identification module, and the weight identification module determines the corresponding name of the book according to the weight information of the book.
Specifically, the weights of different books are usually different from each other, and as long as the weights of the books and the names of the books are stored in a memory of the book reader in advance, the names of the books can be determined according to information stored in the memory after the weights of the books are known through the weight detection module.
(3) If the corresponding book information acquisition module comprises the book information acquisition module, the book information acquisition module acquires electronic tag information arranged in books through the radio frequency signal acquisition module, the first information identification unit or the second information identification unit comprises an electronic tag identification module, the electronic tag identification module determines corresponding book names according to the acquired electronic tag information arranged in the books, namely information of the current books is recorded in the corresponding electronic tag information, and the names of the books can be determined through the identification of the electronic tag information.
Further, in the book reader, the implementation structures of the corresponding information identification units may be different according to different implementation manners of the page number information acquisition modules, and referring to fig. 2, different implementation structures of the corresponding information identification units under different page number information acquisition module structures will be specifically described below:
(1) if the page number information acquisition module comprises a camera module, the page number information acquisition module acquires image information of an inner page of a book as page number information through the camera module, at the moment, the first information identification unit or the second information identification unit comprises an image identification module, a character identification module or a label identification module, the image identification module determines the currently read page number by identifying the image information of the inner page of the book, the character identification module determines the currently read page number by identifying characters or digital page numbers in the image information of the inner page of the book, and the label identification module determines the currently read page number by identifying label information in the image information of the inner page of the book; the image of each page in each book is different, so that the image information can be shot for comparison and identification, or the image information can be extracted for comparison so as to identify which page in which book specifically is, and the scheme that the image identification module identifies the image information of each page in the book to determine which page in the book is the current page can be realized.
(2) If the page number information acquisition module acquires image information of a page turning action of a user through the camera module included in the page number information acquisition module as information containing the page number information or the ultrasonic detection module or the infrared detection module acquires reflection or blocking of ultrasonic waves or infrared rays of the page turning action of the user as information containing the page number information, the first information identification unit or the second information identification unit comprises a page turning action identification module, and the page turning action identification module determines a currently read page number according to the image information of the page turning action of the user and current page information determined before page turning.
The page number of each time of turning of the reader can be defaulted to be one page in the process of recognizing the page turning action, and based on the page number, the page number of the current reading can be determined by counting the page turning number of the reader according to the set counter after the page turning action of the reader is recognized. Or, during the process of recognizing the page turning action, the current page turning number can be determined according to the image of the page turning action (such as according to the information of the thickness of the paper turned over in the image) and the current reading page number can be determined according to the previous reading page.
(3) If the page information acquisition module comprises a weight detection module, the page information acquisition module acquires weight distribution information of the opened book as page information through the weight detection module, the first information identification unit or the second information identification unit comprises a weight identification module, and the weight identification module determines the page number of the current reading according to the weight distribution information of the opened book. Specifically, the weight detection module can be arranged at the position pressed by the book back cover in the book reader, so that when a reader turns over each page of a book, the weight of the book back cover acting on the position of the corresponding weight detection module in the book reader can be changed, and the page number read by the reader at present can be obtained according to the change.
Specifically, along with turning over the page or leaf, books or other picture and text data read the page number of one side more and more, and weight is more and more heavy, and the page number of the other side is less and more, and the weight is more and more light, and weight distribution when weight sensor gathers and detects books or other picture and text data and turns over, converts the signal of telecommunication into and can detect this kind of weight distribution change through analog-to-digital conversion, thereby later with the books that store in advance when turning over weight distribution change information contrast can discern the page number that turns over at present. Further, the identification of different books may also be formed for books of different weights.
(4) If the page number information acquisition module comprises a radio frequency information acquisition module, the page number information acquisition module acquires electronic tag information arranged in a page through the radio frequency signal acquisition module, at the moment, the first information identification unit or the second information identification unit comprises an electronic tag identification module, the electronic tag identification module determines the page number read currently according to the acquired electronic tag information arranged in the page, namely the page number information of the current page is recorded in the corresponding electronic tag information, and the page number read currently can be determined through the identification of the electronic tag information.
Further, in the book reader, the implementation structures of the corresponding information identification units may be different according to different implementation manners of the reading position information acquisition module, and referring to fig. 2, different implementation structures of the corresponding information identification units under different reading position information acquisition module structures will be specifically described below:
(1) if the reading position information acquisition module comprises the camera module, the reading position information acquisition module acquires image information of the reading operation of the user as the reading position information of the user through the camera module, at the moment, the second information identification unit comprises a position identification module, and the position identification module determines the current reading position through identifying the image information of the reading operation of the user; the user reading operation comprises a reading operation performed through limb actions (such as gestures and the like), and also comprises a reading operation performed through actions of an operation object (such as a stick-shaped object and the like); the corresponding position identification module can determine the current reading position by directly identifying the image information of the reading operation of the user, or can determine the current reading position according to the interaction result by identifying the interaction (or called interaction) between the image information of the reading operation of the user and the reading user.
In the processing process of identifying the reading position according to the image information of the reading operation of the user, the reading indication action performed by the hand or the handheld object in the reading process can be specifically identified, including the reading indication action performed by the hand or the handheld object and the coordinate position thereof, so that the reading position of the reader is determined. Specifically, pointing and sliding are two actions commonly used when reading books, usually to point to show attention to a certain place, and gradually read the contents of each page in the book as the finger slides; therefore, the coordinates of the pointing position of the finger can be identified, the voice of the characters corresponding to the pointing position of the finger can be sent out, the coordinate range of the sliding track of the finger can be identified, and the voice of the characters corresponding to the sliding track can be sent out, so that the voice of the corresponding characters can be sent out step by step according to the reading habit of a reader (namely, along with the sliding of the finger of the reader on the book), and the reading of the book can be realized; alternatively, the hand or hand-held object indicates reading of a whole page, or a segment, or a sentence, or a word; in addition, the book reader can also perform interactive operation in the reading process according to gesture actions of the reading user or actions of an operation object, for example, when the reading user is identified to execute a certain preset gesture action or a certain operation, the book reader can inquire whether the reading user performs the reading operation through voice or a display screen, or inquire whether the page number currently read by the reading user is a certain page, and the like, and at the moment, the user can interact with the book reader through operating keys or preset gesture actions in the book reader so as to complete the corresponding reading operation process.
Furthermore, the shot image information of the user reading operation can be subjected to filtering and noise reduction processing, converted into HSV (hue, saturation and brightness) by an RGB (red, blue and green mode) space, a threshold segmentation model is established to perform primary identification on the gesture image, the noise is removed after digital morphology processing and segmentation, and then the positions of the gesture and the fingertip can be identified through searching and geometric identification of a connected domain. Since recognition of gesture motions is a known technique, it is not described in detail here. The identification process for the reading position of the stick is similar to the process of identifying the reading position of the finger, and is simpler than the process of identifying the reading position of the finger, because the stick is simpler than the shape of the hand, has obvious geometric characteristics, and the color or pattern can be customized according to the identification requirement.
For example, for a fixed camera, it is necessary to ensure that a hand or hand-held object falls within the acquisition range of its camera. Considering that the hand or the hand-held object can be at any position of the book, a plurality of photographing cameras or movable photographing cameras can be adopted to collect and cover a plurality of positions of the book, so that the hand or the hand-held object falls in the collection range of the photographing cameras, the hand or the hand-held object is convenient to be photographed and identified, and meanwhile, the corresponding identification accuracy can be improved for more image information collected by the plurality of cameras. And the movable photographing camera can be moved to a proper angle position to photograph and carry out corresponding recognition.
(2) The reading position information acquisition module can also acquire character image information of a user reading operation position as the user reading position information through the camera, the second information identification unit comprises a character identification module and a position identification module, the character identification module is used for identifying the character content of the character image information of the user reading operation position, and the position identification module determines the current reading position according to the character content identified by the character identification module; specifically, information convenient for identification, such as a text position, an image, or content, may be stored in advance as identification reference information, so that the text identification module may match the text after identifying the text, and if the text is matched, the current reading position may be determined.
For example, the corresponding text recognition may include recognition of page numbers, and for a fixed camera, it is necessary to ensure that the page numbers fall within the acquisition range of the camera, so as to ensure that the current page can be turned through the shooting recognition. Considering that the page number may be at any position around the book, a plurality of photographing cameras or movable photographing cameras can be adopted to collect and cover a plurality of positions of the book, so that the page number falls in the collection range of the photographing cameras, the corresponding current page turning and reading can be conveniently photographed and identified, and meanwhile, the corresponding identification accuracy can be improved for more image information collected by the plurality of cameras. And for the movable photographing camera, the movable photographing camera can be moved to a proper angle position for photographing and carrying out corresponding identification on the current page to be turned over.
(3) If the reading position information acquisition module comprises the ultrasonic detection module or the infrared detection module, the reading position information acquisition module acquires the moving position information of the hands or the objects in the book pages as the user reading position information through the ultrasonic detection module or the infrared detection module, at the moment, the second information identification unit comprises a position identification module, and the position identification module identifies the moving position information of the hands or the objects in the book pages to determine the current reading position.
In the book reader provided by the embodiment of the present invention, the first information identification unit includes a first reading content identification module, and the first reading content identification module identifies audio information corresponding to a current reading page of a user from pre-stored book content information according to the book name and the current reading page number, and notifies the audio unit; or the second information identification unit further comprises a second reading content identification module, and the second reading content identification module identifies the audio information corresponding to the current reading position of the user from the pre-stored book content information according to the book name, the current reading page number and the current reading position, and notifies the audio unit. The pre-stored book content information comprises audio information corresponding to the content information of the current reading page or the current reading position, and the audio information is a reading text of the actual content information in the book; or, the audio information may be audio information related to the content information of the current reading page or the current reading position, where the audio information may be audio information for explaining the content information in the book, or may also be other audio information related to the corresponding content information.
In the book reader provided by the embodiment of the present invention, the reading position information collecting module may collect the text image information of the reading operation position of the user through the camera module, and at this time, the second information identifying unit may include a text identifying module, and the text identifying module may identify the text content included in the text image information of the reading operation position of the user, and notify the audio unit of the audio information corresponding to the identified text content. The text recognition module can directly recognize text contents read by a reader and inform the audio unit of assisting in sounding reading, specifically, audio information corresponding to the text contents can be transmitted to the audio unit, or the text contents can be directly converted into the audio information and transmitted to the audio unit.
Further, in the book reader provided in the embodiment of the present invention, the audio unit may further include a recording module, configured to acquire and store audio information, so as to implement a corresponding recording function. For example, the interaction between the book reader and the reading user can be realized by recognizing the recorded voice information sent by the user, or the recording function can also be used for comparing the difference between the pronunciation of the user and the pronunciation of the book reader so as to correct the accuracy of the pronunciation of the user, for example, the function can be applied in the process of language learning, or the user can record the audio information by himself and match with the book item, the current reading page, the current reading position and the like of the book, so that the reading sound made by the user can be heard during reading.
Optionally, the book reader provided in the embodiment of the present invention may further include a display unit, configured to display set content information or information obtained in an image acquisition and identification process or content information obtained externally, for example, the display unit may be configured to display information to a user in an interaction process with the reading user, or display an image, a text, and the like obtained in the image acquisition and identification process, or display predetermined content information, such as information of a current reading page number, and the like, to the user in a reading process of the user.
Optionally, the book reader provided in the embodiment of the present invention may further include a storage unit, configured to store audio information and/or store image and text information obtained in the acquisition and recognition process and/or store externally obtained content information.
Optionally, the book reader provided in the embodiment of the present invention may further include a display unit that displays content information including settings and/or image and text information obtained in the acquisition and recognition process and/or content information obtained externally.
Optionally, the book reader provided in the embodiment of the present invention may further include a communication unit for communicating with a computer.
Furthermore, in the book reader provided in the embodiment of the present invention, after determining the name of the book and the current reading page number according to the bibliographic information and the page number information of the book, the first information identification unit or the second information identification unit further transmits the audio information corresponding to the name of the book and/or the current reading page number to the audio unit, and the audio unit outputs the audio information corresponding to the name of the book and/or the current reading page number in an audio manner. The corresponding audio information corresponding to the book name may be a reading text of the text information corresponding to the actual book name, or may also be audio information related to the book name, such as audio information of contents such as background introduction of the book; the corresponding audio information corresponding to the current reading page number may be a reading text of a number corresponding to the current page number, or may also be audio information related to the current page number, such as audio information of content such as an explanatory description of text content in the page number.
In the embodiment of the invention, in order to facilitate the interactive processing with the reading user, the book reader may further comprise an interactive processing module, configured to acquire interactive operation control information of the reading user, and execute a predetermined interactive operation according to the interactive operation control information, where the interactive operation control information includes at least one of a body motion, a motion of an operation object, voice information, a screen input, or an operation key; specifically, the corresponding interactive operation control information may include reading operation indication information and the like performed on the book, for example, the interactive operation is performed through a body movement, and the reading user may, but is not limited to, perform interactive control on a reading mode or reading content of the reader through interaction between a hand or a handheld object and the book reader, for example, re-reading the content of the current position through a predetermined gesture control.
It should be noted that, in the book reader, the first information identification unit or the second information identification unit may be implemented by a text identification module in the process of identifying the name of the book, the currently read page number, or the reading position, and at this time, the identification processing for different text contents may be implemented by the same text identification module, and different text identification modules do not need to be respectively configured. Similarly, the first information identification unit or the second information identification unit may also be applied to other functional modules with the same name and similar functions in the process of identifying the name of the book, the currently read page number or the reading position, and for the situation, the corresponding processing function can be realized through the same functional module without respectively arranging a plurality of modules with similar functions.
For the purpose of facilitating an understanding of the embodiments of the present invention, a detailed description will be given below of an implementation structure of the embodiments of the present invention in a specific application process with reference to the accompanying drawings.
The book reader provided by the embodiment of the invention is shown in fig. 5, and specifically comprises a sensing part, an identification processing part and a sounding part, wherein the sensing part, the identification processing part and the sounding part are electrically connected; the sensing part is a first information acquisition unit or a second information acquisition unit and is used for acquiring sensing information; the recognition processing part is a first information recognition unit or a second information recognition unit and is used as a central processing part for receiving the sensing information collected by the sensing part, finishing recognition processing according to the sensing information and calling corresponding audio information according to a recognition result to send to the sounding part; the sound production part is contained in the audio unit and is used for producing sound corresponding to the content of the reading position of the user so as to realize the corresponding book reading function.
Referring to fig. 5, 6 and 7, the corresponding sensing section may comprise: for example, the system may include only the corresponding optical photographing and shooting module, may also include both the optical photographing and shooting module and the radio frequency identification module, or may also include each module at the same time. The specific functional roles of the respective modules will be described below.
(1) The infrared or ultrasonic detection module, namely the infrared detection module or the ultrasonic detection module, comprises one or more groups of infrared or ultrasonic transmitting and receiving devices, and judges the movement of the user for turning the book and the hand, such as page turning, pointing or sliding and the like, by detecting the reflection or blockage of the infrared or ultrasonic waves. Referring to fig. 6, the turned-up page or hand reflects the infrared or ultrasonic waves emitted by the infrared or ultrasonic sensor group included in the infrared or ultrasonic detection module to the sensor group receiving part included in the infrared or ultrasonic detection module, so as to implement the detection of the corresponding infrared or ultrasonic waves, and perform the identification of page turning and the like based on the detection result.
In fig. 5, two groups of infrared or ultrasonic sensors are specifically adopted and sequentially triggered, so that misjudgment caused by triggering of a single group of infrared or ultrasonic sensors is avoided. In the process of recognizing the page turning action, the page is turned from the right side to the left side along with the progress of the page turning action, and the right sensor group and the left sensor group are sequentially triggered; and then, judging the current page after page turning according to the read page number.
In the process of identifying the specific position of the finger or other object in the reading page, when the finger or other object is placed on the left page, the sensor group arranged on the left side is triggered, and when the finger or other object is placed on the right page, the sensor group on the right side is triggered, so that the reading position is identified; further, if a plurality of groups of infrared or ultrasonic sensors are arranged around the book, the sliding process is identified by triggering the corresponding plurality of groups of sensors at intervals when the fingers slide, and then the sliding position of the fingers can be determined. The recognition effect for the position of finger sliding can be improved if the number of sensor groups is increased around the book.
(2) The radio frequency identification module, i.e., the radio frequency signal acquisition module or RFID chip, as shown in fig. 7, is used to read the electronic tag attached to or made in the book, and the electronic tag may store book information, so that the radio frequency identification module can obtain the bibliographic information of the book after reading the electronic tag, i.e., determine which book is currently read and the specific page number information of the current reading. At present, the electronic tag can be very thin, so that the electronic tag can be pasted or directly made into a book page; moreover, the information storage capacity of the electronic tag is more and more, and the electronic tag can store information such as book names, page numbers and audio information corresponding to contents, so that the radio frequency identification module can conveniently obtain corresponding information.
(3) An optical photographing and shooting module, as shown in fig. 9, fig. 10 and fig. 11, may include a photographing camera, i.e., a camera, which may be fixed or movable, and may be disposed on the upper portion of the book reader and face the book, and the disposed position does not affect the reader to read the book; further, the arrangement of the camera may only be to shoot a part of the covered book, or may also be to shoot by rotating or moving the camera so as to achieve the maximum shooting coverage without distortion in a short distance, in addition to considering the long-distance shooting or the wide-angle lens solution which is usually used to achieve the required shooting coverage, in order to make the shooting distance practical and avoid the image distortion caused by the wide-angle lens.
The corresponding optical photographing and shooting module may also include a plurality of photographing cameras, as shown in fig. 12, 13 and 14, that is, a plurality of cameras, and similarly, the corresponding plurality of cameras may be fixed or movable and disposed on the upper portion of the book reader facing the book, and the disposed position does not affect the reader reading the book; due to the fact that the plurality of photographing cameras are adopted, photographing coverage required by each photographing camera is greatly reduced, the plurality of photographing cameras can respectively photograph and carry out respective recognition work, and photographing results can be integrated for recognition.
In a word, the corresponding shooting process of optical recognition through the optical photographing and camera shooting module can only cover one part of the book and can also cover the whole book. In the process of identifying the book, the book may be identified by identifying an identification code (such as a bar code in fig. 15) printed on the book, or the book may be identified by identifying characters on the book, or the book may be identified by extracting image features of the book, or the book may be identified by identifying a tag attached to the book. The optical photographing and camera shooting module can also identify the page number of the book through optical photographing, for example, the page number can be identified through identifying the page number (as shown in fig. 16), or the page number can be identified through identifying characters on the page, or the page number can be identified through extracting image features of the page. In addition, the optical photographing and camera shooting module can also be used for identifying the action of a hand or a handheld object on a book, including identifying whether the current action is a book turning action, identifying the coordinate position of the action in a book page to determine the current reading position, identifying the sliding area of the action in the book page to determine the current sliding range, and taking the corresponding sliding range as the range of the current reading content.
Still referring to fig. 5, the corresponding recognition processing part is a central processing module, i.e. a first information recognition unit or a second information recognition unit, for completing the recognition processing of information by the corresponding CPU part, performing the storage processing of book information and other processing information by the corresponding storage part, and performing the communication processing with other modules by using the corresponding communication interface and input/output part, and the recognition processing part may further include a display part for displaying information during the processing, such as currently read page information or book order information. The identification processing part can also comprise an expansion storage part for expanding the storage space so as to be convenient for storing more book information. The recognition processing part can receive the information of the sensing part and complete recognition processing, and then call the corresponding audio information from the storage part and send the audio information to the sound production part, or the recognition processing part can directly recognize the text content of the content part according to the information transmitted by the sensing part, convert the corresponding text content into the audio information and send the audio information to the sound production part.
As shown in fig. 5, the sound generating portion is included in the audio unit, and includes a sound generating module and a speaker, where the sound generating module may include a codec unit and a driving unit, and is configured to receive information audio information of the central processing module, process the information audio information and transmit the processed information audio information to the speaker, so as to generate audio sound through the speaker, and the corresponding speaker may be an earphone or a sound box. The corresponding codec unit is set only when the audio information stored in the recognition processing part needs to be codec, and the codec unit may be set in the recognition processing part if necessary.
The audio information of the books stored in the recognition processing part can be any kind of voice, such as Chinese, English and the like, so that the book reader provided by the embodiment of the invention can be used for reading books of various languages. Meanwhile, the sound emitted may be a sound corresponding to the text content, or may be other preset sounds, such as a sound content, such as an explanation of the text content, and the like.
The implementation of the embodiment of the invention provides a book reader which can read common books in a natural way, and is convenient for people who cannot read the books directly to read the common books.
Furthermore, multipoint image acquisition can be realized through the book reader, and the object to be acquired can be covered by the corresponding multipoint image acquisition in a close range without distortion. Specifically, a plurality of focal lengths are provided for the corresponding movable camera or cameras, so that all parts of the collected object are at the best focal length to ensure that the images of all parts are clear. For example, referring to fig. 21, 22, 23, 24 and 25, since a multi-camera or a movable camera (e.g. a rotatable camera) is adopted, a curved surface (e.g. a large curved surface in the middle of a book) can always have a proper shooting angle and position, so that the curved surface can be effectively shot and recognized, the shooting object can be effectively shot by the corresponding shooting angle whether the shooting angle is right above or inclined from the side, and each part is in a good focal distance to obtain a clear image and good resolution. Moreover, the corresponding multi-point image acquisition has lower requirement on the resolution of the camera, or the camera with the same resolution can shoot the shot object to achieve higher resolution (more beneficial to identification).
The above description is only for the preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope of the present invention are included in the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims (9)

1. A book reader, characterized by comprising:
the book reading device comprises a first information acquisition unit, a first information identification unit and an audio unit, wherein the first information acquisition unit transmits acquired information containing book information and page number information of books to the first information identification unit, the first information identification unit determines audio information corresponding to a current reading page according to the information containing the book information and the page number information of the books and informs the audio unit, and the audio unit outputs the corresponding audio information in an audio form;
the first information acquisition unit comprises a book information acquisition module and a page number information acquisition module,
the book information acquisition module comprises a camera module,
the page number information acquisition module comprises a camera module and an infrared or ultrasonic detection module,
the infrared or ultrasonic detection module realizes detection and comprises: the turned page reflects infrared or ultrasonic waves emitted by an infrared or ultrasonic sensor group contained in the infrared or ultrasonic detection module to a sensor group receiving part contained in the infrared or ultrasonic detection module so as to realize corresponding infrared or ultrasonic detection.
2. Book reader according to claim 1,
the utility model discloses a book storage device, including book storage device, camera module and book storage device, the camera module adopts the mode of shooing to obtain information, the camera module includes a plurality of cameras, two or three or four above cameras promptly, a plurality of cameras are used for accomplishing the multi-point image shooting of multi-angle and/or multiposition, and every camera is fixed camera or movable camera, the angle of shooing and/or the position of movable camera are adjustable, movable camera is based on predetermined control mode or based on the control information of receipt or its activity of manual control in order to carry out the multi-angle and/or the multiposition multi-point image shooting to the book.
3. Book reader according to claim 1,
the camera module obtains information by adopting a photographing mode, the camera module comprises a fixed camera, the fixed camera comprises a plurality of lenses, and each lens contained in the plurality of lenses is controlled to acquire image-text content information based on a preset control mode or received control information.
4. Book reader according to claim 2,
the fixed camera comprises one or more lenses, and if the fixed camera comprises a plurality of lenses, each lens is controlled to collect the image-text content information based on a preset control mode or received control information,
each camera included in the plurality of cameras is used for collecting all or part of the image-text content information of the scene,
the camera sets up in the position that needs the regional of gathering image information includes: above the edge of the area or obliquely above or directly above.
5. Book reader according to claim 3,
the camera sets up in the position that needs the regional of gathering image information includes: above the edge of the area or obliquely above or directly above.
6. Book-reader according to any one of claims 1 to 5,
the book information acquisition module acquires image information of a book cover through the camera module as information containing the book information of the book, the first information identification unit comprises a character identification module or an image identification module or a label identification module, the character identification module determines a book name through identifying characters in the image information of the book cover, the image identification module determines the book name through identifying the image information of the book cover, and the label identification module determines the book name through identifying a label in the image information of the book cover.
7. Book-reader according to any one of claims 1 to 5,
the page number information acquisition module acquires image information of an inner page of a book as information containing the page number information through the camera module, the first information identification unit comprises an image identification module, a character identification module or a label identification module, the image identification module determines the page number of current reading by identifying the image information of the inner page of the book, the character identification module determines the page number of current reading by identifying characters or digital page numbers in the image information of the inner page of the book, and the label identification module determines the page number of current reading by identifying label information contained in the image information of the inner page of the book;
or the page number information acquisition module acquires image information of a page turning action of a user through the camera module to serve as information containing the page number information or the infrared or ultrasonic detection module acquires reflection or blocking of the infrared or ultrasonic wave of the page turning action of the user to serve as information containing the page number information, the first information identification unit comprises a page turning action identification module, and the page turning action identification module determines a currently read page number according to the image information of the page turning action of the user and current page information determined before page turning.
8. Book-reader according to any one of claims 1 to 5,
the first information identification unit comprises a first reading content identification module, the first reading content identification module identifies the audio information corresponding to the current reading page of the user according to the name of the book and the page number information and informs the audio unit,
and/or the presence of a gas in the gas,
the first information identification unit determines the name of the book and the current reading page number according to the bibliographic information and the page number information of the book, then transmits the audio information corresponding to the name of the book and/or the current reading page number to the audio unit, and the audio unit outputs the audio information corresponding to the name of the book and/or the current reading page number in an audio mode.
9. Book-reader according to any one of claims 1 to 5,
the audio unit also comprises a recording module used for acquiring audio information;
and/or the presence of a gas in the gas,
the book reader also comprises a storage unit, a reading unit and a processing unit, wherein the storage unit is used for storing audio information and/or storing image and character information obtained in the acquisition and identification process and/or storing externally obtained content information;
and/or the presence of a gas in the gas,
the book reader also comprises a display unit for displaying set content information and/or image and character information acquired in the acquisition and identification process and/or externally acquired content information;
and/or the presence of a gas in the gas,
the book reader also comprises a communication unit used for communicating with a computer;
and/or the presence of a gas in the gas,
the book reader also comprises an interactive processing module which is used for acquiring interactive operation control information of a reading user and executing preset interactive operation according to the interactive operation control information, wherein the interactive operation control information comprises at least one of limb actions, actions of operating objects, voice information, screen input or operation keys.
CN201410028668.7A 2013-01-25 2014-01-21 A kind of book reader Expired - Fee Related CN103761893B (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
CN201811229624.5A CN109300343A (en) 2013-01-25 2014-01-21 A kind of picture and text identification device
CN201710960784.6A CN107742446A (en) 2013-01-25 2014-01-21 Book reader
CN201711303666.4A CN107967824A (en) 2013-01-25 2014-01-21 A kind of picture and text give directions identification device of taking pictures
CN201410028668.7A CN103761893B (en) 2013-01-25 2014-01-21 A kind of book reader

Applications Claiming Priority (7)

Application Number Priority Date Filing Date Title
CN2013200406389 2013-01-25
CN2013100281744 2013-01-25
CN201320040638.9 2013-01-25
CN201310028174.4 2013-01-25
CN201320040638 2013-01-25
CN201310028174 2013-01-25
CN201410028668.7A CN103761893B (en) 2013-01-25 2014-01-21 A kind of book reader

Related Child Applications (3)

Application Number Title Priority Date Filing Date
CN201711303666.4A Division CN107967824A (en) 2013-01-25 2014-01-21 A kind of picture and text give directions identification device of taking pictures
CN201710960784.6A Division CN107742446A (en) 2013-01-25 2014-01-21 Book reader
CN201811229624.5A Division CN109300343A (en) 2013-01-25 2014-01-21 A kind of picture and text identification device

Publications (2)

Publication Number Publication Date
CN103761893A CN103761893A (en) 2014-04-30
CN103761893B true CN103761893B (en) 2018-11-16

Family

ID=50529124

Family Applications (7)

Application Number Title Priority Date Filing Date
CN201710012059.6A Withdrawn CN106803864A (en) 2013-01-25 2014-01-21 Certain graphics context collection identifying device
CN201710012058.1A Withdrawn CN106791262A (en) 2013-01-25 2014-01-21 Graphics context collection identifying device
CN201710012060.9A Withdrawn CN106791263A (en) 2013-01-25 2014-01-21 One class graphics context collection identifying device
CN201420037927.8U Expired - Fee Related CN203773763U (en) 2013-01-25 2014-01-21 Book reader
CN201410028668.7A Expired - Fee Related CN103761893B (en) 2013-01-25 2014-01-21 A kind of book reader
CN201420038757.5U Expired - Fee Related CN204046697U (en) 2013-01-25 2014-01-21 A kind of graphics context collection recognition device
CN201410027696.7A Expired - Fee Related CN103763453B (en) 2013-01-25 2014-01-21 A kind of graphics context collection identification device

Family Applications Before (4)

Application Number Title Priority Date Filing Date
CN201710012059.6A Withdrawn CN106803864A (en) 2013-01-25 2014-01-21 Certain graphics context collection identifying device
CN201710012058.1A Withdrawn CN106791262A (en) 2013-01-25 2014-01-21 Graphics context collection identifying device
CN201710012060.9A Withdrawn CN106791263A (en) 2013-01-25 2014-01-21 One class graphics context collection identifying device
CN201420037927.8U Expired - Fee Related CN203773763U (en) 2013-01-25 2014-01-21 Book reader

Family Applications After (2)

Application Number Title Priority Date Filing Date
CN201420038757.5U Expired - Fee Related CN204046697U (en) 2013-01-25 2014-01-21 A kind of graphics context collection recognition device
CN201410027696.7A Expired - Fee Related CN103763453B (en) 2013-01-25 2014-01-21 A kind of graphics context collection identification device

Country Status (1)

Country Link
CN (7) CN106803864A (en)

Families Citing this family (42)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106803864A (en) * 2013-01-25 2017-06-06 陈旭 Certain graphics context collection identifying device
CN104199834B (en) * 2014-08-04 2018-11-27 徐�明 The method and system for obtaining remote resource from information carrier surface interactive mode and exporting
CN104157171B (en) * 2014-08-13 2016-11-09 三星电子(中国)研发中心 A kind of point-of-reading system and method thereof
CN104217197B (en) * 2014-08-27 2018-04-13 华南理工大学 A kind of reading method and device of view-based access control model gesture
US9973671B2 (en) * 2014-08-27 2018-05-15 Symbol Technologies, Llc Method and apparatus for directing data capture devices in a mobile unit with a single operation
CN104202640B (en) * 2014-08-28 2016-03-30 深圳市国华识别科技开发有限公司 Based on intelligent television intersection control routine and the method for image recognition
CN104793852A (en) * 2015-04-02 2015-07-22 广东小天才科技有限公司 Method and device for detecting page turning action on point reading machine
CN104766501B (en) * 2015-04-09 2017-07-14 广东小天才科技有限公司 Point reading machine and coordinate correction method thereof
CN105046253B (en) * 2015-06-24 2018-05-11 山西同方知网数字出版技术有限公司 A kind of paper strip of paper used for sealing automatic recognition system and method based on OCR
CN105139699A (en) * 2015-08-04 2015-12-09 广东小天才科技有限公司 Automatic page turning method and device
CN105447499B (en) * 2015-10-23 2018-09-04 北京爱乐宝机器人科技有限公司 A kind of books interactive approach, device and equipment
CN106408560B (en) * 2016-09-05 2020-01-03 广东小天才科技有限公司 Method and device for rapidly acquiring effective image
CN106515258B (en) * 2016-11-10 2017-12-19 深圳市科迈爱康科技有限公司 Notebook, intelligent terminal and notebook content indexing creation method
CN108242233B (en) * 2016-12-26 2020-11-03 腾讯科技(深圳)有限公司 Audio data playing method and device
CN107085724A (en) * 2017-03-31 2017-08-22 上海斐讯数据通信技术有限公司 A kind of book pages information carrying means and method
CN107657747A (en) * 2017-10-17 2018-02-02 梁北洪 A kind of books, system of studying at school on a temporary basis and its encouragement reading method
CN107977694B (en) * 2017-11-28 2021-07-13 倍仪昇智能科技(苏州)有限公司 Automatic analysis system for photographing, inputting and identifying samples
CN108156374B (en) * 2017-12-25 2020-12-08 努比亚技术有限公司 Image processing method, terminal and readable storage medium
CN108257615A (en) * 2018-01-15 2018-07-06 北京物灵智能科技有限公司 A kind of user language appraisal procedure and system
CN108536287B (en) * 2018-03-26 2021-03-02 深圳市同维通信技术有限公司 Method and device for reading according to user instruction
CN108762507B (en) * 2018-05-30 2021-05-04 辽东学院 Image tracking method and device
CN108845786A (en) * 2018-05-31 2018-11-20 北京智能管家科技有限公司 Intelligent reading partner method, apparatus, equipment and storage medium
CN108875694A (en) * 2018-07-04 2018-11-23 百度在线网络技术(北京)有限公司 Speech output method and device
WO2020034519A1 (en) * 2018-08-17 2020-02-20 中国图书进出口(集团)大连有限公司 Spatial audio reading system and method
CN109448453B (en) * 2018-10-23 2021-10-12 昆明微想智森科技股份有限公司 Point reading question-answering method and system based on image recognition tracking technology
CN109703232A (en) * 2018-11-30 2019-05-03 数景智能科技(宁波)有限公司 A kind of intelligence books note
CN109726697B (en) * 2019-01-04 2021-07-20 北京灵优智学科技有限公司 Online video system and method integrating AV video communication and AI real object identification
CN109753554B (en) * 2019-01-14 2021-03-30 广东小天才科技有限公司 Searching method based on three-dimensional space positioning and family education equipment
CN111583734A (en) * 2019-02-19 2020-08-25 阿里巴巴集团控股有限公司 Touch reading method and touch reading pen
CN111695372B (en) * 2019-03-12 2023-10-27 阿里巴巴集团控股有限公司 Click-to-read method and click-to-read data processing method
CN110060524A (en) * 2019-04-30 2019-07-26 广东小天才科技有限公司 Robot-assisted reading method and reading robot
CN110287881A (en) * 2019-06-26 2019-09-27 上海交通大学 Books identifying system, books recognition methods, electronic device and storage medium
CN110489005B (en) * 2019-06-28 2022-12-27 浙江工业大学 Two-dimensional point display with touch positioning function and two-dimensional contact driving method thereof
CN110992738A (en) * 2019-10-21 2020-04-10 北京十分科技有限公司 Automatic reading method and device for reading material
CN111178348B (en) * 2019-12-09 2024-03-22 广东小天才科技有限公司 Method for tracking target object and sound box equipment
CN110949037A (en) * 2019-12-16 2020-04-03 中国工程物理研究院激光聚变研究中心 Automatic identification and ejection device for file box
CN111027341A (en) * 2019-12-28 2020-04-17 安徽硕威智能科技有限公司 Interaction method, device and system based on OID two-dimensional password identification and storage medium thereof
CN111698384B (en) * 2020-06-22 2022-06-21 上海肇观电子科技有限公司 Image processing apparatus
CN111701883A (en) * 2020-07-01 2020-09-25 湖南德荣医疗器械物流配送服务有限公司 Intelligent sorting equipment and method for intelligent warehousing
CN112329563A (en) * 2020-10-23 2021-02-05 复旦大学 Intelligent reading auxiliary method and system based on raspberry pie
CN112258911B (en) * 2020-11-12 2021-11-09 吉林农业科技学院 English word memory device based on time delay detects
CN113496637B (en) * 2021-06-18 2023-01-03 湖南华壹影业有限公司 Auxiliary training system for image information space-time scanning

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN2786695Y (en) * 2005-04-06 2006-06-07 极鼎科技股份有限公司 Interactive studying equipment
CN201364654Y (en) * 2009-03-11 2009-12-16 中国长城计算机深圳股份有限公司 Book point-reading system
CN101676970A (en) * 2008-09-16 2010-03-24 深圳市王菱科技开发有限公司 Reading processing system with multiple electronic read data functions

Family Cites Families (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1202471C (en) * 2001-09-19 2005-05-18 力新国际科技股份有限公司 Book makign system and method
US7660458B1 (en) * 2004-12-14 2010-02-09 Google Inc. Three-dimensional model construction using unstructured pattern
CN2807364Y (en) * 2005-06-24 2006-08-16 赵舜培 Electronic learning auxiliary device
CN200944633Y (en) * 2006-08-15 2007-09-05 沈洪 Multi-scene imaging apparatus
CN1952974B (en) * 2006-11-10 2010-06-09 中山大学 Automatic pinpoint system and method of books in library
CN201035576Y (en) * 2006-12-20 2008-03-12 北京恒基伟业投资发展有限公司 Device of implementing instant translation using digital camera technique
CN201097383Y (en) * 2007-01-12 2008-08-06 林良锐 Book hearing machine
CN201063025Y (en) * 2007-05-11 2008-05-21 葛宇 Detecting apparatus with multiple angle camera head
CN201194112Y (en) * 2008-05-12 2009-02-11 刘建生 Video shooting type multifunctional click-to-read machine
CN101630193A (en) * 2008-07-15 2010-01-20 张雪峰 Hand induction equipment
CN201294001Y (en) * 2008-11-26 2009-08-19 佛山市安讯智能科技有限公司 Recognizer for collecting and processing image words
US8332741B2 (en) * 2008-12-08 2012-12-11 Qurio Holdings, Inc. Method and system for on-demand narration of a customized story
CN201315627Y (en) * 2008-12-30 2009-09-23 蒋清晓 Multifunctional portable-type electronic typoscope
CN101527828B (en) * 2009-04-14 2011-08-10 华为终端有限公司 Image acquisition equipment
CN201540655U (en) * 2009-05-13 2010-08-04 崔伟 Phonic book
CN102110332B (en) * 2009-12-24 2013-01-09 上海阿艾依智控***有限公司 Book registering and managing device based on computer vision and radio frequency identification technology
CN101776953A (en) * 2009-12-29 2010-07-14 胡世曦 Optical positioning method and finger mouse integrated with keyboard
CN201611477U (en) * 2010-03-12 2010-10-20 北京汇冠新技术股份有限公司 Optical touch screen
CN201622581U (en) * 2010-04-08 2010-11-03 陶懿 Processing device of image taking and character recognition
CN101833663B (en) * 2010-04-21 2012-10-10 北方工业大学 Binocular electronic reader
CN202551228U (en) * 2012-02-16 2012-11-21 北京奥美达科技有限公司 Visual aid
CN102566603A (en) * 2012-02-29 2012-07-11 天津天地伟业数码科技有限公司 Architecture and method for positioning dome camera
CN102682608B (en) * 2012-05-16 2014-02-19 江苏尤特斯新技术有限公司 Method for image forensics of motor vehicle plate covering and staining behaviors
CN106803864A (en) * 2013-01-25 2017-06-06 陈旭 Certain graphics context collection identifying device

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN2786695Y (en) * 2005-04-06 2006-06-07 极鼎科技股份有限公司 Interactive studying equipment
CN101676970A (en) * 2008-09-16 2010-03-24 深圳市王菱科技开发有限公司 Reading processing system with multiple electronic read data functions
CN201364654Y (en) * 2009-03-11 2009-12-16 中国长城计算机深圳股份有限公司 Book point-reading system

Also Published As

Publication number Publication date
CN106791262A (en) 2017-05-31
CN103763453B (en) 2019-09-10
CN106803864A (en) 2017-06-06
CN203773763U (en) 2014-08-13
CN204046697U (en) 2014-12-24
CN103763453A (en) 2014-04-30
CN103761893A (en) 2014-04-30
CN106791263A (en) 2017-05-31

Similar Documents

Publication Publication Date Title
CN103761893B (en) A kind of book reader
CN109300343A (en) A kind of picture and text identification device
EP3258423B1 (en) Handwriting recognition method and apparatus
Matusiak et al. Object recognition in a mobile phone application for visually impaired users
Nanayakkara et al. EyeRing: a finger-worn input device for seamless interactions with our surroundings
US8538087B2 (en) Aiding device for reading a printed text
CN110287918B (en) Living body identification method and related product
CN104106078B (en) Optical character recognition OCR (OCR) cache memory updates
CN110084192B (en) Rapid dynamic gesture recognition system and method based on target detection
CN107066081B (en) Interactive control method and device of virtual reality system and virtual reality equipment
CN104835361B (en) A kind of electronic dictionary
CN108287903A (en) Question searching method combined with projection and intelligent pen
CN108353129A (en) Capture apparatus and its control method
CN112749646A (en) Interactive point-reading system based on gesture recognition
CN111539408A (en) Intelligent point reading scheme based on photographing and object recognizing
US20230050987A1 (en) Apparatus for fastening an imaging device at a predetermined arrangement for image capture and detecting regions of interest in an image using image processing
CN108280184A (en) Test question extracting method and system based on intelligent pen and intelligent pen
Nguyen et al. Vietnamese sign language reader using Intel Creative Senz3D
Chauhan et al. Ikshana: Intelligent Assisting system for visually challenged people
Krishna et al. Word Based Text Extraction Algorithm Implementation in Wearable Assistive Device for the Blind
TW201105135A (en) A video detecting and monitoring method with adaptive detection cells and a system thereof
Subha Rajam et al. Design and development of tamil sign alphabets using image processing with right hand palm to aid deaf-dumb people
KR100983779B1 (en) Book information service apparatus and method thereof
Matusiak et al. A mobile phone application for recognizing objects as a personal aid for the visually impaired users
Kirubananthavalli et al. Convolutional Neural Network-Based Hand Gesture Recognizer

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20181116

Termination date: 20210121