CN108197299B

CN108197299B - Photographing and question searching method and system based on handheld photographing equipment

Info

Publication number: CN108197299B
Application number: CN201810069882.5A
Authority: CN
Inventors: 徐杨
Original assignee: Shenzhen China Star Optoelectronics Technology Co Ltd
Current assignee: TCL China Star Optoelectronics Technology Co Ltd
Priority date: 2018-01-24
Filing date: 2018-01-24
Publication date: 2020-07-24
Anticipated expiration: 2038-01-24
Also published as: CN108197299A

Abstract

A photographing question searching method and system based on a handheld photographing device comprise the following steps: the handheld photographing device outputs a photographing indication frame according to the starting instruction, detects whether the vertical distance between the center of a camera lens on the handheld photographing device and the subject paper surface is larger than a preset single-subject photographing distance, and if so, acquires a photographing range and a photographing focal length which are matched with the vertical distance, and adjusts the length and the width of the photographing indication frame according to the photographing range to obtain an adjusted photographing indication frame; the handheld photographing device executes photographing operation according to the photographing instruction and the photographing focal length to obtain a title picture and sends the title picture to the electronic device; the electronic equipment displays the topic picture, determines a target sub-picture containing a target topic from the topic picture, and sends the target sub-picture to the server, so that the server can identify the target topic and feed back the matched topic answer to the electronic equipment for output. By implementing the embodiment of the invention, a plurality of questions can be shot and uploaded for searching by the handheld shooting equipment, the operation is convenient and fast, and the question searching efficiency is high.

Description

Photographing and question searching method and system based on handheld photographing equipment

Technical Field

The invention relates to the technical field of electronic equipment, in particular to a photographing and question searching method and system based on handheld photographing equipment.

Background

At present, more and more search-question applications are available, and when an unknown question is encountered, a student user can search the question answer corresponding to the question through the search-question applications on electronic equipment such as a tablet computer and a student mobile phone. The answer search for the subject by the student user is generally as follows: starting a problem searching application program installed on the electronic equipment, and then acquiring a problem answer fed back by a server on the electronic equipment after a series of operations such as camera starting, focusing photographing, problem intercepting, screenshot confirmation, screenshot uploading and the like are performed in the started problem searching application program, so that the operation is complicated and time is consumed; on the other hand, when multiple subjects are not available on the same page, the student user can only take pictures one by one and upload pictures of each taken subject one by one, and the operation is complicated and mistakes are easily made. Therefore, the existing method for searching the questions is very complicated in operation steps, so that the time for searching the questions is long, and the efficiency for searching the questions is low.

Disclosure of Invention

The embodiment of the invention discloses a photographing and question searching method and system based on a handheld photographing device, which can photograph a plurality of questions simultaneously through the handheld photographing device and upload the questions to a server for searching, are convenient and fast to operate, and improve the question searching efficiency.

The first aspect of the embodiment of the invention discloses a photographing question searching method based on a handheld photographing device, which comprises the following steps:

the handheld photographing device outputs a photographing instruction frame for indicating a region to be photographed according to the detected starting instruction, and detects whether the vertical distance between the center of a lens of a camera on the handheld photographing device and the paper surface of the question is larger than a preset single-question photographing distance or not;

if the shooting distance is greater than the preset shooting distance, the handheld shooting equipment acquires a shooting range matched with the vertical distance and a shooting focal length matched with the shooting range, and adjusts the length and the width of the shooting indicating frame according to the shooting range to obtain an adjusted shooting indicating frame;

the handheld photographing device carries out photographing operation on at least two questions in the adjusted photographing instruction frame according to the detected photographing instruction and the photographing focal length to obtain a question picture, and sends the question picture to the electronic device which is in communication connection with the handheld photographing device;

the electronic equipment displays the topic picture, determines a target sub-picture containing a target topic from the topic picture, and sends the target sub-picture to a server, so that the server identifies the target topic contained in the target sub-picture and feeds back a matched topic answer corresponding to the target topic to the electronic equipment;

and the electronic equipment receives and outputs the topic answers fed back by the server.

The second aspect of the embodiment of the present invention discloses a photographing and topic searching system based on a handheld photographing device, which includes the handheld photographing device, a server and an electronic device establishing a communication connection with the handheld photographing device, wherein the handheld photographing device includes:

the first output unit is used for outputting a photographing instruction frame for indicating a region to be photographed according to the detected starting instruction;

the detection unit is used for detecting whether the vertical distance between the center of a lens of a camera on the handheld photographing equipment and the question paper surface is larger than the preset single-question photographing distance or not;

the first acquisition unit is used for acquiring a photographing range matched with the vertical distance and a photographing focal length matched with the photographing range when the detection unit detects that the vertical distance is greater than the preset single-subject photographing distance;

the adjusting unit is used for adjusting the length and the width of the photographing instruction frame output by the first output unit according to the photographing range acquired by the first acquiring unit to obtain an adjusted photographing instruction frame;

the shooting unit is used for carrying out shooting operation on at least two questions in the adjusted shooting instruction frame according to the shooting focal length obtained by the first obtaining unit according to the detected shooting instruction to obtain a question picture;

the first sending unit is used for sending the theme picture obtained by the photographing unit to the electronic equipment;

wherein the electronic device comprises:

the display unit is used for displaying the theme picture sent by the first sending unit;

the target determining unit is used for determining a target sub-picture containing a target title from the title pictures displayed by the display unit;

the second sending unit is used for sending the target sub-picture determined by the target determining unit to a server;

wherein the server comprises:

the identification matching unit is used for identifying the target topic contained in the target sub-picture sent by the second sending unit and matching the topic answer corresponding to the target topic;

the third sending unit is used for feeding back the question answer obtained by the identification matching unit to the electronic equipment;

the electronic device further includes:

the receiving unit is used for receiving the question answers fed back by the third sending unit;

and the second output unit is used for outputting the answer to the question received by the receiving unit.

The embodiment of the invention discloses a handheld photographing device in three aspects, which comprises:

a memory storing executable program code;

a processor coupled with the memory;

the processor calls the executable program code stored in the memory to execute part or all of the steps of any one of the methods disclosed in the first aspect of the embodiments of the present invention.

A fourth aspect of the present embodiments discloses a computer-readable storage medium storing a program code, where the program code includes instructions for performing some or all of the steps of any one of the methods disclosed in the first aspect of the present embodiments.

A fifth aspect of the embodiments of the present invention discloses a computer program product, which, when running on a computer, causes the computer to perform part or all of the steps of any one of the methods disclosed in the first aspect of the embodiments of the present invention.

A sixth aspect of the present embodiment discloses an application publishing platform, where the application publishing platform is configured to publish the computer program product, and when the computer program product runs on a computer, the computer is caused to perform part or all of the steps of any one of the methods disclosed in the first aspect of the present embodiment.

Compared with the prior art, the embodiment of the invention has the following beneficial effects:

in the embodiment of the invention, the handheld photographing device firstly detects whether a starting instruction triggered by a user is received, and outputs a photographing instruction frame according to the starting instruction after detecting that the starting instruction is received, wherein the photographing instruction frame is used for indicating an area to be photographed; then, the handheld shooting equipment detects whether the vertical distance between the center of a lens of a camera on the handheld shooting equipment and the question paper surface is larger than a preset single-question shooting distance or not; if the vertical distance is detected to be larger than the preset single-subject photographing distance, the handheld photographing device obtains a photographing range matched with the vertical distance and a photographing focal length matched with the photographing range, and then the handheld photographing device adjusts the length and the width of the photographing indication frame according to the photographing range to obtain the adjusted photographing indication frame; then, the handheld photographing device carries out photographing operation on at least two questions in the adjusted photographing instruction frame according to the detected photographing instruction and the obtained photographing focal length to obtain a question picture, and sends the question picture to the electronic device which is in communication connection with the electronic device; further, the electronic equipment displays the topic picture, determines a target sub-picture containing a target topic from the topic picture according to a selection instruction input by a user, and sends the target sub-picture to the server, so that the server identifies the target topic contained in the target sub-picture, and feeds back a matched topic answer corresponding to the target topic to the electronic equipment; and finally, the electronic equipment receives the question answers fed back by the server and outputs the question answers for the user to browse. Therefore, by implementing the embodiment of the invention, the topic contents of at least two topics can be shot at one time through the handheld photographing device, and the topic contents of the at least two topics are transmitted to the electronic device which is in communication connection with the handheld photographing device, so that the electronic device displays the topic answers corresponding to the target topics selected by the user, thereby simplifying the operation steps and improving the topic searching efficiency.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without creative efforts.

Fig. 1 is a schematic flow chart of a photographing question searching method based on a handheld photographing device according to an embodiment of the present invention;

FIG. 2 is a schematic flowchart of another photographing question searching method based on a handheld photographing device according to an embodiment of the present disclosure;

FIG. 3 is a schematic flowchart of another photographing question searching method based on a handheld photographing device according to an embodiment of the present disclosure;

fig. 4 is a schematic structural diagram of a photographing question searching system based on a handheld photographing device disclosed in the embodiment of the present invention;

fig. 5 is a schematic structural diagram of another photographing question searching system based on a handheld photographing device according to an embodiment of the present invention;

fig. 6 is a schematic structural diagram of another photographing question searching system based on a handheld photographing device according to an embodiment of the present invention;

FIG. 7 is a schematic diagram of a photographing question searching method based on a handheld photographing device according to an embodiment of the present invention;

FIG. 8 is a schematic diagram illustrating a search result according to an embodiment of the present invention;

fig. 9 is a block diagram of a partial structure of a handheld photographing device according to an embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

It is to be noted that the terms "comprises" and "comprising" and any variations thereof in the embodiments and drawings of the present invention are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.

The embodiment of the invention discloses a photographing and question searching method and system based on a handheld photographing device, which can photograph a plurality of questions simultaneously through the handheld photographing device and upload the questions to a server for searching, are convenient and fast to operate, and improve the question searching efficiency. The following are detailed below.

Example one

Referring to fig. 1, fig. 1 is a schematic flowchart illustrating a photographing question searching method based on a handheld photographing device according to an embodiment of the present invention. As shown in fig. 1, the photographing question searching method based on the handheld photographing device may include the following steps:

101. and outputting a photographing instruction frame for indicating the region to be photographed by the handheld photographing equipment according to the detected starting instruction.

In the embodiment of the present invention, the handheld photographing device may include any one of a search pen, a scan pen, a photographing pen, and the like. The photographing indication frame may be a closed photographing indication frame, such as a photographing indication frame composed of four straight lines or four curved lines, or may be an open photographing indication frame, such as a photographing indication frame composed of four corner frames, and the like.

102. The handheld photographing device detects whether the vertical distance between the center of a lens of a camera on the handheld photographing device and the question paper surface is greater than a preset single-question photographing distance or not, and if the vertical distance is greater than the preset single-question photographing distance, the step 104 to the step 107 are executed; and if the shooting distance is less than or equal to the preset shooting distance of the single question, executing the step 103 to the step 107.

103. And the handheld photographing equipment continuously outputs distance adjustment prompt information until the adjusted vertical distance is larger than the preset single-question photographing distance, and the distance adjustment prompt information is used for prompting a user to adjust the vertical distance.

104. The handheld photographing device acquires a photographing range matched with the vertical distance and a photographing focal length matched with the photographing range, and adjusts the length and the width of the photographing indicating frame according to the photographing range to obtain the adjusted photographing indicating frame.

In the embodiment of the invention, the handheld photographing device can acquire the photographing range matched with the vertical distance and the photographing focal length matched with the photographing range from the database stored in the handheld photographing device, and can also acquire the photographing range matched with the vertical distance and the photographing focal length matched with the photographing range from the database of the server, so that the aims of quickly adjusting the length and the width of the photographing instruction frame according to the photographing range and quickly focusing to photograph the title are fulfilled, and the efficiency of photographing and searching the title is improved.

105. And the handheld photographing equipment performs photographing operation on at least two questions in the adjusted photographing instruction frame according to the detected photographing instruction and the photographing focal length to obtain question pictures, and sends the question pictures to the electronic equipment which is in communication connection with the handheld photographing equipment.

In the embodiment of the invention, after the photographing instruction is detected, the handheld photographing device can quickly focus at least two questions in the adjusted photographing instruction frame and perform photographing operation according to the obtained photographing focal length, so that the time for adjusting the photographing focal length is saved, the photographing speed is increased, and the efficiency of searching the questions is improved.

In this embodiment of the present invention, the electronic device may be an intelligent electronic device such as a smart phone (e.g., an Android phone, an iOS phone, etc.), a tablet computer, a palm computer, a Mobile Internet Device (MID), a PC, etc., which is not limited in this embodiment of the present invention. The operating system of each type of terminal device may include, but is not limited to, an Android operating system, an IOS operating system, a Symbian operating system, a Black Berry operating system, a windows phone8 operating system, and the like, which is not limited in the embodiment of the present invention.

In the embodiment of the present invention, it should be noted that, while the electronic device displays the topic picture, the electronic device may also send the topic picture to the server, so as to trigger the server to identify all topics in the topic picture, obtain topic answers of all topics from the topic database in a matching manner, and feed the topic answers back to the electronic device. After receiving the topic answer fed back by the server, the electronic device may further detect whether a viewing instruction of the user is received, and when the detection result is yes, output the topic answer of the target topic corresponding to the viewing instruction for reference by the user, where the viewing instruction may be a click instruction, and the target topic is determined according to a click position of the click instruction.

106. The electronic equipment displays the topic picture, determines a target sub-picture containing a target topic from the topic picture, and sends the target sub-picture to the server, so that the server identifies the target topic contained in the target sub-picture and feeds back a matched topic answer corresponding to the target topic to the electronic equipment.

In an embodiment of the present invention, the at least two titles include the target title.

As an optional implementation manner, after the electronic device sends the target sub-picture to the server, the server may further perform the following steps:

the server receives the target sub-picture and performs character recognition on a target topic in the target sub-picture to obtain target character information corresponding to the target topic;

the server matches the question answer corresponding to the target text data from the question bank of the server, sends the question answer corresponding to the target text data to the electronic device, and triggers step 107 that the electronic device receives and outputs the question answer fed back by the server.

It can be seen that, by implementing the method described in fig. 1, the handheld photographing device can photograph the topic contents of at least two topics at one time, and transmit the topic contents of the at least two topics to the electronic device that establishes communication connection with the handheld photographing device, so that the electronic device displays the topic answer corresponding to the target topic selected by the user, thereby simplifying the operation steps and improving the topic searching efficiency.

Example two

Referring to fig. 2, fig. 2 is a schematic flowchart illustrating another photographing question searching method based on a handheld photographing device according to an embodiment of the present invention. As shown in fig. 2, the photographing question searching method based on the handheld photographing device may include the following steps:

201. and outputting a photographing instruction frame for indicating the region to be photographed by the handheld photographing equipment according to the detected starting instruction.

In the embodiment of the present invention, the photographing instruction frame may be a rectangular frame formed by the optical signal output by the built-in laser source of the handheld photographing apparatus on the paper to be photographed, or may be a highlight region formed by the optical signal output by the built-in laser source of the handheld photographing apparatus on the paper to be photographed. The intensity of the optical signal output by the built-in laser source in the handheld photographing device may be automatically adjusted according to the intensity of the ambient light, or may be adjusted according to a control instruction input by a user.

In this embodiment of the present invention, the light source that is built in the handheld photographing apparatus and used for outputting the photographing instruction frame may be an L ED light source, or a laser source, or a mixed light source, and the embodiment of the present invention is not limited.

The handheld photographing device can output a high-quality photographing indication frame through the mixed light source, and meanwhile, the service life of the handheld photographing device can be prolonged and the user experience can be improved by adopting the mixed light source.

As an optional implementation manner, after detecting that the start instruction is received, the handheld photographing apparatus outputs a photographing instruction frame according to the start instruction, and may include the following steps:

when the pressing intensity of the physical key pressed by the user is detected to be light, the handheld photographing equipment is connected with a laser source circuit to start the laser source to output a photographing instruction frame;

the handheld photographing device outputs a starting prompt tone to prompt a user to be ready and can execute photographing operation at any time;

in the embodiment of the invention, the user can trigger the starting instruction through the physical key on the handheld photographing device. The power-on prompt tone can be output by a loudspeaker of the handheld photographing device. The handheld photographing device can also be provided with a prompting light source, and when the fact that the pressing intensity of the physical key pressed by the user is light is detected, the prompting light source can be started to prompt the user that the pressing intensity of the physical key pressed by the user is light. The prompt light source may be a light source ring surrounding the physical key for a circle, or may be a cover light source covering the physical key, which is not limited in the embodiments of the present invention.

202. The handheld photographing device detects whether the vertical distance between the center of a lens of a camera on the handheld photographing device and the question paper surface is greater than a preset single-question photographing distance, and if the vertical distance is greater than the preset single-question photographing distance, the steps 203 to 204 and the steps 213 to 215 are executed; if the distance is less than or equal to the preset shooting distance, step 205 to step 208 are executed.

In the embodiment of the present invention, taking the size of the theme paper as an example of a4 paper, when a photographing instruction frame output by the handheld photographing device frames all theme contents on the theme paper, the handheld photographing device can detect that the distance between the center of a lens of a camera on the handheld photographing device and the theme paper is 16 cm. The preset single-subject photographing distance can be set to be 15cm, 10cm and the like, and the embodiment of the invention is not limited.

203. The handheld photographing device acquires a photographing range matched with the vertical distance and a photographing focal length matched with the photographing range, and adjusts the length and the width of the photographing indicating frame according to the photographing range to obtain the adjusted photographing indicating frame.

204. And the handheld photographing device performs photographing operation on at least two questions in the adjusted photographing instruction frame according to the detected photographing instruction and the photographing focal length to obtain a question picture, and performs step 213.

205. The handheld photographing device obtains the shooting range of the single question matched with the vertical distance and the shooting focal length of the single question matched with the shooting range of the single question, and adjusts the length and the width of the photographing indicating frame according to the shooting range of the single question to obtain the shooting indicating frame of the single question.

206. The handheld photographing device acquires first picture content in the single-subject photographing instruction frame and second picture content captured by a camera on the handheld photographing device.

In the embodiment of the invention, when the handheld photographing device detects that the vertical distance between the center of the lens of the camera on the handheld photographing device and the theme paper surface is smaller than or equal to the preset single-theme photographing distance, the theme to be searched by the user at the moment is a part of themes included in the theme paper surface. At this time, the single-topic photographing instruction frame output by the handheld photographing device is mainly used for indicating a photographing position, that is, indicating a position of a target topic, the handheld photographing device can acquire first picture content in the single-topic photographing instruction frame, the first picture content can include partial topic content of the target topic or all topic content of the target topic, and meanwhile, the handheld photographing device can also acquire second picture content captured by a camera on the handheld photographing device, and the second picture content includes all topic content of the target topic.

207. When the first picture content comprises partial title content of the target single title, the handheld photographing device obtains line spacing values between every two lines of characters which are sequentially adjacent in the first picture content in a first preset direction, and a first line spacing set is obtained.

In this embodiment of the present invention, the first preset direction may be from top to bottom according to the increasing direction of the topic serial numbers, or from bottom to top according to the increasing direction of the topic serial numbers, which is not limited in this embodiment of the present invention.

208. The handheld photographing device determines whether all the line spacing values in the first line spacing set are equal, and if all the line spacing values are equal, step 209 and steps 211 to 215 are executed; if all the line spacing values are not equal, step 210-step 215 are performed.

As an optional implementation manner, when the handheld photographing device determines that all the line spacing values are not equal, the method may further include the following steps:

the handheld photographing equipment identifies the to-be-determined character area in the first picture according to the color difference between the character color and the background color;

the handheld photographing equipment determines a character area comprising the question mark from the character area to be determined according to the question mark naming rule to serve as a target area;

the handheld photographing device determines target content from a target area in the first picture.

In this embodiment of the present invention, the title template form of the preset title naming rule may include, but is not limited to, a form of numeric characters (e.g., roman numerals, chinese numerals, etc.) plus punctuation characters (e.g., pause signs, colon signs, etc.), and a form of numeric characters plus chinese parentheses, such as (1), (2), etc., which is not limited in this embodiment of the present invention.

209. And the handheld photographing device determines the first picture content as the target content.

210. The handheld photographing device determines a first target line spacing value larger than a first preset line spacing value from the first line spacing set, determines an area between two lines of characters which are adjacent in sequence and correspond to all the first target line spacing values as a first blank area, and determines target content from first picture content according to the first blank area.

In the embodiment of the present invention, the first preset line spacing value may be set to a single line spacing, a fixed line spacing (e.g., 23 lbs), and the like, and the embodiment of the present invention is not limited thereto.

As an optional implementation manner, the determining, by the handheld photographing apparatus, the target content from the first picture content according to the first blank area may include the following steps:

the handheld photographing equipment acquires the number of the first blank areas included in the first picture;

if the number of the first blank areas included in the first picture is at most one, the handheld photographing equipment identifies the character areas on the upper side and the lower side of the first blank area according to the color difference between the character color and the background color to obtain an upper character area and a lower character area;

the handheld photographing equipment determines a text area comprising the question mark from the upper text area and the lower text area according to the question mark naming rule to be used as a target area;

As an optional implementation manner, if the number of the first blank regions included in the first picture is at least two, the method may further include the following steps:

the handheld photographing device acquires a character area between two blank areas adjacent in sequence according to the first blank area as a target area;

211. And the handheld photographing equipment determines all the title contents of the target single title from the second picture contents according to the target contents.

In the embodiment of the present invention, after the step 207 to the step 211 are executed, when the first picture content includes a part of topic contents of the target topic, the handheld photographing device may determine all topic contents of the target topic from the second picture content according to the first picture content. At this time, all the topic contents of the target topic determined by the handheld photographing device include both the partial picture content of the first picture or all the picture contents of the first picture, and the partial picture content of the second picture.

212. And the handheld photographing equipment executes imaging operation on all the topic contents of the target topic according to the detected photographing instruction and the topic photographing focal length to obtain a topic picture.

213. And the handheld photographing equipment sends the theme picture to the electronic equipment which establishes communication connection with the handheld photographing equipment.

In the embodiment of the present invention, the handheld photographing device and the electronic device establish a communication connection by accessing to the same WIreless-Fidelity (WiFi), and the handheld photographing device may also establish a communication connection with the electronic device by using a Bluetooth (Bluetooth) communication technology.

214. The electronic equipment displays the topic picture, determines a target sub-picture containing a target topic from the topic picture, and sends the target sub-picture to the server, so that the server identifies the target topic contained in the target sub-picture and feeds back a matched topic answer corresponding to the target topic to the electronic equipment.

215. And the electronic equipment receives and outputs the answers of the questions fed back by the server.

It can be seen that, by implementing the method described in fig. 2, the handheld photographing device can photograph the topic contents of at least two topics at one time, and transmit the topic contents of the at least two topics to the electronic device that establishes communication connection with the handheld photographing device, so that the electronic device displays the topic answer corresponding to the target topic selected by the user.

EXAMPLE III

Referring to fig. 3, fig. 3 is a schematic flowchart illustrating another photographing question searching method of a handheld photographing device according to an embodiment of the present invention. As shown in fig. 3, the photographing question searching method based on the handheld photographing device may include the following steps:

301. and outputting a photographing instruction frame for indicating the region to be photographed by the handheld photographing equipment according to the detected starting instruction.

302. The handheld photographing device detects whether the vertical distance between the center of a lens of a camera on the handheld photographing device and the question paper surface is greater than a preset single-question photographing distance, and if the vertical distance is greater than the preset single-question photographing distance, the steps 303 to 304 and the steps 309 to 312 are executed; if the distance is less than or equal to the preset single-subject photographing distance, the steps 305 to 312 are executed.

303. The handheld photographing device acquires a photographing range matched with the vertical distance and a photographing focal length matched with the photographing range, and adjusts the length and the width of the photographing indicating frame according to the photographing range to obtain the adjusted photographing indicating frame.

304. And the handheld photographing device performs photographing operation on at least two questions in the adjusted photographing instruction frame according to the detected photographing instruction and the photographing focal length to obtain a question picture, and performs step 309.

305. The handheld photographing device obtains the shooting range of the single question matched with the vertical distance and the shooting focal length of the single question matched with the shooting range of the single question, and adjusts the length and the width of the photographing indicating frame according to the shooting range of the single question to obtain the shooting indicating frame of the single question.

306. The handheld photographing device acquires first picture content in the single-subject photographing instruction frame and second picture content captured by a camera on the handheld photographing device.

In the embodiment of the present invention, the second screen content includes all topic contents of the target topic, and the first screen content includes a part of topic contents of the target topic or all topic contents of the target topic.

307. When the first picture content comprises partial topic content of the target topic, the handheld photographing device can determine the whole topic content of the target topic from the second picture content according to the first picture content.

As an optional implementation manner, when the first screen content includes partial topic content of the target topic, the method may further include the following steps:

the method comprises the steps that the handheld photographing equipment obtains line spacing values between every two lines of characters which are sequentially adjacent in a first preset direction in first picture content to obtain a first line spacing set;

the handheld photographing equipment judges whether all line spacing values in the first line spacing set are equal or not;

if all the line spacing values are equal, the handheld photographing equipment determines that the first picture content is the target content;

if all the line spacing values are unequal, the handheld photographing equipment determines a first target line spacing value larger than a first preset line spacing value from the first line spacing set, determines an area between two lines of characters adjacent in sequence corresponding to all the first target line spacing values as a first blank area, and determines target content from the first picture content according to the first blank area.

And the handheld photographing equipment determines all the title contents of the target single title from the second picture contents according to the target contents.

308. And the handheld photographing device executes imaging operation on all the topic contents of the target topic according to the detected photographing instruction and the topic photographing focal length to obtain a topic picture, and executes the step 309.

As an optional implementation manner, a physical key may be disposed on the handheld photographing device, and a user may trigger the start instruction and the photographing instruction through the physical key on the handheld photographing device. The mode that the user triggers the photographing instruction through the physical key on the handheld photographing device may include: the embodiment of the present invention is not limited to this, and the physical key of the handheld photographing device is lightly pressed, or the physical key of the handheld photographing device is rotated, or the physical key of the handheld photographing device is input with human body characteristic information (fingerprint information), or the physical key of the handheld photographing device is toggled.

In the embodiment of the invention, the physical key arranged on the handheld photographing device can be used as a switch to control the on-off of the built-in circuit of the handheld photographing device, wherein when the physical key is lightly pressed, the photographing key can conduct the built-in circuit of the handheld photographing device to enable the handheld photographing device to start working, and when the working is started, the built-in laser source is started to output the photographing instruction frame when the pressing strength of pressing the physical key by a user is judged to be lightly pressed.

As an optional implementation manner, the handheld photographing device performs, according to the detected photographing instruction and according to the target photographing parameter, a photographing operation on the topic content in the photographing instruction frame to obtain a topic picture, which may include the following steps:

when the pressing strength of the physical key pressed by the user is detected to be a pressing force, the handheld photographing device starts a built-in photographing module of the handheld photographing device;

the handheld photographing device acquires the picture content in the photographing instruction frame through a built-in photographing module of the handheld photographing device;

the handheld photographing equipment performs noise reduction optimization processing on the picture content through a built-in content correction module to obtain optimized picture content;

and the handheld photographing equipment performs photographing operation on the optimized picture content to obtain a theme picture.

In the embodiment of the invention, the user can trigger the photographing instruction through the physical key on the handheld photographing device. The prompting light source arranged on the handheld photographing equipment can also be started when the handheld photographing equipment detects that the pressing intensity of the physical key pressed by the user is a re-pressing intensity, so as to prompt the user that the pressing intensity of the physical key pressed by the user is a re-pressing intensity; the prompt light source may be a light source ring surrounding the physical key by a circle, or may be a cover light source covering the physical key, and a prompt light source of the prompt light source output when the physical key is pressed lightly is different from a prompt light source output when the physical key is pressed heavily, and the specific distinguishing manner may be to distinguish according to a difference in color of the prompt light source (for example, the prompt light source emits green light when the prompt light source is pressed lightly, and the prompt light source emits blue light when the prompt light source is pressed heavily), or to distinguish according to an output manner of the prompt light source (for example, the prompt light source flashes when the prompt light source is pressed lightly, and the prompt light source is normally on when the prompt light source is pressed heavily), and the embodiment of the present invention is not.

In the embodiment of the invention, when the handheld photographing device is used by a user, the handheld photographing device can output a certain prompt through the prompt light source to prompt the user that the operation executed by the handheld photographing device is effective operation, so that the next step can be executed.

309. And the handheld photographing equipment sends the theme picture to the electronic equipment which establishes communication connection with the handheld photographing equipment.

310. The electronic device displays the topic picture.

In the embodiment of the invention, after the electronic equipment receives the topic picture sent by the handheld photographing equipment when the electronic equipment is in the black screen state, the screen can be automatically lightened and the topic picture is output, and a user does not need to manually lighten the screen and unlock the electronic equipment with the lightened screen, so that the steps are simplified; meanwhile, the interference of entertainment software prompt information when a user manually lights the screen of the electronic equipment to search for the questions, for example, the interference of the prompt messages of the social software and the like, can be reduced, the question searching efficiency is improved, the learning efficiency is further improved, and the user experience is optimized.

311. The electronic equipment acquires line spacing values between every two lines of characters which are sequentially adjacent in a second preset direction in the question picture to obtain a second line spacing set, and determines a second target line spacing value which is larger than the second preset line spacing value from the second line spacing set; and determining the area between two sequentially adjacent lines of characters corresponding to all the second target line spacing values as a second blank area.

In this embodiment of the present invention, the second preset direction may be from top to bottom according to the ascending direction of the topic sequence numbers, or from bottom to top according to the descending direction of the topic sequence numbers, which is not limited in this embodiment of the present invention.

312. The electronic device detects whether an input selection instruction for selecting a target title is located at a preset touch position, and if the input selection instruction is not located at the preset touch position, the

steps

313, 317 and 319 are executed; if the touch position is located at the preset touch position, step 314 to step 315 are executed.

In the embodiment of the invention, the preset touch position is located in a non-screen area of the electronic equipment. The selection instruction may be triggered by a user clicking a display screen of the electronic device, or may be triggered by the user pressing a pressure sensor installed at a preset location of the electronic device, which is not limited in the embodiment of the present invention.

As an optional implementation manner, when the electronic device detects that the input selection instruction for selecting the target topic is located at the preset touch position, the method may further include the following steps:

the electronic equipment identifies all character areas in the theme picture according to the color difference between the character color and the background color, and numbers all the character areas according to a preset theme sequence to obtain an area number corresponding to each character area;

the electronic equipment detects a touch track of the selection instruction;

the electronic equipment matches the touch track with a preset digital library to obtain a target serial number;

the electronic equipment judges whether the target serial number is larger than the maximum area serial number or not;

if the number is not larger than the maximum area number, the electronic equipment takes the character area corresponding to the area number with the same number as the click times as a target area, and executes the steps 317 to 319;

if the area number is larger than the maximum area number, the electronic device determines the text area corresponding to the maximum area number as the target area, and performs steps 317 to 319.

313. The electronic device determines a touch position of the selection instruction on the topic picture, determines a target region containing the target topic from the topic picture according to a position relation between the touch position and the second blank region, cuts out a picture containing the target region from the topic picture as a target sub-picture containing the target topic, and executes steps 317 to 319.

In an embodiment of the present invention, after performing steps 311 to 313, the electronic device may determine a target sub-picture including a target topic from the topic picture, where content in the target region is topic content of the target topic.

As an optional implementation manner, the electronic device determines, according to the position relationship between the touch position and the second blank area, a target area containing a target topic from the topic picture, and may include the following steps:

the electronic equipment judges whether the touch position is in the second blank area;

if the touch area is not located in the second blank area, the electronic equipment determines an area between the two blank areas closest to the touch position in the title picture as a target area;

if the character line is located in the second blank area, the electronic equipment acquires the character line closest to the second blank area;

the electronic device determines the title region including the closest character line from the title picture as a target region, and performs steps 317 to 319.

314. The electronic equipment identifies all character areas in the theme picture according to the color difference between the character color and the background color, and numbers all the character areas according to a preset theme sequence to obtain the area number corresponding to each character area.

In the embodiment of the present invention, the preset topic sequence may be from the upper side of the topic picture to the lower side of the topic picture, or from the lower side of the topic picture to the upper side of the topic picture, which is not limited in the embodiment of the present invention. The upper side of the theme picture can be a side where the theme with the smallest theme number included in the theme picture is located on the theme picture, and the lower side of the theme picture can be a side where the theme with the largest theme number included in the theme picture is located on the theme picture.

In the embodiment of the invention, when the line spacing between the titles in the test questions to be shot by the user is larger than the line spacing of the characters in the titles, the handheld shooting equipment can identify at least one character area in the picture content according to the color difference between the character color and the background color, and the title division can be carried out on the picture content according to the color difference between the character color and the background color, namely, the identified title content of a single-channel title is included in each character area, thereby being beneficial to improving the title searching efficiency.

315. The electronic equipment judges whether the selection instruction is a click instruction, and if the selection instruction is the click instruction, the step 316 to the step 319 are executed; if the selection instruction is not a click instruction, the flow is ended.

As an optional implementation manner, after the electronic device determines that the selection instruction is not a click instruction, the method may further include the following steps:

after the electronic device does not detect the click command within the preset time period, the text area corresponding to the minimum area number is determined as the target area, and step 317 to step 319 are executed.

As an optional implementation manner, after the electronic device determines that the selection instruction is a click instruction, the method may further include the following steps:

the electronic equipment judges whether the selection instruction is a single click instruction or not;

if the command is a single click command, the electronic equipment determines the text area corresponding to the minimum area number as a target area, and executes the steps 317 to 319;

if the click command is at least two times, the electronic equipment judges whether the click time interval between two adjacent click commands is triggered to exceed a preset time interval or not;

if the time interval exceeds the preset time interval, the electronic device determines the text area corresponding to the minimum area number as the target area, and performs steps 317 to 319;

if the time interval does not exceed the preset time interval, the electronic equipment acquires the click times of triggering the click instructions for at least two times and judges whether the click times are greater than the maximum area number or not;

In this embodiment of the present invention, the preset time interval may be set to 0.1 second, 0.2 second, and the like, which is not limited in this embodiment of the present invention.

316. The electronic device determines a target area number corresponding to the number of clicks from the area numbers corresponding to each text area according to the number of clicks included in the click command, determines the text area corresponding to the target area number as the target area, and performs step 317.

317. The electronic equipment cuts out a picture containing the target area from the theme picture as a target sub-picture containing the target theme.

318. The electronic equipment sends the target sub-picture to the server so that the server can identify the target topic contained in the target sub-picture and feed back the matched topic answer corresponding to the target topic to the electronic equipment.

the server receives a target sub-picture sent by the electronic equipment, and performs content correction processing on the target sub-picture to filter noise interference in the target sub-picture to obtain a processed sub-picture;

the server carries out character recognition processing on the processed sub-picture to obtain character data corresponding to the processed sub-picture;

the server judges whether the text data contains the question number according to the question number naming rule;

if the answer number is not contained, the server determines the text data as the single-question text data, matches a test question answer corresponding to the single-question text data from a test question library of the server, sends the question answer corresponding to the single-question text data to the electronic equipment, and triggers step 316 that the electronic equipment receives the question answer fed back by the server and outputs the question answer.

If the data contains the question number, the server extracts the question number in the text data according to a preset question number naming rule, and carries out question division on the text data according to the question number to obtain at least two single-question text data, wherein each single-question text data contains one piece of question text data;

the server matches the answer of the test question corresponding to each single-question word data from the test question library of the server;

the server sends the question answer corresponding to each single-question text data to the electronic device, and triggers step 316 the electronic device to receive the question answer fed back by the server and output the question answer.

319. And the electronic equipment receives and outputs the answers of the questions fed back by the server.

Therefore, by implementing the method described in fig. 3, the region to be photographed can be quickly indicated through the photographing instruction frame output by the handheld photographing device, and the photographing operation can be quickly executed on the subject content in the photographing instruction frame without performing operations such as starting up and unlocking on the electronic device, so that interference of other application programs on the electronic device, such as message information pushed by social software, can be effectively prevented; meanwhile, the handheld photographing device can be used for photographing the topic contents of at least two topics at one time and transmitting the topic contents of the at least two topics to the electronic device which is in communication connection with the handheld photographing device, so that the electronic device can display the topic answers corresponding to the target topics selected by the user, the multiple topics can be searched at the same time, the operation is simple, the photographing speed is high, and the topic searching efficiency is high.

Example four

Referring to fig. 4, fig. 4 is a schematic structural diagram of a photographing question searching system based on a handheld photographing device according to an embodiment of the present invention. As shown in fig. 4, the system may include a handheld photographing device 40, an electronic device 50 that establishes a communication connection with the handheld photographing device 40, and a server 60. The handheld photographing apparatus 40 may include:

a first output unit 401, configured to output a photographing instruction frame for instructing a region to be photographed according to the detected start instruction.

In this embodiment of the present invention, after the first output unit 401 outputs the photographing instruction frame according to the start instruction, the start detection unit 402 may be further triggered.

The detection unit 402 is configured to detect whether a vertical distance between a lens center of a camera on the handheld photographing device and the question paper surface is greater than a preset single-question photographing distance.

A first obtaining unit 403, configured to obtain a photographing range matched with the vertical distance and a photographing focal length matched with the photographing range when the detecting unit 402 detects that the vertical distance is greater than the preset single-subject photographing distance.

An adjusting unit 404, configured to adjust the length and width of the photographing instruction frame output by the first output unit 401 according to the photographing range acquired by the first acquiring unit 403, so as to obtain an adjusted photographing instruction frame.

The photographing unit 405 is configured to perform, according to the detected photographing instruction, a photographing operation on at least two titles in the adjusted photographing instruction frame according to the photographing focal length obtained by the first obtaining unit 403, so as to obtain a title picture.

A first sending unit 406, configured to send the topic picture obtained by the photographing unit 404 to the electronic device 50.

Wherein, the electronic device 50 includes:

a display unit 501, configured to display the title picture sent by the first sending unit 406.

A target determining unit 502, configured to determine a target sub-picture containing a target title from the title pictures displayed by the display unit 501.

A second sending unit 503, configured to send the target sub-picture determined by the target determining unit 502 to the server 60.

Wherein, the server 60 includes:

an identifying and matching unit 601, configured to identify a target topic included in the target sub-picture sent by the second sending unit 503 and match a topic answer corresponding to the target topic.

And a third sending unit 602, configured to feed back the answer to the question obtained by the identifying and matching unit 601 to the electronic device 50.

The electronic device 50 further includes:

a receiving unit 504, configured to receive the topic answer fed back by the third sending unit 602.

In this embodiment of the present invention, after the second sending unit 503 sends the target sub-picture to the server, the receiving unit 504 may be further triggered to detect whether the topic answer fed back by the third sending unit 602 is received.

A second output unit 505, configured to output the answer to the question received by the receiving unit 504.

It can be seen that, by implementing the system described in fig. 4, the handheld photographing device can photograph the topic contents of at least two topics at one time, and transmit the topic contents of the at least two topics to the electronic device that establishes communication connection with the handheld photographing device, so that the electronic device displays the topic answer corresponding to the target topic selected by the user, thereby simplifying the operation steps and improving the topic searching efficiency.

EXAMPLE five

Referring to fig. 5, fig. 5 is a schematic structural diagram of another photographing question searching system based on a handheld photographing device according to an embodiment of the present invention. The system shown in fig. 5 is optimized from the system shown in fig. 4. In the system shown in fig. 5, the first obtaining unit 403 is further configured to obtain a single-subject photographing range matching the vertical distance and a single-subject photographing focal length matching the single-subject photographing range when the detecting unit 402 detects that the vertical distance is smaller than or equal to the preset single-subject photographing distance.

The adjusting unit 404 is further configured to adjust the length and width of the photographing instruction frame according to the scope of the single-subject photographing acquired by the first acquiring unit 403, so as to obtain the single-subject photographing instruction frame.

Optionally, as shown in fig. 5, the handheld photographing apparatus 40 may further include:

the second obtaining unit 407 is configured to obtain a first picture content in the shooting instruction frame for the topic obtained by the adjusting unit 404, and obtain a second picture content captured by the camera on the handheld shooting device 40, where the second picture content includes all topic contents of the target topic, and the first picture content includes a part of topic contents of the target topic or all topic contents of the target topic.

A content determining unit 408, configured to determine, when the first screen content includes a partial topic content of the target topic, a total topic content of the target topic from the second screen content according to the first screen content.

The photographing unit 405 is further configured to perform, according to the detected photographing instruction, an imaging operation on all topic contents of the target topic determined by the content determining unit 408 according to the topic photographing focal length obtained by the adjusting unit 404 to obtain a topic picture, and trigger the first sending unit 406 to send the topic picture obtained by the photographing unit 405 to the electronic device 50.

Alternatively, as shown in fig. 5, the content determining unit 408 may include:

the first sub-unit 4081 is configured to, when the first image content includes partial topic content of the target topic, obtain a first line spacing set by obtaining line spacing values between every two lines of characters that are sequentially adjacent in the first preset direction in the first image content obtained by the second obtaining unit 407, and determine whether all line spacing values in the first line spacing set are equal.

A second sub-unit 4082, configured to determine that the first screen content is the target content when the determination result of the first sub-unit 4081 is yes; and when the judgment result of the first sub-unit 4081 is negative, determining a first target line spacing value larger than a first preset line spacing value from the first line spacing set obtained by the first sub-unit 4081, determining an area between two sequentially adjacent lines of characters corresponding to all the first target line spacing values as a first blank area, and determining the target content from the first picture content according to the first blank area.

A third sub-unit 4083, configured to determine all topic contents of the target topic from the second screen content according to the target content determined by the second sub-unit 4082.

It can be seen that, by implementing the system described in fig. 5, the handheld photographing device can photograph the topic contents of at least two topics at one time, and transmit the topic contents of the at least two topics to the electronic device that establishes communication connection with the handheld photographing device, so that the electronic device displays the topic answer corresponding to the target topic selected by the user.

EXAMPLE six

Referring to fig. 6, fig. 6 is a schematic structural diagram of another photographing question searching system based on a handheld photographing device according to an embodiment of the present invention. The system shown in fig. 6 is optimized from the system shown in fig. 5. In the system shown in fig. 6, the target determination unit 502 may include:

a fourth sub-unit 5021, configured to obtain a line space value between every two lines of characters sequentially adjacent in a second preset direction in the topic picture displayed by the display unit 501, to obtain a second line space set, and determine a second target line space value greater than the second preset line space value from the second line space set; determining the area between two lines of characters which are adjacent in sequence and correspond to all the second target line spacing values as a second blank area; and detecting whether an input selection instruction for selecting the target title is located at a preset touch position, where the preset touch position is located in a non-screen area of the electronic device 50.

A fifth sub-unit 5022, configured to determine a touch position of the selection instruction on the topic picture when the fourth sub-unit 5021 detects that the selection instruction is not located at the preset touch position, and determine a target region containing a target topic from the topic picture according to a position relationship between the touch position and the second blank region.

A sixth subunit 5023, configured to cut a picture including a target region from the topic pictures as a target sub-picture including a target topic, where content in the target region is topic content of the target topic.

Optionally, as shown in fig. 6, the target determining unit 502 may further include:

a seventh sub-unit 5024, configured to identify all text regions in the theme picture according to a color difference between a text color and a background color when the fourth sub-unit 5021 detects that the selection instruction is located at the preset touch position, and number all the text regions according to a preset theme sequence to obtain a region number corresponding to each text region; and judging whether the selection instruction is a click instruction or not.

An eighth subunit 5025, configured to, when the seventh subunit determines that the selection instruction is a click instruction, determine, according to the number of clicks included in the click instruction, a target region number corresponding to the number of clicks from the region numbers corresponding to each text region, determine, as a target region, the text region corresponding to the target region number, and trigger the sixth subunit 5023 to cut a picture including the target region from the topic picture, as a target sub-picture including the target topic.

Referring to fig. 7, fig. 7 is a schematic diagram of a photographing question searching method based on a handheld photographing device according to an embodiment of the present invention. The area a is an area framed by a photographing instruction box output by the handheld photographing device 40, and when the handheld photographing device 40 receives a photographing instruction, the photographing operation is performed on the area a to obtain a theme picture, and the theme picture can be sent to the electronic device 50; then, the electronic device 50 will output the interface B after receiving the theme picture sent by the handheld photographing device 40. The topic content included in the area a is the topic content included in the topic picture, and the picture content included in the interface B includes all the topic contents in the topic picture.

Please refer to fig. 8, fig. 8 is a schematic diagram illustrating a search result according to an embodiment of the present invention. After receiving the theme picture sent by the handheld photographing device 40, the electronic device 50 outputs an interface B, where the screen content included in the interface B includes all theme contents in the theme picture. When the electronic device 50 detects a selection instruction on the interface B, an area C may be determined according to a touch position of the selection instruction, where a picture content included in the area C is a topic content of a target topic, and at this time, the electronic device 50 may cut a picture including the area C from the topic picture as a target sub-picture including the target topic, and send the target sub-picture to the server 60, so that the server 60 identifies the target topic included in the target sub-picture and sends a matched topic answer corresponding to the target topic to the electronic device 50, further, the electronic device 50 may receive the topic corresponding to the target topic sent by the server 60, and output an interface D, where the interface D includes an answer content of the topic answer corresponding to the target topic.

In the embodiment of the present invention, the way for the electronic device 50 to output the answer to the question corresponding to the target question may be in the form of an output interface D, or in the form of outputting a new interface, and the new interface will completely cover the interface B.

Therefore, by implementing the system described in fig. 6, the region to be photographed can be quickly indicated through the photographing instruction frame output by the handheld photographing device, and the photographing operation can be quickly executed on the subject content in the photographing instruction frame without performing operations such as starting up and unlocking on the electronic device, so that interference of other application programs on the electronic device, such as message information pushed by social software, can be effectively prevented; meanwhile, the handheld photographing device can be used for photographing the topic contents of at least two topics at one time and transmitting the topic contents of the at least two topics to the electronic device which is in communication connection with the handheld photographing device, so that the electronic device can display the topic answers corresponding to the target topics selected by the user, the multiple topics can be searched at the same time, the operation is simple, the photographing speed is high, and the topic searching efficiency is high.

EXAMPLE seven

Referring to fig. 9, fig. 9 is a block diagram of a partial structure of a handheld photographing device according to an embodiment of the present invention. As shown in fig. 9, the handheld photographing apparatus may include:

handheld hardware control module 710, memory 720, handheld hardware camera module 730, processor 740, wireless communication module 750, and power supply 760. Those skilled in the art will appreciate that the configuration of the handheld photographing apparatus shown in fig. 9 does not constitute a limitation of the handheld photographing apparatus and may include more or fewer components than those shown, or some components in combination, or a different arrangement of components.

The following describes the components of the handheld photographing apparatus in detail with reference to fig. 9:

the handheld hardware control module 710 may be used to receive entered numeric or character information and generate key signal inputs relating to user settings and function controls of the handheld camera device. Specifically, the handheld hardware control module 710 may include, but is not limited to, a physical button 711 (e.g., a photographing button, a switch button) disposed on the handheld photographing device, and may be configured to detect a pressing operation performed by a user thereon (e.g., an operation performed by the user on the physical button 711 by using a finger, a handheld touch device, or any other suitable object or accessory), and drive the corresponding connection device according to a preset program. The handheld hardware control module 710 may also include a pressure sensor 712 that may detect a pressure value applied to the physical key 711 and send the detected pressure value to the processor 740.

The memory 720 may be used for storing executable codes, and the processor 740 may execute various functional applications and data processing of the handheld photographing device by executing the executable codes stored in the memory 720, and is particularly used for executing operations related to the handheld photographing device in any one of the first to third embodiments of the method for searching for questions based on photographing by the handheld photographing device. The memory 720 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function (such as a photographing function, a focus positioning function, etc.), and the like; the storage data area may store data (such as test question images, voice data, etc.) created according to the use of the handheld photographing apparatus, and the like. Further, the memory 720 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The handheld hardware camera module 730 may include, but is not limited to, an external camera 731, a focus locator sub-module 732, and an angle corrector sub-module 733. Specifically, the external camera 731 can rotate 180 degrees, and can perform photographing preview through the dominant frame, photograph under the driving of the corresponding program to obtain the test question image, or output the test question image to the memory 720. The focusing and positioning sub-module 732 may include a laser focusing module, an ultraviolet focusing module, and the like, and the focusing and positioning sub-module 732 may perform automatic focusing, positioning, or information projection, or may adjust the focusing and positioning of the external camera 731 according to the moving track of the handheld photographing device. The angle corrector sub-module 733 may adjust a photographing angle of the external camera 731 according to a parameter or a user operation.

The handheld photographing apparatus may further include a gyroscope 734 or a gyroscope 734, the focus positioning sub-module 732 may adjust the focus and the position according to a rotational angular velocity detected by the gyroscope 734 or a gravitational acceleration detected by the gyroscope 734, and the angle corrector sub-module 733 may adjust the photographing angle according to the rotational angular velocity detected by the gyroscope 734 or the gravitational acceleration detected by the gyroscope 734.

The processor 740 is a control center of the handheld photographing apparatus, connects various parts of the entire handheld photographing apparatus by using various interfaces and lines, and performs various functions and processes data of the handheld photographing apparatus by operating or executing software programs and/or modules stored in the memory 720 and calling data stored in the memory 720, thereby performing overall monitoring of the handheld photographing apparatus. Alternatively, processor 740 may include one or more processing units; preferably, the processor 740 may integrate an application processor, which mainly handles operating systems, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 740.

The wireless communication module 750 may be used to transmit test question images, receive control instructions of an external device, and the like when performing a photographing function, and particularly, to the processor 740 after receiving the control instructions of the external device, and processed by the processor 740. The wireless communication module 750 may include, for example, a wireless fidelity (WiFi) module. WiFi belongs to short-distance wireless transmission technology, and handheld photographing equipment can be used for sending test question images and receiving control instructions of external equipment and the like through a WiFi module, and wireless broadband internet access is provided for users.

The handheld photographing device may further include a power supply 760 (e.g., a battery) for powering the various components, which may preferably be logically coupled to the processor 740 via a power management system to manage charging, discharging, and power consumption management functions via the power management system.

The handheld photographing device may further include a stylus 770, and the stylus 770 may include any stylus capable of being used on a touch screen/touch screen, such as but not limited to a rubber soft stylus, a carbon fiber hard stylus, and a pressure-retractable metal stylus. The stylus head 770 may act on the touchscreen/touch screen of the external device to input signals to the external device.

The handheld photographing device can also include at least one sensor 780, such as an image sensor, a light sensor, a motion sensor, a biosensor, and other sensors. In particular, the image sensor may convert an optical image into an electronic signal. The light sensor can adjust the brightness of the dominant frame in the handheld hardware camera module 730 according to the brightness of the ambient light. As one type of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally, three axes), can detect the magnitude and direction of gravity when stationary, and can be used to identify the posture (such as vertical placement, horizontal placement) of the handheld photographing device, and vibration identification related functions (such as tapping); as for the handheld photographing device, other sensors such as a gyroscope, an infrared sensor and the like can be configured, and the details are not described herein.

The handheld photographing device may also include an audio circuit 790, a speaker 791, and a microphone 792 may provide an audio interface between the user and the handheld photographing device. The audio circuit 790 may transmit the electrical signal converted from the received audio data to the speaker 791, and convert the electrical signal into a sound signal for outputting by the speaker 791; on the other hand, the microphone 792 converts the collected sound signals into electrical signals, which are received by the audio circuit 790 and converted into audio data, which are then processed by the audio data output processor 740, either through the wireless communication module 750 for transmission to, for example, an electronic device, or output to the memory 720 for further processing.

Although not shown, the handheld photographing device can also include a charging interface through which the power supply 760 of the handheld photographing device can be charged. The interface that charges can include Micro USB interface, USB Type C interface etc.. The handheld photographing device may further include a switch indicator light, a charging indicator light, and the like, which are not described in detail herein.

The embodiment of the invention discloses a computer-readable storage medium which stores a computer program, wherein the computer program enables a computer to execute any one photographing question searching method based on a handheld photographing device in figures 1-3.

The embodiment of the invention discloses a computer program product, which enables a computer to execute any one photographing and question searching method based on a handheld photographing device in figures 1-3 when the computer program product runs on the computer.

The embodiment of the invention discloses an application publishing platform which is used for publishing a computer program product, wherein when the computer program product runs on a computer, the computer is enabled to execute any one photographing question searching method based on a handheld photographing device in figures 1-3.

It will be understood by those skilled in the art that all or part of the steps in the methods of the embodiments described above may be implemented by instructions associated with a program, which may be stored in a computer-readable storage medium, where the storage medium includes Read-Only Memory (ROM), Random Access Memory (RAM), Programmable Read-Only Memory (PROM), Erasable Programmable Read-Only Memory (EPROM), One-time Programmable Read-Only Memory (OTPROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), compact disc-Read-Only Memory (CD-ROM), or other Memory, magnetic disk, magnetic tape, or magnetic tape, Or any other medium which can be used to carry or store data and which can be read by a computer.

The method and the system for searching for the questions by photographing based on the handheld photographing device disclosed by the embodiment of the invention are described in detail, a specific embodiment is applied in the text to explain the principle and the implementation mode of the invention, and the description of the embodiment is only used for helping to understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims

1. A photographing question searching method based on a handheld photographing device is characterized by comprising the following steps:

the handheld photographing device outputs a photographing indication frame for indicating a region to be photographed according to the detected starting instruction, and adjusts the intensity of an optical signal corresponding to the photographing indication frame according to the ambient light intensity or a control instruction input by a user; the photographing indication frame is a rectangular frame or a highlight area formed by an optical signal output by a built-in laser source of the handheld photographing device on a paper surface to be photographed;

the handheld photographing device detects whether the vertical distance between the center of a lens of a camera on the handheld photographing device and the question paper surface is larger than a preset single-question photographing distance;

2. The method of claim 1, further comprising:

if the shooting distance is smaller than or equal to the preset shooting distance of the single question, the handheld shooting equipment obtains a shooting range of the single question matched with the vertical distance and a shooting focal length of the single question matched with the shooting range of the single question, and adjusts the length and the width of the shooting indicating frame according to the shooting range of the single question to obtain a shooting indicating frame of the single question;

the handheld photographing device acquires first picture content in the single-topic photographing indication frame and second picture content captured by a camera on the handheld photographing device, wherein the second picture content comprises all topic contents of a target single topic, and the first picture content comprises partial topic contents of the target single topic or all topic contents of the target single topic;

when the first picture content comprises partial title content of the target single title, the handheld photographing device determines all title content of the target single title from the second picture content according to the first picture content;

and the handheld photographing equipment performs imaging operation on all the topic contents of the target topic according to the detected photographing instruction and the topic photographing focal length to obtain a topic picture, and executes the sending of the topic picture to the electronic equipment which establishes communication connection with the handheld photographing equipment.

3. The method of claim 2, wherein the determining, by the handheld photographing device, the entire topic content of the target topic from the second screen content according to the first screen content comprises:

the handheld photographing device acquires line spacing values between every two lines of characters which are sequentially adjacent in a first preset direction in the first picture content to obtain a first line spacing set;

the handheld photographing equipment judges whether all the line spacing values in the first line spacing set are equal or not;

if all the line spacing values are equal, the handheld photographing device determines that the first picture content is target content;

if all the line spacing values are unequal, the handheld photographing equipment determines a first target line spacing value larger than a first preset line spacing value from the first line spacing set, determines an area between two lines of characters which are adjacent in sequence and correspond to all the first target line spacing values as a first blank area, and determines target content from the first picture content according to the first blank area;

and the handheld photographing equipment determines all the topic contents of the target single topic from the second picture contents according to the target contents.

4. The method of claim 1, wherein the electronic device determines a target sub-picture containing a target topic from the topic picture, comprising:

the electronic equipment acquires line spacing values between every two lines of characters which are sequentially adjacent in a second preset direction in the theme picture to obtain a second line spacing set, and determines a second target line spacing value which is larger than the second preset line spacing value from the second line spacing set;

the electronic equipment determines the area between two rows of characters which are adjacent in sequence and correspond to all the second target line spacing values as a second blank area;

the electronic equipment detects whether an input selection instruction for selecting a target title is located at a preset touch position, wherein the preset touch position is located in a non-screen area of the electronic equipment;

if the selection instruction is not located at the preset touch position, the electronic equipment determines the touch position of the selection instruction on the topic picture, and determines a target area containing a target topic from the topic picture according to the position relation between the touch position and the second blank area;

and the electronic equipment cuts out a picture containing the target area from the theme picture to be used as a target sub-picture containing a target theme, wherein the content in the target area is the theme content of the target theme.

5. The method of claim 4, further comprising:

if the selection instruction is located at the preset touch position, the electronic equipment identifies all character areas in the theme picture according to the color difference between the character color and the background color, and numbers all the character areas according to a preset theme sequence to obtain area numbers corresponding to all the character areas;

the electronic equipment judges whether the selection instruction is a click instruction or not;

if the selection instruction is the click instruction, the electronic equipment determines a target area number corresponding to the click frequency from the area numbers corresponding to each character area according to the click frequency contained in the click instruction, determines the character area corresponding to the target area number as a target area, and cuts out an image containing the target area from the title image to serve as a target sub-image containing the target title.

6. A photographing and question searching system based on a handheld photographing device is characterized by comprising the handheld photographing device, a server and an electronic device which is in communication connection with the handheld photographing device,

wherein, handheld equipment of shooing includes:

the first output unit is used for outputting a photographing instruction frame for indicating a region to be photographed according to the detected starting instruction, and adjusting the intensity of an optical signal corresponding to the photographing instruction frame according to the ambient light intensity or a control instruction input by a user; the photographing indication frame is a rectangular frame or a highlight area formed by an optical signal output by a built-in laser source of the handheld photographing device on a paper surface to be photographed;

wherein the electronic device comprises:

wherein the server comprises:

the electronic device further includes:

7. The system of claim 6,

the first obtaining unit is further configured to obtain a single-subject photographing range matched with the vertical distance and a single-subject photographing focal length matched with the single-subject photographing range when the detecting unit detects that the vertical distance is smaller than or equal to the preset single-subject photographing distance;

the adjusting unit is further configured to adjust the length and width of the photographing instruction frame according to the scope of the single-subject photographing acquired by the first acquiring unit to obtain a single-subject photographing instruction frame;

the handheld photographing apparatus further comprises:

a second obtaining unit, configured to obtain first picture content in the single-topic photographing instruction frame obtained by the adjusting unit, and obtain second picture content captured by a camera on the handheld photographing device, where the second picture content includes all topic contents of a target single topic, and the first picture content includes part of the topic contents of the target single topic or all topic contents of the target single topic;

a content determining unit, configured to determine, when the first screen content includes a partial topic content of the target topic, all topic contents of the target topic from the second screen content according to the first screen content;

the shooting unit is further used for performing imaging operation on all topic contents of the target topic determined by the content determining unit according to the shooting focal length of the topic obtained by the adjusting unit according to the detected shooting instruction to obtain a topic picture, and triggering the first sending unit to execute the step of sending the topic picture obtained by the shooting unit to the electronic equipment.

8. The system according to claim 7, wherein the content determining unit comprises:

a first sub-unit, configured to, when the first image content includes partial topic content of the target topic, obtain a first line spacing set by obtaining line spacing values between every two lines of characters that are sequentially adjacent in a first preset direction in the first image content obtained by the second obtaining unit, and determine whether all the line spacing values in the first line spacing set are equal;

the second subunit is used for determining the first picture content as the target content when the judgment result of the first subunit is yes; when the judgment result of the first subunit is negative, determining a first target line spacing value larger than a first preset line spacing value from the first line spacing set obtained by the first subunit, determining an area between two lines of characters which are adjacent in sequence and correspond to all the first target line spacing values as a first blank area, and determining target content from the first picture content according to the first blank area;

and the third subunit is used for determining all the topic contents of the target topic from the second picture contents according to the target contents.

9. The system of claim 6, wherein the goal determination unit comprises:

a fourth subunit, configured to obtain a line spacing value between every two lines of characters sequentially adjacent in a second preset direction in the title picture displayed by the display unit, to obtain a second line spacing set, and determine a second target line spacing value greater than the second preset line spacing value from the second line spacing set; determining the area between two rows of characters which are adjacent in sequence and correspond to all the second target line spacing values as a second blank area; detecting whether an input selection instruction for selecting a target title is located at a preset touch position, wherein the preset touch position is located in a non-screen area of the electronic equipment;

a fifth subunit, configured to, when the fourth subunit detects that the selection instruction is not located at the preset touch position, determine a touch position of the selection instruction on the topic picture, and determine, according to a positional relationship between the touch position and the second blank area, a target area containing a target topic from the topic picture;

and the sixth subunit is configured to cut, from the topic pictures, pictures including the target region as target sub-pictures including target topics, where content in the target region is the topic content of the target topic.

10. The system of claim 9, wherein the goal determination unit further comprises:

a seventh subunit, configured to, when the fourth subunit detects that the selection instruction is located at the preset touch position, identify all text regions in the question picture according to a color difference between a text color and a background color, and number all the text regions according to a preset question sequence to obtain a region number corresponding to each text region; judging whether the selection instruction is a click instruction or not;

and the eighth subunit is configured to, when the seventh subunit determines that the selection instruction is the click instruction, determine, according to the click times included in the click instruction, a target region number corresponding to the click times from the region numbers corresponding to each of the text regions, determine, as a target region, the text region corresponding to the target region number, and trigger the sixth subunit to execute the process of cutting out, from the title picture, a picture including the target region, where the picture is used as a target sub-picture including a target title.