CN108197620B

CN108197620B - Photographing and question searching method and system based on eye positioning and handheld photographing equipment

Info

Publication number: CN108197620B
Application number: CN201810065025.8A
Authority: CN
Inventors: 徐杨; 黄东
Original assignee: Guangdong Genius Technology Co Ltd
Current assignee: Guangdong Genius Technology Co Ltd
Priority date: 2018-01-23
Filing date: 2018-01-23
Publication date: 2021-11-26
Anticipated expiration: 2038-01-23
Also published as: CN108197620A

Abstract

The invention relates to the technical field of handheld photographing equipment, and discloses a photographing and question searching method and system based on eye positioning and the handheld photographing equipment, wherein the photographing and question searching method and system comprises the following steps: the handheld photographing device can detect the moving and positioning track of the eyes of the user on the surface of the test question, and determines the area to be photographed on the surface of the test question according to the moving and positioning track so as to select the test question to be searched through the area to be photographed. Then, the handheld photographing device photographs the region to be photographed to obtain a test question image, and sends the test question image to the electronic device, so that the electronic device obtains an answer corresponding to the test question. By implementing the embodiment of the invention, the handheld photographing equipment can determine the region to be photographed according to the moving positioning track of the sight of the user, so that the manual problem selection operation of the user is avoided, the problem photographing and searching process is simplified, and the problem searching efficiency is improved.

Description

Photographing and question searching method and system based on eye positioning and handheld photographing equipment

Technical Field

The invention relates to the technical field of handheld photographing equipment, in particular to a photographing and question searching method and system based on eye positioning and the handheld photographing equipment.

Background

With the close contact between the internet and the education industry, a plurality of student-oriented question searching applications appear in the market. When meeting the questions that can not be solved, the student can shoot through the application of the search question class in the mobile phone and search for the questions, and the process of shooting and searching for the questions comprises: starting up, unlocking by sliding a screen, selecting an application of a question searching class, starting up an application, starting up a camera, photographing in focusing, intercepting test questions, confirming, uploading to a server, identifying by the server, matching the test questions by the server, and feeding back answer information by the server. In practice, it is found that this method of photographing and searching for topics is complex to operate, and takes a lot of time, resulting in inefficient searching for topics.

Disclosure of Invention

The embodiment of the invention discloses a photographing and question searching method and system based on eye positioning and a handheld photographing device, which can simplify the photographing and question searching process and improve the question searching efficiency.

The embodiment of the invention discloses a photographing and question searching method based on eye positioning in a first aspect, and the method comprises the following steps:

the method comprises the steps that a handheld photographing device detects a moving positioning track of eyes of a user on the surface of a test question, wherein the surface of the test question is used for presenting at least one test question, and the moving positioning track is obtained according to at least one positioning point of the eyes of the user on the surface of the test question;

the handheld photographing device determines a region to be photographed on the surface of the test question according to the moving positioning track, wherein the region to be photographed is used for selecting at least one test question to be searched from the test questions on the surface of the test question;

the handheld photographing equipment photographs the area to be photographed to obtain a test question image;

the handheld photographing device sends the test question image to the electronic device, so that the electronic device uploads the target to-be-searched test questions in the test question image to a server to obtain answer information matched with the target to-be-searched test questions.

As an optional implementation manner, in the first aspect of the embodiment of the present invention, the determining, by the handheld photographing apparatus, a region to be photographed on a surface on which the test question is located according to the movement positioning track includes:

when the mobile positioning track only comprises one positioning point, the handheld photographing device determines the region to be photographed with the positioning point as a midpoint on the surface of the test question.

when the mobile positioning track comprises two or more positioning points, the handheld photographing device determines the region to be photographed on the surface of the test question according to a preset rule by taking the two or more positioning points as a basis.

As an optional implementation manner, in the first aspect of the embodiment of the present invention, after the handheld photographing device determines the region to be photographed on the surface where the test question is located according to the moving positioning track, and before the handheld photographing device photographs the region to be photographed to obtain the test question image, the method further includes:

the handheld photographing device projects laser on the region to be photographed to obtain an explicit frame, and the coverage area of the explicit frame is the same as that of the region to be photographed;

the handheld photographing device photographs the region to be photographed to obtain a test question image, and the method comprises the following steps:

and the handheld photographing equipment photographs the coverage area of the dominant frame to obtain the test question image.

As an optional implementation manner, in the first aspect of the embodiment of the present invention, before the handheld photographing apparatus photographs the region to be photographed to obtain the test question image, the method further includes:

the handheld photographing equipment detects the pressure borne by the photographing key;

the handheld photographing equipment detects whether the pressure reaches a preset pressure or not;

and if the pressure reaches the preset pressure, the handheld photographing equipment executes photographing on the area to be photographed to obtain the test question image.

A second aspect of an embodiment of the present invention discloses a handheld photographing apparatus, including:

the device comprises a first detection unit, a second detection unit and a control unit, wherein the first detection unit is used for detecting a moving and positioning track of eyes of a user on the surface of test questions, the surface of the test questions is used for presenting at least one test question, and the moving and positioning track is obtained according to at least one positioning point of the eyes of the user on the surface of the test questions;

the determining unit is used for determining a to-be-photographed area on the surface where the test questions are located according to the moving positioning track, and the to-be-photographed area is used for selecting at least one test question to be searched from the test questions on the surface where the test questions are located;

the photographing unit is used for photographing the area to be photographed to obtain a test question image;

and the first sending unit is used for sending the test question image to the electronic equipment so that the electronic equipment uploads the target to-be-searched test questions in the test question image to a server to obtain answer information matched with the target to-be-searched test questions.

As an optional implementation manner, in the second aspect of the embodiment of the present invention, the determining unit includes:

and the first determining subunit is configured to determine, when the mobile positioning track only includes one positioning point, the area to be photographed on the surface where the test question is located, where the positioning point is the midpoint.

As an optional implementation manner, in the second aspect of the embodiment of the present invention, the determining unit further includes:

and the second determining subunit is used for determining the area to be photographed on the surface of the test question according to a preset rule by taking the two or more positioning points as the basis when the moving positioning track comprises two or more positioning points.

As an optional implementation manner, in the second aspect of the embodiment of the present invention, the handheld photographing apparatus further includes:

the projection unit is used for projecting laser on the to-be-photographed area to obtain an explicit frame after the determination unit determines the to-be-photographed area on the surface of the test question based on the mobile positioning track and before the photographing unit photographs the to-be-photographed area to obtain a test question image, wherein the coverage area of the explicit frame is the same as that of the to-be-photographed area;

the mode that the photographing unit is used for photographing the area to be photographed to obtain the test question image specifically comprises the following steps:

and the photographing unit is used for photographing the coverage area of the dominant frame to obtain the test question image.

the second detection unit is used for detecting the pressure borne by the photographing key;

a third detection unit for detecting whether the pressure reaches a preset pressure;

the photographing unit is specifically configured to photograph the area to be photographed to obtain the test question image when the result detected by the third detecting unit is yes.

The third aspect of the embodiments of the present invention discloses a photographing and question searching system based on eye positioning, which includes: the electronic device, the server and the handheld photographing device of any one of the second aspect;

wherein the electronic device comprises:

the first receiving unit is used for receiving the test question image sent by the handheld photographing equipment;

the second sending unit is used for sending the target to-be-searched test questions in the test question image to the server after the first receiving unit receives the test question image;

the first receiving unit is further configured to receive answer information of the target to-be-searched test questions fed back by the server;

the display unit is used for outputting and displaying the answer information;

the server includes:

the second receiving unit is used for receiving the test questions to be searched and sent by the electronic equipment;

the searching unit is used for searching answer information matched with the test question to be searched;

and the feedback unit is used for sending the answer information to the electronic equipment.

A fourth aspect of the present invention discloses another handheld photographing apparatus, including:

a memory storing executable program code;

a processor coupled with the memory;

the processor calls the executable program code stored in the memory to perform part or all of the steps of any one of the methods of the first aspect.

A fifth aspect of the present invention discloses a computer-readable storage medium storing a program code, where the program code includes instructions for performing part or all of the steps of any one of the methods of the first aspect.

A sixth aspect of the embodiments of the present invention discloses a computer program product, which, when run on a computer, causes the computer to perform some or all of the steps of any one of the methods of the first aspect.

A seventh aspect of the present embodiment discloses an application publishing platform, where the application publishing platform is configured to publish a computer program product, where when the computer program product runs on a computer, the computer is caused to perform part or all of the steps of any one of the methods in the first aspect.

Compared with the prior art, the embodiment of the invention has the following beneficial effects:

in the embodiment of the invention, the handheld photographing device can detect the moving and positioning track of the eyes of the user on the surface of the test question, and determine the area to be photographed on the surface of the test question according to the moving and positioning track so as to select the test question to be searched through the area to be photographed. Then, the handheld photographing device photographs the region to be photographed to obtain a test question image, and sends the test question image to the electronic device, so that the electronic device obtains an answer corresponding to the test question. Therefore, by implementing the embodiment of the invention, the handheld photographing equipment can determine the region to be photographed according to the moving positioning track of the sight of the user, and the operation of manually selecting questions is avoided, so that the process of photographing and searching the questions is simplified, and the efficiency of searching the questions is improved.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without creative efforts.

FIG. 1 is a schematic view of an application scenario of a photographing question searching system based on eye positioning according to an embodiment of the present invention;

FIG. 2 is a schematic flowchart of a photographing question searching method based on eye positioning according to an embodiment of the present invention;

FIG. 3 is a schematic flowchart of another photographing question searching method based on eye positioning according to an embodiment of the present disclosure;

FIG. 4 is a schematic flowchart of another photographing question searching method based on eye positioning according to an embodiment of the present disclosure;

FIG. 5 is a diagram illustrating a method for searching for questions by photographing according to an embodiment of the present invention;

FIG. 6 is a diagram illustrating a search result according to an embodiment of the present invention;

fig. 7 is a schematic structural diagram of a handheld photographing device disclosed in the embodiment of the present invention;

fig. 8 is a schematic structural diagram of another handheld photographing device disclosed in the embodiment of the present invention;

fig. 9 is a schematic structural diagram of another handheld photographing device disclosed in the embodiment of the present invention;

fig. 10 is a schematic diagram of a physical device of a handheld photographing apparatus according to an embodiment of the disclosure;

fig. 11 is a schematic structural diagram of a photographing question searching system based on eye positioning according to an embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

It is to be noted that the terms "first", "second" and "third" etc. in the description and claims of the present invention are used for distinguishing different objects, and are not used for describing a specific order. The terms "comprising" and "having" and any variations thereof in the embodiments and figures of the present invention are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.

First, referring to fig. 1, an application scenario related to an embodiment of the present invention is briefly introduced, and fig. 1 is a schematic view of an application scenario of a photographing and topic searching system based on eye positioning disclosed in an embodiment of the present invention, where the system includes a handheld photographing device, an electronic device, and a server. The handheld photographing device can be a search pen, a scanning pen, a photographing pen, a touch pen and the like, the electronic device can comprise a smart phone, a tablet computer, a family education machine and the like, and the server can comprise a cloud server, a traditional server and the like, wherein the handheld photographing device and the electronic device can be connected through a network, the handheld photographing device can also be connected into the electronic device through a peripheral device interface of the electronic device (not shown in fig. 1), and the electronic device and the server can also be connected through the network. The information interaction among the three devices in the system is summarized as follows: the handheld photographing device sends the obtained test question images to the electronic device, the electronic device sends target to-be-searched test questions in the test question images to the server after receiving the test question images, and the server sends answer information of the target to-be-searched test questions to the electronic device after finding the answer information of the target to-be-searched test questions.

In the following, the invention will be described in detail by means of specific examples in conjunction with the above description.

Example one

Referring to fig. 2, fig. 2 is a schematic flowchart illustrating a photographing question searching method based on eye positioning according to an embodiment of the present invention. As shown in fig. 2, the photographing question searching method based on eye positioning may include the following steps:

201. the handheld photographing device detects a moving positioning track of eyes of a user on the surface of the test question, wherein the surface of the test question is used for presenting at least one test question, and the moving positioning track is obtained according to at least one positioning point of the eyes of the user on the surface of the test question.

In the embodiment of the invention, the handheld photographing device can identify the sight line focus of the eyes of the user on the surface of the test question through the eye tracker arranged on the handheld photographing device, the sight line focus is also the positioning point of the eyes of the user on the surface of the test question, and the moving positioning track of the eyes of the user on the surface of the test question is obtained by recording the sight line focus of the eyes of the user in real time, so that the moving positioning track is essentially composed of at least one sight line focus/positioning point. In addition, the surface on which the test questions are located may be a plane displaying the test question content, such as a paper printed with the test question content, a screen of an electronic device displaying the test question content, and the like.

As an optional implementation manner, when the handheld photographing device detects the movement positioning track, the handheld photographing device may project laser on the movement positioning track, so that the movement positioning track of the eyes of the user can be displayed obviously, and further, the user can clearly know the movement track of the eyes of the user, so that the user can more accurately select the test question to be searched, which the user wants to search.

202. The handheld photographing device determines a to-be-photographed area on the surface where the test questions are located according to the moving positioning track, and the to-be-photographed area is used for selecting at least one test question to be searched from the test questions on the surface where the test questions are located.

In the embodiment of the present invention, the area to be photographed may be a preset geometric figure (such as a circle, a rectangle, a triangle, etc.) in any shape, and the moving positioning track may be a basis for determining the area to be photographed for the handheld photographing device, for example, the area to be photographed includes all the moving positioning tracks, or the moving positioning track is a part of or a whole boundary of the area to be photographed.

As an optional implementation manner, a display may be disposed on the handheld photographing device, and the region to be photographed determined by the handheld photographing device may be output and displayed through the display, so that the user knows the region to be photographed of the handheld photographing device, and when the region to be photographed does not meet the user expectation, the user may make a modification in time.

203. The handheld photographing device photographs the region to be photographed to obtain a test question image.

In the embodiment of the invention, when the handheld photographing device detects that the user triggers the photographing instruction, the handheld photographing device photographs the region to be photographed. The mode of the user triggering the photographing instruction may be pressing a photographing key on the handheld photographing device, or clicking a virtual photographing key displayed on the surface of the handheld photographing device, which is not limited in the embodiment of the present invention.

204. The handheld photographing device sends the test question image to the electronic device, so that the electronic device uploads the target to-be-searched test questions in the test question image to the server to obtain answer information matched with the target to-be-searched test questions.

In the embodiment of the invention, the electronic equipment receives the test question image and extracts the target test question to be searched in the test question image, the format of the target test question to be searched can be an image format, and the electronic equipment uploads the target test question to be searched to the server. The server receives the target test questions to be searched, performs content correction and data matching on the target test questions to be searched, so as to obtain answer information matched with the target test questions to be searched, and sends the answer information to the electronic equipment. The electronic equipment receives the answer information sent by the server and outputs and displays the answer information on a screen of the electronic equipment.

As an alternative embodiment, the method for the server to perform content rectification and data matching on the target test question to be searched may include the following steps:

the server detects all characters with inclination angles in the target test question to be searched;

the server corrects all the characters with the inclination angle to obtain recognizable characters;

the server combines the recognizable characters to generate test question content to be searched;

the server searches test question contents matched with the test question contents to be searched from the database and acquires answer information corresponding to the test question contents;

the server detects whether the content of the test questions to be searched is completely consistent with the content of the test questions;

if not, the server marks characters which are inconsistent with the test question content to be searched in the test question content, and sends the test question content with the marks and the corresponding answer information to the electronic equipment together.

By implementing the implementation mode, the server can correct the characters in the target test questions to be searched, the accuracy of the server in identifying the contents of the target test questions to be searched is improved, in addition, the server can compare the difference between the target test questions to be searched and the searched contents of the test questions, marks different contents, and avoids the situation that a user checks wrong answer information.

In the method described in fig. 2, the handheld photographing device determines the to-be-photographed area on the surface of the test question according to the moving positioning track, so as to select the test question to be searched through the to-be-photographed area, thereby avoiding the manual question selection operation of the user, simplifying the process of photographing and searching the question, and improving the efficiency of searching the question. In addition, by implementing the method described in fig. 2, the user can clearly know the moving track of his eyes, so that the user can more accurately select the test questions to be searched. In addition, the method described in fig. 2 is implemented, so that the user can know the region to be photographed of the handheld photographing device conveniently, and when the region to be photographed does not conform to the user expectation, the user can make modifications in time. In addition, by implementing the method described in fig. 2, the server can correct the characters in the target test question to be searched, so that the accuracy of the server in identifying the content of the target test question to be searched is improved, further, the server can compare the difference between the target test question to be searched and the searched content of the test question, and mark different contents, so that the user is prevented from checking wrong answer information.

Example two

Referring to fig. 3, fig. 3 is a schematic flowchart illustrating another photographing question searching method based on eye positioning according to an embodiment of the present invention. As shown in fig. 3, the photographing question searching method based on eye positioning may include the following steps:

301. the handheld photographing device detects a moving positioning track of eyes of a user on the surface of the test question, wherein the surface of the test question is used for presenting at least one test question, and the moving positioning track is obtained according to at least one positioning point of the eyes of the user on the surface of the test question.

302. When the mobile positioning track only comprises one positioning point, the handheld photographing device determines a region to be photographed with the positioning point as a middle point on the surface of the test question, and the region to be photographed is used for selecting at least one test question to be searched from the test questions on the surface of the test question.

In the embodiment of the invention, the condition that the mobile positioning track only comprises one positioning point can be that the user determines to select a certain test question to be searched, and the sight focus of the eyes of the user is positioned at any position on the test question to be searched, so that the mobile positioning track identified by the handheld photographing equipment only comprises one positioning point. The handheld photographing device can determine the region to be photographed by taking the positioning point as a midpoint.

For example, when the area to be photographed is circular, the handheld photographing device determines the position information of the positioning point, sets the positioning point as the center of the circle of the area to be photographed, and determines a circular area to be photographed on the surface where the test question is located by taking the preset radius as the radius of the circle; when the area to be photographed is rectangular, the handheld photographing device determines the position information of the positioning point, sets the positioning point as the intersection point of the diagonal lines of the rectangular area to be photographed, and then takes the preset length and the preset width as the length and the width of the rectangle, so that the rectangular area to be photographed is determined on the surface of the test question.

In the embodiment of the invention, the area to be photographed can be quickly determined under the condition of only one positioning point, so that the operation of manually selecting the area to be photographed by a user is avoided.

As an optional implementation manner, besides the case that the mobile positioning track only includes one positioning point, the mobile positioning track may further include two or more positioning points. When the mobile positioning track includes two or more positioning points, the method for determining the region to be photographed on the surface where the test question is located by the handheld photographing device may further include the following steps:

the handheld photographing device determines a region to be photographed on the surface of the test question according to a preset rule by taking two or more positioning points as a basis, wherein the region to be photographed is used for selecting at least one test question to be searched from the test questions on the surface of the test question.

For example, the handheld photographing device may obtain position information of two positioning points that are farthest from each other in all the positioning points by detecting all the positioning points, the handheld photographing device may set the two positioning points as the first positioning point and the second positioning point, the handheld photographing device may generate a positioning line segment by connecting the first positioning point and the second positioning point, and the handheld photographing device may determine the region to be photographed based on the positioning line segment. When the area to be photographed is circular, the handheld photographing device can determine the area to be photographed by taking the positioning line section as the diameter; when the area to be photographed is rectangular, the handheld photographing device can detect the length of the positioning line segment, and if the length of the positioning line segment is less than or equal to the width of the paper where the test question is located, the handheld photographing device can use the positioning line segment as a certain width of the rectangular area to be photographed, so that the position of the area to be photographed is determined; if the length of the positioning line segment is greater than the width of the paper with the test questions and less than or equal to the length of the paper with the test questions, the handheld photographing device can use the positioning line segment as a certain length of the rectangular region to be photographed, so that the position of the region to be photographed is determined; if the length of the positioning line segment is larger than that of the paper where the test question is located, the handheld photographing device can use the positioning line segment as a diagonal line of the rectangular region to be photographed, and therefore the position of the region to be photographed is determined.

By implementing the implementation mode, the area to be photographed can be rapidly determined according to different positions of the positioning points.

303. The handheld photographing device photographs the region to be photographed to obtain a test question image.

304. The handheld photographing device sends the test question image to the electronic device, so that the electronic device uploads the target to-be-searched test questions in the test question image to the server to obtain answer information matched with the target to-be-searched test questions.

In the method described in fig. 3, the handheld photographing device can determine the region to be photographed according to the movement positioning track of the eye sight of the user, so that the manual problem selection operation of the user is avoided, the problem photographing and searching process is simplified, and the problem searching efficiency is improved. In addition, by implementing the method described in fig. 3, the region to be photographed can be quickly determined under the condition of only one positioning point, thereby avoiding the operation of manually selecting the region to be photographed by the user. In addition, by implementing the method described in fig. 3, the region to be photographed can be quickly determined according to different positions of a plurality of positioning points.

EXAMPLE III

Referring to fig. 4, fig. 4 is a schematic flowchart illustrating another photographing question searching method based on eye positioning according to an embodiment of the present invention. As shown in fig. 4, the photographing question searching method based on eye positioning may include the following steps:

steps 401 to 402 are the same as steps 301 to 302, and the following description is omitted.

403. The handheld photographing device projects laser on a region to be photographed to obtain an explicit frame, and the coverage area of the explicit frame is the same as that of the region to be photographed.

In the embodiment of the present invention, the handheld photographing apparatus may project the Laser on the region to be photographed by using a Laser Display Technology (LDT), the handheld photographing apparatus may project the Laser only on the boundary of the region to be photographed, so that only the boundary of the dominant frame is displayed explicitly, and the handheld photographing apparatus may also project the Laser in the coverage area of the region to be photographed, so that the entire dominant frame is displayed explicitly.

404. The handheld photographing device detects the pressure borne by the photographing key.

In the embodiment of the invention, the handheld photographing equipment can detect the pressure borne by the photographing key through the pressure sensor arranged on the photographing key; the pressure sensor may be of various types, such as a strain gauge pressure sensor, a ceramic pressure sensor, a piezoelectric pressure sensor, and the like, and the embodiment of the present invention is not limited thereto.

For example, the pressure sensor used by the photographing key can be a ceramic pressure sensor, the ceramic pressure sensor has many advantages, for example, the ceramic itself is a high-elasticity, corrosion-resistant and impact-resistant material, the ceramic pressure sensor also has the advantages, the ceramic pressure sensor senses pressure through the front surface of the ceramic diaphragm in the working process, the pressure can enable the diaphragm to generate tiny deformation, the piezoresistor senses the tiny deformation and then generates a piezoresistance effect, a voltage signal is generated, the magnitude of the pressure is calculated according to the voltage signal and the ceramic pressure sensor, so that the information of pressing the photographing key of a user can be accurately acquired, and the identification accuracy of the handheld photographing device is improved.

405. The handheld photographing device detects whether the pressure reaches a preset pressure, and if so, the steps 406 to 407 are executed; if not, step 404-step 405 are executed.

In the embodiment of the present invention, by implementing the steps 404 to 405, it can be determined whether the user needs to take a picture of the region to be taken by detecting the pressure applied to the photographing key, so as to avoid the adverse effect caused by the user mistakenly touching the photographing key.

As an alternative embodiment, after the handheld photographing device performs step 404, the following steps may be further performed:

when the handheld photographing equipment detects that the photographing key bears pressure, the handheld photographing equipment projects an explicit frame on the surface of the test question through laser;

when the handheld photographing equipment detects that the photographing key bears the pressure reaching the preset pressure, the handheld photographing equipment carries out flashing operation on the dominant frame projected by the laser on the surface of the test question, and photographs the coverage area of the dominant frame to obtain a test question image.

Wherein, implement this kind of implementation, handheld equipment of shooing can make the user know the region of waiting to shoot before shooing the examination questions image to give the suggestion to the user when shooing through the mode of the dominant frame of scintillation, make the user more accurate assurance shoot the progress of searching for the questions.

406. And the hand-held photographing equipment photographs the coverage area of the dominant frame to obtain a test question image.

In the embodiment of the present invention, by implementing the

above steps

403 and 406, an explicit frame may be projected around the target test question to be searched, so that the user can definitely know the target test question to be searched selected by the user, and the probability of shooting a wrong target test question to be searched is reduced.

Please refer to fig. 5, fig. 5 is a diagram illustrating a photographing question searching method according to an embodiment of the present invention. In fig. 5, the display diagram of the method for searching for the questions by photographing includes an electronic device, a handheld photographing device and a textbook page, where the textbook page includes two test questions and related content information, a user detects a movement positioning track of eyes of the user by operating the handheld photographing device, and confirms a region to be photographed according to the movement positioning track, the region to be photographed includes the test questions to be searched (including the test questions i and the test questions ii) of the textbook page, and the user photographs the region to be photographed by operating the handheld photographing device to obtain a test question image and sends the test question image to the electronic device, so as to trigger the electronic device to upload the test questions to be searched for the target in the test question image to a server, thereby obtaining answer information matched with the test questions to be searched for the target and outputting and displaying the answer information.

407. The handheld photographing device sends the test question image to the electronic device, so that the electronic device uploads the target to-be-searched test questions in the test question image to the server to obtain answer information matched with the target to-be-searched test questions.

In the embodiment of the invention, the electronic equipment can distinguish the test question contents by identifying the line spacing in the middle of characters in the test question image, the line spacing between different questions in the test question image is larger than the line spacing inside a certain question, and the electronic equipment can identify the number of the test questions to be searched in the test question image through the larger line spacing.

As an alternative embodiment, the manner of displaying the title and the answer by the electronic device may include the following steps:

the electronic equipment detects whether only one test question to be searched exists in the test question image;

if yes, the electronic equipment acquires answer information of the search test questions through the server and outputs and displays the answer information on a screen of the electronic equipment;

if not, the electronic equipment outputs a test question image on a screen and detects a test question to be searched confirmed by the user;

the electronic equipment sends the test questions to be searched to a server so as to obtain answer information corresponding to the test questions to be searched;

the electronic equipment outputs a floating window below the test question to be searched so as to display answer information corresponding to the test question to be searched.

According to the implementation mode, the electronic equipment can output different answer display modes according to different test question numbers, so that the answer output mode of the electronic equipment is more diversified, answer information is directly displayed when the electronic equipment is in a black screen state, and the influence of contents irrelevant to learning on the electronic equipment on a user is reduced.

Referring to fig. 6, fig. 6 is a diagram illustrating a search result according to an embodiment of the present invention. In fig. 6, the search question result display diagram is displayed on the screen of an electronic device (e.g., a tablet computer). The question searching result display diagram comprises a plurality of target to-be-searched questions, a target to-be-searched question A framed by similar oval frames and an answer display window, wherein the answer display window is displayed on the surface of a question set to be searched in a floating mode, and the answer information comprises: analytical procedure (1), results (2) and summary (3). The target to-be-searched test questions A are selected by a user from a plurality of target to-be-searched test questions, and answer information of the target to-be-searched test questions A is obtained by the electronic equipment through obtaining from a server or matching in a local database of the electronic equipment.

In the method described in fig. 4, the handheld photographing device can determine the region to be photographed according to the movement positioning track of the eye sight of the user, so that the manual problem selection operation of the user is avoided, the problem photographing and searching process is simplified, and the problem searching efficiency is improved. In addition, by implementing the method described in fig. 4, whether the user needs to take a picture of the region to be taken can be determined by detecting the pressure applied to the photographing key, thereby avoiding adverse effects caused by the user mistakenly touching the photographing key. In addition, by implementing the method described in fig. 4, the handheld photographing device can make the user know the area to be photographed before photographing the test question image, and prompt the user in a manner of flashing the explicit frame during photographing, so that the user can more accurately grasp the progress of photographing and searching for the test question. In addition, by implementing the method described in fig. 4, an explicit frame can be projected around the target test question to be searched, so that the user can definitely know the target test question to be searched selected by the user, and the probability of shooting the wrong target test question to be searched is reduced. In addition, by implementing the method described in fig. 4, the electronic device can output different answer display modes according to different test question numbers, so that the answer output modes of the electronic device are more diversified.

Example four

Referring to fig. 7, fig. 7 is a schematic structural diagram of a handheld photographing device according to an embodiment of the present invention. As shown in fig. 7, the handheld photographing apparatus 700 may include:

the first detecting unit 701 is configured to detect a moving positioning track of the user's eyes on a surface where the test questions are located, where the surface where the test questions are located is used to present at least one test question, and the moving positioning track is obtained according to at least one positioning point of the user's eyes on the surface where the test questions are located.

As an optional implementation manner, when the first detecting unit 701 detects the moving positioning track, laser may be projected on the moving positioning track, so that the moving positioning track of the eyes of the user can be displayed obviously, and further, the user can clearly know the moving track of the eyes of the user, so that the user can more accurately select the test question to be searched that the user wants to search.

The determining unit 702 is configured to determine, based on the moving positioning track detected by the first detecting unit 701, a to-be-photographed region on the surface where the test question is located, where the to-be-photographed region is used to select at least one test question to be searched from the test questions on the surface where the test question is located.

And a photographing unit 703 for photographing the region to be photographed determined by the determining unit 702 to obtain a test question image.

The first sending unit 704 is configured to send the test question image obtained by photographing by the photographing unit 703 to the electronic device, so that the electronic device uploads the target test question to be searched in the test question image to the server to obtain answer information matching the target test question to be searched.

In the embodiment of the invention, the electronic equipment uploads the target to-be-searched test questions to the server. The server receives the target test questions to be searched, and performs content correction and data matching on the target test questions to be searched, so that answer information matched with the target test questions to be searched is obtained. The electronic equipment receives the answer information sent by the server and outputs and displays the answer information on a screen of the electronic equipment.

As an optional implementation manner, the manner of content rectification and data matching performed by the server on the target test question to be searched may be:

detecting all characters with inclination angles in a target test question to be searched;

correcting all the characters with the inclination angles to obtain recognizable characters;

combining the recognizable characters to generate test question content to be searched;

searching test question content matched with the test question content to be searched from a database, and acquiring answer information corresponding to the test question content;

detecting whether the content of the test questions to be searched is completely consistent with the content of the test questions;

if not, marking the characters which are inconsistent with the test question content to be searched in the test question content, and sending the test question content with the marks and the corresponding answer information to the electronic equipment.

As an alternative embodiment, the manner of displaying the title and the answer by the electronic device may be:

detecting whether only one test question to be searched exists in the test question image;

if yes, acquiring answer information of the search test questions through a server, and outputting and displaying the answer information on a screen of the electronic equipment;

if not, outputting a test question image on a screen, and detecting a test question to be searched confirmed by a user;

sending the test questions to be searched to a server to obtain answer information corresponding to the test questions to be searched;

and outputting a floating window below the test question to be searched so as to display answer information corresponding to the test question to be searched.

Therefore, by implementing the handheld photographing device described in fig. 7, the region to be photographed on the surface of the test question can be determined according to the moving positioning track, so that the test question to be searched can be selected through the region to be photographed, the manual question selection operation of a user is avoided, the process of photographing and searching the question is simplified, and the question searching efficiency is improved. In addition, the implementation of the handheld photographing device described in fig. 7 enables the user to clearly know the movement track of his eyes, so that the user can more accurately select the test question to be searched.

EXAMPLE five

Referring to fig. 8, fig. 8 is a schematic structural diagram of another handheld photographing apparatus according to an embodiment of the disclosure. The handheld photographing apparatus 700 shown in fig. 8 is optimized from the handheld photographing apparatus 700 shown in fig. 7. In contrast to the handheld photographing device 700 shown in fig. 7, the handheld photographing device 700 shown in fig. 8 may further include:

the projecting unit 705 is configured to project laser on the to-be-photographed area determined by the determining unit 702 to obtain an explicit frame after the determining unit 702 determines the to-be-photographed area on the surface where the test question is located based on the moving positioning track and before the photographing unit 703 photographs the to-be-photographed area to obtain a test question image, where a coverage area of the explicit frame is the same as a coverage area of the to-be-photographed area.

The mode of the photographing unit 703 for photographing the region to be photographed to obtain the test question image is specifically as follows:

the photographing unit 703 is configured to photograph the coverage area of the dominant frame projected by the projecting unit 705, so as to obtain a test question image.

In the embodiment of the invention, the dominant frame can be projected around the target to-be-searched test question, so that the user can definitely know the target to-be-searched test question selected by the user, and the probability of shooting the wrong target to-be-searched test question is reduced.

As an alternative implementation, the determining unit 702 may include:

a first determining subunit 7021, configured to determine, when the moving positioning track detected by the first detecting unit 701 only includes one positioning point, a to-be-photographed region with the one positioning point as a midpoint on the surface of the test question.

Therefore, by implementing the handheld photographing device described in fig. 8, the region to be photographed can be determined according to the movement positioning track of the eye sight of the user, and the manual problem selection operation of the user is avoided, so that the problem photographing and searching process is simplified, and the problem searching efficiency is improved. In addition, by implementing the handheld photographing device described in fig. 8, an explicit frame can be projected around the target test question to be searched, so that the user can definitely know the target test question to be searched selected by the user, and the probability of photographing the wrong target test question to be searched is reduced. In addition, with the implementation of the handheld photographing device described in fig. 8, the region to be photographed can be quickly determined under the condition of only one positioning point, so that the operation of manually selecting the region to be photographed by the user is avoided.

EXAMPLE six

Referring to fig. 9, fig. 9 is a schematic structural diagram of another handheld photographing device disclosed in the embodiment of the present invention. The handheld photographing apparatus 700 shown in fig. 9 is optimized from the handheld photographing apparatus 700 shown in fig. 7. Compared to the handheld photographing apparatus 700 shown in fig. 7, the determining unit 702 in the handheld photographing apparatus 700 shown in fig. 9 may further include:

the second determining subunit 7022 is configured to, when the moving positioning track detected by the first detecting unit 701 includes two or more positioning points, determine, based on the two or more positioning points, an area to be photographed on the surface where the test question is located according to a preset rule.

In the embodiment of the present invention, the mobile positioning track may further include two or more positioning points, except that the mobile positioning track only includes one positioning point. When the mobile positioning track comprises two or more positioning points, the area to be photographed can be quickly determined according to different positions of the plurality of positioning points.

As an optional implementation, the handheld photographing apparatus 700 may further include:

the second detecting unit 706 is used for detecting the pressure applied to the photographing key.

A third detecting unit 707 for detecting whether the pressure detected by the second detecting unit 706 reaches a preset pressure.

The photographing unit 703 is specifically configured to photograph the region to be photographed to obtain the test question image when the result detected by the third detecting unit 707 is yes.

In the embodiment of the invention, whether the user needs to take a picture of the region to be taken can be judged by detecting the pressure on the photographing key, so that the adverse effect caused by mistakenly touching the photographing key by the user is avoided.

As an optional implementation, the third detection unit 707 may further perform:

when the second detection unit 706 detects that the photographing key bears pressure, an explicit frame is projected on the surface of the test question through laser;

when it is detected that the pressure borne by the photographing key reaches the preset pressure, the flicker operation is performed on the dominant frame projected by the laser on the surface where the test question is located, and the photographing unit 703 is triggered to photograph the coverage area of the dominant frame to obtain a test question image.

By implementing the implementation mode, the user can know the area to be shot before shooting the test question image, and the user is prompted by flashing the dominant frame when shooting, so that the user can more accurately grasp the progress of shooting and searching the test question.

Therefore, by implementing the handheld photographing device described in fig. 9, the region to be photographed can be determined according to the movement positioning track of the eye sight of the user, and the manual problem selection operation of the user is avoided, so that the problem photographing and searching process is simplified, and the problem searching efficiency is improved. In addition, with the implementation of the handheld photographing device described in fig. 9, the region to be photographed can be quickly determined according to different positions of the plurality of positioning points. In addition, the handheld photographing device described in fig. 9 can determine whether the user needs to photograph the region to be photographed by detecting the pressure applied to the photographing key, thereby avoiding adverse effects caused by the user mistakenly touching the photographing key. In addition, the handheld photographing device described in fig. 9 can make the user know the area to be photographed before photographing the test question image, and prompt the user in a manner of flashing the dominant frame when photographing, so that the user can more accurately grasp the progress of photographing and searching for the test question.

EXAMPLE seven

Referring to fig. 10, fig. 10 is a schematic diagram of an entity apparatus of a handheld photographing device according to an embodiment of the present invention.

Fig. 10 discloses a block diagram of a portion of the structure of the handheld photographing apparatus (e.g., a search pen) shown in fig. 1. Referring to fig. 10, the handheld photographing apparatus may include: an input unit 1010, a memory 1020, a photographing unit 1030, a processor 1040 coupled to the memory 1020, a wireless communication module 1050, and a power supply 1060. Those skilled in the art will appreciate that the configuration of the handheld camera device illustrated in fig. 10 is not intended to be limiting of the handheld camera device and may include more or less components than those illustrated, or some components in combination, or a different arrangement of components.

The following describes each component of the handheld photographing apparatus in detail with reference to fig. 10:

the input unit 1010 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the handheld photographing apparatus. Specifically, the input unit 1010 may include, but is not limited to, a physical key 1011 (e.g., a photographing key, a switch key) disposed on the handheld photographing device, and the like, and may be configured to detect a pressing operation of the user thereon (e.g., an operation of the user on the physical key 1011 using a finger, a handheld touch and press device, or any suitable object or accessory), and drive the corresponding connection device according to a preset program. The input unit 1010 may further include a pressure sensor 1012 that may detect a pressure value applied to the physical key 1011 and transmit the detected pressure value to the processor 1040.

The memory 1020 can be used for storing executable program codes, and the processor 1040 executes various functional applications and data processing of the handheld photographing device by executing the executable program codes stored in the memory 1020, and in particular, executes relevant steps of a photographing question searching method based on eye positioning in the first to third embodiments. The memory 1020 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function (such as a photographing function, a focus positioning function, etc.), and the like; the storage data area may store data (such as a title image, voice data, etc.) created from use of the handheld photographing apparatus, and the like. Further, the memory 1020 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The photographing unit 1030 may include, but is not limited to, an external camera 1031, a focus positioning module 1032, and an angle correction module 1033. Specifically, the external camera 1031 can rotate 180 degrees, and can perform preview photographing through an explicit frame, obtain a topic image by photographing under the drive of a corresponding program, or output the topic image to the memory 1020. The focusing module 1032 may include a laser focusing module, an ultraviolet focusing module, etc., and the focusing module 1032 may perform automatic focusing, positioning, or information projection, or may adjust the focusing and positioning of the external camera 1031 according to the moving positioning track of the user's eyes. The angle correction module 1033 may adjust the photographing angle of the external camera 1031 according to the parameters or the user operation.

The handheld photographing device may further include a gyroscope 1034 or a gravity sensor 1035, the focus positioning module 1032 may adjust the focusing and positioning according to the rotational angular velocity detected by the gyroscope 1034 or the gravitational acceleration detected by the gravity sensor 1035, and the angle correction module 1033 may adjust the photographing angle according to the rotational angular velocity detected by the gyroscope 1034 or the gravitational acceleration detected by the gravity sensor 1035.

The processor 1040 is a control center of the handheld photographing apparatus, connects various parts of the entire handheld photographing apparatus by using various interfaces and lines, and performs various functions and processes data of the handheld photographing apparatus by operating or executing the executable program codes stored in the memory 1020 and calling the data stored in the memory 1020, thereby performing overall monitoring of the handheld photographing apparatus. Alternatively, processor 1040 may include one or more processing units; preferably, processor 1040 may integrate an application processor, which handles primarily operating systems, applications, etc., and a modem processor, which handles primarily wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 1040.

The wireless communication module 1050 may be used to transmit the test question image, receive a control instruction of the external device, and the like when the photographing function is performed, and particularly, may be transmitted to the processor 1040 after receiving the control instruction of the external device, and may be processed by the processor 1040. The wireless communication module 1050 may include, for example, a wireless fidelity (WiFi) module. WiFi belongs to short-distance wireless transmission technology, and handheld photographing equipment can be used for sending test question images and receiving control instructions of external equipment and the like through a WiFi module, and wireless broadband internet access is provided for users.

The handheld photographing device may also include a power source 1060 (e.g., a battery) for powering the various components, which may preferably be logically connected to the processor 1040 via a power management system to manage charging, discharging, and power consumption management functions via the power management system.

The handheld camera device may further include a stylus 1070, and the stylus 1070 may include, but is not limited to, any stylus that can be used on a touch screen/touch screen, such as a rubber soft stylus, a carbon fiber hard stylus, and a pressure-retractable metal stylus. The stylus head 1070 may act on the touchscreen/touch screen of the external device to input signals to the external device.

The handheld photographing device can also include at least one sensor 1080, such as an image sensor, a light sensor, a motion sensor, a biosensor, and other sensors. In particular, the image sensor may convert an optical image into an electronic signal. The light sensor can adjust the brightness of the dominant frame in the photographing unit 1030 according to the brightness of the ambient light. As one type of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally, three axes), can detect the magnitude and direction of gravity when stationary, and can be used to identify the posture (such as vertical placement, horizontal placement) of the handheld photographing device, and vibration identification related functions (such as tapping); as for the handheld photographing device, other sensors such as a gyroscope, an infrared sensor and the like can be configured, and the details are not described herein.

The handheld photographing device may also include an audio circuit 1090, a speaker 1091, and a microphone 1092 may provide an audio interface between the user and the handheld photographing device. The audio circuit 1090 can transmit the electrical signal converted from the received audio data to the loudspeaker 1091, and the electrical signal is converted into a sound signal by the loudspeaker 1091 and output; on the other hand, the microphone 1092 converts the collected sound signals into electrical signals, which are received by the audio circuit 1090 and converted into audio data, which are processed by the audio data output processor 1040 and transmitted to, for example, an electronic device via the wireless communication module 1050, or output to the memory 1020 for further processing.

Although not shown, the handheld photographing device may also include a charging interface and a display. The handheld photographing device can charge the power source 1060 of the handheld photographing device through the charging interface. The interface that charges can include Micro USB interface, USB Type C interface etc.. The handheld photographing device can preview the test question picture to be photographed by the handheld photographing device through the photographing unit 1030 through the display. In addition, the handheld photographing device may further include a switch indicator light, a charging indicator light, and the like, which are not described herein again.

Example eight

Referring to fig. 11, fig. 11 is a schematic structural diagram of a photographing and question searching system based on eye positioning according to an embodiment of the present invention, and as shown in fig. 11, the photographing and question searching system based on eye positioning may include an electronic device 800, a server 900, and a handheld photographing device 700. The structure and function of the handheld photographing device 700 are the same as those of any one of the handheld photographing devices 700 described in the fourth to sixth embodiments, and the description of the embodiments of the present invention is omitted. Optionally, in the system for searching for questions by taking a picture based on eye positioning, the wireless connection relationship is indicated by a dashed line with a double arrow.

Wherein, electronic equipment 800 includes:

the first receiving unit 801 is configured to receive the test question image sent by the handheld photographing device 700.

A second sending unit 802, configured to send the target to-be-searched test questions in the test question image to the server 900 after the first receiving unit 801 receives the test question image.

The first receiving unit 801 is further configured to receive answer information of the target to-be-searched test questions fed back by the server 900.

A display unit 803, configured to output and display the answer information received by the first receiving unit 801.

The server 900 includes:

a second receiving unit 901, configured to receive the test questions to be searched, sent by the electronic device 800.

The searching unit 902 is configured to search answer information matched with the test question to be searched received by the second receiving unit 901.

A feedback unit 903, configured to send answer information searched by the search unit 902 to the electronic device 800.

The embodiment of the invention also discloses a computer readable storage medium, wherein the computer readable storage medium stores program codes, wherein the program codes comprise instructions for executing part or all of the steps of the method in the above method embodiments.

Embodiments of the present invention also disclose a computer program product, wherein, when the computer program product is run on a computer, the computer is caused to execute part or all of the steps of the method as in the above method embodiments.

The embodiment of the present invention also discloses an application publishing platform, wherein the application publishing platform is used for publishing a computer program product, and when the computer program product runs on a computer, the computer is caused to execute part or all of the steps of the method in the above method embodiments.

It should be appreciated that the particular features, structures, or characteristics referred to throughout this specification may be combined in any suitable manner in one or more embodiments. Those skilled in the art should also appreciate that the embodiments described in this specification are exemplary and alternative embodiments, and that the acts and modules illustrated are not required in order to practice the invention.

In various embodiments of the present invention, it should be understood that the sequence numbers of the above-mentioned processes do not imply an inevitable order of execution, and the execution order of the processes should be determined by their functions and inherent logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention.

In the embodiments provided herein, it should be understood that "B corresponding to a" means that B is associated with a from which B can be determined. It should also be understood, however, that determining B from a does not mean determining B from a alone, but may also be determined from a and/or other information.

In addition, the terms "system" and "network" are often used interchangeably herein. It should be understood that the term "and/or" herein is merely one type of association relationship describing an associated object, meaning that three relationships may exist, for example, a and/or B, may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" herein generally indicates that the former and latter related objects are in an "or" relationship.

It will be understood by those skilled in the art that all or part of the steps in the methods of the embodiments described above may be implemented by hardware instructions of a program, and the program may be stored in a computer-readable storage medium, where the storage medium includes Read-Only Memory (ROM), Random Access Memory (RAM), Programmable Read-Only Memory (PROM), Erasable Programmable Read-Only Memory (EPROM), One-time Programmable Read-Only Memory (OTPROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Compact Disc Read-Only Memory (CD-ROM), or other Memory, such as a magnetic disk, or a combination thereof, A tape memory, or any other medium readable by a computer that can be used to carry or store data.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.

The integrated units, if implemented as software functional units and sold or used as a stand-alone product, may be stored in a computer accessible memory. Based on such understanding, the technical solution of the present invention, which is a part of or contributes to the prior art in essence, or all or part of the technical solution, can be embodied in the form of a software product, which is stored in a memory and includes several requests for causing a computer device (which may be a personal computer, a server, a network device, or the like, and may specifically be a processor in the computer device) to execute part or all of the steps of the above-described method of each embodiment of the present invention.

The method, the system and the handheld photographing device for searching for the questions based on the eye positioning disclosed by the embodiment of the invention are introduced in detail, a specific embodiment is applied in the text to explain the principle and the implementation mode of the invention, and the description of the embodiment is only used for helping to understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims

1. A photographing question searching method based on eye positioning is characterized by comprising the following steps:

the handheld photographing device determines a region to be photographed on the surface where the test question is located according to the moving positioning track, and the method comprises the following steps: when the mobile positioning track comprises two or more positioning points, the handheld photographing device determines a first positioning point and a second positioning point from the positioning points and connects the first positioning point and the second positioning point to obtain a positioning line segment; when the area to be photographed is circular, determining the area to be photographed by taking the positioning line segment as a diameter; when the area to be photographed is rectangular, if the length of the positioning line segment is less than or equal to the width of the surface where the test questions are located, determining the area to be photographed by taking the positioning line segment as the width of the rectangle; if the length of the positioning line segment is larger than the width of the surface where the test questions are located and smaller than or equal to the length of paper where the test questions are located, determining the area to be photographed by taking the positioning line segment as the length of a rectangle; if the length of the positioning line segment is larger than that of the surface of the test question, determining the area to be photographed by taking the positioning line segment as a diagonal line of a rectangle; the area to be photographed is used for selecting at least one test question to be searched from the test questions on the surface where the test questions are located; the first positioning point and the second positioning point are two positioning points with the farthest distance in the positioning points;

2. The method of claim 1, wherein the determining, by the handheld photographing device, the region to be photographed on the surface where the test question is located based on the movement positioning track comprises:

3. The method according to claim 1 or 2, wherein the handheld photographing device determines, based on the movement positioning track, a region to be photographed on a surface where the test question is located, and before the handheld photographing device photographs the region to be photographed to obtain the test question image, the method further includes:

4. The method according to claim 1 or 2, wherein before the handheld photographing device photographs the region to be photographed to obtain the test question image, the method further comprises:

5. A handheld photographing apparatus, comprising:

the determining unit is configured to determine, based on the moving positioning track, a to-be-photographed region on the surface where the test question is located, specifically:

the determining unit is configured to determine a first positioning point and a second positioning point from the positioning points when the moving positioning track includes two or more positioning points, and connect the first positioning point and the second positioning point to obtain a positioning line segment; when the area to be photographed is circular, determining the area to be photographed by taking the positioning line segment as a diameter; when the area to be photographed is rectangular, if the length of the positioning line segment is less than or equal to the width of the surface where the test questions are located, determining the area to be photographed by taking the positioning line segment as the width of the rectangle; if the length of the positioning line segment is larger than the width of the surface where the test questions are located and smaller than or equal to the length of paper where the test questions are located, determining the area to be photographed by taking the positioning line segment as the length of a rectangle; if the length of the positioning line segment is larger than that of the surface of the test question, determining the area to be photographed by taking the positioning line segment as a diagonal line of a rectangle; the first positioning point and the second positioning point are two positioning points with the farthest distance in the positioning points;

6. The handheld photographing apparatus according to claim 5, wherein the determination unit includes:

7. The handheld photographing apparatus according to claim 5 or 6, wherein the handheld photographing apparatus further comprises:

8. The handheld photographing apparatus according to claim 5 or 6, wherein the handheld photographing apparatus further comprises:

9. The system for searching questions by taking a picture based on eye positioning is characterized by comprising: an electronic device, a server and a handheld photographing device according to any one of claims 5 to 8;

wherein the electronic device comprises:

the display unit is used for outputting and displaying the answer information;

the server includes: