CN107967110A - Playback method, playing device, electronic equipment and computer-readable recording medium - Google Patents

Playback method, playing device, electronic equipment and computer-readable recording medium Download PDF

Info

Publication number
CN107967110A
CN107967110A CN201711239997.6A CN201711239997A CN107967110A CN 107967110 A CN107967110 A CN 107967110A CN 201711239997 A CN201711239997 A CN 201711239997A CN 107967110 A CN107967110 A CN 107967110A
Authority
CN
China
Prior art keywords
audio
video frequency
page
frequency content
touch area
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201711239997.6A
Other languages
Chinese (zh)
Inventor
黄东
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Genius Technology Co Ltd
Original Assignee
Guangdong Genius Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Genius Technology Co Ltd filed Critical Guangdong Genius Technology Co Ltd
Priority to CN201711239997.6A priority Critical patent/CN107967110A/en
Publication of CN107967110A publication Critical patent/CN107967110A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/43Querying
    • G06F16/432Query formulation
    • G06F16/434Query formulation using image data, e.g. images, photos, pictures taken by a user

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Mathematical Physics (AREA)
  • Multimedia (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The present invention is suitable for technical field of intelligent equipment, there is provided a kind of playback method, playing device, electronic equipment and computer-readable recording medium, the playback method include:Obtain the image of the page;Based on the image of the page, searched and the associated audio-video frequency content of the page in default database;Monitor the touch operation in described image;When listening to the touch operation in described image, the corresponding touch area of the touch operation is determined;Based on the touch area, audio-video frequency content corresponding with the touch area in the audio-video frequency content is played.The present invention carries out the selection or renewal of textbook (teaching material) file without user, and the adjustment of the page number is carried out without user, it is possible to increase user carries out a convenience for reading broadcasting.

Description

Playback method, playing device, electronic equipment and computer-readable recording medium
Technical field
The invention belongs to technical field of intelligent equipment, more particularly to a kind of playback method, playing device, electronic equipment and meter Calculation machine readable storage medium storing program for executing.
Background technology
At present, in the market exist it is many possess a product for reading and (click on and play) function, such as point reader, point reader can be with The study of guiding children, therefore welcome deeply by parent.
However, existing point reader carries out a mode complex steps for reading broadcasting, it is not convenient enough.For example, first, using Before, it is necessary to which parent selects to set textbook (teaching material) file corresponding with the grade of the children for children;Second, when in use, When textbook page turning each time, it is also necessary to also carry out the adjustment of the page number therewith in a reading equipment;3rd, in the textbook of this grade After (teaching material) update or adapted, the correspondence of point reader and textbook also just loses accuracy.
The content of the invention
In view of this, an embodiment of the present invention provides a kind of playback method, playing device, electronic equipment and computer-readable Storage medium, the selection or renewal of textbook (teaching material) file can be carried out without user, the adjustment of the page number is carried out without user, Improve user and carry out a convenience for reading broadcasting.
The first aspect of the embodiment of the present invention provides a kind of playback method, and the playback method includes:
Obtain the image of the page;
Based on the image of the page, searched and the associated audio-video frequency content of the page in default database;
Monitor the touch operation in described image;
When listening to the touch operation in described image, the corresponding touch area of the touch operation is determined;
Based on the touch area, audio-video frequency content corresponding with the touch area in the audio-video frequency content is played.
It is described to be touched based on described in first aspect in the first possible implementation based on the first aspect of the present invention Region is touched, plays audio-video frequency content corresponding with the touch area in the audio-video frequency content, including:
Determine the positional information of the touch area on the image;
Based on the positional information, play in the audio-video frequency content with the associated audio-video frequency content of the positional information.
It is described to be touched based on described in second of possible implementation of first aspect based on the first aspect of the present invention Region is touched, plays audio-video frequency content corresponding with the touch area in the audio-video frequency content, including:
Identify the touch area corresponding text message on the image;
Based on the text message, the audio-video frequency content with the associate text information in the audio-video frequency content is played.
, may at the third based on the first aspect of the present invention, and any of the above-described kind of possible implementation of first aspect Implementation in, the image based on the page, searches in default database and is regarded with the associated sound of the page Frequency content, including:
Image recognition processing is carried out to described image, obtains the characteristic information of described image;
Based on the characteristic information, the page source of the page is determined;
Based on the page source, the corresponding audio-video frequency content in the page source is searched in default database.
Based on the first aspect of the present invention, and any of the above-described kind of possible implementation of first aspect, in the 4th kind of possibility Implementation in, it is described obtain the page image after, further include:
Based on the image of the page, searched and the associated content of text of the page in default database;
It is described determine the corresponding touch area of the touch operation after, further include:
Based on the touch area, content of text corresponding with the touch area in the content of text is shown.
The second aspect of the embodiment of the present invention provides a kind of playing device, and the playing device includes:
Image acquisition unit, for obtaining the image of the page;
Audio-video frequency content searching unit, for the described image obtained based on described image acquiring unit, in default number Searched and the associated audio-video frequency content of the page according in storehouse;
Touch operation monitoring unit, the touch operation in described image for monitoring the acquisition of described image acquiring unit;
Touch area determination unit, for listening to the touch operation in described image when the touch operation monitoring unit When, determine the corresponding touch area of the touch operation;
Broadcast unit, for the touch area determined based on the touch area determination unit, is played the sound and regarded Audio-video frequency content corresponding with the touch area in the audio-video frequency content that frequency content search unit is searched.
Based on the second aspect of the present invention, in second aspect in the first possible implementation, the playing device is also Including:
Positional information determination unit, for determining the touch area that the touch area determination unit determines described The positional information in described image that image acquisition unit obtains;
The broadcast unit is specifically used for, the positional information determined based on the positional information determination unit, plays In the audio-video frequency content that the audio-video frequency content searching unit is searched with the associated audio-video frequency content of the positional information.
Based on the second aspect of the present invention, in second of possible implementation of second aspect, the playing device is also Including:
Text message recognition unit, for identifying the touch area that the touch area determination unit determines described Corresponding text message in the described image that image acquisition unit obtains;
The broadcast unit is specifically additionally operable to, the text message identified based on the text message recognition unit, Play in the audio-video frequency content that the audio-video frequency content searching unit is searched with the audio and video of the associate text information Hold.
The third aspect of the embodiment of the present invention provides a kind of electronic equipment, including memory, processor and is stored in In the memory and the computer program that can run on the processor, when the processor performs the computer program Realize as described in any one the step of playback method.
The fourth aspect of the embodiment of the present invention provides a kind of computer-readable recording medium, the computer-readable storage Media storage has computer program, and the step of the playback method as described in any one is realized when the computer program is executed by processor Suddenly.
Existing beneficial effect is the embodiment of the present invention compared with prior art:
The present invention is by obtaining the image of the page, and based on the image of the page, searched in default database with The associated audio-video frequency content of the page;The touch operation in described image is monitored, is grasped when listening to the touch in described image When making, the corresponding touch area of the touch operation is determined;And be based on the touch area, play in the audio-video frequency content with The corresponding audio-video frequency content in the touch area.As can be seen that due to search with the associated audio-video frequency content of the page and The process of audio-video frequency content corresponding with the touch area is automatic progress in the audio-video frequency content, is joined without user With, therefore avoid the need for user and make choice file, more new file or adjust the troublesome operation of the page number, improve user's progress Point reads the convenience played.
Brief description of the drawings
To describe the technical solutions in the embodiments of the present invention more clearly, below will be to embodiment or description of the prior art Needed in attached drawing be briefly described, it should be apparent that, drawings in the following description be only the present invention some Embodiment, for those of ordinary skill in the art, without having to pay creative labor, can also be according to these Attached drawing obtains other attached drawings.
Fig. 1 is that playback method provided in an embodiment of the present invention realizes flow chart;
Fig. 2 is one of step 102 in embodiment illustrated in fig. 1 provided in an embodiment of the present invention and realizes flow chart;
Fig. 3 is that the playback method that another embodiment of the present invention provides realizes flow chart;
Fig. 4 is the structure diagram of playing device provided in an embodiment of the present invention;
Fig. 5 is the schematic diagram of electronic equipment provided in an embodiment of the present invention.
Embodiment
In being described below, in order to illustrate rather than in order to limit, it is proposed that such as tool of particular system structure, technology etc Body details, to understand thoroughly the embodiment of the present invention.However, it will be clear to one skilled in the art that these are specific The present invention can also be realized in the other embodiments of details.In other situations, omit to well-known system, device, electricity Road and the detailed description of method, in case unnecessary details hinders description of the invention.
In order to illustrate technical solutions according to the invention, illustrated below by specific embodiment.
What Fig. 1 showed playback method provided in an embodiment of the present invention realizes flow chart, and details are as follows:
In a step 101, the image of the page is obtained;
In embodiments of the present invention, the image of the page is obtained by the photographing module of terminal, the page is being learned for user When difficult content is run into during habit, the book page where the difficulty content, alternatively, the page of other carriers where the difficulty content Face.The present invention can be user play the difficulty content relevant explanation, translate or the difficulty content is read aloud, for Family is explained the puzzle, and teaches the study of user.
It should be noted that the image of the page obtained, can be the overview image of the page, or including The parts of images for the difficult content that user is run into, it is preferable that obtain the overview image of the page.
In a step 102, the image based on the page, is searched and the associated sound of the page in default database Video content;
In embodiments of the present invention, the image information of the every page of the books in advance learnt user, after the informationization Image, and be stored in the associated audio-video frequency content of image of every page in default database, which can set Server is placed in, terminal is connected with server communication, in order to obtain related data from the database of server.
Exemplary, default small English learning database is established, by the information of the every page of primary school's english textbook (teaching material) It is stored in the small English learning database.In addition, in the small English learning database, each page therein is associated with being somebody's turn to do The corresponding audio-video frequency content of English study content of the page, for example, read aloud for each English text of the page Audio content, alternatively, carrying out the video content of deduction demonstration for some session operational scenarios of the page.
In embodiments of the present invention, after the image of certain page is got, the image based on the page, it may be determined that should The relevant information of the page, so can be searched in default database and obtain prestoring in the database with the page The associated audio-video frequency content in face.
It should be noted that after textbook (teaching material) is updated (revision), can be in the database of server Renewal is adjusted correspondingly, the user without terminal carries out extra renewal operation.
In step 103, the touch operation in described image is monitored;
In embodiments of the present invention, after the image of the page is got, the touch behaviour of monitoring users on the image Make, the touch operation of user on the image can further indicate that difficult content that user is run on the page specific Position.For example, determine the difficult content that the content on the corresponding touch area of touch operation of user is run into user.
In another embodiment, if not hearing the touch behaviour of user on the image within a preset time interval Make, then all play out the associated audio-video frequency content of the page in a predetermined order.
At step 104, when listening to the touch operation in described image, the corresponding touch of the touch operation is determined Region;
In the present embodiment, if listening to the touch operation of user on the image, it is determined that the touch operation is corresponding Touch area, and the touch area is based on, further position the specific audio-video frequency content that user needs to play.
In step 105, based on the touch area, play corresponding with the touch area in the audio-video frequency content Audio-video frequency content.
In embodiments of the present invention, the touch area based on user on the image, is finding and the page Further position, determine corresponding with the touch area with the associated audio-video frequency content of the page in associated audio-video frequency content Audio-video frequency content, and play corresponding with touch area audio-video frequency content.
Optionally, above-mentioned steps 105 can be accomplished by the following way:
Determine the positional information of the touch area on the image;
Based on the positional information, play in the audio-video frequency content with the associated audio-video frequency content of the positional information.
In the present embodiment, described image is the overview image of the page, the touch area based on user on the image, really The fixed positional information of the touch area on the image, and then according to the positional information, it may be determined that it is corresponding on the page Audio-video frequency content associated by the word content of position, and the audio-video frequency content is played out.Exemplary, in the audio and video Holding can be in the corresponding audio recitation content of content of text for touch area position in described image, audio translation Perhaps other complementary content of multimedia.So as to reach auxiliary user's the destination of study.
Optionally, above-mentioned steps 105 can also be accomplished by the following way:
Identify the touch area corresponding text message on the image;
Based on the text message, the audio-video frequency content with the associate text information in the audio-video frequency content is played.
In the present embodiment, described image can be the overview image of the page, or the Local map of the page Picture, when described image is the topography of the page, the content which includes is more, is existed based on the topography Searched in default database higher with the accuracy rate of the associated audio-video frequency content of the page.
In the present embodiment, processing is identified to the corresponding image-region in touch area in described image, this is obtained and touches Touch region corresponding text message on the image.In default database, the audio-video frequency content that is stored with accordingly Associate text information, then, based on obtained text message, the corresponding sound of the page can be regarded described in default database The audio-video frequency content with text information association is searched in frequency content, and the audio-video frequency content is played out.Exemplary, should Audio-video frequency content can turn over for the corresponding audio recitation content of content of text, the audio for touch area position on image Translate interior perhaps other complementary content of multimedia.So as to reach auxiliary user's the destination of study.
From the foregoing, it will be observed that the image of the invention by obtaining the page, and based on the image of the page, in default database Middle lookup and the associated audio-video frequency content of the page;The touch operation in described image is monitored, when listening in described image Touch operation when, determine the corresponding touch area of the touch operation;And the touch area is based on, play the audio and video Audio-video frequency content corresponding with the touch area in content.As can be seen that due to searching and the associated audio and video of the page The process of audio-video frequency content corresponding with the touch area is automatic progress in content and the audio-video frequency content, without User participates in, therefore avoids the need for user and make choice file, more new file or adjust the troublesome operation of the page number, improves use Family carries out a convenience for reading broadcasting.
Fig. 2 shows that one of step 102 in embodiment illustrated in fig. 1 provided in an embodiment of the present invention realizes flow chart, in detail State as follows:
In step 201, image recognition processing is carried out to described image, obtains the characteristic information of described image;
In embodiments of the present invention, processing is identified to the image of the page of acquisition, obtains the spy of described image Reference ceases, specifically, the characteristic information can be the content of text information of the page, the characteristic information can also be institute State the pixel characteristic information of the image of the page.
In step 202, based on the characteristic information, the page source of the page is determined;
In the embodiment of the present invention, after the characteristic information of described image is obtained, based on the characteristic information, default Lookup matching is carried out in database, it may be determined that the page source of the page.
It is exemplary, be stored with default database each page of all english textbooks of primary school (teaching material) information and Its corresponding image and related audio-video frequency content, described image (the primary school's english textbook one page pair therein obtained according to identification The image answered) on content of text information, can be determined from the database the corresponding page of the image from it is specific which A books (teaching material), and which specific page on the books (teaching material), can also search to obtain the corresponding sound of the page Video content.
In step 203, based on the page source, the corresponding sound in the page source is searched in default database Video content.
After the page source of the page is determined, based on the page source, and then can be in default database Lookup obtains the corresponding audio-video frequency content in page source.
Exemplary, according to the content of text information on image, after characteristic matching is carried out, determine page belonging to the image The page source in face is page 16 in a last term english textbook.So, in default database, can search To the corresponding audio-video frequency content of page 16 in a last term english textbook.
From the foregoing, it will be observed that the image of the invention by obtaining the page, and based on the image of the page, in default database Middle lookup and the associated audio-video frequency content of the page;The touch operation in described image is monitored, when listening in described image Touch operation when, determine the corresponding touch area of the touch operation;And the touch area is based on, play the audio and video Audio-video frequency content corresponding with the touch area in content.As can be seen that due to searching and the associated audio and video of the page The process of audio-video frequency content corresponding with the touch area is automatic progress in content and the audio-video frequency content, without User participates in, therefore avoids the need for user and make choice file, more new file or adjust the troublesome operation of the page number, improves use Family carries out a convenience for reading broadcasting.
Fig. 3 shows that the playback method that another embodiment of the present invention provides realizes flow chart;Details are as follows:
In the present embodiment, step 301 to step 302 refers to step 101 in embodiment illustrated in fig. 1 to step 102, This is not repeated.
In step 303, the image based on the page, is searched and the associated text of the page in default database This content;
In the present embodiment, in the database, in addition to the associated audio-video frequency content of the page, it can also associate There is content of text corresponding with the page, for example, when the text message on the page is foreign language, in the database In, it is stored with translator of Chinese content of text corresponding with the foreign language text message on the page.Correspondingly, based on the page Image, is searched and the associated content of text of the page in default database.
In the present embodiment, step 304 to step 306 specifically refers to step 103 in embodiment illustrated in fig. 1 to step 105, therefore not to repeat here.
In step 307, based on the touch area, text corresponding with the touch area in the content of text is shown This content.
In the present embodiment, after the definite touch area of user on the image, it will search in the database To with the associated content of text of the page, content of text corresponding with touch area is shown to user.Exemplary, should Content of text corresponding with touch area can be the translator of Chinese of touch area corresponding text message on the page.
From the foregoing, it will be observed that the image of the invention by obtaining the page, and based on the image of the page, in default database Middle lookup and the associated audio-video frequency content of the page;The touch operation in described image is monitored, when listening in described image Touch operation when, determine the corresponding touch area of the touch operation;And the touch area is based on, play the audio and video Audio-video frequency content corresponding with the touch area in content.As can be seen that due to searching and the associated audio and video of the page The process of audio-video frequency content corresponding with the touch area is automatic progress in content and the audio-video frequency content, without User participates in, therefore avoids the need for user and make choice file, more new file or adjust the troublesome operation of the page number, improves use Family carries out a convenience for reading broadcasting.
It is to be understood that the size of the sequence number of each step is not meant to the priority of execution sequence, each process in above-described embodiment Execution sequence should determine that the implementation process without tackling the embodiment of the present invention forms any limit with its function and internal logic It is fixed.
Fig. 4 shows the structure diagram of playing device provided in an embodiment of the present invention, for convenience of description, illustrate only With the relevant part of the embodiment of the present invention, details are as follows:
As shown in figure 4, a kind of playing device 4, including:Image acquisition unit 41, audio-video frequency content searching unit 42, touches Operate monitoring unit 43, touch area determination unit 44 and broadcast unit 45.
Image acquisition unit 41, for obtaining the image of the page;
Audio-video frequency content searching unit 42, for the described image obtained based on image acquisition unit 41, in default number Searched and the associated audio-video frequency content of the page according in storehouse;
Touch operation monitoring unit 43, the touch operation in described image for monitoring the acquisition of image acquisition unit 41;
Touch area determination unit 44, for listening to the touch operation in described image when touch operation monitoring unit 43 When, determine the corresponding touch area of the touch operation;
Broadcast unit 45, for the touch area determined based on touch area determination unit 44, in playing audio-video Hold audio-video frequency content corresponding with the touch area in the audio-video frequency content that searching unit 42 is searched.
Optionally, playing device 4 further includes:
Positional information determination unit, for determining that the definite touch area of touch area determination unit 44 is obtained in image Take the positional information in the described image of the acquisition of unit 41;
Broadcast unit 45 is specifically used for, the positional information determined based on the positional information determination unit, plays sound Video content searching unit 42 search the audio-video frequency content in the associated audio-video frequency content of the positional information.
Optionally, playing device 4 further includes:
Text message recognition unit, for identifying that the definite touch area of touch area determination unit 44 is obtained in image Take corresponding text message in the described image of the acquisition of unit 41;
Broadcast unit 45 is specifically additionally operable to, and the text message identified based on the text message recognition unit, is broadcast Audio-video frequency content in the audio-video frequency content that playback video content searching unit 42 is searched with the associate text information.
From the foregoing, it will be observed that the image of the invention by obtaining the page, and based on the image of the page, in default database Middle lookup and the associated audio-video frequency content of the page;The touch operation in described image is monitored, when listening in described image Touch operation when, determine the corresponding touch area of the touch operation;And the touch area is based on, play the audio and video Audio-video frequency content corresponding with the touch area in content.As can be seen that due to searching and the associated audio and video of the page The process of audio-video frequency content corresponding with the touch area is automatic progress in content and the audio-video frequency content, without User participates in, therefore avoids the need for user and make choice file, more new file or adjust the troublesome operation of the page number, improves use Family carries out a convenience for reading broadcasting.
Fig. 5 is the schematic diagram of electronic equipment provided in an embodiment of the present invention.As shown in figure 5, the electronic equipment 5 of the embodiment Including:Processor 50, memory 51 and it is stored in the calculating that can be run in the memory 51 and on the processor 50 Machine program 52.The processor 50 realizes the step in above-mentioned each playback method embodiment when performing the computer program 52 Suddenly, such as the step 101 shown in Fig. 1 is to step 105.Alternatively, the processor 50 is realized when performing the computer program 52 The function of each module/unit in above-mentioned each device embodiment, such as the function of unit 41 to 45 shown in Fig. 4.
Exemplary, the computer program 52 can be divided into one or more module/units, it is one or Multiple module/units are stored in the memory 51, and are performed by the processor 50, to complete the present invention.Described one A or multiple module/units can be the series of computation machine programmed instruction section that can complete specific function, which is used for Implementation procedure of the computer program 52 in the electronic equipment 5 is described.For example, the computer program 52 can be divided Image acquisition unit is cut into, audio-video frequency content searching unit, touch operation monitoring unit, touch area determination unit and broadcasting are single Member, each unit concrete function are as follows:
Image acquisition unit, for obtaining the image of the page;
Audio-video frequency content searching unit, for the described image obtained based on described image acquiring unit, in default number Searched and the associated audio-video frequency content of the page according in storehouse;
Touch operation monitoring unit, the touch operation in described image for monitoring the acquisition of described image acquiring unit;
Touch area determination unit, for listening to the touch operation in described image when the touch operation monitoring unit When, determine the corresponding touch area of the touch operation;
Broadcast unit, for the touch area determined based on the touch area determination unit, is played the sound and regarded Audio-video frequency content corresponding with the touch area in the audio-video frequency content that frequency content search unit is searched.
The electronic equipment 5 can be that the calculating such as desktop PC, notebook, palm PC and cloud server are set It is standby.The electronic equipment may include, but be not limited only to, processor 50, memory 51.It will be understood by those skilled in the art that Fig. 5 The only example of electronic equipment 5, does not form the restriction to electronic equipment 5, can include than illustrating more or fewer portions Part, either combines some components or different components, such as the electronic equipment can also include input-output equipment, net Network access device, bus etc..
Alleged processor 50 can be central processing unit (Central Processing Unit, CPU), can also be Other general processors, digital signal processor (Digital Signal Processor, DSP), application-specific integrated circuit (Application Specific Integrated Circuit, ASIC), field programmable gate array (Field- Programmable Gate Array, FPGA) either other programmable logic device, discrete gate or transistor logic, Discrete hardware components etc..General processor can be microprocessor or the processor can also be any conventional processor Deng.
The memory 51 can be the internal storage unit of the electronic equipment 5, such as the hard disk of electronic equipment 5 or interior Deposit.The memory 51 can also be the External memory equipment of the electronic equipment 5, such as be equipped with the electronic equipment 5 Plug-in type hard disk, intelligent memory card (Smart Media Card, SMC), secure digital (Secure Digital, SD) card, dodges Deposit card (Flash Card) etc..Further, the memory 51 can also both include the storage inside list of the electronic equipment 5 Member also includes External memory equipment.The memory 51 is used to store needed for the computer program and the electronic equipment Other programs and data.The memory 51 can be also used for temporarily storing the data that has exported or will export.
It is apparent to those skilled in the art that for convenience of description and succinctly, only with above-mentioned each work( Can unit, module division progress for example, in practical application, can be as needed and by above-mentioned function distribution by different Functional unit, module are completed, i.e., the internal structure of described device are divided into different functional units or module, more than completion The all or part of function of description.Each functional unit, module in embodiment can be integrated in a processing unit, also may be used To be that unit is individually physically present, can also two or more units integrate in a unit, it is above-mentioned integrated Unit can both be realized in the form of hardware, can also be realized in the form of SFU software functional unit.In addition, each function list Member, the specific name of module are not limited to the protection domain of the application also only to facilitate mutually distinguish.Said system The specific work process of middle unit, module, may be referred to the corresponding process in preceding method embodiment, details are not described herein.
In the above-described embodiments, the description to each embodiment all emphasizes particularly on different fields, and is not described in detail or remembers in some embodiment The part of load, may refer to the associated description of other embodiments.
Those of ordinary skill in the art may realize that each exemplary list described with reference to the embodiments described herein Member and algorithm steps, can be realized with the combination of electronic hardware or computer software and electronic hardware.These functions are actually Performed with hardware or software mode, application-specific and design constraint depending on technical solution.Professional technician Described function can be realized using distinct methods to each specific application, but this realization is it is not considered that exceed The scope of the present invention.
In embodiment provided by the present invention, it should be understood that disclosed device/electronic equipment and method, can be with Realize by another way.For example, device described above/electronic equipment embodiment is only schematical, for example, institute The division of module or unit is stated, is only a kind of division of logic function, there can be other dividing mode when actually realizing, such as Multiple units or component can combine or be desirably integrated into another system, or some features can be ignored, or not perform.Separately A bit, shown or discussed mutual coupling or direct-coupling or communication connection can be by some interfaces, device Or INDIRECT COUPLING or the communication connection of unit, can be electrical, machinery or other forms.
The unit illustrated as separating component may or may not be physically separate, be shown as unit The component shown may or may not be physical location, you can with positioned at a place, or can also be distributed to multiple In network unit.Some or all of unit therein can be selected to realize the mesh of this embodiment scheme according to the actual needs 's.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit, can also That unit is individually physically present, can also two or more units integrate in a unit.Above-mentioned integrated list Member can both be realized in the form of hardware, can also be realized in the form of SFU software functional unit.
If the integrated module/unit realized in the form of SFU software functional unit and as independent production marketing or In use, it can be stored in a computer read/write memory medium.Based on such understanding, the present invention realizes above-mentioned implementation All or part of flow in example method, can also instruct relevant hardware to complete, the meter by computer program Calculation machine program can be stored in a computer-readable recording medium, the computer program when being executed by processor, it can be achieved that on The step of stating each embodiment of the method.Wherein, the computer program includes computer program code, the computer program generation Code can be source code form, object identification code form, executable file or some intermediate forms etc..The computer-readable medium It can include:Any entity or device, recording medium, USB flash disk, mobile hard disk, the magnetic of the computer program code can be carried Dish, CD, computer storage, read-only storage (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium etc..It is it should be noted that described The content that computer-readable medium includes can carry out appropriate increasing according to legislation in jurisdiction and the requirement of patent practice Subtract, such as in some jurisdictions, according to legislation and patent practice, computer-readable medium do not include be electric carrier signal and Telecommunication signal.
Embodiment described above is merely illustrative of the technical solution of the present invention, rather than its limitations;Although with reference to foregoing reality Example is applied the present invention is described in detail, it will be understood by those of ordinary skill in the art that:It still can be to foregoing each Technical solution described in embodiment is modified, or carries out equivalent substitution to which part technical characteristic;And these are changed Or replace, the essence of appropriate technical solution is departed from the spirit and scope of various embodiments of the present invention technical solution, should all Within protection scope of the present invention.

Claims (10)

1. a kind of playback method, it is characterised in that the playback method includes:
Obtain the image of the page;
Based on the image of the page, searched and the associated audio-video frequency content of the page in default database;
Monitor the touch operation in described image;
When listening to the touch operation in described image, the corresponding touch area of the touch operation is determined;
Based on the touch area, audio-video frequency content corresponding with the touch area in the audio-video frequency content is played.
2. playback method according to claim 1, it is characterised in that it is described to be based on the touch area, play the sound Audio-video frequency content corresponding with the touch area in video content, including:
Determine the positional information of the touch area on the image;
Based on the positional information, play in the audio-video frequency content with the associated audio-video frequency content of the positional information.
3. playback method according to claim 1, it is characterised in that it is described to be based on the touch area, play the sound Audio-video frequency content corresponding with the touch area in video content, including:
Identify the touch area corresponding text message on the image;
Based on the text message, the audio-video frequency content with the associate text information in the audio-video frequency content is played.
4. playback method according to any one of claims 1 to 3, it is characterised in that the image based on the page, Lookup and the associated audio-video frequency content of the page in default database, including:
Image recognition processing is carried out to described image, obtains the characteristic information of described image;
Based on the characteristic information, the page source of the page is determined;
Based on the page source, the corresponding audio-video frequency content in the page source is searched in default database.
5. playback method according to any one of claims 1 to 3, it is characterised in that after the image for obtaining the page, Further include:
Based on the image of the page, searched and the associated content of text of the page in default database;
It is described determine the corresponding touch area of the touch operation after, further include:
Based on the touch area, content of text corresponding with the touch area in the content of text is shown.
6. a kind of playing device, it is characterised in that the playing device includes:
Image acquisition unit, for obtaining the image of the page;
Audio-video frequency content searching unit, for the described image obtained based on described image acquiring unit, in default database Middle lookup and the associated audio-video frequency content of the page;
Touch operation monitoring unit, the touch operation in described image for monitoring the acquisition of described image acquiring unit;
Touch area determination unit, for when the touch operation monitoring unit listens to the touch operation in described image, Determine the corresponding touch area of the touch operation;
Broadcast unit, for the touch area determined based on the touch area determination unit, is played in the audio and video Hold audio-video frequency content corresponding with the touch area in the audio-video frequency content that searching unit is searched.
7. playing device according to claim 6, it is characterised in that the playing device further includes:
Positional information determination unit, for determining the touch area that the touch area determination unit determines in described image The positional information in described image that acquiring unit obtains;
The broadcast unit is specifically used for, the positional information determined based on the positional information determination unit, described in broadcasting Audio-video frequency content searching unit search the audio-video frequency content in the associated audio-video frequency content of the positional information.
8. playing device according to claim 6, it is characterised in that the playing device further includes:
Text message recognition unit, for identifying the touch area that the touch area determination unit determines in described image Corresponding text message in the described image that acquiring unit obtains;
The broadcast unit is specifically additionally operable to, the text message identified based on the text message recognition unit, is played Audio-video frequency content in the audio-video frequency content that the audio-video frequency content searching unit is searched with the associate text information.
9. a kind of electronic equipment, including memory, processor and it is stored in the memory and can be on the processor The computer program of operation, it is characterised in that the processor realizes such as claim 1 to 5 when performing the computer program The step of any one the method.
10. a kind of computer-readable recording medium, the computer-readable recording medium storage has computer program, its feature exists In when the computer program is executed by processor the step of realization such as any one of claim 1 to 5 the method.
CN201711239997.6A 2017-11-30 2017-11-30 Playback method, playing device, electronic equipment and computer-readable recording medium Pending CN107967110A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711239997.6A CN107967110A (en) 2017-11-30 2017-11-30 Playback method, playing device, electronic equipment and computer-readable recording medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711239997.6A CN107967110A (en) 2017-11-30 2017-11-30 Playback method, playing device, electronic equipment and computer-readable recording medium

Publications (1)

Publication Number Publication Date
CN107967110A true CN107967110A (en) 2018-04-27

Family

ID=61999116

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711239997.6A Pending CN107967110A (en) 2017-11-30 2017-11-30 Playback method, playing device, electronic equipment and computer-readable recording medium

Country Status (1)

Country Link
CN (1) CN107967110A (en)

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108874356A (en) * 2018-05-31 2018-11-23 珠海格力电器股份有限公司 voice broadcast method, device, mobile terminal and storage medium
CN109241541A (en) * 2018-08-14 2019-01-18 平安普惠企业管理有限公司 Exchange method and terminal device based on voice conversion
CN109255346A (en) * 2018-08-31 2019-01-22 深圳闳宸科技有限公司 Reading method, device and electronic equipment
CN109670454A (en) * 2018-12-21 2019-04-23 Oppo广东移动通信有限公司 A kind of biological information introduces method, biological information introduces device and terminal device
CN110232141A (en) * 2019-05-31 2019-09-13 三角兽(北京)科技有限公司 Resource acquiring method, resource acquisition device, storage medium and electronic equipment
CN110377218A (en) * 2019-06-26 2019-10-25 北京奇艺世纪科技有限公司 Data processing method, device, computer equipment and storage medium
CN110557699A (en) * 2019-09-11 2019-12-10 百度在线网络技术(北京)有限公司 intelligent sound box interaction method, device, equipment and storage medium
CN111078081A (en) * 2019-06-09 2020-04-28 广东小天才科技有限公司 Control method of point-to-read mode and electronic equipment
CN111343512A (en) * 2020-02-04 2020-06-26 聚好看科技股份有限公司 Information acquisition method, display device and server
CN111506744A (en) * 2020-04-07 2020-08-07 广东小天才科技有限公司 Point reading method and terminal equipment
CN111695372A (en) * 2019-03-12 2020-09-22 阿里巴巴集团控股有限公司 Click-to-read method and click-to-read data processing method
CN112650467A (en) * 2020-12-24 2021-04-13 深圳市富途网络科技有限公司 Voice playing method and related device
CN113365132A (en) * 2021-05-27 2021-09-07 网易有道信息技术(江苏)有限公司 Image processing method and device, electronic equipment and storage medium
CN113837830A (en) * 2021-09-13 2021-12-24 珠海格力电器股份有限公司 Product display method, display device and electronic equipment

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104050838A (en) * 2014-07-15 2014-09-17 北京网梯科技发展有限公司 Reading system, device and method capable of recognizing and reading common printed matter
CN104253904A (en) * 2014-09-04 2014-12-31 广东小天才科技有限公司 Method and smartphone for implementing reading learning
CN106021408A (en) * 2016-05-13 2016-10-12 立德高科(昆山)数码科技有限责任公司 Method for playing selected identification image by reading specified image
US20160342613A1 (en) * 2015-05-22 2016-11-24 Kyocera Document Solutions Inc. Display device and image forming apparatus
CN106980459A (en) * 2017-03-31 2017-07-25 广州华多网络科技有限公司 Reading method and device based on touch-screen equipment

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104050838A (en) * 2014-07-15 2014-09-17 北京网梯科技发展有限公司 Reading system, device and method capable of recognizing and reading common printed matter
CN104253904A (en) * 2014-09-04 2014-12-31 广东小天才科技有限公司 Method and smartphone for implementing reading learning
US20160342613A1 (en) * 2015-05-22 2016-11-24 Kyocera Document Solutions Inc. Display device and image forming apparatus
CN106021408A (en) * 2016-05-13 2016-10-12 立德高科(昆山)数码科技有限责任公司 Method for playing selected identification image by reading specified image
CN106980459A (en) * 2017-03-31 2017-07-25 广州华多网络科技有限公司 Reading method and device based on touch-screen equipment

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108874356A (en) * 2018-05-31 2018-11-23 珠海格力电器股份有限公司 voice broadcast method, device, mobile terminal and storage medium
CN109241541A (en) * 2018-08-14 2019-01-18 平安普惠企业管理有限公司 Exchange method and terminal device based on voice conversion
CN109255346A (en) * 2018-08-31 2019-01-22 深圳闳宸科技有限公司 Reading method, device and electronic equipment
CN109670454A (en) * 2018-12-21 2019-04-23 Oppo广东移动通信有限公司 A kind of biological information introduces method, biological information introduces device and terminal device
CN109670454B (en) * 2018-12-21 2020-09-25 Oppo广东移动通信有限公司 Biological information introduction method, biological information introduction device and terminal equipment
CN111695372A (en) * 2019-03-12 2020-09-22 阿里巴巴集团控股有限公司 Click-to-read method and click-to-read data processing method
CN111695372B (en) * 2019-03-12 2023-10-27 阿里巴巴集团控股有限公司 Click-to-read method and click-to-read data processing method
CN110232141A (en) * 2019-05-31 2019-09-13 三角兽(北京)科技有限公司 Resource acquiring method, resource acquisition device, storage medium and electronic equipment
CN111078081A (en) * 2019-06-09 2020-04-28 广东小天才科技有限公司 Control method of point-to-read mode and electronic equipment
CN110377218A (en) * 2019-06-26 2019-10-25 北京奇艺世纪科技有限公司 Data processing method, device, computer equipment and storage medium
CN110377218B (en) * 2019-06-26 2021-09-28 北京奇艺世纪科技有限公司 Data processing method, data processing device, computer equipment and storage medium
CN110557699B (en) * 2019-09-11 2021-09-07 百度在线网络技术(北京)有限公司 Intelligent sound box interaction method, device, equipment and storage medium
CN110557699A (en) * 2019-09-11 2019-12-10 百度在线网络技术(北京)有限公司 intelligent sound box interaction method, device, equipment and storage medium
CN111343512A (en) * 2020-02-04 2020-06-26 聚好看科技股份有限公司 Information acquisition method, display device and server
CN111506744A (en) * 2020-04-07 2020-08-07 广东小天才科技有限公司 Point reading method and terminal equipment
CN111506744B (en) * 2020-04-07 2024-03-19 广东小天才科技有限公司 Click-to-read method and terminal equipment
CN112650467A (en) * 2020-12-24 2021-04-13 深圳市富途网络科技有限公司 Voice playing method and related device
CN112650467B (en) * 2020-12-24 2023-12-19 深圳市富途网络科技有限公司 Voice playing method and related device
CN113365132A (en) * 2021-05-27 2021-09-07 网易有道信息技术(江苏)有限公司 Image processing method and device, electronic equipment and storage medium
CN113837830A (en) * 2021-09-13 2021-12-24 珠海格力电器股份有限公司 Product display method, display device and electronic equipment

Similar Documents

Publication Publication Date Title
CN107967110A (en) Playback method, playing device, electronic equipment and computer-readable recording medium
CN107967357B (en) Friend pushing method and system and terminal equipment
CN108416003A (en) A kind of picture classification method and device, terminal, storage medium
CN109255346A (en) Reading method, device and electronic equipment
CN107733984A (en) A kind of method, terminal and computer-readable recording medium for pushing screen locking information
CN107133263B (en) POI recommendation method, device, equipment and computer readable storage medium
TWI798652B (en) A method and system for automatically generating a data collection module
CN110209809B (en) Text clustering method and device, storage medium and electronic device
US20180350250A1 (en) Network terminal-based learning display device
CN107657973A (en) Text and audio mix display methods, device, terminal device and storage medium
US20190147104A1 (en) Method and apparatus for constructing artificial intelligence application
CN104267974B (en) The call method and device of business interface
CN108694941A (en) For the method for interactive session, information processing unit and product
CN111858951A (en) Learning recommendation method and device based on knowledge graph and terminal equipment
CN112200318A (en) Target detection method, device, machine readable medium and equipment
US20160275185A1 (en) Mobile terminal-based song recommendation method and device
CN108958731A (en) A kind of Application Program Interface generation method, device, equipment and storage medium
CN110610698B (en) Voice labeling method and device
CN109814787B (en) Key information determination method, device, equipment and storage medium
CN110321882A (en) A kind of education resource acquisition methods, device, learning terminal and storage medium
CN106528141B (en) Task sweep-out method and system
CN112464075B (en) Application recommendation method and device of intelligent sound box and electronic equipment
CN107679222A (en) Image processing method, mobile terminal and computer-readable recording medium
CN110598112A (en) Topic recommendation method and device, terminal equipment and storage medium
CN111858865A (en) Semantic recognition method and device, electronic equipment and computer-readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20180427

RJ01 Rejection of invention patent application after publication