CN101937612B - Real image network control device and correlation method thereof - Google Patents
Real image network control device and correlation method thereof Download PDFInfo
- Publication number
- CN101937612B CN101937612B CN2009101487023A CN200910148702A CN101937612B CN 101937612 B CN101937612 B CN 101937612B CN 2009101487023 A CN2009101487023 A CN 2009101487023A CN 200910148702 A CN200910148702 A CN 200910148702A CN 101937612 B CN101937612 B CN 101937612B
- Authority
- CN
- China
- Prior art keywords
- image
- real
- controlled device
- network control
- operation information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- Computer And Data Communications (AREA)
Abstract
The invention provides a real image network control device and a correlation method thereof. The real image network control device comprise a device information database, an image receiving unit, an identification unit, a graphical user interface and a network module, wherein the device information database stores operation information of a controlled device; the image receiving unit acquires a reality image of a peripheral environment and comprises an image of the controlled device; the identification unit identifies the controlled device on the reality image in order to generate an identified result; the graphical user interface comprises a display unit and a signal processing unit, the display unit is used for displaying the reality image and the operation information according to the identified result, and the signal processing unit receives a control signal related to the operation information; and the network module is coupled to the controlled device through a network protocol and used for transmitting an indication signal to the controlled device according to the network protocol and the control signal. Through a photo interface of real scene and the real image, the invention realizes network remote control and ensures that a user can select a controlled object intuitively.
Description
Technical field
The present invention relates to real image network control device and correlation technique thereof, be a kind of control device and method thereof that is used for a network system, relate in particular to a kind of devices and methods therefor that Long-distance Control is carried out at real image interface, the real border of a network system utilization that is used for.
Background technology
Along with popularizing and development of the network technology, the notion of information household appliances should be accumulate and given birth to, and has also opened the application market of digital home.The key concept of digital home builds on a home network; Making originally separately independently, housed device links each other; Set up common communication protocol; Make the kinsfolk be able to use arbitrary easily available equipment, electrical equipment, audio-visual or consumption electronic products equipment in the control man, and reach the shared shared of digital content.
The interface that is used to control housed device at present is main with literal still, yet under such Long-distance Control, the user must be remembered that the label and the model of housed device, to select correct controlling object.In case housed device is numerous; Or it is same with many of a sort housed devices are arranged in the zone; As two TVs or several electric fans are arranged in the floor area simultaneously; Under these circumstances, the user must expend the take notes in detail character features of factory plate model of these equipment of more energy, avoids choosing wrong controlling object.
Please refer to Fig. 1, Fig. 1 is the synoptic diagram at a Long-distance Control interface 12 of known home network.Long-distance Control interface 12 strip columnwises are listed several controllable device models, and when a certain device of user's desire control, the user must connect the impression of model and device appearance, to select correct model.Yet the user must learn that model avoids selecting mistake by heart, causes the inconvenience on the selection operation.
Summary of the invention
Therefore; The present invention mainly is to provide a kind of network system that is used for; Utilize real image interface, real border to carry out the devices and methods therefor of Long-distance Control, letting the user visually select the target device of desire control intuitively, and do not need the character features such as model, title of all controllable devices of hypermnesia.
The present invention discloses a kind of real image network control device, includes a device information database, an image receiving element, an identification unit, a graphic user interface and a mixed-media network modules mixed-media.One operation information of this device information database storage one controlled device.This image receiving element is obtained a real border image, and this reality border image comprises the image of this controlled device.This identification unit identification this controlled device on should reality border image is to produce an identification result.This graphic user interface comprises a display unit, and it is used for showing should reality border image and show this operation information according to this identification result, and a signal processing unit, and it is used for receiving the control signal about this operation information.This mixed-media network modules mixed-media is coupled to this controlled device through a procotol; And this mixed-media network modules mixed-media comprises a delivery unit; It is used for transmitting an indicator signal to this controlled device according to this procotol and this control signal, and a receiving element, is used for receiving this operation information.
The present invention also discloses a kind of real image network control method, includes an operation information of obtaining a controlled device; Obtain a real border image of surrounding environment, this reality border image comprises the image of this controlled device; Identification this controlled device on should reality border image is to produce an identification result; Demonstration should reality border image; According to this identification result, show this operation information; Reception is about a control signal of this operation information; And, transmit an indicator signal to this controlled device according to a procotol and this control signal.
The present invention also discloses a kind of real image network control device, includes an image receiving element, a graphic user interface and a mixed-media network modules mixed-media.This image receiving element is used for obtaining a real border image of surrounding environment, and this reality border image comprises the image of a controlled device.This graphic user interface comprises a display unit and a signal processing unit.This display unit is used for showing should reality border image, and according to an identification result, shows an operation information of this controlled device.This signal processing unit is used for receiving the control signal about this operation information.This mixed-media network modules mixed-media is coupled to this controlled device and a master station through a procotol, and this mixed-media network modules mixed-media comprises one first delivery unit, one first receiving element and one second delivery unit.This first delivery unit be used for transmitting should reality border image to this master station; This first receiving element is used for receiving from this identification result and this operation information of this master station about this reality border image; This second delivery unit is used for transmitting an indicator signal to this controlled device according to this procotol and this control signal.
The present invention also discloses a kind of real image network control method, includes through a procotol to be coupled to a master station and a controlled device; Obtain a real border image of surrounding environment, this reality border image comprises the image of this controlled device; Transmission should reality border image to this master station; Reception from this master station about an identification result of this reality border image and an operation information of this controlled device; Demonstration should reality border image; According to this identification result, show this operation information; Reception is about a control signal of this operation information; And, transmit an indicator signal to this controlled device according to this procotol and this control signal.
The present invention mainly photo interface through " real border real image " realizes network remote control, lets the user can see that photo can select controlling object intuitively.
Description of drawings
Fig. 1 is the synoptic diagram at a known Long-distance Control interface.
Fig. 2 is the synoptic diagram of a network system of the embodiment of the invention.
Fig. 3 is the example once the real border of identification image.
Fig. 4 is a real image network control schematic representation of apparatus of the embodiment of the invention.
Fig. 5 is the process flow diagram of a real image network control flow process of the embodiment of the invention.
Fig. 6 is a real image network control schematic representation of apparatus of the embodiment of the invention.
Fig. 7 is used for the synoptic diagram of an operation interface of the real border image of identification for the embodiment of the invention.
Fig. 8 is the process flow diagram of a real image network control flow process of the embodiment of the invention.
Fig. 9 is a real image network control schematic representation of apparatus of the embodiment of the invention.
Figure 10 is the process flow diagram of a real image network control flow process of the embodiment of the invention.
The primary clustering symbol description:
10 network systems
12 Long-distance Control interfaces
100 home networks
102 gateway apparatus
104 main control end
106 home entertaining subsystems
108 tame electronic systems
110 wireless device subsystems
120 external networks
200 DTVs
210 game machines
220 STBs
230 mobile devices
40,60,90 real image network control devices
400 device information databases
410,900 image receiving elements
420 identification units
430,910 graphic user interfaces
432,912 display units
434,914 signal processing units
440,920 mixed-media network modules mixed-medias
442 delivery units
444 receiving elements
600 metadatabases
610 frame-choosing units
620 information receiving units
The IMG_SEL frame selects image
The free operation information of INFO_SEL
70 operation interfaces
700 real border images
710 marquees
720 device kind menu fields
730 model menu fields
922 first delivery units
924 first receiving elements
926 second delivery units
928 second receiving elements
50,80,1000 real image network control flow processs
20, SE_IMG, the real border of SSE_IMG image
OP_INFO, SOP_INFO operation information
ID_REL, ID_REL_1, ID_REL_2, SID_REL identification result
CTRL_Sg, SCTRL_Sg control signal
SET_Sg, SSET_Sg indicator signal
RES_Sg, SRES_Sg report signal
500,510,520,530,540,550,560,800, step
810、820、830、840、850、860、870、880、
890、1005、1010、1020、1030、1040、1050、
1060、1070、1080
Embodiment
Please refer to Fig. 2, Fig. 2 is the synoptic diagram of a network system 10 of the embodiment of the invention.Network system 10 comprises a home network 100, and it utilizes a gateway apparatus (Gateway) 102, through Internet Protocol, with an external network 120 interconnection.In addition; Home network 100 can build on DLNA (Digital Life Network Alliance; DLNA), on protecting wire net network alliance of energy-conservation family (Energy Conservation and Homecare Network) and other home network technologies, comprise a main control end 104, a home entertaining subsystem 106, one tame electronic system 108 and a wireless device subsystem 110.Home entertaining subsystem 106 can comprise AV devices such as personal computer, DTV, DVD player, game machine and family's theater; Be connected in main control end through LAN agreement (like Ethernet), can play, audio-visual broadcast and audio/video file transposition; Family's electronic system 108 can comprise electric equipment products such as air-conditioning, refrigerator, water heater, washing machine and micro-wave oven, and main control end 104 can be passed through power line network, inquiry and remote control domestic electrical equipment; Wireless device subsystem 110 comprises an access point apparatus, links to each other with main control end 104 through the LAN agreement on the one hand, utilizes wireless devices such as wireless local area network protocol and video camera, mobile phone, printer and notebook computer to link up on the other hand.Arbitrary subsystem assembly in home entertaining subsystem 106, tame electronic system 108 or the wireless device subsystem 110 (like digital TV or washing machine) can be broadcasted the relevant information of oneself on home network 100; And main control end 104 can be found subsystem assembly and obtain relevant operation information, and it can comprise software and hardware, state and information on services of device or the like.The information of above home network is shared and service obtains and should be well known to those skilled in the art, and does not give unnecessary details in this.
What pay special attention to is; In network system 10; Though main control end 104 is an autonomous device with gateway apparatus 102, those skilled in the art should know that main control end 104 can incorporate gateway apparatus 102 into, make gateway apparatus 102 play the part of the role of gateway and home network server simultaneously.
In the present invention, the user utilizes image capture equipment (like digital camera, embedded in mobile phone camera or network camera) that domestic environment is carried out real border and takes the photograph phase, to obtain the real border image (like photo) of the solid images that comprises subsystem assembly.When main control end 104 obtained these real borders image, main control end 104 was automatically or by the subsystem assembly that links to each other with main control end in the image of the real border of free ground of user identification, and obtained the operation information of the successful subsystem assembly of identification.Afterwards, when the user carried out Long-distance Control through real border image, main control end 104 can show the relevant information of these subsystem assemblies on the image of real border, like device name, on off state and service list or the like.The user then selects corresponding real border image earlier, directly clicks the solid images of subsystem assembly again, carries out the project (carrying like functional switch, parameter adjustment, file) of desire control.Therefore, the user can utilize vision to select the subsystem assembly of desire control very intuitively, and does not need the title model of each subsystem assembly of hypermnesia.
Please refer to Fig. 3, Fig. 3 is the example once the real border of identification image 20.Real border image 20 is as a computer screen desktop; Wherein the solid images of a DTV 200, a game machine 210, a STB 220 and a mobile device 230 is by the identification success; Therefore solid images is other demonstrates relevant apparatus and status information, like model name and on off state.In addition, a feature list of mobile device 230 also is presented on the real border image 20, and it is to be drawn by the conversion of the information on services of mobile device 230, comprises " ON/OFF ", " file reception/transmission " reaches " file broadcast " function.
Except utilizing main control end RACS device, user's subsystem assembly also capable of using (like mobile phone or notebook computer) is controlled other subsystem assemblies.For instance; When if user's desire utilizes the personal computer of the mobile device control home entertaining subsystem 106 of wireless device subsystem 110 to transmit an image file to DTV; At first; The user utilizes mobile device to take to comprise the real border image of the context of personal computer and DTV; Then mobile device carries out device identification through real border image uploading to the main control end 104 that wireless network will take, if identification success, the then state and the information on services of main control end 104 passback identification results and personal computer and DTV.According to identification result, mobile device learns that real border image comprises personal computer and DTV stream oriented device, and sets the associated picture position of stream oriented device in the image of real border.In addition; Mobile device shows correlation behavior information and service list on the image of the real border of correspondence; Let the user click the solid images of personal computer, select " file transmission " function, tendency to develop to send image file and transmission destination, click the image of DTV in addition again; Select " file reception " function, to accomplish the image file transposition.
What pay special attention to is that subsystem assembly is not limited in the scope of home network 100 control of subsystem assembly.In general, because the user can go out, make that can take communication formula system and device can leave home network 100 and get into external network 120.In the case, the subsystem assembly of external network 120 can pass through network, controls the subsystem assembly of home network 100 with " real border real image " mode.For instance; If when obtaining as yet the mobile device of the real border image of not identification and getting into external network 120; Mobile device can be uploaded real border image through the Internet and give main control end 104, and carrying out device identification, and main control end 104 is also through the Internet passback identification result and associative operation information.
Hereinafter is divided into main control end and subsystem assembly two large divisions, to specify the control that " main control end-subsystem assembly " reaches " subsystem assembly-subsystem assembly ".
One, main control end:
Please refer to Fig. 4, Fig. 4 is the synoptic diagram of a real image network control device 40 of the embodiment of the invention.Real image network control device 40 can be used for main control end 104; Be used for communication protocol through home network; Control a subsystem assembly with " control of real border real image " mode; It comprises a device information database 400, an image receiving element 410, an identification unit 420, comprises a graphic user interface 430 of a display unit 432 and a signal processing unit 434, and a mixed-media network modules mixed-media 440 that comprises a delivery unit 442 and a receiving element 444.When main control end 104 is utilized mixed-media network modules mixed-media 440 to connect home network and is found this subsystem assembly of subsystem; Receiving element 444 receives the operation information OP_INFO that these subsystem assemblies are broadcasted, and and is stored by device information database 400 (like hard disk unit).Image receiving element 410 is the wire/wireless communication interface arrangement; Can adopt the interface specifications such as IEEE 1394 of radio universal serial bus or U.S. Institute of Electrical and Electronics Engineers IEEE institute standard; Or can obtain a real border image SE_IMG of main control end context through modes such as mail or notes, it comprises the solid images of this subsystem assembly.Or, if real image network control device 40 also comprises an image capture equipment (not being shown among the figure), also can after the real border image SE_IMG of acquisition, directly send image receiving element 410 to.Identification unit 420 is used for the subsystem assembly on the real border image SE_IMG of identification, to produce an identification result ID_REL.Graphic user interface 430 utilizes display unit 432 to show that real border image and all kinds of handle icon are to the user.In addition, according to identification result ID_REL, display unit 432 is shown in operation information OP_INFO on the solid images of subsystem assembly or near zone.In other words, through identification result ID_REL, operation information OP_INFO is presented at suitable place, lets the user come into plain view operation information OP_INFO corresponding to this subsystem assembly, and its display result is with reference to figure 3.That is to say that display unit 432 convertible and acquisition operation information OP_INFO provide a service list or menu, to let the user select the project of this subsystem assembly of desire control.In addition, display unit 432 is preferably after identification result ID_REL indication identification success and indicating this subsystem assembly, just can operation information OP_INFO be presented on the real border image SE_IMG.When the user clicked the service list that is provided or the menu on the display unit 432, signal processing unit 434 was used for receiving the control signal CTRL_Sg about operation information OP_INFO.In other words, signal processing unit 434 is to receive user-selected control item purpose control signal.In addition, if real image network control device 40 also comprises a Touch Screen (not being shown among the figure), the then touching signals conversion responded to by Touch Screen of control signal CTRL_Sg and getting.The delivery unit 442 of mixed-media network modules mixed-media 440 transmits an indicator signal SET_Sg who is used to control this subsystem assembly according to household network communication agreement and control signal CTRL_Sg.Thus, subsystem assembly receives indicator signal SET_Sg through network, and carries out user-selected control project according to indicator signal SET_Sg.After carrying out the control project, subsystem assembly can transmit one through home network and report signal RES_Sg to receiving element 444 according to execution result and state.
Please refer to Fig. 5, Fig. 5 is the process flow diagram of a real image network control flow process 50 of the embodiment of the invention.Real image network control flow process 50 comprises the following step:
Step 500: beginning.
Step 510: obtain operation information OP_INFO and real border image SE_IMG.
Step 520: this subsystem assembly on the real border image SE_IMG of identification, to produce identification result ID_REL.
Step 530:, show real border image SE_IMG and operation information OP_INFO according to identification result ID_REL.
Step 540: receive control signal CTRL_Sg about operation information OP_INFO.
Step 550:, transmit indicator signal SET_Sg to this subsystem assembly according to household network communication agreement and control signal CTRL_Sg.
Step 560: finish.
Real image network control flow process 50 can be used to carry out the operation of real image network control device 40, so its detailed principle please refer to Fig. 4 explanation, repeats no more in this.
In order more to clearly demonstrate the real border of aforesaid identification image, please refer to Fig. 6, Fig. 6 is the synoptic diagram of a real image network control device 60 of the embodiment of the invention.The assembly of the assembly of real image network control device 60 and real image network control device 40 is roughly the same, and difference is to comprise a metadatabase (Metadata Database) 600, one frame-choosing unit 610 and an information receiving unit 620 than real image network control device more than 40.In real image network control device 60, the real border image SE_IMG of identification has two kinds of patterns.First kind of pattern is automatic recognition mode; In this pattern; Metadatabase 600 provide this subsystem assembly dispatch from the factory peddle before by reference entity image and relevant information that manufacturer provided; And identification unit 420 utilizes the solid images of this subsystem assembly on the real border image SE_IMG of image comparison technology identification directly according to metadatabase 600, to produce an identification result ID_REL_1.Therefore, recognition mode is to be cooperatively interacted by metadatabase 600 and identification unit 420 automatically, to reach the automatic identifying function of real image network control device 60.The other type pattern is free recognition mode; In this pattern; Frame-choosing unit 610 is in real border image SE_IMG; Frame takes out and selects image I MG_SEL by the free frame of user, and information receiving unit 620 receives the free operation information INFO_SEL that the user provided, and it can comprise information such as model and manufacturer.In the case, 420 of identification units select image I MG_SEL and free operation information INFO_SEL according to frame, and this subsystem assembly on the real border image SE_IMG of identification is to produce an identification result ID_REL_2.Therefore, even when real image network control device 60 can't pick out subsystem assembly automatically, the user can pass through free recognition mode, manually in real border image SE_IMG, sets up the subsystem assembly of desire control.Automatically reaching under the simultaneous situation of free recognition mode, graphic user interface 430 shows real border image SE_IMG and associative operation information according to identification result ID_REL_1 or ID_REL_2.
Please refer to Fig. 7, Fig. 7 is the embodiment synoptic diagram of an operation interface 70 that is used for the real border image of identification.Operation interface 70 is used to realize second kind of identification mode, and it comprises a real border image 700, a marquee 710, device kind menu field 720 and model menu field 730.When the target of desiring identification is the DTV in the real border image 700; The user can be with marquee 710 dislocations on the solid images of DTV; Then in device kind menu field 720, select " audio-visual devices ", and in model menu field 730, select " XOOP RV9547 ".The frame that the image that 710 frames of marquee are got is among Fig. 5 selects image I MG_SEL; The data of device kind menu field 720 and model menu field 730 are free operation information INFO_SEL.Therefore according to after the aforementioned setting, when carrying out the real image control of real border next time, the device information of DTV and service list can be shown on the digital TV image of real border image 700 and supply the user to read choosing.
Please refer to Fig. 8, Fig. 8 is the process flow diagram of a real image network control flow process 80 of the embodiment of the invention.Real image network control flow process 80 can realize reaching automatically free recognition mode, and to be used for real image network control device 60, it comprises the following step:
Step 800: beginning.
Step 810: obtain operation information OP_INFO and real border image SE_IMG.
Step 820: with automatic recognition mode, this subsystem assembly on the real border image SE_IMG of identification is to produce an identification result ID_REL_1.
Step 830: judge that identification result ID_REL_1 indicates the identification success? If then carry out step 860; If not, then carry out step 840.
Step 840: with free recognition mode, this subsystem assembly on the real border image SE_IMG of identification is to produce an identification result ID_REL_2.
Step 850: judge that identification result ID_REL_2 indicates the identification success? If then carry out step 860; If not, then carry out step 890.
Step 860:, show real border image SE_IMG and operation information OP_INFO according to the identification result that is received.
Step 870: receive control signal CTRL_Sg about operation information OP_INFO.
Step 880:, transmit indicator signal SET_Sg to this subsystem assembly according to household network communication agreement and control signal CTRL_Sg.
Step 890: finish.
In real image network control flow process 80, recognition mode is preferential the selection automatically, and free recognition mode is next.Real image network control flow process 80 can be used to carry out the operation of real image network control device 60, so its detailed principle please refer to Fig. 6 explanation, repeats no more in this.In addition, if automatically with free recognition mode all (when identification result ID_REL_1 and ID_REL_2 all indicate the identification failure) during the identification failure, main control end can provide known network control interface to the user.
Two, subsystem assembly:
Please refer to Fig. 9, Fig. 9 is the synoptic diagram of a real image network control device 90 of the embodiment of the invention.Real image network control device 90 can be used for having among Fig. 1 the subsystem assembly of network control computer function; Like a mobile device or a notebook computer; Be used for communication protocol through home network, control another subsystem assembly (to call object apparatus in the following text) with " control of real border real image " mode.Real image network control device 90 includes an image receiving element 900, a graphic user interface 910 and a mixed-media network modules mixed-media 920; Wherein graphic user interface 910 comprises a display unit 912 and a signal processing unit 914, and mixed-media network modules mixed-media 920 comprises one first delivery unit 922, one first receiving element 924, one second delivery unit 926 and one second receiving element 928.Image receiving element 900 is used for obtaining a real border image SSE_IMG of surrounding environment, and it comprises the image of object apparatus.Mixed-media network modules mixed-media 920 is coupled to this object apparatus and a master station (like main control end 104) through the household network communication agreement.First delivery unit 922 transmits real border image SSE_IMG to this master station; And this object apparatus on the real border image SSE_IMG of master station identification; Producing an identification result SID_REL, and transmit operation information SOP_INFO to the first receiving element 924 of identification result SID_REL and this object apparatus.Display unit 912 shows real border image SSE_IMG, and according to identification result SID_REL, display operation information SOP_INFO on real border image SSE_IMG, its display result can be with reference to figure 3.When the user clicks service item that display unit 912 shown or adjusting gear parameter, the control signal SCTRL_Sg that signal processing unit 914 receives about operation information SOP_INFO.Because image receiving element 900 and graphic user interface 910 usages and main control end part are similar, so its detailed description please refer to Fig. 4 interior literary composition is described.Second delivery unit 926 is used for according to household network communication agreement and control signal SCTRL_Sg, transmits an indicator signal SSET_Sg to object apparatus.Object apparatus is carried out the control project according to indicator signal SSET_Sg, and after carrying out, reports signal SRES_Sg to the second receiving element 928 according to execution result and state transmission one.
Please refer to Figure 10, Figure 10 is the process flow diagram of a real image network control flow process 1000 of the embodiment of the invention.Real image network control flow process 1000 is used for carrying out the operation of real image network control device 90, comprises the following step:
Step 1005: beginning.
Step 1010: obtain real border image SSE_IMG.
Step 1020: transmit real border image SSE_IMG to master station.
Step 1030: receive identification result SID_REL and operation information SOP_INFO from this master station.
Step 1040: show real border image SSE_IMG.
Step 1050:, go up display operation information SOP_INFO in real border image SSE_IMG according to identification result SID_REL.
Step 1060: receive a control signal SCTRL_Sg about operation information SOP_INFO.
Step 1070:, transmit indicator signal SSET_Sg to object apparatus according to household network communication agreement and control signal SCTRL_Sg.
Step 1080: finish.
In real image network control flow process 1000; Identification result SID_REL can indicate which part of solid images on real border image SSE_IMG of object apparatus; With let operation information SOP_INFO be presented on the solid images of object apparatus or near, and then let the come into plain view corresponding relation of operation information SOP_INFO and object apparatus of user.In addition, because real image network control flow process 1000 can be used to carry out the operation of real image network control device 90, so its detailed principle repeats no more in this.
What pay special attention to is, the convenient notion of the present invention of explaining is asked in being illustrated as of aforementioned main control end and subsystem assembly, and all only lifting a sub-systems device is desire control subject matter.Under normal circumstances, real border image comprises the solid images of several desire control subject matters (subsystem assembly) usually, and the device information database of main control end comprises the operation information of a plurality of subsystem assemblies.Therefore, main control end can once pick out a plurality of subsystem assemblies in the image of real border, and relevant real image network control principle and aforementioned similar, so do not give unnecessary details.
In sum, the present invention mainly photo interface through " real border real image " realizes network remote control, lets the user can see that photo can select controlling object intuitively.In addition, another benefit person of being to use can take the scene of desiring as real boundary face according to oneself hobby.
The above is merely preferred embodiment of the present invention, and all equivalent variations and modifications of doing according to claim of the present invention all should belong within the scope that the present invention contains.
Claims (32)
1. real image network control device comprises:
One device information database is used for storing an operation information of a controlled device;
One image receiving element is used for obtaining a real border image of surrounding environment, and said real border image comprises the image of said controlled device;
One identification unit is used for said controlled device on the image of the said real border of identification, to produce an identification result;
One graphic user interface, said graphic user interface comprises:
One display unit is used for showing said real border image, and according to said identification result, shows said operation information;
And
One signal processing unit is used for receiving the control signal about said operation information; And
One mixed-media network modules mixed-media is coupled to said controlled device through a procotol, is used for according to said procotol and said control signal, transmits an indicator signal to said controlled device.
2. real image network control device as claimed in claim 1 also comprises a Touch Screen, is used for receiving the touching signals corresponding to said control signal.
3. real image network control device as claimed in claim 1 also comprises an image capture equipment, is used for capturing said real border image.
4. real image network control device as claimed in claim 1, wherein said graphic user interface also comprises:
One frame-choosing unit is used in the image of said real border, and frame is got by the free frame of a user and selected image; And
One information receiving unit is used for receiving the free operation information that said user provides.
5. real image network control device as claimed in claim 4, wherein said identification unit selects image and said free operation information according to said frame, and the said controlled device on the image of the said real border of identification is to produce said identification result.
6. real image network control device as claimed in claim 1 also comprises a metadatabase, is used for storing the reference entity image and the relevant information of said controlled device.
7. real image network control device as claimed in claim 6, wherein said identification unit are according to said metadatabase, and the image of the said controlled device on the image of the said real border of identification is to produce said identification result.
8. real image network control device as claimed in claim 1, wherein said mixed-media network modules mixed-media also receives the signal of reporting of said controlled device.
9. real image network control device as claimed in claim 1, wherein said operation information comprise a software and hardware information, a status information and an information on services of said controlled device.
10. real image network control device as claimed in claim 1, wherein said display unit shows said real border image and said operation information after said identification result indication identification success and indicating said controlled device.
11. real image network control device as claimed in claim 1, wherein said mixed-media network modules mixed-media also receives the said operation information of said controlled device.
12. a real image network control method comprises:
Obtain an operation information of a controlled device;
Obtain a real border image of surrounding environment, said real border image comprises the image of said controlled device;
Said controlled device on the image of the said real border of identification is to produce an identification result;
Show said real border image;
According to said identification result, show said operation information;
Reception is about a control signal of said operation information; And
According to a procotol and said control signal, transmit an indicator signal to said controlled device.
13. real image network control method as claimed in claim 12 also comprises:
The image center is got by the free frame of a user and is selected image in said real border; And
Receive the free operation information that said user provides.
14. real image network control method as claimed in claim 13; Wherein the said controlled device on the image of the said real border of identification comprises according to said frame with the operation that produces said identification result and selects image and said free operation information; Said controlled device on the image of the said real border of identification is to produce said identification result.
15. real image network control method as claimed in claim 12 comprises also and obtains a metadatabase that it stores the reference entity image and the relevant information of said controlled device.
16. real image network control method as claimed in claim 15; Wherein the said controlled device on the image of the said real border of identification comprises according to said metadatabase with the operation that produces said identification result; The image of the said controlled device on the image of the said real border of identification is to produce said identification result.
17. real image network control method as claimed in claim 12 also comprises the signal of reporting that receives said controlled device.
18. real image network control method as claimed in claim 12, wherein said operation information comprise a software and hardware information, a status information and an information on services of said controlled device.
19. real image network control method as claimed in claim 12 wherein shows that according to said identification result the operation of said operation information comprises:
After said identification result indication identification success and indicating said controlled device, show said operation information.
20. real image network control method as claimed in claim 12 also comprises the said operation information that receives said controlled device.
21. a real image network control device comprises:
One image receiving element is used for obtaining a real border image of surrounding environment, and said real border image comprises the image of a controlled device;
One graphic user interface, said graphic user interface comprises:
One display unit is used for showing said real border image, and according to an identification result, shows an operation information of said controlled device; And
One signal processing unit is used for receiving the control signal about said operation information; And
One mixed-media network modules mixed-media is coupled to a said controlled device and a master station through a procotol, and said mixed-media network modules mixed-media comprises:
One first delivery unit is used for transmitting said real border image to said master station;
One first receiving element is used for receiving from said identification result and the said operation information of said master station about said real border image; And
One second delivery unit is used for according to said procotol and said control signal, transmits an indicator signal to said controlled device.
22. real image network control device as claimed in claim 21 also comprises a Touch Screen, is used for receiving the touching signals corresponding to said control signal.
23. real image network control device as claimed in claim 21 also comprises an image capture equipment, is used for capturing said real border image.
24. real image network control device as claimed in claim 21, the said controlled device on the image of the said real border of wherein said master station identification is to produce said identification result.
25. real image network control device as claimed in claim 21, wherein said mixed-media network modules mixed-media also comprises one second receiving element, is used for receiving the signal of reporting of said controlled device.
26. real image network control device as claimed in claim 21, wherein said operation information comprise a software and hardware information, a status information and an information on services of said controlled device.
27. real image network control device as claimed in claim 21, wherein said display unit shows said operation information after said identification result indication identification success and indicating said controlled device.
28. a real image network control method comprises:
Be coupled to a master station and a controlled device through a procotol;
Obtain a real border image of surrounding environment, said real border image comprises the image of said controlled device;
Transmit said real border image to said master station;
Reception from said master station about an identification result of said real border image and an operation information of said controlled device;
Show said real border image;
According to said identification result, show said operation information;
Reception is about a control signal of said operation information; And
According to said procotol and said control signal, transmit an indicator signal to said controlled device.
29. real image network control method as claimed in claim 28, the said controlled device on the image of wherein said real border carries out identification by said master station, to produce said identification result.
30. real image network control method as claimed in claim 28 also comprises the signal of reporting that receives said controlled device.
31. real image network control method as claimed in claim 28, wherein said operation information comprise a software and hardware information, a status information and an information on services of said controlled device.
32. real image network control method as claimed in claim 28 wherein shows that according to said identification result the operation of said operation information comprises:
After said identification result indication identification success and indicating said controlled device, show said operation information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2009101487023A CN101937612B (en) | 2009-06-30 | 2009-06-30 | Real image network control device and correlation method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2009101487023A CN101937612B (en) | 2009-06-30 | 2009-06-30 | Real image network control device and correlation method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101937612A CN101937612A (en) | 2011-01-05 |
| CN101937612B true CN101937612B (en) | 2012-05-09 |
Family
ID=43390924
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2009101487023A Active CN101937612B (en) | 2009-06-30 | 2009-06-30 | Real image network control device and correlation method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101937612B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105739315B (en) * | 2016-02-02 | 2019-12-06 | 杭州鸿雁电器有限公司 | Control method and device for indoor user electrical equipment |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1756205A (en) * | 2004-09-28 | 2006-04-05 | 乐金电子（沈阳）有限公司 | Home network system and its control method |
| JP2006129184A (en) * | 2004-10-29 | 2006-05-18 | Toshiba Corp | Network electric appliance control system |
| CN2789856Y (en) * | 2005-05-01 | 2006-06-21 | 珠海格力电器股份有限公司 | Remote monitoring household appliance system based on communication network |
| CN1879137A (en) * | 2003-11-04 | 2006-12-13 | 皇家飞利浦电子股份有限公司 | Universal remote control device with touch screen |
| CN101159095A (en) * | 2007-10-24 | 2008-04-09 | 沈阳荣科科技工程有限公司 | Multi-function electric meter reading system based on computer visual sense |
| WO2008104540A1 (en) * | 2007-02-27 | 2008-09-04 | Accenture Global Services Gmbh | Video call device control |
-
2009
- 2009-06-30 CN CN2009101487023A patent/CN101937612B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1879137A (en) * | 2003-11-04 | 2006-12-13 | 皇家飞利浦电子股份有限公司 | Universal remote control device with touch screen |
| CN1756205A (en) * | 2004-09-28 | 2006-04-05 | 乐金电子（沈阳）有限公司 | Home network system and its control method |
| JP2006129184A (en) * | 2004-10-29 | 2006-05-18 | Toshiba Corp | Network electric appliance control system |
| CN2789856Y (en) * | 2005-05-01 | 2006-06-21 | 珠海格力电器股份有限公司 | Remote monitoring household appliance system based on communication network |
| WO2008104540A1 (en) * | 2007-02-27 | 2008-09-04 | Accenture Global Services Gmbh | Video call device control |
| CN101159095A (en) * | 2007-10-24 | 2008-04-09 | 沈阳荣科科技工程有限公司 | Multi-function electric meter reading system based on computer visual sense |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101937612A (en) | 2011-01-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR101699736B1 (en) | Image display apparatus and method for operating the same | |
| CN102713814B (en) | Apparatus for controlling multimedia device and method for providing graphic user interface | |
| CN102117631B (en) | System and method for playing multimedia | |
| CN103795785A (en) | Internet of things control method and terminal | |
| CN107272879A (en) | Display device, system and method for controlling external equipment | |
| WO2021109418A1 (en) | Video resource display method, mobile terminal and server | |
| CN105379292A (en) | Apparatus and method for navigating through media content | |
| CN103297836A (en) | Intelligent channel changing method and system based on gesture tracks | |
| CN101895620A (en) | Home appliance remote controller driving downloading method and system and mobile phone integrated with home appliance remote controller | |
| WO2007129227A2 (en) | A method and system for extending internet protocol remote control to non-internet protocol devices | |
| CN103281580A (en) | Television set remote control method for separating user interface and system thereof | |
| CN103338398A (en) | Set top box control method of mobile terminal and mobile terminal | |
| TWI458291B (en) | Network control device with pictures and related method | |
| CN103546823A (en) | Multi-screen interactive system on basis of local network and method for implementing multi-screen interactive system | |
| CN103796076A (en) | Data processing method and corresponding media playing device and playing control device | |
| CN103873905A (en) | Television control system and television control method | |
| CN111050198A (en) | Display device and switching method of Bluetooth audio device | |
| CN106416279A (en) | Companion device | |
| WO2011038151A1 (en) | A method and system for controlling electronic devices | |
| CN111405321B (en) | Video acquisition method, display device and server | |
| CN107798852A (en) | A kind of control method of Universal infrared remote controller system | |
| CN102098461A (en) | Remote control system and remote control method thereof | |
| CN104081725A (en) | Control system for playing a data stream on a receiving device | |
| US8064830B2 (en) | Wireless access system capable of controlling electronic devices and control method thereof | |
| CN107302709A (en) | The delivering that identifier controls video frequency program is defined using the user of video receiver device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |