WO2007109553A2 - Internet protocol based media streaming solution - Google Patents

Internet protocol based media streaming solution Download PDF

Info

Publication number
WO2007109553A2
WO2007109553A2 PCT/US2007/064191 US2007064191W WO2007109553A2 WO 2007109553 A2 WO2007109553 A2 WO 2007109553A2 US 2007064191 W US2007064191 W US 2007064191W WO 2007109553 A2 WO2007109553 A2 WO 2007109553A2
Authority
WO
WIPO (PCT)
Prior art keywords
media
data
streaming
network
application
Prior art date
Application number
PCT/US2007/064191
Other languages
French (fr)
Other versions
WO2007109553A3 (en
Inventor
Seale Moorer
Eric Eichensehr
Adam Love
Original Assignee
Exceptional Innovation, Llc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US11/686,836 external-priority patent/US8209398B2/en
Application filed by Exceptional Innovation, Llc filed Critical Exceptional Innovation, Llc
Publication of WO2007109553A2 publication Critical patent/WO2007109553A2/en
Publication of WO2007109553A3 publication Critical patent/WO2007109553A3/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L65/61Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio

Definitions

  • each audso device is dosng precisely v ⁇ hat It was designed to do. each operates completely independent from ⁇ s? etners with the possible exception of she portable MP3 player that may he connected *o a PC for synobroni ⁇ etlo ⁇ . As a result, a user en ⁇ s up going from one keypad to another o ⁇ juggling a senes of remote controls in order to control the devices.
  • the audio/video devices are not designed to communicate With other home devices ( ⁇ o. s TV, lighting, security system, etc ⁇ .
  • other home devices ⁇ o. s TV, lighting, security system, etc ⁇ .
  • the user must turn on a TV a DVD player and an audio amplifier by usung thfee different remote controls. Then the user must set me IV to receive a video signal from the DVD player, set the sudio amplifier to receive an audio ssgrta! from the DVD player and use another conuoi unit to adjust the lighting of the room Even when a user indices a universal remote, as is known sn the art.
  • a method of streaming roedsa data in a VVeP Service environment includes the steps of establishing s medsa streaming network betwee nowadays a first med;a davsce and a second media dsvsoe.
  • the madia streaming network implemented with Web Servsce for Devices and a maM;me medsa stresi ' ning protocol pmcsss-ng nsadia data for transfer using a media streaming application implemented in the hrsi media device, transferring the processed media data vsa the media streaming network, receiving the processed media data from the media streaming network, and fermenng the processed media cjara for playback usrng the medsa streaming application implemented in the second me ⁇ sia device.
  • the rnedsa -streaming application may be a fsltef-based media streaming application
  • the I ' iifer-Pased media streaming application may include at least one of s filter to read th ⁇ med;a data from a file or input, a filter to decode the media data, a filter to transform the media data, and a filter to render the media data
  • the method may farther include me s-teps of configuring at least one client and at least one device connected to a network, the at least one client and at least one device o-ei ⁇ a configured w?th w ⁇ p services for devices and father configured to transfer media data
  • the at least one client comprises one of a IV, a personal computer, a persona: digital assistance a control panel, and a game controller and the at least one devsoe compnses an audio system, a video system, an intercom system a lighting system, a security
  • streaming media data in a Wen Service environment sncindes a medsa streaming network implemented with Web Service and configured to transfer media data ussng a re&Mmie rnedsa streaming protocol a fir ⁇ t rnedss cievsee connected io the media streaming network and implemented with a media streaming application for processing media data for transfer, and a second media tlevsce connected to the media stteammg network and implemented with the rnedsa streaming application for rendering the processed rnedsa data from the first media device for playback.
  • the media strearmno application may be a firter--pas €d media streaming application.
  • the filter-based media streaming application may include at leas?
  • a filter to read tne m ⁇ dsa data from a f-!e or snput a I ' iHe? ' to decode the media data, a ⁇ (fet to transform the media data, and a filter to render tne media data
  • an automation system may delude the system for streaming media data noted above and further may include at least ⁇ n ⁇ clrem and at least one devsce connected to a neiwork that are configured wsf h wen services for devices and further configured fo transfer media data with the media streaming application, wherein the at ⁇ east one client comprises, one of s TV, a personal computer, a personal digital assistance, a control panel and a game controller and the at least one device comprises an audio system a video system, an intercom system, a iight;ng system, a security system, and a HVAC system
  • Tne naal-time media streaming protocol may be an internet reai-tsme transport protocol (RTF).
  • Each of the first and second me ⁇ iB devices may include a network interface connected to the network, and a processor running an operating system (DS) Wen Service application and the real-time media streaming apphcaison ⁇ ' he medsa data may oe audio data, vsdee data or a combination of audio and vsdeo dsta
  • An access point for streaming media data in a Web Service environment includes a processor running an operating system (OS) 1 a Wets Service applicators and a real time media streaming application, wherein me real time media stream application processes out-bound med.a data for transfer or renders ⁇ n-no ⁇ md media data for playback, u mr-ds-s te-rrmnai configured ⁇ > interface an externa* media device, vyhereln the med ⁇ a ⁇ rm
  • OS
  • the medsa streaming application may oe a filter-based roedsa streaming application
  • the fsiter-based media streaming application may include at least one ef a filter Io read the media data from a file or input, a filler to decode the me ⁇ i& data, a filter ID transform the media data, and a filter to render the medsa data.
  • An automation system may include the access oosnt as noted above and further may include at least one clsent and at least one dsvsee connected to a network that am- configured with web services % devices and further configured to transfer media data with the media streaming application, wherein the at least one client comprises one of a TV, a personal computer, a personal digital assistance, a corns ol panel and a game comber and the at least one ⁇ levice composes an aud>o system, a video system, an intercom system, a lighting system, a security system, and a HVAC system.
  • the real -time media streaming protocol may be an internet real- time transport protocol (RTPi).
  • RTPi internet real- time transport protocol
  • the >n-bound and out-bound medsa data may be audio da?a, vsdeo data or a combination of aud>o and video da ⁇ a.
  • the m ⁇ d-a ; .emi ; nal s configured kor at least one of audio in, vsdeo in and TV signai in,
  • the ierminai may be configured for ai ieast one o?
  • an intercom unit for a Web Service environment may include s hetwork interface connected to a media streaming neivvork implemented wstn a real-time medsa streaming protocol, a processor configured to run an operating system (OS), a Web Service application and a media stream apphcatron , a microphone configured to collect a first voice ssgnai.
  • OS operating system
  • Web Service application a Web Service application
  • a microphone configured to collect a first voice ssgnai.
  • the real-time media streaming protocoi may be an internet real-time rranspoh protocol 5 RTP).
  • the media streaming application may fee a f ⁇ te ⁇ based media streaming application
  • the niter-based media streaming application may include at ieast one of a ⁇ lier k> reao 1 the media data from a file or input decode Ire media data, transform the media data, and i ⁇ ender the media dels
  • a method of establishing a vosce communication sn a Web Service environment includes the steps of collecting a nrst vosce sagos! via a- microphone, converting the f-rst voice Signal into a digital data stream, processing the digital data stream for fransfer ussng a medsa streaming application, transferrin ⁇ tne p?ooessed digital data stream vsa a media streaming network ussncf a rsah ⁇ m ⁇ media streaming protocol, receiving the processed digital data stream ⁇ om the media streaming network, i ' endenng the processed digital data streaming u ⁇ sng the medsa steaming application for playback, converting the rendered digital data stream to an analog audio signal, and playsng the analog audso signal via a speaker f ⁇ 01$l
  • the media streaming application may be a filter-based media streaming application Ire filter- based media streaming application may
  • a fnaeNne-feadabie medium Includes stored instructions, which, when executed by a processor cause the processor to stream medsa data in a Web Service environment, medium includes instructions for estahlishing a medra sl?eam?r?9 network between a fir ⁇ t media device ano 1 a second media
  • the media streaming network implemented With Web Service and a real-time! media streaming protocol, instructions for processing medsa data for transfer using a media stream-ng application ⁇ ipiersierited in the first media device instructions for trsnsfernng the processed media data via the media streaming network, instructions *or receiving ⁇ t?e processed media dala from the media streaming network, and instructions is for rendering the processed media data for playback using the media streaming application implemented $n me second media device
  • the media streaming appisca ⁇ on may be a fiifet-based media streaming application
  • the filter-based med ⁇ a streaming application may snoiude at leasi one of a filter to read lhe media data from a f ⁇ e or snout, decode the media data, transform the
  • the real time media streaming protocol may be an internet reai-ume transport protocol (RTP) Ths? media data may be audio data, video riata or a combination of audio a?id ⁇ deo data.
  • RTP internet reai-ume transport protocol
  • Rg 2 schematically shows various media devices configured and connected to a network. ?or use s ⁇ the convergence solution of Fsg 1. constructed according to pfi ⁇ cspies s of the invention.
  • FIG. 3 schematically shows a structure of a digital audio/vsdeo access posnt oonsU uc*e-d according to the principles of the invention: fOO.14]
  • F-g 4 schematically shows a structure of a media streaming system constructed according to the principles of the invention, ⁇ >
  • Fig 5 schematically shows a structure of an audio sireaming system constructed aeeosro ⁇ ri ⁇ to the principles of the invention.
  • Fig 1 schematically shows an overview of a convergence solution according to an embodiment of the invention.
  • the convergence solution may be a combination of
  • the hardware may include a server 10 connected to a network network such as an Ethernet network) and may po&ssbiy be connected Io the internet 14, devices 102 (e g audio 20, video 22. intercom 24 ; lighting 25, secunh/ system 28, HVAC 38, and the iike) and clients 104 (e.g TV 30, personal computer (PC) 32, personal dsgrtai assistance (PDA) 3 ⁇ controller 36 such as a control parse!, game controller ⁇ i.e. X-Box ⁇ . not shown ⁇ s-nd the HKe).
  • a server 10 connected to a network network such as an Ethernet network
  • devices 102 e g audio 20, video 22. intercom 24 ; lighting 25, secunh/ system 28, HVAC 38, and the iike
  • clients 104 e.g TV 30, personal computer (PC) 32, personal dsgrtai assistance (PDA) 3 ⁇ controller 36 such as a control parse!, game controller ⁇ i.e. X-Box ⁇ . not
  • the s cisems 104 may snciucse a remote control 39 or a remote control may be configured to be a ciseni 104
  • the server IO may be any type of computer such as a PC connected to the network 12.
  • the cheats 104 such as clients 30, 32. 34, 36 provide a user wsih control over the devices 102 such as devices 20, 22 , 24, 26 28. 38 [ ⁇ H)S0
  • the software ⁇ j e . application) enables the hardware such as tne server 10,
  • the application may uifee ai leas! one portion of the hardware to send commands to the devices 102 and receive feedback from them
  • the application may integrate
  • the application may be implemented with Web Services.
  • Web Services use standard Internet protocol OP,; and are based on standard ⁇ yi..-reiated technolocjies such as SOAP (Simple Oo-ieet Access Pfotecoh for communications and WSDL (Web Services Device Language) to describe interfaces
  • SOAP Simple Oo-ieet Access Pfotecoh for communications
  • WSDL Web Services Device Language
  • the devsoes x- rnay be configured as a SideShow T!s5 device or 'gadget " A Side8how w device or gadget may communicate with any client or devsce implemented wdh WSD in the network via protocols according to S;deShow m XsVH.
  • Fig. 2 schematically shows various medsa devrces configured and connected to the network 12, for use m the convergence soiutson of Fig 1 constructed according Io pnnoipies of the invention in particuiar, Fsg. 2 shows media devices, such as the plural audso devices 20, video devils 22 and intercom system 24 of Fig.
  • 1 thai may be configured s ⁇ ci connected to the convergence system according to an embodiment of me invention
  • These media devices may oe any type of devices oonfioureo to reoerve, slore, iransfer and piay media files or s.gnals for example, a timer card 40, storage 42, and sound card 44 are connected to the sever 10 or aiternatsveiy/additionally a PC 32 s. f ⁇ 034]
  • the tuner card 40 may be any type of weii-known card capable of receiving video Signals that may be connected to a TV signal source such as an antenna, cable bo ; ⁇ , saleMe receiver, or the irke-.
  • the tasw card 40 may convert the Tv signal from an analog format to a dspjtai format
  • the storage 42 may be a hard disk dnve, memory card/reader. CD/DVD BOfVi driver, rV1P3 player, or the like, and stores, at least for example, dsostal audio/video (media ⁇ content.
  • the sound card 44 may he any type of wasi- i ⁇ nown sound card capable of receiving audio signals and ma-y Pe connected to an audio provide an audso signai iVom the audio signai source to any of the devices connected to the network 12.
  • the sound card 44 may convert the audio signal from the analog format ⁇ o the digital format
  • Fig 2 shows the tuner card 4O 1 storage 42 and sound card 44 connected to the sever 10.
  • mese devices may he connected ⁇ O the network 10 y;a deferent devices or connected ⁇ i?ectiy to the network,
  • a storage 46. such as a network storage may be directly connected to the network 12
  • deuces implemented with Web Sendees may be direc% connected to the network For e ⁇ an$ ⁇ ie.
  • a Web Services (WS) enabied ampler 46, WS enai3ied audso/videc (AA/) device SO, VVS enabied audso device 52 and WS enabled video device 54 may be directly connected Io the network 12.
  • a user may eontroi fhese devices 50, 62 54 ffom any of the c ⁇ ents " KM (shown in deta;i in Fi ⁇ 1 ⁇ For exampie, by ⁇ s? ⁇ g tbe TV 30 iocated so a siving room and its remote eontroi 39, the user r ⁇ ?ay select an MP3 tiie stored in the s ⁇ eraoe 42 or 46 in a chiid s room and ciay ihe file through the W3 audio device 52 ;n a dsnsng roon> o? the WS ampNf ' ser 4B in the isvsncj room. ⁇ -so.
  • the controller 39 by ussng the controller 39.
  • the user may select tne TV Signal received by the tyner card 40 located ;n a basement and play the TV signal through the WS AA/ device 50, suoh as a TV, located m a bed room.
  • the user may access any type of media f ⁇ es or sKinais whenever and wherever he or she wants f €KKI ⁇ J For those med ⁇ a devices that are not implemented with Web Se ⁇ sces, access points may be used to connect those devices to the network 12, For example, if a TV ssgnel source and the tuner card 40 are located tn separata rooms, on A/V access posns 60 implemented with Web Services may be used to connect the TV Signal source ⁇ O the s network.
  • the A/V access point 60 may be equipped with a tuner card and connected to tn& network 12 wirelessly, fCRXiTJ Similarly.
  • &n audro source and video source may be connected to the network 12 vsa. en audio access point 62 and video access point 54, respectively While the access oosms 80 62, 04 may be used to interface between the media sources Ce g TV, audio and if vsdeo Signal sources and the like), the same access points may he used as media playback devices (e g. TV, stereo system, video monitor and the IiKs).
  • media playback devices e g. TV, stereo system, video monitor and the IiKs.
  • an A/V access point 66 implemented With Web Services may provide a TV with s- TV Signal received l>c?m the tuner card 40 or the TV signal received from me A/V access point 60
  • An audio access point 68 may provide an au ⁇ o playback device with an MP3 file stored ;n ⁇ % the sto?ae ? e 48
  • a video access, pemf TO may provide a monitor with the video signal received i ' rom the video access posnt 84.
  • an intercom system may he imptemented.
  • Such access pcsms may utibxe the technology disciosed sn Applicarsf s. eopendsnQ patent applica ⁇ o ⁇ U.S. Patent Appiscaiion No (to he assigned), entitled NETWORK BASED DIGITAL
  • FIG. 1 schematica ⁇ y shows a struciure of a digital audio/video access posni constructed according to the principles of the invention.
  • Rg 3 shows exemplary structure o? an access point Tl , such as the access points 60. &2, 84, 66, 88
  • the access point ?1 may be equippeo with a oetworH interface 72 that aiiows me access point ? 1 to communicate with the server 10.
  • the clients 104 the oevices 102 (such as 40. 42 44. 46. 48 50. 62. 54. 56, 58 and other access points SO. 62. 64, 66. 68, 70 of Fig 3 via me IP network 12
  • the network interface 72 may Pe a wired or wireless interface.
  • the access point 71 may include a processor 74 that may run an operating system (OS? and app ⁇ catlon* to implement Web Services in the access point 71. Thus, upon hesng connected to the network 12, the access point 71 may he qujckry recognized
  • Ths processor 74 may also run a media streaming application 80.
  • DirectShow ' ⁇ available from yierosoft !V Redmond, WA
  • DifectShowTM divides ⁇ media processing task (e g.
  • a media streaming application such as a
  • ⁇ filter oased media streaming application thai may be for example DirectShow ' ⁇ may be used.
  • Such en application may be a multimedia framework aoei API 700 to perform operates with media files and the IiKe it may be an extensile, filler-based framework that can render or record media tiles on demand Bach filter (?02 ⁇ ?D4. 70 ⁇ , /08) repneserns a stage in the process sno; of the media data, e g, reeding media data from a file
  • the filter include a numPer of pins 710 mat represent connection points on the filter ma? may be connected to other filters.
  • Rns 710 rney be esther output or snput r ⁇ posols:.
  • data is either requested from en output pin or sent to an snoot psn sn order to transfer data between filters
  • the friers may tee busii using a set of C - ⁇ classes provided in the DiteotShow SDK, caPed the DiredShow(tm) Base Classes, These handle much of the creators, registration and connection looic for trse filter. For the fiker graph to use filters automatically, mey need to be registered in a separate
  • the access posm 71 may further include an analog to digital tN ⁇ ) converter 82, a TV tuner 84 a dsgstal to analog (D/Aj converter 80, video in terminal SS. audio m
  • the access point 71 may oe capable of handling various media streams te g . TV ei$nal.
  • the access point 71 may Pe equipped With fewer components than what are shown in Fig 3
  • the A/0 converter may not be neeessanly be needed P>CI44
  • the access point 71 may include ooiy necessary components for a specific purpose.
  • the video in terminal 88 may receive a video dai ⁇ stream from a video source, such as a camcorder, security camera, camera phone, VCR. OVD player, portable media player, DVR, game controller, or the like Any ksnd of video in is contemplated by the invention including eomposns. s-video. component, HOM!
  • RTP internet foaMirne transport protocol
  • This , support includes source identification and support for gateways isk ⁇ audio ano video ondges. as weii as a mur
  • an audio source such as a rnrcrc-phone, radio, C0/0V0 player, portable Any type of audio in terminal is coniempiated tey
  • the audio dala stream m the anaiog format may oe convened to a o'gitai aud ⁇ o data stream by the A/D converter 82. " The digital audio date stream from the
  • X5 A/D converter 82 or the audio in terminal 90 may Pe processed by ihe processor 74 using the media streaming application 80 such as DsreciShow 'f>> "', and transferred to the network via network interface ?2 us:no, the internet standard protocol such as RTP, Similarly, the TV signal In terrnsna! 92 may receive a TV Signal fmm the W signal source such as an antenna. caPie outlet, sei-top box VCR. DVD, OVR, game conUo ⁇ e? or the like The TV
  • ssgnai may then be converted to a digital media steam by the tuoer 84.
  • the digital TV Signal stream ss processed using the media streaming application 80. such as 0;rectShov ⁇ for maHsme multicast or umcast via the network 12 using tne internet standard protocol such as RTF.
  • the tuner 84 niav communicate with the Web Service Application 78 such that a user can control the tuner 84 via the chents 104
  • 6 point Ti may mtedace media playback devsces. such as an A/V device, video device or audio device, m ofde-r to play back the media stream data transferred from the network 12.
  • media playback devsces such as an A/V device, video device or audio device
  • m ofde-r to play back the media stream data transferred from the network 12.
  • an audio data st/esm which has been previously processed by a different devsce of access point using the media streaming application s$ transferred to the network mtertaee 72 via the network 12 using the internet standard protocol.
  • the audio data st/esm which has been previously processed by a different devsce of access point using the media streaming application s$ transferred to the network mtertaee 72 via the network 12 using the internet standard protocol.
  • the rendered audso cats stream may be converted to the analog format by the D/A converter 86 ⁇ necessary
  • the audio data stream rendered by the media stream application 80 may then he transfensd to the audio device via the audio out terminal SS Similarly to the audro m terminal any type of aodso is contemplated by the snventron
  • ⁇ c be established ' by ussng two or more access posnts 71.
  • F;g. 4 shows a structure of a media streaming system according to sn embodiment o? " the invention,
  • the media streaming system includes two or more- media st/eaming units such as the first and second med-a streaming unsis 402 and -404
  • me first media streaming unit 402 and ihe second streaming ynst 404 may be controlled by the server 10 ar>d/or the cl-erits 104 in ihss srnbodin'sent.
  • me first media streaming unit 402 is cor ifs ⁇
  • the first media stream unrt 402 may Include a netv ⁇ os ' k inten'ace ?2A. a processor ?4A and a tuner 84 ⁇
  • the tuner 84A m5j receive a TV signal from an external TV signal source
  • the TV signal may r>e processed by the processor 74A using the media streaming application 8OA.
  • Signals such as dsgicai fn ⁇ ving picture data may be aiso processed using the media so-earnsno application 8OA as noted by the input arrow 406.
  • the processed media stream may tne ⁇ be transferred to the second medss streaming unrt 404 via the network interface ?2A and the network 12 usrng the internet standard protocol
  • the second media stream umt 404 may include a network interface ?2S. a processor 74 B. and a D/A converter SS.
  • the media stmam receded by the network interface ?2B may be rendered for playback by 5 a media streaming application 808.
  • the rendered media stream may be smsar ⁇ ed io an AA/ device directly (si the devso ⁇ accepts digital s>g?iais) or via the D/A converter 86B if analog signals are needed fCIOS ⁇ J f s ⁇ S shows a structure of an audio streaming system according to an embodiment of the invention
  • the audio streaming system may include two or more so media steaming units such as the first and second audio streaming units 604 and b ' ⁇ .
  • Hie server H ) , the clients 104 and the first and second audio stream-no, unsts 504, 506 may all he connected to me network 12 and implemented with WSD.
  • the first sueho streaming un ⁇ 504 and the second audio streaming unit 50 ⁇ may be controlled by the server 10 and the clients 104 in thss embodiment the first audso stresrning un>
  • the first auoK j streaming unit 604 may include a network interface 72C, processor 74C. and a xo sound card 84C
  • the sound card B4C may receive an audio slgnai from an externa! audio s i gnal source.
  • the audio signal may be processed by th « processor ?4C using the audio sueamsno application 8OC
  • a digital audio data stream may bypass the sound card 84C when it is from a dsgitai "media file source. "
  • the processed audio stream may then Pe transferred to the second audio stmamsng unit 506 vsa the network interface 72C and ihs *
  • the second sudio stream unst 506 may snciude a network interface ?2D. a processor ' ?4D, and a sound card 840
  • the audro sUeam receded by the network interface ?2D may Pe rendered for playback by a media streaming application 8OD,
  • the rendered media stream may be steamed out to an audio playback device directly (digitally) or via the sound card 84D to o ⁇ erate an analog signal
  • the intercom system may Include two or more intercom units such as the firs! and second intercom units ⁇ O8 and ⁇ 10
  • the server 10 the cJienis 104 arsd the first a ⁇ d second ⁇ tercom unsts 608, 610 may all be connected to tne network I ⁇ and Implemented with Web Service.
  • the first intercom unit 608 may include a network
  • the microphone 1 14E captures a voice for othe?
  • the data stream is then processed by ih% data streaming application 8OE. as described above, and transferred to the second intercom suit 610 via the network interface ?2E and th& network 12, AHo, the data stream transferred from the second intercom unit OIO vsa the network 12 and the network interface ?2E may tee rende?eci for playback by tne processor T ⁇ E using the data streaming application 8OE
  • the rendered data stream may be conv e rted to an analog audio Signal by %h& sound card 84E 1 ampiifsed by the ampliiss 112E, and transferred to the speaker 1 16E.
  • the user interface 118B provides the user with various control options such that the user may seiect an intercom in a differem location for communication, start intercom processing, stop intercom processing, and the ⁇ ke.
  • the second sniercom unit QtO Includes a network interface ?2F, a processor ?4F, a sound card S4E an amplifier i 12F. a microphone 114F, a speaKer 116F and a user an interface ' S * 8F,
  • the second intercom unit 610 operates ⁇ n substantially the same manner as the first intercom unit 008. More intercom units may b ⁇ added sf necessary or desired and the data streaming application soon as DirectShow riv: . enaotes both multicast and unicast of any data stream over the multiple intercom units
  • vaooos embodiments of the invention descnbed herein are intended tor operation wsth as software programs runnsfig on ⁇ computer- processor
  • aitemstive software implementations including, but not limited to, distributed processing or component/ohjsct distributed processing, ⁇ a?al!e! processing, virtual machine- processing, any future enhancements, or any future protocol can also bo used to implement the metnods described herein
  • [CN)SSJ tt should also be noted that the software implementations of the invention as described herein are optionally stored on a tangible storage medium, s ⁇ ch as. a magneuc medium such as a disk or tape, a rnagneto-opisca! or optical medium such as a disk, or a solid state medium such as a memory card or other package that houses one or more read-only ⁇ non-volafiiei memories, random access msmones, or other re-wntabie (volatiie) memories.
  • a magneuc medium such as a disk or tape
  • a rnagneto-opisca! or optical medium such as a disk
  • solid state medium such as a memory card or other package that houses one or more read-only ⁇ non-volafiiei memories, random access msmones, or other re-wntabie (volatiie) memories.
  • a digital file attachment to email or other self-contained information archive or se* of archives is considered a distribution medium equivalent to a tangible storage medium
  • the invenlion is considered lo include a tangible storage medium or distribution medium, es Hsted herein and including anvrecognfeed equivalents and successor me-dsa.
  • m which the software implementations herein me stored ICIDS4J Wbikj the invention has been descnbed in terms of exemplary embodiments, ⁇ hose &Hs ⁇ ed :n me art ⁇ .vsH reeo ⁇ ni ⁇ e t ⁇ at the invention can be praettoed with rnod ⁇ ficatsons in the s-psm and scope of the appended claims.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

A system and method for streaming media data in a Web Service environment between two or more units are disclosed. The first unit processes the media data for transfer, using a media streaming application. A network implemented with Web Service transfers the processed media data using a real-time media streaming protocol. The second unit renders the processed media data for playback, using the media streaming application.

Description

!NTERNET PROTOCOL BASED MEDIA STREAMING SOLUTION
BACKGROUND OF THE INVENTION
1. Field of me Invention
[OCIOI] The? invention ss directed io media data streaming, and more particularly to media data streaming ;n a Web Service environment and/or automation environment
2 Related Art
|0<K12] Household, acadenise facility and/or business spaces now more commonly have more than one audio or video device such as CO/DVD player ponabie lv1P3 pisyec tune?, preanφ. power amp, speakers. VCR. DVR, computers rynnsng medsa players or connected to soma other source of audio sr video (e g,. internet radio. satellite radio and the ^e), etc. Typically, a CD/DVD player from one company comes With its own remote control and an amplifier by an entirely different company comes with sis own remote control The same space may have a PC w;m its keyboard and mouse, and yet another company"e portable y P3 player wHh its own control switches. While each audso device is dosng precisely v^hat It was designed to do. each operates completely independent from ^s? etners with the possible exception of she portable MP3 player that may he connected *o a PC for synobroniϊetloπ. As a result, a user enάs up going from one keypad to another o^ juggling a senes of remote controls in order to control the devices. |0DCJ31 S>nce these aυdio/yidec and similar devices are not desigr;eo; to communicate with ^ac^ other or tneir communication, ss very limited, access to these auolo/video dev-ces is limited by tbesr physical locations For example, ϋ Ie difficult fc play an MRS file saved in a PC bard disk drive in one room or area (& child's bedroom) on speakers located sn another rcom or area (an entertainment room} Thus. Ir* order for a user to enjoy music of his or her choice whenever and wherever he or she wants, each room needs io h<s equipped With all the necessary audio/video equipment and digital audio/video content
|0004| Also, the audio/video devices are not designed to communicate With other home devices (© o.s TV, lighting, security system, etc }. Thus, it is difficult, if not impossible, to converge the devices for common control IOr certain occasions for example, in order to watch a movie, the user must turn on a TV a DVD player and an audio amplifier by usung thfee different remote controls. Then the user must set me IV to receive a video signal from the DVD player, set the sudio amplifier to receive an audio ssgrta! from the DVD player and use another conuoi unit to adjust the lighting of the room Even when a user indices a universal remote, as is known sn the art. the result is a plurality oi devices thai are separately operated and are operated separately from a smgle universal remote. These devices do no? converge as described above, yoteover, the devices lack any abi% to ss nd or receive medsa data from a source to a destination. fOCIClSJ Accordingly, there is a need for a solution for the aforementioned accessibility. conneαaPility and convergence issues to allow media data to be shared, transferred, or received in any desired device
SUtUtIvIARY OF THE INVENTION
|0lK)f$l The invention meets the foregoing need using iP based media streaming, which results ;n a significant snemase in accessibility and eserabiiity of media data and other advantages apparent from tne dsseussson herein.
|CMK)?| Accordingly m one aspect of the invention, a method of streaming roedsa data in a VVeP Service environment includes the steps of establishing s medsa streaming network betwee?! a first med;a davsce and a second media dsvsoe. the madia streaming network implemented with Web Servsce for Devices and a maM;me medsa stresi'ning protocol pmcsss-ng nsadia data for transfer using a media streaming application implemented in the hrsi media device, transferring the processed media data vsa the media streaming network, receiving the processed media data from the media streaming network, and fermenng the processed media cjara for playback usrng the medsa streaming application implemented in the second me<sia device.
[HHδltJ The rnedsa -streaming application may be a fsltef-based media streaming application The I'iifer-Pased media streaming application may include at least one of s filter to read th© med;a data from a file or input, a filter to decode the media data, a filter to transform the media data, and a filter to render the media data The method may farther include me s-teps of configuring at least one client and at least one device connected to a network, the at least one client and at least one device o-eiπa configured w?th wβp services for devices and father configured to transfer media data With the media streaming ec-piiootion wherein the at least one client comprises one of a IV, a personal computer, a persona: digital assistance a control panel, and a game controller and the at least one devsoe compnses an audio system, a video system, an intercom system a lighting system, a security system, and a HVAC system The real time medis streaming protocol may be an internet real-time transpod protocol (RTP) The rnedsa data may Pe audio data, video data or a combination of audio ar>d video data Accordingly, in another aspect of me invention, a system fo? streaming media data in a Wen Service environment, sncindes a medsa streaming network implemented with Web Service and configured to transfer media data ussng a re&Mmie rnedsa streaming protocol a firβt rnedss cievsee connected io the media streaming network and implemented with a media streaming application for processing media data for transfer, and a second media tlevsce connected to the media stteammg network and implemented with the rnedsa streaming application for rendering the processed rnedsa data from the first media device for playback. The media strearmno application may be a firter--pas€d media streaming application. The filter-based media streaming application may include at leas? one of a filter to read tne mβdsa data from a f-!e or snput, a I'iHe?' to decode the media data, a ή(fet to transform the media data, and a filter to render tne media data
[CK)OS] Accordingly, in another aspect of the invention, an automation system may delude the system for streaming media data noted above and further may include at least αnβ clrem and at least one devsce connected to a neiwork that are configured wsf h wen services for devices and further configured fo transfer media data with the media streaming application, wherein the at ^east one client comprises, one of s TV, a personal computer, a personal digital assistance, a control panel and a game controller and the at least one device comprises an audio system a video system, an intercom system, a iight;ng system, a security system, and a HVAC system
|0010] Tne naal-time media streaming protocol may be an internet reai-tsme transport protocol (RTF). Each of the first and second meύiB devices may include a network interface connected to the network, and a processor running an operating system (DS) Wen Service application and the real-time media streaming apphcaison ^'he medsa data may oe audio data, vsdee data or a combination of audio and vsdeo dsta [0011] An access point for streaming media data in a Web Service environment, includes a processor running an operating system (OS)1 a Wets Service applicators and a real time media streaming application, wherein me real time media stream application processes out-bound med.a data for transfer or renders §n-noιmd media data for playback, u mr-ds-s te-rrmnai configured κ> interface an externa* media device, vyhereln the med^a ^rmsnal receives me out- bound media data from the external media device or sends the in-bound media data rendered by the real time media stream application to the external media devsce, and a network interface connected to a media streaming network implemented wsth Web Service for Devices and a real-time media streaming protocol. wherein fne network interface sends the out- bound media data processed by the real time media stream application to the media streaming network or receive the in--oouod media date from the media streaming network
[ODt t! The medsa streaming application may oe a filter-based roedsa streaming application The fsiter-based media streaming application may include at least one ef a filter Io read the media data from a file or input, a filler to decode the meύi& data, a filter ID transform the media data, and a filter to render the medsa data. An automation system may include the access oosnt as noted above and further may include at least one clsent and at least one dsvsee connected to a network that am- configured with web services % devices and further configured to transfer media data with the media streaming application, wherein the at least one client comprises one of a TV, a personal computer, a personal digital assistance, a corns ol panel and a game comber and the at least one levice composes an aud>o system, a video system, an intercom system, a lighting system, a security system, and a HVAC system. The real -time media streaming protocol may be an internet real- time transport protocol (RTPi The >n-bound and out-bound medsa data may be audio da?a, vsdeo data or a combination of aud>o and video da^a. The mεd-a ;.emi;nal :s configured kor at least one of audio in, vsdeo in and TV signai in, The
Figure imgf000006_0001
ierminai may be configured for ai ieast one o? audso out or vsdeo out, |flϋ13| Λcccrctingiy, in another aspect of the snvention, an intercom unit for a Web Service environment may include s hetwork interface connected to a media streaming neivvork implemented wstn a real-time medsa streaming protocol, a processor configured to run an operating system (OS), a Web Service application and a media stream apphcatron, a microphone configured to collect a first voice ssgnai. a speaker that reproduces a second vosce Signal transferred from the network interface, and a sound card that converts the first vo-ce Signal to a digital data stream and converts the second vosoe Signal to ar> analog data stream, wherein the media stream application processes the first voice signal for transfer and renders the second vosce Signal (ot playback. [0014] The real-time media streaming protocoi may be an internet real-time rranspoh protocol 5 RTP). The media streaming application may fee a fϋte^based media streaming application The niter-based media streaming application may include at ieast one of a ϋlier k> reao1 the media data from a file or input decode Ire media data, transform the media data, and i~ender the media dels
[CIfJI S| Accordingly, sn another aspect o? the invention, a method of establishing a vosce communication sn a Web Service environment includes the steps of collecting a nrst vosce sagos! via a- microphone, converting the f-rst voice Signal into a digital data stream, processing the digital data stream for fransfer ussng a medsa streaming application, transferrin^ tne p?ooessed digital data stream vsa a media streaming network ussncf a rsah ϋmβ media streaming protocol, receiving the processed digital data stream πom the media streaming network, i'endenng the processed digital data streaming u§sng the medsa steaming application for playback, converting the rendered digital data stream to an analog audio signal, and playsng the analog audso signal via a speaker f§01$l The media streaming application may be a filter-based media streaming application Ire filter- based media streaming application may include at least one of a filter Io read the media data from a File or input, decode the meciia dsta. fransiOfm the media data, and render the media data. The reahtsme media streaming protocol may ee > an internet real-ύrne transport protocol (RTP).
|CK>1?J Accordingly, in another aspect Df the invention, a fnaeNne-feadabie medium Includes stored instructions, which, when executed by a processor cause the processor to stream medsa data in a Web Service environment, medium includes instructions for estahlishing a medra sl?eam?r?9 network between a firβt media device ano1 a second media
;o de^ce. the media streaming network implemented With Web Service and a real-time! media streaming protocol, instructions for processing medsa data for transfer using a media stream-ng application ϊπipiersierited in the first media device instructions for trsnsfernng the processed media data via the media streaming network, instructions *or receiving ιt?e processed media dala from the media streaming network, and instructions is for rendering the processed media data for playback using the media streaming application implemented $n me second media device
|0018] The media streaming appiscaϋon may be a fiifet-based media streaming application, The filter-based medϊa streaming application may snoiude at leasi one of a filter to read lhe media data from a fϋe or snout, decode the media data, transform the
?o media ύ≠a, mv4 render the media data The real time media streaming protocol may be an internet reai-ume transport protocol (RTP) Ths? media data may be audio data, video riata or a combination of audio a?id ^deo data. fOOt 9] Additional features of the invention may be set forth or apparent from consideration of the following detailed description, drawings, and clasms. Moreover it >s to
:y. be understood that both the foregoing summary of the invention and the following detailed oesonphon are exemplary and Intended to provide further explanation Without limiting the soooe of the .nventic-n as claimed.
BRIEF DESCRIPTION OF THE DRAWINGS
,w [0020] The accompanying drawings, which are inclutted to provide a fυrttier -.mo&rstarsdino of the invention, are incorporateα sn and constitute a part of this specification. sNuxtraie embodiments of the invention and together With the detailed description serve Io explain the principles Pf the invention No attempt ss mad& to show structural details of she invention m more detail than may be necessary for a fundafYsenia! s< understanding of the invention and ϊhe vaπous ways in which it may he practiced. In the drawings
S |0021J Bg 1 shoves an schematic overview of a convergence solution constructed according to the principles cf the invention;
|0022| Rg 2 schematically shows various media devices configured and connected to a network. ?or use sπ the convergence solution of Fsg 1. constructed according to pfiπcspies s of the invention.
|δO23] Fig. 3 schematically shows a structure of a digital audio/vsdeo access posnt oonsU uc*e-d according to the principles of the invention: fOO.14] F-g 4 schematically shows a structure of a media streaming system constructed according to the principles of the invention, κ> |0025j Fig 5 schematically shows a structure of an audio sireaming system constructed aeeosroϊriξϊ to the principles of the invention.
[0028J FiO β schematically shows a structure of an intercom system constructed aeeomiino; to the principles o-? the invention, and
[002?| Fig* ? schematically shows processing stages of a media streaming appiioaoon i'i constructed according to and used with the invention
OETAlIf=D DbSCRfPTiON OF THE INVENTION
|MI2S1 The embodiments of the invention and me various features and advantageous details mereof are explained more fuiiy With refe^oce to the non-iirriiting embodimems
;-o anrj examples that are described and/or illustrated in the accompanying drawings ano detailed sn the following description. It should be noted that the features Illustrated in the drawings are not necessarliy drawn to scale, and feature of one embodiment may be employed wrlh other embodiments as the skilled artisan would recognize, even if not exo!sc;% stated herein Descriptions of weif-known components and processing iδ leohniqiie^ may be omitted so as to not unnecessarily obscure the embodiments o? the invention The examples used herein ai"e intended merely to fao-iifste an Lihderstanding αf wavs U^ which the invention may oe pnaoticed and to further enable those of skiil ;n the art to practice the embodiments of the invention Accordingly, the examples and embodiments herein should not be construed as limiting the scope of the invention, which
:0 is defined solely by the appended claims and applicable law Moreover it ss noted that i;k«? reference numerals represent sϊrnϋar parts throughout the several views of the d?avϊinc|s,
P02t] Fig 1 schematically shows an overview of a convergence solution according to an embodiment of the invention. The convergence solution may be a combination of
^s hardware and software. The hardware may include a server 10 connected to a network
Figure imgf000008_0001
network such as an Ethernet network) and may po&ssbiy be connected Io the internet 14, devices 102 (e g audio 20, video 22. intercom 24 ; lighting 25, secunh/ system 28, HVAC 38, and the iike) and clients 104 (e.g TV 30, personal computer (PC) 32, personal dsgrtai assistance (PDA) 3< controller 36 such as a control parse!, game controller {i.e. X-Box^. not shown} s-nd the HKe). Moreover, the s cisems 104 may snciucse a remote control 39 or a remote control may be configured to be a ciseni 104 The server IO may be any type of computer such as a PC connected to the network 12. The cheats 104 such as clients 30, 32. 34, 36 provide a user wsih control over the devices 102 such as devices 20, 22 , 24, 26 28. 38 [<H)S0| The software <j e . application) enables the hardware such as tne server 10,
!-j devices 102 and clients 104 to communicate with each other despite thesr different proprietary languages and communication protocols, and may provide the user with coniro; ova- most or au the hardware from a ssngie c^ent The application may uifee ai leas! one portion of the hardware to send commands to the devices 102 and receive feedback from them The application may integrate centrales device control into a PC
;? based πi«§ environment <;e g., Microsoft Media Center^ environment) that may store organize and play digital media content The user may use the same remcne corsirol 39 to Is1Sf en to mus-io. watch and record £s!ev*s!on, enjoy farπuy phofcoraphs and home movies, as weii as adjust me isghiing, secure the home, adjust the temperature, distribute mussc throughout the house, chock surveillance cameras and the i&e
^o |iO31| The application may be implemented with Web Services. The Web Services use standard Internet protocol OP,; and are based on standard χyi..-reiated technolocjies such as SOAP (Simple Oo-ieet Access Pfotecoh for communications and WSDL (Web Services Device Language) to describe interfaces The devices implemented wsth Web Service for Device (WSD) become black boxes on the network providing services to any
^;> applicator* on any piatfon^ written in any language Moreover, the use of WSD aliows lor the capabilities of Universal Plug and Play (UPnPs that seamlessly connect and ssmolsfy smpiementatson,
[0032] Alternatively or additionally, if me server 1Q or the PC 32 is running a
Figure imgf000009_0001
^, the devsoes x- rnay be configured as a SideShowT!s5 device or 'gadget " A Side8howw device or gadget may communicate with any client or devsce implemented wdh WSD in the network via protocols according to S;deShowm XsVH. communication speo^soahons Moreover, the server 10 or the PC 32 using Microsoft Windows ViStss^ may be runπsng a SioeShow^ gaoget application running on me Microsoft Windows Vssta™ computer providing a user iv> sntenace rendeπng for the device that communicates wsth automation control devices vsa WSD technology [0033] Fig. 2 schematically shows various medsa devrces configured and connected to the network 12, for use m the convergence soiutson of Fig 1 constructed according Io pnnoipies of the invention in particuiar, Fsg. 2 shows media devices, such as the plural audso devices 20, video devils 22 and intercom system 24 of Fig. 1 thai may be configured sπci connected to the convergence system according to an embodiment of me invention These media devices may oe any type of devices oonfioureo to reoerve, slore, iransfer and piay media files or s.gnals for example, a timer card 40, storage 42, and sound card 44 are connected to the sever 10 or aiternatsveiy/additionally a PC 32 s. fϋ034] The tuner card 40 may be any type of weii-known card capable of receiving video Signals that may be connected to a TV signal source such as an antenna, cable bo;<, saleMe receiver, or the irke-. and may provide a TV signal to any of the devices 102 or clients connected to the network 12 The tasw card 40 may convert the Tv signal from an analog format to a dspjtai format The storage 42 may be a hard disk dnve, memory card/reader. CD/DVD BOfVi driver, rV1P3 player, or the like, and stores, at least for example, dsostal audio/video (media} content. The sound card 44 may he any type of weri- i^nown sound card capable of receiving audio signals and ma-y Pe connected to an audio
Figure imgf000010_0001
provide an audso signai iVom the audio signai source to any of the devices connected to the network 12. The sound card 44 may convert the audio signal from the analog format ϊo the digital format Although Fig 2 shows the tuner card 4O1 storage 42 and sound card 44 connected to the sever 10. mese devices may he connected ΪO the network 10 y;a deferent devices or connected άi?ectiy to the network, For example, a storage 46. such as a network storage, may be directly connected to the network 12
[0f)3$! deuces implemented with Web Sendees may be direc% connected to the network For eκan$ρie. a Web Services (WS) enabied ampler 46, WS enai3ied audso/videc (AA/) device SO, VVS enabied audso device 52 and WS enabled video device 54 may be directly connected Io the network 12. and a user may eontroi fhese devices 50, 62 54 ffom any of the cϋents "KM (shown in deta;i in Fi§ 1} For exampie, by υs?πg tbe TV 30 iocated so a siving room and its remote eontroi 39, the user rτ?ay select an MP3 tiie stored in the s^eraoe 42 or 46 in a chiid s room and ciay ihe file through the W3 audio device 52 ;n a dsnsng roon> o? the WS ampNf'ser 4B in the isvsncj room. Λ-so. by ussng the controller 39. the user may select tne TV Signal received by the tyner card 40 located ;n a basement and play the TV signal through the WS AA/ device 50, suoh as a TV, located m a bed room. Thus, acoordsng to the invention, the user may access any type of media fϋes or sKinais whenever and wherever he or she wants f€KKIβJ For those med^a devices that are not implemented with Web Se^sces, access points may be used to connect those devices to the network 12, For example, if a TV ssgnel source and the tuner card 40 are located tn separata rooms, on A/V access posns 60 implemented with Web Services may be used to connect the TV Signal source ΪO the s network. The A/V access point 60 may be equipped with a tuner card and connected to tn& network 12 wirelessly, fCRXiTJ Similarly. &n audro source and video source may be connected to the network 12 vsa. en audio access point 62 and video access point 54, respectively While the access oosms 80 62, 04 may be used to interface between the media sources Ce g TV, audio and if vsdeo Signal sources and the like), the same access points may he used as media playback devices (e g. TV, stereo system, video monitor and the IiKs). for example an A/V access point 66 implemented With Web Services may provide a TV with s- TV Signal received l>c?m the tuner card 40 or the TV signal received from me A/V access point 60 An audio access point 68 may provide an auΦo playback device with an MP3 file stored ;n ι% the sto?ae?e 48 A video access, pemf TO may provide a monitor with the video signal received i'rom the video access posnt 84. By usrng the same operational principles of the audio access, oomt 62 and 68, an intercom system may he imptemented. Such access pcsms may utibxe the technology disciosed sn Applicarsf s. eopendsnQ patent applicaϋoπ U.S. Patent Appiscaiion No (to he assigned), entitled NETWORK BASED DIGITAL
^ ACCESS POiNT DEVICE, fifed Uarφ 14, 200/, to Seaie Poorer, et al incorporated herein by reference in its enurety pi)3E| Fig 3 schematicaϋy shows a struciure of a digital audio/video access posni constructed according to the principles of the invention. In particular, Rg 3 shows exemplary structure o? an access point Tl , such as the access points 60. &2, 84, 66, 88
?s TO shown sn Fig 2. accenting to an embodiment of the invention The access point ?1 may be equippeo with a oetworH interface 72 that aiiows me access point ? 1 to communicate with the server 10. the clients 104 the oevices 102 (such as 40. 42 44. 46. 48 50. 62. 54. 56, 58 and other access points SO. 62. 64, 66. 68, 70 of Fig 3 via me IP network 12 The network interface 72 may Pe a wired or wireless interface. The network
^ interface 80 may connect using Ws-Fi (Wireless Fidelity iEEE 802,1 Ix) biuetooth'^. rire Wireτλ- (IEEE 1394), power line. wi?ed Bthsrrse?, ar?d the like and any future protocols |t>CV38! The access point 71 may include a processor 74 that may run an operating system (OS? and appϋcatlon* to implement Web Services in the access point 71. Thus, upon hesng connected to the network 12, the access point 71 may he qujckry recognized
35 as a device in the network 12 ano' controϋed by the sever IQ and the clients 104, |0f!40| Ths processor 74 may also run a media streaming application 80. such DirectShow'^ (available from yierosoft !V Redmond, WA), to provide a common Interface lor me media fstes, DifectShow™ divides β media processing task (e g. video or audio playback tast<} snfo a set of steps known as filters DireotBhovy^ filler graphs may be- «5 used ;n video playback in which the filters provide steps such as file parsing, video/audκ> de- multiplexing, decompressing, rencfeπng and the IiKe, Of course the invention contemplates- am/ simϋa? or future application of DirectShow^. filter-graph application,
|0041] More specifically as shown in Fig. 7, a media streaming application such as a
>δ filter oased media streaming application thai may be for example DirectShow'^ may be used. Such en application may be a multimedia framework aoei API 700 to perform operates with media files and the IiKe it may be an extensile, filler-based framework that can render or record media tiles on demand Bach filter (?02< ?D4. 70β, /08) repneserns a stage in the process sno; of the media data, e g, reeding media data from a file
ΪS Of input 702, decoding media data 704, transforming media data ?06 or rendering media daia 70S It *>houi<$ Pe noted that only an exemplary numoer of filters are shown Other tirtess may be integrated at any stage of processing as needed
|0042] The filter
Figure imgf000012_0001
include a numPer of pins 710 mat represent connection points on the filter ma? may be connected to other filters. Rns 710 rney be esther output or snput rδ posols:. Depending oo the fslter. data is either requested from en output pin or sent to an snoot psn sn order to transfer data between filters The friers may tee busii using a set of C -^ classes provided in the DiteotShow SDK, caPed the DiredShow(tm) Base Classes, These handle much of the creators, registration and connection looic for trse filter. For the fiker graph to use filters automatically, mey need to be registered in a separate
^? Drreet&how registry entry as well as bei^g registe?-ed wrtb COiV? This registration can be managed by the DisectSho Base Classes. However, sf the application adds the filters msruiaϋy, lhey do not need to be registered at all
|O043] 'The access posm 71 may further include an analog to digital tNϋ) converter 82, a TV tuner 84 a dsgstal to analog (D/Aj converter 80, video in terminal SS. audio m
3Λ terminal 90, TV sigoal sn terminal 92, video out terows! 94 and aυctso out terminal 96 Thus, the access point 71 may oe capable of handling various media streams te g . TV ei$nal. video signal and audio signal) While these components allow the access point 71 to interface with vanous types of devices, the access point 71 may Pe equipped With fewer components than what are shown in Fig 3 For example, -f tne video and audio signals
Figure imgf000012_0002
in and sudso m tarmloals 88 and δu are exclusively digital, the A/0 converter may not be neeessanly be needed P>CI44| Also, sf the access point ?1 ss only used to interface a TV signal source, oilier components, such as the A/D converter 82, D/A converter 86, video in temisnal 88, audio ir: tsrnima! 90. video out terminal 04, and audio out terminal 96, may not be requ;md Thus, the access point 71 may include ooiy necessary components for a specific purpose. s [§04$] in operation, the video in terminal 88 may receive a video dai^ stream from a video source, such as a camcorder, security camera, camera phone, VCR. OVD player, portable media player, DVR, game controller, or the like Any ksnd of video in is contemplated by the invention including eomposns. s-video. component, HOM! (High Delation Multimedia Interface), OVl ^Digital Video interface) including DVhA, OVi-D and m DVi T IEEE 13S4 (FireWim;λS}. RG8HV. RGBS and me like and any future protocols thereof H the video streaming daia is in an analog formal the video stream data ;s convened to 3 digital data stream Oy the A/D converter 82. Tne digital v;deo stream data from the A/D convener 82 or th@ video m terminal 08 are processed by the π^ecsia sireamsno application 80 The processed video data stream is ther? transfened to the
? net ork 12 vsa the rietwcrk interface 72 using a standard internet protocol such as internet foaMirne transport protocol (RTP). The data part of RTP ss a thsn protocol prov-dinq Support for aopiicatioos w§fh real-time properties such as continuous media. Including timing, reconstruction, loss detection, security and content identification, Thus. RTP provides support for real-time conferencing of a group of any size within the internet.
^ This, support includes source identification and support for gateways iskβ audio ano video ondges. as weii as a mur|scast4o-unioa.si translator RTP further offers q«aiity-of -service feedoaok from receivers to the multicast group as weϋ as support for fhs syπthrαr?^.airøn of different medsa streams fdCMSJ SiiTϋiar to die vsdeo oata stream, the audio In terπnnal 90 may receive an audio data stream from an audio source such as a rnrcrc-phone, radio, C0/0V0 player, portable
Figure imgf000013_0001
Any type of audio in terminal is coniempiated tey the invention inciuolng RCA, SPDlP, AES. EBU. ΪOSUNK, XLR interfaces and the like and aov future p. otocols if necessary, the audio dala stream m the anaiog format may oe convened to a o'gitai aud^o data stream by the A/D converter 82. "The digital audio date stream from the
X5 A/D converter 82 or the audio in terminal 90 may Pe processed by ihe processor 74 using the media streaming application 80 such as DsreciShow'f>>"', and transferred to the network via network interface ?2 us:no, the internet standard protocol such as RTP, Similarly, the TV signal In terrnsna! 92 may receive a TV Signal fmm the W signal source such as an antenna. caPie outlet, sei-top box VCR. DVD, OVR, game conUoϋe? or the like The TV
>; ssgnai may then be converted to a digital media steam by the tuoer 84. The digital TV Signal stream ss processed using the media streaming application 80. such as 0;rectShov^ for maHsme multicast or umcast via the network 12 using tne internet standard protocol such as RTF. The tuner 84 niav communicate with the Web Service Application 78 such that a user can control the tuner 84 via the chents 104 |3M?| in addition to imerfaαno, the media sources as mentioned above, the access
6 point Ti may mtedace media playback devsces. such as an A/V device, video device or audio device, m ofde-r to play back the media stream data transferred from the network 12. For exampie, an audio data st/esm, which has been previously processed by a different devsce of access point using the media streaming application s$ transferred to the network mtertaee 72 via the network 12 using the internet standard protocol. The audio data
K- stream >s then rendered by processor 7*1 using the media streaming application for olayoaek, The rendered audso cats stream may be converted to the analog format by the D/A converter 86 ^ necessary The audio data stream rendered by the media stream application 80 may then he transfensd to the audio device via the audio out terminal SS Similarly to the audro m terminal any type of aodso is contemplated by the snventron
*s -ncivd.ng RCA. SPDiF. AES1 EBU, TOSUMK1 KlR, interfaces and the like and any future protocols
[004S] The video data stream from th^ network 12 ss processed in a similar manner with me audio data stream, Since the access point ?1 is configured to intenace both the media sources and media playback devices, a real-tsme encMo-end medsa streaming may
^c be established' by ussng two or more access posnts 71.
[CIII4S| F;g. 4 shows a structure of a media streaming system according to sn embodiment o?" the invention, The media streaming system includes two or more- media st/eaming units such as the first and second med-a streaming unsis 402 and -404 The server 10. the ciients 104 and the fsmt and second media streaming units 402, 404 are all
?< cormee^ed to me network 12 and implemented With WSD. Th us, me first media streaming unit 402 and ihe second
Figure imgf000014_0001
streaming ynst 404 may be controlled by the server 10 ar>d/or the cl-erits 104 in ihss srnbodin'sent. me first media streaming unit 402 is cor ifs<|ured to interface the meclsa sources, and the second media stream unit 404 msy ^e conlipureci to ihierface the media payback deuces However, both media streaming units
;o 402, 404 may be configured to lntedace esther one of the media soorce and media playback device of both, as described m Fig 3 above The first media stream unrt 402 may Include a netv^os'k inten'ace ?2A. a processor ?4A and a tuner 84Λ The tuner 84A m5j receive a TV signal from an external TV signal source The TV signal may r>e processed by the processor 74A using the media streaming application 8OA. Nc-mϊV
3§ Signals, such as dsgicai fnαving picture data may be aiso processed using the media so-earnsno application 8OA as noted by the input arrow 406. The processed media stream may tneπ be transferred to the second medss streaming unrt 404 via the network interface ?2A and the network 12 usrng the internet standard protocol The second media stream umt 404 may include a network interface ?2S. a processor 74 B. and a D/A converter SS. The media stmam receded by the network interface ?2B may be rendered for playback by 5 a media streaming application 808. The rendered media stream may be smsarπed io an AA/ device directly (si the devsoθ accepts digital s>g?iais) or via the D/A converter 86B if analog signals are needed fCIOSδJ f s^ S shows a structure of an audio streaming system according to an embodiment of the invention The audio streaming system may include two or more so media steaming units such as the first and second audio streaming units 604 and b'υδ. Hie server H), the clients 104 and the first and second audio stream-no, unsts 504, 506 may all he connected to me network 12 and implemented with WSD. Thus, the first sueho streaming unύ 504 and the second audio streaming unit 50§ may be controlled by the server 10 and the clients 104 in thss embodiment the first audso stresrning un>| &0^ may
^ be configured to interface the audio sources, and the second audio stream unit 506 may he configured to interface the audio {playback) devices However, both of the audio streaming unsts 5Od. 506 may he configured to interface wth either one of the audio source device and audio (playback) device or both, as described in Fig 3 above. The first auoKj streaming unit 604 may include a network interface 72C, processor 74C. and a xo sound card 84C The sound card B4C may receive an audio slgnai from an externa! audio signal source. The audio signal may be processed by th« processor ?4C using the audio sueamsno application 8OC A digital audio data stream may bypass the sound card 84C when it is from a dsgitai "media file source." The processed audio stream may then Pe transferred to the second audio stmamsng unit 506 vsa the network interface 72C and ihs*
K. network 12 using the internet standard protocol. The second sudio stream unst 506 may snciude a network interface ?2D. a processor '?4D, and a sound card 840 The audro sUeam receded by the network interface ?2D may Pe rendered for playback by a media streaming application 8OD, The rendered media stream may be steamed out to an audio playback device directly (digitally) or via the sound card 84D to o^erate an analog signal
>r. [00S1] fig 6 snows a structure of an intercom system according to an embodiment of me invention. The intercom system may Include two or more intercom units such as the firs! and second intercom units βO8 and §10 The server 10, the cJienis 104 arsd the first a^d second ^tercom unsts 608, 610 may all be connected to tne network I^ and Implemented with Web Service. The first intercom unit 608 may include a network
?% interface ??E, proce&sor ?4£ and sound card 84E, amplifier 112E. microphone 1 :4£. speaker 1 t6E and user interface 118E The microphone 1 14E captures a voice for othe?
■■m audio? from the First user, and the sound card 84E converts the voice signal Io a clsoslal data stream The data stream is then processed by ih% data streaming application 8OE. as described above, and transferred to the second intercom unii 610 via the network interface ?2E and th& network 12, AHo, the data stream transferred from the second intercom unit OIO vsa the network 12 and the network interface ?2E may tee rende?eci for playback by tne processor TδE using the data streaming application 8OE The rendered data stream may be converted to an analog audio Signal by %h& sound card 84E1 ampiifsed by the ampliiss 112E, and transferred to the speaker 1 16E. which recreates the voice from the second intercom unsi 610. The user interface 118B provides the user with various control options such that the user may seiect an intercom in a differem location for communication, start intercom processing, stop intercom processing, and the ϋke. The second sniercom unit QtO Includes a network interface ?2F, a processor ?4F, a sound card S4E an amplifier i 12F. a microphone 114F, a speaKer 116F and a user an interface 'S *8F, The second intercom unit 610 operates <n substantially the same manner as the first intercom unit 008. More intercom units may bθ added sf necessary or desired and the data streaming application soon as DirectShowriv:. enaotes both multicast and unicast of any data stream over the multiple intercom units
P0S2J in accordance with various embodiments of the invention, the methods described herein are intended for operation with dedicated hardware implementations ifidudsng, but no? limited to, semiconductors application specie integrated orcuits, proo/ammable logic arrays, and other hardware devices constructed to implement the methods and modules described herein Moreover, vaooos embodiments of the invention descnbed herein are intended tor operation wsth as software programs runnsfig on ø computer- processor Furthermore, aitemstive software implementations including, but not limited to, distributed processing or component/ohjsct distributed processing, ρa?al!e! processing, virtual machine- processing, any future enhancements, or any future protocol can also bo used to implement the metnods described herein
[CN)SSJ tt should also be noted that the software implementations of the invention as described herein are optionally stored on a tangible storage medium, s^ch as. a magneuc medium such as a disk or tape, a rnagneto-opisca! or optical medium such as a disk, or a solid state medium such as a memory card or other package that houses one or more read-only {non-volafiiei memories, random access msmones, or other re-wntabie (volatiie) memories. A digital file attachment to email or other self-contained information archive or se* of archives is considered a distribution medium equivalent to a tangible storage medium Accordingly, the invenlion is considered lo include a tangible storage medium or distribution medium, es Hsted herein and including anvrecognfeed equivalents and successor me-dsa. m which the software implementations herein me stored ICIDS4J Wbikj the invention has been descnbed in terms of exemplary embodiments, ^hose &Hsϋed :n me art \.vsH reeoøni^e t^at the invention can be praettoed with rnodϊficatsons in the s-psm and scope of the appended claims. These examples given above are merely illustrative and are not meant te be an exhaustive lsst of S\ possible designs : embodiments, applications or modifications of the invention.

Claims

WHAT IS CLAIMED IS"
1 A method o?' streaming media data in a Web Service environment comprising the steps of1 ss establishing a media streaming network between a f^st media device and a second medsa device the media streaming network implemented with Web Servsoe for Devices and a real-time media streaming protocol processing med;a data for transfer usmg a media streaming application implemented in the first medsa device" K' transferring the processed media data v*a the media streaming network; receiving the processed media data from the media streaming network, and rendering the processed media data for playback ussng me media streaming application implemented in the second media device
v4,
2, TPe method of claim l, wherein the media streaming application is 3 filter- eased media streaming application
3 TPs method of claim 2, wherein the fster-pased media streaming application eompn-se^ at lea&t one of a filter to read the media data from a file or input, a
>c
Figure imgf000018_0001
f^ter to render me media ciata
4 The method according to claim 2 further comprising- oonfigunng at least, one cϋent and at least ons device connected to a network, the ?;, at feast one client and at lea-st one device besng configured with web services for devices and further configured to transfer media data With the media streaming application, vvhei~ei-n the a* feast one cf&ent comprises one of a TV. a personal computer, a p-eθsθ?>s! digstaϊ assistance, a comroi panel and a game controller and the at ieast one device compneee an audio system, a video system, an Intercom system, a lighting "j Q system, a security system, and a HVAC system
5. The method of claim 1 , wheresn me real time media streaming protocol Is an internet real-time transport pm>tocoi (RTP)
?v 6 Tne method of ciaim t . wherein the media data ss audio c*ata, video data or a combination oϊ audso and video data ? A system for sUeamsno media data in a Web Service environment, eompnsino/ a media streaming network implemented with Web Service and conjured to 5 transfer medsa data using a real-time media streaming protocol
§ nrst media device connected to the medsa streaming network and implemented with a medsa streaming application for processing media data for transfer, ano: a second media device connected to the media streaming network and implemented wHh the me-diss streaming apphcstion for reπdermg tne processed media data H^ from the ύf«i medsa devsce for o^aybacH
8 The system of ciaim 7. where>n ϊde mecha streaming application is a fiiter- baaed media s-treaming application.
9. The svstem of ciasm ? wherein the Mat-based madia streaming apspiioatson comprises at ieast or>e of a fiiter to read tne medsa data from a fife or input, a fitter to decoda the media data, a fsiter to ^ansforrn the media data, and a fi^te? to fender me media data
so 10 An sutematϊoπ system that comprises the system for streaming media according to claim 7 and further comprises" at ieasl one ciseni and at feast one device connected to a network that are conito^red with web services for devices and iufther configured to transfer media data with the media streaming application, i-; wherein the at ieasi one cisant comprises one of a TV. a parsonai computer, a ρ&rs.onai oigstal assistance, a controi panei. snd a game controller and the at least om devβce compnses an audsc system, a video's system, an sntercc-m sysfem a i.cshbng system, a security system, and a HVAC system
1 1 The systβrr; of cia-m ?. wherein the ?esi~tirne media streaming protocol ss an snternet real-time transport protocoi (RTP),
12 The system of ciasm 7. wherein each of sasd first and second madia devices, comprises1 a network irue?fsc«t ceπsiected to ttie network- and a processor running an operating system (OS). Web Service application and the reahtirne media streaming application
13 The system of claim 7 wherein the media data is audio data, video data or !ϊ a combination of audio and video data
M An access point for streaming media data sn a Web Service environment, comprising* a processor running an operating system (OS), a Web Service application and a κ: -eai time media streaming application, wherein the real hrne medsa stream application processes, out-oounrj media data for transfer or renders in-bound media data for playback, a media temi-oai configured to interface an externa? media device, wherein the me<t*a terminal recedes the out- bound media data from the externa! media device or sends, me sn-oound media data rendered by the real time media stream application to the ;s external media device, and a network interface connected to a media streaming network implemented wrth Web Serv-ce for Devices and a reahtlme media streaming protocol wherein the network interface ^ends th« out-hound medsa data processed py the real time media stream application to the media streaming network or receive the In-bound media data from the ^CJ media streaming neiwork.
15 The access, point o? ciasm 14, wnerein the media streaming appircatson is a fiiter-based media streaming appϋcation.
?$ 16 The access posnt of claim 14. wherein the filter-based rnedsa streaming eppiication comprises at ieast one of a filter to read the media data from a fiie or input, a fii÷er io decode the media data, a fiiter to Iranstom^ the medsa data, and a filter to render the rmvcisa data
30 1 ?. An automation sy&tem that comprises the access posnt acoofdir?g to claim
14 and Further comphse-s1 at ieast one eϋenr and at least one device connected to a network that are continued with vveb services for devices and further configured to transfer media data
With the media streaming application. ;^ wherein the al ieast one cϋent composes one ot a TV, a personal computer, a perxonai digitai assistance a control panel, and δ game controϋer and the at least one device comprises a^ audio ayβiem. a video system, an intercom system, a lighting system, a secunty system, a^cl a HVAG system.
IB, The access point of claim 15, wherein the real-isme media streaming protocol ss an internet reaMϊme transport protocol (RTP).
IS, The access, point of eiasm IS, wherein the In-bound and out-bound medsa data is audso data, video data or a combination of audio and video
50 20 The access point of claim 15, wherein the media terminal is configured for ai least one of audio in. video in a^d TV signal in
2 I . The access point of ciaim 15, wherein the rrsediθ farrnsnal is configured for at least one of suchc out or video out
22 An intercom unit for a Web Service environment, comprising. a network interface connected to a media sireanisng network implemented with a real-ϋme media streaming protocol. a proce&eor configured to run sn operanng sy&tem (OS), a Web Service κ> application and a rπeα'ra stream appiicabon' a microphone confsgurβcl to cαiiect a first voice signal, a speaker that reproduces, a second voice ssgnai transferred fmm the network interface; and a sound card that convents the first vosce signal to a digital data stream and ?& converts tHe second voice signal to an analog data stream. therein the media stream spphcatson processes the first vo-ce signal % transfe? and renders the second vosce signal for payback.
23 The intercom unit of claim 22, wherβsn the reai-tsme media streaming .vo protocol Is an internet real-tsrne ύansport protocol (RTP)
24. The intercom unit of oiasm 22. wherein the media streaming application is a iϋier-Daseo media streaming appi-cstson 2S The intercom unit of claim 22. wherein the fPter-based media streaming application comprises at ieast one of a filter to read the media data from a file or input, decode the media data, transform the media data, and render the media data.
v 2S A method of establishing a voice communication in a Wete Service environment, comprising the steps of cofecisng a fsrst voice Signal via a microphone, converting the first vosee signai into a dsgstal data stream. processing the digital data stream for transfer ussng a media streaming application, ;<> tran&femog the processed ύ-ψw deta stream via 3 medsa streaming network y§?n§ a mai-tsme media streaming protocϋl
•receiving the processed digital data stream from the medsa streaming network, rendering tπa processed digstal data streaiYimg using the media streaming application fα? piaypeck:
■ s converting the rendered dsgstai data stream to an analog audio signal Br-.ύ piaying the anabø audio ssgnai via a speaker
2? The method of oiairti 26. whθ?"θiπ the media ^trean^ng spphcatsen ss a t-ιter- based media streaming application.
2v The method of oiaim 2β, where-n me fitter- ba&βd media streaming application comprises at ieast one of a fsiter to read the media data from a fiie or input, decode the medsa data, transform the media data, and render [he medsa data.
^? 29 The method αf claim 2β, whβresn the real -time media learning protocoi is
^ irsiernet reai-tsme transport protocoi (RTPj
30, A machine-readable medium comprising stored instructions, whscn, when e<ee;.^ed by a processor cause the processor to stream media data in a Weh Service 30 environment medium comprising' instructions for estabirsrsinø a media streaming nerwork between a first media device and a second media devsce, the media streaming network impiememed with vVeis Service and a ?eai-bme medse streaming prcΦoooi; instructions for processing media data for transfer using a med-a streaming 3% application impiementori in tne first media devsee' instructions fer transferring me processed media data via the ftiedsa streaming cet^ork: instructions for receiving ^ne processed' media d&la from the media streaming network, and s instructions for rendenng the processed media data for playback ussng the medsa st^eammα appHcation smρten'?ented in the second media devsce.
31 The medium of
Figure imgf000023_0001
the media streaming appiscation ss a I'iiter-haa.ed media siream^g applscation
32 The medium of αa.;m 31. wherssn the fϋter-baβed media βtreamtrjg a^phcabo^ cofϊφfsses at fea&t one of a filter to read the media dsta from a fϋe or input, decide the media date. tf§r*$føfm me merjsa data, arsd render the ry^edsa data
■ ^ 33 The medium of claim 30, wheresn the re^i hms rrjedsa streaming protocol Is an intern^ mai-time transport protocol (RTp)
3^. The medium of cia^m 30, ^heresn the media data is audio data, video data or a combination of audio and video data
PCT/US2007/064191 2006-03-16 2007-03-16 Internet protocol based media streaming solution WO2007109553A2 (en)

Applications Claiming Priority (18)

Application Number Priority Date Filing Date Title
US78260006P 2006-03-16 2006-03-16
US78259506P 2006-03-16 2006-03-16
US78259906P 2006-03-16 2006-03-16
US78263506P 2006-03-16 2006-03-16
US78273406P 2006-03-16 2006-03-16
US78259606P 2006-03-16 2006-03-16
US78259806P 2006-03-16 2006-03-16
US78263406P 2006-03-16 2006-03-16
US60/782,595 2006-03-16
US60/782,599 2006-03-16
US60/782,598 2006-03-16
US60/782,635 2006-03-16
US60/782,734 2006-03-16
US60/782,600 2006-03-16
US60/782,634 2006-03-16
US60/782,596 2006-03-16
US11/686,836 2007-03-15
US11/686,836 US8209398B2 (en) 2006-03-16 2007-03-15 Internet protocol based media streaming solution

Publications (2)

Publication Number Publication Date
WO2007109553A2 true WO2007109553A2 (en) 2007-09-27
WO2007109553A3 WO2007109553A3 (en) 2008-07-31

Family

ID=38523193

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2007/064191 WO2007109553A2 (en) 2006-03-16 2007-03-16 Internet protocol based media streaming solution

Country Status (1)

Country Link
WO (1) WO2007109553A2 (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6175872B1 (en) * 1997-12-12 2001-01-16 Gte Internetworking Incorporated Collaborative environment for syncronizing audio from remote devices
US20050021805A1 (en) * 2001-10-01 2005-01-27 Gianluca De Petris System and method for transmitting multimedia information streams, for instance for remote teaching

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6175872B1 (en) * 1997-12-12 2001-01-16 Gte Internetworking Incorporated Collaborative environment for syncronizing audio from remote devices
US20050021805A1 (en) * 2001-10-01 2005-01-27 Gianluca De Petris System and method for transmitting multimedia information streams, for instance for remote teaching

Also Published As

Publication number Publication date
WO2007109553A3 (en) 2008-07-31

Similar Documents

Publication Publication Date Title
US8209398B2 (en) Internet protocol based media streaming solution
US8582565B1 (en) System for streaming audio to a mobile device using voice over internet protocol
US8402498B2 (en) Method and apparatus for controlling a set-top box based on device events
AU2016202175B2 (en) Systems and methods for networked music playback
US7577110B2 (en) Audio chat system based on peer-to-peer architecture
US20080259818A1 (en) Home-to-home delivery of media content via cable
CN113168850B (en) Distributed synchronous playback apparatus and method therefor
US20020124097A1 (en) Methods, systems and computer program products for zone based distribution of audio signals
US10032475B2 (en) Enhancing an audio recording
US20080155062A1 (en) System for providing media data
US20130194431A1 (en) Automated broadcast systems and methods
CN101355470A (en) System, method and apparatus for implementing business continuity in household network circumstance
KR20070005495A (en) Content integration platform with format and protocol conversion
US20070217446A1 (en) Network based digital access point device
US20100161801A1 (en) Multimedia processing resource with distributed settings
KR100393417B1 (en) Method for internet web broadcasting performance in local performing place and apparatus therefor
US20200195883A1 (en) Cable television entry adapter
KR101727310B1 (en) Cross-Directional Casting Method
CN110149305B (en) Video network-based multi-party audio and video playing method and transfer server
US9854276B2 (en) Information processing device, information processing method, and program
WO2003058965A1 (en) Conferencing with synchronous presention of media programs
US8284713B2 (en) Wireless audio systems and related methods
CN109714316B (en) Audio mixing processing method of video network and video network system
WO2007109553A2 (en) Internet protocol based media streaming solution
De et al. WiVision: a wireless video system for real-time distribution and on-demand playback

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 07758712

Country of ref document: EP

Kind code of ref document: A2

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 07758712

Country of ref document: EP

Kind code of ref document: A2