CN105981373A - Inverse telecine filter - Google Patents
Inverse telecine filter Download PDFInfo
- Publication number
- CN105981373A CN105981373A CN201580007983.4A CN201580007983A CN105981373A CN 105981373 A CN105981373 A CN 105981373A CN 201580007983 A CN201580007983 A CN 201580007983A CN 105981373 A CN105981373 A CN 105981373A
- Authority
- CN
- China
- Prior art keywords
- field
- unnecessary
- adjacent
- video sequence
- respective time
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 claims abstract description 46
- 238000001914 filtration Methods 0.000 claims abstract description 9
- 238000013139 quantization Methods 0.000 claims description 11
- 230000033001 locomotion Effects 0.000 claims description 7
- 230000000750 progressive effect Effects 0.000 abstract description 14
- 230000009466 transformation Effects 0.000 abstract 1
- 238000004891 communication Methods 0.000 description 32
- 238000005516 engineering process Methods 0.000 description 21
- 238000010586 diagram Methods 0.000 description 10
- 230000006870 function Effects 0.000 description 9
- 230000005540 biological transmission Effects 0.000 description 6
- 238000003860 storage Methods 0.000 description 4
- 230000000007 visual effect Effects 0.000 description 4
- 238000006243 chemical reaction Methods 0.000 description 3
- 230000006835 compression Effects 0.000 description 3
- 238000007906 compression Methods 0.000 description 3
- 241000760358 Enodes Species 0.000 description 2
- 239000000654 additive Substances 0.000 description 2
- 230000000996 additive effect Effects 0.000 description 2
- 239000003795 chemical substances by application Substances 0.000 description 2
- 238000004590 computer program Methods 0.000 description 2
- 229910001416 lithium ion Inorganic materials 0.000 description 2
- QELJHCBNGDEXLD-UHFFFAOYSA-N nickel zinc Chemical compound [Ni].[Zn] QELJHCBNGDEXLD-UHFFFAOYSA-N 0.000 description 2
- 241000208340 Araliaceae Species 0.000 description 1
- HBBGRARXTFLTSG-UHFFFAOYSA-N Lithium ion Chemical compound [Li+] HBBGRARXTFLTSG-UHFFFAOYSA-N 0.000 description 1
- 229910003307 Ni-Cd Inorganic materials 0.000 description 1
- 235000005035 Panax pseudoginseng ssp. pseudoginseng Nutrition 0.000 description 1
- 235000003140 Panax quinquefolius Nutrition 0.000 description 1
- 238000009825 accumulation Methods 0.000 description 1
- 230000000712 assembly Effects 0.000 description 1
- 238000000429 assembly Methods 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 238000004100 electronic packaging Methods 0.000 description 1
- 239000000446 fuel Substances 0.000 description 1
- 235000008434 ginseng Nutrition 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000004807 localization Effects 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 230000014759 maintenance of location Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000008054 signal transmission Effects 0.000 description 1
- 230000011664 signaling Effects 0.000 description 1
- 238000007619 statistical method Methods 0.000 description 1
- 230000001502 supplementing effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/117—Filters, e.g. for pre-processing or post-processing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
- H04N7/0112—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level one of the standards corresponding to a cinematograph film standard
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/124—Quantisation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/172—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
- H04N19/43—Hardware specially adapted for motion estimation or compensation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/23418—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
- H04N7/0112—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level one of the standards corresponding to a cinematograph film standard
- H04N7/0115—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level one of the standards corresponding to a cinematograph film standard with details on the detection of a particular field or frame pattern in the incoming video signal, e.g. 3:2 pull-down pattern
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Mobile Radio Communication Systems (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
Systems, methods, and instrumentalities are disclosed to performing inverse telecine transformation of an encoded video sequence to produce an accurate reconstruction of the original progressive video. A method of video filtering may comprise receiving a plurality of frames comprising a series of fields, wherein at least one field of the series of fields is a superfluous field, comparing each field to at least one temporally adjacent field to determine a pair of fields which are most similar to each other, wherein the pair of fields comprise the superfluous field, determining which of the pair of fields is least similar to a respective temporally adjacent field that is not the other of the pair of fields and designating that field the superfluous field, and reconstructing the plurality of frames without the determined superfluous field.
Description
Cross-Reference to Related Applications
This application claims U.S. Provisional Patent Application No.61/938 submitted on February 10th, 2014, the rights and interests of 100, this faces
Time patent application content entirety by reference be hereby incorporated by.
Background technology
Radiomovies (telecine) can relate to for being the technology of video by movie conversion.Motion picture data can be by per second 24
The mode record of frame, and NTSC (NTSC) video can be by the vertical scanning frequency of 59.94Hz or per second
The mode of 59.94 records and can show according to the 29.97Hz frame rate of staggered (interlace) field.
Summary of the invention
This application discloses system, the method and apparatus that video is filtered.Multiple frames can be converted into multiple field.?
Can have even parity (even parity).Field can have strange parity (oddparity).Series of fields can include to
Few unnecessary (superfluous) field (such as, a series of even parity fields can include at least one unnecessary field, a series of very
Parity field can include at least one unnecessary field).Each field is neighbouring (temporally adjacent) with at least one time
Field (according to identical parity or according to contrary parity) compares and can determine that the most similar field is right.This
To including unnecessary field.This unnecessary field can be this field alignment with the respective time adjacent to field (is not other of field alignment
, and it can be that the time of same parity is adjacent to field) the most dissimilar field.This unnecessary field can be named as unnecessary field.
Multiple frames can be reconstructed (such as, according to the multiple fields not including fixed unnecessary field).
Can include receiving the video sequence including multiple including method, server, wave filter and the display of video filtering
This video sequence is also decoded by row (such as, being coded of video sequence).Field in multiple fields can be even parity field
With the one in strange parity field.Field in multiple fields can include unnecessary field (such as, radiomovies produce repetition or redundancy
).At least one time of each field with same parity is compared adjacent to field, it may be determined that the most similar field
Right.This is to including unnecessary field (such as, the one in the field of this centering is unnecessary field).Which of this field alignment can be determined by
Field and respective time are unnecessary adjacent to field (such as, having same parity) the most similar which field determining this field alignment
, this respective time is not other of this field alignment adjacent to field.Can be in the case of field unnecessary determined by not using
Reconstruct this video sequence.This video sequence can be re-coded in the case of field unnecessary determined by not using.
Accompanying drawing explanation
Figure 1A is the system diagram of the exemplary communication system that can implement disclosed one or more embodiments.
Figure 1B is the illustration wireless transmitter/receiver unit (WTRU) that can use inside the communication system shown in Figure 1A
System diagram.
Fig. 1 C is the illustration radio access network that can use inside the communication system shown in Figure 1A and illustrates core
The system diagram of heart network.
Fig. 1 D be can use inside the communication system shown in Figure 1A another illustrate radio access network and
Another illustrates the system diagram of core network.
Fig. 1 E be can use inside the communication system shown in Figure 1A another illustrate radio access network and
Another illustrates the system diagram of core network.
Fig. 2 is the figure of the example relationship between film (such as frame) and terleaved video (such as field).
Fig. 3 is the figure of the example of 2:3 drop-down (pulldown).
Fig. 4 is the figure of example drop-down for 2:3.
Fig. 5 is the figure of example drop-down for 2:3.
Fig. 6 is the figure of the example of the inverse radiomovies removed by field.
Fig. 7 is the figure of the example making the average inverse radiomovies of use.
Fig. 8 is example video coding and the figure of decoding process of the field that visual artefacts (artifacts) introduces reconstruct.
Fig. 9 is the figure of the example how identifying the drop-down pattern of 2:3.
Figure 10 is the figure how determining the example retaining which repeat fields.
Figure 11 is institute in inverse radiomovies of the prior art, inverse radiomovies described herein and the application
The figure of the example of the inverse radiomovies with postfilter (fc=0.5) described.
Figure 12 is institute in inverse radiomovies of the prior art, inverse radiomovies described herein and the application
The figure of the example of the inverse radiomovies with postfilter (fc=0.5) described.
Figure 13 is institute in inverse radiomovies of the prior art, inverse radiomovies described herein and the application
The figure of the example of the inverse radiomovies with postfilter (fc=0.5) described.
Detailed description of the invention
Detailed description referring now to different accompanying drawing illustrating property embodiments.May implement although this description provides
Detailed example, it is noted that the purpose of details be exemplary and never in any form limit the application
Scope.
Figure 1A is the diagram of the exemplary communication system 100 that can implement disclosed one or more embodiments.Communication
System 100 can be to provide the multiple access of the contents such as such as voice, data, video, message transmission, broadcast to connect for multiple wireless users
Enter system.This communication system 100 allows multiple radio subscriber to access by sharing the system resource including wireless bandwidth
This type of content, for example, communication system 100 can use one or more channel access methods, such as CDMA
(CDMA), time division multiple acess (TDMA), frequency division multiple access (FDMA), orthogonal FDMA (OFDMA), Single Carrier Frequency Division Multiple Access (SC-FDMA) etc..
As shown in Figure 1A, communication system 100 can include wireless transmitter/receiver unit (WTRU) 102a, 102b, 102c,
And/or 102d (generally or be referred to as WTRU 102), radio access network (RAN) 104, core network 106/107/109, public
With switched telephone network (PSTN) 108, the Internet 110 and other networks 112, it would be appreciated that disclosed embodiment party
Formula contemplates any number of WTRU, base station, network and/or network components.Each WTRU 102a, 102b, 102c, 102d
Any type of equipment working in wireless environments and/or communicating can be arranged to.Such as, WTRU 102a, 102b,
102c, 102d may be configured to launch and/or receive wireless signal, and can include subscriber equipment (UE), movement station, consolidate
Determine or mobile subscriber unit, pager, cell phone, personal digital assistant (PDA), smart phone, laptop computer, online
Basis, personal computer, wireless senser, electronic equipment for consumption etc..
Communication system 100 can also include base station 114a and base station 114b.114a, 114b can be joined in each base station
It is set to promote to access one or more leading to fetching by wireless with at least one in WTRU 102a, 102b, 102c, 102d
Any type of equipment of communication network, described network can be core network 106/107/109, the Internet 110 and/or network
112.As example, base station 114a, 114b can be base transceiver station (BTS), node B, e node B, home node-b, family
E node B, site controller, access point (AP), wireless router etc..Although each base station 114a, 114b are described as
It is single parts, it would be appreciated that base station 114a, 114b can include any number of interconnection base station and/or network components.
Base station 114a can be a part of RAN 103/104/105, described RAN can also include other base stations and/or
Network components (not shown), such as base station controller (BSC), radio network controller (RNC), via node etc..Base station
114a and/or base station 114b may be configured in the specific geographical area internal emission of entitled community (not shown) and/or connects
Receive wireless signal.Community can be further divided into cell sector.Such as, the community associated with base station 114a can be divided into three fans
District.Thus, in one embodiment, base station 114a can include three transceivers, say, that each transceiver
A sector corresponding to community.In another embodiment, base station 114a can use multiple-input and multiple-output (MIMO) skill
Art, thus can use multiple transceivers for each sector of community.
Base station 114a, 114b can via air interface 115/116/117 and one or more WTRU 102a, 102b,
102c, 102d communicate, and this air interface 115/116/117 can be the most suitable wireless communication link (such as radio frequency
(RF), microwave, infrared ray (IR), ultraviolet (UV), visible ray etc.).Described air interface 115/116/117 can be with arbitrarily
Suitable radio access technologies (RAT) is set up.
More specifically, as it has been described above, communication system 100 can be multiple access system, and can use one or
Multiple channel access scheme, such as CDMA, TDMA, FDMA, OFDMA, SC-FDMA etc..For example, RAN RAN 103/
Base station 114a in 104/105 and WTRU 102a, 102b, 102c can implement such as Universal Mobile Telecommunications System (UMTS) land
Ground radio accesses the radiotechnics of (UTRA) etc, and this technology can use wideband CDMA (WCDMA) to set up sky
Middle interface 115/116/117.The such as high-speed packet that can include WCDMA access (HSPA) and/or evolved HSPA (HSPA+) it
The communication protocol of class.The high-speed downlink packet that can include HSPA accesses (HSDPA) and/or High Speed Uplink Packet accesses
(HSUPA)。
In another embodiment, base station 114a and WTRU 102a, 102b, 102c can implement evolved UMTS land
Ground radio accesses the radiotechnics of (E-UTRA) etc, and this technology can use Long Term Evolution (LTE) and/or senior LTE
(LTE-A) air interface 115/116/117 is set up.
In other embodiments, base station 114a and WTRU 102a, 102b, 102c can implement such as IEEE 802.16
(World Interoperability for Microwave Access, WiMax (WiMAX)), CDMA2000, CDMA20001X, CDMA2000EV-DO, Interim Standard 2000
(IS-2000), Interim Standard 95 (IS-95), Interim Standard 856 (IS-856), global system for mobile communications (GSM), for GSM
Strengthen the radio access technologies such as data rate evolution (EDGE), GSM EDGE (GERAN).
As example, the base station 114b in Figure 1A can be wireless router, home node-b, family e node B or access
Point, and can use the most suitable RAT to facilitate the wireless connections in regional area, such as place of business, house, traffic
Instrument, campus etc..In one embodiment, base station 114b can be by implementing such as IEEE with WTRU 102c, 102d
The radiotechnics of 802.11 etc sets up WLAN (WLAN).In another embodiment, base station 114b with
WTRU 102c, 102d can set up Wireless Personal Network by the radiotechnics implementing such as IEEE 802.15 etc
(WPAN).In yet another embodiment, base station 114b and WTRU 102c, 102d can be by using RAT based on honeycomb
(such as WCDMA, CDMA2000, GSM, LTE, LTE-A etc.) sets up picocell or Femto cell.As shown in Figure 1A,
Base station 114b can be directly connected to the Internet 110.Thus, base station 114b is not necessarily required to via core network 106/107/109
Access the Internet 110.
RAN 103/104/105 can communicate with core network 106/107/109, described core network 106/107/109
Can be arranged to one or more WTRU 102a, 102b, 102c, 102d provide voice, data, application and/or by
Any type of network that the voice (VoIP) of Internet protocol services.Such as, core network 106/107/109 can provide calling
Control, billed services, service based on shift position, prepaid call, Internet connection, video distribution etc., and/or perform
The enhanced security feature of user authentication etc.Although the most not showing, it would be appreciated that RAN 103/104/105
And/or core network 106/107/109 can those use identical with RAN 103/104/105 with other directly or indirectly
The RAN of RAT or different RAT communicates.Such as, except being connected with the RAN103/104/105 using E-UTRA radiotechnics
Outside, core network 106/107/109 can also communicate with another RAN (not shown) of other use gsm radio technology.
Core network 106/107/109 can function as WTRU 102a, 102b, 102c, 102d access PSTN 108,
The Internet 110 and/or the gateway of other networks 112.PSTN 108 can include providing plain old telephone service (POTS)
Circuit exchanging telephone network.The Internet 110 can include using the global interconnected computer networks of common communication protocol and setting
Standby system, described agreement can be the TCP in transmission control protocol (TCP)/Internet protocol (IP) IP race, number of users
According to datagram protocol (UDP) and IP.It is wired or wireless logical that network 112 can include being had by other service suppliers and/or run
Communication network.Such as, network 112 can include another core network being connected with one or more RAN, the one or more
RAN can use identical RAT or different RAT from RAN 103/104/105.
In communication system 100, some or all of WTRU 102a, 102b, 102c, 102d can include multimode ability, change speech
It, WTRU 102a, 102b, 102c, 102d can be included on different radio link the multiple receipts communicated with different networks
Sender.Such as, the WTRU 102c shown in Figure 1A may be configured to and use the base station of radiotechnics based on honeycomb
114a communicates, and communicates with the base station 114b that can use IEEE 802 radiotechnics.
Figure 1B is the system diagram illustrating WTRU 102.As shown in Figure 1B, WTRU 102 can include processor 118, receive
Sender 120, transmitting/receiving means 122, speaker/microphone 124, keyboard 126, display/touch pad 128, non-removable
Memorizer 130, removable memorizer 132, power supply 134, global positioning system (GPS) chipset 136 and other ancillary equipment
138.Will be appreciated that WTRU 102 can also include the anyon of above-mentioned parts while keeping meeting embodiment
Combination.And, it is permissible that embodiment considers the node that base station 114a and 114b and/or base station 114a and 114b can represent
Including in Figure 1B describe and in this some described or all elements, wherein, among other, node such as, but not limited to
Transceiver station (BTS), node B, site controller, access point (AP), home node-b, evolved home node-b (e node B),
Family's enode b (HeNB), family's enode b gateway and agent node.
Processor 118 can be general processor, application specific processor, conventional processors, digital signal processor (DSP),
One or more microprocessors that multi-microprocessor associates with DSP core, controller, microcontroller, special IC
(ASIC), field programmable gate array (FPGA) circuit, other any type of integrated circuit (IC), state machines etc..Process
Device 118 can perform Signal coding, data process, power controls, input/output processes and/or other arbitrarily can make WTRU
102 functions worked in wireless environments.Processor 118 is coupled to transceiver 120, and transceiver 120 can couple
To transmitting/receiving means 122.Although processor 118 and transceiver 120 are depicted as stand-alone assembly by Figure 1B, but should
Understanding, processor 118 and transceiver 120 can be integrated in an Electronic Packaging or chip.
Transmitting/receiving means 122 may be configured to launch via air interface 115/116/117 or receive go to or
Signal from base station (such as base station 114a).Giving an example, in one embodiment, transmitting/receiving means 122 can be
It is configured to launch and/or receive the antenna of RF signal.In another embodiment, as example, transmitting/receiving means
122 can be arranged to launch and/or receive IR, UV or the transmitter/detector of visible light signal.Another embodiment party
In formula, transmitting/receiving means 122 may be configured to launch and receive RF and optical signal.Will be appreciated that transmitting/reception
Parts 122 may be configured to launch and/or receive the combination in any of wireless signal.
Although additionally, transmitting/receiving means 122 is depicted as single parts in fig. ib, but WTRU 102 is permissible
Including any number of transmitting/receiving means 122.More specifically, WTRU 102 can use MIMO technology.Therefore, one
In individual embodiment, WTRU 102 can include that two or more are launched via air interface 115/116/117 and receive
The transmitting/receiving means 122 (the most multiple antenna) of radio signal.
The signal that transceiver 120 may be configured to launch transmitting/receiving means 122 is modulated, and
The signal receiving transmitting/receiving means 122 is demodulated.As it has been described above, WTRU 102 can have multimode ability.Therefore,
Transceiver 120 can include allowing WTRU 102 to lead to by the multiple RAT of such as UTRA and IEEE 802.11 etc
Multiple transceivers of letter.
The processor 118 of WTRU 102 is coupled to speaker/microphone 124, keyboard 126 and/or display/touch
Plate 128 (such as liquid crystal display (LCD) display unit or Organic Light Emitting Diode (OLED) display unit), and can receive
User input data from these parts.Processor 118 can also be to speaker/microphone 124, keyboard 126 and/or display
Device/touch pad 128 exports user data.Additionally, processor 118 can from the most suitable memorizer, the most non-removable deposit
Access information in reservoir 130 and/or removable memorizer 132, and information is stored in these memorizeies.Described non-removable deposit
Reservoir 130 can include random access memory (RAM), read only memory (ROM), hard disk or other any type of storages
Device storage device.Removable memorizer 132 can include that subscriber identity module (SIM) card, memory stick, secure digital (SD) are remembered
Card etc..In other embodiments, processor 118 can not be physically located in the memory access WTRU 102 from those
Information, and data are stored in these memorizeies, the most for example, described memorizer may be located at server or family calculates
Machine (not shown).
Processor 118 can receive the electric power from power supply 134, and can be configured distribution and/or control for
The electric power of other assemblies in WTRU 102.Power supply 134 can be the most suitable equipment for WTRU 102 power supply.Citing comes
Saying, power supply 134 can include that one or more dry cell batteries is (such as NI-G (Ni-Cd), nickel zinc (Ni-Zn), ni-mh (NiMH), lithium
Ion (Li-ion) etc.), solaode, fuel cell etc..
Processor 118 can also couple with GPS chip group 136, and this chipset may be configured to provide and WTRU 102
The relevant positional information (such as longitude and latitude) in current location.Supplementing or replacing as the information from GPS chip group 136
Changing, WTRU 102 can believe via the position that air interface 115/116/117 receives from base station (such as base station 114a, 114b)
Breath, and/or determine its position according to the signal timing of base station reception near two or more.Will be appreciated that and protecting
Holding while meeting embodiment, WTRU 102 can obtain positional information by the most suitable localization method.
Processor 118 is also coupled to other ancillary equipment 138, can include among these providing supplementary features, function
And/or one or more softwares of wired or wireless connection and/or hardware module.Such as, ancillary equipment 138 can include accelerating
Degree meter, digital compass, satellite transceiver, digital camera (for photo and video), USB (universal serial bus) (USB) port,
Vibratory equipment, television transceiver, Earphone with microphone, bluetooth module, frequency modulation (FM) radio unit, digital music player, matchmaker
Body player, video game machine module, explorer etc..
Fig. 1 C is the RAN 103 according to an embodiment and the system diagram of core network 106.As it has been described above, RAN
103 can use UTRA radiotechnics and communicate with WTRU 102a, 102b, 102c via air interface 115.RAN
103 can also communicate with core network 106.As shown in Figure 1 C, RAN 103 can include node B 140a, 140b, 140c, its
In each node B can include one or more receipts of communicating via air interface 115 with WTRU 102a, 102b, 102c
Sender.Each in node B 140a, 140b, 140c can be associated with the specific cell (not shown) in RAN 103.
RAN 103 can also include RNC 142a, 142b.Will be appreciated that while keeping being consistent with embodiment, RAN
103 can include any number of node B and RNC.
As shown in Figure 1 C, node B 140a, 140b can communicate with RNC 142a.Additionally, node B 140c is permissible
Communicate with RNC 142b.Node B 140a, 140b, 140c can come and corresponding RNC 142a, 142b via Iub interface
Communicate.RNC 142a, 142b can communicate with one another via Iur interface.Each RNC 142a, 142b can be configured
Become to control respective nodes B 140a, 140b, 140c of being attached thereto.It addition, each RNC 142a, 142b can be configured to hold
Row or support other functions, such as open sea wharf, load control, access control, packet scheduling, switching control, macro-diversity,
Security function, data encryption etc..
Core network 106 shown in Fig. 1 C can include WMG (MGW) 144, mobile switching centre (MSC) 146, clothes
Business GPRS Support Node (SGSN) 148 and/or Gateway GPRS Support Node (GGSN) 150.Although aforementioned each parts are retouched
Stating into is the part of core network 106, it would be appreciated that other entities outside core network carrier can also have
And/or the either component that operation is among these.
The MSC 146 that RNC 142a in RAN 103 can be connected in core network 106 via IuCS interface.MSC
146 may be coupled to MGW 144.MSC 146 and MGW 144 can be that WTRU 102a, 102b, 102c provide for PSTN
The access of the circuit-switched network of 108 etc, in order to facilitate between WTRU 102a, 102b, 102c and conventional land lines communication equipment
Communication.
The SGSN 148 that RNC 142a in RAN 103 can also be connected in core network 106 via IuPS interface.Institute
State SGSN 148 and may be coupled to GGSN 150.SGSN 148 and GGSN 150 can be that WTRU 102a, 102b, 102c provide
Access for the packet switching network of the Internet 110 etc, in order to facilitate WTRU 102a, 102b, 102c and IP enabled device
Between communication.
As it has been described above, core network 106 may be also connected to network 112, this network can include other service suppliers
Other the wired or wireless networks having and/or run.
Fig. 1 D is the RAN 104 according to an embodiment and the system diagram of core network 107.As it has been described above, RAN
104 can use E-UTRA radiotechnics and communicate with WTRU 102a, 102b, 102c via air interface 116.
Additionally, RAN 104 can also communicate with core network 107.
RAN 104 can include e node B 160a, 160b, 160c, it would be appreciated that keeping and embodiment phase
While symbol, RAN 104 can include any number of e node B.Each e node B 160a, 160b, 160c can include
One or more transceivers, in order to communicate with WTRU 102a, 102b, 102c via air interface 116.An enforcement
In mode, e node B 160a, 160b, 160c can implement MIMO technology.Thus, for example, e node B 160a can make
To launch wireless signal to WTRU 102a with multiple antennas, and receive the wireless signal from WTRU 102a.
Each e node B 160a, 160b, 160c can be associated with specific cell (not shown), and can be configured
One-tenth processes user scheduling in provided for radio resources management decision-making, handover decisions, up-link and/or downlink etc..Such as figure
Shown in 1D, e node B 160a, 160b, 160c can communicate with one another via X2 interface.
Core network 107 shown in Fig. 1 D can include mobile management gateway (MME) 162, gateway 164 and divide
Group data network (PDN) gateway 166.Although each parts above-mentioned are described as a part for core network 107, but
It should be appreciated that other entities outside core network carrier equally have and/or run either component among these
MME 162 can be connected with each e node B 160a, 160b, the 160c in RAN 104 via S1 interface,
And control node can be served as.Such as, MME 162 can be responsible for the user of certification WTRU 102a, 102b, 102c, activate/
Deexcitation carries, and selects particular service gateway etc. during the initial attachment of WTRU 102a, 102b, 102c.Described MME
162 may be provided for controlling plane function, in order in RAN 104 and other radiotechnics employing GSM or WCDMA etc
Other RAN (not shown)s between perform switching.
Each e node B 160a that gateway 164 can be connected in RAN 104 via S1 interface, 160b,
160c.This gateway 164 generally can route and forward the user data to/from WTRU 102a, 102b, 102c to divide
Group.Additionally, gateway 164 can also carry out grappling user face during other functions, the such as switching between e node B, under
Uplink data is available for triggering paging when WTRU 102a, 102b, 102c use, and manages and store WTRU 102a, 102b, 102c
Context etc..
Gateway 164 may be also connected to PDN Gateway 166, can be that WTRU 102a, 102b, 102c provide for all
Access such as the packet switching network of the Internet 110 etc, in order to facilitate WTRU 102a, 102b, 102c and IP enabled device it
Between communication.
Core network 107 can facilitate the communication with other networks.Such as, core network 107 can be WTRU 102a,
102b, 102c provide the access of the circuit-switched network for PSTN 108 etc, in order to facilitate WTRU 102a, 102b, 102c
And the communication between conventional land lines communication equipment.As example, core network 107 can include IP gateway (such as IP multimedia
Subsystem (IMS) server) or communicate, wherein said IP gateway act as between core network 107 and PSTN 108
Interface.Additionally, core network 107 can be WTRU 102a, 102b, 102c provides the access for network 112, wherein this net
Network can include other wired or wireless networks that other service suppliers have and/or run.
Fig. 1 E is the RAN 105 according to an embodiment and the system diagram of core network 109.RAN 105 can be
The access aloft communicated with WTRU 102a, 102b, 102c on interface 117 by using IEEE 802.16 radiotechnics
Service network (ASN).As discussed further below, WTRU 102a, 102b, 102c, RAN 104 and core network
Communication link between the difference in functionality entity of 109 can be defined as reference point.
As referring to figure 1e, RAN 105 can include base station 180a, 180b, 180c and ASN gateway 182, but should
Solving, while keeping being consistent with embodiment, RAN 105 can include any number of base station and ASN gateway.Each base
Stand the specific cell (not shown) that 180a, 180b, 180c can be associated with in RAN 1054, and each base station can include one
Individual or multiple transceivers, in order to communicate with WTRU 102a, 102b, 102c via air interface 117.A reality
Executing in mode, base station 180a, 180b, 180c can implement MIMO technology.Thus, for example, base station 180a can use many
Individual antenna launches wireless signal to WTRU 102a, and receives the wireless signal from WTRU 102a.Base station 180a,
180b, 180c may be provided for mobile management function, such as handover trigger, tunnel foundation, provided for radio resources management, portfolio
Classification, service quality (QoS) strategy enforcement etc..ASN gateway 182 can serve as portfolio accumulation point, and can be responsible for seeking
Exhale, subscriber profiles caching, route etc. for core network 109.
Air interface 117 between WTRU 102a, 102b, 102c and RAN 105 can be defined as being to implement IEEE
802.16 the R1 reference point of specification.It addition, each WTRU 102a, 102b, 102c can set up logic with core network 109
Interface (not shown).Logic interfacing between WTRU 102a, 102b, 102c and core network 109 can be defined as R2 reference
Point, this reference point may be used for certification, mandate, IP main frame configuration management and/or mobile management.
Communication link between each base station 180a, 180b, 180c can be defined as R8 reference point, and this reference point comprises
For facilitating the agreement of the data transmission between WTRU switching and base station.Base station 180a, 180b, 180c and ASN gateway 182
Between communication link can be defined as R6 reference point.Described R6 reference point can include for facilitate based on each WTRU
The mobile management of the mobility event that 102a, 102b, 102c are associated.
As referring to figure 1e, RAN 105 may be coupled to core network 109.Leading between RAN 105 and core network 109
Letter link may be defined as R3 reference point, and as example, this reference point contains for facilitating data transmission and mobility pipe
The agreement of reason ability.Core network 109 can include mobile IP home agent (MIP-HA) 184, certification, authorize, keep accounts (AAA)
Server 186 and gateway 188.Although aforementioned each parts are described as a part for core network 109, but should
Understanding, the entity beyond core network carrier can also have and/or run either component among these.
MIP-HA can be responsible for IP address management, and WTRU 102a, 102b, 102c can be allowed at different ASN
And/or the internetwork roaming of different core networks.MIP-HA 184 can be that WTRU 102a, 102b, 102c provide for the Internet
The access of the packet switching network of 110 etc, in order to that facilitates between WTRU 102a, 102b, 102c and IP enabled device is logical
Letter.Aaa server 186 can be responsible for user authentication and support user's service.It is mutual that gateway 188 can be facilitated with other networks
Logical.Such as, gateway 188 can be that WTRU 102a, 102b, 102c provide the circuit-switched network for PSTN 108 etc
Access, in order to facilitate the communication between WTRU 102a, 102b, 102c and conventional land lines communication equipment.It addition, gateway 188 is permissible
Thering is provided the access for network 112 for WTRU 102a, 102b, 102c, wherein this network can include that other service suppliers gather around
Other the wired or wireless networks having and/or run.
Although the most not showing, it would be appreciated that RAN 105 may be coupled to other ASN, and core net
Network 109 may be coupled to other core networks.Communication link between RAN 105 and other ASN can be defined as R4 reference point,
This reference point can include the association for coordinating WTRU 102a, 102b, 102c movement between RAN 105 and other ASN
View.Communication link between core network 109 and other core networks may be defined as R5 reference point, and this reference point can be wrapped
Include for facilitating the agreement of intercommunication between home core network and interviewed core network.
The one or more embodiments described in this can be used for processing system for video, video display system and/or regard
Frequently compressibility.
Forward Fig. 2 to, it is possible to provide a kind of inverse radiomovies wave filter.Inverse radiomovies wave filter can be used for performing encoded
The inverse radiomovies conversion of video, it can make it possible to accurate reconstruction original progressive (progressive) video.Repeat fields (example
As, wherein a field of this repetition centering is redundancy or unnecessary) existence in radiomovies video can be together with being subject to
Coding artifacts affects these less version and is identified together.
Fig. 2 is the example between film A (such as, a frame or multiframe) and terleaved video A0 and A1 (the most one or more field)
Figure 200 of relation.Interlock and can refer to by the row's (such as, pixel column in moving-picture frame) being sequentially numbered the end of to from top and described row
It is divided into two set: use row's (such as, it is referred to alternatively as pushing up field, even field and/or 0) of even-numbered and compile with odd number
Number row's (such as, it is referred to alternatively as field, the end, odd field and/or 1).Such as, as shown in Figure 2, the two in frame of video
Field can show at two different times.Such as, as in figure 2 it is shown, top (such as even number) field A0 can be prior to the end (such as odd number) field A1
It is rendered, or in contrast.Preferential (bff) pattern of preferential (tff) pattern in field, top and/or field, the end can be used.
When film is converted to video format (such as, ntsc video), the switch technology being referred to as radiomovies can be used.
The deformation of one or more radiomovies technology, such as 2:3 can be used drop-down or pull technology under 3:2.
Fig. 3 is Figure 30 0 of the example of pull technology under 2:3.Film can be slowed down about 0.1% and reach by the drop-down radiomovies of 2:3
To 23.976 frames per second.Under 2:3, the four of film progressive frames (A, B, C, D) can be distributed to being in the five of 29.97Hz by pull technology
In individual interlaced frames of video 301-305.Each in these five interlaced frames of video can include two video fields (such as, top field, idol
Several and/or 0 and field, the end, odd field and/or 1).This can produce ten video field (such as, even field A0, B0, B0, C0
And D0, and odd field A1, B1, C1, D1 and D1).Because four moving-picture frames are divided into field at the bottom of five fields, top and five, described
One or more (such as, both) in Chang is repeatable.During it is understood that repeat on the spot, the one of centering is unnecessary
(such as, redundancy).Such as, in Fig. 3, B0 and D1 is repeatable.In this kind of situation, repeat fields (such as, top field, even field and/
Or 0) it is unnecessary (such as, redundancy) to the one in (B0 and B0).Repeat fields (such as, field, the end, odd field and/or 1
) it is unnecessary (such as, redundancy) to the one in (D1 and D1).
Fig. 4 is Figure 40 0 of example drop-down for 2:3.Film can be slowed down about 0.1% and reach every by the drop-down radiomovies of 2:3
Second 23.976 frames.Under 2:3, the four of film progressive frames (A, B, C, D) can be distributed to five friendships being in 29.97Hz by pull technology
In wrong frame of video 401-405.Each in these five interlaced frames of video can include two video fields (such as, top field, even field
And/or 0 and field, the end, odd field and/or 1).This can produce ten video fields (such as, even field A0, B0, C0, D0 and D0,
And odd field A1, B1, B1, C1 and D1).Because four moving-picture frames are divided into field at the bottom of five fields, top and five, in described field
One or more (such as, both) repeatable.During it is understood that repeat on the spot, the one of centering is unnecessary (example
As, redundancy).Such as, in Fig. 4, D0 and B1 is repeatable.In this kind of situation, repeat fields (such as, top field, even field and/or 0
) it is unnecessary (such as, redundancy) to the one in (D0 and D0).Repeat fields (such as, field, the end, odd field and/or 1) is right
One in (B1 and B1) is unnecessary (such as, redundancy).
Fig. 5 is Figure 50 0 of example drop-down for 2:3.Film can be slowed down about 0.1% and reach every by the drop-down radiomovies of 2:3
Second 23.976 frames.Under 2:3 pull technology can by four line by line moving-picture frame (A, B, C, D) distribution interlock to being in five of 29.97Hz
In frame of video 501-505.Each in these five interlaced frames of video can include two video fields (such as, top field, even field
And/or 0 and field, the end, odd field and/or 1).This can produce ten video fields (such as, even field A0, B0, B0, C0 and D0,
And odd field A1, B1, C1, C1 and D1).Because four moving-picture frames are divided into field at the bottom of five fields, top and five, in described field
One or more (such as, both) repeatable.During it is understood that repeat on the spot, the one of centering is unnecessary (example
As, redundancy).Such as, in Fig. 5, B0 and C1 is repeatable.In this kind of situation, repeat fields (such as, top field, even field and/or 0
) it is unnecessary (such as, redundancy) to the one in (B0 and B0).Repeat fields (such as, field, the end, odd field and/or 1) is right
One in (C1 and C1) is unnecessary (such as, redundancy)
When performing 2:3 and being drop-down, hybrid frame or dirty (dirty) frame of video can be generated.Hybrid frame or dirty frame can refer to include coming
Frame of video from the field of neighbouring moving-picture frame (such as, rather than same film frame).Such as, the frame 303 and 304 in Fig. 3 can be mixing
Frame or dirty frame.Frame 403 and 404 in Fig. 4 can be hybrid frame or dirty frame.Frame 503 in Fig. 5 can be hybrid frame or dirty frame.
Inverse radiomovies process can be provided.This is conducive to the radiomovies detecting and removing in the video sequence of decoding.Example
As, noninterlace display (such as, computer monitor and control unit, numeral TV etc.) can illustrate the noninterlace content of better quality.Remove mixed
Close frame or dirty frame to improve video compress and/or be applied to the result for the treatment of technology (such as, filtering) of video of decoding.
Can perform for the search repeating (such as, redundancy or unnecessary) field.The comparable field from neighbouring frame of video is with really
Determine 2:3 drop-down radiomovies pattern.Such as, this and can keep following the trail of at last some frames by checking the frame in terleaved video
Completing in proper order by (pair-wise) deviation between even field and odd field in (such as last 5-10 frame).By little to deviation
Example in common (frame-wise) frame by frame deviation doubtful can be attached most importance to and be answered (such as, redundancy or unnecessary) field.If such is real
Example is formed has the system pattern with 5 frames as cycle, then this example can be confirmed as the radiomovies generated.
Fig. 6 is Figure 60 0 of the example of the inverse radiomovies removed by field.Field can quilt to repeat (such as, redundancy or unnecessary)
Remove.Inverse radiomovies technology can include that the field (such as, redundancy or unnecessary) to being repeated removes.Such as, field B1 ' and
B1 " repeat fields can be identified as.Repeat fields B1 " unnecessary field can be determined as and be removed, thus field B1 ' 602 can be stayed
In output sequence (result of inverse radiomovies).Such as, field D0 ' and D0 " repeat fields can be identified as.Repeat fields D0 ' can quilt
It is determined as unnecessary field and is removed, thus field D0 " 604 can be left in output sequence (result of inverse radiomovies).Logical
Cross merging even field and/or odd field and abandon unnecessary field (such as, B1 " and D0 '), can be with reconstructed frame C0 ' | C1 '.
Fig. 7 is the Figure 70 0 of the example making the average inverse radiomovies of use.Field can be performed average.Can be to one or more
Repeat fields is averaged.Because such as field may be encoded and reconstruct, and these can include different reconstructed errors, institute
More preferable reconstruction quality averagely can be provided with field.This kind of reconstructed error averagely can be reduced in field.As example, B1 ' and B1 " can be
Repeat fields in odd field (such as, field, the end or 1).In output sequence (such as, the result of inverse radiomovies), field B1*702
May be provided as B1 ' and B1 " between average (such as, B1*=(B1 '+B1 ")/2).D0 ' and D0 " can be even field (such as,
Top field or 0) in repeat fields.In output sequence (such as, the result of inverse radiomovies), field D0*704 may be provided as
D0 ' and D0 " between average (such as, D0*=(D0 '+D0 ")/2).
Fig. 8 is example video coding and Figure 80 0 of decoding process.Visual artefacts can be introduced reconstruct by coding and decoding
?.The video flowing of decoding can be edited and/or can be included the advertisement (such as, it can change radiomovies pattern) inserted.Due to
Compression (such as, encode video flowing), the reconstruct field of the video flowing of decoding can be affected by Coding artifacts.Because in order to
Compression of video sequence is for transmission and/or storage, and visually significantly information may be lost, and therefore may occur in which Coding artifacts.
Compression can introduce visual artefacts (such as, such as block (blocking) and quantizing noise).Depending on decrement, pseudomorphism can be introduced into
In the frame of reconstruct.
Wave filter, server and/or display device can receive the video sequence that (such as, via processor) is encoded.Filter
Ripple device, server and/or display device can include processor, and such as, this processor can be implemented in this function described
Person or many persons.Wave filter can include one or more video filter (such as, one or more video postfilters).Service
Device can include content server.Encoded can be regarded by wave filter, server and/or display device (such as, via processor)
Frequency sequence is decoded.The video sequence of decoding can include multiple field.Frame can be by even parity field (such as, top field, even field
And/or 0) and strange parity field (such as, field, the end, odd field and/or 1) represent.Even field and/or odd field (decoding
Video sequence) series of fields (such as, field A0 '-D0 " and/or field A1 '-D1 ') can be included.In this series of field at least
One field can be unnecessary field.
Encoded, transmit/store and decode after, reconstruct (such as, decoding) field A0 '-D0 " and A1 '-D1 ' can with former
Beginning, field A0-D0 and A1-D1 differed.Such as, the field of decoding can differ with the respective frame data in original video.And, very
Repeat fields to reconstruct can mutually differ (such as, in addition to differing) with original repeat fields.Such as, repeat fields B1 ' and
B1 " can mutually differ or differ with original repeat fields B1.Repeat fields B1 ' and B1 " puppet of varying number can be comprised
Picture.Repeat fields B1 ' with B1 " credit rating different from reconstructed frame can be produced.Regarding of prediction decoding can be carried out according to different reference field
Repeat fields B1 in Pin ' and/or B1 ".B1 ' can carry out interior coding (intracoded), and B1 " motion prediction can be carried out, such as,
Or in contrast.Result is probably B1 ' and B1 " between deviation may be the most notable.The noninterlace frame produced can show visible
Visual artefacts.
Repeat fields D0 ' with D0 " can mutually differ or different from original repeat fields D0.Repeat fields D0 ' and D0 " can
Comprise the pseudomorphism of varying number.For the frame of reconstruct, repeat fields D0 ' and D0 " identical credit rating can not be produced.
Can perform to reconstruct more accurately the inverse radiomovies conversion of the encoded video of original progressive video.Example
As by identifying that repeat fields the highest with original series similarity in decoding sequence is (such as, by identifying the unnecessary of repetition centering
), the impact of video compress can be reduced.Can by identify drop-down pattern (such as, the drop-down pattern of 2:3) and determine and/or
Merge repeat fields and perform inverse radiomovies technology to generate reconstructed frame.
Can provide identification drop-down pattern.Although being described about the drop-down pattern of 2:3, but the enforcement described in this
Mode can be applicable to any drop-down pattern.
Fig. 9 be identify the drop-down pattern of 2:3 or determine the most similar field to Figure 90 0 of example of method.For
Identification 2:3 drop-down pattern, comparable field, top and/or field, the end (such as, neighbouring field, top and/or field, the end).Such as, can use mean square
Error (MSE) compare neighbouring field (such as, the time is adjacent to field) in field, top (such as, MSE (A0 ', B0 '), MSE (B0 ',
C0 '), MSE (C0 ', D0 '), MSE (D0 ', D0 ")).In field, top, there is the field of minimum MSE 902 to being identified (such as,
D0 ' and D0 ").There is the field of minimum MSE to including repeat fields.Additive method can be used to compare the neighbouring field in field, top.Can
Use MSE compare neighbouring field in field, the end (such as, MSE (A1 ', B1 '), MSE (B1 ', B1 "), MSE (B1 ", C1 '), MSE
(C1’,D1’)).There is in field, the end field of minimum MSE 904 to can be identified (such as, B1 ' and B1 ").Have minimum MSE's
Field is to including repeat fields.Additive method can be used to the neighbouring field comparing in field, the end.Such as, the tolerance in addition to MSE can be used
Neighbouring field is compared to determine the most similar field right.
The mark of repeat fields may be used to determine the drop-down pattern of 2:3.Once being identified, the drop-down pattern of 2:3 can be considered to keep
Constant.Drop-down pattern can be considered due to editor, advertisement insert and/or other and change, so in this sequence from start to finish
MSE tracked and this pattern can be adjusted (such as, the need to).
MSE can be used in video coding technique (such as estimation), such as, to compare frame of video objectively and/or to regard
Frequently field.The traceable vision difference of MSE.Such as, low MSE can be frame and/or the field good instruction of coupling, and such as it can reduce by mistake
The probability identified.Equation below (formula 1) may be used to identify drop-down pattern (such as, the drop-down pattern of 2:3):
Figure 10 is how to determine which field (such as, preferred in repeat fields) in repeat fields can selected example
Figure 100 0.After two or more (such as, to) in identifying repeat fields, the optional repetition that can make distortion minimization
, and it is believed that other repeat fields of this centering are unnecessary.
The repeat fields making distortion minimization can be to make the expection distortion relative to corresponding primary field (one or more)
The field minimized.Such as because may village two or more repeat fields, can use determine for the reference field compared and
Select to make the repeat fields of distortion minimization.
(such as, field, top, even field and/or 0) can include A0 ', B0 ', C0 ', D0 ' and D0 in first parity series field ".
As described herein, D0 ' and D0 " can be identified as repeating right.In inverse radiomovies, D0 ' or D0 " will be chosen and other
Field will be unnecessary.The field (such as, making the field of distortion minimization) chosen may be expressed as D0*.
(such as, field, the end, odd field and/or 1) can include A1 ', B1 ', B1 in second parity series field ", C1 ' and D1 '.
As described herein, B1 ' and B1 " can be identified as repeating right.In inverse radiomovies, B1 ' or B1 " will be chosen and other
Field will be unnecessary.The field (such as, making the field of distortion minimization) chosen may be expressed as B1*.
Such as, field B1 ' and B1 " in each can be with their neighbouring (example in Di Chang (such as, same parity)
As, the time is neighbouring) field compares.B1 ' can compare (1002) with A1 '.B1 ' can compare (1004) with C1 '.B1”
Can compare (1006) with A1 '.B1 " can compare (1008) with C1 '.Which field being determined by field alignment is respective with it
Neighbouring field (one or more) the most similar select unnecessary field.Such as, when selecting unnecessary field, can be by calculating neighbouring field
Distortion backfence with its time (such as, using the tolerance such as, but not limited to MSE) determines the similarity between neighbouring field.
Can determine that set (such as, the figure of the possible reference field of pin repeat fields (such as, the B1 ' in Figure 10 and/or B1 ")
A1 ' in 10 and C1 ').Optimal reference field can be selected from the set of possible reference field.Such as, can be possible by calculating
Relative to the distortion of this repeat fields and determine that the reference field making distortion minimization is to determine reference field in reference field each.Example
As, for Figure 10, the optimal reference field of repeat fields { B1 ', B1 " } can use equation below (formula 2) to determine:
If (MSE (A1 ', B1 ')+MSE (A1 ', B1 ")) < (MSE (C1 ', B1 ')+MSE (C1 ', B1 "))
A1 ' is selected as optimal reference formula 2
Otherwise (such as, if (MSE (A1 ', B1 ')+MSE (A1 ', B1 ") >
(MSE (C1 ', B1 ')+MSE (C1 ', B1 ")))
C1 ' is selected as optimal reference.
Reference field can refer to can be used as the field of the succedaneum of primary field.
Such as, for the set of given repeat fields, can compare same parity closest to (such as, the time is closest)
One or multiple execution in Chang are compared.Such as, repeat fields B1 in Figure 10 ' and B1 ", can be by from A1's ' and C1 '
Set determining, reference field performs to compare.Can compare opposite parity closest in (such as, the time is closest) field
Person or many persons perform to compare.Such as, repeat fields B1 in Figure 10 ' and B1 ", can be by from the set of B0 ', C0 ' and D0 '
In determine with reference to performing to compare.
One or more fields of one or more parities can be compareed, perform to compare on the search window that size is N.Example
As, the field (such as, all fields) in the distance of the position, two fields (N=2) impinging upon detected repeat fields can be performed ratio
Relatively.Such as, repeat fields B1 in Figure 10 ' and B1 ", can be by determining ginseng from the set of A1 ', B0 ', C0 ', D0 ' and C1 '
Examine and perform to compare.
Can determine that the repeat fields making distortion minimization relative to optimal reference field, and select this to regard for original progressive
The reconstruct of frequency sequence.Such as, equation below (formula 3) can be used to determine the field making distortion minimization of selection:
Quantized value can be used to select repeat fields.The video flowing that field is encoded can be analyzed to determine this quantized value.Can
Carry out making distortion minimum for the quantization zooming parameter that (such as, each) macro block of repeat fields is carried out encode by assessment
The selection of the repeat fields changed.Relatively low quantization zooming parameter may indicate that this and/or frame have relatively low quantization error, and it is compiled
The impact of code pseudomorphism is less, and/or it is the most similar to original.
The assessment to quantization parameter (QP) can be carried out by performing statistical analysis.For given repeat fields (such as, figure
B1 ' in 10 and B1 ") in (each) macro block, it may be determined that for quantization parameter that DCT coefficient is encoded.With each
Based on macro block (per-macroblock), QP can be different.Can determine that one or more (such as, all) of repeat fields
The average QP of macro block.The repeat fields with minimum average QP is selectable as making the repeat fields of distortion minimization.
Can select to make the repeat fields of distortion minimization based on type of prediction.When repeat fields is of hybrid frame or dirty frame
Timesharing, can based on the type of prediction on this carry out making the repeat fields of distortion minimization selection (such as, cancel unnecessary
The selection of field).Such as, field and/or frame can carry out interior coding or non-interior coding (such as, motion compensation).The field of non-interior coding
May be cleaner, because it is predicted according to reference field and can be closer to original expression.Type of prediction can be with picture (example
As, field) level signal transmission, and based on the type of prediction of each in the repeat fields detected, can be to coded bit stream
In this kind of signaling be analyzed determining selected field.
The repeat fields making distortion minimization can be determined based on macro-block level selection course.Such as, can by will from two or
The macro block selected in more different repeat fields is stitched together and builds new field.Such as, different repeat fields is the grandest
Block can compare each other and compare, and optional expection and original progressive video sequence closest to macro block be used for building
New field.The newest field can be used to reconstruct original progressive video sequence.Such as, as described herein, can use MSE,
QP and/or type of prediction relatively carry out the comparison between the respective macroblock of different repeat fields.
The example compared as macro block, as shown in Figure 10, detectable repeat fields is to B1 ' and B1 ", and can determine that optimal
Reference frame.Describe for determining repeating frame and for the Resource selection optimal reference frame for the repeating frame detected in this
Technology.Then can be compared by macro-block level and carry out selecting from two repeating frames detected building for reconstruct original by
The field B1* of row frame of video.Such as, according to following comparison (formula 4), each macro block B1* (n) in B1* is selectable as
From the respective macroblock of B1 ' or as from B1 " respective macroblock:
Replace selecting single optimal reference field for determined by the macro block of repeating frame compare, it may be determined that
Good reference macroblock is to be used in the determination of each in macro block B1* (n).Such as, formula 2 can be applicable to macro-block level, in order to
Consider respective macroblock B1 of repeat fields ' (n) and B1 " (n) determine each optimal reference macro block (such as, " optimal reference (n)) ".
Respective macroblock B1 when with repeating frame ' (n) and B1 " (n) when comparing, and can search for having same parity, opposite parity
And/or the respective macroblock of the set of the surrounding field of both parities, to find, there is minimum distortion (such as, minimum MSE)
Respective macroblock.
The example compared as macro block, detectable repeating frame is to B1 ' and B1 " (such as, as shown in Figure 10), and
Carry out macro-block level by quantization parameter (such as, QP zooming parameter) and/or type of prediction to compare and can build for reconstructing subsequently
The field B1* of original progressive video frame.In the case of quantization parameter compares, such as, macro block B1* (n) is selectable as accordingly
Macro block B1 ' (n) or as respective macroblock B1 " (n), depend in these respective macroblock which there is finer quantization,
Or equally there is less QP zooming parameter.Finer quantization and/or less QP zooming parameter may indicate that described grand
Block is closer to the data from original progressive video sequence in terms of distortion-aware, and therefore, this kind of macro block can be chosen
To be included in B1*.In the case of type of prediction compares, such as, macro block B1* (n) is selectable as respective macroblock B1 '
(n) or as respective macroblock B1 " (n), depend on that these respective macroblock carry out encoding used pre-in video bit stream
Survey type.Such as, use the macro block of P or B type of prediction coding can be better than using the macro block of I type of prediction coding to be chosen, because of
For P or B type of prediction may indicate that this macro block in terms of distortion-aware closer to original progressive video sequence.
Post-filtering can be performed after performing inverse radiomovies.Once original progressive frame is reconstructed, and postfilter can quilt
Apply the pseudomorphism introduced to remove the interleaved code being likely to be due to content.Such as, if it is determined that the field belonging to different frame is passed through
The codec of such as MPEG-2 is encoded as picture frame, then there may be significantly in vertical direction in the progressive frame of reconstruct
Nyquist (Nyquist) noise.Have be arranged on the vertical low pass filters of the cut-off frequency (fc) under Nyquist can
It is employed.
Figure 11 is inverse radiomovies 1102 in prior art, in the inverse radiomovies 1104 this described and in this described
There is Figure 110 0 of the example of the inverse radiomovies 1106 of post-filtering (fc=0.5).
Figure 12 is inverse radiomovies 1202 in prior art, in the inverse radiomovies 1204 this described and in this described
There is Figure 120 0 of the example of the inverse radiomovies 1206 of post-filtering (fc=0.5).
Figure 13 is inverse radiomovies 1302 in prior art, in the inverse radiomovies 1304 this described and in this described
There is Figure 130 0 of the example of the inverse radiomovies 1306 of post-filtering (fc=0.5).
With particular combination, feature and element are described although above, but one of ordinary skill in the art will appreciate that
, each feature or element can be used alone, or be used in combination with any further feature and element.Additionally, describe in this
Method can implement in computer program, software or firmware, described computer program, software or firmware are comprised in by counting
In the computer-readable medium that calculation machine or processor perform.The example of computer-readable medium includes that electronic signal is (by wired
Or wireless connections transmission) and computer-readable recording medium.The example of computer-readable recording medium including, but not limited to
Read only memory (ROM), random access memory (RAM), depositor, buffer storage, semiconductor memory apparatus, magnetizing mediums
(such as internal hard drive or removable dish), magnet-optical medium and light medium (such as CD-ROM disk and digital universal disc (DVD)).With
The processor that software is associated can realize radio-frequency receiving-transmitting in WTRU, UE, terminal, base station, RNC or any master computer
Device.
Claims (24)
1. a video filtering method, the method includes:
Receive the encoded video sequence including multiple, and described encoded video sequence is decoded, its midfield
Being the one in even parity field and strange parity field, at least one field in wherein said multiple fields is unnecessary field;
At least one time of each field with same parity is compared adjacent to field;
Determining that the most similar field is right, wherein said field is to including described unnecessary field;
Which of described field alignment is determined by which field of described field alignment and respective time the most similar adjacent to field determines
Individual field is described unnecessary field, and the wherein said respective time is not other of described field alignment adjacent to field;And
Described video sequence is reconstructed in the case of field unnecessary determined by not using.
Method the most according to claim 1, wherein compared with the situation using described unnecessary field, the video sequence reconstructed
There is less distortion.
Method the most according to claim 1, the method also includes applying wave filter to remove pseudomorphism.
Method the most according to claim 1, the wherein said respective time has adjacent to field with described field identical strange
Idol.
Method the most according to claim 1, the wherein said respective time has adjacent to field with described field contrary strange
Idol.
Method the most according to claim 1, the most similar described field is to having least mean-square error
Those fields.
Method the most according to claim 1, wherein said unnecessary field has higher about its respective time adjacent to field
Mean square error.
Method the most according to claim 1, wherein said unnecessary field has higher for its respective time adjacent to field
Average quantization zooming parameter.
Method the most according to claim 1, wherein said unnecessary field is the field that described centering passes through motion compensation.
Method the most according to claim 1, the method also includes the pattern determining the unnecessary field in described video sequence.
11. 1 kinds of video filtering methods, the method includes:
Receiving the multiple frames including series of fields, at least one field in wherein said series of fields is unnecessary field;
Each field was compared adjacent to field with at least one time, right to determine the most similar field, wherein said field
To including described unnecessary field;
Determine which field of described field alignment is the most similar adjacent to field to the respective time and indicate this for described unnecessary field,
The described respective time is not other of described field alignment adjacent to field;And
The plurality of frame is reconstructed in the case of field unnecessary determined by not using.
12. methods according to claim 11, wherein said multiple frames are encoded video sequences.
13. methods according to claim 12, the method includes receiving described encoded video sequence and to described
Encoded video sequence is decoded.
14. methods according to claim 11, the method also includes applying wave filter to remove pseudomorphism.
15. methods according to claim 11, the wherein said respective time has adjacent to field with described field identical
Parity.
16. methods according to claim 11, the wherein said respective time has adjacent to field with described field contrary
Parity.
17. methods according to claim 11, the most similar described field is to being to have least mean-square error
Those fields.
18. methods according to claim 11, wherein said unnecessary field has higher about its respective time adjacent to field
Mean square error.
19. methods according to claim 11, wherein said unnecessary field has higher for its respective time adjacent to field
Average quantization zooming parameter.
20. methods according to claim 11, wherein said unnecessary field is the field that described centering passes through motion compensation.
21. methods according to claim 11, the method also includes the pattern determining the unnecessary field in described video sequence.
22. 1 kinds of wave filter, this wave filter includes:
Processor, is configured to:
Receiving the video sequence including multiple, its midfield is the one in even parity field and strange parity field, wherein said
At least one field in multiple fields is unnecessary field;
At least one time of each field with same parity is compared adjacent to field;
Determining that the most similar field is right, wherein said field is to including described unnecessary field;
Which field determining described field alignment is unnecessary field, and wherein said unnecessary field is the most similar adjacent to field to the respective time,
The described respective time is not other of described field alignment adjacent to field;And
Described video sequence is reconstructed in the case of field unnecessary determined by not using.
23. 1 kinds of servers, including:
Processor, is configured to:
Receive the encoded video sequence including multiple, and described encoded video sequence is decoded, its midfield
Being the one in even parity field and strange parity field, at least one field in wherein said multiple fields is unnecessary field;
At least one time of each field with same parity is compared adjacent to field;
Determining that the most similar field is right, wherein said field is to including described unnecessary field;
Which field determining described field alignment is described unnecessary field, and wherein said unnecessary field and respective time is least phase adjacent to field
Seemingly, the described respective time is not other of described field alignment adjacent to field;
Described video sequence is reconstructed in the case of field unnecessary determined by not using;And
The video sequence of reconstruct is re-started coding.
24. 1 kinds of display devices, this display device includes:
Processor, is configured to:
Receive the encoded video sequence including multiple, and described encoded video sequence is decoded, its midfield
Being the one in even parity field and strange parity field, at least one field in wherein said multiple fields is unnecessary field;
At least one time of each field with same parity is compared adjacent to field;
Determining that the most similar field is right, wherein said field is to including described unnecessary field;
Which field determining described field alignment is described unnecessary field, and wherein said unnecessary field is with the respective time adjacent to field least
Similar, the described respective time is not other of described field alignment adjacent to field;
Described video sequence is reconstructed in the case of field unnecessary determined by not using;And
The video sequence that display is reconstructed.
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201461938100P | 2014-02-10 | 2014-02-10 | |
US61/938,100 | 2014-02-10 | ||
PCT/US2015/015187 WO2015120443A1 (en) | 2014-02-10 | 2015-02-10 | Inverse telecine filter |
Publications (1)
Publication Number | Publication Date |
---|---|
CN105981373A true CN105981373A (en) | 2016-09-28 |
Family
ID=52474141
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201580007983.4A Pending CN105981373A (en) | 2014-02-10 | 2015-02-10 | Inverse telecine filter |
Country Status (6)
Country | Link |
---|---|
US (1) | US20160360199A1 (en) |
EP (1) | EP3105922B1 (en) |
KR (1) | KR101858212B1 (en) |
CN (1) | CN105981373A (en) |
TW (1) | TW201603583A (en) |
WO (1) | WO2015120443A1 (en) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2017126899A2 (en) * | 2016-01-19 | 2017-07-27 | Samsung Electronics Co., Ltd. | Methods and systems for reconstructing a high frame rate high resolution video |
US11303847B2 (en) * | 2019-07-17 | 2022-04-12 | Home Box Office, Inc. | Video frame pulldown based on frame analysis |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1606345A (en) * | 2003-06-10 | 2005-04-13 | 三星电子株式会社 | Apparatus and method for performing inverse telecine process |
CN1666502A (en) * | 2002-06-28 | 2005-09-07 | 皇家飞利浦电子股份有限公司 | Method and apparatus for conversion of video formats to 120 hz 4 to 1 interlaced formats |
CN101064785A (en) * | 2006-04-27 | 2007-10-31 | 富士通株式会社 | Detection device and detection method for 32-pull down sequence |
US20080062308A1 (en) * | 2006-09-07 | 2008-03-13 | Texas Instruments Incorporated | Film mode detection |
CN101569186A (en) * | 2006-12-27 | 2009-10-28 | 英特尔公司 | A method and system for telecine detection and restoration |
CN101785300A (en) * | 2007-08-23 | 2010-07-21 | 高通股份有限公司 | Systems and methods for combining deinterlacing and frame rate decimation for video format conversion |
US20100254453A1 (en) * | 2009-04-02 | 2010-10-07 | Qualcomm Incorporated | Inverse telecine techniques |
US8401070B2 (en) * | 2005-11-10 | 2013-03-19 | Lsi Corporation | Method for robust inverse telecine |
Family Cites Families (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB9303369D0 (en) * | 1993-02-19 | 1993-04-07 | Philips Electronics Uk Ltd | Identifying film frames in a video sequence |
US5828786A (en) * | 1993-12-02 | 1998-10-27 | General Instrument Corporation | Analyzer and methods for detecting and processing video data types in a video data stream |
US5757435A (en) * | 1995-12-08 | 1998-05-26 | C-Cube Microsystems, Inc. | MPEG-2 inverse telecine circuit |
US5847772A (en) * | 1996-09-11 | 1998-12-08 | Wells; Aaron | Adaptive filter for video processing applications |
US6873368B1 (en) * | 1997-12-23 | 2005-03-29 | Thomson Licensing Sa. | Low noise encoding and decoding method |
US20050231635A1 (en) * | 2004-04-16 | 2005-10-20 | Lin Ken K | Automated inverse telecine process |
US8879856B2 (en) * | 2005-09-27 | 2014-11-04 | Qualcomm Incorporated | Content driven transcoder that orchestrates multimedia transcoding using content information |
US8199255B1 (en) * | 2007-04-30 | 2012-06-12 | Nvidia Corporation | System, method, and computer program product for configuring a plurality of devices to process content |
US20090161766A1 (en) * | 2007-12-21 | 2009-06-25 | Novafora, Inc. | System and Method for Processing Video Content Having Redundant Pixel Values |
US10368108B2 (en) * | 2011-12-21 | 2019-07-30 | Ati Technologies Ulc | Downstream video composition |
-
2015
- 2015-02-10 WO PCT/US2015/015187 patent/WO2015120443A1/en active Application Filing
- 2015-02-10 CN CN201580007983.4A patent/CN105981373A/en active Pending
- 2015-02-10 KR KR1020167023349A patent/KR101858212B1/en active IP Right Grant
- 2015-02-10 US US15/117,714 patent/US20160360199A1/en not_active Abandoned
- 2015-02-10 TW TW104104387A patent/TW201603583A/en unknown
- 2015-02-10 EP EP15704944.6A patent/EP3105922B1/en not_active Not-in-force
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1666502A (en) * | 2002-06-28 | 2005-09-07 | 皇家飞利浦电子股份有限公司 | Method and apparatus for conversion of video formats to 120 hz 4 to 1 interlaced formats |
CN1606345A (en) * | 2003-06-10 | 2005-04-13 | 三星电子株式会社 | Apparatus and method for performing inverse telecine process |
US8401070B2 (en) * | 2005-11-10 | 2013-03-19 | Lsi Corporation | Method for robust inverse telecine |
CN101064785A (en) * | 2006-04-27 | 2007-10-31 | 富士通株式会社 | Detection device and detection method for 32-pull down sequence |
US20080062308A1 (en) * | 2006-09-07 | 2008-03-13 | Texas Instruments Incorporated | Film mode detection |
CN101569186A (en) * | 2006-12-27 | 2009-10-28 | 英特尔公司 | A method and system for telecine detection and restoration |
CN101785300A (en) * | 2007-08-23 | 2010-07-21 | 高通股份有限公司 | Systems and methods for combining deinterlacing and frame rate decimation for video format conversion |
US20100254453A1 (en) * | 2009-04-02 | 2010-10-07 | Qualcomm Incorporated | Inverse telecine techniques |
Also Published As
Publication number | Publication date |
---|---|
KR20160114121A (en) | 2016-10-04 |
US20160360199A1 (en) | 2016-12-08 |
EP3105922B1 (en) | 2018-04-04 |
EP3105922A1 (en) | 2016-12-21 |
WO2015120443A1 (en) | 2015-08-13 |
TW201603583A (en) | 2016-01-16 |
KR101858212B1 (en) | 2018-05-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP6964567B2 (en) | Sampling grid information for spatial layers in multi-layer video coding | |
US20220329831A1 (en) | Enhanced chroma coding using cross plane filtering | |
US20230108208A1 (en) | Complexity reduction of overlapped block motion compensation | |
KR102008078B1 (en) | Adaptive upsampling for multi-layer video coding | |
US10321130B2 (en) | Enhanced deblocking filters for video coding | |
ES2950165T3 (en) | Systems, apparatus and methods for the refinement of inter prediction with optical flow | |
JP2021536686A (en) | Adaptive motion vector accuracy for affine motion model-based video coding | |
CN107409220A (en) | Copy search in block | |
CN103797792A (en) | Systems and methods for spatial prediction | |
JP2022501906A (en) | Complexity reduction and bit width control for bidirectional optical flow | |
TW201433153A (en) | Reference picture lists modification | |
CN104769639A (en) | Temporal filter for denoising a high dynamic range video | |
US20240107024A1 (en) | Affine motion model derivation method | |
CN105830448A (en) | Error concealment mode signaling for a video transmission system | |
CN105981373A (en) | Inverse telecine filter | |
TWI846813B (en) | Apparatus and methods for inter prediction refinement with optical flow | |
US20220132136A1 (en) | Inter prediction bandwidth reduction method with optical flow compensation |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20160928 |
|
WD01 | Invention patent application deemed withdrawn after publication |