CA3181332A1 - System and method for a multi-primary wide gamut color system - Google Patents
System and method for a multi-primary wide gamut color systemInfo
- Publication number
- CA3181332A1 CA3181332A1 CA3181332A CA3181332A CA3181332A1 CA 3181332 A1 CA3181332 A1 CA 3181332A1 CA 3181332 A CA3181332 A CA 3181332A CA 3181332 A CA3181332 A CA 3181332A CA 3181332 A1 CA3181332 A1 CA 3181332A1
- Authority
- CA
- Canada
- Prior art keywords
- primary
- color
- image data
- green
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title abstract description 171
- 238000004891 communication Methods 0.000 claims description 41
- 239000003086 colorant Substances 0.000 abstract description 46
- 239000011159 matrix material Substances 0.000 description 148
- 238000005070 sampling Methods 0.000 description 92
- 230000008569 process Effects 0.000 description 86
- 230000032258 transport Effects 0.000 description 55
- 238000006243 chemical reaction Methods 0.000 description 49
- 238000013507 mapping Methods 0.000 description 46
- 230000006870 function Effects 0.000 description 36
- 238000012545 processing Methods 0.000 description 33
- 238000012546 transfer Methods 0.000 description 31
- 239000007991 ACES buffer Substances 0.000 description 25
- 230000003287 optical effect Effects 0.000 description 25
- 238000012986 modification Methods 0.000 description 22
- 230000004048 modification Effects 0.000 description 22
- 238000013461 design Methods 0.000 description 21
- 230000005540 biological transmission Effects 0.000 description 18
- 238000004422 calculation algorithm Methods 0.000 description 17
- 230000009977 dual effect Effects 0.000 description 17
- 238000004364 calculation method Methods 0.000 description 16
- 238000006467 substitution reaction Methods 0.000 description 14
- 239000013598 vector Substances 0.000 description 13
- 238000005516 engineering process Methods 0.000 description 12
- 238000004519 manufacturing process Methods 0.000 description 12
- 230000015654 memory Effects 0.000 description 11
- 230000002093 peripheral effect Effects 0.000 description 11
- 238000012856 packing Methods 0.000 description 10
- 230000009466 transformation Effects 0.000 description 9
- 239000000654 additive Substances 0.000 description 8
- 230000000996 additive effect Effects 0.000 description 8
- 230000008859 change Effects 0.000 description 7
- 238000004737 colorimetric analysis Methods 0.000 description 7
- 230000000295 complement effect Effects 0.000 description 7
- 238000001914 filtration Methods 0.000 description 7
- 230000035807 sensation Effects 0.000 description 7
- 239000000243 solution Substances 0.000 description 7
- 238000001228 spectrum Methods 0.000 description 7
- 238000003860 storage Methods 0.000 description 7
- 238000007792 addition Methods 0.000 description 6
- 230000008901 benefit Effects 0.000 description 6
- 238000011161 development Methods 0.000 description 6
- 230000018109 developmental process Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 6
- 238000003384 imaging method Methods 0.000 description 6
- 239000002096 quantum dot Substances 0.000 description 6
- 230000003595 spectral effect Effects 0.000 description 6
- OAICVXFJPJFONN-UHFFFAOYSA-N Phosphorus Chemical compound [P] OAICVXFJPJFONN-UHFFFAOYSA-N 0.000 description 5
- 102100030988 Angiotensin-converting enzyme Human genes 0.000 description 4
- 102100035765 Angiotensin-converting enzyme 2 Human genes 0.000 description 4
- 108090000975 Angiotensin-converting enzyme 2 Proteins 0.000 description 4
- 101100325959 Arabidopsis thaliana BHLH77 gene Proteins 0.000 description 4
- 101100378100 Mus musculus Ace3 gene Proteins 0.000 description 4
- 108090000882 Peptidyl-Dipeptidase A Proteins 0.000 description 4
- 238000007906 compression Methods 0.000 description 4
- 238000010276 construction Methods 0.000 description 4
- 238000000295 emission spectrum Methods 0.000 description 4
- 230000006978 adaptation Effects 0.000 description 3
- 238000003491 array Methods 0.000 description 3
- 230000006835 compression Effects 0.000 description 3
- 238000012937 correction Methods 0.000 description 3
- 238000009826 distribution Methods 0.000 description 3
- 239000012530 fluid Substances 0.000 description 3
- 238000012858 packaging process Methods 0.000 description 3
- 238000009877 rendering Methods 0.000 description 3
- 230000011664 signaling Effects 0.000 description 3
- 230000001360 synchronised effect Effects 0.000 description 3
- 230000003111 delayed effect Effects 0.000 description 2
- 230000001419 dependent effect Effects 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000002347 injection Methods 0.000 description 2
- 239000007924 injection Substances 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 238000004806 packaging method and process Methods 0.000 description 2
- 210000001525 retina Anatomy 0.000 description 2
- 238000010079 rubber tapping Methods 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- ONIBWKKTOPOVIA-BYPYZUCNSA-N L-Proline Chemical compound OC(=O)[C@@H]1CCCN1 ONIBWKKTOPOVIA-BYPYZUCNSA-N 0.000 description 1
- 241000023320 Luma <angiosperm> Species 0.000 description 1
- 235000006679 Mentha X verticillata Nutrition 0.000 description 1
- 235000002899 Mentha suaveolens Nutrition 0.000 description 1
- 235000001636 Mentha x rotundifolia Nutrition 0.000 description 1
- 241000699670 Mus sp. Species 0.000 description 1
- 241001085205 Prenanthella exigua Species 0.000 description 1
- XUIMIQQOPSSXEZ-UHFFFAOYSA-N Silicon Chemical compound [Si] XUIMIQQOPSSXEZ-UHFFFAOYSA-N 0.000 description 1
- 208000031861 Tritanopia Diseases 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 201000010018 blue color blindness Diseases 0.000 description 1
- 238000005282 brightening Methods 0.000 description 1
- 230000015556 catabolic process Effects 0.000 description 1
- 230000010267 cellular communication Effects 0.000 description 1
- 238000004040 coloring Methods 0.000 description 1
- 238000003066 decision tree Methods 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 238000006731 degradation reaction Methods 0.000 description 1
- 230000001934 delay Effects 0.000 description 1
- 238000009795 derivation Methods 0.000 description 1
- 230000004069 differentiation Effects 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 238000007667 floating Methods 0.000 description 1
- 230000007274 generation of a signal involved in cell-cell signaling Effects 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000012886 linear function Methods 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- OSWPMRLSEDHDFF-UHFFFAOYSA-N methyl salicylate Chemical group COC(=O)C1=CC=CC=C1O OSWPMRLSEDHDFF-UHFFFAOYSA-N 0.000 description 1
- 238000002156 mixing Methods 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000010422 painting Methods 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000001902 propagating effect Effects 0.000 description 1
- 201000000763 red color blindness Diseases 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 210000003583 retinal pigment epithelium Anatomy 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 229910052710 silicon Inorganic materials 0.000 description 1
- 239000010703 silicon Substances 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000009987 spinning Methods 0.000 description 1
- 238000010561 standard procedure Methods 0.000 description 1
- 239000000758 substrate Substances 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 238000000844 transformation Methods 0.000 description 1
- 238000002834 transmittance Methods 0.000 description 1
- 230000007723 transport mechanism Effects 0.000 description 1
- 229910052724 xenon Inorganic materials 0.000 description 1
- FHNFHKCVQCLJFQ-UHFFFAOYSA-N xenon atom Chemical compound [Xe] FHNFHKCVQCLJFQ-UHFFFAOYSA-N 0.000 description 1
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/02—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the way in which colour is displayed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3102—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM] using two-dimensional electronic spatial light modulators
- H04N9/3105—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM] using two-dimensional electronic spatial light modulators for displaying all colours simultaneously, e.g. by using two or more electronic spatial light modulators
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3141—Constructional details thereof
- H04N9/3147—Multi-projection systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3179—Video signal processing therefor
- H04N9/3182—Colour adjustment, e.g. white balance, shading or gamut
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2300/00—Aspects of the constitution of display devices
- G09G2300/04—Structural and physical details of display devices
- G09G2300/0439—Pixel structures
- G09G2300/0452—Details of colour pixel setup, e.g. pixel composed of a red, a blue and two green components
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2320/00—Control of display operating conditions
- G09G2320/02—Improving the quality of display appearance
- G09G2320/0242—Compensation of deficiencies in the appearance of colours
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2320/00—Control of display operating conditions
- G09G2320/06—Adjustment of display parameters
- G09G2320/0666—Adjustment of display parameters for control of colour parameters, e.g. colour temperature
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/06—Colour space transformation
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2360/00—Aspects of the architecture of display systems
- G09G2360/16—Calculation or use of calculated indices related to luminance levels in display data
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2370/00—Aspects of data communication
- G09G2370/10—Use of a protocol of communication by packets in interfaces along the display data pipeline
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2370/00—Aspects of data communication
- G09G2370/14—Use of low voltage differential signaling [LVDS] for display data communication
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/003—Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto
- G09G5/006—Details of the interface to the display terminal
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Processing Of Color Television Signals (AREA)
- Liquid Crystal (AREA)
- Controls And Circuits For Display Device (AREA)
- Luminescent Compositions (AREA)
- Image Processing (AREA)
Abstract
Systems and methods for a multi-primary color system for display. A multi-primary color system increases the number of primary colors available in a color system and color system equipment. Increasing the number of primary colors reduces metameric errors from viewer to viewer. One embodiment of the multi-primary color system includes Red, Green, Blue, Cyan, Yellow, and Magenta primaries. The systems of the present invention maintain compatibility with existing color systems and equipment and provide systems for backwards compatibility with older color systems.
Description
2 SYSTEM AND METHOD FOR A MULTI-PRIMARY WIDE GAMUT COLOR
SYSTEM
CROSS REFERENCES TO RELATED APPLICATIONS
[0001] This application relates to and claims priority from the following applications.
This application claims priority from U.S. Application No. 16/860,769, filed April 28, 2020, U.S. Application No. 16/887,807, filed May 29, 2020, U.S. Application No.
17/009,408, filed September 1, 2020, U.S. Application No. 17/060,959, filed October 1, 2020, and U.S.
Application No. 17/180,441, filed February 19, 2021, each of which is incorporated herein by reference.
[0002] U.S. Application No. 16/860,769 is a continuation-in-part of U.S.
Application No.
16/853,203, filed April 20, 2020, which is a continuation-in-part of U.S.
Patent Application No. 16/831,157, filed March 26, 2020, which is a continuation of U.S. Patent Application No.
16/659,307, filed October 21, 2019, now U.S. Patent No. 10,607,527, which is related to and claims priority from U.S. Provisional Patent Application No. 62/876,878, filed July 22, 2019, U.S. Provisional Patent Application No. 62/847,630, filed May 14, 2019, U.S.
Provisional Patent Application No. 62/805,705, filed February 14, 2019, and U.S.
Provisional Patent Application No. 62/750,673, filed October 25, 2018, each of which is incorporated herein by reference in its entirety.
SYSTEM
CROSS REFERENCES TO RELATED APPLICATIONS
[0001] This application relates to and claims priority from the following applications.
This application claims priority from U.S. Application No. 16/860,769, filed April 28, 2020, U.S. Application No. 16/887,807, filed May 29, 2020, U.S. Application No.
17/009,408, filed September 1, 2020, U.S. Application No. 17/060,959, filed October 1, 2020, and U.S.
Application No. 17/180,441, filed February 19, 2021, each of which is incorporated herein by reference.
[0002] U.S. Application No. 16/860,769 is a continuation-in-part of U.S.
Application No.
16/853,203, filed April 20, 2020, which is a continuation-in-part of U.S.
Patent Application No. 16/831,157, filed March 26, 2020, which is a continuation of U.S. Patent Application No.
16/659,307, filed October 21, 2019, now U.S. Patent No. 10,607,527, which is related to and claims priority from U.S. Provisional Patent Application No. 62/876,878, filed July 22, 2019, U.S. Provisional Patent Application No. 62/847,630, filed May 14, 2019, U.S.
Provisional Patent Application No. 62/805,705, filed February 14, 2019, and U.S.
Provisional Patent Application No. 62/750,673, filed October 25, 2018, each of which is incorporated herein by reference in its entirety.
[0003] U.S. Application No. 16/887,807 is a continuation-in-part of U.S.
Application No.
16/860,769, filed April 28, 2020, which is a continuation-in-part of U.S.
Application No.
16/853,203, filed April 20, 2020, which is a continuation-in-part of U.S.
Patent Application No. 16/831,157, filed March 26, 2020, which is a continuation of U.S. Patent Application No.
16/659,307, filed October 21, 2019, now U.S. Patent No. 10,607,527, which is related to and claims priority from U.S. Provisional Patent Application No. 62/876,878, filed July 22, 2019, U.S. Provisional Patent Application No. 62/847,630, filed May 14, 2019, U.S.
Provisional Patent Application No. 62/805,705, filed February 14, 2019, and U.S.
Provisional Patent Application No. 62/750,673, filed October 25, 2018, each of which is incorporated herein by reference in its entirety.
Application No.
16/860,769, filed April 28, 2020, which is a continuation-in-part of U.S.
Application No.
16/853,203, filed April 20, 2020, which is a continuation-in-part of U.S.
Patent Application No. 16/831,157, filed March 26, 2020, which is a continuation of U.S. Patent Application No.
16/659,307, filed October 21, 2019, now U.S. Patent No. 10,607,527, which is related to and claims priority from U.S. Provisional Patent Application No. 62/876,878, filed July 22, 2019, U.S. Provisional Patent Application No. 62/847,630, filed May 14, 2019, U.S.
Provisional Patent Application No. 62/805,705, filed February 14, 2019, and U.S.
Provisional Patent Application No. 62/750,673, filed October 25, 2018, each of which is incorporated herein by reference in its entirety.
[0004] U. S . Application No. 17/009,408 is a continuation-in-part of U.S.
Application No.
16/887,807, filed May 29, 2020, which is a continuation-in-part of U.S.
Application No.
16/860,769, filed April 28, 2020, which is a continuation-in-part of U.S.
Application No.
16/853,203, filed April 20, 2020, which is a continuation-in-part of U.S.
Patent Application No. 16/831,157, filed March 26, 2020, which is a continuation of U.S. Patent Application No.
16/659,307, filed October 21, 2019, now U.S. Patent No. 10,607,527, which is related to and claims priority from U.S. Provisional Patent Application No. 62/876,878, filed July 22, 2019, U.S. Provisional Patent Application No. 62/847,630, filed May 14, 2019, U.S.
Provisional Patent Application No. 62/805,705, filed February 14, 2019, and U.S.
Provisional Patent Application No. 62/750,673, filed October 25, 2018, each of which is incorporated herein by reference in its entirety.
Application No.
16/887,807, filed May 29, 2020, which is a continuation-in-part of U.S.
Application No.
16/860,769, filed April 28, 2020, which is a continuation-in-part of U.S.
Application No.
16/853,203, filed April 20, 2020, which is a continuation-in-part of U.S.
Patent Application No. 16/831,157, filed March 26, 2020, which is a continuation of U.S. Patent Application No.
16/659,307, filed October 21, 2019, now U.S. Patent No. 10,607,527, which is related to and claims priority from U.S. Provisional Patent Application No. 62/876,878, filed July 22, 2019, U.S. Provisional Patent Application No. 62/847,630, filed May 14, 2019, U.S.
Provisional Patent Application No. 62/805,705, filed February 14, 2019, and U.S.
Provisional Patent Application No. 62/750,673, filed October 25, 2018, each of which is incorporated herein by reference in its entirety.
[0005] U. S . Application No. 17/060,959 is a continuation-in-part of U.S.
Application No.
17/009,408, filed September 1, 2020, which is a continuation-in-part of U.S.
Application No.
16/887,807, filed May 29, 2020, which is a continuation-in-part of U.S.
Application No.
16/860,769, filed April 28, 2020, which is a continuation-in-part of U.S.
Application No.
16/853,203, filed April 20, 2020, which is a continuation-in-part of U.S.
Patent Application No. 16/831,157, filed March 26, 2020, which is a continuation of U.S. Patent Application No.
16/659,307, filed October 21, 2019, now U.S. Patent No. 10,607,527, which is related to and claims priority from U.S. Provisional Patent Application No. 62/876,878, filed July 22, 2019, U.S. Provisional Patent Application No. 62/847,630, filed May 14, 2019, U.S.
Provisional Patent Application No. 62/805,705, filed February 14, 2019, and U.S.
Provisional Patent Application No. 62/750,673, filed October 25, 2018, each of which is incorporated herein by reference in its entirety.
Application No.
17/009,408, filed September 1, 2020, which is a continuation-in-part of U.S.
Application No.
16/887,807, filed May 29, 2020, which is a continuation-in-part of U.S.
Application No.
16/860,769, filed April 28, 2020, which is a continuation-in-part of U.S.
Application No.
16/853,203, filed April 20, 2020, which is a continuation-in-part of U.S.
Patent Application No. 16/831,157, filed March 26, 2020, which is a continuation of U.S. Patent Application No.
16/659,307, filed October 21, 2019, now U.S. Patent No. 10,607,527, which is related to and claims priority from U.S. Provisional Patent Application No. 62/876,878, filed July 22, 2019, U.S. Provisional Patent Application No. 62/847,630, filed May 14, 2019, U.S.
Provisional Patent Application No. 62/805,705, filed February 14, 2019, and U.S.
Provisional Patent Application No. 62/750,673, filed October 25, 2018, each of which is incorporated herein by reference in its entirety.
[0006] U. S . Application No. 17/180,441 is a continuation-in-part of U.S.
Application No.
17/009,408, filed September 1, 2020, which is a continuation-in-part of U.S.
Application No.
16/887,807, filed May 29, 2020, which is a continuation-in-part of U.S.
Application No.
16/860,769, filed April 28, 2020, which is a continuation-in-part of U.S.
Application No.
16/853,203, filed April 20, 2020, which is a continuation-in-part of U.S.
Patent Application No. 16/831,157, filed March 26, 2020, which is a continuation of U.S. Patent Application No.
16/659,307, filed October 21, 2019, now U.S. Patent No. 10,607,527, which is related to and claims priority from U.S. Provisional Patent Application No. 62/876,878, filed July 22, 2019, U.S. Provisional Patent Application No. 62/847,630, filed May 14, 2019, U.S.
Provisional Patent Application No. 62/805,705, filed February 14, 2019, and U.S.
Provisional Patent Application No. 62/750,673, filed October 25, 2018, each of which is incorporated herein by reference in its entirety.
BACKGROUND OF THE INVENTION
Application No.
17/009,408, filed September 1, 2020, which is a continuation-in-part of U.S.
Application No.
16/887,807, filed May 29, 2020, which is a continuation-in-part of U.S.
Application No.
16/860,769, filed April 28, 2020, which is a continuation-in-part of U.S.
Application No.
16/853,203, filed April 20, 2020, which is a continuation-in-part of U.S.
Patent Application No. 16/831,157, filed March 26, 2020, which is a continuation of U.S. Patent Application No.
16/659,307, filed October 21, 2019, now U.S. Patent No. 10,607,527, which is related to and claims priority from U.S. Provisional Patent Application No. 62/876,878, filed July 22, 2019, U.S. Provisional Patent Application No. 62/847,630, filed May 14, 2019, U.S.
Provisional Patent Application No. 62/805,705, filed February 14, 2019, and U.S.
Provisional Patent Application No. 62/750,673, filed October 25, 2018, each of which is incorporated herein by reference in its entirety.
BACKGROUND OF THE INVENTION
[0007] 1. Field of the Invention
[0008] The present invention relates to color systems, and more specifically to a wide gamut color system with an increased number of primary colors.
[0009] 2. Description of the Prior Art
[0010] It is generally known in the prior art to provide for an increased color gamut system within a display.
[0011] Prior art patent documents include the following:
[0012] U. S . Patent No. 10,222,263 for RGB value calculation device by inventor Yasuyuki Shigezane, filed February 6, 2017 and issued March 5, 2019, is directed to a microcomputer that equally divides the circumference of an RGB circle into 6xn (n is an integer of 1 or more) parts, and calculates an RGB value of each divided color. (255, 0, 0) is stored as a reference RGB value of a reference color in a ROM in the microcomputer. The microcomputer converts the reference RGB value depending on an angular difference of the RGB circle between a designated color whose RGB value is to be found and the reference color, and assumes the converted RGB value as an RGB value of the designated color.
[0013] U. S . Patent No. 9,373,305 for Semiconductor device, image processing system and program by inventor Hiorfumi Kawaguchi, filed May 29, 2015 and issued June 21, 2016, is directed to an image process device including a display panel operable to provide an input interface for receiving an input of an adjustment value of at least a part of color attributes of each vertex of n axes (n is an integer equal to or greater than 3) serving as adjustment axes in an RGB color space, and an adjustment data generation unit operable to calculate the degree of influence indicative of a following index of each of the n-axis vertices, for each of the n axes, on a basis of distance between each of the n-axis vertices and a target point which is an arbitrary lattice point in the RGB color space, and operable to calculate adjusted coordinates of the target point in the RGB color space.
[0014] U. S . Publication No. 20130278993 for Color-mixing bi-primary color systems for displays by inventor Heikenfeld, et.al, filed September 1, 2011 and published October 24, 2013, is directed to a display pixel. The pixel includes first and second substrates arranged to define a channel. A fluid is located within the channel and includes a first colorant and a second colorant. The first colorant has a first charge and a color. The second colorant has a second charge that is opposite in polarity to the first charge and a color that is complimentary to the color of the first colorant. A first electrode, with a voltage source, is operably coupled to the fluid and configured to moving one or both of the first and second colorants within the fluid and alter at least one spectral property of the pixel.
[0015] U. S . Patent No. 8,599,226 for Device and method of data conversion for wide gamut displays by inventor Ben-Chorin, et. al, filed February 13, 2012 and issued December 3, 2013, is directed to a method and system for converting color image data from a, for example, three-dimensional color space format to a format usable by an n-primary display, wherein n is greater than or equal to 3. The system may define a two-dimensional sub-space having a plurality of two-dimensional positions, each position representing a set of n primary color values and a third, scaleable coordinate value for generating an n-primary display input signal. Furthermore, the system may receive a three-dimensional color space input signal including out-of range pixel data not reproducible by a three-primary additive display, and may convert the data to side gamut color image pixel data suitable for driving the wide gamut color display.
[0016] U. S . Patent No. 8,081,835 for Multiprimary color sub-pixel rendering with metameric filtering by inventor Elliot, et. al, filed July 13, 2010 and issued December 20, 2011, is directed to systems and methods of rendering image data to multiprimary displays that adjusts image data across metamers as herein disclosed. The metamer filtering may be based upon input image content and may optimize sub-pixel values to improve image rendering accuracy or perception. The optimizations may be made according to many possible desired effects. One embodiment comprises a display system comprising: a display, said display capable of selecting from a set of image data values, said set comprising at least one metamer; an input image data unit; a spatial frequency detection unit, said spatial frequency detection unit extracting a spatial frequency characteristic from said input image data; and a selection unit, said unit selecting image data from said metamer according to said spatial frequency characteristic.
[0017] U. S . Patent No. 7,916,939 for High brightness wide gamut display by inventor Roth, et. al, filed November 30, 2009 and issued March 29, 2011, is directed to a device to produce a color image, the device including a color filtering arrangement to produce at least four colors, each color produced by a filter on a color filtering mechanism having a relative segment size, wherein the relative segment sizes of at least two of the primary colors differ.
[0018] U. S . Patent No. 6,769,772 for Six color display apparatus having increased color gamut by inventor Roddy, et. al, filed October 11, 2002 and issued August 3, 2004, is directed to a display system for digital color images using six color light sources or two or more multicolor LED arrays or OLEDs to provide an expanded color gamut.
Apparatus uses two or more spatial light modulators, which may be cycled between two or more color light sources or LED arrays to provide a six-color display output. Pairing of modulated colors using relative luminance helps to minimize flicker effects.
SUMMARY OF THE INVENTION
Apparatus uses two or more spatial light modulators, which may be cycled between two or more color light sources or LED arrays to provide a six-color display output. Pairing of modulated colors using relative luminance helps to minimize flicker effects.
SUMMARY OF THE INVENTION
[0019] It is an object of this invention to provide an enhancement to the current RGB
systems or a replacement for them.
systems or a replacement for them.
[0020] In one embodiment, the present invention provides system for displaying a primary color system including a set of image data, an image data converter, a set of Session Description Protocol (SDP) parameters, and at least one display device, wherein the set of image data includes primary color data for at least four primary color values, wherein the at least one display device and the image data converter are in network communication, and wherein the image data converter is operable to convert the set of image data for display on the at least one display device.
[0021] In another embodiment, the present invention provides a system for displaying a primary color system including a set of image data, an image data converter, wherein the image data converter includes a digital interface, wherein the digital interface is operable to encode and decode the set of image data, a set of Session Description Protocol (SDP) parameters, and at least one display device, wherein the set of image data further includes primary color data for at least four primary color values, wherein the at least four primary color values include a cyan primary, wherein the at least one display device and the image
22 data converter are in network communication, and wherein the image data converter is operable to convert the set of image data for display on the at least one display device.
[0022] In yet another embodiment, the present invention provides a system for displaying a primary color system including a set of image data, an image data converter, wherein the image data converter includes a digital interface, wherein the digital interface is operable to encode and decode the set of image data, a set of Session Description Protocol (SDP) parameters, and at least one display device, wherein the set of image data further includes primary color data for at least four primary color values, wherein the at least four primary color values include at least one white emitter, wherein the at least one display device and the image data converter are in network communication, and wherein the image data converter is operable to convert the set of image data for display on the at least one display device.
[0022] In yet another embodiment, the present invention provides a system for displaying a primary color system including a set of image data, an image data converter, wherein the image data converter includes a digital interface, wherein the digital interface is operable to encode and decode the set of image data, a set of Session Description Protocol (SDP) parameters, and at least one display device, wherein the set of image data further includes primary color data for at least four primary color values, wherein the at least four primary color values include at least one white emitter, wherein the at least one display device and the image data converter are in network communication, and wherein the image data converter is operable to convert the set of image data for display on the at least one display device.
[0023] In still another embodiment, the present invention provides a method for displaying a multi-primary color system including providing a set of image data, encoding the set of image data using a digital interface of an image data converter, wherein the image data converter is in network communication with at least one display device, decoding the set of image data using the digital interface of the image data converter, and converting the set of image data for display on the at least one display device.
[0024] These and other aspects of the present invention will become apparent to those skilled in the art after a reading of the following description of the preferred embodiment when considered with the drawings, as they support the claimed invention.
BRIEF DESCRIPTION OF THE DRAWINGS
BRIEF DESCRIPTION OF THE DRAWINGS
[0025] The patent or application file contains at least one drawing executed in color.
Copies of this patent or patent application publication with color drawing(s) will be provided by the Office upon request and payment of the necessary fee.
Copies of this patent or patent application publication with color drawing(s) will be provided by the Office upon request and payment of the necessary fee.
[0026] FIG. 1 illustrates one embodiment of a four primary system including a red primary, a green primary, a cyan primary, and a blue primary.
[0027] FIG. 2 illustrates one embodiment of a four primary system including a red primary, a first green primary, a second green primary, and a blue primary.
[0028] FIG. 3 illustrates another embodiment of a four primary system including a red primary, a first green primary, a second green primary, and a blue primary.
[0029] FIG. 4 illustrates one embodiment of a five primary system including a red primary, a green primary, a cyan primary, a blue primary, and a white emitter.
[0030] FIG. 5 illustrates one embodiment of a five primary system including a red primary, a first green primary, a second green primary, a blue primary, and a white emitter.
[0031] FIG. 6 illustrates another embodiment of a five primary system including a red primary, a first green primary, a second green primary, a blue primary, and a white emitter.
[0032] FIG. 7 illustrates another embodiment of a five primary system including a red primary, a first green primary, a second green primary, a blue primary, and a white emitter.
[0033] FIG. 8 illustrates one embodiment of a six primary system including a red primary, a green primary, a blue primary, a cyan primary, a magenta primary, and a yellow primary ("6P-B") compared to ITU-R BT.709-6.
[0034] FIG. 9 illustrates another embodiment of a six primary system including a red primary, a green primary, a blue primary, a cyan primary, a magenta primary, and a yellow primary ("6P-C") compared to SMPTE RP431-2 for a D60 white point.
[0035] FIG. 10 illustrates yet another embodiment of a six primary system including a red primary, a green primary, a blue primary, a cyan primary, a magenta primary, and a yellow primary ("6P-C") compared to SMPTE RP431-2 for a D65 white point.
[0036] FIG. 11 illustrates Super 6Pa compared to 6P-C.
[0037] FIG. 12 illustrates Super 6Pb compared to Super 6Pa and 6P-C.
[0038] FIG. 13 illustrates one embodiment of a six primary system including a red primary, a yellow primary, a green primary, a cyan primary, a blue primary, and a white emitter.
[0039] FIG. 14 illustrates one embodiment of a six primary system including a red primary, a first green primary, a second green primary, a blue primary, a first white emitter, and a second white emitter.
[0040] FIG. 15A illustrates one embodiment of a six primary system including a a red primary, a green primary, a blue primary, a first white emitter, a second white emitter, and a third white emitter.
[0041] FIG. 15B illustrates an example of the emission spectra of a six primary system including a red primary, a green primary, a blue primary, a first white emitter, a second white emitter, and a third white emitter.
[0042] FIG. 15C illustrates an example of the emission spectra of a six primary system including a first red primary, a second red primary, a first green primary, a second green primary, a first blue primary, and a second blue primary.
[0043] FIG. 16 illustrates an embodiment of an encode and decode system for a multi-primary color system.
[0044] FIG. 17 illustrates a sequential method where three color primaries are passed to the transport format as full bit level image data and inserted as normal ("System 2").
[0045] FIG. 18 illustrates one embodiment of a system encode and decode process using a dual link method ("System 3").
[0046] FIG. 19 illustrates one embodiment of an encoding process using a dual link method.
[0047] FIG. 20 illustrates one embodiment of a decoding process using a dual link method.
[0048] FIG. 21 illustrates one embodiment of a six-primary color system encode using a 4:4:4 sampling method.
[0049] FIG. 22 illustrates one embodiment for a method to package six channels of primary information into the three standard primary channels used in current serial video standards by modifying bit numbers for a 12-bit SDI and a 10-bit SDI.
[0050] FIG. 23 illustrates a simplified diagram estimating perceived viewer sensation as code values define each hue angle.
[0051] FIG. 24 illustrates one embodiment for a method of stacking/encoding six-primary color information using a 4:4:4 video system.
[0052] FIG. 25 illustrates one embodiment for a method of unstacking/decoding six-primary color information using a 4:4:4 video system.
[0053] FIG. 26 illustrates one embodiment of a 4:4:4 decoder for a six-primary color system.
[0054] FIG. 27 illustrates one embodiment of an optical filter.
[0055] FIG. 28 illustrates another embodiment of an optical filter.
[0056] FIG. 29 illustrates an embodiment of the present invention for sending six primary colors to a standardized transport format.
[0057] FIG. 30 illustrates one embodiment of a decode process adding a pixel delay to the RGB data for realigning the channels to a common pixel timing.
[0058] FIG. 31 illustrates one embodiment of an encode process for 4:2:2 video for packaging five channels of information into the standard three-channel designs.
[0059] FIG. 32 illustrates one embodiment for a non-constant luminance encode for a six-primary color system.
[0060] FIG. 33 illustrates one embodiment of a packaging process for a six-primary color system.
[0061] FIG. 34 illustrates a 4:2:2 unstack process for a six-primary color system.
[0062] FIG. 35 illustrates one embodiment of a process to inversely quantize each individual color and pass the data through an electronic optical function transfer (EOTF) in a non-constant luminance system.
[0063] FIG. 36 illustrates one embodiment of a constant luminance encode for a six-primary color system.
[0064] FIG. 37 illustrates one embodiment of a constant luminance decode for a six-primary color system.
[0065] FIG. 38 illustrates one example of 4:2:2 non-constant luminance encoding.
[0066] FIG. 39 illustrates one embodiment of a non-constant luminance decoding system.
[0067] FIG. 40 illustrates one embodiment of a 4:2:2 constant luminance encoding system.
[0068] FIG. 41 illustrates one embodiment of a 4:2:2 constant luminance decoding system.
[0069] FIG. 42 illustrates a raster encoding diagram of sample placements for a six-primary color system.
[0070] FIG. 43 illustrates one embodiment of the six-primary color unstack process in a 4:2:2 video system.
[0071] FIG. 44 illustrates one embodiment of mapping input to the six-primary color system unstack process.
[0072] FIG. 45 illustrates one embodiment of mapping the output of a six-primary color system decoder.
[0073] FIG. 46 illustrates one embodiment of mapping the RGB decode for a six-primary color system.
[0074] FIG. 47 illustrates one embodiment of an unstack system for a six-primary color system.
[0075] FIG. 48 illustrates one embodiment of a legacy RGB decoder for a six-primary, non-constant luminance system.
[0076] FIG. 49 illustrates one embodiment of a legacy RGB decoder for a six-primary, constant luminance system.
[0077] FIG. 50 illustrates one embodiment of a six-primary color system with output to a legacy RGB system.
[0078] FIG. 51 illustrates one embodiment of six-primary color output using a non-constant luminance decoder.
[0079] FIG. 52 illustrates one embodiment of a legacy RGB process within a six-primary color system.
[0080] FIG. 53 illustrates one embodiment of packing six-primary color system image data into an /CTCp (ITP) format.
[0081] FIG. 54 illustrates one embodiment of a six-primary color system converting RGBCYM image data into XYZ image data for an ITP format.
[0082] FIG. 55 illustrates one embodiment of six-primary color mapping with SMPTE
ST424.
ST424.
[0083] FIG. 56 illustrates one embodiment of a six-primary color system readout for a SMPTE ST424 standard.
[0084] FIG. 57 illustrates a process of 2160p transport over 12G-SDI.
[0085] FIG. 58 illustrates one embodiment for mapping RGBCYM data to the SMPTE
ST2082 standard for a six-primary color system.
ST2082 standard for a six-primary color system.
[0086] FIG. 59 illustrates one embodiment for mapping YRGB YCYM CR CB CC Cy data to the SMPTE ST2082 standard for a six-primary color system.
[0087] FIG. 60 illustrates one embodiment for mapping six-primary color system data using the SMPTE ST292 standard.
[0088] FIG. 61 illustrates one embodiment of the readout for a six-primary color system using the SMPTE ST292 standard.
[0089] FIG. 62 illustrates modifications to the SMPTE ST352 standards for a six-primary color system.
[0090] FIG. 63 illustrates modifications to the SMPTE ST2022 standard for a six-primary color system.
[0091] FIG. 64 illustrates a table of 4:4:4 sampling for a six-primary color system for a 10-bit video system.
[0092] FIG. 65 illustrates a table of 4:4:4 sampling for a six-primary color system for a 12-bit video system.
[0093] FIG. 66 illustrates sequence substitutions for 10-bit and 12-bit video in 4:2:2 sampling systems in a Y Cb Cr Cc Cy color space.
[0094] FIG. 67 illustrates sample placements of six-primary system components for a 4:2:2 sampling system image.
[0095] FIG. 68 illustrates sequence substitutions for 10-bit and 12-bit video in 4:2:0 sampling systems using a Y Cb Cr Cc Cy color space.
[0096] FIG. 69 illustrates sample placements of six-primary system components for a 4:2:0 sampling system image.
[0097] FIG. 70 illustrates modifications to SMPTE ST2110-20 for a 10-bit six-primary color system in 4:4:4 video.
[0098] FIG. 71 illustrates modifications to SMPTE ST2110-20 for a 12-bit six-primary color system in 4:4:4 video.
[0099] FIG. 72 illustrates modifications to SMPTE ST2110-20 for a 10-bit six primary color system in 4:2:2 video.
[00100] FIG. 73 illustrates modifications to SMPTE ST2110-20 for a 12-bit six-primary color system in 4:2:0 video.
[00101] FIG. 74 illustrates an RGB sampling transmission for a 4:4:4 sampling system.
[00102] FIG. 75 illustrates a RGBCYM sampling transmission for a 4:4:4 sampling system.
[00103] FIG. 76 illustrates an example of System 2 to RGBCYM 4:4:4 transmission.
[00104] FIG. 77 illustrates a Y Cb Cr sampling transmission using a 4:2:2 sampling system.
[00105] FIG. 78 illustrates a Y Cr Cb Cc Cy sampling transmission using a 4:2:2 sampling system.
[00106] FIG. 79 illustrates an example of a System 2 to Y Cr Cb Cc Cy 4:2:2 Transmission as non-constant luminance.
[00107] FIG. 80 illustrates a Y Cb Cr sampling transmission using a 4:2:0 sampling system.
[00108] FIG. 81 illustrates a Y Cr Cb Cc Cy sampling transmission using a 4:2:0 sampling system.
[00109] FIG. 82 illustrates a dual stack LCD projection system for a six-primary color system.
[00110] FIG. 83 illustrates one embodiment of a single projector.
[00111] FIG. 84 illustrates a six-primary color system using a single projector and reciprocal mirrors.
[00112] FIG. 85 illustrates a dual stack DMD projection system for a six-primary color system.
[00113] FIG. 86 illustrates one embodiment of a single DMD projector solution.
[00114] FIG. 87 illustrates one embodiment of a color filter array for a six-primary color system with a white OLED monitor.
[00115] FIG. 88 illustrates one embodiment of an optical filter array for a six-primary color system with a white OLED monitor.
[00116] FIG. 89 illustrates one embodiment of a matrix of an LCD drive for a six-primary color system with a backlight illuminated LCD monitor.
[00117] FIG. 90 illustrates one embodiment of an optical filter array for a six-primary color system with a backlight illuminated LCD monitor.
[00118] FIG. 91 illustrates an array for a Quantum Dot (QD) display device.
[00119] FIG. 92 illustrates one embodiment of an array for a six-primary color system for use with a direct emissive assembled display.
[00120] FIG. 93 illustrates one embodiment of a six-primary color system in an emissive display that does not incorporate color filtered subpixels.
[00121] FIG. 94 illustrates one embodiment of a primary triad system for a multi-primary system including red, green, blue, cyan, magenta, and yellow primaries.
[00122] FIG. 95 illustrates one embodiment of out-of-gamut color mapping.
[00123] FIG. 96 illustrates another embodiment of out-of-gamut color mapping.
[00124] FIG. 97 illustrates a process to validate the ACES-to-6P-to-ACES
conversion process according to one embodiment of the present invention.
conversion process according to one embodiment of the present invention.
[00125] FIG. 98 illustrates one embodiment of a system with at least eight primary triads.
[00126] FIG. 99 illustrates a flow chart of an embodiment of a system with eight triads in a six-primary system.
[00127] FIG. 100 illustrates one embodiment of a system with primary triads including a virtual primary.
[00128] FIG. 101 is a schematic diagram of an embodiment of the invention illustrating a computer system.
DETAILED DESCRIPTION
DETAILED DESCRIPTION
[00129] The present invention is generally directed to a multi-primary color system.
[00130] In one embodiment, the present invention provides system for displaying a primary color system including a set of image data, an image data converter, a set of Session Description Protocol (SDP) parameters, and at least one display device, wherein the set of image data includes primary color data for at least four primary color values, wherein the at least one display device and the image data converter are in network communication, and wherein the image data converter is operable to convert the set of image data for display on the at least one display device. In one embodiment, the at least one display device is operable to display the primary color system based on the set of image data, wherein the primary color system displayed on the at least one display device is based on the set of image data. In one embodiment, the at least four primary color values include at least one white emitter. In one embodiment, the at least four primary color values include a red primary, a green primary, a cyan primary, and a blue primary. In one embodiment, the at least four primary color values include a red primary, a first green primary, a second green primary, and a blue primary, wherein the first green primary and the second green primary have different chromaticity values. In one embodiment, the at least four primary color values include a red primary, a green primary, a cyan primary, a blue primary, and a white emitter. In one embodiment, the at least four primary color values include a red primary, a yellow primary, a green primary, a cyan primary, and a blue primary. In one embodiment, the at least four primary color values include a red primary, a first green primary, a second green primary, a blue primary, and a white emitter, wherein the first green primary and the second green primary have different chromaticity values. In one embodiment, the at least four primary color values include a red primary, a green primary, a blue primary, a cyan primary, a magenta primary, and a yellow primary. In one embodiment, the at least four primary color values include a red primary, a yellow primary, a green primary, a cyan primary, a blue primary, and a white emitter. In one embodiment, the at least four primaries include a red primary, a first green primary, a second green primary, a blue primary, a first white emitter, and a second white emitter, wherein the first green primary and the second green primary have different chromaticity values, and wherein the first white emitter and the second white emitter have different color temperatures. In one embodiment, the at least four primary color values include a first red primary, a second red primary, a first green primary, a second green primary, a first blue primary, and a second blue primary, wherein the first red primary, the first green primary, and the first blue primary are narrow band primaries, and wherein the second red primary, the second green primary, and the second blue primary are wide band primaries. In one embodiment, the system further includes a set of saturation data corresponding to the set of image data, wherein the set of image data includes a first set of color channel data and a second set of color channel data, and wherein the set of saturation data is used to extend a set of hue angles for the first set of color channel data and the second set of color channel data.
In one embodiment, the set of image data includes a first set of color channel data and a second set of color channel data, wherein the image data converter further includes a first link component and a second link component, wherein the first link component is operable to transport the first set of color channel data to the at least one display device, and wherein the second link component is operable to transport the second set of color channel data to the at least one display device in parallel with the first link component.
In one embodiment, the set of image data includes a first set of color channel data and a second set of color channel data, wherein the image data converter further includes a first link component and a second link component, wherein the first link component is operable to transport the first set of color channel data to the at least one display device, and wherein the second link component is operable to transport the second set of color channel data to the at least one display device in parallel with the first link component.
[00131] In another embodiment, the present invention provides a system for displaying a primary color system including a set of image data, an image data converter, wherein the image data converter includes a digital interface, wherein the digital interface is operable to encode and decode the set of image data, a set of Session Description Protocol (SDP) parameters, and at least one display device, wherein the set of image data further includes primary color data for at least four primary color values, wherein the at least four primary color values include a cyan primary, wherein the at least one display device and the image data converter are in network communication, and wherein the image data converter is operable to convert the set of image data for display on the at least one display device. In one embodiment, the cyan primary is positioned to limit maximum saturation. In one embodiment, the cyan primary is positioned by expanding a set of hue angles for the at least four primaries.
[00132] In yet another embodiment, the present invention provides a system for displaying a primary color system including a set of image data, an image data converter, wherein the image data converter includes a digital interface, wherein the digital interface is operable to encode and decode the set of image data, a set of Session Description Protocol (SDP) parameters, and at least one display device, wherein the set of image data further includes primary color data for at least four primary color values, wherein the at least four primary color values include at least one white emitter, wherein the at least one display device and the image data converter are in network communication, and wherein the image data converter is operable to convert the set of image data for display on the at least one display device. In one embodiment, the at least one white emitter includes at least three white emitters, wherein the at least three white emitters each have a different color temperature, and wherein the at least three white emitters include a mid-Kelvin white emitter. In one embodiment, the mid-Kelvin white emitter includes a green bias.
[00133] In still another embodiment, the present invention provides a method for displaying a multi-primary color system including providing a set of image data, encoding the set of image data using a digital interface of an image data converter, wherein the image data converter is in network communication with at least one display device, decoding the set of image data using the digital interface of the image data converter, and converting the set of image data for display on the at least one display device. In one embodiment, the method includes modifying a set of Session Description Protocol (SDP) parameters based on the conversion. In one embodiment, the method includes processing the set of image data using at least one transfer function (TF). In one embodiment, the method includes the image data converter converting a bit level of the set of image data, thereby creating an updated bit level.
In one embodiment, the method includes displaying the multi-primary system on the at least one display device based on the set of image data.
In one embodiment, the method includes displaying the multi-primary system on the at least one display device based on the set of image data.
[00134] The present invention relates to color systems. A multitude of color systems are known, but they continue to suffer numerous issues. As imaging technology is moving forward, there has been a significant interest in expanding the range of colors that are replicated on electronic displays. Enhancements to the television system have expanded from the early CCIR 601 standard to ITU-R BT.709-6, to SMPTE RP431-2, and ITU-R
BT.2020.
Each one has increased the gamut of visible colors by expanding the distance from the reference white point to the position of the Red (R), Green (G), and Blue (B) color primaries (collectively known as "RGB") in chromaticity space. While this approach works, it has several disadvantages. When implemented in content presentation, issues arise due to the technical methods used to expand the gamut of colors seen (typically using a more-narrow emissive spectrum) can result in increased viewer metameric errors and require increased power due to lower illumination source. These issues increase both capital and operational costs.
BT.2020.
Each one has increased the gamut of visible colors by expanding the distance from the reference white point to the position of the Red (R), Green (G), and Blue (B) color primaries (collectively known as "RGB") in chromaticity space. While this approach works, it has several disadvantages. When implemented in content presentation, issues arise due to the technical methods used to expand the gamut of colors seen (typically using a more-narrow emissive spectrum) can result in increased viewer metameric errors and require increased power due to lower illumination source. These issues increase both capital and operational costs.
[00135] With the current available technologies, displays are limited in respect to their range of color and light output. There are many misconceptions regarding how viewers interpret the display output technically versus real-world sensations viewed with the human eye. The reason we see more than just the three emitting primary colors is because the eye combines the spectral wavelengths incident on it into the three bands. Humans interpret the radiant energy (spectrum and amplitude) from a display and process it so that an individual color is perceived. The display does not emit a color or a specific wavelength that directly relates to the sensation of color. It simply radiates energy at the same spectrum which humans sense as light and color. It is the observer who interprets this energy as color.
[00136] When the CIE 2 standard observer was established in 1931, common understanding of color sensation was that the eye used red, blue, and green cone receptors (James Maxwell & James Forbes 1855). Later with the Munsell vision model (Munsell 1915), Munsell described the vision system to include three separate components: luminance, hue, and saturation. Using RGB emitters or filters, these three primary colors are the components used to produce images on today's modern electronic displays.
[00137] There are three primary physical variables that affect sensation of color. These are the spectral distribution of radiant energy as it is absorbed into the retina, the sensitivity of the eye in relation to the intensity of light landing on the retinal pigment epithelium, and the distribution of cones within the retina. The distribution of cones (e.g., L
cones, M cones, and S cones) varies considerably from person to person.
cones, M cones, and S cones) varies considerably from person to person.
[00138] Enhancements in brightness have been accomplished through larger backlights or higher efficiency phosphors. Encoding of higher dynamic ranges is addressed using higher range, more perceptually uniform electro-optical transfer functions to support these enhancements to brightness technology, while wider color gamuts are produced by using narrow bandwidth emissions. Narrower bandwidth emitters result in the viewer experiencing higher color saturation. But there can be a disconnect between how saturation is produced and how it is controlled. What is believed to occur when changing saturation is that increasing color values of a color primary represents an increase to saturation. This is not true, as changing saturation requires the variance of a color primary spectral output as parametric. There are no variable spectrum displays available to date as the technology to do so has not been commercially developed, nor has the new infrastructure required to support this been discussed.
[00139] Instead, the method that a display changes for viewer color sensation is by changing color luminance. As data values increase, the color primary gets brighter. Changes to color saturation are accomplished by varying the brightness of all three primaries and taking advantage of the dominant color theory.
[00140] Expanding color primaries beyond RGB has been discussed before. There have been numerous designs of multi-primary displays. For example, SHARP has attempted this with their four-color QUATTRON TV systems by adding a yellow color primary and developing an algorithm to drive it. Another four primary color display was proposed by Matthew Brennesholtz which included an additional cyan primary, and a six primary display was described by Yan Xiong, Fei Deng, Shan Xu, and Sufang Gao of the School of Physics and Optoelectric Engineering at the Yangtze University Jingzhou China. In addition, AU
OPTRONICS has developed a five primary display technology. SONY has also recently disclosed a camera design featuring RGBCMY (red, green, blue, cyan, magenta, and yellow) and RGBCMYW (red, green, blue cyan, magenta, yellow, and white) sensors.
OPTRONICS has developed a five primary display technology. SONY has also recently disclosed a camera design featuring RGBCMY (red, green, blue, cyan, magenta, and yellow) and RGBCMYW (red, green, blue cyan, magenta, yellow, and white) sensors.
[00141] Actual working displays have been shown publicly as far back as the late 1990's, including samples from Tokyo Polytechnic University, Nagoya City University, and Genoa Technologies. However, all of these systems are exclusive to their displays, and any additional color primary information is limited to the display's internal processing.
[00142] Additionally, the Visual Arts System for Archiving and Retrieval of Images (VASARI) project developed a colorimetric scanner system for direct digital imaging of paintings. The system provides more accurate coloring than conventional film, allowing it to replace film photography. Despite the project beginning in 1989, technical developments have continued. Additional information is available at https://www. south ampton. ac uki¨km2/prol sly as an: (last accessed March 30, 2020), which is incorporated herein by reference in its entirety.
[00143] None of the prior art discloses developing additional color primary information outside of the display. Moreover, the system driving the display is often proprietary to the demonstration. In each of these executions, nothing in the workflow is included to acquire or generate additional color primary information. The development of a multi-primary color system is not complete if the only part of the system that supports the added primaries is within the display itself
[00144] Referring now to the drawings in general, the illustrations are for the purpose of describing one or more preferred embodiments of the invention and are not intended to limit the invention thereto.
[00145] Additional details about multi-primary systems are available in U.S.
Patent No.
10,607,527 and U.S. Publication No. 20200251039, each of which is incorporated herein by reference in its entirety.
Patent No.
10,607,527 and U.S. Publication No. 20200251039, each of which is incorporated herein by reference in its entirety.
[00146] The multi-primary system of the present invention includes at least four primaries.
The at least four primaries preferably include at least one red primary, at least one green primary, and/or at least one blue primary. In one embodiment, the at least four primaries include a cyan primary, a magenta primary, and/or a yellow primary.
The at least four primaries preferably include at least one red primary, at least one green primary, and/or at least one blue primary. In one embodiment, the at least four primaries include a cyan primary, a magenta primary, and/or a yellow primary.
[00147] In one embodiment, the at least four primaries include at least one white emitter.
In one embodiment, the at least one white emitter includes a D65 white emitter, a D60 white emitter, a D45 white emitter, a D27 white emitter, and/or a D25 white emitter.
Advantageously, using a D65 white emitter eliminates most of the problems with metamerism. In a preferred embodiment, the at least one white emitter is a single white emitter that matches the white point (e.g., a D65 white emitter for a D65 white point). In another embodiment, the at least one white emitter is at least two white emitters. The at least two white emitters are preferably separated such that a linear combination of the at least two white emitters covers a desired white Kelvin range. In one embodiment, the at least two white emitters include a D65 white emitter and a D27 white emitter. In another embodiment, the at least two white emitters include a D65 white emitter and a D25 white emitter.
In one embodiment, the at least one white emitter includes a D65 white emitter, a D60 white emitter, a D45 white emitter, a D27 white emitter, and/or a D25 white emitter.
Advantageously, using a D65 white emitter eliminates most of the problems with metamerism. In a preferred embodiment, the at least one white emitter is a single white emitter that matches the white point (e.g., a D65 white emitter for a D65 white point). In another embodiment, the at least one white emitter is at least two white emitters. The at least two white emitters are preferably separated such that a linear combination of the at least two white emitters covers a desired white Kelvin range. In one embodiment, the at least two white emitters include a D65 white emitter and a D27 white emitter. In another embodiment, the at least two white emitters include a D65 white emitter and a D25 white emitter.
[00148] In yet another embodiment, the at least two white emitters include three white emitters. In one embodiment, the three white emitters include a D65 white emitter, a D45 white emitter, and a D27 white emitter. Alternatively, the three white emitters include a D65 white emitter, a mid-Kelvin white emitter (e.g., D45), and a D27 white emitter. In a preferred embodiment, the mid-Kelvin white emitter includes a green bias.
Advantageously, the green bias compensates for the slight magenta shift (e.g., when going from D25 to D65 with the straight line between the two points below the blackbody locus). Colors near the white locus and beyond are then a combination of the at least two white emitters (e.g., two white emitters, three white emitters). A majority of colors will have a white component that is broad band.
Therefore, the resultant spectra of a mixture of color primaries and white primaries will also be broad band with an extent dependent on an amount of the at least one white primary. A
higher broad band character of light results in fewer metameric problems. This is due to a white point being comprised of a combination of color primaries (e.g., RGB, CMY, RGBC, RGBCMY, etc.) in a non-white emitter system. Total luminance is then related to intensities of the color primaries (e.g., RGB, CMY, RGBC, RGBCMY, etc.).
Advantageously, the green bias compensates for the slight magenta shift (e.g., when going from D25 to D65 with the straight line between the two points below the blackbody locus). Colors near the white locus and beyond are then a combination of the at least two white emitters (e.g., two white emitters, three white emitters). A majority of colors will have a white component that is broad band.
Therefore, the resultant spectra of a mixture of color primaries and white primaries will also be broad band with an extent dependent on an amount of the at least one white primary. A
higher broad band character of light results in fewer metameric problems. This is due to a white point being comprised of a combination of color primaries (e.g., RGB, CMY, RGBC, RGBCMY, etc.) in a non-white emitter system. Total luminance is then related to intensities of the color primaries (e.g., RGB, CMY, RGBC, RGBCMY, etc.).
[00149] Advantageously, if at least one white emitter is included, increased luminance can be achieved separate from the color primaries. Additionally, colors such as vibrantly colored pastels are attained by using the color primaries to "color shift" a bright white to the pastel.
Alternatively, a fine balance of the color primaries is required, and small changes in a ratio of the color primaries will produce an unwanted color shift. Thus, a system with at least one white emitter is more tolerant to minor variations of intensity of the color primaries.
Alternatively, a fine balance of the color primaries is required, and small changes in a ratio of the color primaries will produce an unwanted color shift. Thus, a system with at least one white emitter is more tolerant to minor variations of intensity of the color primaries.
[00150] 4 PRIMARY SYSTEMS
[00151] In one embodiment, the multi-primary system includes four primaries.
In one embodiment, the four primaries include a red primary, a green primary, a cyan primary, and a blue primary. In one embodiment, the red primary has a dominant wavelength of 615nm, the green primary has a dominant wavelength of 545nm, the cyan primary has a dominant wavelength of 493nm, and the blue primary has a dominant wavelength of 465nm as shown in Table 1. In one embodiment, the dominant wavelength is approximately (e.g., within 10%) the value listed in the table below. Alternatively, the dominant wavelength is within 5% of the value listed in the table below. In yet another embodiment, the dominant wavelength is within 2% of the value listed in the table below.
In one embodiment, the four primaries include a red primary, a green primary, a cyan primary, and a blue primary. In one embodiment, the red primary has a dominant wavelength of 615nm, the green primary has a dominant wavelength of 545nm, the cyan primary has a dominant wavelength of 493nm, and the blue primary has a dominant wavelength of 465nm as shown in Table 1. In one embodiment, the dominant wavelength is approximately (e.g., within 10%) the value listed in the table below. Alternatively, the dominant wavelength is within 5% of the value listed in the table below. In yet another embodiment, the dominant wavelength is within 2% of the value listed in the table below.
[00152] TABLE 1 u' v' R 0.680 0.320 0.496 0.526 615nm G 0.265 0.690 0.099 0.578 545nm C 0.163 0.342 0.096 0.454 493nm B 0.150 0.060 0.175 0.158 465nm
[00153] FIG. 1 illustrates one embodiment of a four primary system including a red primary, a green primary, a cyan primary, and a blue primary. The example shown in FIG. 1 uses the values shown in Table 1.
[00154] In another embodiment, the four primaries include a red primary, a first green primary, a second green primary, and a blue primary. In one embodiment, the red primary has a dominant wavelength of 615nm, the first green primary has a dominant wavelength of 525nm, the second green primary has a dominant wavelength of 550nm, and the blue primary has a dominant wavelength of 465nm as shown in Table 2. In one embodiment, the dominant wavelength is approximately (e.g., within 10%) the value listed in the table below.
Alternatively, the dominant wavelength is within 5% of the value listed in the table below.
In yet another embodiment, the dominant wavelength is within 2% of the value listed in the table below.
Alternatively, the dominant wavelength is within 5% of the value listed in the table below.
In yet another embodiment, the dominant wavelength is within 2% of the value listed in the table below.
[00155] TABLE 2 u' v' R 0.680 0.320 0.496 0.526 615nm G1 0.300 0.700 0.111 0.583 525nm G2 0.150 0.720 0.053 0.571 550nm B 0.150 0.060 0.175 0.158 465nm
[00156] FIG. 2 illustrates one embodiment of a four primary system including a red primary, a first green primary, a second green primary, and a blue primary.
The example shown in FIG. 2 uses the values shown in Table 2.
The example shown in FIG. 2 uses the values shown in Table 2.
[00157] In another embodiment, the red primary has a dominant wavelength of 615nm, the first green primary has a dominant wavelength of 520nm, the second green primary has a dominant wavelength of 550nm, and the blue primary has a dominant wavelength of 465nm as shown in Table 3. In one embodiment, the dominant wavelength is approximately (e.g., within 10%) the value listed in the table below. Alternatively, the dominant wavelength is within 5% of the value listed in the table below. In yet another embodiment, the dominant wavelength is within 2% of the value listed in the table below.
[00158] TABLE 3 u' v' R 0.680 0.320 0.496 0.526 615nm G1 0.302 0.692 0.113 0.582 520nm G2 0.074 0.834 0.023 0.584 550nm B 0.150 0.060 0.175 0.158 465nm
[00159] FIG. 3 illustrates another embodiment of a four primary system including a red primary, a first green primary, a second green primary, and a blue primary.
The example shown in FIG. 3 uses the values shown in Table 3.
The example shown in FIG. 3 uses the values shown in Table 3.
[00160] 5 PRIMARY SYSTEMS
[00161] In one embodiment, the multi-primary system includes five primaries.
In one embodiment, the five primaries include a red primary, a green primary, a cyan primary, a blue primary, and a white emitter. In one embodiment, the white emitter is a D65 emitter. In one embodiment, the red primary has a dominant wavelength of 615nm, the green primary has a dominant wavelength of 545nm, the cyan primary has a dominant wavelength of 493nm, and the blue primary has a dominant wavelength of 465nm as shown in Table 4.
In one embodiment, the five primaries include a red primary, a green primary, a cyan primary, a blue primary, and a white emitter. In one embodiment, the white emitter is a D65 emitter. In one embodiment, the red primary has a dominant wavelength of 615nm, the green primary has a dominant wavelength of 545nm, the cyan primary has a dominant wavelength of 493nm, and the blue primary has a dominant wavelength of 465nm as shown in Table 4.
[00162] TABLE 4 u' v' W (D65) 0.313 0.329 0.198 0.468 0.680 0.320 0.496 0.526 615nm 0.265 0.690 0.099 0.578 545nm 0.163 0.342 0.096 0.454 493nm 0.150 0.060 0.175 0.158 465nm
[00163] FIG. 4 illustrates one embodiment of a five primary system including a red primary, a green primary, a cyan primary, a blue primary, and a white emitter.
The example shown in FIG. 4 uses the values shown in Table 4.
The example shown in FIG. 4 uses the values shown in Table 4.
[00164] In another embodiment, the five primaries include a red primary, a yellow primary, a green primary, a cyan primary, and a blue primary. In one embodiment, the red primary has a dominant wavelength of 615nm, the yellow primary has a dominant wavelength of 570nm, the green primary has a dominant wavelength of 545nm, the cyan primary has a dominant wavelength of 493nm, and the blue primary has a dominant wavelength of 465nm as shown in Table 5. In one embodiment, the dominant wavelength is approximately (e.g., within 10%) the value listed in the table below.
Alternatively, the dominant wavelength is within 5% of the value listed in the table below. In yet another embodiment, the dominant wavelength is within 2% of the value listed in the table below.
Alternatively, the dominant wavelength is within 5% of the value listed in the table below. In yet another embodiment, the dominant wavelength is within 2% of the value listed in the table below.
[00165] TABLE 5 u' v' R 0.680 0.320 0.496 0.526 615nm Y 0.450 0.547 0.208 0.568 570nm G 0.265 0.690 0.099 0.578 545nm C 0.163 0.342 0.096 0.454 493nm B 0.150 0.060 0.175 0.158 465nm
[00166] FIG. 5 illustrates another embodiment of a five primary system including a red primary, a yellow primary, a green primary, a cyan primary, and a blue primary. The example shown in FIG. 5 uses the values shown in Table 5.
[00167] In yet another embodiment, the five primaries include a red primary, a first green primary, a second green primary, a blue primary, and a white emitter. In one embodiment, the white emitter is a D65 emitter. In one embodiment, the red primary has a dominant wavelength of 615nm, the first green primary has a dominant wavelength of 525nm, the second green primary has a dominant wavelength of 550nm, and the blue primary has a dominant wavelength of 465nm as shown in Table 6. In one embodiment, the dominant wavelength is approximately (e.g., within 10%) the value listed in the table below.
Alternatively, the dominant wavelength is within 5% of the value listed in the table below.
In yet another embodiment, the dominant wavelength is within 2% of the value listed in the table below.
Alternatively, the dominant wavelength is within 5% of the value listed in the table below.
In yet another embodiment, the dominant wavelength is within 2% of the value listed in the table below.
[00168] TABLE 6 u' v' W (D65) 0.313 0.329 0.198 0.468 0.680 0.320 0.496 0.526 615nm G1 0.300 0.700 0.111 0.583 525nm G2 0.150 0.720 0.053 0.571 550nm 0.150 0.060 0.175 0.158 465nm
[00169] FIG. 6 illustrates another embodiment of a five primary system including a red primary, a first green primary, a second green primary, a blue primary, and a white emitter.
The example shown in FIG. 6 uses the values shown in Table 6.
The example shown in FIG. 6 uses the values shown in Table 6.
[00170] In another embodiment, the red primary has a dominant wavelength of 615nm, the first green primary has a dominant wavelength of 520nm, the second green primary has a dominant wavelength of 550nm, and the blue primary has a dominant wavelength of 465nm as shown in Table 7. In one embodiment, the dominant wavelength is approximately (e.g., within 10%) the value listed in the table below. Alternatively, the dominant wavelength is within 5% of the value listed in the table below. In yet another embodiment, the dominant wavelength is within 2% of the value listed in the table below.
[00171] TABLE 7 u' v' W (D65) 0.313 0.329 0.198 0.468 0.680 0.320 0.496 0.526 615nm G1 0.302 0.692 0.113 0.582 520nm G2 0.150 0.720 0.053 0.571 550nm 0.150 0.060 0.175 0.158 465nm
[00172] FIG. 7 illustrates another embodiment of a five primary system including a red primary, a first green primary, a second green primary, a blue primary, and a white emitter.
The example shown in FIG. 7 uses the values shown in Table 7.
The example shown in FIG. 7 uses the values shown in Table 7.
[00173] 6 PRIMARY SYSTEMS
[00174] In one embodiment, the multi-primary system includes six primaries. In one preferred embodiment, the six primaries include a red primary, a green primary, a blue primary, a cyan primary, a magenta primary, and a yellow primary.
[00175] 6P-B
[00176] 6P-B is a color set that uses the same RGB values that are defined in the ITU-R
BT.709-6 television standard. The gamut includes these RGB primary colors and then adds three more color primaries orthogonal to these based on the white point. The white point used in 6P-B is D65 (ISO 11664-2).
BT.709-6 television standard. The gamut includes these RGB primary colors and then adds three more color primaries orthogonal to these based on the white point. The white point used in 6P-B is D65 (ISO 11664-2).
[00177] In one embodiment, the red primary has a dominant wavelength of 609nm, the yellow primary has a dominant wavelength of 571m, the green primary has a dominant wavelength of 552nm, the cyan primary has a dominant wavelength of 491m, and the blue primary has a dominant wavelength of 465nm as shown in Table 8. In one embodiment, the dominant wavelength is approximately (e.g., within 10%) the value listed in the table below.
Alternatively, the dominant wavelength is within 5% of the value listed in the table below.
In yet another embodiment, the dominant wavelength is within 2% of the value listed in the table below.
Alternatively, the dominant wavelength is within 5% of the value listed in the table below.
In yet another embodiment, the dominant wavelength is within 2% of the value listed in the table below.
[00178] TABLE 8 u' v' W (D65) 0.3127 0.3290 0.1978 0.4683 0.6400 0.3300 0.4507 0.5228 609nm 0.3000 0.6000 0.1250 0.5625 552nm 0.1500 0.0600 0.1754 0.1578 464nm 0.1655 0.3270 0.1041 0.4463 491m 0.3221 0.1266 0.3325 0.2940 0.4400 0.5395 0.2047 0.5649 571m
[00179] FIG. 8 illustrates 6P-B compared to ITU-R BT.709-6.
[00180] 6P-C
[00181] 6P-C is based on the same RGB primaries defined in SMPTE RP431-2 projection recommendation. Each gamut includes these RGB primary colors and then adds three more color primaries orthogonal to these based on the white point. The white point used in 6P-B is D65 (ISO 11664-2). Two versions of 6P-C are used. One is optimized for a D60 white point (SMPTE 5T2065-1), and the other is optimized for a D65 white point.
[00182] In one embodiment, the red primary has a dominant wavelength of 615nm, the yellow primary has a dominant wavelength of 570nm, the green primary has a dominant wavelength of 545nm, the cyan primary has a dominant wavelength of 493nm, and the blue primary has a dominant wavelength of 465nm as shown in Table 9. In one embodiment, the dominant wavelength is approximately (e.g., within 10%) the value listed in the table below.
Alternatively, the dominant wavelength is within 5% of the value listed in the table below.
In yet another embodiment, the dominant wavelength is within 2% of the value listed in the table below.
Alternatively, the dominant wavelength is within 5% of the value listed in the table below.
In yet another embodiment, the dominant wavelength is within 2% of the value listed in the table below.
[00183] TABLE 9 u' v' W (D60) 0.3217 0.3377 0.2008 0.4742 0.6800 0.3200 0.4964 0.5256 615nm 0.2650 0.6900 0.0980 0.5777 545nm 0.1500 0.0600 0.1754 0.1579 465nm 0.1627 0.3419 0.0960 0.4540 493nm 0.3523 0.1423 0.3520 0.3200 0.4502 0.5472 0.2078 0.5683 570nm
[00184] FIG. 9 illustrates 6P-C compared to SMPTE RP431-2 for a D60 white point.
[00185] In one embodiment, the red primary has a dominant wavelength of 615nm, the yellow primary has a dominant wavelength of 570nm, the green primary has a dominant wavelength of 545nm, the cyan primary has a dominant wavelength of 423nm, and the blue primary has a dominant wavelength of 465nm as shown in Table 10. In one embodiment, the dominant wavelength is approximately (e.g., within 10%) the value listed in the table below.
Alternatively, the dominant wavelength is within 5% of the value listed in the table below.
In yet another embodiment, the dominant wavelength is within 2% of the value listed in the table below.
Alternatively, the dominant wavelength is within 5% of the value listed in the table below.
In yet another embodiment, the dominant wavelength is within 2% of the value listed in the table below.
[00186] TABLE 10 u' v' W (D65) 0.3127 0.3290 0.1978 0.4683 0.6800 0.3200 0.4964 0.5256 615nm 0.2650 0.6900 0.0980 0.5777 545nm 0.1500 0.0600 0.1754 0.1579 465nm 0.1617 0.3327 0.0970 0.4490 492nm 0.3383 0.1372 0.3410 0.3110 0.4470 0.5513 0.2050 0.5689 570nm
[00187] FIG. 10 illustrates 6P-C compared to SMPTE RP431-2 for a D65 white point.
[00188] SUPER 6P
[00189] One of the advantages of ITU-R BT.2020 is that it can include all of the Pointer colors and that increasing primary saturation in a six-color primary design could also do this.
Pointer is described in "The Gamut of Real Surface Colors, M.R. Pointer, Published in Colour Research and Application Volume #5, Issue #3 (1980), which is incorporated herein by reference in its entirety. However, extending the 6P gamut beyond SMPTE
RP431-2 ("6P-C") adds two problems. The first problem is the requirement to narrow the spectrum of the extended primaries. The second problem is the complexity of designing a backwards compatible system using color primaries that are not related to current standards. But in some cases, there may be a need to extend the gamut beyond 6P-C and avoid these problems. If the goal is to encompass Pointer's data set, then it is possible to keep most of the 6P-C system and only change the cyan color primary position. In one embodiment, the cyan color primary position is located so that the gamut edge encompasses all of Pointer's data set. In another embodiment, the cyan color primary position is a location that limits maximum saturation.
With 6P-C, cyan is positioned as u'=0.096, v'=0.454. In one embodiment of Super 6P, cyan is moved to u'=0.075, v'=0.430 ("Super 6Pa" (S6Pa)). Advantageously, this creates anew gamut that covers Pointer's data set almost in its entirety. FIG. 11 illustrates Super 6Pa compared to 6P-C.
Pointer is described in "The Gamut of Real Surface Colors, M.R. Pointer, Published in Colour Research and Application Volume #5, Issue #3 (1980), which is incorporated herein by reference in its entirety. However, extending the 6P gamut beyond SMPTE
RP431-2 ("6P-C") adds two problems. The first problem is the requirement to narrow the spectrum of the extended primaries. The second problem is the complexity of designing a backwards compatible system using color primaries that are not related to current standards. But in some cases, there may be a need to extend the gamut beyond 6P-C and avoid these problems. If the goal is to encompass Pointer's data set, then it is possible to keep most of the 6P-C system and only change the cyan color primary position. In one embodiment, the cyan color primary position is located so that the gamut edge encompasses all of Pointer's data set. In another embodiment, the cyan color primary position is a location that limits maximum saturation.
With 6P-C, cyan is positioned as u'=0.096, v'=0.454. In one embodiment of Super 6P, cyan is moved to u'=0.075, v'=0.430 ("Super 6Pa" (S6Pa)). Advantageously, this creates anew gamut that covers Pointer's data set almost in its entirety. FIG. 11 illustrates Super 6Pa compared to 6P-C.
[00190] Table 11 is a table of values for Super 6Pa. The definition of x,y are described in ISO 11664-3:2012/CIE S 014 Part 3, which is incorporated herein by reference in its entirety.
The definition of u ',v ' are described in ISO 11664-5:2016/CIE S 014 Part 5, which is incorporated herein by reference in its entirety. defines each color primary as dominant color wavelength for RGB and complementary wavelengths CMY.
The definition of u ',v ' are described in ISO 11664-5:2016/CIE S 014 Part 5, which is incorporated herein by reference in its entirety. defines each color primary as dominant color wavelength for RGB and complementary wavelengths CMY.
[00191] TABLE 11 v W (D60) 0.3217 0.3377 0.2008 0.4742 W (D65) 0.3127 0.3290 0.1978 0.4683 R 0.6800 0.3200 0.4964 0.5256 615nm G 0.2650 0.6900 0.0980 0.5777 545nm B 0.1500 0.0600 0.1754 0.1579 465nm C 0.1211 0.3088 0.0750 0.4300 490nm M 0.3523 0.1423 0.3520 0.3200 Y 0.4502 0.5472 0.2078 0.5683 570nm
[00192] In an alternative embodiment, the saturation is expanded on the same hue angle as 6P-C as shown in FIG. 12. Advantageously, this makes backward compatibility less complicated. However, this requires much more saturation (i.e., narrower spectra). In another embodiment of Super 6P, cyan is moved to u'=0.067, v'=0.449 ("Super 6Pb"
(S6Pb)).
Additionally, FIG. 12 illustrates Super 6Pb compared to Super 6Pa and 6P-C.
(S6Pb)).
Additionally, FIG. 12 illustrates Super 6Pb compared to Super 6Pa and 6P-C.
[00193] Table 12 is a table of values for Super 6Pb. The definition of x,y are described in ISO 11664-3:2012/CIE S 014 Part 3, which is incorporated herein by reference in its entirety.
The definition of u ',v' are described in ISO 11664-5:2016/CIE S 014 Part 5, which is incorporated herein by reference in its entirety. defines each color primary as dominant color wavelength for RGB and complementary wavelengths CMY.
The definition of u ',v' are described in ISO 11664-5:2016/CIE S 014 Part 5, which is incorporated herein by reference in its entirety. defines each color primary as dominant color wavelength for RGB and complementary wavelengths CMY.
[00194] TABLE 12 u' v' W (ACES D60) 0.32168 0.33767 0.2008 0.4742 W (D65) 0.3127 0.3290 0.1978 0.4683 0.6800 0.3200 0.4964 0.5256 615nm 0.2650 0.6900 0.0980 0.5777 545nm 0.1500 0.0600 0.1754 0.1579 465nm 0.1156 0.3442 0.0670 0.4490 493nm 0.3523 0.1423 0.3520 0.3200 0.4502 0.5472 0.2078 0.5683 570nm
[00195] In another embodiment, the six primaries include a red primary, a yellow primary, a green primary, a cyan primary, a blue primary, and white emitter. In one embodiment, the white emitter is a D65 white emitter. In one embodiment, the red primary has a dominant wavelength of 615nm, the yellow primary has a dominant wavelength of 570nm, the green primary has a dominant wavelength of 545nm, the cyan primary has a dominant wavelength of 493nm, and the blue primary has a dominant wavelength of 465nm as shown in Table 13.
In one embodiment, the dominant wavelength is approximately (e.g., within 10%) the value listed in the table below. Alternatively, the dominant wavelength is within 5% of the value listed in the table below. In yet another embodiment, the dominant wavelength is within 2%
of the value listed in the table below.
In one embodiment, the dominant wavelength is approximately (e.g., within 10%) the value listed in the table below. Alternatively, the dominant wavelength is within 5% of the value listed in the table below. In yet another embodiment, the dominant wavelength is within 2%
of the value listed in the table below.
[00196] TABLE 13 u' v' W (D65) 0.313 0.329 0.198 0.468 0.680 0.320 0.496 0.526 615nm 0.450 0.547 0.208 0.568 570nm 0.265 0.690 0.099 0.578 545nm 0.163 0.342 0.096 0.454 493nm 0.150 0.060 0.175 0.158 465nm
[00197] FIG. 13 illustrates one embodiment of a six primary system including a red primary, a yellow primary, a green primary, a cyan primary, a blue primary, and a white emitter. The example shown in FIG. 13 uses the values shown in Table 13.
[00198] In yet another embodiment, the six primaries include a red primary, a first green primary, a second green primary, a blue primary, a first white emitter, and a second white emitter. In one embodiment, the first white emitter is a D65 white emitter. In one embodiment, the second white emitter is a D25 white emitter. In one embodiment, the red primary has a dominant wavelength of 615nm, the first green primary has a dominant wavelength of 520nm, the second green primary has a dominant wavelength of 550nm, and the blue primary has a dominant wavelength of 465nm as shown in Table 14. In an alternative embodiment, the first green primary has a dominant wavelength of 525nm. In one embodiment, the dominant wavelength is approximately (e.g., within 10%) the value listed in the table below. Alternatively, the dominant wavelength is within 5% of the value listed in the table below. In yet another embodiment, the dominant wavelength is within 2% of the value listed in the table below.
[00199] TABLE 14 u' v' W (D65) 0.313 0.329 0.198 0.468 W (D25) 0.477 0.414 0.272 0.531 0.680 0.320 0.496 0.526 615nm G1 0.300 0.700 0.111 0.583 525nm G2 0.150 0.720 0.053 0.571 550nm 0.150 0.060 0.175 0.158 465nm
[00200] FIG. 14 illustrates one embodiment of a six primary system including a red primary, a first green primary, a second green primary, a blue primary, a first white emitter, and a second white emitter. The example shown in FIG. 14 uses the values shown in Table 14.
[00201] In still another embodiment, the six primaries include a red primary, a green primary, a blue primary, a first white emitter, a second white emitter, and a third white emitter. In one embodiment, the first white emitter is a D80 white emitter. In one embodiment, the second white emitter is a D20 white emitter. In one embodiment, the third white emitter is a D45 white emitter. In a preferred embodiment, the third white emitter includes a green bias (e.g., 40% green, 60% D45). In one embodiment, the red primary has a dominant wavelength of 630nm, the green primary has a dominant wavelength of 532nm, and the blue primary has a dominant wavelength of 467nm as shown in Table 15. In one embodiment, the dominant wavelength is approximately (e.g., within 10%) the value listed in the table below. Alternatively, the dominant wavelength is within 5% of the value listed in the table below. In yet another embodiment, the dominant wavelength is within 2% of the value listed in the table below.
[00202] TABLE 15 W-R (D25) 0.5265 0.4133 W-G (D45-G) 0.2855 0.5393 W-B (D65) 0.2940 0.3094 0.708 0.292 630nm 0.170 0.797 532nm 0.131 0.046 467nm
[00203] FIG. 15A illustrates one embodiment of a six primary system including a red primary, a green primary, a blue primary, a first white emitter, a second white emitter, and a third white emitter. The example shown in FIG. 15A uses the values shown in Table 15.
Advantageously, this embodiment allows for fewer metameric errors.
Advantageously, this embodiment allows for fewer metameric errors.
[00204] FIG. 15B illustrates an example of the emission spectra of a six primary system including a red primary, a green primary, a blue primary, a first white emitter, a second white emitter, and a third white emitter. The example shown in FIG. 15B uses the values shown in Table 15.
[00205] Alternatively, the six primary system includes a first red primary, a second red primary, a first green primary, a second green primary, a first blue primary, and a second blue primary. The first red primary, the first green primary, and the first blue primary are preferably narrow band primaries. The second red primary, the second green primary, and the second blue primary are preferably wide band primaries. In one embodiment, the first red primary has a dominant wavelength of 630nm, the first green primary has a dominant wavelength of 532nm, and the first blue primary has a dominant wavelength of 4671m. In one embodiment, the dominant wavelength is approximately (e.g., within 10%) the value recited above. Alternatively, the dominant wavelength is within 5% of the value recited above. In yet another embodiment, the dominant wavelength is within 2% of the value recited above.
[00206] FIG. 15C illustrates an example of the emission spectra of a six primary system including a first red primary, a second red primary, a first green primary, a second green primary, a first blue primary, and a second blue primary. Advantageously, this embodiment also allows for fewer metameric errors.
[00207] In a preferred embodiment, a matrix is created from XYZ values of each of the primaries (e.g., the at least four primaries, the at least five primaries, the at least six primaries). As the XYZ values of the primaries change, the matrix changes.
Additional details about the matrix are described below.
Additional details about the matrix are described below.
[00208] FORMATTING AND TRANSPORTATION OF MULTI-PRIMARY SIGNALS
[00209] The present invention includes three different methods to format video for transport: System 1, System 2, and System 3. System 1 is comprised of an encode and decode system, which can be divided into base encoder and digitation, image data stacking, mapping into the standard data transport, readout, unstack, and finally image decoding. In one embodiment, the basic method of this system is to combine opposing color primaries within the three standard transport channels and identify them by their code value.
[00210] System 2 uses a sequential method where three color primaries are passed to the transport format as full bit level image data and inserted as normal. The three additional channels are delayed by one pixel and then placed into the transport instead of the first colors.
This is useful in situations where quantizing artifacts may be critical to image performance.
In one embodiment, this system is comprised of the six primaries (e.g., RGB
plus a method to delay the CYM colors for injection), image resolution identification to allow for pixel count synchronization, start of video identification, and RGB Delay.
This is useful in situations where quantizing artifacts may be critical to image performance.
In one embodiment, this system is comprised of the six primaries (e.g., RGB
plus a method to delay the CYM colors for injection), image resolution identification to allow for pixel count synchronization, start of video identification, and RGB Delay.
[00211] System 3 utilizes a dual link method where two wires are used. In one embodiment, a first set of three channels (e.g., RGB) are sent to link A and a second set of three channels (e.g., CYM) is sent to link B. Once they arrive at the image destination, they are recombined.
[00212] To transport up to six color components (e.g., four, five, or six), System 1, System 2, or System 3 can be used as described. If four color components are used, two of the channels are set to "0". If five color components are used, one of the channels is set to "0".
Advantageously, this transportation method works for all primary systems described herein that include up to six color components.
Advantageously, this transportation method works for all primary systems described herein that include up to six color components.
[00213] COMPARISON OF THREE SYSTEMS
[00214] Advantageously, System 1 fits within legacy SDI, CTA, and Ethernet transports.
Additionally, System 1 has zero latency processing for conversion to an RGB
display.
However, System 1 is limited to 11-bit words.
Additionally, System 1 has zero latency processing for conversion to an RGB
display.
However, System 1 is limited to 11-bit words.
[00215] System 2 is advantageously operable to transport 6 channels using 16-bit words with no compression. Additionally, System 2 fits within newer SDI, CTA, and Ethernet transport formats. However, System 2 requires double bit rate speed. For example, a 4K
image requires a data rate for an 8K RGB image.
image requires a data rate for an 8K RGB image.
[00216] In comparison, System 3 is operable to transport up to 6 channels using 16-bit words with compression and at the same data required for a specific resolution. For example, a data rate for an RGB image is the same as for a 6P image using System 3.
However, System 3 requires a twin cable connection within the video system.
However, System 3 requires a twin cable connection within the video system.
[00217] NOMENCLATURE
[00218] In one embodiment, a standard video nomenclature is used to better describe each system.
[00219] R describes red data as linear light. G describes green data as linear light. B
describes blue data as linear light. C describes cyan data as linear light. M
describes magenta data as linear light. r and/or Y describe yellow data as linear light.
describes blue data as linear light. C describes cyan data as linear light. M
describes magenta data as linear light. r and/or Y describe yellow data as linear light.
[00220] R' describes red data as non-linear light. G' describes green data as non-linear light. B' describes blue data as non-linear light. C' describes cyan data as non-linear light. M' describes magenta data as non-linear light. Yc and/or Y' describe yellow data as non-linear light.
[00221] Y6 describes the luminance sum of RGBCMY data. YRGB describes a System encode that is the linear luminance sum of the RGB data. Yovry describes a System 2 encode that is the linear luminance sum of the CMY data.
[00222] CR describes the data value of red after subtracting linear image luminance. CB
describes the data value of blue after subtracting linear image luminance. Cc describes the data value of cyan after subtracting linear image luminance. Cy describes the data value of yellow after subtracting linear image luminance.
describes the data value of blue after subtracting linear image luminance. Cc describes the data value of cyan after subtracting linear image luminance. Cy describes the data value of yellow after subtracting linear image luminance.
[00223] TRGB describes a System 2 encode that is the nonlinear luminance sum of the RGB data. Y 'Civiy describes a System 2 encode that is the nonlinear luminance sum of the CMY data. -Y describes the sum of RGB data subtracted from Y6.
[00224] C 'R describes the data value of red after subtracting nonlinear image luminance.
C '13 describes the data value of blue after subtracting nonlinear image luminance. C'c describes the data value of cyan after subtracting nonlinear image luminance.
C 'y describes the data value of yellow after subtracting nonlinear image luminance.
C '13 describes the data value of blue after subtracting nonlinear image luminance. C'c describes the data value of cyan after subtracting nonlinear image luminance.
C 'y describes the data value of yellow after subtracting nonlinear image luminance.
[00225] B+Y describes a System 1 encode that includes either blue or yellow data. G+M
describes a System 1 encode that includes either green or magenta data. R+C
describes a System 1 encode that includes either green or magenta data.
describes a System 1 encode that includes either green or magenta data. R+C
describes a System 1 encode that includes either green or magenta data.
[00226] CR+Cc describes a System 1 encode that includes either color difference data.
CB+Cy describes a System 1 encode that includes either color difference data.
CB+Cy describes a System 1 encode that includes either color difference data.
[00227] 4:4:4 describes full bandwidth sampling of a color in an RGB system.
4:4:4:4:4:4 describes full sampling of a color in an RGBCMY system. 4:2:2 describes an encode where a full bandwidth luminance channel (Y) is used to carry image detail and the remaining components are half sampled as a Cb Cr encode. 4:2:2:2:2 describes an encode where a full bandwidth luminance channel (Y) is used to carry image detail and the remaining components are half sampled as a Cb Cr Cy Cc encode. 4:2:0 describes a component system similar to 4:2:2, but where Cr and Cb samples alternate per line. 4:2:0:2:0 describes a component system similar to 4:2:2, but where Cr, Cb, Cy, and Cc samples alternate per line.
4:4:4:4:4:4 describes full sampling of a color in an RGBCMY system. 4:2:2 describes an encode where a full bandwidth luminance channel (Y) is used to carry image detail and the remaining components are half sampled as a Cb Cr encode. 4:2:2:2:2 describes an encode where a full bandwidth luminance channel (Y) is used to carry image detail and the remaining components are half sampled as a Cb Cr Cy Cc encode. 4:2:0 describes a component system similar to 4:2:2, but where Cr and Cb samples alternate per line. 4:2:0:2:0 describes a component system similar to 4:2:2, but where Cr, Cb, Cy, and Cc samples alternate per line.
[00228] Constant luminance is the signal process where luminance (Y) are calculated in linear light. Non-constant luminance is the signal process where luminance (Y) are calculated in nonlinear light.
[00229] DERIVING COLOR COMPONENTS
[00230] When using a color difference method (4:2:2), several components need specific processing so that they can be used in lower frequency transports. These are derived as:
[00231] Ye: = 0.1063R' + 0.2319511' + 0.3576G' + 0.19685C + 0.0361B' +
0.0712M'
0.0712M'
[00232] G'e, ¨ __ 1 0.3576Y) (0.1063k) ¨ (0.03610 ¨ (0.196850 ¨ (0.2319511c) ¨
(0.07120)
(0.07120)
[00233] ¨Y' = Ye: ¨ (C' + )Jc' + M') Yc"¨Y' 1002341 CR = CR = Cc = Cy =
1.7874 1.9278 1.6063 1.5361 [00235] = ¨cR" B, = cB" = cc' -y6' yc, = CY6¨
1.7874 1.9278 1.6063 1.5361 [00236] The ratios for Cr, Cb, Cc, and Cy are also valid in linear light calcuations.
[00237] Magenta can be calculated as follows:
[00238] M = B +R or M = ¨B+R
B xR BxR
[00239] SYSTEM 1 [00240] In one embodiment, the multi-primary color system is compatible with legacy systems. A backwards compatible multi-primary color system is defined by a sampling method. In one embodiment, the sampling method is 4:4:4. In one embodiment, the sampling method is 4:2:2. In another embodiment, the sampling method is 4:2:0. In one embodiment of a backwards compatible multi-primary color system, new encode and decode systems are divided into the steps of performing base encoding and digitization, image data stacking, mapping into the standard data transport, readout, unstacking, and image decoding ("System 1"). In one embodiment, System 1 combines opposing color primaries within three standard transport channels and identifies them by their code value. In one embodiment of a backwards compatible multi-primary color system, the processes are analog processes. In another embodiment of a backwards compatible multi-primary color system, the processes are digital processes.
[00241] In one embodiment, the sampling method for a multi-primary color system is a 4:4:4 sampling method. Black and white bits are redefined. In one embodiment, putting black at midlevel within each data word allows the addition of CYM color data.
[00242] FIG. 16 illustrates an embodiment of an encode and decode system for a multi-primary color system. In one embodiment, the multi-primary color encode and decode system is divided into a base encoder and digitation, image data stacking, mapping into the standard data transport, readout, unstack, and finally image decoding ("System 1"). In one embodiment, the method of this system combines opposing color primaries within the three standard transport channels and identifies them by their code value. In one embodiment, the encode and decode for a multi-primary color system are analog-based. In another embodiment, the encode and decode for a multi-primary color system are digital-based.
System 1 is designed to be compatible with lower bandwidth systems and allows a maximum of 11 bits per channel and is limited to sending only three channels of up to six primaries at a time. In one embodiment, it does this by using a stacking system where either the color channel or the complementary channel is decoded depending on the bit level of that one channel.
[00243] SYSTEM 2 [00244] FIG. 17 illustrates a sequential method where three color primaries are passed to the transport format as full bit level image data and inserted as normal ("System 2"). The three additional channels are delayed by one pixel and then placed into the transport instead of the first colors. This method is useful in situations where quantizing artifacts is critical to image performance. In one embodiment, this system is comprised of six primaries (RGBCYM), a method to delay the CYM colors for injection, image resolution identification to all for pixel count synchronization, start of video identification, RGB
delay, and for YCCCCC systems, logic to select the dominant color primary. The advantage of System 2 is that full bit level video can be transported, but at double the normal data rate.
[00245] SYSTEM 3 [00246] FIG. 18 illustrates one embodiment of a system encode and decode process using a dual link method ("System 3"). System 3 utilizes a dual link method where two wires are used. In one embodiment, RGB is sent to link A and CYM is sent to link B.
After arriving at the image destination, the two links are recombined.
[00247] System 3 is simpler and more straight forward than Systems 1 and 2.
The advantage with this system is that adoption is simply to format non-RGB
primaries (e.g., CYM) on a second link. So, in one example, for an SDI design, RGB is sent on a standard SDI stream just as it is currently done. There is no modification to the transport and this link is operable to be sent to any RGB display requiring only the compensation for the luminance difference because the CYM components are not included. CYM data is transported in the same manner as RGB data. This data is then combined in the display to make up a 6P image.
The downside is that the system requires two wires to move one image. This system is operable to work with most any format including SMPTE 5T292, 424, 2082, and 2110. It also is operable to work with dual HDMI/CTA connections. In one embodiment, the system includes at least one transfer function (e.g., OETF, EOTF).
[00248] FIG. 19 illustrates one embodiment of an encoding process using a dual link method.
[00249] FIG. 20 illustrates one embodiment of a decoding process using a dual link method.
[00250] TRANSFER FUNCTIONS
[00251] The system design minimizes limitations to use standard transfer functions for both encode and/or decode processes. Current practices used in standards include, but are not limited to, ITU-R BT.1886, ITU-R BT.2020, SMPTE ST274, SMPTE ST296, SMPTE
ST2084, and ITU-R BT.2100. These standards are compatible with this system and require no modification.
[00252] Encoding and decoding 6P images is formatted into several different configurations to adapt to image transport frequency limitations. The highest quality transport is obtained by keeping all components as RGBCMY components. This uses the highest sampling frequencies and requires the most signal bandwidth. An alternate method is to sum the image details in a luminance channel at full bandwidth and then send the color difference signals at half or quarter sampling (e.g., Y Cr Cb Cc Cy). This allows a similar image to pass through lower bandwidth transports.
[00253] SIX-PRIMARY COLOR ENCODE USING A 4:4:4 SAMPLING METHOD
[00254] FIG. 21 illustrates one embodiment of a six-primary color system encode using a 4:4:4 sampling method.
[00255] Subjective testing during the development and implementation of the current digital cinema system (DCI Version 1.2) showed that perceptible quantizing artifacts were not noticeable with system bit resolutions higher than 11 bits. Current serial digital transport systems support 12 bits. Remapping six color components to a 12-bit stream is accomplished by lowering the bit limit to 11 bits (values 0 to 2047) for 12-bit serial systems or 9 bits (values 0 to 512) for 10-bit serial systems. This process is accomplished by processing RGBCYM video information through a standard Optical Electronic Transfer Function (OETF) (e.g., ITU-R BT.709-6), digitizing the video information as four samples per pixel, and quantizing the video information as 11-bit or 9-bit.
[00256] In another embodiment, the RGBCYM video information is processed through a standard Optical Optical Transfer Function (00TF). In yet another embodiment, the RGBCYM video information is processed through a Transfer Function (TF) other than OETF
or 00TF. TFs consist of two components, a Modulation Transfer Function (MTF) and a Phase Transfer Function (PTF). The MTF is a measure of the ability of an optical system to transfer various levels of detail from object to image. In one embodiment, performance is measured in terms of contrast (degrees of gray), or of modulation, produced for a perfect source of that detail level. The PTF is a measure of the relative phase in the image(s) as a function of frequency. A relative phase change of 180 , for example, indicates that black and white in the image are reversed. This phenomenon occurs when the TF becomes negative.
[00257] There are several methods for measuring MTF. In one embodiment, MTF is measured using discrete frequency generation. In one embodiment, MTF is measured using continuous frequency generation. In another embodiment, MTF is measured using image scanning. In another embodiment, MTF is measured using waveform analysis.
[00258] In one embodiment, the six-primary color system is for a 12-bit serial system.
Current practices normally set black at bit 0 and white at bit 4095 for 12-bit video. In order to package six colors into the existing three-serial streams, the bit defining black is moved to bit 2048. Thus, the new encode has RGB values starting at 2048 for black and bit 4095 for white and CYM values starting at bit 2047 for black and bit 0 as white. In another embodiment, the six-primary color system is for a 10-bit serial system.
[00259] FIG. 22 illustrates one embodiment for a method to package six channels of primary information into the three standard primary channels used in current serial video standards by modifying bit numbers for a 12-bit SDI and a 10-bit SDI. FIG. 23 illustrates a simplified diagram estimating perceived viewer sensation as code values define each hue angle. Table 16 and Table 17 list bit assignments for computer, production, and broadcast for a 12-bit system and a 10-bit system, respectively. In one embodiment, "Computer" refers to bit assignments compatible with CTA 861-G, November 2016, which is incorporated herein by reference in its entirety. In one embodiment, "Production" and/or "Broadcast" refer to bit assignments compatible with SMPTE ST 2082-0 (2016), SMPTE ST 2082-1 (2015), SMPTE
ST 2082-10 (2015), SMPTE ST 2082-11(2016), SMPTE ST 2082-12 (2016), SMPTE ST
2110-10 (2017), SMPTE ST 2110-20 (2017), SMPTE ST 2110-21 (2017), SMPTE ST
30 (2017), SMPTE ST 2110-31 (2018), and/or SMPTE ST 2110-40 (2018), each of which is incorporated herein by reference in its entirety.
[00260] TABLE 16: 12-Bit Assignments Computer Production Broadcast RGB CYM RGB CYM RGB CYM
Peak Brightness 4095 0 4076 16 3839 256 Minimum Brightness 2048 2047 2052 2032 2304 1792 [00261] TABLE 17: 10-Bit Assignments Computer Production Broadcast RGB CYM RGB CYM RGB CYM
Peak Brightness 1023 0 1019 4 940 64 Minimum Brightness 512 511 516 508 576 448 [00262] In one embodiment, the OETF process is defined in ITU-R BT.709-6, which is incorporated herein by reference in its entirety. In one embodiment, the OETF
process is defined in ITU-R BT.709-5, which is incorporated herein by reference in its entirety. In another embodiment, the OETF process is defined in ITU-R BT.709-4, which is incorporated herein by reference in its entirety. In yet another embodiment, the OETF
process is defined in ITU-R BT.709-3, which is incorporated herein by reference in its entirety. In yet another embodiment, the OETF process is defined in ITU-R BT.709-2, which is incorporated herein by reference in its entirety. In yet another embodiment, the OETF process is defined in ITU-R BT.709-1, which is incorporated herein by reference in its entirety.
[00263] In one embodiment, the encoder is a non-constant luminance encoder. In another embodiment, the encoder is a constant luminance encoder.
[00264] SIX-PRIMARY COLOR PACKING/STACKING USING A 4:4:4 SAMPLING
METHOD
[00265] FIG. 24 illustrates one embodiment for a method of stacking/encoding six-primary color information using a 4:4:4 video system. Image data must be assembled according the serial system used. This is not a conversion process, but instead is a packing/stacking process.
In one embodiment, the packing/stacking process is for a six-primary color system using a 4:4:4 sampling method.
[00266] FIG. 25 illustrates one embodiment for a method of unstacking/decoding six-primary color information using a 4:4:4 video system. In one embodiment, the RGB channels and the CYM channels are combined into one 12-bit word and sent to a standardized transport format. In one embodiment, the standardized transport format is SDI. In one embodiment, the decode is for a non-constant luminance, six-primary color system. In another embodiment, the decode is for a constant luminance, six-primary color system. In yet another embodiment, an electronic optical transfer function (EOTF) (e.g., ITU-R BT.1886) coverts image data back to linear for display. In one embodiment, the EOTF is defined in ITU-R BT.1886 (2011), which is incorporated herein by reference in its entirety.
FIG. 26 illustrates one embodiment of a 4:4:4 decoder.
[00267] System 2 uses sequential mapping to the standard transport format, so it includes a delay for the CYM data. The CYM data is recovered in the decoder by delaying the RGB
data. Since there is no stacking process, the full bit level video can be transported. For displays that are using optical filtering, this RGB delay could be removed and the process of mapping image data to the correct filter could be eliminated by assuming this delay with placement of the optical filter and the use of sequential filter colors.
[00268] Two methods can be used based on the type of optical filter used.
Since this system is operating on a horizontal pixel sequence, some vertical compensation is required and pixels are rectangular. This can be either as a line double repeat using the same RGBCYM data to fill the following line as shown in FIG. 27, or could be separated as RGB
on line one and CYM on line two as shown in FIG. 28. The format shown in FIG.
28 allows for square pixels, but the CMY components requires a line delay for synchronization. Other patterns eliminating the white subpixel are also compatible with the present invention.
[00269] FIG. 29 illustrates an embodiment of the present invention for sending six primary colors to a standardized transport format using a 4:4:4 encoder according to System 2.
Encoding is straight forward with a path for RGB sent directly to the transport format. RGB
data is mapped to each even numbered data segment in the transport. CYM data is mapped to each odd numbered segment. Because different resolutions are used in all of the standardized transport formats, there must be identification for what they are so that the start of each horizontal line and horizontal pixel count can be identified to time the RGB/CYM mapping to the transport. The identification is the same as currently used in each standardized transport function. Table 18, Table 19, Table 20, and Table 21 list 16-bit assignments, 12-bit assignments, 10-bit assignments, and 8-bit assignments, respectively. In one embodiment, "Computer" refers to bit assignments compatible with CTA 861-G, November 2016, which is incorporated herein by reference in its entirety. In one embodiment, "Production" and/or "Broadcast" refer to bit assignments compatible with SMPTE ST 2082-0 (2016), SMPTE ST
2082-1 (2015), SMPTE ST 2082-10 (2015), SMPTE ST 2082-11(2016), SMPTE ST 2082-12 (2016), SMPTE ST 2110-10 (2017), SMPTE ST 2110-20 (2017), SMPTE ST 2110-21 (2017), SMPTE ST 2110-30 (2017), SMPTE ST 2110-31 (2018), and/or SMPTE ST 2110-(2018), each of which is incorporated herein by reference in its entirety.
[00270] TABLE 18: 16-Bit Assignments Computer Production RGB CYM RGB CYM
Peak Brightness 65536 65536 65216 65216 Minimum Brightness 0 0 256 256 [00271] TABLE 19: 12-Bit Assignments Computer Production Broadcast RGB CYM RGB CYM RGB CYM
Peak Brightness 4095 4095 4076 4076 3839 3839 Minimum Brightness 0 0 16 16 256 256 [00272] TABLE 20: 10-Bit Assignments Computer Production Broadcast RGB CYM RGB CYM RGB CYM
Peak Brightness 1023 1023 1019 1019 940 940 Minimum Brightness 0 0 4 4 64 64 [00273] TABLE 21: 8-Bit Assignments Computer Production Broadcast RGB CYM RGB CYM RGB CYM
Peak Brightness 255 255 254 254 235 235 Minimum Brightness 0 0 1 1 16 16 [00274] The decode adds a pixel delay to the RGB data to realign the channels to a common pixel timing. EOTF is applied and the output is sent to the next device in the system.
Metadata based on the standardized transport format is used to identify the format and image resolution so that the unpacking from the transport can be synchronized. FIG.
30 shows one embodiment of a decoding with a pixel delay.
[00275] In one embodiment, the decoding is 4:4:4 decoding. With this method, the six-primary color decoder is in the signal path, where 11-bit values for RGB are arranged above data level 2048, while CYM levels are arranged below data level 2047 as 11-bit. If the same data set is sent to a display and/or process that is not operable for six-primary color processing, the image data is assumed as black at 0 level as a full 12-bit word. Decoding begins by tapping image data prior to the unstacking process.
[00276] SIX-PRIMARY COLOR ENCODE USING A 4:2:2 SAMPLING METHOD
[00277] In one embodiment, the packing/stacking process is for a six-primary color system using a 4:2:2 sampling method. In order to fit the new six-primary color system into a lower bandwidth serial system, while maintaining backwards compatibility, the standard method of converting from RGBCYM to a luminance and a set of color difference signals requires the addition of at least one new image designator. In one embodiment, the encoding and/or decoding process is compatible with transport through SMPTE ST 292-0 (2011), SMPTE ST
292-1 (2011, 2012, and/or 2018), SMPTE ST 292-2 (2011), SMPTE ST 2022-1 (2007), SMPTE ST 2022-2 (2007), SMPTE ST 2022-3 (2010), SMPTE ST 2022-4 (2011), SMPTE
ST 2022-5 (2012 and/or 2013), SMPTE ST 2022-6 (2012), SMPTE ST 2022-7 (2013), and/or and CTA 861-G (2106), each of which is incorporated herein by reference in its entirety.
[00278] In order for the system to package all of the image while supporting both six-primary and legacy displays, an electronic luminance component (Y) must be derived. The first component is: E. It can be described as:
G6 = 0.1063ER' ed + 0.231954ellow 0.3576Ereen 0.19685Eyan + 0.036141,w + 0.0712E14agenta [00279] Critical to getting back to legacy display compatibility, value Ely is described as:
Ely = E ¨ (Ec'yan + Eeuow E enta) [00280] In addition, at least two new color components are disclosed. These are designated as Cc and Cy components. The at least two new color components include a method to compensate for luminance and enable the system to function with older Y Cb Cr infrastructures. In one embodiment, adjustments are made to Cb and Cr in a Y
Cb Cr infrastructure since the related level of luminance is operable for division over more components. These new components are as follows:
(El? ¨ 6 ) (EL ¨ CT6) (E¨E6) ¨ G6) E' ¨ Ecf R =
1.7874 ,Ef c B = _______________ 1.9278 , E' C = _________________________ 1.6063 , CY 1.5361 [00281] Within such a system, it is not possible to define magenta as a wavelength. This is because the green vector in CIE 1976 passes into, and beyond, the CIE
designated purple line. Magenta is a sum of blue and red. Thus, in one embodiment, magenta is resolved as a calculation, not as optical data. In one embodiment, both the camera side and the monitor side of the system use magenta filters. In this case, if magenta were defined as a wavelength, it would not land at the point described. Instead, magenta would appear as a very deep blue which would include a narrow bandwidth primary, resulting in metameric issues from using narrow spectral components. In one embodiment, magenta as an integer value is resolved using the following equation:
rINT RINTI
MINT ¨ 2 [00282] The above equation assists in maintaining the fidelity of a magenta value while minimizing any metameric errors. This is advantageous over prior art, where magenta appears instead as a deep blue instead of the intended primary color value.
[00283] SIX-PRIMARY NON-CONSTANT LUMINANCE ENCODE USING A 4:2:2 SAMPLING METHOD
[00284] In one embodiment, the six-primary color system using a non-constant luminance encode for use with a 4:2:2 sampling method. In one embodiment, the encoding process and/or decoding process is compatible with transport through SMPTE ST 292-0 (2011), SMPTE ST 292-1 (2011, 2012, and/or 2018), SMPTE ST 292-2 (2011), SMPTE ST 2022-(2007), SMPTE ST 2022-2 (2007), SMPTE ST 2022-3 (2010), SMPTE ST 2022-4 (2011), SMPTE ST 2022-5 (2012 and/or 2013), SMPTE ST 2022-6 (2012), SMPTE ST 2022-7 (2013), and/or and CTA 861-G (2106), each of which is incorporated herein by reference in its entirety.
[00285] Current practices use a non-constant luminance path design, which is found in all the video systems currently deployed. FIG. 31 illustrates one embodiment of an encode process for 4:2:2 video for packaging five channels of information into the standard three-channel designs. For 4:2:2, a similar method to the 4:4:4 system is used to package five channels of information into the standard three-channel designs used in current serial video standards. FIG. 31 illustrates 12-bit SDI and 10-bit SDI encoding for a 4:2:2 system. Table 22 and Table 23 list bit assignments for a 12-bit and 10-bit system, respectively. In one embodiment, "Computer" refers to bit assignments compatible with CTA 861-G, November 2016, which is incorporated herein by reference in its entirety. In one embodiment, "Production" and/or "Broadcast" refer to bit assignments compatible with SMPTE
(2016), SMPTE ST 2082-1 (2015), SMPTE ST 2082-10 (2015), SMPTE ST 2082-11 (2016), SMPTE ST 2082-12 (2016), SMPTE ST 2110-10 (2017), SMPTE ST 2110-20 (2017), SMPTE ST 2110-21 (2017), SMPTE ST 2110-30 (2017), SMPTE ST 2110-31 (2018), and/or SMPTE ST 2110-40 (2018), each of which is incorporated herein by reference in its entirety.
[00286] TABLE 22: 12-Bit Assignments Computer Production Broadcast EY6 ECR,ECB ECc,ECy EY6 ECR,ECB ECc,E Cy EY6 ECR,EC- ECc,EC-B
Peak 4095 4095 0 4076 4076 16 3839 3839 256 Brightness Minimum 0 2048 2047 16 2052 2032 256 2304 1792 Brightness [00287] TABLE 23: 10-Bit Assignments Computer Production Broadcast EY6 ECR,ECB E Cc,E Cy EY6 ECR,ECB ECc,E Cy EY6 ECR,EC- ECc,EC-B
Peak 1023 1023 0 1019 1019 4 940 940 64 Brightness Minimum 0 512 511 4 516 508 64 576 448 Brightness [00288] FIG. 32 illustrates one embodiment for a non-constant luminance encoding process for a six-primary color system. The design of this process is similar to the designs used in current RGB systems. Input video is sent to the Optical Electronic Transfer Function (OETF) process and then to the Ey6encoder. The output of this encoder includes all of the image detail information. In one embodiment, all of the image detail information is output as a monochrome image.
[00289] The output is then subtracted from EL, EL, EL and E)C to make the following color difference components:
4R, 4B, These components are then half sampled (x2) while G6is fully sampled (x4).
[00290] FIG. 33 illustrates one embodiment of a packaging process for a six-primary color system. These components are then sent to the packing/stacking process.
Components Ey_INT and EL_INT are inverted so that bit 0 now defines peak luminance for the corresponding component. In one embodiment, this is the same packaging process performed with the 4:4:4 sampling method design, resulting in two 11-bit components combining into one 12-bit component.
[00291] SIX-PRIMARY NON-CONSTANT LUMINANCE DECODE USING A 4:2:2 SAMPLING METHOD
[00292] FIG. 34 illustrates a 4:2:2 unstack process for a six-primary color system. In one embodiment, the image data is extracted from the serial format through the normal processes as defined by the serial data format standard. In another embodiment, the serial data format standard uses a 4:2:2 sampling structure. In yet another embodiment, the serial data format standard is SMPTE 5T292. The color difference components are separated and formatted back to valid 11-bit data. Components Ec' Y-INT and EL-INT are inverted so that bit 2047 defines peak color luminance.
[00293] FIG. 35 illustrates one embodiment of a process to inversely quantize each individual color and pass the data through an electronic optical function transfer (EOTF) in a non-constant luminance system. The individual color components, as well as G6_ are INT
inversely quantized and summed to breakout each individual color. Magenta is then calculated and G6_,NTis combined with these colors to resolve green. These calculations then go back through an Electronic Optical Transfer Function (EOTF) process to output the six-primary color system.
[00294] In one embodiment, the decoding is 4:2:2 decoding. This decode follows the same principles as the 4:4:4 decoder. However, in 4:2:2 decoding, a luminance channel is used instead of discrete color channels. Here, image data is still taken prior to unstack from the EL3_1NT Ey_INT and E'R_INT EL_INT channels. With a 4:2:2 decoder, a new component, called E_fy, is used to subtract the luminance levels that are present from the CYM channels from the Ecf B-INT ECf Y-INT and ECf R-INT EL-INT components. The resulting output is now the R and B image components of the EOTF process. E_fy is also sent to the G matrix to convert the luminance and color difference components to a green output.
Thus, R'G'B ' is input to the EOTF process and output as GRGB, BRGB, and BRGB.
In another embodiment, the decoder is a legacy RGB decoder for non-constant luminance systems.
[00295] In one embodiment, the standard is SMPTE ST292. In one embodiment, the standard is SMPTE RP431-2. In one embodiment, the standard is ITU-R BT.2020.
In another embodiment, the standard is SMPTE RP431-1. In another embodiment, the standard is ITU-R
BT.1886. In another embodiment, the standard is SMPTE ST274. In another embodiment, the standard is SMPTE ST296. In another embodiment, the standard is SMPTE ST2084.
In yet another embodiment, the standard is ITU-R BT.2100. In yet another embodiment, the standard is SMPTE ST424. In yet another embodiment, the standard is SMPTE
ST425. In yet another embodiment, the standard is SMPTE ST2110.
[00296] SIX-PRIMARY CONSTANT LUMINANCE DECODE USING A 4:2:2 SAMPLING METHOD
[00297] FIG. 36 illustrates one embodiment of a constant luminance encode for a six-primary color system. FIG. 37 illustrates one embodiment of a constant luminance decode for a six-primary color system. The process for constant luminance encode and decode are very similar. The main difference being that the management of Ey6is linear. The encode and decode processes stack into the standard serial data streams in the same way as is present in a non-constant luminance, six-primary color system. In one embodiment, the stacker design is the same as with the non-constant luminance system.
[00298] System 2 operation is using a sequential method of mapping to the standard transport instead of the method in System 1 where pixel data is combined to two color primaries in one data set as an 11-bit word. The advantage of System 1 is that there is no change to the standard transport. The advantage of System 2 is that full bit level video can be transported, but at double the normal data rate.
[00299] The difference between the systems is the use of two Y channels in System 2.
YRGB and YCym are used to define the luminance value for RGB as one group and CYM for the other.
[00300] FIG. 38 illustrates one example of 4:2:2 non-constant luminance encoding.
Because the RGB and CYM components are mapped at different time intervals, there is no requirement for a stacking process and data is fed directly to the transport format. The development of the separate color difference components is identical to System 1.
[00301] The encoder for System 2 takes the formatted color components in the same way as System 1. Two matrices are used to build two luminance channels. YRGB
contains the luminance value for the RGB color primaries. YCym contains the luminance value for the CYM color primaries. A set of delays are used to sequence the proper channel for YRGB, YCIVIY, and the RBCY channels. Because the RGB and CYM components are mapped at different time intervals, there is no requirement for a stacking process, and data is fed directly to the transport format. The development of the separate color difference components is identical to System 1. The Encoder for System 2 takes the formatted color components in the same way as System 1. Two matrices are used to build two luminance channels:
YRGB
contains the luminance value for the RGB color primaries and Yon, contains the luminance value for the CMY color primaries. This sequences YRGB, CR, and CC channels into the even segments of the standardized transport and Yavry, CB, and CY into the odd numbered segments. Since there is no combining color primary channels, full bit levels can be used limited only by the design of the standardized transport method. In addition, for use in matrix driven displays, there is no change to the input processing and only the method of outputting the correct color is required if the filtering or emissive subpixel is also placed sequentially.
[00302] Timing for the sequence is calculated by the source format descriptor which then flags the start of video and sets the pixel timing.
[00303] FIG. 39 illustrates one embodiment of a non-constant luminance decoding system.
Decoding uses timing synchronization from the format descriptor and start of video flags that are included in the payload ID, SDP, or EDID tables. This starts the pixel clock for each horizontal line ot identify which set of components are routed to the proper part of the decoder. A pixel delay is used to realign the color primarily data of each subpixel. YRGB and YCIVIY are combined to assemble a new Y6 component which is used to decode the CR, CB, CC, CY, and CM components into RGBCYM.
[00304] The constant luminance system is not different from the non-constant luminance system in regard to operation. The difference is that the luminance calculation is done as a linear function instead of including the 00TF. FIG. 40 illustrates one embodiment of a 4:2:2 constant luminance encoding system. FIG. 41 illustrates one embodiment of a 4:2:2 constant luminance decoding system.
[00305] SIX-PRIMARY COLOR SYSTEM USING A 4:2:0 SAMPLING SYSTEM
[00306] In one embodiment, the six-primary color system uses a 4:2:0 sampling system.
The 4:2:0 format is widely used in H.262/MPEG-2, H.264/MPEG-4 Part 10 and VC-1 compression. The process defined in SMPTE RP2050-1 provides a direct method to convert from a 4:2:2 sample structure to a 4:2:0 structure. When a 4:2:0 video decoder and encoder are connected via a 4:2:2 serial interface, the 4:2:0 data is decoded and converted to 4:2:2 by up-sampling the color difference component. In the 4:2:0 video encoder, the 4:2:2 video data is converted to 4:2:0 video data by down-sampling the color difference component.
[00307] There typically exists a color difference mismatch between the 4:2:0 video data from the 4:2:0 video data to be encoded. Several stages of codec concatenation are common through the processing chain. As a result, color difference signal mismatch between 4:2:0 video data input to 4:2:0 video encoder and 4:2:0 video output from 4:2:0 video decoder is accumulated and the degradation becomes visible.
[00308] FILTERING WITHIN A SIX-PRIMARY COLOR SYSTEM USING A 4:2:0 SAMPLING METHOD
[00309] When a 4:2:0 video decoder and encoder are connected via a serial interface, 4:2:0 data is decoded and the data is converted to 4:2:2 by up-sampling the color difference component, and then the 4:2:2 video data is mapped onto a serial interface. In the 4:2:0 video encoder, the 4:2:2 video data from the serial interface is converted to 4:2:0 video data by down-sampling the color difference component. At least one set of filter coefficients exists for 4:2:0/4:2:2 up-sampling and 4:2:2/4:2:0 down-sampling. The at least one set of filter coefficients provide minimally degraded 4:2:0 color difference signals in concatenated operations.
[00310] FILTER COEFFICIENTS IN A SIX-PRIMARY COLOR SYSTEM USING A
4:2:0 SAMPLING METHOD
[00311] FIG. 42 illustrates one embodiment of a raster encoding diagram of sample placements for a six-primary color 4:2:0 progressive scan system. Within this compression process, horizontal lines show the raster on a display matrix. Vertical lines depict drive columns. The intersection of these is a pixel calculation. Data around a particular pixel is used to calculate color and brightness of the subpixels. Each "X" shows placement timing of the Ey6 sample. Red dots depict placement of the sample. Blue -/NT -INT EL-INT
triangles show placement of the Ecf B_INT ECf Y-INT sample.
[00312] In one embodiment, the raster is an RGB raster. In another embodiment, the raster is a RGBCYM raster.
[00313] SIX-PRIMARY COLOR SYSTEM BACKWARDS COMPATIBILITY
[00314] By designing the color gamut within the saturation levels of standard formats and using inverse color primary positions, it is easy to resolve an RGB image with minimal processing. In one embodiment for six-primary encoding, image data is split across three color channels in a transport system. In one embodiment, the image data is read as six-primary data. In another embodiment, the image data is read as RGB data. By maintaining a standard white point, the axis of modulation for each channel is considered as values describing two colors (e.g., blue and yellow) for a six-primary system or as a single color (e.g., blue) for an RGB system. This is based on where black is referenced. In one embodiment of a six-primary color system, black is decoded at a mid-level value. In an RGB
system, the same data stream is used, but black is referenced at bit zero, not a mid-level.
[00315] In one embodiment, the RGB values encoded in the 6P stream are based on ITU-R
BT.709. In another embodiment, the RGB values encoded are based on SMPTE
RP431.
Advantageously, these two embodiments require almost no processing to recover values for legacy display.
[00316] Two decoding methods are proposed. The first is a preferred method that uses very limited processing, negating any issues with latency. The second is a more straightforward method using a set of matrices at the end of the signal path to conform the 6P
image to RGB.
[00317] In one embodiment, the decoding is for a 4:4:4 system. In one embodiment, the assumption of black places the correct data with each channel. If the 6P
decoder is in the signal path, 11-bit values for RGB are arranged above data level 2048, while CYM level are arranged below data level 2047 as 11-bit. However, if this same data set is sent to a display or process that is does not understand 6P processing, then that image data is assumed as black at 0 level as a full 12-bit word.
[00318] FIG. 43 illustrates one embodiment of the six-primary color unstack process in a 4:2:2 video system. Decoding starts by tapping image data prior to the unstacking process.
The input to the 6P unstack will map as shown in FIG. 44. The output of the 6P
decoder will map as shown in FIG. 45. This same data is sent uncorrected as the legacy RGB
image data.
The interpretation of the RGB decode will map as shown in FIG. 46.
[00319] Alternatively, the decoding is for a 4:2:2 system. This decode uses the same principles as the 4:4:4 decoder, but because a luminance channel is used instead of discrete color channels, the processing is modified. Legacy image data is still taken prior to unstack from the .E.B_INT Ey_INT and .E.R_INT EL_INT channels as shown in FIG. 47.
[00320] FIG. 48 illustrates one embodiment of a non-constant luminance decoder with a legacy process. The dotted box marked (1) shows the process where a new component called Eiyis used to subtract the luminance levels that are present from the CYM
channels from the ECf B-INT ECf Y-INT and ECf R-INT Ecf c_INT components as shown in box (2).
The resulting output is now the R and B image components of the EOTF process. Eiyis also sent to the G
matrix to convert the luminance and color difference components to a green output as shown in box (3). Thus, R'G 'B ' is input to the EOTF process and output as GRGB, RRGB, and BRGB. In another embodiment, the decoder is a legacy RGB decoder for non-constant luminance systems.
[00321] For a constant luminance system, the process is very similar with the exception that green is calculated as linear as shown in FIG. 49.
[00322] SIX-PRIMARY COLOR SYSTEM USING A MATRIX OUTPUT
[00323] In one embodiment, the six-primary color system outputs a legacy RGB
image.
This requires a matrix output to be built at the very end of the signal path.
FIG. 50 illustrates one embodiment of a legacy RGB image output at the end of the signal path. The design logic of the C, M, and Y primaries is in that they are substantially equal in saturation and placed at substantially inverted hue angles compared to R, G, and B primaries, respectively. In one embodiment, substantially equal in saturation refers to a 10% difference in saturation values for the C, M, and Y primaries in comparison to saturation values for the R, G, and B
primaries, respectively. In addition, substantially equal in saturation covers additional percentage differences in saturation values falling within the 10% difference range. For example, substantially equal in saturation further covers a 7.5% difference in saturation values for the C, M, and Y primaries in comparison to the saturation values for the R, G, and B primaries, respectively; a 5% difference in saturation values for the C, M, and Y primaries in comparison to the saturation values for the R, G, and B primaries, respectively; a 2%
difference in saturation values for the C, M, and Y primaries in comparison to the saturation values for the R, G, and B primaries, respectively; a 1% difference in saturation values for the C, M, and Y primaries in comparison to the saturation values for the R, G, and B
primaries, respectively; and/or a 0.5% difference in saturation values for the C, M, and Y
primaries in comparison to the saturation values for the R, G, and B
primaries, respectively.
In a preferred embodiment, the C, M, and Y primaries are equal in saturation to the R, G, and B primaries, respectively. For example, the cyan primary is equal in saturation to the red primary, the magenta primary is equal in saturation to the green primary, and the yellow primary is equal in saturation to the blue primary.
[00324] In an alternative embodiment, the saturation values of the C, M, and Y
primaries are not required to be substantially equal to their corollary primary saturation value among the R, G, and B primaries, but are substantially equal in saturation to a primary other than their corollary R, G, or B primary value. For example, the C primary saturation value is not required to be substantially equal in saturation to the R primary saturation value, but rather is substantially equal in saturation to the G primary saturation value and/or the B primary saturation value. In one embodiment, two different color saturations are used, wherein the two different color saturations are based on standardized gamuts already in use.
[00325] In one embodiment, substantially inverted hue angles refers to a 10%
angle range from an inverted hue angle (e.g., 180 degrees). In addition, substantially inverted hue angles cover additional percentage differences within the 10% angle range from an inverted hue angle. For example, substantially inverted hue angles further covers a 7.5% angle range from an inverted hue angle, a 5% angle range from an inverted hue angle, a 2% angle range from an inverted hue angle, a 1% angle range from an inverted hue angle, and/or a 0.5% angle range from an inverted hue angle. In a preferred embodiment, the C, M, and Y
primaries are placed at inverted hue angles (e.g., 180 degrees) compared to the R, G, and B
primaries, respectively.
[00326] In one embodiment, the gamut is the ITU-R BT.709-6 gamut. In another embodiment, the gamut is the SMPTE RP431-2 gamut.
[00327] The unstack process includes output as six, 11-bit color channels that are separated and delivered to a decoder. To convert an image from a six-primary color system to an RGB image, at least two matrices are used. One matrix is a 3x3 matrix converting a six-primary color system image to XYZ values. A second matrix is a 3x3 matrix for converting from XYZ to the proper RGB color space. In one embodiment, XYZ values represent additive color space values, where XYZ matrices represent additive color space matrices.
Additive color space refers to the concept of describing a color by stating the amounts of primaries that, when combined, create light of that color.
[00328] When a six-primary display is connected to the six-primary output, each channel will drive each color. When this same output is sent to an RGB display, the CYM channels are ignored and only the RGB channels are displayed. An element of operation is that both systems drive from the black area. At this point in the decoder, all are coded as bit 0 being black and bit 2047 being peak color luminance. This process can also be reversed in a situation where an RGB source can feed a six-primary display. The six-primary display would then have no information for the CYM channels and would display the input in a standard RGB gamut. FIG. 51 illustrates one embodiment of six-primary color output using a non-constant luminance decoder. FIG. 52 illustrates one embodiment of a legacy RGB
process within a six-primary color system.
[00329] The design of this matrix is a modification of the CIE process to convert RGB to XYZ. First, u 'v' values are converted back to CIE 1931 xyz values using the following formulas:
9uf 4v, x= Y
(6uf -16vf +12) (6uf -16vf +12) [00330] Next, RGBCYM values are mapped to a matrix. The mapping is dependent upon the gamut standard being used. In one embodiment, the gamut is ITU-R BT.709-6.
The mapping for RGBCYM values for an ITU-R BT.709-6 (6P-B) gamut are:
1 [7 x Y z I (R 0.640 0.330 0.030 1 R G B C Y Al \I
II G i I I 0.300 0.600 0.100 x 0.640 0.300 0.150 0.439 0.165 0.319 1 B 0.150 0.060 0.790 I
I I 0.439 0540 0021 I
0.330 0.600 0.060 0.540 0.327 0.126 0..327 0.509 i 1 C . V
z 0.030 0.100 0.790 0.021 0.509 0.554/ I
I-1 Y 0.165 M 0.320 0.126 0.554) i ( 0.519 0.393 0.140 = 0.393 0.460 0.160 0.140 0.160 0.650 [00331] In one embodiment, the gamut is SMPTE RP431-2. The mapping for RGBCYM
values for a SMPTE RP431-2 (6P-C) gamut are:
[7 x Y 1 l(R 0.680 0.320 0.(z)00 1 R G B C Y M \ I
I I G 0.264 0.691 0.045 I i x 0.680 0.264 0.150 0.450 0.163 0.352 1 B 0.150 0.060 0.790 I
0.320 0.690 0.060 0.547 0.342 0.142 i 1 I I C 0.450 0.547 0.026 I V
z 0.000 0.045 0.790 0.026 0.496 0.505/ I
il Y 0.163 0.342 0.496) I- M 0.352 0.142 0.505 i ( 0.565 0.400 0.121 = 0.400 0.549 0.117 0.121 0.117 0.650 [00332] Following mapping the RGBCYM values to a matrix, a white point conversion Occurs:
x X=- Y=1 Z=1-x-y Y
[00333] For a six-primary color system using an ITU-R BT.709-6 (6P-B) color gamut, the white point is D65:
0.9504 = 0.3127 0.3584 = 1 - 0.3127 - 0.3290 0.3290 [00334] For a six-primary color system using a SMPTE RP431-2 (6P-C) color gamut, the white point is D60:
0.9541 = .3218 0.3410= 1 - 0.3218 - 0.3372 0.3372 [00335] Following the white point conversion, a calculation is required for RGB saturation values, SR, SG, and SB. The results from the second operation are inverted and multiplied with the white point XYZ values. In one embodiment, the color gamut used is an ITU-R BT.709-6 color gamut. The values calculate as:
SR
ITU-RBT.709-6 [
5.445 -4.644 -0.0253) (0.950)1 SG
SB =[( -4.644 6.337 -0.563 1 -0.0253 -0.563 1.682 0.358 Where riu-R BT.709-6 [
0.522 SG = 1.722 SB 0.015 [00336] In one embodiment, the color gamut is a SMPTE RP431-2 color gamut. The values calculate as:
[
3.692 -2.649 -0.211) (0.951 = [( -2.649 3.795 -0.189 -0.211 -0.189 1.611 0.341)]
Where riSMPTE RP431-2 [
0.802 SG = 1.203 SB 0.159 [00337] Next, a six-primary color-to-XYZ matrix must be calculated. For an embodiment where the color gamut is an ITU-R BT.709-6 color gamut, the calculation is as follows:
ryi _ [(00..359 193 00..439 60 60 3 00j1140)ITU-R BT.709- .
6 (0 522 1.722 0153\D65 0.522 1.722 0.153 [Z] I_0.140 0.160 0.650) 0.522 1.722 0.153 Wherein the resulting matrix is multiplied by the SRSoSn matrix:
ITU-R BT.709-6 [Xyl _ [00..22 7051 00..679727 00..0000231 1 B 1 [Z] [0.073 0.276 0.010] I y I
[m]
[00338] For an embodiment where the color gamut is a SMPTE RP431-2 color gamut, the calculation is as follows:
-2 .-,-, D60 ryi,[(00..456051 00..454091 02 0..11171 0..88002 0 2 11..2203 01b 3 0..15 Z 0.121 0.117 0.650 0.802 1.203 0.159 Wherein the resulting matrix is multiplied by the SRSoSn matrix:
[Xyl _ [00..4325 31 00..468620 00..0011991 1B 1 [Z] [0.097 0.141 0.103] I y I
[m]
[00339] Finally, the XYZ matrix must converted to the correct standard color space. In an embodiment where the color gamut used is an ITU-R BT709.6 color gamut, the matrices are as follows:
rB IITU-R BT709.6 3.241 ¨1.537 ¨0.4991 ri G = ¨0.969 1.876 0.042 Y
0.056 ¨0.204 1.057 Z
[00340] In an embodiment where the color gamut used is a SMPTE RP431-2 color gamut, the matrices are as follows:
[ R SMPTE RP431-2 2.73 ¨1.018 ¨0.4401 ri G = ¨0.795 1.690 0.023 Y
B 0.041 ¨0.088 1.101 Z
[00341] PACKING A SIX-PRIMARY COLOR SYSTEM INTO ICTCp [00342] ICTCp (ITP) is a color representation format specified in the Rec. ITU-R BT.2100 standard that is used as a part of the color image pipeline in video and digital photography systems for high dynamic range (HDR) and wide color gamut (WCG) imagery. The I
(intensity) component is a luma component that represents the brightness of the video. CT and Cp are blue-yellow ("tritanopia") and red-green ("protanopia") chroma components. The format is derived from an associated RGB color space by a coordination transformation that includes two matrix transformations and an intermediate non-linear transfer function, known as a gamma pre-correction. The transformation produces three signals: I, CT, and Cp. The ITP
transformation can be used with RGB signals derived from either the perceptual quantizer (PQ) or hybrid log-gamma (HLG) nonlinearity functions. The PQ curve is described in ITU-R BT2100-2:2018, Table 4, which is incorporated herein by reference in its entirety.
[00343] FIG. 53 illustrates one embodiment of packing six-primary color system image data into an ICTCp (ITP) format. In one embodiment, RGB image data is converted to an XYZ matrix. The XYZ matrix is then converted to an LMS matrix. The LMS matrix is then sent to an optical electronic transfer function (OETF). The conversion process is represented below:
[LI [(an a12 a13) ( 0.359 0.696 -0.036)1 ri M = a21 a22 a23 -0.192 1.100 0.075 G
S a31 a32 a33 0.007 0.075 0.843 B
Output from the OETF is converted to ITP format. The resulting matrix is:
(0.5 0.5 0 1.614 -3.323 1.710 4.378 -4.246 -0.135) [00344] FIG. 54 illustrates one embodiment of a six-primary color system converting RGBCYM image data into XYZ image data for an ITP format (e.g., 6P-B, 6P-C).
For a six-primary color system, this is modified by replacing the RGB to XYZ matrix with a process to convert RGBCYM to XYZ. This is the same method as described in the legacy RGB
process.
The new matrix is as follows for an ITU-R BT.709-6 (6P-B) color gamut:
ITU-R BT.709-6 [L I (0.271 0.677 0.002) ( 0.359 0.696 -0.036) I G I
B
M = 0.205 0.792 0.003 -0.192 1.100 0.075 lc S 0.073 0.277 0.100 0.007 0.075 0.843 I y [M-1 [00345] RGBCYM data, based on an ITU-R BT.709-6 color gamut, is converted to an XYZ matrix. The resulting XYZ matrix is converted to an LMS matrix, which is sent to an OETF. Once processed by the OETF, the LMS matrix is converted to an ITP
matrix. The resulting ITP matrix is as follows:
(0.5 0.5 0 1.614 -3.323 1.710 4.378 -4.246 -0.135) [00346] In another embodiment, the LMS matrix is sent to an Optical Optical Transfer Function (00TF). In yet another embodiment, the LMS matrix is sent to a Transfer Function other than 00TF or OETF.
[00347] In another embodiment, the RGBCYM data is based on the SMPTE ST431-2 (6P-C) color gamut. The matrices for an embodiment using the SMPTE ST431-2 color gamut are as follows:
[R1 [L I (0.453 0.481 0.019 0.359 0.696 ¨0.036 I G
B
M = 0.321 0.660 0.019 ¨0.192 1.100 0.075 lc 0.097 0.141 0.103 0.007 0.075 0.843 I y [M-1 The resulting ITP matrix is:
(0.5 0.5 0 1.614 ¨3.323 1.710 4.378 ¨4.246 ¨0.135) [00348] The decode process uses the standard ITP decode process, as the SRSGSB
cannot be easily inverted. This makes it difficult to recover the six RGBCYM
components from the ITP encode. Therefore, the display is operable to use the standard ICtCp decode process as described in the standards and is limited to just RGB output.
[00349] CONVERTING TO A FIVE-COLOR MULTI-PRIMARY DISPLAY
[00350] In one embodiment, the system is operable to convert image data incorporating five primary colors. In one embodiment, the five primary colors include Red (R), Green (G), Blue (G), Cyan (C), and Yellow (Y), collectively referred to as RGBCY. In another embodiment, the five primary colors include Red (R), Green (G), Blue (B), Cyan (C), and Magenta (M), collectively referred to as RGBCM. In one embodiment, the five primary colors do not include Magenta (M).
[00351] In one embodiment, the five primary colors include Red (R), Green (G), Blue (B), Cyan (C), and Orange (0), collectively referred to as RGBCO. RGBCO primaries provide optimal spectral characteristics, transmittance characteristics, and makes use of a D65 white point. See, e.g., Moon-Cheol Kim et al., Wide Color Gamut Five Channel Multi-Primary for HDTV Application, Journal of Imaging Sci. & Tech. Vol. 49, No. 6, Nov./Dec.
2005, at 594-604, which is hereby incorporated by reference in its entirety.
[00352] In one embodiment, a five-primary color model is expressed as F = M.
C, where F
is equal to a tristimulus color vector, F = (X, Y, Z)T, and C is equal to a linear display control vector, C = (Cl, C2, C3, C4, C5)T. Thus, a conversion matrix for the five-primary color model is represented as M = ( Y1 Y2 Y3 Y4 Y5 Z2 Z3 Z4 Zs [00353] Using the above equation and matrix, a gamut volume is calculated for a set of given control vectors on the gamut boundary. The control vectors are converted into CIELAB
uniform color space. However, because matrix M is non-square, the matrix inversion requires splitting the color gamut into a specified number of pyramids, with the base of each pyramid representing an outer surface and where the control vectors are calculated using linear equation for each given XYZ triplet present within each pyramid. By separating regions into pyramids, the conversion process is normalized. In one embodiment, a decision tree is created in order to determine which set of primaries are best to define a specified color. In one embodiment, a specified color is defined by multiple sets of primaries. In order to locate each pyramid, 2D chromaticity look-up tables are used, with corresponding pyramid numbers for input chromaticity values in xy or u'v' . Typical methods using pyramids require 1000 x 1000 address ranges in order to properly search the boundaries of adjacent pyramids with look-up table memory. The system of the present invention uses a combination of parallel processing for adjacent pyramids and at least one algorithm for verifying solutions by checking constraint conditions. In one embodiment, the system uses a parallel computing algorithm. In one embodiment, the system uses a sequential algorithm. In another embodiment, the system uses a brightening image transformation algorithm. In another embodiment, the system uses a darkening image transformation algorithm. In another embodiment, the system uses an inverse sinusoidal contrast transformation algorithm. In another embodiment, the system uses a hyperbolic tangent contrast transformation algorithm. In yet another embodiment, the system uses a sine contrast transformation execution times algorithm. In yet another embodiment, the system uses a linear feature extraction algorithm. In yet another embodiment, the system uses a JPEG2000 encoding algorithm. In yet another embodiment, the system uses a parallelized arithmetic algorithm. In yet another embodiment, the system uses an algorithm other than those previously mentioned. In yet another embodiment, the system uses any combination of the aforementioned algorithms.
[00354] MAPPING A SIX-PRIMARY COLOR SYSTEM INTO STANDARDIZED
TRANSPORT FORMATS
[00355] Each encode and/or decode system fits into existing video serial data streams that have already been established and standardized. This is key to industry acceptance. Encoder and/or decoder designs require little or no modification for a six-primary color system to map to these standard serial formats.
[00356] FIG. 55 illustrates one embodiment of a six-primary color system mapping to a SMPTE 5T424 standard serial format. The SMPTE 5T424/5T425 set of standards allow very high sampling systems to be passed through a single cable. This is done by using alternating data streams, each containing different components of the image. For use with a six-primary color system transport, image formats are limited to RGB due to the absence of a method to send a full bandwidth Y signal.
[00357] The process for mapping a six-primary color system to a SMPTE 5T425 format is the same as mapping to a SMPTE 5T424 format. To fit a six-primary color system into a SMPTE 5T425/424 stream involves the following substitutions: G;NT M;NT is placed in the Green data segments, RfiNT CINT is placed in the Red data segments, and B;NT YINT is placed into the Blue data segments. FIG. 56 illustrates one embodiment of an readout.
[00358] System 2 requires twice the data rate as System 1, so it is not compatible with SMPTE 424. However, it maps easily into SMPTE 5T2082 using a similar mapping sequence. In one example, System 2 is used to have the same data speed defined for 8K
imaging to show a 4K image.
[00359] In one embodiment, sub-image and data stream mapping occur as shown in SMPTE 5T2082. An image is broken into four sub-images, and each sub-image is broken up into two data streams (e.g., sub-image 1 is broken up into data stream 1 and data stream 2).
The data streams are put through a multiplexer and then sent to the interface as shown in FIG.
57.
[00360] FIG. 58 and FIG. 59 illustrate serial digital interfaces for a six-primary color system using the SMPTE 5T2082 standard. In one embodiment, the six-primary color system data is RGBCYM data, which is mapped to the SMPTE 5T2082 standard (FIG. 58).
Data streams 1, 3, 5, and 7 follow the pattern shown for data stream 1. Data streams 2, 4, 6, and 8 follow the pattern shown for data stream 2. In one embodiment, the six-primary color system data is YRGB YCYM CR CB CC CY data, which is mapped to the SMPTE 5T2082 standard (FIG.
59). Data streams 1, 3, 5, and 7 follow the pattern shown for data stream 1.
Data streams 2, 4, 6, and 8 follow the pattern shown for data stream 2.
[00361] In one embodiment, the standard serial format is SMPTE 5T292. SMPTE
is an older standard than 5T424 and is a single wire format for 1.5GB video, whereas 5T424 is designed for up to 3GB video. However, while 5T292 can identify the payload ID of SMPTE 5T352, it is constrained to only accepting an image identified by a hex value, Oh. All other values are ignored. Due to the bandwidth and identifications limitations in 5T292, a component video six-primary color system incorporates a full bit level luminance component.
To fit a six-primary color system into a SMPTE ST292 stream involves the following substitutions: G6_INT is placed in the Y data segments, Ec' b_INTINT is placed in the Cb data segments, and E!-ur¨INT EL¨INT is placed in the Cr data segments. In another embodiment, the standard serial format is SMPTE ST352.
[00362] SMPTE ST292 and ST424 Serial Digital Interface (SDI) formats include payload identification (ID) metadata to help the receiving device identify the proper image parameters. The tables for this need modification by adding at least one flag identifying that the image source is a six-primary color RGB image. Therefore, six-primary color system format additions need to be added. In one embodiment, the standard is the standard.
[00363] FIG. 60 illustrates one embodiment of an SMPTE 5T292 6P mapping. FIG.
illustrates one embodiment of an SMPTE 5T292 6P readout.
[00364] FIG. 62 illustrates modifications to the SMPTE 5T352 standards for a six-primary color system. Hex code "Bh" identifies a constant luminance source and flag "Fh" indicates the presence of a six-primary color system. In one embodiment, Fh is used in combination with at least one other identifier located in byte 3. In another embodiment, the Fh flag is set to 0 if the image data is formatted as System 1 and the Fh flag is set to 1 if the image data is formatted as System 2.
[00365] In another embodiment, the standard serial format is SMPTE 5T2082.
Where a six-primary color system requires more data, it may not always be compatible with SMPTE
5T424. However, it maps easily into SMPTE 5T2082 using the same mapping sequence.
This usage would have the same data speed defined for 8K imaging in order to display a 4K
image.
[00366] In another embodiment, the standard serial format is SMPTE 5T2022.
Mapping to 5T2022 is similar to mapping to 5T292 and 5T242, but as an ETHERNET format.
The output of the stacker is mapped to the media payload based on Real-time Transport Protocol (RTP) 3550, established by the Internet Engineering Task Force (IETF). RTP
provides end-to-end network transport functions suitable for applications transmitting real-time data, including, but not limited to, audio, video, and/or simulation data, over multicast or unicast network services. The data transport is augmented by a control protocol (RTCP) to allow monitoring of the data delivery in a manner scalable to large multicast networks, and to provide control and identification functionality. There are no changes needed in the formatting or mapping of the bit packing described in SMPTE ST 2022-6: 2012 (HBRMT).
[00367] FIG. 63 illustrates one embodiment of a modification for a six-primary color system using the SMPTE 5T2202 standard. For SMPTE 5T2202-6:2012 (HBRMT), there are no changes needed in formatting or mapping of the bit packing. 5T2022 relies on header information to correctly configure the media payload. Parameters for this are established within the payload header using the video source format fields including, but not limited to, MAP, FRAME, FRATE, and/or SAMPLE. MAP, FRAME, and FRATE remain as described in the standard. MAP is used to identify if the input is 5T292 or 5T425 (RGB
or Y Cb Cr).
SAMPLE is operable for modification to identify that the image is formatted as a six-primary color system image. In one embodiment, the image data is sent using flag "Oh"
(unknown/unspecified).
[00368] In another embodiment, the standard is SMPTE 5T2110. SMPTE ST2110 is a relatively new standard and defines moving video through an Internet system.
The standard is based on development from the IETF and is described under RFC3550. Image data is described through "pgroup" construction. Each pgroup consists of an integer number of octets. In one embodiment, a sample definition is RGB or YCbCr and is described in metadata. In one embodiment, the metadata format uses a Session Description Protocol (SDP) format. Thus, pgroup construction is defined for 4:4:4, 4:2:2, and 4:2:0 sampling as 8-bit, 10-bit, 12-bit, and in some cases 16-bit and 16-bit floating point wording. In one embodiment, six-primary color image data is limited to a 10-bit depth. In another embodiment, six-primary color image data is limited to a 12-bit depth. Where more than one sample is used, it is described as a set. For example, 4:4:4 sampling for blue, as a non-linear RGB set, is described as CO'B, C l'B, C2'B, C3'B, and C4'B. The lowest number index being left most within the image. In another embodiment, the method of substitution is the same method used to map six-primary color content into the ST2110 standard.
[00369] In another embodiment, the standard is SMPTE ST2110. SMPTE ST2110-20 describes the construction for each pgroup. In one embodiment, six-primary color system content arrives for mapping as non-linear data for the SMPTE ST2110 standard.
In another embodiment, six-primary color system content arrives for mapping as linear data for the SMPTE ST2110 standard.
[00370] FIG. 64 illustrates a table of 4:4:4 sampling for a six-primary color system for a 10-bit video system. For 4:4:4 10-bit video, 15 octets are used and cover 4 pixels.
[00371] FIG. 65 illustrates a table of 4:4:4 sampling for a six-primary color system for a 12-bit video system. For 4:4:4 12-bit video, 9 octets are used and cover 2 pixels before restarting the sequence.
[00372] Non-linear GRBMYC image data would arrive as: G;NT __,NT, R;NT C;NT, and B;NT YlfNT= Component substitution would follow what has been described for SMPTE
ST424, where G;NT M;NT is placed in the Green data segments, R;NT C;NT is placed in the Red data segments, and B;NT YINT is placed in the Blue data segments. The sequence described in the standard is shown as RO', GO', BO', R1', G1', B1', etc.
[00373] FIG. 66 illustrates sequence substitutions for 10-bit and 12-bit video in 4:2:2 sampling systems in a Y Cb Cr Cc Cy color space. Components are delivered to a 4:2:2 pgroup including, but not limited to, G6_1NT, Ecf b_INT Ecf y_INT, and Ecfr_iNT + Ecfc-iNT=
For 4:2:2 10-bit video, 5 octets are used and cover 2 pixels before restarting the sequence. For 4:2:2 12-bit video, 6 octets are used and cover 2 pixels before restarting the sequence.
Component substitution follows what has been described for SMPTE ST292, where G6_1NT
is placed in the Y data segments, Ecf b_INT Ecf y_INT is placed in the Cb data segments, and ECf r-INT EL-INT is placed in the Cr data segments. The sequence described in the standard is shown as Cb0', YO', Cr0', Y1', Crl', Y3', Cb2', Y4', Cr2', Y5', etc. In another embodiment, the video data is represented at a bit level other than 10-bit or 12-bit. In another embodiment, the sampling system is a sampling system other than 4:2:2. In another embodiment, the standard is STMPE ST2110.
[00374] FIG. 67 illustrates sample placements of six-primary system components for a 4:2:2 sampling system image. This follows the substitutions illustrated in FIG. 66, using a 4:2:2 sampling system.
[00375] FIG. 68 illustrates sequence substitutions for 10-bit and 12-bit video in 4:2:0 sampling systems using a Y Cb Cr Cc Cy color space. Components are delivered to a pgroup including, but not limited to, G6_1NT, Ecf b_INT and EL_INT. For 4:2:0 10-bit video data, 15 octets are used and cover 8 pixels before restarting the sequence. For 4:2:0 12-bit video data, 9 octets are used and cover 4 pixels before restarting the sequence.
Component substitution follows what is described in SMPTE ST292 where Eyf 6_1NT is placed in the Y data segments, Ecf b-INT EcfINT is placed in the Cb data segments, and Ecf r-INT
EL-INT is placed in the Cr data segments. The sequence described in the standard is shown as Y'00, Y'01, Y', etc.
[00376] FIG. 69 illustrates sample placements of six-primary system components for a 4:2:0 sampling system image. This follows the substitutions illustrated in FIG. 68, using a 4:2:0 sampling system.
[00377] FIG. 70 illustrates modifications to SMPTE ST2110-20 for a 10-bit six-primary color system in 4:4:4 video. SMPTE ST2110-20 describes the construction of each "pgroup".
Normally, six-primary color system data and/or content would arrive for mapping as non-linear. However, with the present system there is no restriction on mapping data and/or content. For 4:4:4, 10-bit video, 15 octets are used and cover 4 pixels before restarting the sequence. Non-linear, six-primary color system image data would arrive as G;NT, B;NT, R;NT, KNIT, YINT, and C;NT. The sequence described in the standard is shown as RO', GO', BO', R1', G1', B1', etc.
[00378] FIG. 71 illustrates modifications to SMPTE ST2110-20 for a 12-bit six-primary color system in 4:4:4 video. For 4:4:4, 12-bit video, 9 octets are used and cover 2 pixels before restarting the sequence. Non-linear, six-primary color system image data would arrive as G;NT, -114:INT,ITINT, and C.INT= The sequence described in the standard is shown as RO', GO', BO', R1', G1', B1', etc.
[00379] FIG. 72 illustrates modifications to SMPTE ST2110-20 for a 10-bit six primary color system in 4:2:2 video. Components that are delivered to a SMPTE ST2110 pgroup include, but are not limited to, Eyf rgb-INT, Gcym-INT, ECf b-INT, ECf r-INT, ECf y-INT, and Ecfc-iNT= For 4:2:2, 10-bit video, 5 octets are used and cover 2 pixels before restarting the sequence. For 4:2:2:2, 12-bit video, 6 octets are used and cover 2 pixels before restarting the sequence. Component substitution follows what is described for SMPTE ST292, where EYf rgb-INT or EYf cym-INT are placed in the Y data segments, Ecfr_iNT or E
-cf c-INT are placed in the Cr data segments, and Ecf b-INT or EcfINT are placed in the Cb data segments. The sequence described in the standard is shown as Cb'0, Y'0, Cr'0, Y'l, Cb'l, Y'2, Cr'1, Y'3, Cb'2, Y'4, Cr'2, etc.
[00380] FIG. 73 illustrates modifications to SMPTE ST2110-20 for a 12-bit six-primary color system in 4:2:0 video. Components that are delivered to a SMPTE ST2110 pgroup are the same as with the 4:2:2 method. For 4:2:0, 10-bit video, 15 octets are used and cover 8 pixels before restarting the sequence. For 4:2:0, 12-bit video, 9 octets are used and cover 4 pixels before restarting the sequence. Component substitution follows what is described for SMPTE ST292, where E,f7 rgb-INT or E3Tcym-I NT are placed in the Y data segments, ur -INT or EL-INT are placed in the Cr data segments, and 4b-INT or 43,_INT are placed in the Cb data segments. The sequence described in the standard is shown as Y'00, Y'01, Y', etc.
[00381] Table 24 summarizes mapping to SMPTE ST2110 for 4:2:2:2:2 and 4:2:0:2:0 sampling for System 1 and Table 25 summaries mapping to SMPTE 5T2110 for 4:4:4:4:4:4 sampling (linear and non-linear) for System 1.
[00382] TABLE 24 Sampling Bit Depth Pgroup Y PbPr Sample Order 6P Sample Order Octets Pixels 4:2:2:2:2 8 4 2 CB', YO Y/ ' 5 2 CB', YO Y/ ' CB' Cy', YO ^ Y/ ' 12 6 2 CB', YO Y/ ' CB' Cy', YO ^ Y/ ' 16,16f 8 2 C 'B, Y '0, C 'R, CB' Cy', YO ^ Y/ ' 4:2:0:2:0 8 6 4 Y'00,Y'01,Y'10,Y'll, CB'00, CR'100 10 15 8 Y'00,Y'01,Y'10,Y'll, Y'00,Y'01,Y10,Y11,CB'00 Cy'00, CB'00, CR'100 CR'00 Cc'00 Y'02,Y'03,Y'12,Y'13, Y'02,Y'03,Y'12,Y'13,CB'01 Cy01, CB'01, CR'101 CR'01 C'c'01 12 9 4 Y'00,Y'01,Y'10,Y'll, Y'00,Y'01,Y10,Y11,CB'00 Cy00, CB'00, CR'100 CR'00 Cc'00 [00383] TABLE 25 Sampling Bit pgroup RGB Sample Order 6P Sample Order Depth Octets pixels 4:4:4:4:4:4 8 3 1 R,G,B
Linear 10 15 4 RO, GO, BO, R1, Gl, Bl, R+CO, G+MO, B+YO, R2, G2,B2 R+Cl, G+Ml, B+Yl, R+C2, G+M2, B+Y2 12 9 2 RO, GO, BO, R1, Gl, B1 R+CO, G+MO, B+YO, R+Cl, G+Ml, B+Y1 16,16f 6 1 R, G, B R+C, G+M, B+Y
4:4:4:4:4:4 8 3 1 R', G', B' Non- 10 15 4 RO', GO', BO', R1', G1', R' C'0, G'+M'O, Linear B1', R2', G2',B2' B '+Y'0, R'+C '1, G'+M'1, B' Y'l, R'+C '2, G'+M'2, B'+Y'2 12 9 2 RO', GO', BO', R1', G1', R' C'0, G'+M'O, Bl' B '+Y'0, R'+C'1, G'+M'1, B '+Y'l 16,16f 6 1 R', G', B' R'+C', G'+M', B'+Y' [00384] Table 26 summarizes mapping to SMPTE ST2110 for 4:2:2:2:2 sampling for System 2 and Table 27 summaries mapping to SMPTE ST2110 for 4:4:4:4:4:4 sampling (linear and non-linear) for System 2.
[00385] TABLE 26 Sampling Bit pgroup Y PbPr Sample 6P Sample Order Depth octets pixels Order 4:2:2:2:2 8 8 2 CB',Y0',CR',Y1' CB', Cy', YRGB0',CR', CC', YCMY0' CB', Cy', YRGB1 10 2 CB',Y0',CR',Y1' CB', Cy, YRGB0',CR', CC', YCMY0' CB', Cr', YRGB1 12 12 2 CB',Y0',CR',Y1' CB', Cy', YRGB0',CR', CC', YCMY0' CB', Cr', YRGB1 16, 16f 16 2 C 'B, Y '0, C 'B, /71 CB', Cy', YRGB0',CR', CC', YCMY0' CB', Cr', YRGB1 [00386] TABLE 27 Sampling Bit pgroup RGB Sample Order 6P Sample Order Depth octets pixels 4:4:4:4:4:4 8 3 1 R,G,B R,C,G,M,B,Y
Linear 10 15 4 RO, GO, BO, R1, Gl, RO,CO,GO,MO,BO,YO,R1,C1,G1,M
Bl, R2, G2,B2 1,B 1,Y 1,R2,C2, G2,M2,B2+Y2 12 9 2 RO, GO, BO, R1, Gl, RO,CO,GO,MO,BO,Y0, B1 R1,C1,G1,M1,B1,Y1 16, 16f 6 1 R, G, B R,C,G,M,B,Y
4:4:4:4:4:4 8 3 1 R', G', B' R',C',G',M',B',Y' Non-Linear 10 15 4 RO GO', BO', R1', RO ',CO
',G0',M0',B0',Y0',R1 ',C1 ' G1', B1', R2', ,G1',M1',B1',Y1',R2',C2 G2 ',B2 ' G2 ',M2 ',B2 '+Y2 ' 12 9 2 RO', GO', BO', R1', R0',C0',G0',M0',B0',Y0', G1', B1 ' R1 ',C1 ',G1 ',M1',B1',Y1 ' 16,16f 6 1 R', G', B' R',C',G',M',B',Y' [00387] SESSION DESCRIPTION PROTOCOL (SDP) MODIFICATION FOR A SIX-PRIMARY COLOR SYSTEM
[00388] SDP is derived from IETF RFC 4566 which sets parameters including, but not limited to, bit depth and sampling parameters. In one embodiment, SDP
parameters are contained within the RTP payload. In another embodiment, SDP parameters are contained within the media format and transport protocol. This payload information is transmitted as text. Therefore, modifications for the additional sampling identifiers requires the addition of new parameters for the sampling statement. SDP parameters include, but are not limited to, color channel data, image data, framerate data, a sampling standard, a flag indicator, an active picture size code, a timestamp, a clock frequency, a frame count, a scrambling indicator, and/or a video format indicator. For non-constant luminance imaging, the additional parameters include, but are not limited to, RGBCYM-4:4:4, YBRCY-4:2:2, and YBRCY-4:2:0. For constant luminance signals, the additional parameters include, but are not limited to, CLYBRCY-4:2:2 and CLYBRCY-4:2:0.
[00389] Additionally, differentiation is included with the colorimetry identifier in one embodiment. For example, 6PB1 defines 6P with a color gamut limited to ITU-R
BT.709 formatted as System 1, 6PB2 defines 6P with a color gamut limited to ITU-R
BT.709 formatted as System 2, 6PB3 defines 6P with a color gamut limited to ITU-R
BT.709 formatted as System 3, 6PC1 defines 6P with a color gamut limited to SMPTE RP
formatted as System 1, 6PC2 defines 6P with a color gamut limited to SMPTE RP
formatted as System 2, 6PC3 defines 6P with a color gamut limited to SMPTE RP
formatted as System 3, 6PS1 defines 6P with a color gamut as Super 6P
formatted as System 1, 6P52 defines 6P with a color gamut as Super 6P formatted as System 2, and 6P53 defines 6P with a color gamut as Super 6P formatted as System 3.
[00390] Colorimetry can also be defined between a six-primary color system using the ITU-R BT.709-6 standard and the SMPTE 5T431-2 standard, or colorimetry can be left defined as is standard for the desired standard. For example, the SDP
parameters for a 1920x1080 six-primary color system using the ITU-R BT.709-6 standard with a 10-bit signal as System 1 are as follows: m = video 30000 RTP/AVP 112, a = rtpmap:112 raw/90000, a =
fmtp:112, sampling = YBRCY-4:2:2, width = 1920, height = 1080, exactframerate =
30000/1001, depth = 10, TCS = SDR, colorimetry = 6PB1, PM = 2110GPM, SSN =
20:2017.
[00391] In one embodiment, the six-primary color system is integrated with a Consumer Technology Association (CTA) 861-based system. CTA-861 establishes protocols, requirements, and recommendations for the utilization of uncompressed digital interfaces by consumer electronics devices including, but not limited to, digital televisions (DTVs), digital cable, satellite or terrestrial set-top boxes (STBs), and related peripheral devices including, but not limited to, DVD players and/or recorders, and other related Sources or Sinks.
[00392] These systems are provided as parallel systems so that video content is parsed across several line pairs. This enables each video component to have its own transition-minimized differential signaling (TMDS) path. TMDS is a technology for transmitting high-speed serial data and is used by the Digital Visual Interface (DVI) and High-Definition Multimedia Interface (HDMI) video interfaces, as well as other digital communication interfaces. TMDS is similar to low-voltage differential signaling (LVDS) in that it uses differential signaling to reduce electromagnetic interference (EMI), enabling faster signal transfers with increased accuracy. In addition, TMDS uses a twisted pair for noise reduction, rather than a coaxial cable that is conventional for carrying video signals.
Similar to LVDS, data is transmitted serially over the data link. When transmitting video data, and using HDMI, three TMDS twisted pairs are used to transfer video data.
[00393] In such a system, each pixel packet is limited to 8 bits only. For bit depths higher than 8 bits, fragmented packs are used. This arrangement is no different than is already described in the current CTA-861 standard.
[00394] Based on CTA extension Version 3, identification of a six-primary color transmission would be performed by the sink device (e.g., the monitor). Adding recognition of the additional formats would be flagged in the CTA Data Block Extended Tag Codes (byte 3). Since codes 33 and above are reserved, any two bits could be used to identify that the format is RGB, RGBCYM, Y Cb Cr, or Y Cb Cr Cc Cy and/or identify System 1 or System 2. Should byte 3 define a six-primary sampling format, and where the block 5 extension identifies byte 1 as ITU-R BT.709, then logic assigns as 6P-B. However, should byte 4 bit 7 identify colorimetry as DCI-P3, the color gamut would be assigned as 6P-C.
[00395] In one embodiment, the system alters the AVI Infoframe Data to identify content.
AVI Infoframe Data is shown in Table 10 of CTA 861-G. In one embodiment, Y2=1, Y1=0, and YO=0 identifies content as 6P 4:2:0:2:0. In another embodiment, Y2=1, Y1=0, and YO=1 identifies content as Y Cr Cb Cc Cy. In yet another embodiment, Y2=1, Y1=1, and YO=0 identifies content as RGBCMY.
[00396] Byte 2 C1=1, C0=1 identifies extended colorimetry in Table 11 of CTA
861-G.
Byte 3 EC2, EC1, ECO identifies additional colorimetry extension valid in Table 13 of CTA
861-G. Table 14 of CTA 861-G reserves additional extensions. In one embodiment, ACE3=1, ACE2=0, ACE1=0, and ACE0=X identifies 6P-B. In one embodiment, ACE3=0, ACE2=1, ACE1=0, and ACE0=X identifies 6P-C. In one embodiment, ACE3=0, ACE2=0, ACE1=1, and ACE0=X identifies System 1. In one embodiment, ACE3=1, ACE2=1, ACE1=0, and ACE0=X identifies System 2.
[00397] FIG. 74 illustrates the current RGB sampling structure for 4:4:4 sampling video data transmission. For HDMI 4:4:4 sampling, video data is sent through three TMDS line pairs. FIG. 75 illustrates a six-primary color sampling structure, RGBCYM, using System 1 for 4:4:4 sampling video data transmission. In one embodiment, the six-primary color sampling structure complies with CTA 861-G, November 2016, Consumer Technology Association, which is incorporated herein by reference in its entirety. FIG.
76 illustrates an example of System 2 to RGBCYM 4:4:4 transmission. FIG. 77 illustrates current Y Cb Cr 4:2:2 sampling transmission as non-constant luminance. FIG. 78 illustrates a six-primary color system (System 1) using Y Cr Cb Cc Cy 4:2:2 sampling transmission as non-constant luminance. FIG. 79 illustrates an example of a System 2 to Y Cr Cb Cc Cy 4:2:2 Transmission as non-constant luminance. In one embodiment, the Y Cr Cb Cc Cy 4:2:2 sampling transmission complies with CTA 861-G, November 2016, Consumer Technology Association. FIG. 80 illustrates current Y Cb Cr 4:2:0 sampling transmission.
FIG. 81 illustrates a six-primary color system (System 1) using Y Cr Cb Cc Cy 4:2:0 sampling transmission.
[00398] HDMI sampling systems include Extended Display Identification Data (EDID) metadata. EDID metadata describes the capabilities of a display device to a video source. The data format is defined by a standard published by the Video Electronics Standards Association (VESA). The EDID data structure includes, but is not limited to, manufacturer name and serial number, product type, phosphor or filter type, timings supported by the display, display size, luminance data, and/or pixel mapping data. The EDID
data structure is modifiable and modification requires no additional hardware and/or tools.
[00399] EDID information is transmitted between the source device and the display through a display data channel (DDC), which is a collection of digital communication protocols created by VESA. With EDID providing the display information and DDC
providing the link between the display and the source, the two accompanying standards enable an information exchange between the display and source.
[00400] In addition, VESA has assigned extensions for EDID. Such extensions include, but are not limited to, timing extensions (00), additional time data black (CEA EDID Timing Extension (02)), video timing block extensions (VTB-EXT (10)), EDID 2.0 extension (20), display information extension (DI-EXT (40)), localized string extension (LS-EXT (50)), microdisplay interface extension (MI-EXT (60)), display ID extension (70), display transfer characteristics data block (DTCDB (A7, AF, BF)), block map (FO), display device data block (DDDB (FF)), and/or extension defined by monitor manufacturer (FF).
[00401] In one embodiment, SDP parameters include data corresponding to a payload identification (ID) and/or EDID information.
[00402] MULTI-PRIMARY COLOR SYSTEM DISPLAY
[00403] FIG. 82 illustrates a dual stack LCD projection system for a six-primary color system. In one embodiment, the display is comprised of a dual stack of projectors. This display uses two projectors stacked on top of one another or placed side by side. Each projector is similar, with the only difference being the color filters in each unit. Refresh and pixel timings are synchronized, enabling a mechanical alignment between the two units so that each pixel overlays the same position between projector units. In one embodiment, the two projectors are Liquid-Crystal Display (LCD) projectors. In another embodiment, the two projectors are Digital Light Processing (DLP) projectors. In yet another embodiment, the two projectors are Liquid-Crystal on Silicon (LCOS) projectors. In yet another embodiment, the two projectors are Light-Emitting Diode (LED) projectors.
[00404] In one embodiment, the display is comprised of a single projector. A
single projector six-primary color system requires the addition of a second cross block assembly for the additional colors. One embodiment of a single projector (e.g., single LCD
projector) is shown in FIG. 83. A single projector six-primary color system includes a cyan dichroic mirror, an orange dichroic mirror, a blue dichroic mirror, a red dichroic mirror, and two additional standard mirrors. In one embodiment, the single projector six-primary color system includes at least six mirrors. In another embodiment, the single projector six-primary color system includes at least two cross block assembly units.
[00405] FIG. 84 illustrates a six-primary color system using a single projector and reciprocal mirrors. In one embodiment, the display is comprised of a single projector unit working in combination with at first set of at least six reciprocal mirrors, a second set of at least six reciprocal mirrors, and at least six LCD units. Light from at least one light source emits towards the first set of at least six reciprocal mirrors. The first set of at least six reciprocal mirrors reflects light towards at least one of the at least six LCD
units. The at least six LCD units include, but are not limited to, a Green LCD, a Yellow LCD, a Cyan, LCD, a Red LCD, a Magenta LCD, and/or a Blue LCD. Output from each of the at least six LCDs is received by the second set of at least six reciprocal mirrors. Output from the second set of at least six reciprocal mirrors is sent to the single projector unit. Image data output by the single projector unit is output as a six-primary color system. In another embodiment, there are more than two sets of reciprocal mirrors. In another embodiment, more than one projector is used.
[00406] In another embodiment, the display is comprised of a dual stack Digital Micromirror Device (DMD) projector system. FIG. 85 illustrates one embodiment of a dual stack DMD projector system. In this system, two projectors are stacked on top of one another.
In one embodiment, the dual stack DMD projector system uses a spinning wheel filter. In another embodiment, the dual stack DMD projector system uses phosphor technology. In one embodiment, the filter systems are illuminated by a xenon lamp. In another embodiment, the filter system uses a blue laser illuminator system. Filter systems in one projector are RGB, while the second projector uses a CYM filter set. The wheels for each projector unit are synchronized using at least one of an input video sync or a projector to projector sync, and timed so that the inverted colors are output of each projector at the same time.
[00407] In one embodiment, the projectors are phosphor wheel systems. A yellow phosphor wheel spins in time with a DMD imager to output sequential RG. The second projector is designed the same, but uses a cyan phosphor wheel. The output from this projector becomes sequential BG. Combined, the output of both projectors is YRGGCB.
Magenta is developed by synchronizing the yellow and cyan wheels to overlap the flashing DMD.
[00408] In another embodiment, the display is a single DMD projector solution.
A single DMD device is coupled with an RGB diode light source system. In one embodiment, the DMD projector uses LED diodes. In one embodiment, the DMD projector includes CYM
diodes. In another embodiment, the DMD projector creates CYM primaries using a double flashing technique. FIG. 86 illustrates one embodiment of a single DMD
projector solution.
[00409] FIG. 87 illustrates one embodiment of a six-primary color system using a white OLED display. In yet another embodiment, the display is a white OLED monitor.
Current emissive monitor and/or television designs use a white emissive OLED array covered by a color filter. Changes to this type of display only require a change to pixel indexing and new six color primary filters. Different color filter arrays are used, placing each subpixel in a position that provides the least light restrictions, color accuracy, and off axis display.
[00410] FIG. 88 illustrates one embodiment of an optical filter array for a white OLED
display.
[00411] FIG. 89 illustrates one embodiment of a matrix of an LCD drive for a six-primary color system with a backlight illuminated LCD monitor. In yet another embodiment, the display is a backlight illuminated LCD display. The design of an LCD display involves adding the CYM subpixels. Drives for these subpixels are similar to the RGB
matrix drives.
With the advent of 8K LCD televisions, it is technically feasible to change the matrix drive and optical filter and have a 4K six-primary color TV.
[00412] FIG. 90 illustrates one embodiment of an optical filter array for a six-primary color system with a backlight illuminated LCD monitor. The optical filter array includes the additional CYM subpixels.
[00413] In yet another embodiment, the display is a direct emissive assembled display.
The design for a direct emissive assembled display includes a matrix of color emitters grouped as a six-color system. Individual channel inputs drive each Quantum Dot (QD) element illuminator and/or micro LED element.
[00414] FIG. 91 illustrates an array for a Quantum Dot (QD) display device.
[00415] FIG. 92 illustrates one embodiment of an array for a six-primary color system for use with a direct emissive assembled display.
[00416] FIG. 93 illustrates one embodiment of a six-primary color system in an emissive display that does not incorporate color filtered subpixels. For LCD and WOLED
displays, this can be modified for a six-primary color system by expanding the RGB or WRGB filter arrangement to an RGBCYM matrix. For WRGB systems, the white subpixel could be removed as the luminance of the three additional primaries will replace it.
SDI video is input through an SDI decoder. In one embodiment, the SDI decoder outputs to a Y
CrCbCcCy-RGBCYM converter. The converter outputs RGBCYM data, with the luminance component (Y) subtracted. RGBCYM data is then converted to RGB data. This RGB data is sent to a scale sync generation component, receives adjustments to image controls, contrast, brightness, chroma, and saturation, is sent to a color correction component, and output to the display panel as LVDS data. In another embodiment the SDI decoder outputs to an SDI Y-R
switch component. The SDI Y-R switch component outputs RGBCYM data. The RGBCYM
data is sent to a scale sync generation component, receives adjustments to image controls, contrast, brightness, chroma, and saturation, is sent to a color correction component, and output to a display panel as LVDS data.
[00417] PRIMARY TRIADS
[00418] A conversion between XYZ and any three primary system (e.g., RGB) yields an exact solution. However, in systems with more than three primaries, there is not an exact solution. For example, a six primary system with an RGBCMY to XYZ is overdetermined.
This requires a mathematical pseudo-inverse (e.g., Moore-Penrose pseudo-inverse), which provides one of an infinite number of solutions. An algorithm is required to go from XYZ to RGBCMY.
[00419] In one embodiment, the system uses at least one triad in the algorithm. Each of the at least one triad is formed using three points (e.g., primaries). Although a larger number of permutations is possible for the three points, the order of the three points is not important (e.g., ABC functions the same as BCA). Therefore, for each set of primaries, a number of possible triads is calculated using the following equation:
n!
C (n, r) = n Cr = ___________________________ (n ¨ r)! r!
where n = the number of primaries and r = 3. Thus, for three primaries, there is one possible triad; for four primaries, there are 4 possible triads; for five primaries, there are 10 possible triads; for six primaries, there are 20 possible triads; for seven primaries, there are 35 possible triads; for eight primaries, there are 56 possible triads; for nine primaries, there are 84 possible triads; for ten primaries, there are 120 possible triads; for eleven primaries, there are 165 possible triads; and for twelve primaries, there are 220 possible triads.
[00420] In one embodiment, the system uses at least five primary triads. In one embodiment, the at least five primary triads are formed using at least six primaries (e.g., Pi-P6). In one embodiment, the first triad is formed using Pi, P2, and P3; the second triad is formed using P4, P5, and P6; the third triad is formed using Pi, P3, and P5;
the fourth triad is formed using P2, P3, and P4; and the fifth triad is formed using Pi, P2, and P6. For example, in a six primary system using RGBCMY, the first triad is formed using RGB, the second triad is formed using CMY, the third triad is formed using RMB, the fourth triad is formed using CGB, and the fifth triad is formed using RGY. Alternate numbers of primaries, numbers of triads, and alternate triads are compatible with the present invention.
[00421] In a preferred embodiment, a color value (e.g., ACES APO) is converted to a colorimetric position (e.g., XYZ), and corresponding values for the at least five primary triads are calculated. In one embodiment, the conversion process first converts an RGB value in ACES APO to XYZ with a D65 white point. Alternative white points are compatible with the present invention. To convert the RGB value in ACES APO to XYZ for a 6P-C
system using a D65 white point, the following equation is used:
0.938653 [ ¨0.005740 0.017517 I [R
0.338102 0.727227 ¨0.065328 G
[Z D65 0.000721 0.000816 1.087264 B AcEsD65 [00422] In one embodiment, a color value in ACES APO is converted to XYZ with a D65 white point. In one embodiment, the conversion from ACES APO to XYZ with a D65 white point is performed using the following equation:
0.950348 0.000000 0.000101 I [/'? XY1 = [0.343170 0.734689 -0.077859 G
L D65 0.000000 0.000000 1.088917 B ACES APO
Apo [00423] In one embodiment, a color value in ACES APO is converted to XYZ with a D60 white point. In one embodiment, the conversion from ACES APO to XYZ with a D60 white point is performed using the following equation:
[X 0.952552 0.000000 0.000094 I [/'?
YI = [0.343966 0.728166 -0.072133 G
L D60 0.000000 0.000000 1.008825 B ACES APO
Apo [00424] In one embodiment, a color value in ACES APO with a D60 white point is converted to ACES APO with a D65 white point. In one embodiment, the conversion from ACES APO with a D60 white point to ACES APO with a D65 white point is performed using a Bradford chromatic adaptation. In one embodiment, the conversion from ACES
APO with a D60 white point to ACES APO with a D65 white point is performed using the following equation:
[R 0.986779 -0.005817 0.003823 I [R
G = 0.001868 0.996064 -0.000986 G
LB AcEsApo-D65 0.015613 0.003559 1.001637 B ACESApo-D60 [00425] In one embodiment, a color value in XYZ with a D60 white point is converted to XYZ with a D65 white point. In one embodiment, the conversion from XYZ with a white point to XYZ with a D65 white point is performed using a Bradford chromatic adaptation. In one embodiment, the conversion from XYZ with a D60 white point to XYZ
with a D65 white point is performed using the following equation:
[X 0.987239 -0.007592 0.003067 I
YI = [-0.006107 1.001864 -0.005086 Y
L D65 0.015927 0.005321 1.081537 Z D60 [00426] In one embodiment, a color value in ACES APO is converted to XYZ with a D65 white point using a Bradford chromatic adaptation. In one embodiment, the conversion from ACES APO to XYZ with a D65 white point is performed using the following equation:
0.937785 ¨0.005528 0.003734 I [R XY1 =[0.338790 0.729523 ¨0.077399 G
L D65 0.017001 0.003875 1.090699 B
AcE,Apo [00427] In one embodiment, the system uses equations found in RP 177 to generate a normalized set of values for color conversion matrices. "RP 177:1993 - SMPTE
Recommended Practice - Derivation of Basic Television Color Equations," in RP
177:1993, vol., no., pp.1-4, 1 Nov. 1993, doi: 10.5594/SMPTE.RP177.1993, is incorporated herein by reference in its entirety. In one embodiment, the calculation of the normalized set of values for the color conversion matrices uses the following equations:
xY (1 ¨ x ¨ y)Y
X= ¨ Y = 1 Z __________ [00428] An RGB-to-XYZ matrix and a CMY-to-XYZ matrix are created using a white point (e.g., D65) of the system. In each of these triads, the white point is within the triad. The RGB-to-XYZ matrix determines what ratio of each normalized primary (R, G, and B) is required to achieve the D65 white with an RGB value of [1 1 1], and then scales the matrix such that the input of [1 1 1] yields the XYZ of D65. Similarly, the CMY-to-XYZ matrix determines what ratio of each normalized primary (C, M, and Y) is required to achieve the D65 white with a CMY value of [1 1 1], and then scales the matrix such that the input of [11 11 yields the XYZ of D65. With these two matrices, additional triad-to-XYZ
matrices are created by using the columns in the RGB-to-XYZ matrix and the CMY-to-XYZ
matrix. For example, an RMB-to-XYZ matrix is created by taking the RGB-to-XYZ matrix and replacing the second column with the second column from the CMY-to-XYZ matrix. In this case, as well as all other triads, the D65 white point is not inside the triad, so in that case no combination of RMB can achieve the D65 color point.
[00429] In one embodiment, a hardware calibration is required to create the conversion matrices. For example, if a projector has 7 signals (e.g., RGBCMYVV) for a six primary system, the output is measured as real XYZ for the individual primaries at maximum and for white when all six primaries are at maximum. A projector calibration is required to adjust the intensities of the primaries to achieve a white point (e.g., D65) from a [1 1 1 1 1 1] position.
The matrices are then created as described above.
[00430] A normalized matrix is used when a multi-primary display device is calibrated such that full power of all primaries yields the intended white point (e.g., D65). If the multi-primary display device has primaries such that the result from all primaries being at full power gives a white point that is not the desired white point, then the non-normalized method is used and the calibration is done (e.g., via software, a look-up table (LUT)) to scale the primaries such that the full power values result in the desired white point.
In one embodiment, the LUT is a three-dimensional (3D) LUT.
[00431] Alternatively, the system uses a non-normalized method to generate a set of values for the color conversion matrices. For example, a set of six primaries Pi-P6 has a set of xyz primary values as shown in Table 28. Although this example shows a set of six primaries, this process is operable to be used with at least four primaries.
[00432] TABLE 28 P ixyz P ix Piy Piz P2xyz P2x P2y P2z P3xyz P3x P3y P3z P4xyz P4x P4y P4z Psxyz Psx Psy Psz P6xyz P6x P6y P6z [00433] In one embodiment, an XYZ-to-P1P2P3 matrix is created using the inverse of the result from transposing a PiXYZ matrix created from the primary values in Table 28, a P2XYZ matrix created from the primary values in Table 28, and a P3XYZ matrix created from the primary values in Table 28. The conversion from XYZ color space to P1P2P3 is shown below in the following equation:
iPix Ply Piz T Pix P2 X P3 X 1 X
P2 I p p P2 )-1 [PLY P2Y P3 ) [Y1 P3 \ P3 X P3y P3 Z Z Z P2 Z P3 Z
[00434] Similarly, in one embodiment, an XYZ-to-P4P5P6 matrix is created using the inverse of the result from transposing a P4xyz matrix created from the primary values in Table 28, a P5xyz matrix created from the primary values in Table 28, and a P6xyz matrix created from the primary values in Table 28. The conversion from XYZ color space to P4P5P6 is shown below in the following equation:
[134 P4Xx p P4yy pP4: T / P4 X Ps X P6 X 1 X
P5 I p 5 )-1 [P4Y PsY P6yI [YI
P6 \ P6 x P6y P6 Z Z P4 Z Ps Z P6 Z
[00435] This process is used to create additional matrices for alternative triads. As stated above, although this process is shown using six primaries, alternate numbers of primaries, numbers of triads, and alternate triads are compatible with the present invention.
[00436] FIG. 94 illustrates one embodiment of a primary triad system for a multi-primary system including red, green, blue, cyan, magenta, and yellow primaries. The primary triad system includes an RGB triad, a CMY triad, an RMB triad, a CGB triad, and an RGY triad.
[00437] Primary values for each color value (RGBCMY) are listed in Table 29 below.
[00438] TABLE 29 Rxyz 0.68 0.32 0 Gxyz 0.265 0.69 0.045 Bxyz 0.15 0.06 0.79 Cxyz 0.1617 0.3327 0.5056 Mxyz 0.3383 0.1372 0.5245 Yxyz 0.4470 0.5513 0.0017 [00439] In one embodiment, an XYZ-to-RGB matrix is created using the inverse of the result from transposing an Rxyz matrix created from the primary values in Table 29, a Gxyz matrix created from the primary values in Table 29, and a Bxyz matrix created from the primary values in Table 29. For example, to obtain the RGB triad, an inverse is taken of the transpose of a matrix created using the first three rows of Table 29 for 6P-C.
The conversion from D65 XYZ color space to RGB in a 6P-C system using a D65 white point is shown below in the following equation:
[
1.78421 -0.666447 -0.2881581 RGI = [-0.831579 1.76711 0.0236842 Y
L6. 613,-C 0.0473684 -0.100658 1.26447 Z D65 [00440] In one embodiment, an XYZ-to-CMY matrix is created using the inverse of the result from transposing a Cxyz matrix created from the primary values in Table 29, an Mxyz matrix created from the primary values in Table 29, and a Yxyz matrix created from the primary values in Table 29. The conversion from D65 XYZ color space to CMY in a 6P-C
system using a D65 white point is shown below in the following equation:
[C -3.06125 2.47801 1.32629 I
MI = [ 2.94733 -2.39167 0.631184 Y
I-Y 6P-C 1.11392 0.913668 -0.957473 Z D65 [00441] In one embodiment, an XYZ-to-RMB matrix is created using the inverse of the result from transposing an Rxyz matrix created from the primary values in Table 29, an Mxyz matrix created from the primary values in Table 29, and a Bxyz matrix created from the primary values in Table 29. The conversion from D65 XYZ color space to RMB in a 6P-C
system using a D65 white point is shown below in the following equation:
[
-9.56454 23.4496 0.03506591 MR1 =[ 31.435 -66.7993 -0.8953 Y
LB 613,-C -20.8704 44.3497 1.86023 Z D65 [00442] In one embodiment, an XYZ-to-CBG matrix is created using the inverse of the result from transposing a Cxyz matrix created from the primary values in Table 29, a Bxyz matrix created from the primary values in Table 29, and a Gxyz matrix created from the primary values in Table 29. The conversion from D65 XYZ color space to CBG in a 6P-C
system using a D65 white point is shown below in the following equation:
[C ¨22.6099 8.44536 3.6516 I
BI = 13.9183 -5.28179 -0.975739 Y
[G 613,-C 9.69162 -2.16357 -1.67586 Z D65 [00443] In one embodiment, an XYZ-to-RGY matrix is created using the inverse of the result from transposing an Rxyz matrix created from the primary values in Table 29, a Gxyz matrix created from the primary values in Table 29, and a Yxyz matrix created from the primary values in Table 29. The conversion from D65 XYZ color space to RGY in a 6P-C
system using a D65 white point is shown below in the following equation:
[R 2.41684 ¨2.01079 16.5996 I
GI = [0.0556266 -0.118206 23.7071 Y
6P-C -1.47247 3.12899 -39.3067 Z D65 [00444] The XYZ value is multiplied by each of the XYZ-to-triad matrices shown above (i.e., the XYZ-to-RGB matrix, the XYZ-to-CMY matrix, the XYZ-to-RMB matrix, the XYZ-to-CBG matrix, the XYZ-to-RGY matrix). The result of each multiplication is filtered for negative values. If a resulting matrix includes one or more negative values, all three values in the resulting matrix are set to zero. This results in a set of triad vectors.
The primary components of the at least five primary triads are added together on a per-component basis (e.g., {SUM (R), SUM (B), SUM (G), SUM (C), SUM (M), SUM (Y)1). In one embodiment, if any of the merged colors are present in at least two triads, the primary components are divided by a number of the at least two primary triads to create a set of final values. For example, if any of the merged colors are present in two triads (e.g., RGB and RN/TB), the values are divided by two (2) and merged back into the matrices, resulting in a set of final 6P
values. If the merged colors are only present in one triad, this represents the set of final 6P
values.
[00445] If the signal values for two triads are non-negative, the sums for each component are divided by two. In the embodiment described above (i.e., RGB, CMY, RBM, CBG, and RGY), it is not possible for more than two triads to be completely non-negative. In alternative embodiments, with a different set of at least five triads, it is possible for more than two triads to be completely non-negative. In the six primary system described above, the result is output as an RGBCMY value.
[00446] If all of the values for the at least five primary triads resulting from each multiplication are negative, the color is out-of-gamut for the at least six primaries and must be mapped to an in-gamut color. In one embodiment, signals from the triad with the least negative minimum value are used, with the negative signal values clipped to zero. These signal values are then used on a per-component basis for each out-of-gamut signal. After including all of the out-of-gamut signals, the signal values for each of the at least six primaries (e.g., RGBCMY) are clipped to one.
[00447] In one embodiment, the system includes a three-dimensional look up table that converts an out-of-gamut color value to an in-gamut color value for the at least six primary system. In one embodiment, XYZ values for the out-of-gamut color value are converted to xyY. The out-of-gamut color value is substituted to an in-gamut color value with a new xy and the original Y, thereby creating a new xyY. The new xyY is then transformed to XYZ. If any channel is greater than 1.0, the complete triad is divided by the maximum, scaling the channel to a maximum value of 1Ø
[00448] In a preferred embodiment, the system maps the out-of-gamut color to an in-gamut color by defining a vector using a white point and the out-of-gamut color and mapping the out-of-gamut color to a locus edge of the multi-primary system along the vector as shown in FIG. 95. Points inside the shape are white and represent points that do not need to be remapped. Advantageously, mapping along the straight line to the white point provides a more radially consistent and more operationally reasonable position.
Alternatively, the system maps the out-of-gamut color value to the nearest in-gamut color regardless of a location of the white point (e.g., perpendicular reference) as shown in FIG.
96. In one embodiment, the mapping is done in xyY color space. The colorimetric xy values are mapped from the out-of-gamut color to the in-gamut color. In a preferred embodiment, the Y is carried along unchanged and merged with the new remapped x,y in-gamut color.
[00449] The set of final 6P values is converted back to XYZ space with a D65 white point using a 6P-to-XYZ matrix. The conversion from 6P-to-XYZ for 6P-C is shown below in the following equation:
ryi [ZiD65 FRi 0.48657095 0.26566769 0.19821729 0.32295962 ¨0.54969800 1.177199435 I G I
I B I
= [ 0.22897456 0.69173852 0.07928691 0.67867175 ¨0.22203240 0.543360700 lc I I
0.00000000 0.04511338 1.04394437 0.98336936 ¨0.78858190 0.894270250 Im I
1-06p-c [00450] Once this conversion is complete, the XYZ values are converted to ACES
using an XYZ-to-ACES matrix. This matrix is the inverse of the ACES-to-XYZ matrix.
The conversion from XYZ-to-ACES is shown below in the following equation:
[R 1.062343 0.008404 -0.0166111r G = -0.493934 1.371087 0.090340 Y
[13 AcEsD65 0.000334 -0.001034 0.919683 Z
[00451] In one embodiment, the ISO 17321 matrix/chart values are defined using a perfect reflecting diffuser matrix (0.97784 0.97784 0.97784), an 18% grey card matrix (0.18 0.18 0.18), and the 24 patches of the ISO 17321-1 chart, as illuminated using CIE D60:
(0.11877 0.08709 0.05895), (0.40002 0.31916 0.23737), (0.18476 0.20398 0.31311), (0.10901 0.13511 0.06493), (0.26684 0.24604 0.40932), (0.32283 0.46208 0.40606), (0.38606 0.22744 0.05777), (0.13822 0.13037 0.33703), (0.30203 0.13752 0.12758),(0.0931 0.06347 0.13525), (0.34876 0.43654 0.10614), (0.48656 0.36686 0.08061), (0.08732 0.07443 0.27274), (0.15366 0.25691 0.09071), (0.21742 0.0707 0.0513), (0.5892 0.53943 0.09157), (0.30904 0.14818 0.27426), (0.14901 0.23378 0.35939), (0.86653 0.86792 0.85818), (0.57356 0.57256 0.57169), (0.35346 0.35337 0.35391), (0.20253 0.20243 0.20287), (0.09467 0.0952 0.09637), (0.03745 0.03766 0.03895).
These are the ACES RICD values for a perfect reflecting diffuser, an 18 % gray card, and the 24 patches of the ISO 17321-1 chart, as illuminated using CIE D60.
[00452] While the process shown in FIG. 97 is using the ACES RICD values for a perfect reflecting diffuser, an 18 % gray card, and the 24 patches of the ISO 17321-1 chart, as illuminated using CIE D60, it can be used to validate any conversion from ACES-to-6P-to-ACES.
[00453] It is important to note that 6P 11,1,1,1,1,11 converts to ACES-0 {2,2,2}. In one embodiment using ITU-R BT.2100 color space, it is necessary to perform a scaling operation of the linear display-referred RGB values, followed by applying an inverse Perceptual Quantizer (PQ) EOTF. The scaling is such that 6P data 11,1,1,1,1,11 maps to 10-bit PQ
{668,668,668}. In one embodiment, the scaling maps at a rate of 403 candelas per square meter (cd/m2).
[00454] In a more preferred embodiment, the system uses at least eight primary triads.
FIG. 98 illustrates one embodiment of a system with at least eight primary triads. In one embodiment, the at least eight primary triads are formed using at least six primaries. In one embodiment, a multi-primary system includes six primaries (e.g., Pi-P6) and eight primary triads. In one embodiment, the first triad is formed using Pi, P2, and P3; the second triad is formed using P4, P5, and P6; the third triad is formed using Pi, P3, and P5;
the fourth triad is formed using P2, P3, and P4; the fifth triad is formed using Pi, P2, and P6;
the sixth triad is formed using P3, P4, and P5; the seventh triad is formed using P2, P4, and P6;
and the eighth triad is formed using Pi, P5, and P6. Any point is included in a first triad of a first set of triads (e.g., P1P2P3, P1P2P5, 131133P6, or P2P3P4) and a second triad of a second set of triads (e.g., P4P5P6, P2P4P5, P1P5P6, or P3P4P6). For example, a multi-primary system includes a red primary (R), a green primary (G), a blue primary (B), a cyan primary (C), a yellow primary (Y), and a magenta primary (M). Any point is present in one of RGB, RGY, RMB, or CGB
and in one of CMY, CGY, RMY, or CMB. In one embodiment, the resulting values are added together and divided by two as shown in the equation below (e.g., for an XYZ input), wherein a point is present in only one triad in each set shown in brackets:
7R GB CGMG 1) RGBCMY = R Y /2 RMB RMY
CGB CMB
[00455] In a preferred embodiment, the third triad, the fourth triad, and the fifth triad are formed by doing one replacement in the first triad, and the sixth triad, the seventh triad, and the eighth triad are formed by doing one replacement in the second triad. In one embodiment, red replaces cyan, blue replaces yellow, green replaces magenta, cyan replaces red, yellow replaces blue, and/or magenta replaces green. For example, RGB is modified to RMB, RGY, and CGB, and CMY is modified to RMY, CGY, and CMB. In a preferred embodiment, the primary triads are selected such that none of the primary triads include both a primary and its complement (e.g., no triad contains R and C, no triad contains B and Y, no triad contains G
and M). Primary triads including both a primary and its complement are not needed for a full color description of the system. In a preferred embodiment, the primary triads are selected such that the first triad includes the white point, the second triad includes the white point, and no other triads include the white point. For example, RGB includes the white point, CMY
includes the white point, and no other triads include the white point.
[00456] Alternate numbers of primaries, alternate numbers of triads, and alternate triads are compatible with the present invention. Advantageously, this embodiment provides an easier method of calculating luminance because every color is included in two triads and a simple divide by two provides a final result while still describing the full gamut using the primary triads. Out-of-gamut colors are mapped to in-gamut colors as previously described.
[00457] The XYZ-to-RGB matrix, the XYZ-to-CMY matrix, the XYZ-to-RMB matrix, the XYZ-to-CBG matrix, and the XYZ-to-RGY matrix are calculated as previously described.
Additionally, in one embodiment, an XYZ-to-CMB matrix, an XYZ-to-RMY matrix, and an XYZ-to-CGY matrix are calculated as described below.
[00458] In one embodiment, an XYZ-to-CMB matrix is created using the inverse of the result from transposing a Cxyz matrix created from the primary values in Table 29, an Mxyz matrix created from the primary values in Table 29, and a Bxyz matrix created from the primary values in Table 29. The conversion from D65 XYZ color space to CMB in a 6P-C
system using a D65 white point is shown below in the following equation:
-1.52475 3.73828 0.005590121 MC1 =[ 4.60881 -1.02888 -0.796949 Y
LB 613,-C -2.08406 -1.7094 1.79136 Z D65 [00459] In one embodiment, an XYZ-to-RMY matrix is created using the inverse of the result from transposing an Rxyz matrix created from the primary values in Table 29, an Mxyz matrix created from the primary values in Table 29, and a Yxyz matrix created from the primary values in Table 29. The conversion from D65 XYZ color space to RMY in a 6P-C
system using a D65 white point is shown below in the following equation:
[R 2.37548 -1.92289 -1.029181 M = 0.00447267 -0.00950442 1.90618 Y
I-Y 6P-C -1.37995 2.93239 0.122998 ZI D65 [00460] In one embodiment, an XYZ-to-CGY matrix is created using the inverse of the result from transposing a Cxyz matrix created from the primary values in Table 29, a Gxyz matrix created from the primary values in Table 29, and a Yxyz matrix created from the primary values in Table 29. The conversion from D65 XYZ color space to CGY in a 6P-C
system using a D65 white point is shown below in the following equation:
[C 0.29784 -0.2478 2.04565 I
GI = [-3.50535 2.84449 -0.750686 Y
I-Y 6P-c 4.20751 -1.59669 -0.294967 Z D65 [00461] A set of matrices is defined for the at least eight triads based on the XYZ values of the at least six primaries in a multi-primary system. For each set of XYZ
values (per pixel), the values for each of the at least eight triads are derived by multiplying the XYZ value by each triad inverse matrix. Each set of triad values is checked for negative values, and any triad with a negative value is set to (0, 0, 0). Like components from each triad are summed for each pixel and a set of values in the multi-primary system are created for each pixel. The sum is divided by a number of triads with non-negative values to compensate for luminance.
For example, if a point is found in one triad, the sum is the final value; if a point is found in two triads, the sum is divided by two to provide the final value; if a point is found in three triads, the sum is divided by three to provide the final value; if a point is found in four triads, the sum is divided by four to provide the final value; etc.
[00462] As previously described, in a six primary system, there are a total of 20 possible triads. Thus, points may be included in more than two triads of the total of 20 possible triads.
However, in the embodiment of the present invention described above using eight triads (i.e., RGB, CMY, RMB, CBG, RGY, CMB, RMY, and CGY), no point is included in more than two triads. This is advantageous over a system that uses all possible triads (e.g., 20 for RGBCMY) because it requires significantly less processing for calculations.
Further, a simple divide by two is always required for calculations, which simplifies logic and reduces processing required to complete the calculations.
[00463] FIG. 99 illustrates a flow chart of an embodiment of a system with eight triads in a six-primary system (i.e., RGBCMY).
[00464] TRIADS IN FOUR PRIMARY AND FIVE PRIMARY SYSTEMS
[00465] In one embodiment, a multi-primary system includes four primaries (e.g., Pi-P4).
Any point is included in a first triad of a first set of triads including PiP4 (e.g., P1P4P2 or P1P4P3) and a second triad of a second set of triads including P2P3 (e.g., P2P3P1 or P2P3P4).
For example, a multi-primary system includes a red primary (R), a green primary (G), a blue primary (B), and a cyan primary (C). Any point is present in one of RGB or CGB
and in one of RCB or RCG. In one embodiment, the resulting values are added together and divided by two as shown in the equation below (e.g., for an XYZ input), wherein a point is present in only one triad in each set shown in brackets:
RcD
RGBC = [CB G/2 GRCGGEiBlR
[00466] In one embodiment, a multi-primary system includes five primaries (e.g., Pi-P5).
Any point is included in a first triad of a first set of triads (e.g., P1P4P3, P1P4P5, or P4P2P5) and a second triad of a second set of triads (e.g., P1P2P5, P1P2P3, or P2P3P4).
For example, a multi-primary system includes a red primary (R), a green primary (G), a blue primary (B), a cyan primary (C), and a yellow primary (Y). Any point is present in one of RCY, RCB, or CGY
and in one of RGY, RGB, or CGB. In one embodiment, the resulting values are added together and divided by two as shown in the equation below (e.g., for an XYZ
input), wherein a point is present in only one triad in each set shown in brackets:
RC] [RGY
RGBC =([RCB + RGB )/2 CGY CGB!
1004671 Advantageously, each color point resides within only two triads. As previously described, in a five primary system, there are a total of 10 possible triads.
Thus, points may be included in more than two triads of the total of 10 possible triads.
However, in the embodiment of the present invention described above using six triads (i.e., RGB, RGY, CGB, RCB, CGY, and CRY), no point is included in more than two triads. This is advantageous over a system that uses all possible triads (e.g., 10 for RGBCY) because it requires significantly less processing for calculations. Further, a simple divide by two is always required for calculations, which simplifies logic and reduces processing required to complete the calculations.
[00468] In one embodiment, the system uses at least one virtual primary in at least one triad. In one example, an RGBC system uses a virtual magenta primary and a virtual yellow primary. In one embodiment, the virtual magenta primary is an average of a red primary point and a blue primary point. In one embodiment, the virtual yellow primary is an average of a red primary point and a green primary point. In another example, an RGBY
system uses a virtual magenta primary and a virtual cyan primary. In one embodiment, the virtual cyan primary is an average of a green primary point and a blue primary point. In yet another example, an RGBCY system uses a virtual magenta primary. In one embodiment, the at least one virtual primary is located on a line connecting two non-virtual primaries.
Advantageously, using the virtual primaries allows for the eight triads described above (e.g., RGB, CMY, RBM, CBG, RGY, CMB, RMY, and CGY) to be used within a four primary system and/or a five primary system.
[00469] TRIADS WITH TWO PRIMARIES AND A VIRTUAL PRIMARY
[00470] In another embodiment, the three points forming a triad include two primaries and a point within the color gamut used as a virtual primary. In a preferred embodiment, the virtual primary is a white point (e.g., D65). Each triad is formed using two adjacent primaries and the virtual primary (e.g., the white point). For example, in an RGBCMY
system with a white point ("W"), the triads include WRY, WYG, WGC, WCB, WBM, and WMR as shown in FIG. 100. Advantageously, using the white point as a virtual primary covers the complete color area, and points are only within one triangle. Thus, a four primary system with an additional virtual primary results in four triads, a five primary system with an additional virtual primary results in five triads, a six primary system with an additional virtual primary results in six triads, a seven primary system with an additional virtual primary results in seven triads, an eight primary system with an additional virtual primary results in eight triads, a nine primary system with an additional virtual primary results in nine triads, a ten primary system with an additional virtual primary results in ten triads, an eleven primary system with an additional virtual primary results in eleven triads, a twelve primary system with an additional virtual primary results in twelve triads, etc.
[00471] The white point W is a virtual primary defined as [1 1 1 1 1 1] of RGBCMY. All color points are in only one of the six triads for a six primary system. If a color point is on the line between two triads, the system determines in which triad the color point resides (e.g., based on significant figures and precision of a processor).
[00472] For example, when reconstructing the RGBCMY from a RYW triad, the XYZ-to-RYW gives the following matrix:
[R Y W] = [0.244 0.572 0.345]
[00473] All RGBCMY values are set to the virtual primary value, which is 0.345 in the example above. Thus, RGBCMY(R) = RGBCMY(R) + R (=0.244 in the example above) and RGBCMY(Y)=RGBCMY(Y) + Y (=0.572 in the example above), which yields the following matrix:
[R GBCM Y] = [0.589 0.345 0.345 0.345 0.345 0.917]
[00474] Further away from the white point, the W value decreases substantially. The W
gives positive RGBCMY, and if the magnitude of W is greater than the magnitude of one of the other elements, the result might still be all positive in RGBCMY. From the above example, if R = -0.244, then the final R value would still be positive (i.e., R = 0.345 ¨ 0.244 = 0.101).
[00475] Advantageously, the addition of the virtual primary (e.g., white point) constrains the system to a finite number of values when converting from XYZ to a multi-primary color gamut (e.g., RGBCMY). The virtual primary is not necessary when converting from the multi-primary color gamut (e.g., RGBCMY) to XYZ because this operation is well-defined by a 3x6 matrix (e.g., RGBCMY-to-XYZ matrix) and an absolute inverse of the 3x6 matrix is not possible.
[00476] In one embodiment, the multi-primary system includes at least one internal primary (e.g., at least one white point) and at least three peripheral primaries. For example, the multi-primary system includes P peripheral primaries and I internal primaries. There will be I sets of P triads formed from the P peripheral primaries and each of the I
internal primaries. Any point will only be within one of the P triads including each of the I internal primaries. These resulting values are then averaged together.
[00477] In one embodiment, a multi-primary system includes three peripheral primaries (e.g., Pi-P3) and an internal primary (I). Any point is included in one triad of a set of triads including I (e.g., P1P2I, P1P3I, or P2P3I) and a triad formed with the three peripheral primaries (e.g., P1P2P3). These resulting values from the one triad of the set of triads including I and the triad formed with the three peripheral primaries are added together and divided by two. For example, a multi-primary system includes a red primary (R), a green primary (G), a blue primary (B), and a white primary (W). Any point is present in one of RGW, RBW, or GBW
and in RGB. In one embodiment, the resulting values are added together and divided by two as shown in the equation below (e.g., for an XYZ input), wherein a point is present in only one triad in each set shown in brackets:
RGW
RGBW = ([RBW1+ RGB) /2 GBW
In another embodiment, the value of RGW, RBW, or GBW is used without dividing by two to produce RGBW.
[00478] In one embodiment, a multi-primary system includes three peripheral primaries (e.g., Pi-P3) and two internal primaries (e.g., I1-I2). Any point is included in a first triad of a first set of triads including II (e.g., P1P2I1, P1P3I1, or P2P311) and a second triad of a second set of triads including 12 (e.g., P1P212, P1P312, or P2P3I2). These resulting values from the first triad of the first set of triads and the second triad of the second set of triads are added together and divided by two. For example, a multi-primary system includes a red primary (R), a green primary (G), a blue primary (B), a first white primary (WO, and a second white primary (W2).
Any point is present in one of RGW1, RBWi, or GBWi and in one of RGW2, RBW2, or GBW2. In one embodiment, the resulting values are added together and divided by two as shown in the equation below (e.g., for an XYZ input), wherein a point is present in only one triad in each set shown in brackets:
RGWil [RGW2 RGBW1W2 = ([RBWi + RBW2 )/2 GBWi GB W2 [00479] In one embodiment, a multi-primary system includes four peripheral primaries (e.g., Pi-134) and two internal primaries (e.g., 11-12). Any point is included in a first triad of a first set of triads including Ii (e.g., P1P2I1, P2P411, P3P411, or P1P3I1) and a second triad of a second set of triads including 12 (e.g., P1P212, P2P4I2, P3P4I2, or P1P312).
These resulting values from the first triad of the first set of triads and the second triad of the second set of triads are added together and divided by two. For example, a multi-primary system includes a red primary (R), a green primary (G), a blue primary (B), a cyan primary (C), a first white primary (WO, and a second white primary (W2). Any point is present in one of RGW1, GCW1, BCW1, or RBWi and in one of RGW2, GCW2, BCW2, or RBW2. In one embodiment, the resulting values are added together and divided by two as shown in the equation below (e.g., for an XYZ input), wherein a point is present in only one triad in each set shown in brackets:
/[RGW11 [RGW21\
GCW, GCW2 RGBCW1W2 = /2 RBWi RBW2 [00480] In one embodiment, a multi-primary system includes three peripheral primaries (e.g., P1-P3) and three internal primaries (e.g., 11-13). Any point is included in a first triad of a first set of triads including Ii (e.g., P1P2I1, P1P3I1, or P2P311), a second triad of a second set of triads including 12 (e.g., P1P212, P1P312, or P2P3I2), and a third triad of a third set of triads including 13 (e.g., PiP213, P1P313, or P2P3I3). These resulting values from the first triad of the first set of triads, the second triad of the second set of triads, and the third triad of the third set of triads are added together and divided by three. For example, a multi-primary system includes a first red primary (Ri), a second red primary (R2), a first green primary (GO, a second green primary (G2), a first blue primary (BO, and a second blue primary (B2). The second red primary, the second green primary, and the second blue primary are contained within a triad formed by the first red primary, the first green primary, and the first blue primary. Any point is present in one of R1G1R2, RiB1R2, or G1B1R2, in one of R1G1G2, R1B1G2, or G1B1G2, and in one of R1G1B2, RiBiB2, or G1B1B2. In one embodiment, the resulting values are added together and divided by three as shown in the equation below (e.g., for an XYZ input), wherein a point is present in only one triad in each set shown in brackets:
R1G1R2 [R1G1G2 [R1G1B2 R1R2G1G2B1B2 = ([RiBiR2 + R1B1G2 + RiBiB21) /3 G1B1R2 GA_ G2 G1B1B2 [00481] In another embodiment, the multi-primary system includes the three peripheral primaries (e.g., Pi-P3) and the three internal primaries (e.g., 11-13). Any point is included in a first triad of a first set of triads (e.g., P1P2I1, P11113, P2P3I2, P21112, P1P313, P31213, or 111213) and a second triad (e.g., PiP2P3). These resulting values from the first triad of the first set of triads and the second triad are added together and divided by two. For example, a multi-primary system includes a first red primary (Ri), a second red primary (R2), a first green primary (GO, a second green primary (G2), a first blue primary (BO, and a second blue primary (B2). The second red primary, the second green primary, and the second blue primary are contained within a triad formed by the first red primary, the first green primary, and the first blue primary. Any point is present in one of R1G1R2, RiR2B2, G1B1G2, G1R2G2, RiBiB2, B1G2B2, or R2G2B2 and in RiGiBi. In one embodiment, the resulting values are added together and divided by three as shown in the equation below (e.g., for an XYZ input), wherein a point is present in only one triad in each set shown in brackets:
el GiR21 1 IGI-BiG21 1 R1R2G1G2B1B2 = 1 1GiR2G2 I + [RiGiBi] 1/2 I I ReR1B2 I I
iBiGG2BB21 l_R ) [00482] In one embodiment, the present invention provides a system for displaying a multi-primary color system including a set of image data, an image data converter, a set of saturation data corresponding to the set of image data, wherein the set of saturation data is used to extend a set of hue angles for the first set of color channel data and the second set of color channel data, a set of Session Description Protocol (SDP) parameters, and at least one display device, wherein the at least one display device and the image data converter are in network communication, wherein the image data converter further includes a cyan primary position, and wherein the image data converter is operable to convert the set of image data for display on the at least one display device. In one embodiment, the set of image data includes a first set of color channel data and a second set of color channel data. In one embodiment, the image data converter includes a digital interface, wherein the digital interface is operable to encode and decode the set of image data. In one embodiment, the set of SDP
parameters is modifiable. In one embodiment, the system further includes at least one transfer function (TF) for processing the set of image data. In one embodiment, the cyan primary position is positioned to limit saturation. In one embodiment, the cyan primary position is located at u'=0.096, v'=0.454. In one embodiment, the cyan primary position is determined by expanding the set of hue angles. In one embodiment, the cyan primary position is located at u'=0.067, v'=0.449. In one embodiment, the set of image data includes a bit level. In one embodiment, the image data converter is operable to convert the bit level of the set of image data, thereby creating an updated bit level. In one embodiment, once the set of image data has been converted by the image data converter for the at least one display device the set of SDP
parameters is modified based on the conversion. In one embodiment, the at least one display device is operable to display the multi-primary color system based on the set of image data.
In one embodiment, the system further includes at least one electronic luminance component, wherein the at least one electronic luminance component is not calculated within the at least one display. In one embodiment, the first set of color channel data includes a first bit value defining black and a second bit value defining white, wherein the second set of color channel data includes a third bit value defining black and a fourth bit value defining white. In one embodiment, the set of SDP parameters is modified to include data corresponding to the first set of color channel data and the second set of color channel data. In one embodiment, the system further includes a magenta primary value. In one embodiment, the magenta primary value is derived from the set of image data. In one embodiment, the magenta primary value is not defined as a wavelength. In one embodiment, the multi-primary color system is a six-primary color system.
[00483] In another embodiment, the present invention provides a system for displaying a multi-primary color system including a set of image data, an image data converter, a set of saturation data corresponding to the set of image data, a set of Session Description Protocol (SDP) parameters, and at least one display device, wherein the at least one display device and the image data converter are in network communication, wherein the image data converter further includes a cyan primary position, wherein the cyan primary position is positioned to limit saturation, and wherein the image data converter is operable to convert the set of image data for display on the at least one display device. In one embodiment, the image data converter includes a digital interface, wherein the digital interface is operable to encode and decode the set of image data. In one embodiment, the set of image data includes a first set of color channel data and a second set of color channel data. In one embodiment, the set of saturation data is used to extend a set of hue angles for the first set of color channel data and the second set of color channel data. In one embodiment, the set of image data further includes a bit level. In one embodiment, the system further includes at least one transfer function (TF) for processing the set of image data. In one embodiment, the set of SDP
parameters is modifiable. In one embodiment, the image data converter is operable to convert the bit level of the set of image data, thereby creating an updated bit level.
In one embodiment, the cyan primary position is located at u'=0.096, v'=0.454. In one embodiment, once the set of image data has been converted by the image data converter for the at least one display device, the set of SDP parameters is modified based on the conversion.
In one embodiment, the at least one display device is operable to display the multi-primary color system based on the set of image data. In one embodiment, the multi-primary color system is a six-primary color system.
[00484] In yet another embodiment, the present invention provides a system for displaying a multi-primary color system including a set of image data, an image data converter, a set of saturation data corresponding to the set of image data, a set of Session Description Protocol (SDP) parameters, and at least one display device, wherein the at least one display device and the image data converter are in network communication, wherein the image data converter further includes a cyan primary position, wherein the cyan primary position is determined by expanding the set of hue angles, and wherein the image data converter is operable to convert the set of image data for display on the at least one display device. In one embodiment, the image data converter includes a digital interface, wherein the digital interface is operable to encode and decode the set of image data. In one embodiment, the set of image data includes a first set of color channel data and a second set of color channel data. In one embodiment, the set of saturation data is used to extend a set of hue angles for the first set of color channel data and the second set of color channel data.
[00485] In one embodiment, the present invention provides a system for displaying a multi-primary color system including a set of image data, wherein the set of image data includes a first set of color channel data and a second set of color channel data, an image data converter, wherein the image data converter includes a digital interface, wherein the digital interface is operable to encode and decode the set of image data, a set of Session Description Protocol (SDP) parameters, and at least one display device, wherein the at least one display device and the image data converter are in network communication, wherein the image data converter is operable to map the first set of color channel data and the second set of color channel data to a color matrix, wherein the color matrix includes primary color values for Red (R), Green (G), Blue (B), Cyan (C), Yellow (Y), and Magenta (M), wherein the C, M, and Y primary color values are substantially equal in saturation to the R, G, and B primary color values, respectively, and wherein the image data converter is operable to convert the set of image data for display on the at least one display device using the color matrix and an additive color space matrix corresponding to a specified color space. In one embodiment, the system further includes at least one transfer function (TF) for processing the set of image data. In one embodiment, the set of SDP parameters is modifiable. In one embodiment, the C, M, and Y primary color values include a set of substantially inverted hue angles corresponding to a set of hue angles for the R, G, and B primary color values, respectively. In one embodiment, the specified color space uses an ITU-R BT709.6 color gamut.
In one embodiment, the set of image data includes a bit level, wherein the image data converter is operable to convert the bit level of the set of image data, thereby creating an updated bit level. In one embodiment, once the set of image data has been converted by the image data converter for the at least one display device, the set of SDP parameters is modified based on the conversion. In one embodiment, the at least one display device is operable to display the multi-primary color system based on the set of image data. In one embodiment, the system further includes at least one electronic luminance component, wherein the at least one electronic luminance component is not calculated within the at least one display device. In one embodiment, the additive color space matrix is based on mathematical space and not based on the set of image data. In one embodiment, the set of SDP parameters is modified to include data corresponding to the first set of color channel data and the second set of color channel data. In one embodiment, the multi-primary color system is a six-primary color system.
[00486] In another embodiment, the present invention provides a system for displaying a multi-primary color system includes a set of image data, wherein the set of image data includes a first set of color channel data and a second set of color channel data, an image data converter, a set of Session Description Protocol (SDP) parameters, and at least one display device, wherein the at least one display device and the image data converter are in network communication, wherein the image data converter is operable to map the first set of color channel data and the second set of color channel data to a color matrix, wherein the color matrix includes primary color values for Red (R), Green (G), Blue (B), Cyan (C), Yellow (Y), and Magenta (M), and wherein the image data converter is operable to convert the set of image data for display on the at least one display device using the color matrix and an additive color space matrix corresponding to a specified color space. In one embodiment, the set of SDP parameters is modifiable. In one embodiment, the C, M, and Y
primary color values are substantially equal in saturation to the R, G, and B primary color values, respectively. In one embodiment, the specified color space uses an ITU-R
BT709.6 color gamut. In one embodiment, the first set of color channel data defines a first minimum color luminance and a first maximum color luminance, wherein the second set of color channel data defines a second minimum color luminance and a second maximum color luminance. In one embodiment, the set of SDP parameters indicates the magenta primary value and the set of image data being displayed on the at least one display device is using the multi-primary color system. In one embodiment, the image data converter is operable to convert a bit level for the set of image data to a new bit level. In one embodiment, the system further includes a set of saturation data corresponding to the set of image data, wherein the set of saturation data is used to extend a set of hue angles for the first set of color channel data and the second set of color channel data. In one embodiment, the set of SDP parameters includes the first set of color channel data, the second set of color channel data, mapping data for the set of image data, and a flag indicator. In one embodiment, the image data converter includes a digital interface, and wherein the digital interface is operable to encode and decode the set of image data using at least one color difference component. In one embodiment, the at least one display device is operable to display the multi-primary color system based on the set of image data, wherein the multi-primary color system displayed on the at least one display device is based on the set of image data, such that the set of SDP parameters indicates the M primary color value and that the set of image data being displayed on the at least one display device is using the multi-primary color system. In one embodiment, the set of image data includes a bit level, wherein the image data converter is operable to convert the bit level for the set of image data to a new bit level using the at least one TF. In one embodiment, the set of image data defines a minimum color luminance and a maximum color luminance. In one embodiment, the digital interface includes payload identification (ID) metadata, wherein the payload ID metadata is operable to identify the set of image data as a multi-primary color set of image data. In one embodiment, the M primary color value is calculated based on values for R and B from the set of image data. In one embodiment, the multi-primary color system is a six-primary color system.
[00487] In yet another embodiment, the present invention provides a system for displaying a set of image data using a multi-primary color system including a set of image data, a Magenta (M) primary value, an image data converter, a set of Session Description Protocol (SDP) parameters, at least one display device, wherein the at least one display device and the image data converter are in network communication, wherein the image data converter is operable to map the set of image data to a color matrix, wherein the color matrix includes primary values for Red (R), Green (G), Blue (B), Cyan (C), and Yellow (Y), wherein the color matrix further includes the M primary value, wherein the C, M, and the Y
primary color values include a set of substantially inverted hue angles corresponding to a set of hue angles for the R, G, and B primary color values, respectively, wherein the image data converter is operable to convert the set of image data for display on the at least one display device using the color matrix and an additive color space matrix corresponding to a specified color space.
In one embodiment, the image data converter includes a digital interface. In one embodiment, the digital interface is operable to encode and decode the set of image data.
In one embodiment, the system further includes at least one transfer function (TF) for processing the set of image data. In one embodiment, the set of SDP parameters is modifiable.
In one embodiment, the specified color space uses an ITU-R BT709.6 color gamut. In one embodiment, the multi-primary color system is a six-primary color system.
[00488] In one embodiment, the present invention provides a system for displaying a primary color system including a set of image data, an image data converter, a set of Session Description Protocol (SDP) parameters, and at least one display device, wherein the set of image data further includes primary color data for at least five primary color values, wherein the at least one display device and the image data converter are in network communication, and wherein the image data converter is operable to convert the set of image data for display on the at least one display device. In one embodiment, the set of image data includes a first set of color channel data and a second set of color channel data. In one embodiment, the image data converter includes a digital interface, wherein the digital interface is operable to encode and decode the set of image data. In one embodiment, the system further includes at least one transfer function (TF) for processing the set of image data. In one embodiment, the set of image data includes a bit level, wherein the image data converter is operable to convert the bit level of the set of image data, thereby creating an updated bit level.
In one embodiment, the set of SDP parameters is modifiable. In one embodiment, once the set of image data has been converted by the image data converter for the at least one display device, the set of SDP parameters is modified based on the conversion. In one embodiment, the at least one display device is operable to display the primary color system based on the set of image data. In one embodiment, the system further includes at least one electronic luminance component, wherein the at least one electronic luminance component is not calculated within the at least one display. In one embodiment, the first set of color channel data includes a first bit value defining black and a second bit value defining white, wherein the second set of color channel data includes a third bit value defining black and a fourth bit value defining white. In one embodiment, the set of SDP parameters is modified to include data corresponding to the first set of color channel data and the second set of color channel data.
In one embodiment, the primary color values are operable to be expressed using a tristimulus color vector, a linear display control vector, and a conversion matrix.
[00489] In another embodiment, the present invention provides a system for displaying a primary color system including a set of image data, wherein the set of image data includes a first set of color channel data and a second set of color channel data, an image data converter, a set of Session Description Protocol (SDP) parameters, wherein the set of SDP
parameters is modifiable, and at least one display device, wherein the set of image data further includes primary color data for at least five primary color values, wherein the at least one display device and the image data converter are in network communication, and wherein the image data converter is operable to convert the set of image data for display on the at least one display device. In one embodiment, the system further includes a standardized transport format, wherein the standardized transport format is operable to receive the first set of color channel data and the second set of color channel data as a combined set of color channel data, wherein the combined set of color channel data has a combined bit level equal to the bit level for the set of image data. In one embodiment, the set of SDP parameters indicate the set of image data being displayed on the at least one display device is using the primary color system. In one embodiment, the image data converter is operable to convert a bit level for the set of image data to a new bit level. In one embodiment, the system further includes a set of saturation data corresponding to the set of image data, wherein the set of saturation data is used to extend a set of hue angles for the first set of color channel data and the second set of color channel data. In one embodiment, the set of SDP parameters includes the first set of color channel data, the second set of color channel data, mapping data for the set of image data, and a flag indicator. In one embodiment, the image data converter includes a digital interface, and wherein the digital interface is operable to encode and decode the set of image data using at least one color difference component.
[00490] In yet another embodiment, the present invention provides a system for displaying a set of image data using a primary color system including a set of image data, an image data converter, a set of Session Description Protocol (SDP) parameters, and at least one display device, wherein the set of image data further includes primary color data for at least five primary color values, wherein the at least one display device and the image data converter are in network communication, and wherein the image data converter is operable to convert the set of image data for display on the at least one display device. In one embodiment, the at least one display device is operable to display the primary color system based on the set of image data, wherein the primary color system displayed on the at least one display device is based on the set of image data, such that the set of SDP parameters indicates that the set of image data being displayed on the at least one display device is using the primary color system. In one embodiment, the image data converter includes a digital interface, wherein the digital interface is operable to encode and decode the set of image data. In one embodiment, the system further includes at least one transfer function (TF) for processing the set of image data. In one embodiment, the set of SDP parameters is modifiable. In one embodiment, the set of image data includes a bit level, wherein the image data converter is operable to convert the bit level for the set of image data to a new bit level using the at least one TF. In one embodiment, the set of image data defines a minimum color luminance and a maximum color luminance. In one embodiment, the set of image data includes red (R), green (G), blue (B), cyan (C), and yellow (Y) primary color values. In one embodiment, the digital interface includes payload identification (ID) metadata, wherein the payload ID metadata is operable to identify the set of image data as a primary color set of image data.
[00491] In one embodiment, the present invention provides a system for displaying a primary color system including a set of image data, wherein the set of image data includes a bit level, an image data converter, wherein the image data converter includes a digital interface, wherein the digital interface is operable to encode and decode the set of image data, a set of Session Description Protocol (SDP) parameters, wherein the set of SDP
parameters is modifiable, and at least one display device, wherein the set of image data further includes primary color data for at least four primary color values, wherein the at least one display device and the image data converter are in network communication, wherein the image data converter is operable to convert the bit level for the set of image data, thereby creating an updated bit level, wherein the image data converter is operable to convert the set of image data for display on the at least one display device, wherein once the set of image data has been converted by the image data converter for the at least one display device, the set of SDP
parameters is modified based on the conversion, and wherein the at least one display device is operable to display the primary color system based on the set of image data, and wherein the set of SDP parameters indicates that the image data being displayed on the at least one display device is using the primary color system. In one embodiment, the at least one display device is a single display device. In one embodiment, the at least four primary color values are operable to be expressed using a tristimulus color vector, a linear display control vector, and a conversion matrix. In one embodiment, the digital interface encodes and decodes the set of image data using at least one color difference component, wherein the at least one color difference component is operable for up-sampling and/or down-sampling.
[00492] In another embodiment, the present invention provides a system for displaying a primary color system including a set of image data, wherein the set of image data includes a bit level, an image data converter, wherein the image data converter includes a digital interface, wherein the digital interface is operable to encode and decode the set of image data, at least one transfer function (TF) for processing the set of image data, a set of Session Description Protocol (SDP) parameters, wherein the set of SDP parameters is modifiable, and at least one display device, wherein the set of image data further includes primary color data for at least four primary color values, wherein the at least four primary color values include a cyan primary, wherein the at least one display device and the image data converter are in network communication, wherein the image data converter is operable to convert the bit level for the set of image data, thereby creating an updated bit level, wherein the image data converter is operable to convert the set of image data for display on the at least one display device, wherein once the set of image data has been converted by the image data converter for the at least one display device, the set of SDP parameters is modified based on the conversion, and wherein the at least one display device is operable to display the primary color system based on the set of image data, and wherein the set of SDP
parameters indicates that the image data being displayed on the at least one display device is using the primary color system.
[00493] In yet another embodiment, the present invention provides a system for displaying a primary color system, including a set of image data, wherein the set of image data includes a bit level, an image data converter, wherein the image data converter includes a digital interface, wherein the digital interface is operable to encode and decode the set of image data, at least one transfer function (TF) for processing the set of image data, a set of Session Description Protocol (SDP) parameters, wherein the set of SDP parameters is modifiable, and at least one display device, wherein the set of image data further includes primary color data for at least four primary color values, wherein the at least four primary color values include at least one white emitter, wherein the at least one display device and the image data converter are in network communication, wherein the image data converter is operable to convert the bit level for the set of image data, thereby creating an updated bit level, wherein the image data converter is operable to convert the set of image data for display on the at least one display device,. wherein once the set of image data has been converted by the image data converter for the at least one display device the set of SDP parameters is modified based on the conversion, and wherein the at least one display device is operable to display the primary color system based on the set of image data, and wherein the set of SDP
parameters indicates that the image data being displayed on the at least one display device is using the primary color system.
[00494] In one embodiment, the present invention provides a system for color conversion in a multi-primary color system including a color signal corresponding to XYZ
coordinates of a color, at least four primaries, at least four triads, wherein each of the at least four triads includes three of the at least four primaries, at least four XYZ-to-triad matrices, wherein each of the at least four XYZ-to-triad matrices corresponds to one of the at least four triads, and at least one display device, wherein the XYZ coordinates are multiplied by the at least four XYZ-to-triad matrices to determine one or more of the at least four triads in which the XYZ
coordinates are located, wherein a sum of primary components of the one or more of the at least four triads is determined on a per-component basis, wherein the sum is divided by a number of the one or more of the at least four triads, thereby creating an updated color signal, and wherein the at least one display device is operable to display the updated color signal. In one embodiment, the at least four primaries are at least five primaries, wherein the at least five primaries include at least four color primaries and a white point, and wherein the at least four triads each include two adjacent color primaries of the at least four color primaries and the white point. In one embodiment, each of the at least four triads does not contain a primary and its complement. In one embodiment, the at least four primaries include red (R), green (G), blue (B), cyan (C), magenta (M), and yellow (Y), wherein the at least four triads are eight triads, and wherein the eight triads include RGB, CMY, RBM, CGB, RGY, CMB, RMY, and CGY. In one embodiment, the at least four primaries include red (R), green (G), blue (B), cyan (C), magenta (M), and yellow (Y), wherein the at least four triads are five triads, and wherein the five triads include RGB, CMY, RBM, CGB, and RGY. In one embodiment, the at least four primaries include red (R), green (G), blue (B), cyan (C), and yellow (Y), wherein the at least four triads are six triads, and wherein the six triads include RGB, RGY, CGB, RCB, CGY, and CRY. In one embodiment, the one or more of the at least four triads is not more than two of the at least four triads. In one embodiment, the color is an out-of-gamut color and remapped to an in-gamut color along a straight line between the out-of-gamut color and a white point. In one embodiment, all values in a resulting matrix from the multiplication of the XYZ coordinates and the at least four XYZ-to-triad matrices are set to zero if any value in the resulting matrix is negative. In one embodiment, the at least four triads are selected such that a first triad includes a white point, a second triad includes the white point, and no other triads include the white point. In one embodiment, the at least four primaries include at least one virtual primary. In one embodiment, the at least one virtual primary is a virtual magenta primary, a virtual yellow primary, a virtual cyan primary, and/or a white point.
[00495] In another embodiment, the present invention provides a system for color conversion in a multi-primary color system including a color signal corresponding to XYZ
coordinates of a color, at least five primaries, wherein the at least five primaries include at least four color primaries and a virtual primary within a color gamut formed using the at least four color primaries, at least four triads, wherein each of the at least four triads includes two adjacent primaries of the at least four color primaries and the virtual primary, at least four XYZ-to-triad matrices, wherein each of the at least four XYZ-to-triad matrices corresponds to one of the at least four triads, and at least one display device, wherein the XYZ coordinates are multiplied by the at least four XYZ-to-triad matrices to determine one of the at least four triads in which the XYZ coordinates are located, thereby creating an updated color signal, and wherein the at least one display device is operable to display the updated color signal. In one embodiment, the at least four color primaries include red (R), green (G), blue (B), cyan (C), magenta (M), and yellow (Y). In one embodiment, the virtual primary is a white point. In one embodiment, the at least four color primaries includes at least one virtual color primary.
[00496] In yet another embodiment, the present invention provides a system for color conversion in a multi-primary color system including a color signal corresponding to XYZ
coordinates of a color, six primaries, eight triads, wherein each of the eight triads includes three of the six primaries, eight XYZ-to-triad matrices, wherein each of the eight XYZ-to-triad matrices corresponds to one of the eight triads, and at least one display device, wherein the XYZ coordinates are multiplied by each of the eight XYZ-to-triad matrices to determine two of the eight triads in which the XYZ coordinates are located, wherein a sum of primary components of the two triads is determined on a per-component basis, and wherein the sum is divided by two, thereby creating an updated color signal, and wherein the at least one display device is operable to display the updated color signal. In one embodiment, each of the eight triads does not contain a primary and its complement. In one embodiment, the six primaries include red (R), green (G), blue (B), cyan (C), magenta (M), and yellow (Y).
In one embodiment, the eight triads include RGB, CMY, RBM, CGB, RGY, CMB, RMY, and CGY.
[00497] FIG. 101 is a schematic diagram of an embodiment of the invention illustrating a computer system, generally described as 800, having a network 810, a plurality of computing devices 820, 830, 840, a server 850, and a database 870.
[00498] The server 850 is constructed, configured, and coupled to enable communication over a network 810 with a plurality of computing devices 820, 830, 840. The server 850 includes a processing unit 851 with an operating system 852. The operating system 852 enables the server 850 to communicate through network 810 with the remote, distributed user devices. Database 870 may house an operating system 872, memory 874, and programs 876.
[00499] In one embodiment of the invention, the system 800 includes a network 810 for distributed communication via a wireless communication antenna 812 and processing by at least one mobile communication computing device 830. Alternatively, wireless and wired communication and connectivity between devices and components described herein include wireless network communication such as WI-Fl, WORLDWIDE INTEROPERABILITY
FOR MICROWAVE ACCESS (WIMAX), Radio Frequency (RF) communication including RF identification (RFID), NEAR FIELD COMMUNICATION (NFC), BLUETOOTH
including BLUETOOTH LOW ENERGY (BLE), ZIGBEE, Infrared (IR) communication, cellular communication, satellite communication, Universal Serial Bus (USB), Ethernet communications, communication via fiber-optic cables, coaxial cables, twisted pair cables, and/or any other type of wireless or wired communication. In another embodiment of the invention, the system 800 is a virtualized computing system capable of executing any or all aspects of software and/or application components presented herein on the computing devices 820, 830, 840. In certain aspects, the computer system 800 may be implemented using hardware or a combination of software and hardware, either in a dedicated computing device, or integrated into another entity, or distributed across multiple entities or computing devices.
[00500] By way of example, and not limitation, the computing devices 820, 830, 840 are intended to represent various forms of electronic devices including at least a processor and a memory, such as a server, blade server, mainframe, mobile phone, personal digital assistant (PDA), smartphone, desktop computer, notebook computer, tablet computer, workstation, laptop, and other similar computing devices. The components shown here, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the invention described and/or claimed in the present application.
[00501] In one embodiment, the computing device 820 includes components such as a processor 860, a system memory 862 having a random access memory (RAM) 864 and a read-only memory (ROM) 866, and a system bus 868 that couples the memory 862 to the processor 860. In another embodiment, the computing device 830 may additionally include components such as a storage device 890 for storing the operating system 892 and one or more application programs 894, a network interface unit 896, and/or an input/output controller 898. Each of the components may be coupled to each other through at least one bus 868. The input/output controller 898 may receive and process input from, or provide output to, a number of other devices 899, including, but not limited to, alphanumeric input devices, mice, electronic styluses, display units, touch screens, signal generation devices (e.g., speakers), or printers.
[00502] By way of example, and not limitation, the processor 860 may be a general-purpose microprocessor (e.g., a central processing unit (CPU)), a graphics processing unit (GPU), a microcontroller, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA), a Programmable Logic Device (PLD), a controller, a state machine, gated or transistor logic, discrete hardware components, or any other suitable entity or combinations thereof that can perform calculations, process instructions for execution, and/or other manipulations of information.
[00503] In another implementation, shown as 840 in FIG. 101 multiple processors 860 and/or multiple buses 868 may be used, as appropriate, along with multiple memories 862 of multiple types (e.g., a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core).
[00504] Also, multiple computing devices may be connected, with each device providing portions of the necessary operations (e.g., a server bank, a group of blade servers, or a multi-processor system). Alternatively, some steps or methods may be performed by circuitry that is specific to a given function.
[00505] According to various embodiments, the computer system 800 may operate in a networked environment using logical connections to local and/or remote computing devices 820, 830, 840 through a network 810. A computing device 830 may connect to a network 810 through a network interface unit 896 connected to a bus 868. Computing devices may communicate communication media through wired networks, direct-wired connections or wirelessly, such as acoustic, RF, or infrared, through an antenna 897 in communication with the network antenna 812 and the network interface unit 896, which may include digital signal processing circuitry when necessary. The network interface unit 896 may provide for communications under various modes or protocols.
[00506] In one or more exemplary aspects, the instructions may be implemented in hardware, software, firmware, or any combinations thereof A computer readable medium may provide volatile or non-volatile storage for one or more sets of instructions, such as operating systems, data structures, program modules, applications, or other data embodying any one or more of the methodologies or functions described herein. The computer readable medium may include the memory 862, the processor 860, and/or the storage media 890 and may be a single medium or multiple media (e.g., a centralized or distributed computer system) that store the one or more sets of instructions 900. Non-transitory computer readable media includes all computer readable media, with the sole exception being a transitory, propagating signal per se. The instructions 900 may further be transmitted or received over the network 810 via the network interface unit 896 as communication media, which may include a modulated data signal such as a carrier wave or other transport mechanism and includes any deliver media. The term "modulated data signal" means a signal that has one or more of its characteristics changed or set in a manner as to encode information in the signal.
[00507] Storage devices 890 and memory 862 include, but are not limited to, volatile and non-volatile media such as cache, RAM, ROM, EPROM, EEPROM, FLASH memory, or other solid state memory technology, discs (e.g., digital versatile discs (DVD), HD-DVD, BLU-RAY, compact disc (CD), or CD-ROM) or other optical storage; magnetic cassettes, magnetic tape, magnetic disk storage, floppy disks, or other magnetic storage devices; or any other medium that can be used to store the computer readable instructions and which can be accessed by the computer system 800.
[00508] In one embodiment, the computer system 800 is within a cloud-based network. In one embodiment, the server 850 is a designated physical server for distributed computing devices 820, 830, and 840. In one embodiment, the server 850 is a cloud-based server platform. In one embodiment, the cloud-based server platform hosts serverless functions for distributed computing devices 820, 830, and 840.
[00509] In another embodiment, the computer system 800 is within an edge computing network. The server 850 is an edge server, and the database 870 is an edge database. The edge server 850 and the edge database 870 are part of an edge computing platform. In one embodiment, the edge server 850 and the edge database 870 are designated to distributed computing devices 820, 830, and 840. In one embodiment, the edge server 850 and the edge database 870 are not designated for computing devices 820, 830, and 840. The distributed computing devices 820, 830, and 840 are connected to an edge server in the edge computing network based on proximity, availability, latency, bandwidth, and/or other factors.
[00510] It is also contemplated that the computer system 800 may not include all of the components shown in FIG. 101 may include other components that are not explicitly shown in FIG. 101 or may utilize an architecture completely different than that shown in FIG. 101.
The various illustrative logical blocks, modules, elements, circuits, and algorithms described in connection with the embodiments discussed herein may be implemented as electronic hardware, computer software, or combinations of both. To clearly illustrate the interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the overall system. Skilled artisans may implement the described functionality in varying ways for each particular application (e.g., arranged in a different order or positioned in a different way), but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
[00511] The above-mentioned examples are provided to serve the purpose of clarifying the aspects of the invention, and it will be apparent to one skilled in the art that they do not serve to limit the scope of the invention. By nature, this invention is highly adjustable, customizable and adaptable. The above-mentioned examples are just some of the many configurations that the mentioned components can take on. All modifications and improvements have been deleted herein for the sake of conciseness and readability but are properly within the scope of the present invention.
1.7874 1.9278 1.6063 1.5361 [00235] = ¨cR" B, = cB" = cc' -y6' yc, = CY6¨
1.7874 1.9278 1.6063 1.5361 [00236] The ratios for Cr, Cb, Cc, and Cy are also valid in linear light calcuations.
[00237] Magenta can be calculated as follows:
[00238] M = B +R or M = ¨B+R
B xR BxR
[00239] SYSTEM 1 [00240] In one embodiment, the multi-primary color system is compatible with legacy systems. A backwards compatible multi-primary color system is defined by a sampling method. In one embodiment, the sampling method is 4:4:4. In one embodiment, the sampling method is 4:2:2. In another embodiment, the sampling method is 4:2:0. In one embodiment of a backwards compatible multi-primary color system, new encode and decode systems are divided into the steps of performing base encoding and digitization, image data stacking, mapping into the standard data transport, readout, unstacking, and image decoding ("System 1"). In one embodiment, System 1 combines opposing color primaries within three standard transport channels and identifies them by their code value. In one embodiment of a backwards compatible multi-primary color system, the processes are analog processes. In another embodiment of a backwards compatible multi-primary color system, the processes are digital processes.
[00241] In one embodiment, the sampling method for a multi-primary color system is a 4:4:4 sampling method. Black and white bits are redefined. In one embodiment, putting black at midlevel within each data word allows the addition of CYM color data.
[00242] FIG. 16 illustrates an embodiment of an encode and decode system for a multi-primary color system. In one embodiment, the multi-primary color encode and decode system is divided into a base encoder and digitation, image data stacking, mapping into the standard data transport, readout, unstack, and finally image decoding ("System 1"). In one embodiment, the method of this system combines opposing color primaries within the three standard transport channels and identifies them by their code value. In one embodiment, the encode and decode for a multi-primary color system are analog-based. In another embodiment, the encode and decode for a multi-primary color system are digital-based.
System 1 is designed to be compatible with lower bandwidth systems and allows a maximum of 11 bits per channel and is limited to sending only three channels of up to six primaries at a time. In one embodiment, it does this by using a stacking system where either the color channel or the complementary channel is decoded depending on the bit level of that one channel.
[00243] SYSTEM 2 [00244] FIG. 17 illustrates a sequential method where three color primaries are passed to the transport format as full bit level image data and inserted as normal ("System 2"). The three additional channels are delayed by one pixel and then placed into the transport instead of the first colors. This method is useful in situations where quantizing artifacts is critical to image performance. In one embodiment, this system is comprised of six primaries (RGBCYM), a method to delay the CYM colors for injection, image resolution identification to all for pixel count synchronization, start of video identification, RGB
delay, and for YCCCCC systems, logic to select the dominant color primary. The advantage of System 2 is that full bit level video can be transported, but at double the normal data rate.
[00245] SYSTEM 3 [00246] FIG. 18 illustrates one embodiment of a system encode and decode process using a dual link method ("System 3"). System 3 utilizes a dual link method where two wires are used. In one embodiment, RGB is sent to link A and CYM is sent to link B.
After arriving at the image destination, the two links are recombined.
[00247] System 3 is simpler and more straight forward than Systems 1 and 2.
The advantage with this system is that adoption is simply to format non-RGB
primaries (e.g., CYM) on a second link. So, in one example, for an SDI design, RGB is sent on a standard SDI stream just as it is currently done. There is no modification to the transport and this link is operable to be sent to any RGB display requiring only the compensation for the luminance difference because the CYM components are not included. CYM data is transported in the same manner as RGB data. This data is then combined in the display to make up a 6P image.
The downside is that the system requires two wires to move one image. This system is operable to work with most any format including SMPTE 5T292, 424, 2082, and 2110. It also is operable to work with dual HDMI/CTA connections. In one embodiment, the system includes at least one transfer function (e.g., OETF, EOTF).
[00248] FIG. 19 illustrates one embodiment of an encoding process using a dual link method.
[00249] FIG. 20 illustrates one embodiment of a decoding process using a dual link method.
[00250] TRANSFER FUNCTIONS
[00251] The system design minimizes limitations to use standard transfer functions for both encode and/or decode processes. Current practices used in standards include, but are not limited to, ITU-R BT.1886, ITU-R BT.2020, SMPTE ST274, SMPTE ST296, SMPTE
ST2084, and ITU-R BT.2100. These standards are compatible with this system and require no modification.
[00252] Encoding and decoding 6P images is formatted into several different configurations to adapt to image transport frequency limitations. The highest quality transport is obtained by keeping all components as RGBCMY components. This uses the highest sampling frequencies and requires the most signal bandwidth. An alternate method is to sum the image details in a luminance channel at full bandwidth and then send the color difference signals at half or quarter sampling (e.g., Y Cr Cb Cc Cy). This allows a similar image to pass through lower bandwidth transports.
[00253] SIX-PRIMARY COLOR ENCODE USING A 4:4:4 SAMPLING METHOD
[00254] FIG. 21 illustrates one embodiment of a six-primary color system encode using a 4:4:4 sampling method.
[00255] Subjective testing during the development and implementation of the current digital cinema system (DCI Version 1.2) showed that perceptible quantizing artifacts were not noticeable with system bit resolutions higher than 11 bits. Current serial digital transport systems support 12 bits. Remapping six color components to a 12-bit stream is accomplished by lowering the bit limit to 11 bits (values 0 to 2047) for 12-bit serial systems or 9 bits (values 0 to 512) for 10-bit serial systems. This process is accomplished by processing RGBCYM video information through a standard Optical Electronic Transfer Function (OETF) (e.g., ITU-R BT.709-6), digitizing the video information as four samples per pixel, and quantizing the video information as 11-bit or 9-bit.
[00256] In another embodiment, the RGBCYM video information is processed through a standard Optical Optical Transfer Function (00TF). In yet another embodiment, the RGBCYM video information is processed through a Transfer Function (TF) other than OETF
or 00TF. TFs consist of two components, a Modulation Transfer Function (MTF) and a Phase Transfer Function (PTF). The MTF is a measure of the ability of an optical system to transfer various levels of detail from object to image. In one embodiment, performance is measured in terms of contrast (degrees of gray), or of modulation, produced for a perfect source of that detail level. The PTF is a measure of the relative phase in the image(s) as a function of frequency. A relative phase change of 180 , for example, indicates that black and white in the image are reversed. This phenomenon occurs when the TF becomes negative.
[00257] There are several methods for measuring MTF. In one embodiment, MTF is measured using discrete frequency generation. In one embodiment, MTF is measured using continuous frequency generation. In another embodiment, MTF is measured using image scanning. In another embodiment, MTF is measured using waveform analysis.
[00258] In one embodiment, the six-primary color system is for a 12-bit serial system.
Current practices normally set black at bit 0 and white at bit 4095 for 12-bit video. In order to package six colors into the existing three-serial streams, the bit defining black is moved to bit 2048. Thus, the new encode has RGB values starting at 2048 for black and bit 4095 for white and CYM values starting at bit 2047 for black and bit 0 as white. In another embodiment, the six-primary color system is for a 10-bit serial system.
[00259] FIG. 22 illustrates one embodiment for a method to package six channels of primary information into the three standard primary channels used in current serial video standards by modifying bit numbers for a 12-bit SDI and a 10-bit SDI. FIG. 23 illustrates a simplified diagram estimating perceived viewer sensation as code values define each hue angle. Table 16 and Table 17 list bit assignments for computer, production, and broadcast for a 12-bit system and a 10-bit system, respectively. In one embodiment, "Computer" refers to bit assignments compatible with CTA 861-G, November 2016, which is incorporated herein by reference in its entirety. In one embodiment, "Production" and/or "Broadcast" refer to bit assignments compatible with SMPTE ST 2082-0 (2016), SMPTE ST 2082-1 (2015), SMPTE
ST 2082-10 (2015), SMPTE ST 2082-11(2016), SMPTE ST 2082-12 (2016), SMPTE ST
2110-10 (2017), SMPTE ST 2110-20 (2017), SMPTE ST 2110-21 (2017), SMPTE ST
30 (2017), SMPTE ST 2110-31 (2018), and/or SMPTE ST 2110-40 (2018), each of which is incorporated herein by reference in its entirety.
[00260] TABLE 16: 12-Bit Assignments Computer Production Broadcast RGB CYM RGB CYM RGB CYM
Peak Brightness 4095 0 4076 16 3839 256 Minimum Brightness 2048 2047 2052 2032 2304 1792 [00261] TABLE 17: 10-Bit Assignments Computer Production Broadcast RGB CYM RGB CYM RGB CYM
Peak Brightness 1023 0 1019 4 940 64 Minimum Brightness 512 511 516 508 576 448 [00262] In one embodiment, the OETF process is defined in ITU-R BT.709-6, which is incorporated herein by reference in its entirety. In one embodiment, the OETF
process is defined in ITU-R BT.709-5, which is incorporated herein by reference in its entirety. In another embodiment, the OETF process is defined in ITU-R BT.709-4, which is incorporated herein by reference in its entirety. In yet another embodiment, the OETF
process is defined in ITU-R BT.709-3, which is incorporated herein by reference in its entirety. In yet another embodiment, the OETF process is defined in ITU-R BT.709-2, which is incorporated herein by reference in its entirety. In yet another embodiment, the OETF process is defined in ITU-R BT.709-1, which is incorporated herein by reference in its entirety.
[00263] In one embodiment, the encoder is a non-constant luminance encoder. In another embodiment, the encoder is a constant luminance encoder.
[00264] SIX-PRIMARY COLOR PACKING/STACKING USING A 4:4:4 SAMPLING
METHOD
[00265] FIG. 24 illustrates one embodiment for a method of stacking/encoding six-primary color information using a 4:4:4 video system. Image data must be assembled according the serial system used. This is not a conversion process, but instead is a packing/stacking process.
In one embodiment, the packing/stacking process is for a six-primary color system using a 4:4:4 sampling method.
[00266] FIG. 25 illustrates one embodiment for a method of unstacking/decoding six-primary color information using a 4:4:4 video system. In one embodiment, the RGB channels and the CYM channels are combined into one 12-bit word and sent to a standardized transport format. In one embodiment, the standardized transport format is SDI. In one embodiment, the decode is for a non-constant luminance, six-primary color system. In another embodiment, the decode is for a constant luminance, six-primary color system. In yet another embodiment, an electronic optical transfer function (EOTF) (e.g., ITU-R BT.1886) coverts image data back to linear for display. In one embodiment, the EOTF is defined in ITU-R BT.1886 (2011), which is incorporated herein by reference in its entirety.
FIG. 26 illustrates one embodiment of a 4:4:4 decoder.
[00267] System 2 uses sequential mapping to the standard transport format, so it includes a delay for the CYM data. The CYM data is recovered in the decoder by delaying the RGB
data. Since there is no stacking process, the full bit level video can be transported. For displays that are using optical filtering, this RGB delay could be removed and the process of mapping image data to the correct filter could be eliminated by assuming this delay with placement of the optical filter and the use of sequential filter colors.
[00268] Two methods can be used based on the type of optical filter used.
Since this system is operating on a horizontal pixel sequence, some vertical compensation is required and pixels are rectangular. This can be either as a line double repeat using the same RGBCYM data to fill the following line as shown in FIG. 27, or could be separated as RGB
on line one and CYM on line two as shown in FIG. 28. The format shown in FIG.
28 allows for square pixels, but the CMY components requires a line delay for synchronization. Other patterns eliminating the white subpixel are also compatible with the present invention.
[00269] FIG. 29 illustrates an embodiment of the present invention for sending six primary colors to a standardized transport format using a 4:4:4 encoder according to System 2.
Encoding is straight forward with a path for RGB sent directly to the transport format. RGB
data is mapped to each even numbered data segment in the transport. CYM data is mapped to each odd numbered segment. Because different resolutions are used in all of the standardized transport formats, there must be identification for what they are so that the start of each horizontal line and horizontal pixel count can be identified to time the RGB/CYM mapping to the transport. The identification is the same as currently used in each standardized transport function. Table 18, Table 19, Table 20, and Table 21 list 16-bit assignments, 12-bit assignments, 10-bit assignments, and 8-bit assignments, respectively. In one embodiment, "Computer" refers to bit assignments compatible with CTA 861-G, November 2016, which is incorporated herein by reference in its entirety. In one embodiment, "Production" and/or "Broadcast" refer to bit assignments compatible with SMPTE ST 2082-0 (2016), SMPTE ST
2082-1 (2015), SMPTE ST 2082-10 (2015), SMPTE ST 2082-11(2016), SMPTE ST 2082-12 (2016), SMPTE ST 2110-10 (2017), SMPTE ST 2110-20 (2017), SMPTE ST 2110-21 (2017), SMPTE ST 2110-30 (2017), SMPTE ST 2110-31 (2018), and/or SMPTE ST 2110-(2018), each of which is incorporated herein by reference in its entirety.
[00270] TABLE 18: 16-Bit Assignments Computer Production RGB CYM RGB CYM
Peak Brightness 65536 65536 65216 65216 Minimum Brightness 0 0 256 256 [00271] TABLE 19: 12-Bit Assignments Computer Production Broadcast RGB CYM RGB CYM RGB CYM
Peak Brightness 4095 4095 4076 4076 3839 3839 Minimum Brightness 0 0 16 16 256 256 [00272] TABLE 20: 10-Bit Assignments Computer Production Broadcast RGB CYM RGB CYM RGB CYM
Peak Brightness 1023 1023 1019 1019 940 940 Minimum Brightness 0 0 4 4 64 64 [00273] TABLE 21: 8-Bit Assignments Computer Production Broadcast RGB CYM RGB CYM RGB CYM
Peak Brightness 255 255 254 254 235 235 Minimum Brightness 0 0 1 1 16 16 [00274] The decode adds a pixel delay to the RGB data to realign the channels to a common pixel timing. EOTF is applied and the output is sent to the next device in the system.
Metadata based on the standardized transport format is used to identify the format and image resolution so that the unpacking from the transport can be synchronized. FIG.
30 shows one embodiment of a decoding with a pixel delay.
[00275] In one embodiment, the decoding is 4:4:4 decoding. With this method, the six-primary color decoder is in the signal path, where 11-bit values for RGB are arranged above data level 2048, while CYM levels are arranged below data level 2047 as 11-bit. If the same data set is sent to a display and/or process that is not operable for six-primary color processing, the image data is assumed as black at 0 level as a full 12-bit word. Decoding begins by tapping image data prior to the unstacking process.
[00276] SIX-PRIMARY COLOR ENCODE USING A 4:2:2 SAMPLING METHOD
[00277] In one embodiment, the packing/stacking process is for a six-primary color system using a 4:2:2 sampling method. In order to fit the new six-primary color system into a lower bandwidth serial system, while maintaining backwards compatibility, the standard method of converting from RGBCYM to a luminance and a set of color difference signals requires the addition of at least one new image designator. In one embodiment, the encoding and/or decoding process is compatible with transport through SMPTE ST 292-0 (2011), SMPTE ST
292-1 (2011, 2012, and/or 2018), SMPTE ST 292-2 (2011), SMPTE ST 2022-1 (2007), SMPTE ST 2022-2 (2007), SMPTE ST 2022-3 (2010), SMPTE ST 2022-4 (2011), SMPTE
ST 2022-5 (2012 and/or 2013), SMPTE ST 2022-6 (2012), SMPTE ST 2022-7 (2013), and/or and CTA 861-G (2106), each of which is incorporated herein by reference in its entirety.
[00278] In order for the system to package all of the image while supporting both six-primary and legacy displays, an electronic luminance component (Y) must be derived. The first component is: E. It can be described as:
G6 = 0.1063ER' ed + 0.231954ellow 0.3576Ereen 0.19685Eyan + 0.036141,w + 0.0712E14agenta [00279] Critical to getting back to legacy display compatibility, value Ely is described as:
Ely = E ¨ (Ec'yan + Eeuow E enta) [00280] In addition, at least two new color components are disclosed. These are designated as Cc and Cy components. The at least two new color components include a method to compensate for luminance and enable the system to function with older Y Cb Cr infrastructures. In one embodiment, adjustments are made to Cb and Cr in a Y
Cb Cr infrastructure since the related level of luminance is operable for division over more components. These new components are as follows:
(El? ¨ 6 ) (EL ¨ CT6) (E¨E6) ¨ G6) E' ¨ Ecf R =
1.7874 ,Ef c B = _______________ 1.9278 , E' C = _________________________ 1.6063 , CY 1.5361 [00281] Within such a system, it is not possible to define magenta as a wavelength. This is because the green vector in CIE 1976 passes into, and beyond, the CIE
designated purple line. Magenta is a sum of blue and red. Thus, in one embodiment, magenta is resolved as a calculation, not as optical data. In one embodiment, both the camera side and the monitor side of the system use magenta filters. In this case, if magenta were defined as a wavelength, it would not land at the point described. Instead, magenta would appear as a very deep blue which would include a narrow bandwidth primary, resulting in metameric issues from using narrow spectral components. In one embodiment, magenta as an integer value is resolved using the following equation:
rINT RINTI
MINT ¨ 2 [00282] The above equation assists in maintaining the fidelity of a magenta value while minimizing any metameric errors. This is advantageous over prior art, where magenta appears instead as a deep blue instead of the intended primary color value.
[00283] SIX-PRIMARY NON-CONSTANT LUMINANCE ENCODE USING A 4:2:2 SAMPLING METHOD
[00284] In one embodiment, the six-primary color system using a non-constant luminance encode for use with a 4:2:2 sampling method. In one embodiment, the encoding process and/or decoding process is compatible with transport through SMPTE ST 292-0 (2011), SMPTE ST 292-1 (2011, 2012, and/or 2018), SMPTE ST 292-2 (2011), SMPTE ST 2022-(2007), SMPTE ST 2022-2 (2007), SMPTE ST 2022-3 (2010), SMPTE ST 2022-4 (2011), SMPTE ST 2022-5 (2012 and/or 2013), SMPTE ST 2022-6 (2012), SMPTE ST 2022-7 (2013), and/or and CTA 861-G (2106), each of which is incorporated herein by reference in its entirety.
[00285] Current practices use a non-constant luminance path design, which is found in all the video systems currently deployed. FIG. 31 illustrates one embodiment of an encode process for 4:2:2 video for packaging five channels of information into the standard three-channel designs. For 4:2:2, a similar method to the 4:4:4 system is used to package five channels of information into the standard three-channel designs used in current serial video standards. FIG. 31 illustrates 12-bit SDI and 10-bit SDI encoding for a 4:2:2 system. Table 22 and Table 23 list bit assignments for a 12-bit and 10-bit system, respectively. In one embodiment, "Computer" refers to bit assignments compatible with CTA 861-G, November 2016, which is incorporated herein by reference in its entirety. In one embodiment, "Production" and/or "Broadcast" refer to bit assignments compatible with SMPTE
(2016), SMPTE ST 2082-1 (2015), SMPTE ST 2082-10 (2015), SMPTE ST 2082-11 (2016), SMPTE ST 2082-12 (2016), SMPTE ST 2110-10 (2017), SMPTE ST 2110-20 (2017), SMPTE ST 2110-21 (2017), SMPTE ST 2110-30 (2017), SMPTE ST 2110-31 (2018), and/or SMPTE ST 2110-40 (2018), each of which is incorporated herein by reference in its entirety.
[00286] TABLE 22: 12-Bit Assignments Computer Production Broadcast EY6 ECR,ECB ECc,ECy EY6 ECR,ECB ECc,E Cy EY6 ECR,EC- ECc,EC-B
Peak 4095 4095 0 4076 4076 16 3839 3839 256 Brightness Minimum 0 2048 2047 16 2052 2032 256 2304 1792 Brightness [00287] TABLE 23: 10-Bit Assignments Computer Production Broadcast EY6 ECR,ECB E Cc,E Cy EY6 ECR,ECB ECc,E Cy EY6 ECR,EC- ECc,EC-B
Peak 1023 1023 0 1019 1019 4 940 940 64 Brightness Minimum 0 512 511 4 516 508 64 576 448 Brightness [00288] FIG. 32 illustrates one embodiment for a non-constant luminance encoding process for a six-primary color system. The design of this process is similar to the designs used in current RGB systems. Input video is sent to the Optical Electronic Transfer Function (OETF) process and then to the Ey6encoder. The output of this encoder includes all of the image detail information. In one embodiment, all of the image detail information is output as a monochrome image.
[00289] The output is then subtracted from EL, EL, EL and E)C to make the following color difference components:
4R, 4B, These components are then half sampled (x2) while G6is fully sampled (x4).
[00290] FIG. 33 illustrates one embodiment of a packaging process for a six-primary color system. These components are then sent to the packing/stacking process.
Components Ey_INT and EL_INT are inverted so that bit 0 now defines peak luminance for the corresponding component. In one embodiment, this is the same packaging process performed with the 4:4:4 sampling method design, resulting in two 11-bit components combining into one 12-bit component.
[00291] SIX-PRIMARY NON-CONSTANT LUMINANCE DECODE USING A 4:2:2 SAMPLING METHOD
[00292] FIG. 34 illustrates a 4:2:2 unstack process for a six-primary color system. In one embodiment, the image data is extracted from the serial format through the normal processes as defined by the serial data format standard. In another embodiment, the serial data format standard uses a 4:2:2 sampling structure. In yet another embodiment, the serial data format standard is SMPTE 5T292. The color difference components are separated and formatted back to valid 11-bit data. Components Ec' Y-INT and EL-INT are inverted so that bit 2047 defines peak color luminance.
[00293] FIG. 35 illustrates one embodiment of a process to inversely quantize each individual color and pass the data through an electronic optical function transfer (EOTF) in a non-constant luminance system. The individual color components, as well as G6_ are INT
inversely quantized and summed to breakout each individual color. Magenta is then calculated and G6_,NTis combined with these colors to resolve green. These calculations then go back through an Electronic Optical Transfer Function (EOTF) process to output the six-primary color system.
[00294] In one embodiment, the decoding is 4:2:2 decoding. This decode follows the same principles as the 4:4:4 decoder. However, in 4:2:2 decoding, a luminance channel is used instead of discrete color channels. Here, image data is still taken prior to unstack from the EL3_1NT Ey_INT and E'R_INT EL_INT channels. With a 4:2:2 decoder, a new component, called E_fy, is used to subtract the luminance levels that are present from the CYM channels from the Ecf B-INT ECf Y-INT and ECf R-INT EL-INT components. The resulting output is now the R and B image components of the EOTF process. E_fy is also sent to the G matrix to convert the luminance and color difference components to a green output.
Thus, R'G'B ' is input to the EOTF process and output as GRGB, BRGB, and BRGB.
In another embodiment, the decoder is a legacy RGB decoder for non-constant luminance systems.
[00295] In one embodiment, the standard is SMPTE ST292. In one embodiment, the standard is SMPTE RP431-2. In one embodiment, the standard is ITU-R BT.2020.
In another embodiment, the standard is SMPTE RP431-1. In another embodiment, the standard is ITU-R
BT.1886. In another embodiment, the standard is SMPTE ST274. In another embodiment, the standard is SMPTE ST296. In another embodiment, the standard is SMPTE ST2084.
In yet another embodiment, the standard is ITU-R BT.2100. In yet another embodiment, the standard is SMPTE ST424. In yet another embodiment, the standard is SMPTE
ST425. In yet another embodiment, the standard is SMPTE ST2110.
[00296] SIX-PRIMARY CONSTANT LUMINANCE DECODE USING A 4:2:2 SAMPLING METHOD
[00297] FIG. 36 illustrates one embodiment of a constant luminance encode for a six-primary color system. FIG. 37 illustrates one embodiment of a constant luminance decode for a six-primary color system. The process for constant luminance encode and decode are very similar. The main difference being that the management of Ey6is linear. The encode and decode processes stack into the standard serial data streams in the same way as is present in a non-constant luminance, six-primary color system. In one embodiment, the stacker design is the same as with the non-constant luminance system.
[00298] System 2 operation is using a sequential method of mapping to the standard transport instead of the method in System 1 where pixel data is combined to two color primaries in one data set as an 11-bit word. The advantage of System 1 is that there is no change to the standard transport. The advantage of System 2 is that full bit level video can be transported, but at double the normal data rate.
[00299] The difference between the systems is the use of two Y channels in System 2.
YRGB and YCym are used to define the luminance value for RGB as one group and CYM for the other.
[00300] FIG. 38 illustrates one example of 4:2:2 non-constant luminance encoding.
Because the RGB and CYM components are mapped at different time intervals, there is no requirement for a stacking process and data is fed directly to the transport format. The development of the separate color difference components is identical to System 1.
[00301] The encoder for System 2 takes the formatted color components in the same way as System 1. Two matrices are used to build two luminance channels. YRGB
contains the luminance value for the RGB color primaries. YCym contains the luminance value for the CYM color primaries. A set of delays are used to sequence the proper channel for YRGB, YCIVIY, and the RBCY channels. Because the RGB and CYM components are mapped at different time intervals, there is no requirement for a stacking process, and data is fed directly to the transport format. The development of the separate color difference components is identical to System 1. The Encoder for System 2 takes the formatted color components in the same way as System 1. Two matrices are used to build two luminance channels:
YRGB
contains the luminance value for the RGB color primaries and Yon, contains the luminance value for the CMY color primaries. This sequences YRGB, CR, and CC channels into the even segments of the standardized transport and Yavry, CB, and CY into the odd numbered segments. Since there is no combining color primary channels, full bit levels can be used limited only by the design of the standardized transport method. In addition, for use in matrix driven displays, there is no change to the input processing and only the method of outputting the correct color is required if the filtering or emissive subpixel is also placed sequentially.
[00302] Timing for the sequence is calculated by the source format descriptor which then flags the start of video and sets the pixel timing.
[00303] FIG. 39 illustrates one embodiment of a non-constant luminance decoding system.
Decoding uses timing synchronization from the format descriptor and start of video flags that are included in the payload ID, SDP, or EDID tables. This starts the pixel clock for each horizontal line ot identify which set of components are routed to the proper part of the decoder. A pixel delay is used to realign the color primarily data of each subpixel. YRGB and YCIVIY are combined to assemble a new Y6 component which is used to decode the CR, CB, CC, CY, and CM components into RGBCYM.
[00304] The constant luminance system is not different from the non-constant luminance system in regard to operation. The difference is that the luminance calculation is done as a linear function instead of including the 00TF. FIG. 40 illustrates one embodiment of a 4:2:2 constant luminance encoding system. FIG. 41 illustrates one embodiment of a 4:2:2 constant luminance decoding system.
[00305] SIX-PRIMARY COLOR SYSTEM USING A 4:2:0 SAMPLING SYSTEM
[00306] In one embodiment, the six-primary color system uses a 4:2:0 sampling system.
The 4:2:0 format is widely used in H.262/MPEG-2, H.264/MPEG-4 Part 10 and VC-1 compression. The process defined in SMPTE RP2050-1 provides a direct method to convert from a 4:2:2 sample structure to a 4:2:0 structure. When a 4:2:0 video decoder and encoder are connected via a 4:2:2 serial interface, the 4:2:0 data is decoded and converted to 4:2:2 by up-sampling the color difference component. In the 4:2:0 video encoder, the 4:2:2 video data is converted to 4:2:0 video data by down-sampling the color difference component.
[00307] There typically exists a color difference mismatch between the 4:2:0 video data from the 4:2:0 video data to be encoded. Several stages of codec concatenation are common through the processing chain. As a result, color difference signal mismatch between 4:2:0 video data input to 4:2:0 video encoder and 4:2:0 video output from 4:2:0 video decoder is accumulated and the degradation becomes visible.
[00308] FILTERING WITHIN A SIX-PRIMARY COLOR SYSTEM USING A 4:2:0 SAMPLING METHOD
[00309] When a 4:2:0 video decoder and encoder are connected via a serial interface, 4:2:0 data is decoded and the data is converted to 4:2:2 by up-sampling the color difference component, and then the 4:2:2 video data is mapped onto a serial interface. In the 4:2:0 video encoder, the 4:2:2 video data from the serial interface is converted to 4:2:0 video data by down-sampling the color difference component. At least one set of filter coefficients exists for 4:2:0/4:2:2 up-sampling and 4:2:2/4:2:0 down-sampling. The at least one set of filter coefficients provide minimally degraded 4:2:0 color difference signals in concatenated operations.
[00310] FILTER COEFFICIENTS IN A SIX-PRIMARY COLOR SYSTEM USING A
4:2:0 SAMPLING METHOD
[00311] FIG. 42 illustrates one embodiment of a raster encoding diagram of sample placements for a six-primary color 4:2:0 progressive scan system. Within this compression process, horizontal lines show the raster on a display matrix. Vertical lines depict drive columns. The intersection of these is a pixel calculation. Data around a particular pixel is used to calculate color and brightness of the subpixels. Each "X" shows placement timing of the Ey6 sample. Red dots depict placement of the sample. Blue -/NT -INT EL-INT
triangles show placement of the Ecf B_INT ECf Y-INT sample.
[00312] In one embodiment, the raster is an RGB raster. In another embodiment, the raster is a RGBCYM raster.
[00313] SIX-PRIMARY COLOR SYSTEM BACKWARDS COMPATIBILITY
[00314] By designing the color gamut within the saturation levels of standard formats and using inverse color primary positions, it is easy to resolve an RGB image with minimal processing. In one embodiment for six-primary encoding, image data is split across three color channels in a transport system. In one embodiment, the image data is read as six-primary data. In another embodiment, the image data is read as RGB data. By maintaining a standard white point, the axis of modulation for each channel is considered as values describing two colors (e.g., blue and yellow) for a six-primary system or as a single color (e.g., blue) for an RGB system. This is based on where black is referenced. In one embodiment of a six-primary color system, black is decoded at a mid-level value. In an RGB
system, the same data stream is used, but black is referenced at bit zero, not a mid-level.
[00315] In one embodiment, the RGB values encoded in the 6P stream are based on ITU-R
BT.709. In another embodiment, the RGB values encoded are based on SMPTE
RP431.
Advantageously, these two embodiments require almost no processing to recover values for legacy display.
[00316] Two decoding methods are proposed. The first is a preferred method that uses very limited processing, negating any issues with latency. The second is a more straightforward method using a set of matrices at the end of the signal path to conform the 6P
image to RGB.
[00317] In one embodiment, the decoding is for a 4:4:4 system. In one embodiment, the assumption of black places the correct data with each channel. If the 6P
decoder is in the signal path, 11-bit values for RGB are arranged above data level 2048, while CYM level are arranged below data level 2047 as 11-bit. However, if this same data set is sent to a display or process that is does not understand 6P processing, then that image data is assumed as black at 0 level as a full 12-bit word.
[00318] FIG. 43 illustrates one embodiment of the six-primary color unstack process in a 4:2:2 video system. Decoding starts by tapping image data prior to the unstacking process.
The input to the 6P unstack will map as shown in FIG. 44. The output of the 6P
decoder will map as shown in FIG. 45. This same data is sent uncorrected as the legacy RGB
image data.
The interpretation of the RGB decode will map as shown in FIG. 46.
[00319] Alternatively, the decoding is for a 4:2:2 system. This decode uses the same principles as the 4:4:4 decoder, but because a luminance channel is used instead of discrete color channels, the processing is modified. Legacy image data is still taken prior to unstack from the .E.B_INT Ey_INT and .E.R_INT EL_INT channels as shown in FIG. 47.
[00320] FIG. 48 illustrates one embodiment of a non-constant luminance decoder with a legacy process. The dotted box marked (1) shows the process where a new component called Eiyis used to subtract the luminance levels that are present from the CYM
channels from the ECf B-INT ECf Y-INT and ECf R-INT Ecf c_INT components as shown in box (2).
The resulting output is now the R and B image components of the EOTF process. Eiyis also sent to the G
matrix to convert the luminance and color difference components to a green output as shown in box (3). Thus, R'G 'B ' is input to the EOTF process and output as GRGB, RRGB, and BRGB. In another embodiment, the decoder is a legacy RGB decoder for non-constant luminance systems.
[00321] For a constant luminance system, the process is very similar with the exception that green is calculated as linear as shown in FIG. 49.
[00322] SIX-PRIMARY COLOR SYSTEM USING A MATRIX OUTPUT
[00323] In one embodiment, the six-primary color system outputs a legacy RGB
image.
This requires a matrix output to be built at the very end of the signal path.
FIG. 50 illustrates one embodiment of a legacy RGB image output at the end of the signal path. The design logic of the C, M, and Y primaries is in that they are substantially equal in saturation and placed at substantially inverted hue angles compared to R, G, and B primaries, respectively. In one embodiment, substantially equal in saturation refers to a 10% difference in saturation values for the C, M, and Y primaries in comparison to saturation values for the R, G, and B
primaries, respectively. In addition, substantially equal in saturation covers additional percentage differences in saturation values falling within the 10% difference range. For example, substantially equal in saturation further covers a 7.5% difference in saturation values for the C, M, and Y primaries in comparison to the saturation values for the R, G, and B primaries, respectively; a 5% difference in saturation values for the C, M, and Y primaries in comparison to the saturation values for the R, G, and B primaries, respectively; a 2%
difference in saturation values for the C, M, and Y primaries in comparison to the saturation values for the R, G, and B primaries, respectively; a 1% difference in saturation values for the C, M, and Y primaries in comparison to the saturation values for the R, G, and B
primaries, respectively; and/or a 0.5% difference in saturation values for the C, M, and Y
primaries in comparison to the saturation values for the R, G, and B
primaries, respectively.
In a preferred embodiment, the C, M, and Y primaries are equal in saturation to the R, G, and B primaries, respectively. For example, the cyan primary is equal in saturation to the red primary, the magenta primary is equal in saturation to the green primary, and the yellow primary is equal in saturation to the blue primary.
[00324] In an alternative embodiment, the saturation values of the C, M, and Y
primaries are not required to be substantially equal to their corollary primary saturation value among the R, G, and B primaries, but are substantially equal in saturation to a primary other than their corollary R, G, or B primary value. For example, the C primary saturation value is not required to be substantially equal in saturation to the R primary saturation value, but rather is substantially equal in saturation to the G primary saturation value and/or the B primary saturation value. In one embodiment, two different color saturations are used, wherein the two different color saturations are based on standardized gamuts already in use.
[00325] In one embodiment, substantially inverted hue angles refers to a 10%
angle range from an inverted hue angle (e.g., 180 degrees). In addition, substantially inverted hue angles cover additional percentage differences within the 10% angle range from an inverted hue angle. For example, substantially inverted hue angles further covers a 7.5% angle range from an inverted hue angle, a 5% angle range from an inverted hue angle, a 2% angle range from an inverted hue angle, a 1% angle range from an inverted hue angle, and/or a 0.5% angle range from an inverted hue angle. In a preferred embodiment, the C, M, and Y
primaries are placed at inverted hue angles (e.g., 180 degrees) compared to the R, G, and B
primaries, respectively.
[00326] In one embodiment, the gamut is the ITU-R BT.709-6 gamut. In another embodiment, the gamut is the SMPTE RP431-2 gamut.
[00327] The unstack process includes output as six, 11-bit color channels that are separated and delivered to a decoder. To convert an image from a six-primary color system to an RGB image, at least two matrices are used. One matrix is a 3x3 matrix converting a six-primary color system image to XYZ values. A second matrix is a 3x3 matrix for converting from XYZ to the proper RGB color space. In one embodiment, XYZ values represent additive color space values, where XYZ matrices represent additive color space matrices.
Additive color space refers to the concept of describing a color by stating the amounts of primaries that, when combined, create light of that color.
[00328] When a six-primary display is connected to the six-primary output, each channel will drive each color. When this same output is sent to an RGB display, the CYM channels are ignored and only the RGB channels are displayed. An element of operation is that both systems drive from the black area. At this point in the decoder, all are coded as bit 0 being black and bit 2047 being peak color luminance. This process can also be reversed in a situation where an RGB source can feed a six-primary display. The six-primary display would then have no information for the CYM channels and would display the input in a standard RGB gamut. FIG. 51 illustrates one embodiment of six-primary color output using a non-constant luminance decoder. FIG. 52 illustrates one embodiment of a legacy RGB
process within a six-primary color system.
[00329] The design of this matrix is a modification of the CIE process to convert RGB to XYZ. First, u 'v' values are converted back to CIE 1931 xyz values using the following formulas:
9uf 4v, x= Y
(6uf -16vf +12) (6uf -16vf +12) [00330] Next, RGBCYM values are mapped to a matrix. The mapping is dependent upon the gamut standard being used. In one embodiment, the gamut is ITU-R BT.709-6.
The mapping for RGBCYM values for an ITU-R BT.709-6 (6P-B) gamut are:
1 [7 x Y z I (R 0.640 0.330 0.030 1 R G B C Y Al \I
II G i I I 0.300 0.600 0.100 x 0.640 0.300 0.150 0.439 0.165 0.319 1 B 0.150 0.060 0.790 I
I I 0.439 0540 0021 I
0.330 0.600 0.060 0.540 0.327 0.126 0..327 0.509 i 1 C . V
z 0.030 0.100 0.790 0.021 0.509 0.554/ I
I-1 Y 0.165 M 0.320 0.126 0.554) i ( 0.519 0.393 0.140 = 0.393 0.460 0.160 0.140 0.160 0.650 [00331] In one embodiment, the gamut is SMPTE RP431-2. The mapping for RGBCYM
values for a SMPTE RP431-2 (6P-C) gamut are:
[7 x Y 1 l(R 0.680 0.320 0.(z)00 1 R G B C Y M \ I
I I G 0.264 0.691 0.045 I i x 0.680 0.264 0.150 0.450 0.163 0.352 1 B 0.150 0.060 0.790 I
0.320 0.690 0.060 0.547 0.342 0.142 i 1 I I C 0.450 0.547 0.026 I V
z 0.000 0.045 0.790 0.026 0.496 0.505/ I
il Y 0.163 0.342 0.496) I- M 0.352 0.142 0.505 i ( 0.565 0.400 0.121 = 0.400 0.549 0.117 0.121 0.117 0.650 [00332] Following mapping the RGBCYM values to a matrix, a white point conversion Occurs:
x X=- Y=1 Z=1-x-y Y
[00333] For a six-primary color system using an ITU-R BT.709-6 (6P-B) color gamut, the white point is D65:
0.9504 = 0.3127 0.3584 = 1 - 0.3127 - 0.3290 0.3290 [00334] For a six-primary color system using a SMPTE RP431-2 (6P-C) color gamut, the white point is D60:
0.9541 = .3218 0.3410= 1 - 0.3218 - 0.3372 0.3372 [00335] Following the white point conversion, a calculation is required for RGB saturation values, SR, SG, and SB. The results from the second operation are inverted and multiplied with the white point XYZ values. In one embodiment, the color gamut used is an ITU-R BT.709-6 color gamut. The values calculate as:
SR
ITU-RBT.709-6 [
5.445 -4.644 -0.0253) (0.950)1 SG
SB =[( -4.644 6.337 -0.563 1 -0.0253 -0.563 1.682 0.358 Where riu-R BT.709-6 [
0.522 SG = 1.722 SB 0.015 [00336] In one embodiment, the color gamut is a SMPTE RP431-2 color gamut. The values calculate as:
[
3.692 -2.649 -0.211) (0.951 = [( -2.649 3.795 -0.189 -0.211 -0.189 1.611 0.341)]
Where riSMPTE RP431-2 [
0.802 SG = 1.203 SB 0.159 [00337] Next, a six-primary color-to-XYZ matrix must be calculated. For an embodiment where the color gamut is an ITU-R BT.709-6 color gamut, the calculation is as follows:
ryi _ [(00..359 193 00..439 60 60 3 00j1140)ITU-R BT.709- .
6 (0 522 1.722 0153\D65 0.522 1.722 0.153 [Z] I_0.140 0.160 0.650) 0.522 1.722 0.153 Wherein the resulting matrix is multiplied by the SRSoSn matrix:
ITU-R BT.709-6 [Xyl _ [00..22 7051 00..679727 00..0000231 1 B 1 [Z] [0.073 0.276 0.010] I y I
[m]
[00338] For an embodiment where the color gamut is a SMPTE RP431-2 color gamut, the calculation is as follows:
-2 .-,-, D60 ryi,[(00..456051 00..454091 02 0..11171 0..88002 0 2 11..2203 01b 3 0..15 Z 0.121 0.117 0.650 0.802 1.203 0.159 Wherein the resulting matrix is multiplied by the SRSoSn matrix:
[Xyl _ [00..4325 31 00..468620 00..0011991 1B 1 [Z] [0.097 0.141 0.103] I y I
[m]
[00339] Finally, the XYZ matrix must converted to the correct standard color space. In an embodiment where the color gamut used is an ITU-R BT709.6 color gamut, the matrices are as follows:
rB IITU-R BT709.6 3.241 ¨1.537 ¨0.4991 ri G = ¨0.969 1.876 0.042 Y
0.056 ¨0.204 1.057 Z
[00340] In an embodiment where the color gamut used is a SMPTE RP431-2 color gamut, the matrices are as follows:
[ R SMPTE RP431-2 2.73 ¨1.018 ¨0.4401 ri G = ¨0.795 1.690 0.023 Y
B 0.041 ¨0.088 1.101 Z
[00341] PACKING A SIX-PRIMARY COLOR SYSTEM INTO ICTCp [00342] ICTCp (ITP) is a color representation format specified in the Rec. ITU-R BT.2100 standard that is used as a part of the color image pipeline in video and digital photography systems for high dynamic range (HDR) and wide color gamut (WCG) imagery. The I
(intensity) component is a luma component that represents the brightness of the video. CT and Cp are blue-yellow ("tritanopia") and red-green ("protanopia") chroma components. The format is derived from an associated RGB color space by a coordination transformation that includes two matrix transformations and an intermediate non-linear transfer function, known as a gamma pre-correction. The transformation produces three signals: I, CT, and Cp. The ITP
transformation can be used with RGB signals derived from either the perceptual quantizer (PQ) or hybrid log-gamma (HLG) nonlinearity functions. The PQ curve is described in ITU-R BT2100-2:2018, Table 4, which is incorporated herein by reference in its entirety.
[00343] FIG. 53 illustrates one embodiment of packing six-primary color system image data into an ICTCp (ITP) format. In one embodiment, RGB image data is converted to an XYZ matrix. The XYZ matrix is then converted to an LMS matrix. The LMS matrix is then sent to an optical electronic transfer function (OETF). The conversion process is represented below:
[LI [(an a12 a13) ( 0.359 0.696 -0.036)1 ri M = a21 a22 a23 -0.192 1.100 0.075 G
S a31 a32 a33 0.007 0.075 0.843 B
Output from the OETF is converted to ITP format. The resulting matrix is:
(0.5 0.5 0 1.614 -3.323 1.710 4.378 -4.246 -0.135) [00344] FIG. 54 illustrates one embodiment of a six-primary color system converting RGBCYM image data into XYZ image data for an ITP format (e.g., 6P-B, 6P-C).
For a six-primary color system, this is modified by replacing the RGB to XYZ matrix with a process to convert RGBCYM to XYZ. This is the same method as described in the legacy RGB
process.
The new matrix is as follows for an ITU-R BT.709-6 (6P-B) color gamut:
ITU-R BT.709-6 [L I (0.271 0.677 0.002) ( 0.359 0.696 -0.036) I G I
B
M = 0.205 0.792 0.003 -0.192 1.100 0.075 lc S 0.073 0.277 0.100 0.007 0.075 0.843 I y [M-1 [00345] RGBCYM data, based on an ITU-R BT.709-6 color gamut, is converted to an XYZ matrix. The resulting XYZ matrix is converted to an LMS matrix, which is sent to an OETF. Once processed by the OETF, the LMS matrix is converted to an ITP
matrix. The resulting ITP matrix is as follows:
(0.5 0.5 0 1.614 -3.323 1.710 4.378 -4.246 -0.135) [00346] In another embodiment, the LMS matrix is sent to an Optical Optical Transfer Function (00TF). In yet another embodiment, the LMS matrix is sent to a Transfer Function other than 00TF or OETF.
[00347] In another embodiment, the RGBCYM data is based on the SMPTE ST431-2 (6P-C) color gamut. The matrices for an embodiment using the SMPTE ST431-2 color gamut are as follows:
[R1 [L I (0.453 0.481 0.019 0.359 0.696 ¨0.036 I G
B
M = 0.321 0.660 0.019 ¨0.192 1.100 0.075 lc 0.097 0.141 0.103 0.007 0.075 0.843 I y [M-1 The resulting ITP matrix is:
(0.5 0.5 0 1.614 ¨3.323 1.710 4.378 ¨4.246 ¨0.135) [00348] The decode process uses the standard ITP decode process, as the SRSGSB
cannot be easily inverted. This makes it difficult to recover the six RGBCYM
components from the ITP encode. Therefore, the display is operable to use the standard ICtCp decode process as described in the standards and is limited to just RGB output.
[00349] CONVERTING TO A FIVE-COLOR MULTI-PRIMARY DISPLAY
[00350] In one embodiment, the system is operable to convert image data incorporating five primary colors. In one embodiment, the five primary colors include Red (R), Green (G), Blue (G), Cyan (C), and Yellow (Y), collectively referred to as RGBCY. In another embodiment, the five primary colors include Red (R), Green (G), Blue (B), Cyan (C), and Magenta (M), collectively referred to as RGBCM. In one embodiment, the five primary colors do not include Magenta (M).
[00351] In one embodiment, the five primary colors include Red (R), Green (G), Blue (B), Cyan (C), and Orange (0), collectively referred to as RGBCO. RGBCO primaries provide optimal spectral characteristics, transmittance characteristics, and makes use of a D65 white point. See, e.g., Moon-Cheol Kim et al., Wide Color Gamut Five Channel Multi-Primary for HDTV Application, Journal of Imaging Sci. & Tech. Vol. 49, No. 6, Nov./Dec.
2005, at 594-604, which is hereby incorporated by reference in its entirety.
[00352] In one embodiment, a five-primary color model is expressed as F = M.
C, where F
is equal to a tristimulus color vector, F = (X, Y, Z)T, and C is equal to a linear display control vector, C = (Cl, C2, C3, C4, C5)T. Thus, a conversion matrix for the five-primary color model is represented as M = ( Y1 Y2 Y3 Y4 Y5 Z2 Z3 Z4 Zs [00353] Using the above equation and matrix, a gamut volume is calculated for a set of given control vectors on the gamut boundary. The control vectors are converted into CIELAB
uniform color space. However, because matrix M is non-square, the matrix inversion requires splitting the color gamut into a specified number of pyramids, with the base of each pyramid representing an outer surface and where the control vectors are calculated using linear equation for each given XYZ triplet present within each pyramid. By separating regions into pyramids, the conversion process is normalized. In one embodiment, a decision tree is created in order to determine which set of primaries are best to define a specified color. In one embodiment, a specified color is defined by multiple sets of primaries. In order to locate each pyramid, 2D chromaticity look-up tables are used, with corresponding pyramid numbers for input chromaticity values in xy or u'v' . Typical methods using pyramids require 1000 x 1000 address ranges in order to properly search the boundaries of adjacent pyramids with look-up table memory. The system of the present invention uses a combination of parallel processing for adjacent pyramids and at least one algorithm for verifying solutions by checking constraint conditions. In one embodiment, the system uses a parallel computing algorithm. In one embodiment, the system uses a sequential algorithm. In another embodiment, the system uses a brightening image transformation algorithm. In another embodiment, the system uses a darkening image transformation algorithm. In another embodiment, the system uses an inverse sinusoidal contrast transformation algorithm. In another embodiment, the system uses a hyperbolic tangent contrast transformation algorithm. In yet another embodiment, the system uses a sine contrast transformation execution times algorithm. In yet another embodiment, the system uses a linear feature extraction algorithm. In yet another embodiment, the system uses a JPEG2000 encoding algorithm. In yet another embodiment, the system uses a parallelized arithmetic algorithm. In yet another embodiment, the system uses an algorithm other than those previously mentioned. In yet another embodiment, the system uses any combination of the aforementioned algorithms.
[00354] MAPPING A SIX-PRIMARY COLOR SYSTEM INTO STANDARDIZED
TRANSPORT FORMATS
[00355] Each encode and/or decode system fits into existing video serial data streams that have already been established and standardized. This is key to industry acceptance. Encoder and/or decoder designs require little or no modification for a six-primary color system to map to these standard serial formats.
[00356] FIG. 55 illustrates one embodiment of a six-primary color system mapping to a SMPTE 5T424 standard serial format. The SMPTE 5T424/5T425 set of standards allow very high sampling systems to be passed through a single cable. This is done by using alternating data streams, each containing different components of the image. For use with a six-primary color system transport, image formats are limited to RGB due to the absence of a method to send a full bandwidth Y signal.
[00357] The process for mapping a six-primary color system to a SMPTE 5T425 format is the same as mapping to a SMPTE 5T424 format. To fit a six-primary color system into a SMPTE 5T425/424 stream involves the following substitutions: G;NT M;NT is placed in the Green data segments, RfiNT CINT is placed in the Red data segments, and B;NT YINT is placed into the Blue data segments. FIG. 56 illustrates one embodiment of an readout.
[00358] System 2 requires twice the data rate as System 1, so it is not compatible with SMPTE 424. However, it maps easily into SMPTE 5T2082 using a similar mapping sequence. In one example, System 2 is used to have the same data speed defined for 8K
imaging to show a 4K image.
[00359] In one embodiment, sub-image and data stream mapping occur as shown in SMPTE 5T2082. An image is broken into four sub-images, and each sub-image is broken up into two data streams (e.g., sub-image 1 is broken up into data stream 1 and data stream 2).
The data streams are put through a multiplexer and then sent to the interface as shown in FIG.
57.
[00360] FIG. 58 and FIG. 59 illustrate serial digital interfaces for a six-primary color system using the SMPTE 5T2082 standard. In one embodiment, the six-primary color system data is RGBCYM data, which is mapped to the SMPTE 5T2082 standard (FIG. 58).
Data streams 1, 3, 5, and 7 follow the pattern shown for data stream 1. Data streams 2, 4, 6, and 8 follow the pattern shown for data stream 2. In one embodiment, the six-primary color system data is YRGB YCYM CR CB CC CY data, which is mapped to the SMPTE 5T2082 standard (FIG.
59). Data streams 1, 3, 5, and 7 follow the pattern shown for data stream 1.
Data streams 2, 4, 6, and 8 follow the pattern shown for data stream 2.
[00361] In one embodiment, the standard serial format is SMPTE 5T292. SMPTE
is an older standard than 5T424 and is a single wire format for 1.5GB video, whereas 5T424 is designed for up to 3GB video. However, while 5T292 can identify the payload ID of SMPTE 5T352, it is constrained to only accepting an image identified by a hex value, Oh. All other values are ignored. Due to the bandwidth and identifications limitations in 5T292, a component video six-primary color system incorporates a full bit level luminance component.
To fit a six-primary color system into a SMPTE ST292 stream involves the following substitutions: G6_INT is placed in the Y data segments, Ec' b_INTINT is placed in the Cb data segments, and E!-ur¨INT EL¨INT is placed in the Cr data segments. In another embodiment, the standard serial format is SMPTE ST352.
[00362] SMPTE ST292 and ST424 Serial Digital Interface (SDI) formats include payload identification (ID) metadata to help the receiving device identify the proper image parameters. The tables for this need modification by adding at least one flag identifying that the image source is a six-primary color RGB image. Therefore, six-primary color system format additions need to be added. In one embodiment, the standard is the standard.
[00363] FIG. 60 illustrates one embodiment of an SMPTE 5T292 6P mapping. FIG.
illustrates one embodiment of an SMPTE 5T292 6P readout.
[00364] FIG. 62 illustrates modifications to the SMPTE 5T352 standards for a six-primary color system. Hex code "Bh" identifies a constant luminance source and flag "Fh" indicates the presence of a six-primary color system. In one embodiment, Fh is used in combination with at least one other identifier located in byte 3. In another embodiment, the Fh flag is set to 0 if the image data is formatted as System 1 and the Fh flag is set to 1 if the image data is formatted as System 2.
[00365] In another embodiment, the standard serial format is SMPTE 5T2082.
Where a six-primary color system requires more data, it may not always be compatible with SMPTE
5T424. However, it maps easily into SMPTE 5T2082 using the same mapping sequence.
This usage would have the same data speed defined for 8K imaging in order to display a 4K
image.
[00366] In another embodiment, the standard serial format is SMPTE 5T2022.
Mapping to 5T2022 is similar to mapping to 5T292 and 5T242, but as an ETHERNET format.
The output of the stacker is mapped to the media payload based on Real-time Transport Protocol (RTP) 3550, established by the Internet Engineering Task Force (IETF). RTP
provides end-to-end network transport functions suitable for applications transmitting real-time data, including, but not limited to, audio, video, and/or simulation data, over multicast or unicast network services. The data transport is augmented by a control protocol (RTCP) to allow monitoring of the data delivery in a manner scalable to large multicast networks, and to provide control and identification functionality. There are no changes needed in the formatting or mapping of the bit packing described in SMPTE ST 2022-6: 2012 (HBRMT).
[00367] FIG. 63 illustrates one embodiment of a modification for a six-primary color system using the SMPTE 5T2202 standard. For SMPTE 5T2202-6:2012 (HBRMT), there are no changes needed in formatting or mapping of the bit packing. 5T2022 relies on header information to correctly configure the media payload. Parameters for this are established within the payload header using the video source format fields including, but not limited to, MAP, FRAME, FRATE, and/or SAMPLE. MAP, FRAME, and FRATE remain as described in the standard. MAP is used to identify if the input is 5T292 or 5T425 (RGB
or Y Cb Cr).
SAMPLE is operable for modification to identify that the image is formatted as a six-primary color system image. In one embodiment, the image data is sent using flag "Oh"
(unknown/unspecified).
[00368] In another embodiment, the standard is SMPTE 5T2110. SMPTE ST2110 is a relatively new standard and defines moving video through an Internet system.
The standard is based on development from the IETF and is described under RFC3550. Image data is described through "pgroup" construction. Each pgroup consists of an integer number of octets. In one embodiment, a sample definition is RGB or YCbCr and is described in metadata. In one embodiment, the metadata format uses a Session Description Protocol (SDP) format. Thus, pgroup construction is defined for 4:4:4, 4:2:2, and 4:2:0 sampling as 8-bit, 10-bit, 12-bit, and in some cases 16-bit and 16-bit floating point wording. In one embodiment, six-primary color image data is limited to a 10-bit depth. In another embodiment, six-primary color image data is limited to a 12-bit depth. Where more than one sample is used, it is described as a set. For example, 4:4:4 sampling for blue, as a non-linear RGB set, is described as CO'B, C l'B, C2'B, C3'B, and C4'B. The lowest number index being left most within the image. In another embodiment, the method of substitution is the same method used to map six-primary color content into the ST2110 standard.
[00369] In another embodiment, the standard is SMPTE ST2110. SMPTE ST2110-20 describes the construction for each pgroup. In one embodiment, six-primary color system content arrives for mapping as non-linear data for the SMPTE ST2110 standard.
In another embodiment, six-primary color system content arrives for mapping as linear data for the SMPTE ST2110 standard.
[00370] FIG. 64 illustrates a table of 4:4:4 sampling for a six-primary color system for a 10-bit video system. For 4:4:4 10-bit video, 15 octets are used and cover 4 pixels.
[00371] FIG. 65 illustrates a table of 4:4:4 sampling for a six-primary color system for a 12-bit video system. For 4:4:4 12-bit video, 9 octets are used and cover 2 pixels before restarting the sequence.
[00372] Non-linear GRBMYC image data would arrive as: G;NT __,NT, R;NT C;NT, and B;NT YlfNT= Component substitution would follow what has been described for SMPTE
ST424, where G;NT M;NT is placed in the Green data segments, R;NT C;NT is placed in the Red data segments, and B;NT YINT is placed in the Blue data segments. The sequence described in the standard is shown as RO', GO', BO', R1', G1', B1', etc.
[00373] FIG. 66 illustrates sequence substitutions for 10-bit and 12-bit video in 4:2:2 sampling systems in a Y Cb Cr Cc Cy color space. Components are delivered to a 4:2:2 pgroup including, but not limited to, G6_1NT, Ecf b_INT Ecf y_INT, and Ecfr_iNT + Ecfc-iNT=
For 4:2:2 10-bit video, 5 octets are used and cover 2 pixels before restarting the sequence. For 4:2:2 12-bit video, 6 octets are used and cover 2 pixels before restarting the sequence.
Component substitution follows what has been described for SMPTE ST292, where G6_1NT
is placed in the Y data segments, Ecf b_INT Ecf y_INT is placed in the Cb data segments, and ECf r-INT EL-INT is placed in the Cr data segments. The sequence described in the standard is shown as Cb0', YO', Cr0', Y1', Crl', Y3', Cb2', Y4', Cr2', Y5', etc. In another embodiment, the video data is represented at a bit level other than 10-bit or 12-bit. In another embodiment, the sampling system is a sampling system other than 4:2:2. In another embodiment, the standard is STMPE ST2110.
[00374] FIG. 67 illustrates sample placements of six-primary system components for a 4:2:2 sampling system image. This follows the substitutions illustrated in FIG. 66, using a 4:2:2 sampling system.
[00375] FIG. 68 illustrates sequence substitutions for 10-bit and 12-bit video in 4:2:0 sampling systems using a Y Cb Cr Cc Cy color space. Components are delivered to a pgroup including, but not limited to, G6_1NT, Ecf b_INT and EL_INT. For 4:2:0 10-bit video data, 15 octets are used and cover 8 pixels before restarting the sequence. For 4:2:0 12-bit video data, 9 octets are used and cover 4 pixels before restarting the sequence.
Component substitution follows what is described in SMPTE ST292 where Eyf 6_1NT is placed in the Y data segments, Ecf b-INT EcfINT is placed in the Cb data segments, and Ecf r-INT
EL-INT is placed in the Cr data segments. The sequence described in the standard is shown as Y'00, Y'01, Y', etc.
[00376] FIG. 69 illustrates sample placements of six-primary system components for a 4:2:0 sampling system image. This follows the substitutions illustrated in FIG. 68, using a 4:2:0 sampling system.
[00377] FIG. 70 illustrates modifications to SMPTE ST2110-20 for a 10-bit six-primary color system in 4:4:4 video. SMPTE ST2110-20 describes the construction of each "pgroup".
Normally, six-primary color system data and/or content would arrive for mapping as non-linear. However, with the present system there is no restriction on mapping data and/or content. For 4:4:4, 10-bit video, 15 octets are used and cover 4 pixels before restarting the sequence. Non-linear, six-primary color system image data would arrive as G;NT, B;NT, R;NT, KNIT, YINT, and C;NT. The sequence described in the standard is shown as RO', GO', BO', R1', G1', B1', etc.
[00378] FIG. 71 illustrates modifications to SMPTE ST2110-20 for a 12-bit six-primary color system in 4:4:4 video. For 4:4:4, 12-bit video, 9 octets are used and cover 2 pixels before restarting the sequence. Non-linear, six-primary color system image data would arrive as G;NT, -114:INT,ITINT, and C.INT= The sequence described in the standard is shown as RO', GO', BO', R1', G1', B1', etc.
[00379] FIG. 72 illustrates modifications to SMPTE ST2110-20 for a 10-bit six primary color system in 4:2:2 video. Components that are delivered to a SMPTE ST2110 pgroup include, but are not limited to, Eyf rgb-INT, Gcym-INT, ECf b-INT, ECf r-INT, ECf y-INT, and Ecfc-iNT= For 4:2:2, 10-bit video, 5 octets are used and cover 2 pixels before restarting the sequence. For 4:2:2:2, 12-bit video, 6 octets are used and cover 2 pixels before restarting the sequence. Component substitution follows what is described for SMPTE ST292, where EYf rgb-INT or EYf cym-INT are placed in the Y data segments, Ecfr_iNT or E
-cf c-INT are placed in the Cr data segments, and Ecf b-INT or EcfINT are placed in the Cb data segments. The sequence described in the standard is shown as Cb'0, Y'0, Cr'0, Y'l, Cb'l, Y'2, Cr'1, Y'3, Cb'2, Y'4, Cr'2, etc.
[00380] FIG. 73 illustrates modifications to SMPTE ST2110-20 for a 12-bit six-primary color system in 4:2:0 video. Components that are delivered to a SMPTE ST2110 pgroup are the same as with the 4:2:2 method. For 4:2:0, 10-bit video, 15 octets are used and cover 8 pixels before restarting the sequence. For 4:2:0, 12-bit video, 9 octets are used and cover 4 pixels before restarting the sequence. Component substitution follows what is described for SMPTE ST292, where E,f7 rgb-INT or E3Tcym-I NT are placed in the Y data segments, ur -INT or EL-INT are placed in the Cr data segments, and 4b-INT or 43,_INT are placed in the Cb data segments. The sequence described in the standard is shown as Y'00, Y'01, Y', etc.
[00381] Table 24 summarizes mapping to SMPTE ST2110 for 4:2:2:2:2 and 4:2:0:2:0 sampling for System 1 and Table 25 summaries mapping to SMPTE 5T2110 for 4:4:4:4:4:4 sampling (linear and non-linear) for System 1.
[00382] TABLE 24 Sampling Bit Depth Pgroup Y PbPr Sample Order 6P Sample Order Octets Pixels 4:2:2:2:2 8 4 2 CB', YO Y/ ' 5 2 CB', YO Y/ ' CB' Cy', YO ^ Y/ ' 12 6 2 CB', YO Y/ ' CB' Cy', YO ^ Y/ ' 16,16f 8 2 C 'B, Y '0, C 'R, CB' Cy', YO ^ Y/ ' 4:2:0:2:0 8 6 4 Y'00,Y'01,Y'10,Y'll, CB'00, CR'100 10 15 8 Y'00,Y'01,Y'10,Y'll, Y'00,Y'01,Y10,Y11,CB'00 Cy'00, CB'00, CR'100 CR'00 Cc'00 Y'02,Y'03,Y'12,Y'13, Y'02,Y'03,Y'12,Y'13,CB'01 Cy01, CB'01, CR'101 CR'01 C'c'01 12 9 4 Y'00,Y'01,Y'10,Y'll, Y'00,Y'01,Y10,Y11,CB'00 Cy00, CB'00, CR'100 CR'00 Cc'00 [00383] TABLE 25 Sampling Bit pgroup RGB Sample Order 6P Sample Order Depth Octets pixels 4:4:4:4:4:4 8 3 1 R,G,B
Linear 10 15 4 RO, GO, BO, R1, Gl, Bl, R+CO, G+MO, B+YO, R2, G2,B2 R+Cl, G+Ml, B+Yl, R+C2, G+M2, B+Y2 12 9 2 RO, GO, BO, R1, Gl, B1 R+CO, G+MO, B+YO, R+Cl, G+Ml, B+Y1 16,16f 6 1 R, G, B R+C, G+M, B+Y
4:4:4:4:4:4 8 3 1 R', G', B' Non- 10 15 4 RO', GO', BO', R1', G1', R' C'0, G'+M'O, Linear B1', R2', G2',B2' B '+Y'0, R'+C '1, G'+M'1, B' Y'l, R'+C '2, G'+M'2, B'+Y'2 12 9 2 RO', GO', BO', R1', G1', R' C'0, G'+M'O, Bl' B '+Y'0, R'+C'1, G'+M'1, B '+Y'l 16,16f 6 1 R', G', B' R'+C', G'+M', B'+Y' [00384] Table 26 summarizes mapping to SMPTE ST2110 for 4:2:2:2:2 sampling for System 2 and Table 27 summaries mapping to SMPTE ST2110 for 4:4:4:4:4:4 sampling (linear and non-linear) for System 2.
[00385] TABLE 26 Sampling Bit pgroup Y PbPr Sample 6P Sample Order Depth octets pixels Order 4:2:2:2:2 8 8 2 CB',Y0',CR',Y1' CB', Cy', YRGB0',CR', CC', YCMY0' CB', Cy', YRGB1 10 2 CB',Y0',CR',Y1' CB', Cy, YRGB0',CR', CC', YCMY0' CB', Cr', YRGB1 12 12 2 CB',Y0',CR',Y1' CB', Cy', YRGB0',CR', CC', YCMY0' CB', Cr', YRGB1 16, 16f 16 2 C 'B, Y '0, C 'B, /71 CB', Cy', YRGB0',CR', CC', YCMY0' CB', Cr', YRGB1 [00386] TABLE 27 Sampling Bit pgroup RGB Sample Order 6P Sample Order Depth octets pixels 4:4:4:4:4:4 8 3 1 R,G,B R,C,G,M,B,Y
Linear 10 15 4 RO, GO, BO, R1, Gl, RO,CO,GO,MO,BO,YO,R1,C1,G1,M
Bl, R2, G2,B2 1,B 1,Y 1,R2,C2, G2,M2,B2+Y2 12 9 2 RO, GO, BO, R1, Gl, RO,CO,GO,MO,BO,Y0, B1 R1,C1,G1,M1,B1,Y1 16, 16f 6 1 R, G, B R,C,G,M,B,Y
4:4:4:4:4:4 8 3 1 R', G', B' R',C',G',M',B',Y' Non-Linear 10 15 4 RO GO', BO', R1', RO ',CO
',G0',M0',B0',Y0',R1 ',C1 ' G1', B1', R2', ,G1',M1',B1',Y1',R2',C2 G2 ',B2 ' G2 ',M2 ',B2 '+Y2 ' 12 9 2 RO', GO', BO', R1', R0',C0',G0',M0',B0',Y0', G1', B1 ' R1 ',C1 ',G1 ',M1',B1',Y1 ' 16,16f 6 1 R', G', B' R',C',G',M',B',Y' [00387] SESSION DESCRIPTION PROTOCOL (SDP) MODIFICATION FOR A SIX-PRIMARY COLOR SYSTEM
[00388] SDP is derived from IETF RFC 4566 which sets parameters including, but not limited to, bit depth and sampling parameters. In one embodiment, SDP
parameters are contained within the RTP payload. In another embodiment, SDP parameters are contained within the media format and transport protocol. This payload information is transmitted as text. Therefore, modifications for the additional sampling identifiers requires the addition of new parameters for the sampling statement. SDP parameters include, but are not limited to, color channel data, image data, framerate data, a sampling standard, a flag indicator, an active picture size code, a timestamp, a clock frequency, a frame count, a scrambling indicator, and/or a video format indicator. For non-constant luminance imaging, the additional parameters include, but are not limited to, RGBCYM-4:4:4, YBRCY-4:2:2, and YBRCY-4:2:0. For constant luminance signals, the additional parameters include, but are not limited to, CLYBRCY-4:2:2 and CLYBRCY-4:2:0.
[00389] Additionally, differentiation is included with the colorimetry identifier in one embodiment. For example, 6PB1 defines 6P with a color gamut limited to ITU-R
BT.709 formatted as System 1, 6PB2 defines 6P with a color gamut limited to ITU-R
BT.709 formatted as System 2, 6PB3 defines 6P with a color gamut limited to ITU-R
BT.709 formatted as System 3, 6PC1 defines 6P with a color gamut limited to SMPTE RP
formatted as System 1, 6PC2 defines 6P with a color gamut limited to SMPTE RP
formatted as System 2, 6PC3 defines 6P with a color gamut limited to SMPTE RP
formatted as System 3, 6PS1 defines 6P with a color gamut as Super 6P
formatted as System 1, 6P52 defines 6P with a color gamut as Super 6P formatted as System 2, and 6P53 defines 6P with a color gamut as Super 6P formatted as System 3.
[00390] Colorimetry can also be defined between a six-primary color system using the ITU-R BT.709-6 standard and the SMPTE 5T431-2 standard, or colorimetry can be left defined as is standard for the desired standard. For example, the SDP
parameters for a 1920x1080 six-primary color system using the ITU-R BT.709-6 standard with a 10-bit signal as System 1 are as follows: m = video 30000 RTP/AVP 112, a = rtpmap:112 raw/90000, a =
fmtp:112, sampling = YBRCY-4:2:2, width = 1920, height = 1080, exactframerate =
30000/1001, depth = 10, TCS = SDR, colorimetry = 6PB1, PM = 2110GPM, SSN =
20:2017.
[00391] In one embodiment, the six-primary color system is integrated with a Consumer Technology Association (CTA) 861-based system. CTA-861 establishes protocols, requirements, and recommendations for the utilization of uncompressed digital interfaces by consumer electronics devices including, but not limited to, digital televisions (DTVs), digital cable, satellite or terrestrial set-top boxes (STBs), and related peripheral devices including, but not limited to, DVD players and/or recorders, and other related Sources or Sinks.
[00392] These systems are provided as parallel systems so that video content is parsed across several line pairs. This enables each video component to have its own transition-minimized differential signaling (TMDS) path. TMDS is a technology for transmitting high-speed serial data and is used by the Digital Visual Interface (DVI) and High-Definition Multimedia Interface (HDMI) video interfaces, as well as other digital communication interfaces. TMDS is similar to low-voltage differential signaling (LVDS) in that it uses differential signaling to reduce electromagnetic interference (EMI), enabling faster signal transfers with increased accuracy. In addition, TMDS uses a twisted pair for noise reduction, rather than a coaxial cable that is conventional for carrying video signals.
Similar to LVDS, data is transmitted serially over the data link. When transmitting video data, and using HDMI, three TMDS twisted pairs are used to transfer video data.
[00393] In such a system, each pixel packet is limited to 8 bits only. For bit depths higher than 8 bits, fragmented packs are used. This arrangement is no different than is already described in the current CTA-861 standard.
[00394] Based on CTA extension Version 3, identification of a six-primary color transmission would be performed by the sink device (e.g., the monitor). Adding recognition of the additional formats would be flagged in the CTA Data Block Extended Tag Codes (byte 3). Since codes 33 and above are reserved, any two bits could be used to identify that the format is RGB, RGBCYM, Y Cb Cr, or Y Cb Cr Cc Cy and/or identify System 1 or System 2. Should byte 3 define a six-primary sampling format, and where the block 5 extension identifies byte 1 as ITU-R BT.709, then logic assigns as 6P-B. However, should byte 4 bit 7 identify colorimetry as DCI-P3, the color gamut would be assigned as 6P-C.
[00395] In one embodiment, the system alters the AVI Infoframe Data to identify content.
AVI Infoframe Data is shown in Table 10 of CTA 861-G. In one embodiment, Y2=1, Y1=0, and YO=0 identifies content as 6P 4:2:0:2:0. In another embodiment, Y2=1, Y1=0, and YO=1 identifies content as Y Cr Cb Cc Cy. In yet another embodiment, Y2=1, Y1=1, and YO=0 identifies content as RGBCMY.
[00396] Byte 2 C1=1, C0=1 identifies extended colorimetry in Table 11 of CTA
861-G.
Byte 3 EC2, EC1, ECO identifies additional colorimetry extension valid in Table 13 of CTA
861-G. Table 14 of CTA 861-G reserves additional extensions. In one embodiment, ACE3=1, ACE2=0, ACE1=0, and ACE0=X identifies 6P-B. In one embodiment, ACE3=0, ACE2=1, ACE1=0, and ACE0=X identifies 6P-C. In one embodiment, ACE3=0, ACE2=0, ACE1=1, and ACE0=X identifies System 1. In one embodiment, ACE3=1, ACE2=1, ACE1=0, and ACE0=X identifies System 2.
[00397] FIG. 74 illustrates the current RGB sampling structure for 4:4:4 sampling video data transmission. For HDMI 4:4:4 sampling, video data is sent through three TMDS line pairs. FIG. 75 illustrates a six-primary color sampling structure, RGBCYM, using System 1 for 4:4:4 sampling video data transmission. In one embodiment, the six-primary color sampling structure complies with CTA 861-G, November 2016, Consumer Technology Association, which is incorporated herein by reference in its entirety. FIG.
76 illustrates an example of System 2 to RGBCYM 4:4:4 transmission. FIG. 77 illustrates current Y Cb Cr 4:2:2 sampling transmission as non-constant luminance. FIG. 78 illustrates a six-primary color system (System 1) using Y Cr Cb Cc Cy 4:2:2 sampling transmission as non-constant luminance. FIG. 79 illustrates an example of a System 2 to Y Cr Cb Cc Cy 4:2:2 Transmission as non-constant luminance. In one embodiment, the Y Cr Cb Cc Cy 4:2:2 sampling transmission complies with CTA 861-G, November 2016, Consumer Technology Association. FIG. 80 illustrates current Y Cb Cr 4:2:0 sampling transmission.
FIG. 81 illustrates a six-primary color system (System 1) using Y Cr Cb Cc Cy 4:2:0 sampling transmission.
[00398] HDMI sampling systems include Extended Display Identification Data (EDID) metadata. EDID metadata describes the capabilities of a display device to a video source. The data format is defined by a standard published by the Video Electronics Standards Association (VESA). The EDID data structure includes, but is not limited to, manufacturer name and serial number, product type, phosphor or filter type, timings supported by the display, display size, luminance data, and/or pixel mapping data. The EDID
data structure is modifiable and modification requires no additional hardware and/or tools.
[00399] EDID information is transmitted between the source device and the display through a display data channel (DDC), which is a collection of digital communication protocols created by VESA. With EDID providing the display information and DDC
providing the link between the display and the source, the two accompanying standards enable an information exchange between the display and source.
[00400] In addition, VESA has assigned extensions for EDID. Such extensions include, but are not limited to, timing extensions (00), additional time data black (CEA EDID Timing Extension (02)), video timing block extensions (VTB-EXT (10)), EDID 2.0 extension (20), display information extension (DI-EXT (40)), localized string extension (LS-EXT (50)), microdisplay interface extension (MI-EXT (60)), display ID extension (70), display transfer characteristics data block (DTCDB (A7, AF, BF)), block map (FO), display device data block (DDDB (FF)), and/or extension defined by monitor manufacturer (FF).
[00401] In one embodiment, SDP parameters include data corresponding to a payload identification (ID) and/or EDID information.
[00402] MULTI-PRIMARY COLOR SYSTEM DISPLAY
[00403] FIG. 82 illustrates a dual stack LCD projection system for a six-primary color system. In one embodiment, the display is comprised of a dual stack of projectors. This display uses two projectors stacked on top of one another or placed side by side. Each projector is similar, with the only difference being the color filters in each unit. Refresh and pixel timings are synchronized, enabling a mechanical alignment between the two units so that each pixel overlays the same position between projector units. In one embodiment, the two projectors are Liquid-Crystal Display (LCD) projectors. In another embodiment, the two projectors are Digital Light Processing (DLP) projectors. In yet another embodiment, the two projectors are Liquid-Crystal on Silicon (LCOS) projectors. In yet another embodiment, the two projectors are Light-Emitting Diode (LED) projectors.
[00404] In one embodiment, the display is comprised of a single projector. A
single projector six-primary color system requires the addition of a second cross block assembly for the additional colors. One embodiment of a single projector (e.g., single LCD
projector) is shown in FIG. 83. A single projector six-primary color system includes a cyan dichroic mirror, an orange dichroic mirror, a blue dichroic mirror, a red dichroic mirror, and two additional standard mirrors. In one embodiment, the single projector six-primary color system includes at least six mirrors. In another embodiment, the single projector six-primary color system includes at least two cross block assembly units.
[00405] FIG. 84 illustrates a six-primary color system using a single projector and reciprocal mirrors. In one embodiment, the display is comprised of a single projector unit working in combination with at first set of at least six reciprocal mirrors, a second set of at least six reciprocal mirrors, and at least six LCD units. Light from at least one light source emits towards the first set of at least six reciprocal mirrors. The first set of at least six reciprocal mirrors reflects light towards at least one of the at least six LCD
units. The at least six LCD units include, but are not limited to, a Green LCD, a Yellow LCD, a Cyan, LCD, a Red LCD, a Magenta LCD, and/or a Blue LCD. Output from each of the at least six LCDs is received by the second set of at least six reciprocal mirrors. Output from the second set of at least six reciprocal mirrors is sent to the single projector unit. Image data output by the single projector unit is output as a six-primary color system. In another embodiment, there are more than two sets of reciprocal mirrors. In another embodiment, more than one projector is used.
[00406] In another embodiment, the display is comprised of a dual stack Digital Micromirror Device (DMD) projector system. FIG. 85 illustrates one embodiment of a dual stack DMD projector system. In this system, two projectors are stacked on top of one another.
In one embodiment, the dual stack DMD projector system uses a spinning wheel filter. In another embodiment, the dual stack DMD projector system uses phosphor technology. In one embodiment, the filter systems are illuminated by a xenon lamp. In another embodiment, the filter system uses a blue laser illuminator system. Filter systems in one projector are RGB, while the second projector uses a CYM filter set. The wheels for each projector unit are synchronized using at least one of an input video sync or a projector to projector sync, and timed so that the inverted colors are output of each projector at the same time.
[00407] In one embodiment, the projectors are phosphor wheel systems. A yellow phosphor wheel spins in time with a DMD imager to output sequential RG. The second projector is designed the same, but uses a cyan phosphor wheel. The output from this projector becomes sequential BG. Combined, the output of both projectors is YRGGCB.
Magenta is developed by synchronizing the yellow and cyan wheels to overlap the flashing DMD.
[00408] In another embodiment, the display is a single DMD projector solution.
A single DMD device is coupled with an RGB diode light source system. In one embodiment, the DMD projector uses LED diodes. In one embodiment, the DMD projector includes CYM
diodes. In another embodiment, the DMD projector creates CYM primaries using a double flashing technique. FIG. 86 illustrates one embodiment of a single DMD
projector solution.
[00409] FIG. 87 illustrates one embodiment of a six-primary color system using a white OLED display. In yet another embodiment, the display is a white OLED monitor.
Current emissive monitor and/or television designs use a white emissive OLED array covered by a color filter. Changes to this type of display only require a change to pixel indexing and new six color primary filters. Different color filter arrays are used, placing each subpixel in a position that provides the least light restrictions, color accuracy, and off axis display.
[00410] FIG. 88 illustrates one embodiment of an optical filter array for a white OLED
display.
[00411] FIG. 89 illustrates one embodiment of a matrix of an LCD drive for a six-primary color system with a backlight illuminated LCD monitor. In yet another embodiment, the display is a backlight illuminated LCD display. The design of an LCD display involves adding the CYM subpixels. Drives for these subpixels are similar to the RGB
matrix drives.
With the advent of 8K LCD televisions, it is technically feasible to change the matrix drive and optical filter and have a 4K six-primary color TV.
[00412] FIG. 90 illustrates one embodiment of an optical filter array for a six-primary color system with a backlight illuminated LCD monitor. The optical filter array includes the additional CYM subpixels.
[00413] In yet another embodiment, the display is a direct emissive assembled display.
The design for a direct emissive assembled display includes a matrix of color emitters grouped as a six-color system. Individual channel inputs drive each Quantum Dot (QD) element illuminator and/or micro LED element.
[00414] FIG. 91 illustrates an array for a Quantum Dot (QD) display device.
[00415] FIG. 92 illustrates one embodiment of an array for a six-primary color system for use with a direct emissive assembled display.
[00416] FIG. 93 illustrates one embodiment of a six-primary color system in an emissive display that does not incorporate color filtered subpixels. For LCD and WOLED
displays, this can be modified for a six-primary color system by expanding the RGB or WRGB filter arrangement to an RGBCYM matrix. For WRGB systems, the white subpixel could be removed as the luminance of the three additional primaries will replace it.
SDI video is input through an SDI decoder. In one embodiment, the SDI decoder outputs to a Y
CrCbCcCy-RGBCYM converter. The converter outputs RGBCYM data, with the luminance component (Y) subtracted. RGBCYM data is then converted to RGB data. This RGB data is sent to a scale sync generation component, receives adjustments to image controls, contrast, brightness, chroma, and saturation, is sent to a color correction component, and output to the display panel as LVDS data. In another embodiment the SDI decoder outputs to an SDI Y-R
switch component. The SDI Y-R switch component outputs RGBCYM data. The RGBCYM
data is sent to a scale sync generation component, receives adjustments to image controls, contrast, brightness, chroma, and saturation, is sent to a color correction component, and output to a display panel as LVDS data.
[00417] PRIMARY TRIADS
[00418] A conversion between XYZ and any three primary system (e.g., RGB) yields an exact solution. However, in systems with more than three primaries, there is not an exact solution. For example, a six primary system with an RGBCMY to XYZ is overdetermined.
This requires a mathematical pseudo-inverse (e.g., Moore-Penrose pseudo-inverse), which provides one of an infinite number of solutions. An algorithm is required to go from XYZ to RGBCMY.
[00419] In one embodiment, the system uses at least one triad in the algorithm. Each of the at least one triad is formed using three points (e.g., primaries). Although a larger number of permutations is possible for the three points, the order of the three points is not important (e.g., ABC functions the same as BCA). Therefore, for each set of primaries, a number of possible triads is calculated using the following equation:
n!
C (n, r) = n Cr = ___________________________ (n ¨ r)! r!
where n = the number of primaries and r = 3. Thus, for three primaries, there is one possible triad; for four primaries, there are 4 possible triads; for five primaries, there are 10 possible triads; for six primaries, there are 20 possible triads; for seven primaries, there are 35 possible triads; for eight primaries, there are 56 possible triads; for nine primaries, there are 84 possible triads; for ten primaries, there are 120 possible triads; for eleven primaries, there are 165 possible triads; and for twelve primaries, there are 220 possible triads.
[00420] In one embodiment, the system uses at least five primary triads. In one embodiment, the at least five primary triads are formed using at least six primaries (e.g., Pi-P6). In one embodiment, the first triad is formed using Pi, P2, and P3; the second triad is formed using P4, P5, and P6; the third triad is formed using Pi, P3, and P5;
the fourth triad is formed using P2, P3, and P4; and the fifth triad is formed using Pi, P2, and P6. For example, in a six primary system using RGBCMY, the first triad is formed using RGB, the second triad is formed using CMY, the third triad is formed using RMB, the fourth triad is formed using CGB, and the fifth triad is formed using RGY. Alternate numbers of primaries, numbers of triads, and alternate triads are compatible with the present invention.
[00421] In a preferred embodiment, a color value (e.g., ACES APO) is converted to a colorimetric position (e.g., XYZ), and corresponding values for the at least five primary triads are calculated. In one embodiment, the conversion process first converts an RGB value in ACES APO to XYZ with a D65 white point. Alternative white points are compatible with the present invention. To convert the RGB value in ACES APO to XYZ for a 6P-C
system using a D65 white point, the following equation is used:
0.938653 [ ¨0.005740 0.017517 I [R
0.338102 0.727227 ¨0.065328 G
[Z D65 0.000721 0.000816 1.087264 B AcEsD65 [00422] In one embodiment, a color value in ACES APO is converted to XYZ with a D65 white point. In one embodiment, the conversion from ACES APO to XYZ with a D65 white point is performed using the following equation:
0.950348 0.000000 0.000101 I [/'? XY1 = [0.343170 0.734689 -0.077859 G
L D65 0.000000 0.000000 1.088917 B ACES APO
Apo [00423] In one embodiment, a color value in ACES APO is converted to XYZ with a D60 white point. In one embodiment, the conversion from ACES APO to XYZ with a D60 white point is performed using the following equation:
[X 0.952552 0.000000 0.000094 I [/'?
YI = [0.343966 0.728166 -0.072133 G
L D60 0.000000 0.000000 1.008825 B ACES APO
Apo [00424] In one embodiment, a color value in ACES APO with a D60 white point is converted to ACES APO with a D65 white point. In one embodiment, the conversion from ACES APO with a D60 white point to ACES APO with a D65 white point is performed using a Bradford chromatic adaptation. In one embodiment, the conversion from ACES
APO with a D60 white point to ACES APO with a D65 white point is performed using the following equation:
[R 0.986779 -0.005817 0.003823 I [R
G = 0.001868 0.996064 -0.000986 G
LB AcEsApo-D65 0.015613 0.003559 1.001637 B ACESApo-D60 [00425] In one embodiment, a color value in XYZ with a D60 white point is converted to XYZ with a D65 white point. In one embodiment, the conversion from XYZ with a white point to XYZ with a D65 white point is performed using a Bradford chromatic adaptation. In one embodiment, the conversion from XYZ with a D60 white point to XYZ
with a D65 white point is performed using the following equation:
[X 0.987239 -0.007592 0.003067 I
YI = [-0.006107 1.001864 -0.005086 Y
L D65 0.015927 0.005321 1.081537 Z D60 [00426] In one embodiment, a color value in ACES APO is converted to XYZ with a D65 white point using a Bradford chromatic adaptation. In one embodiment, the conversion from ACES APO to XYZ with a D65 white point is performed using the following equation:
0.937785 ¨0.005528 0.003734 I [R XY1 =[0.338790 0.729523 ¨0.077399 G
L D65 0.017001 0.003875 1.090699 B
AcE,Apo [00427] In one embodiment, the system uses equations found in RP 177 to generate a normalized set of values for color conversion matrices. "RP 177:1993 - SMPTE
Recommended Practice - Derivation of Basic Television Color Equations," in RP
177:1993, vol., no., pp.1-4, 1 Nov. 1993, doi: 10.5594/SMPTE.RP177.1993, is incorporated herein by reference in its entirety. In one embodiment, the calculation of the normalized set of values for the color conversion matrices uses the following equations:
xY (1 ¨ x ¨ y)Y
X= ¨ Y = 1 Z __________ [00428] An RGB-to-XYZ matrix and a CMY-to-XYZ matrix are created using a white point (e.g., D65) of the system. In each of these triads, the white point is within the triad. The RGB-to-XYZ matrix determines what ratio of each normalized primary (R, G, and B) is required to achieve the D65 white with an RGB value of [1 1 1], and then scales the matrix such that the input of [1 1 1] yields the XYZ of D65. Similarly, the CMY-to-XYZ matrix determines what ratio of each normalized primary (C, M, and Y) is required to achieve the D65 white with a CMY value of [1 1 1], and then scales the matrix such that the input of [11 11 yields the XYZ of D65. With these two matrices, additional triad-to-XYZ
matrices are created by using the columns in the RGB-to-XYZ matrix and the CMY-to-XYZ
matrix. For example, an RMB-to-XYZ matrix is created by taking the RGB-to-XYZ matrix and replacing the second column with the second column from the CMY-to-XYZ matrix. In this case, as well as all other triads, the D65 white point is not inside the triad, so in that case no combination of RMB can achieve the D65 color point.
[00429] In one embodiment, a hardware calibration is required to create the conversion matrices. For example, if a projector has 7 signals (e.g., RGBCMYVV) for a six primary system, the output is measured as real XYZ for the individual primaries at maximum and for white when all six primaries are at maximum. A projector calibration is required to adjust the intensities of the primaries to achieve a white point (e.g., D65) from a [1 1 1 1 1 1] position.
The matrices are then created as described above.
[00430] A normalized matrix is used when a multi-primary display device is calibrated such that full power of all primaries yields the intended white point (e.g., D65). If the multi-primary display device has primaries such that the result from all primaries being at full power gives a white point that is not the desired white point, then the non-normalized method is used and the calibration is done (e.g., via software, a look-up table (LUT)) to scale the primaries such that the full power values result in the desired white point.
In one embodiment, the LUT is a three-dimensional (3D) LUT.
[00431] Alternatively, the system uses a non-normalized method to generate a set of values for the color conversion matrices. For example, a set of six primaries Pi-P6 has a set of xyz primary values as shown in Table 28. Although this example shows a set of six primaries, this process is operable to be used with at least four primaries.
[00432] TABLE 28 P ixyz P ix Piy Piz P2xyz P2x P2y P2z P3xyz P3x P3y P3z P4xyz P4x P4y P4z Psxyz Psx Psy Psz P6xyz P6x P6y P6z [00433] In one embodiment, an XYZ-to-P1P2P3 matrix is created using the inverse of the result from transposing a PiXYZ matrix created from the primary values in Table 28, a P2XYZ matrix created from the primary values in Table 28, and a P3XYZ matrix created from the primary values in Table 28. The conversion from XYZ color space to P1P2P3 is shown below in the following equation:
iPix Ply Piz T Pix P2 X P3 X 1 X
P2 I p p P2 )-1 [PLY P2Y P3 ) [Y1 P3 \ P3 X P3y P3 Z Z Z P2 Z P3 Z
[00434] Similarly, in one embodiment, an XYZ-to-P4P5P6 matrix is created using the inverse of the result from transposing a P4xyz matrix created from the primary values in Table 28, a P5xyz matrix created from the primary values in Table 28, and a P6xyz matrix created from the primary values in Table 28. The conversion from XYZ color space to P4P5P6 is shown below in the following equation:
[134 P4Xx p P4yy pP4: T / P4 X Ps X P6 X 1 X
P5 I p 5 )-1 [P4Y PsY P6yI [YI
P6 \ P6 x P6y P6 Z Z P4 Z Ps Z P6 Z
[00435] This process is used to create additional matrices for alternative triads. As stated above, although this process is shown using six primaries, alternate numbers of primaries, numbers of triads, and alternate triads are compatible with the present invention.
[00436] FIG. 94 illustrates one embodiment of a primary triad system for a multi-primary system including red, green, blue, cyan, magenta, and yellow primaries. The primary triad system includes an RGB triad, a CMY triad, an RMB triad, a CGB triad, and an RGY triad.
[00437] Primary values for each color value (RGBCMY) are listed in Table 29 below.
[00438] TABLE 29 Rxyz 0.68 0.32 0 Gxyz 0.265 0.69 0.045 Bxyz 0.15 0.06 0.79 Cxyz 0.1617 0.3327 0.5056 Mxyz 0.3383 0.1372 0.5245 Yxyz 0.4470 0.5513 0.0017 [00439] In one embodiment, an XYZ-to-RGB matrix is created using the inverse of the result from transposing an Rxyz matrix created from the primary values in Table 29, a Gxyz matrix created from the primary values in Table 29, and a Bxyz matrix created from the primary values in Table 29. For example, to obtain the RGB triad, an inverse is taken of the transpose of a matrix created using the first three rows of Table 29 for 6P-C.
The conversion from D65 XYZ color space to RGB in a 6P-C system using a D65 white point is shown below in the following equation:
[
1.78421 -0.666447 -0.2881581 RGI = [-0.831579 1.76711 0.0236842 Y
L6. 613,-C 0.0473684 -0.100658 1.26447 Z D65 [00440] In one embodiment, an XYZ-to-CMY matrix is created using the inverse of the result from transposing a Cxyz matrix created from the primary values in Table 29, an Mxyz matrix created from the primary values in Table 29, and a Yxyz matrix created from the primary values in Table 29. The conversion from D65 XYZ color space to CMY in a 6P-C
system using a D65 white point is shown below in the following equation:
[C -3.06125 2.47801 1.32629 I
MI = [ 2.94733 -2.39167 0.631184 Y
I-Y 6P-C 1.11392 0.913668 -0.957473 Z D65 [00441] In one embodiment, an XYZ-to-RMB matrix is created using the inverse of the result from transposing an Rxyz matrix created from the primary values in Table 29, an Mxyz matrix created from the primary values in Table 29, and a Bxyz matrix created from the primary values in Table 29. The conversion from D65 XYZ color space to RMB in a 6P-C
system using a D65 white point is shown below in the following equation:
[
-9.56454 23.4496 0.03506591 MR1 =[ 31.435 -66.7993 -0.8953 Y
LB 613,-C -20.8704 44.3497 1.86023 Z D65 [00442] In one embodiment, an XYZ-to-CBG matrix is created using the inverse of the result from transposing a Cxyz matrix created from the primary values in Table 29, a Bxyz matrix created from the primary values in Table 29, and a Gxyz matrix created from the primary values in Table 29. The conversion from D65 XYZ color space to CBG in a 6P-C
system using a D65 white point is shown below in the following equation:
[C ¨22.6099 8.44536 3.6516 I
BI = 13.9183 -5.28179 -0.975739 Y
[G 613,-C 9.69162 -2.16357 -1.67586 Z D65 [00443] In one embodiment, an XYZ-to-RGY matrix is created using the inverse of the result from transposing an Rxyz matrix created from the primary values in Table 29, a Gxyz matrix created from the primary values in Table 29, and a Yxyz matrix created from the primary values in Table 29. The conversion from D65 XYZ color space to RGY in a 6P-C
system using a D65 white point is shown below in the following equation:
[R 2.41684 ¨2.01079 16.5996 I
GI = [0.0556266 -0.118206 23.7071 Y
6P-C -1.47247 3.12899 -39.3067 Z D65 [00444] The XYZ value is multiplied by each of the XYZ-to-triad matrices shown above (i.e., the XYZ-to-RGB matrix, the XYZ-to-CMY matrix, the XYZ-to-RMB matrix, the XYZ-to-CBG matrix, the XYZ-to-RGY matrix). The result of each multiplication is filtered for negative values. If a resulting matrix includes one or more negative values, all three values in the resulting matrix are set to zero. This results in a set of triad vectors.
The primary components of the at least five primary triads are added together on a per-component basis (e.g., {SUM (R), SUM (B), SUM (G), SUM (C), SUM (M), SUM (Y)1). In one embodiment, if any of the merged colors are present in at least two triads, the primary components are divided by a number of the at least two primary triads to create a set of final values. For example, if any of the merged colors are present in two triads (e.g., RGB and RN/TB), the values are divided by two (2) and merged back into the matrices, resulting in a set of final 6P
values. If the merged colors are only present in one triad, this represents the set of final 6P
values.
[00445] If the signal values for two triads are non-negative, the sums for each component are divided by two. In the embodiment described above (i.e., RGB, CMY, RBM, CBG, and RGY), it is not possible for more than two triads to be completely non-negative. In alternative embodiments, with a different set of at least five triads, it is possible for more than two triads to be completely non-negative. In the six primary system described above, the result is output as an RGBCMY value.
[00446] If all of the values for the at least five primary triads resulting from each multiplication are negative, the color is out-of-gamut for the at least six primaries and must be mapped to an in-gamut color. In one embodiment, signals from the triad with the least negative minimum value are used, with the negative signal values clipped to zero. These signal values are then used on a per-component basis for each out-of-gamut signal. After including all of the out-of-gamut signals, the signal values for each of the at least six primaries (e.g., RGBCMY) are clipped to one.
[00447] In one embodiment, the system includes a three-dimensional look up table that converts an out-of-gamut color value to an in-gamut color value for the at least six primary system. In one embodiment, XYZ values for the out-of-gamut color value are converted to xyY. The out-of-gamut color value is substituted to an in-gamut color value with a new xy and the original Y, thereby creating a new xyY. The new xyY is then transformed to XYZ. If any channel is greater than 1.0, the complete triad is divided by the maximum, scaling the channel to a maximum value of 1Ø
[00448] In a preferred embodiment, the system maps the out-of-gamut color to an in-gamut color by defining a vector using a white point and the out-of-gamut color and mapping the out-of-gamut color to a locus edge of the multi-primary system along the vector as shown in FIG. 95. Points inside the shape are white and represent points that do not need to be remapped. Advantageously, mapping along the straight line to the white point provides a more radially consistent and more operationally reasonable position.
Alternatively, the system maps the out-of-gamut color value to the nearest in-gamut color regardless of a location of the white point (e.g., perpendicular reference) as shown in FIG.
96. In one embodiment, the mapping is done in xyY color space. The colorimetric xy values are mapped from the out-of-gamut color to the in-gamut color. In a preferred embodiment, the Y is carried along unchanged and merged with the new remapped x,y in-gamut color.
[00449] The set of final 6P values is converted back to XYZ space with a D65 white point using a 6P-to-XYZ matrix. The conversion from 6P-to-XYZ for 6P-C is shown below in the following equation:
ryi [ZiD65 FRi 0.48657095 0.26566769 0.19821729 0.32295962 ¨0.54969800 1.177199435 I G I
I B I
= [ 0.22897456 0.69173852 0.07928691 0.67867175 ¨0.22203240 0.543360700 lc I I
0.00000000 0.04511338 1.04394437 0.98336936 ¨0.78858190 0.894270250 Im I
1-06p-c [00450] Once this conversion is complete, the XYZ values are converted to ACES
using an XYZ-to-ACES matrix. This matrix is the inverse of the ACES-to-XYZ matrix.
The conversion from XYZ-to-ACES is shown below in the following equation:
[R 1.062343 0.008404 -0.0166111r G = -0.493934 1.371087 0.090340 Y
[13 AcEsD65 0.000334 -0.001034 0.919683 Z
[00451] In one embodiment, the ISO 17321 matrix/chart values are defined using a perfect reflecting diffuser matrix (0.97784 0.97784 0.97784), an 18% grey card matrix (0.18 0.18 0.18), and the 24 patches of the ISO 17321-1 chart, as illuminated using CIE D60:
(0.11877 0.08709 0.05895), (0.40002 0.31916 0.23737), (0.18476 0.20398 0.31311), (0.10901 0.13511 0.06493), (0.26684 0.24604 0.40932), (0.32283 0.46208 0.40606), (0.38606 0.22744 0.05777), (0.13822 0.13037 0.33703), (0.30203 0.13752 0.12758),(0.0931 0.06347 0.13525), (0.34876 0.43654 0.10614), (0.48656 0.36686 0.08061), (0.08732 0.07443 0.27274), (0.15366 0.25691 0.09071), (0.21742 0.0707 0.0513), (0.5892 0.53943 0.09157), (0.30904 0.14818 0.27426), (0.14901 0.23378 0.35939), (0.86653 0.86792 0.85818), (0.57356 0.57256 0.57169), (0.35346 0.35337 0.35391), (0.20253 0.20243 0.20287), (0.09467 0.0952 0.09637), (0.03745 0.03766 0.03895).
These are the ACES RICD values for a perfect reflecting diffuser, an 18 % gray card, and the 24 patches of the ISO 17321-1 chart, as illuminated using CIE D60.
[00452] While the process shown in FIG. 97 is using the ACES RICD values for a perfect reflecting diffuser, an 18 % gray card, and the 24 patches of the ISO 17321-1 chart, as illuminated using CIE D60, it can be used to validate any conversion from ACES-to-6P-to-ACES.
[00453] It is important to note that 6P 11,1,1,1,1,11 converts to ACES-0 {2,2,2}. In one embodiment using ITU-R BT.2100 color space, it is necessary to perform a scaling operation of the linear display-referred RGB values, followed by applying an inverse Perceptual Quantizer (PQ) EOTF. The scaling is such that 6P data 11,1,1,1,1,11 maps to 10-bit PQ
{668,668,668}. In one embodiment, the scaling maps at a rate of 403 candelas per square meter (cd/m2).
[00454] In a more preferred embodiment, the system uses at least eight primary triads.
FIG. 98 illustrates one embodiment of a system with at least eight primary triads. In one embodiment, the at least eight primary triads are formed using at least six primaries. In one embodiment, a multi-primary system includes six primaries (e.g., Pi-P6) and eight primary triads. In one embodiment, the first triad is formed using Pi, P2, and P3; the second triad is formed using P4, P5, and P6; the third triad is formed using Pi, P3, and P5;
the fourth triad is formed using P2, P3, and P4; the fifth triad is formed using Pi, P2, and P6;
the sixth triad is formed using P3, P4, and P5; the seventh triad is formed using P2, P4, and P6;
and the eighth triad is formed using Pi, P5, and P6. Any point is included in a first triad of a first set of triads (e.g., P1P2P3, P1P2P5, 131133P6, or P2P3P4) and a second triad of a second set of triads (e.g., P4P5P6, P2P4P5, P1P5P6, or P3P4P6). For example, a multi-primary system includes a red primary (R), a green primary (G), a blue primary (B), a cyan primary (C), a yellow primary (Y), and a magenta primary (M). Any point is present in one of RGB, RGY, RMB, or CGB
and in one of CMY, CGY, RMY, or CMB. In one embodiment, the resulting values are added together and divided by two as shown in the equation below (e.g., for an XYZ input), wherein a point is present in only one triad in each set shown in brackets:
7R GB CGMG 1) RGBCMY = R Y /2 RMB RMY
CGB CMB
[00455] In a preferred embodiment, the third triad, the fourth triad, and the fifth triad are formed by doing one replacement in the first triad, and the sixth triad, the seventh triad, and the eighth triad are formed by doing one replacement in the second triad. In one embodiment, red replaces cyan, blue replaces yellow, green replaces magenta, cyan replaces red, yellow replaces blue, and/or magenta replaces green. For example, RGB is modified to RMB, RGY, and CGB, and CMY is modified to RMY, CGY, and CMB. In a preferred embodiment, the primary triads are selected such that none of the primary triads include both a primary and its complement (e.g., no triad contains R and C, no triad contains B and Y, no triad contains G
and M). Primary triads including both a primary and its complement are not needed for a full color description of the system. In a preferred embodiment, the primary triads are selected such that the first triad includes the white point, the second triad includes the white point, and no other triads include the white point. For example, RGB includes the white point, CMY
includes the white point, and no other triads include the white point.
[00456] Alternate numbers of primaries, alternate numbers of triads, and alternate triads are compatible with the present invention. Advantageously, this embodiment provides an easier method of calculating luminance because every color is included in two triads and a simple divide by two provides a final result while still describing the full gamut using the primary triads. Out-of-gamut colors are mapped to in-gamut colors as previously described.
[00457] The XYZ-to-RGB matrix, the XYZ-to-CMY matrix, the XYZ-to-RMB matrix, the XYZ-to-CBG matrix, and the XYZ-to-RGY matrix are calculated as previously described.
Additionally, in one embodiment, an XYZ-to-CMB matrix, an XYZ-to-RMY matrix, and an XYZ-to-CGY matrix are calculated as described below.
[00458] In one embodiment, an XYZ-to-CMB matrix is created using the inverse of the result from transposing a Cxyz matrix created from the primary values in Table 29, an Mxyz matrix created from the primary values in Table 29, and a Bxyz matrix created from the primary values in Table 29. The conversion from D65 XYZ color space to CMB in a 6P-C
system using a D65 white point is shown below in the following equation:
-1.52475 3.73828 0.005590121 MC1 =[ 4.60881 -1.02888 -0.796949 Y
LB 613,-C -2.08406 -1.7094 1.79136 Z D65 [00459] In one embodiment, an XYZ-to-RMY matrix is created using the inverse of the result from transposing an Rxyz matrix created from the primary values in Table 29, an Mxyz matrix created from the primary values in Table 29, and a Yxyz matrix created from the primary values in Table 29. The conversion from D65 XYZ color space to RMY in a 6P-C
system using a D65 white point is shown below in the following equation:
[R 2.37548 -1.92289 -1.029181 M = 0.00447267 -0.00950442 1.90618 Y
I-Y 6P-C -1.37995 2.93239 0.122998 ZI D65 [00460] In one embodiment, an XYZ-to-CGY matrix is created using the inverse of the result from transposing a Cxyz matrix created from the primary values in Table 29, a Gxyz matrix created from the primary values in Table 29, and a Yxyz matrix created from the primary values in Table 29. The conversion from D65 XYZ color space to CGY in a 6P-C
system using a D65 white point is shown below in the following equation:
[C 0.29784 -0.2478 2.04565 I
GI = [-3.50535 2.84449 -0.750686 Y
I-Y 6P-c 4.20751 -1.59669 -0.294967 Z D65 [00461] A set of matrices is defined for the at least eight triads based on the XYZ values of the at least six primaries in a multi-primary system. For each set of XYZ
values (per pixel), the values for each of the at least eight triads are derived by multiplying the XYZ value by each triad inverse matrix. Each set of triad values is checked for negative values, and any triad with a negative value is set to (0, 0, 0). Like components from each triad are summed for each pixel and a set of values in the multi-primary system are created for each pixel. The sum is divided by a number of triads with non-negative values to compensate for luminance.
For example, if a point is found in one triad, the sum is the final value; if a point is found in two triads, the sum is divided by two to provide the final value; if a point is found in three triads, the sum is divided by three to provide the final value; if a point is found in four triads, the sum is divided by four to provide the final value; etc.
[00462] As previously described, in a six primary system, there are a total of 20 possible triads. Thus, points may be included in more than two triads of the total of 20 possible triads.
However, in the embodiment of the present invention described above using eight triads (i.e., RGB, CMY, RMB, CBG, RGY, CMB, RMY, and CGY), no point is included in more than two triads. This is advantageous over a system that uses all possible triads (e.g., 20 for RGBCMY) because it requires significantly less processing for calculations.
Further, a simple divide by two is always required for calculations, which simplifies logic and reduces processing required to complete the calculations.
[00463] FIG. 99 illustrates a flow chart of an embodiment of a system with eight triads in a six-primary system (i.e., RGBCMY).
[00464] TRIADS IN FOUR PRIMARY AND FIVE PRIMARY SYSTEMS
[00465] In one embodiment, a multi-primary system includes four primaries (e.g., Pi-P4).
Any point is included in a first triad of a first set of triads including PiP4 (e.g., P1P4P2 or P1P4P3) and a second triad of a second set of triads including P2P3 (e.g., P2P3P1 or P2P3P4).
For example, a multi-primary system includes a red primary (R), a green primary (G), a blue primary (B), and a cyan primary (C). Any point is present in one of RGB or CGB
and in one of RCB or RCG. In one embodiment, the resulting values are added together and divided by two as shown in the equation below (e.g., for an XYZ input), wherein a point is present in only one triad in each set shown in brackets:
RcD
RGBC = [CB G/2 GRCGGEiBlR
[00466] In one embodiment, a multi-primary system includes five primaries (e.g., Pi-P5).
Any point is included in a first triad of a first set of triads (e.g., P1P4P3, P1P4P5, or P4P2P5) and a second triad of a second set of triads (e.g., P1P2P5, P1P2P3, or P2P3P4).
For example, a multi-primary system includes a red primary (R), a green primary (G), a blue primary (B), a cyan primary (C), and a yellow primary (Y). Any point is present in one of RCY, RCB, or CGY
and in one of RGY, RGB, or CGB. In one embodiment, the resulting values are added together and divided by two as shown in the equation below (e.g., for an XYZ
input), wherein a point is present in only one triad in each set shown in brackets:
RC] [RGY
RGBC =([RCB + RGB )/2 CGY CGB!
1004671 Advantageously, each color point resides within only two triads. As previously described, in a five primary system, there are a total of 10 possible triads.
Thus, points may be included in more than two triads of the total of 10 possible triads.
However, in the embodiment of the present invention described above using six triads (i.e., RGB, RGY, CGB, RCB, CGY, and CRY), no point is included in more than two triads. This is advantageous over a system that uses all possible triads (e.g., 10 for RGBCY) because it requires significantly less processing for calculations. Further, a simple divide by two is always required for calculations, which simplifies logic and reduces processing required to complete the calculations.
[00468] In one embodiment, the system uses at least one virtual primary in at least one triad. In one example, an RGBC system uses a virtual magenta primary and a virtual yellow primary. In one embodiment, the virtual magenta primary is an average of a red primary point and a blue primary point. In one embodiment, the virtual yellow primary is an average of a red primary point and a green primary point. In another example, an RGBY
system uses a virtual magenta primary and a virtual cyan primary. In one embodiment, the virtual cyan primary is an average of a green primary point and a blue primary point. In yet another example, an RGBCY system uses a virtual magenta primary. In one embodiment, the at least one virtual primary is located on a line connecting two non-virtual primaries.
Advantageously, using the virtual primaries allows for the eight triads described above (e.g., RGB, CMY, RBM, CBG, RGY, CMB, RMY, and CGY) to be used within a four primary system and/or a five primary system.
[00469] TRIADS WITH TWO PRIMARIES AND A VIRTUAL PRIMARY
[00470] In another embodiment, the three points forming a triad include two primaries and a point within the color gamut used as a virtual primary. In a preferred embodiment, the virtual primary is a white point (e.g., D65). Each triad is formed using two adjacent primaries and the virtual primary (e.g., the white point). For example, in an RGBCMY
system with a white point ("W"), the triads include WRY, WYG, WGC, WCB, WBM, and WMR as shown in FIG. 100. Advantageously, using the white point as a virtual primary covers the complete color area, and points are only within one triangle. Thus, a four primary system with an additional virtual primary results in four triads, a five primary system with an additional virtual primary results in five triads, a six primary system with an additional virtual primary results in six triads, a seven primary system with an additional virtual primary results in seven triads, an eight primary system with an additional virtual primary results in eight triads, a nine primary system with an additional virtual primary results in nine triads, a ten primary system with an additional virtual primary results in ten triads, an eleven primary system with an additional virtual primary results in eleven triads, a twelve primary system with an additional virtual primary results in twelve triads, etc.
[00471] The white point W is a virtual primary defined as [1 1 1 1 1 1] of RGBCMY. All color points are in only one of the six triads for a six primary system. If a color point is on the line between two triads, the system determines in which triad the color point resides (e.g., based on significant figures and precision of a processor).
[00472] For example, when reconstructing the RGBCMY from a RYW triad, the XYZ-to-RYW gives the following matrix:
[R Y W] = [0.244 0.572 0.345]
[00473] All RGBCMY values are set to the virtual primary value, which is 0.345 in the example above. Thus, RGBCMY(R) = RGBCMY(R) + R (=0.244 in the example above) and RGBCMY(Y)=RGBCMY(Y) + Y (=0.572 in the example above), which yields the following matrix:
[R GBCM Y] = [0.589 0.345 0.345 0.345 0.345 0.917]
[00474] Further away from the white point, the W value decreases substantially. The W
gives positive RGBCMY, and if the magnitude of W is greater than the magnitude of one of the other elements, the result might still be all positive in RGBCMY. From the above example, if R = -0.244, then the final R value would still be positive (i.e., R = 0.345 ¨ 0.244 = 0.101).
[00475] Advantageously, the addition of the virtual primary (e.g., white point) constrains the system to a finite number of values when converting from XYZ to a multi-primary color gamut (e.g., RGBCMY). The virtual primary is not necessary when converting from the multi-primary color gamut (e.g., RGBCMY) to XYZ because this operation is well-defined by a 3x6 matrix (e.g., RGBCMY-to-XYZ matrix) and an absolute inverse of the 3x6 matrix is not possible.
[00476] In one embodiment, the multi-primary system includes at least one internal primary (e.g., at least one white point) and at least three peripheral primaries. For example, the multi-primary system includes P peripheral primaries and I internal primaries. There will be I sets of P triads formed from the P peripheral primaries and each of the I
internal primaries. Any point will only be within one of the P triads including each of the I internal primaries. These resulting values are then averaged together.
[00477] In one embodiment, a multi-primary system includes three peripheral primaries (e.g., Pi-P3) and an internal primary (I). Any point is included in one triad of a set of triads including I (e.g., P1P2I, P1P3I, or P2P3I) and a triad formed with the three peripheral primaries (e.g., P1P2P3). These resulting values from the one triad of the set of triads including I and the triad formed with the three peripheral primaries are added together and divided by two. For example, a multi-primary system includes a red primary (R), a green primary (G), a blue primary (B), and a white primary (W). Any point is present in one of RGW, RBW, or GBW
and in RGB. In one embodiment, the resulting values are added together and divided by two as shown in the equation below (e.g., for an XYZ input), wherein a point is present in only one triad in each set shown in brackets:
RGW
RGBW = ([RBW1+ RGB) /2 GBW
In another embodiment, the value of RGW, RBW, or GBW is used without dividing by two to produce RGBW.
[00478] In one embodiment, a multi-primary system includes three peripheral primaries (e.g., Pi-P3) and two internal primaries (e.g., I1-I2). Any point is included in a first triad of a first set of triads including II (e.g., P1P2I1, P1P3I1, or P2P311) and a second triad of a second set of triads including 12 (e.g., P1P212, P1P312, or P2P3I2). These resulting values from the first triad of the first set of triads and the second triad of the second set of triads are added together and divided by two. For example, a multi-primary system includes a red primary (R), a green primary (G), a blue primary (B), a first white primary (WO, and a second white primary (W2).
Any point is present in one of RGW1, RBWi, or GBWi and in one of RGW2, RBW2, or GBW2. In one embodiment, the resulting values are added together and divided by two as shown in the equation below (e.g., for an XYZ input), wherein a point is present in only one triad in each set shown in brackets:
RGWil [RGW2 RGBW1W2 = ([RBWi + RBW2 )/2 GBWi GB W2 [00479] In one embodiment, a multi-primary system includes four peripheral primaries (e.g., Pi-134) and two internal primaries (e.g., 11-12). Any point is included in a first triad of a first set of triads including Ii (e.g., P1P2I1, P2P411, P3P411, or P1P3I1) and a second triad of a second set of triads including 12 (e.g., P1P212, P2P4I2, P3P4I2, or P1P312).
These resulting values from the first triad of the first set of triads and the second triad of the second set of triads are added together and divided by two. For example, a multi-primary system includes a red primary (R), a green primary (G), a blue primary (B), a cyan primary (C), a first white primary (WO, and a second white primary (W2). Any point is present in one of RGW1, GCW1, BCW1, or RBWi and in one of RGW2, GCW2, BCW2, or RBW2. In one embodiment, the resulting values are added together and divided by two as shown in the equation below (e.g., for an XYZ input), wherein a point is present in only one triad in each set shown in brackets:
/[RGW11 [RGW21\
GCW, GCW2 RGBCW1W2 = /2 RBWi RBW2 [00480] In one embodiment, a multi-primary system includes three peripheral primaries (e.g., P1-P3) and three internal primaries (e.g., 11-13). Any point is included in a first triad of a first set of triads including Ii (e.g., P1P2I1, P1P3I1, or P2P311), a second triad of a second set of triads including 12 (e.g., P1P212, P1P312, or P2P3I2), and a third triad of a third set of triads including 13 (e.g., PiP213, P1P313, or P2P3I3). These resulting values from the first triad of the first set of triads, the second triad of the second set of triads, and the third triad of the third set of triads are added together and divided by three. For example, a multi-primary system includes a first red primary (Ri), a second red primary (R2), a first green primary (GO, a second green primary (G2), a first blue primary (BO, and a second blue primary (B2). The second red primary, the second green primary, and the second blue primary are contained within a triad formed by the first red primary, the first green primary, and the first blue primary. Any point is present in one of R1G1R2, RiB1R2, or G1B1R2, in one of R1G1G2, R1B1G2, or G1B1G2, and in one of R1G1B2, RiBiB2, or G1B1B2. In one embodiment, the resulting values are added together and divided by three as shown in the equation below (e.g., for an XYZ input), wherein a point is present in only one triad in each set shown in brackets:
R1G1R2 [R1G1G2 [R1G1B2 R1R2G1G2B1B2 = ([RiBiR2 + R1B1G2 + RiBiB21) /3 G1B1R2 GA_ G2 G1B1B2 [00481] In another embodiment, the multi-primary system includes the three peripheral primaries (e.g., Pi-P3) and the three internal primaries (e.g., 11-13). Any point is included in a first triad of a first set of triads (e.g., P1P2I1, P11113, P2P3I2, P21112, P1P313, P31213, or 111213) and a second triad (e.g., PiP2P3). These resulting values from the first triad of the first set of triads and the second triad are added together and divided by two. For example, a multi-primary system includes a first red primary (Ri), a second red primary (R2), a first green primary (GO, a second green primary (G2), a first blue primary (BO, and a second blue primary (B2). The second red primary, the second green primary, and the second blue primary are contained within a triad formed by the first red primary, the first green primary, and the first blue primary. Any point is present in one of R1G1R2, RiR2B2, G1B1G2, G1R2G2, RiBiB2, B1G2B2, or R2G2B2 and in RiGiBi. In one embodiment, the resulting values are added together and divided by three as shown in the equation below (e.g., for an XYZ input), wherein a point is present in only one triad in each set shown in brackets:
el GiR21 1 IGI-BiG21 1 R1R2G1G2B1B2 = 1 1GiR2G2 I + [RiGiBi] 1/2 I I ReR1B2 I I
iBiGG2BB21 l_R ) [00482] In one embodiment, the present invention provides a system for displaying a multi-primary color system including a set of image data, an image data converter, a set of saturation data corresponding to the set of image data, wherein the set of saturation data is used to extend a set of hue angles for the first set of color channel data and the second set of color channel data, a set of Session Description Protocol (SDP) parameters, and at least one display device, wherein the at least one display device and the image data converter are in network communication, wherein the image data converter further includes a cyan primary position, and wherein the image data converter is operable to convert the set of image data for display on the at least one display device. In one embodiment, the set of image data includes a first set of color channel data and a second set of color channel data. In one embodiment, the image data converter includes a digital interface, wherein the digital interface is operable to encode and decode the set of image data. In one embodiment, the set of SDP
parameters is modifiable. In one embodiment, the system further includes at least one transfer function (TF) for processing the set of image data. In one embodiment, the cyan primary position is positioned to limit saturation. In one embodiment, the cyan primary position is located at u'=0.096, v'=0.454. In one embodiment, the cyan primary position is determined by expanding the set of hue angles. In one embodiment, the cyan primary position is located at u'=0.067, v'=0.449. In one embodiment, the set of image data includes a bit level. In one embodiment, the image data converter is operable to convert the bit level of the set of image data, thereby creating an updated bit level. In one embodiment, once the set of image data has been converted by the image data converter for the at least one display device the set of SDP
parameters is modified based on the conversion. In one embodiment, the at least one display device is operable to display the multi-primary color system based on the set of image data.
In one embodiment, the system further includes at least one electronic luminance component, wherein the at least one electronic luminance component is not calculated within the at least one display. In one embodiment, the first set of color channel data includes a first bit value defining black and a second bit value defining white, wherein the second set of color channel data includes a third bit value defining black and a fourth bit value defining white. In one embodiment, the set of SDP parameters is modified to include data corresponding to the first set of color channel data and the second set of color channel data. In one embodiment, the system further includes a magenta primary value. In one embodiment, the magenta primary value is derived from the set of image data. In one embodiment, the magenta primary value is not defined as a wavelength. In one embodiment, the multi-primary color system is a six-primary color system.
[00483] In another embodiment, the present invention provides a system for displaying a multi-primary color system including a set of image data, an image data converter, a set of saturation data corresponding to the set of image data, a set of Session Description Protocol (SDP) parameters, and at least one display device, wherein the at least one display device and the image data converter are in network communication, wherein the image data converter further includes a cyan primary position, wherein the cyan primary position is positioned to limit saturation, and wherein the image data converter is operable to convert the set of image data for display on the at least one display device. In one embodiment, the image data converter includes a digital interface, wherein the digital interface is operable to encode and decode the set of image data. In one embodiment, the set of image data includes a first set of color channel data and a second set of color channel data. In one embodiment, the set of saturation data is used to extend a set of hue angles for the first set of color channel data and the second set of color channel data. In one embodiment, the set of image data further includes a bit level. In one embodiment, the system further includes at least one transfer function (TF) for processing the set of image data. In one embodiment, the set of SDP
parameters is modifiable. In one embodiment, the image data converter is operable to convert the bit level of the set of image data, thereby creating an updated bit level.
In one embodiment, the cyan primary position is located at u'=0.096, v'=0.454. In one embodiment, once the set of image data has been converted by the image data converter for the at least one display device, the set of SDP parameters is modified based on the conversion.
In one embodiment, the at least one display device is operable to display the multi-primary color system based on the set of image data. In one embodiment, the multi-primary color system is a six-primary color system.
[00484] In yet another embodiment, the present invention provides a system for displaying a multi-primary color system including a set of image data, an image data converter, a set of saturation data corresponding to the set of image data, a set of Session Description Protocol (SDP) parameters, and at least one display device, wherein the at least one display device and the image data converter are in network communication, wherein the image data converter further includes a cyan primary position, wherein the cyan primary position is determined by expanding the set of hue angles, and wherein the image data converter is operable to convert the set of image data for display on the at least one display device. In one embodiment, the image data converter includes a digital interface, wherein the digital interface is operable to encode and decode the set of image data. In one embodiment, the set of image data includes a first set of color channel data and a second set of color channel data. In one embodiment, the set of saturation data is used to extend a set of hue angles for the first set of color channel data and the second set of color channel data.
[00485] In one embodiment, the present invention provides a system for displaying a multi-primary color system including a set of image data, wherein the set of image data includes a first set of color channel data and a second set of color channel data, an image data converter, wherein the image data converter includes a digital interface, wherein the digital interface is operable to encode and decode the set of image data, a set of Session Description Protocol (SDP) parameters, and at least one display device, wherein the at least one display device and the image data converter are in network communication, wherein the image data converter is operable to map the first set of color channel data and the second set of color channel data to a color matrix, wherein the color matrix includes primary color values for Red (R), Green (G), Blue (B), Cyan (C), Yellow (Y), and Magenta (M), wherein the C, M, and Y primary color values are substantially equal in saturation to the R, G, and B primary color values, respectively, and wherein the image data converter is operable to convert the set of image data for display on the at least one display device using the color matrix and an additive color space matrix corresponding to a specified color space. In one embodiment, the system further includes at least one transfer function (TF) for processing the set of image data. In one embodiment, the set of SDP parameters is modifiable. In one embodiment, the C, M, and Y primary color values include a set of substantially inverted hue angles corresponding to a set of hue angles for the R, G, and B primary color values, respectively. In one embodiment, the specified color space uses an ITU-R BT709.6 color gamut.
In one embodiment, the set of image data includes a bit level, wherein the image data converter is operable to convert the bit level of the set of image data, thereby creating an updated bit level. In one embodiment, once the set of image data has been converted by the image data converter for the at least one display device, the set of SDP parameters is modified based on the conversion. In one embodiment, the at least one display device is operable to display the multi-primary color system based on the set of image data. In one embodiment, the system further includes at least one electronic luminance component, wherein the at least one electronic luminance component is not calculated within the at least one display device. In one embodiment, the additive color space matrix is based on mathematical space and not based on the set of image data. In one embodiment, the set of SDP parameters is modified to include data corresponding to the first set of color channel data and the second set of color channel data. In one embodiment, the multi-primary color system is a six-primary color system.
[00486] In another embodiment, the present invention provides a system for displaying a multi-primary color system includes a set of image data, wherein the set of image data includes a first set of color channel data and a second set of color channel data, an image data converter, a set of Session Description Protocol (SDP) parameters, and at least one display device, wherein the at least one display device and the image data converter are in network communication, wherein the image data converter is operable to map the first set of color channel data and the second set of color channel data to a color matrix, wherein the color matrix includes primary color values for Red (R), Green (G), Blue (B), Cyan (C), Yellow (Y), and Magenta (M), and wherein the image data converter is operable to convert the set of image data for display on the at least one display device using the color matrix and an additive color space matrix corresponding to a specified color space. In one embodiment, the set of SDP parameters is modifiable. In one embodiment, the C, M, and Y
primary color values are substantially equal in saturation to the R, G, and B primary color values, respectively. In one embodiment, the specified color space uses an ITU-R
BT709.6 color gamut. In one embodiment, the first set of color channel data defines a first minimum color luminance and a first maximum color luminance, wherein the second set of color channel data defines a second minimum color luminance and a second maximum color luminance. In one embodiment, the set of SDP parameters indicates the magenta primary value and the set of image data being displayed on the at least one display device is using the multi-primary color system. In one embodiment, the image data converter is operable to convert a bit level for the set of image data to a new bit level. In one embodiment, the system further includes a set of saturation data corresponding to the set of image data, wherein the set of saturation data is used to extend a set of hue angles for the first set of color channel data and the second set of color channel data. In one embodiment, the set of SDP parameters includes the first set of color channel data, the second set of color channel data, mapping data for the set of image data, and a flag indicator. In one embodiment, the image data converter includes a digital interface, and wherein the digital interface is operable to encode and decode the set of image data using at least one color difference component. In one embodiment, the at least one display device is operable to display the multi-primary color system based on the set of image data, wherein the multi-primary color system displayed on the at least one display device is based on the set of image data, such that the set of SDP parameters indicates the M primary color value and that the set of image data being displayed on the at least one display device is using the multi-primary color system. In one embodiment, the set of image data includes a bit level, wherein the image data converter is operable to convert the bit level for the set of image data to a new bit level using the at least one TF. In one embodiment, the set of image data defines a minimum color luminance and a maximum color luminance. In one embodiment, the digital interface includes payload identification (ID) metadata, wherein the payload ID metadata is operable to identify the set of image data as a multi-primary color set of image data. In one embodiment, the M primary color value is calculated based on values for R and B from the set of image data. In one embodiment, the multi-primary color system is a six-primary color system.
[00487] In yet another embodiment, the present invention provides a system for displaying a set of image data using a multi-primary color system including a set of image data, a Magenta (M) primary value, an image data converter, a set of Session Description Protocol (SDP) parameters, at least one display device, wherein the at least one display device and the image data converter are in network communication, wherein the image data converter is operable to map the set of image data to a color matrix, wherein the color matrix includes primary values for Red (R), Green (G), Blue (B), Cyan (C), and Yellow (Y), wherein the color matrix further includes the M primary value, wherein the C, M, and the Y
primary color values include a set of substantially inverted hue angles corresponding to a set of hue angles for the R, G, and B primary color values, respectively, wherein the image data converter is operable to convert the set of image data for display on the at least one display device using the color matrix and an additive color space matrix corresponding to a specified color space.
In one embodiment, the image data converter includes a digital interface. In one embodiment, the digital interface is operable to encode and decode the set of image data.
In one embodiment, the system further includes at least one transfer function (TF) for processing the set of image data. In one embodiment, the set of SDP parameters is modifiable.
In one embodiment, the specified color space uses an ITU-R BT709.6 color gamut. In one embodiment, the multi-primary color system is a six-primary color system.
[00488] In one embodiment, the present invention provides a system for displaying a primary color system including a set of image data, an image data converter, a set of Session Description Protocol (SDP) parameters, and at least one display device, wherein the set of image data further includes primary color data for at least five primary color values, wherein the at least one display device and the image data converter are in network communication, and wherein the image data converter is operable to convert the set of image data for display on the at least one display device. In one embodiment, the set of image data includes a first set of color channel data and a second set of color channel data. In one embodiment, the image data converter includes a digital interface, wherein the digital interface is operable to encode and decode the set of image data. In one embodiment, the system further includes at least one transfer function (TF) for processing the set of image data. In one embodiment, the set of image data includes a bit level, wherein the image data converter is operable to convert the bit level of the set of image data, thereby creating an updated bit level.
In one embodiment, the set of SDP parameters is modifiable. In one embodiment, once the set of image data has been converted by the image data converter for the at least one display device, the set of SDP parameters is modified based on the conversion. In one embodiment, the at least one display device is operable to display the primary color system based on the set of image data. In one embodiment, the system further includes at least one electronic luminance component, wherein the at least one electronic luminance component is not calculated within the at least one display. In one embodiment, the first set of color channel data includes a first bit value defining black and a second bit value defining white, wherein the second set of color channel data includes a third bit value defining black and a fourth bit value defining white. In one embodiment, the set of SDP parameters is modified to include data corresponding to the first set of color channel data and the second set of color channel data.
In one embodiment, the primary color values are operable to be expressed using a tristimulus color vector, a linear display control vector, and a conversion matrix.
[00489] In another embodiment, the present invention provides a system for displaying a primary color system including a set of image data, wherein the set of image data includes a first set of color channel data and a second set of color channel data, an image data converter, a set of Session Description Protocol (SDP) parameters, wherein the set of SDP
parameters is modifiable, and at least one display device, wherein the set of image data further includes primary color data for at least five primary color values, wherein the at least one display device and the image data converter are in network communication, and wherein the image data converter is operable to convert the set of image data for display on the at least one display device. In one embodiment, the system further includes a standardized transport format, wherein the standardized transport format is operable to receive the first set of color channel data and the second set of color channel data as a combined set of color channel data, wherein the combined set of color channel data has a combined bit level equal to the bit level for the set of image data. In one embodiment, the set of SDP parameters indicate the set of image data being displayed on the at least one display device is using the primary color system. In one embodiment, the image data converter is operable to convert a bit level for the set of image data to a new bit level. In one embodiment, the system further includes a set of saturation data corresponding to the set of image data, wherein the set of saturation data is used to extend a set of hue angles for the first set of color channel data and the second set of color channel data. In one embodiment, the set of SDP parameters includes the first set of color channel data, the second set of color channel data, mapping data for the set of image data, and a flag indicator. In one embodiment, the image data converter includes a digital interface, and wherein the digital interface is operable to encode and decode the set of image data using at least one color difference component.
[00490] In yet another embodiment, the present invention provides a system for displaying a set of image data using a primary color system including a set of image data, an image data converter, a set of Session Description Protocol (SDP) parameters, and at least one display device, wherein the set of image data further includes primary color data for at least five primary color values, wherein the at least one display device and the image data converter are in network communication, and wherein the image data converter is operable to convert the set of image data for display on the at least one display device. In one embodiment, the at least one display device is operable to display the primary color system based on the set of image data, wherein the primary color system displayed on the at least one display device is based on the set of image data, such that the set of SDP parameters indicates that the set of image data being displayed on the at least one display device is using the primary color system. In one embodiment, the image data converter includes a digital interface, wherein the digital interface is operable to encode and decode the set of image data. In one embodiment, the system further includes at least one transfer function (TF) for processing the set of image data. In one embodiment, the set of SDP parameters is modifiable. In one embodiment, the set of image data includes a bit level, wherein the image data converter is operable to convert the bit level for the set of image data to a new bit level using the at least one TF. In one embodiment, the set of image data defines a minimum color luminance and a maximum color luminance. In one embodiment, the set of image data includes red (R), green (G), blue (B), cyan (C), and yellow (Y) primary color values. In one embodiment, the digital interface includes payload identification (ID) metadata, wherein the payload ID metadata is operable to identify the set of image data as a primary color set of image data.
[00491] In one embodiment, the present invention provides a system for displaying a primary color system including a set of image data, wherein the set of image data includes a bit level, an image data converter, wherein the image data converter includes a digital interface, wherein the digital interface is operable to encode and decode the set of image data, a set of Session Description Protocol (SDP) parameters, wherein the set of SDP
parameters is modifiable, and at least one display device, wherein the set of image data further includes primary color data for at least four primary color values, wherein the at least one display device and the image data converter are in network communication, wherein the image data converter is operable to convert the bit level for the set of image data, thereby creating an updated bit level, wherein the image data converter is operable to convert the set of image data for display on the at least one display device, wherein once the set of image data has been converted by the image data converter for the at least one display device, the set of SDP
parameters is modified based on the conversion, and wherein the at least one display device is operable to display the primary color system based on the set of image data, and wherein the set of SDP parameters indicates that the image data being displayed on the at least one display device is using the primary color system. In one embodiment, the at least one display device is a single display device. In one embodiment, the at least four primary color values are operable to be expressed using a tristimulus color vector, a linear display control vector, and a conversion matrix. In one embodiment, the digital interface encodes and decodes the set of image data using at least one color difference component, wherein the at least one color difference component is operable for up-sampling and/or down-sampling.
[00492] In another embodiment, the present invention provides a system for displaying a primary color system including a set of image data, wherein the set of image data includes a bit level, an image data converter, wherein the image data converter includes a digital interface, wherein the digital interface is operable to encode and decode the set of image data, at least one transfer function (TF) for processing the set of image data, a set of Session Description Protocol (SDP) parameters, wherein the set of SDP parameters is modifiable, and at least one display device, wherein the set of image data further includes primary color data for at least four primary color values, wherein the at least four primary color values include a cyan primary, wherein the at least one display device and the image data converter are in network communication, wherein the image data converter is operable to convert the bit level for the set of image data, thereby creating an updated bit level, wherein the image data converter is operable to convert the set of image data for display on the at least one display device, wherein once the set of image data has been converted by the image data converter for the at least one display device, the set of SDP parameters is modified based on the conversion, and wherein the at least one display device is operable to display the primary color system based on the set of image data, and wherein the set of SDP
parameters indicates that the image data being displayed on the at least one display device is using the primary color system.
[00493] In yet another embodiment, the present invention provides a system for displaying a primary color system, including a set of image data, wherein the set of image data includes a bit level, an image data converter, wherein the image data converter includes a digital interface, wherein the digital interface is operable to encode and decode the set of image data, at least one transfer function (TF) for processing the set of image data, a set of Session Description Protocol (SDP) parameters, wherein the set of SDP parameters is modifiable, and at least one display device, wherein the set of image data further includes primary color data for at least four primary color values, wherein the at least four primary color values include at least one white emitter, wherein the at least one display device and the image data converter are in network communication, wherein the image data converter is operable to convert the bit level for the set of image data, thereby creating an updated bit level, wherein the image data converter is operable to convert the set of image data for display on the at least one display device,. wherein once the set of image data has been converted by the image data converter for the at least one display device the set of SDP parameters is modified based on the conversion, and wherein the at least one display device is operable to display the primary color system based on the set of image data, and wherein the set of SDP
parameters indicates that the image data being displayed on the at least one display device is using the primary color system.
[00494] In one embodiment, the present invention provides a system for color conversion in a multi-primary color system including a color signal corresponding to XYZ
coordinates of a color, at least four primaries, at least four triads, wherein each of the at least four triads includes three of the at least four primaries, at least four XYZ-to-triad matrices, wherein each of the at least four XYZ-to-triad matrices corresponds to one of the at least four triads, and at least one display device, wherein the XYZ coordinates are multiplied by the at least four XYZ-to-triad matrices to determine one or more of the at least four triads in which the XYZ
coordinates are located, wherein a sum of primary components of the one or more of the at least four triads is determined on a per-component basis, wherein the sum is divided by a number of the one or more of the at least four triads, thereby creating an updated color signal, and wherein the at least one display device is operable to display the updated color signal. In one embodiment, the at least four primaries are at least five primaries, wherein the at least five primaries include at least four color primaries and a white point, and wherein the at least four triads each include two adjacent color primaries of the at least four color primaries and the white point. In one embodiment, each of the at least four triads does not contain a primary and its complement. In one embodiment, the at least four primaries include red (R), green (G), blue (B), cyan (C), magenta (M), and yellow (Y), wherein the at least four triads are eight triads, and wherein the eight triads include RGB, CMY, RBM, CGB, RGY, CMB, RMY, and CGY. In one embodiment, the at least four primaries include red (R), green (G), blue (B), cyan (C), magenta (M), and yellow (Y), wherein the at least four triads are five triads, and wherein the five triads include RGB, CMY, RBM, CGB, and RGY. In one embodiment, the at least four primaries include red (R), green (G), blue (B), cyan (C), and yellow (Y), wherein the at least four triads are six triads, and wherein the six triads include RGB, RGY, CGB, RCB, CGY, and CRY. In one embodiment, the one or more of the at least four triads is not more than two of the at least four triads. In one embodiment, the color is an out-of-gamut color and remapped to an in-gamut color along a straight line between the out-of-gamut color and a white point. In one embodiment, all values in a resulting matrix from the multiplication of the XYZ coordinates and the at least four XYZ-to-triad matrices are set to zero if any value in the resulting matrix is negative. In one embodiment, the at least four triads are selected such that a first triad includes a white point, a second triad includes the white point, and no other triads include the white point. In one embodiment, the at least four primaries include at least one virtual primary. In one embodiment, the at least one virtual primary is a virtual magenta primary, a virtual yellow primary, a virtual cyan primary, and/or a white point.
[00495] In another embodiment, the present invention provides a system for color conversion in a multi-primary color system including a color signal corresponding to XYZ
coordinates of a color, at least five primaries, wherein the at least five primaries include at least four color primaries and a virtual primary within a color gamut formed using the at least four color primaries, at least four triads, wherein each of the at least four triads includes two adjacent primaries of the at least four color primaries and the virtual primary, at least four XYZ-to-triad matrices, wherein each of the at least four XYZ-to-triad matrices corresponds to one of the at least four triads, and at least one display device, wherein the XYZ coordinates are multiplied by the at least four XYZ-to-triad matrices to determine one of the at least four triads in which the XYZ coordinates are located, thereby creating an updated color signal, and wherein the at least one display device is operable to display the updated color signal. In one embodiment, the at least four color primaries include red (R), green (G), blue (B), cyan (C), magenta (M), and yellow (Y). In one embodiment, the virtual primary is a white point. In one embodiment, the at least four color primaries includes at least one virtual color primary.
[00496] In yet another embodiment, the present invention provides a system for color conversion in a multi-primary color system including a color signal corresponding to XYZ
coordinates of a color, six primaries, eight triads, wherein each of the eight triads includes three of the six primaries, eight XYZ-to-triad matrices, wherein each of the eight XYZ-to-triad matrices corresponds to one of the eight triads, and at least one display device, wherein the XYZ coordinates are multiplied by each of the eight XYZ-to-triad matrices to determine two of the eight triads in which the XYZ coordinates are located, wherein a sum of primary components of the two triads is determined on a per-component basis, and wherein the sum is divided by two, thereby creating an updated color signal, and wherein the at least one display device is operable to display the updated color signal. In one embodiment, each of the eight triads does not contain a primary and its complement. In one embodiment, the six primaries include red (R), green (G), blue (B), cyan (C), magenta (M), and yellow (Y).
In one embodiment, the eight triads include RGB, CMY, RBM, CGB, RGY, CMB, RMY, and CGY.
[00497] FIG. 101 is a schematic diagram of an embodiment of the invention illustrating a computer system, generally described as 800, having a network 810, a plurality of computing devices 820, 830, 840, a server 850, and a database 870.
[00498] The server 850 is constructed, configured, and coupled to enable communication over a network 810 with a plurality of computing devices 820, 830, 840. The server 850 includes a processing unit 851 with an operating system 852. The operating system 852 enables the server 850 to communicate through network 810 with the remote, distributed user devices. Database 870 may house an operating system 872, memory 874, and programs 876.
[00499] In one embodiment of the invention, the system 800 includes a network 810 for distributed communication via a wireless communication antenna 812 and processing by at least one mobile communication computing device 830. Alternatively, wireless and wired communication and connectivity between devices and components described herein include wireless network communication such as WI-Fl, WORLDWIDE INTEROPERABILITY
FOR MICROWAVE ACCESS (WIMAX), Radio Frequency (RF) communication including RF identification (RFID), NEAR FIELD COMMUNICATION (NFC), BLUETOOTH
including BLUETOOTH LOW ENERGY (BLE), ZIGBEE, Infrared (IR) communication, cellular communication, satellite communication, Universal Serial Bus (USB), Ethernet communications, communication via fiber-optic cables, coaxial cables, twisted pair cables, and/or any other type of wireless or wired communication. In another embodiment of the invention, the system 800 is a virtualized computing system capable of executing any or all aspects of software and/or application components presented herein on the computing devices 820, 830, 840. In certain aspects, the computer system 800 may be implemented using hardware or a combination of software and hardware, either in a dedicated computing device, or integrated into another entity, or distributed across multiple entities or computing devices.
[00500] By way of example, and not limitation, the computing devices 820, 830, 840 are intended to represent various forms of electronic devices including at least a processor and a memory, such as a server, blade server, mainframe, mobile phone, personal digital assistant (PDA), smartphone, desktop computer, notebook computer, tablet computer, workstation, laptop, and other similar computing devices. The components shown here, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the invention described and/or claimed in the present application.
[00501] In one embodiment, the computing device 820 includes components such as a processor 860, a system memory 862 having a random access memory (RAM) 864 and a read-only memory (ROM) 866, and a system bus 868 that couples the memory 862 to the processor 860. In another embodiment, the computing device 830 may additionally include components such as a storage device 890 for storing the operating system 892 and one or more application programs 894, a network interface unit 896, and/or an input/output controller 898. Each of the components may be coupled to each other through at least one bus 868. The input/output controller 898 may receive and process input from, or provide output to, a number of other devices 899, including, but not limited to, alphanumeric input devices, mice, electronic styluses, display units, touch screens, signal generation devices (e.g., speakers), or printers.
[00502] By way of example, and not limitation, the processor 860 may be a general-purpose microprocessor (e.g., a central processing unit (CPU)), a graphics processing unit (GPU), a microcontroller, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA), a Programmable Logic Device (PLD), a controller, a state machine, gated or transistor logic, discrete hardware components, or any other suitable entity or combinations thereof that can perform calculations, process instructions for execution, and/or other manipulations of information.
[00503] In another implementation, shown as 840 in FIG. 101 multiple processors 860 and/or multiple buses 868 may be used, as appropriate, along with multiple memories 862 of multiple types (e.g., a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core).
[00504] Also, multiple computing devices may be connected, with each device providing portions of the necessary operations (e.g., a server bank, a group of blade servers, or a multi-processor system). Alternatively, some steps or methods may be performed by circuitry that is specific to a given function.
[00505] According to various embodiments, the computer system 800 may operate in a networked environment using logical connections to local and/or remote computing devices 820, 830, 840 through a network 810. A computing device 830 may connect to a network 810 through a network interface unit 896 connected to a bus 868. Computing devices may communicate communication media through wired networks, direct-wired connections or wirelessly, such as acoustic, RF, or infrared, through an antenna 897 in communication with the network antenna 812 and the network interface unit 896, which may include digital signal processing circuitry when necessary. The network interface unit 896 may provide for communications under various modes or protocols.
[00506] In one or more exemplary aspects, the instructions may be implemented in hardware, software, firmware, or any combinations thereof A computer readable medium may provide volatile or non-volatile storage for one or more sets of instructions, such as operating systems, data structures, program modules, applications, or other data embodying any one or more of the methodologies or functions described herein. The computer readable medium may include the memory 862, the processor 860, and/or the storage media 890 and may be a single medium or multiple media (e.g., a centralized or distributed computer system) that store the one or more sets of instructions 900. Non-transitory computer readable media includes all computer readable media, with the sole exception being a transitory, propagating signal per se. The instructions 900 may further be transmitted or received over the network 810 via the network interface unit 896 as communication media, which may include a modulated data signal such as a carrier wave or other transport mechanism and includes any deliver media. The term "modulated data signal" means a signal that has one or more of its characteristics changed or set in a manner as to encode information in the signal.
[00507] Storage devices 890 and memory 862 include, but are not limited to, volatile and non-volatile media such as cache, RAM, ROM, EPROM, EEPROM, FLASH memory, or other solid state memory technology, discs (e.g., digital versatile discs (DVD), HD-DVD, BLU-RAY, compact disc (CD), or CD-ROM) or other optical storage; magnetic cassettes, magnetic tape, magnetic disk storage, floppy disks, or other magnetic storage devices; or any other medium that can be used to store the computer readable instructions and which can be accessed by the computer system 800.
[00508] In one embodiment, the computer system 800 is within a cloud-based network. In one embodiment, the server 850 is a designated physical server for distributed computing devices 820, 830, and 840. In one embodiment, the server 850 is a cloud-based server platform. In one embodiment, the cloud-based server platform hosts serverless functions for distributed computing devices 820, 830, and 840.
[00509] In another embodiment, the computer system 800 is within an edge computing network. The server 850 is an edge server, and the database 870 is an edge database. The edge server 850 and the edge database 870 are part of an edge computing platform. In one embodiment, the edge server 850 and the edge database 870 are designated to distributed computing devices 820, 830, and 840. In one embodiment, the edge server 850 and the edge database 870 are not designated for computing devices 820, 830, and 840. The distributed computing devices 820, 830, and 840 are connected to an edge server in the edge computing network based on proximity, availability, latency, bandwidth, and/or other factors.
[00510] It is also contemplated that the computer system 800 may not include all of the components shown in FIG. 101 may include other components that are not explicitly shown in FIG. 101 or may utilize an architecture completely different than that shown in FIG. 101.
The various illustrative logical blocks, modules, elements, circuits, and algorithms described in connection with the embodiments discussed herein may be implemented as electronic hardware, computer software, or combinations of both. To clearly illustrate the interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the overall system. Skilled artisans may implement the described functionality in varying ways for each particular application (e.g., arranged in a different order or positioned in a different way), but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
[00511] The above-mentioned examples are provided to serve the purpose of clarifying the aspects of the invention, and it will be apparent to one skilled in the art that they do not serve to limit the scope of the invention. By nature, this invention is highly adjustable, customizable and adaptable. The above-mentioned examples are just some of the many configurations that the mentioned components can take on. All modifications and improvements have been deleted herein for the sake of conciseness and readability but are properly within the scope of the present invention.
Claims
[Claim 11 A system for displaying a primary color system, comprising:
a set of image data;
an image data converter;
a set of Session Description Protocol (SDP) parameters; and at least one display device;
wherein the set of image data includes primary color data for at least four primary color values;
wherein the at least one display device and the image data converter are in network communication; and wherein the image data converter is operable to convert the set of image data for display on the at least one display device.
[Claim 21 The system of claim 1, wherein the at least one display device is operable to display the primary color system based on the set of image data, and wherein the primary color system displayed on the at least one display device is based on the set of image data.
[Claim 31 The system of claim 1, wherein the at least four primary color values include at least one white emitter.
[Claim 41 The system of claim 1, wherein the at least four primary color values include a red primary, a green primary, a cyan primary, and a blue primary.
[Claim 51 The system of claim 1, wherein the at least four primary color values include a red primary, a first green primary, a second green primary, and a blue primary, and wherein the first green primary and the second green primary have different chromaticity values.
[Claim 61 The system of claim 1, wherein the at least four primary color values include a red primary, a green primary, a cyan primary, a blue primary, and a white emitter.
[Claim 71 The system of claim 1, wherein the at least four primary color values include a red primary, a yellow primary, a green primary, a cyan primary, and a blue primary.
[Claim 81 The system of claim 1, wherein the at least four primary color values include a red primary, a first green primary, a second green primary, a blue primary, and a white emitter, and wherein the first green primary and the second green primary have different chromaticity values.
[Claim 91 The system of claim 1, wherein the at least four primary color values include a red primary, a green primary, a blue primary, a cyan primary, AMENDED SHEET (ARTICLE 19) a magenta primary, and a yellow primary.
[Claim 101 The system of claim 9, wherein the cyan primary, the magenta primary, and the yellow primary are substantially equal in saturation to the red primary, the green primary, and the blue primary, respectively.
[Claim 111 The system of claim 1, wherein the at least four primary color values include a red primary, a yellow primary, a green primary, a cyan primary, a blue primary, and a white emitter.
[Claim 121 The system of claim 1, wherein the at least four primaries include a red primary, a first green primary, a second green primary, a blue primary, a first white emitter, and a second white emitter, wherein the first green primary and the second green primary have different chromaticity values, and wherein the first white emitter and the second white emitter have different color temperatures.
[Claim 131 The system of claim 1, wherein the at least four primary color values include a first red primary, a second red primary, a first green primary, a second green primary, a first blue primary, and a second blue primary, wherein the first red primary, the first green primary, and the first blue primary are narrow band primaries, and wherein the second red primary, the second green primary, and the second blue primary are wide band primaries.
[Claim 141 The system of claim 1, wherein the set of image data includes a first set of color channel data and a second set of color channel data, wherein the image data converter further includes a first link component and a second link component, wherein the first link component is operable to transport the first set of color channel data to the at least one display device, and wherein the second link component is operable to transport the second set of color channel data to the at least one display device in parallel with the first link component.
[Claim 151 A system for displaying a primary color system, comprising:
a set of image data;
an image data converter, wherein the image data converter includes a digital interface, wherein the digital interface is operable to encode and decode the set of image data;
a set of Session Description Protocol (SDP) parameters; and at least one display device;
wherein the set of image data further includes primary color data for at least four primary color values, wherein the at least four primary color values include a cyan primary;
AMENDED SHEET (ARTICLE 19) wherein the at least one display device and the image data converter are in network communication; and wherein the image data converter is operable to convert the set of image data for display on the at least one display device.
[Claim 161 The system of claim 15, wherein the cyan primary is positioned to limit maximum saturation.
[Claim 171 The system of claim 15, wherein the cyan primary is positioned by expanding a set of hue angles for the at least four primaries.
[Claim 181 A system for displaying a primary color system, comprising:
a set of image data;
an image data converter, wherein the image data converter includes a digital interface, wherein the digital interface is operable to encode and decode the set of image data;
a set of Session Description Protocol (SDP) parameters; and at least one display device;
wherein the set of image data further includes primary color data for at least four primary color values, wherein the at least four primary color values include at least one white emitter;
wherein the at least one display device and the image data converter are in network communication; and wherein the image data converter is operable to convert the set of image data for display on the at least one display device.
[Claim 191 The system of claim 18, wherein the at least one white emitter includes at least three white emitters, wherein the at least three white emitters each have a different color temperature, and wherein the at least three white emitters include a mid-Kelvin white emitter.
[Claim 201 The system of claim 19, wherein the mid-Kelvin white emitter includes a green bias.
AMENDED SHEET (ARTICLE 19)
a set of image data;
an image data converter;
a set of Session Description Protocol (SDP) parameters; and at least one display device;
wherein the set of image data includes primary color data for at least four primary color values;
wherein the at least one display device and the image data converter are in network communication; and wherein the image data converter is operable to convert the set of image data for display on the at least one display device.
[Claim 21 The system of claim 1, wherein the at least one display device is operable to display the primary color system based on the set of image data, and wherein the primary color system displayed on the at least one display device is based on the set of image data.
[Claim 31 The system of claim 1, wherein the at least four primary color values include at least one white emitter.
[Claim 41 The system of claim 1, wherein the at least four primary color values include a red primary, a green primary, a cyan primary, and a blue primary.
[Claim 51 The system of claim 1, wherein the at least four primary color values include a red primary, a first green primary, a second green primary, and a blue primary, and wherein the first green primary and the second green primary have different chromaticity values.
[Claim 61 The system of claim 1, wherein the at least four primary color values include a red primary, a green primary, a cyan primary, a blue primary, and a white emitter.
[Claim 71 The system of claim 1, wherein the at least four primary color values include a red primary, a yellow primary, a green primary, a cyan primary, and a blue primary.
[Claim 81 The system of claim 1, wherein the at least four primary color values include a red primary, a first green primary, a second green primary, a blue primary, and a white emitter, and wherein the first green primary and the second green primary have different chromaticity values.
[Claim 91 The system of claim 1, wherein the at least four primary color values include a red primary, a green primary, a blue primary, a cyan primary, AMENDED SHEET (ARTICLE 19) a magenta primary, and a yellow primary.
[Claim 101 The system of claim 9, wherein the cyan primary, the magenta primary, and the yellow primary are substantially equal in saturation to the red primary, the green primary, and the blue primary, respectively.
[Claim 111 The system of claim 1, wherein the at least four primary color values include a red primary, a yellow primary, a green primary, a cyan primary, a blue primary, and a white emitter.
[Claim 121 The system of claim 1, wherein the at least four primaries include a red primary, a first green primary, a second green primary, a blue primary, a first white emitter, and a second white emitter, wherein the first green primary and the second green primary have different chromaticity values, and wherein the first white emitter and the second white emitter have different color temperatures.
[Claim 131 The system of claim 1, wherein the at least four primary color values include a first red primary, a second red primary, a first green primary, a second green primary, a first blue primary, and a second blue primary, wherein the first red primary, the first green primary, and the first blue primary are narrow band primaries, and wherein the second red primary, the second green primary, and the second blue primary are wide band primaries.
[Claim 141 The system of claim 1, wherein the set of image data includes a first set of color channel data and a second set of color channel data, wherein the image data converter further includes a first link component and a second link component, wherein the first link component is operable to transport the first set of color channel data to the at least one display device, and wherein the second link component is operable to transport the second set of color channel data to the at least one display device in parallel with the first link component.
[Claim 151 A system for displaying a primary color system, comprising:
a set of image data;
an image data converter, wherein the image data converter includes a digital interface, wherein the digital interface is operable to encode and decode the set of image data;
a set of Session Description Protocol (SDP) parameters; and at least one display device;
wherein the set of image data further includes primary color data for at least four primary color values, wherein the at least four primary color values include a cyan primary;
AMENDED SHEET (ARTICLE 19) wherein the at least one display device and the image data converter are in network communication; and wherein the image data converter is operable to convert the set of image data for display on the at least one display device.
[Claim 161 The system of claim 15, wherein the cyan primary is positioned to limit maximum saturation.
[Claim 171 The system of claim 15, wherein the cyan primary is positioned by expanding a set of hue angles for the at least four primaries.
[Claim 181 A system for displaying a primary color system, comprising:
a set of image data;
an image data converter, wherein the image data converter includes a digital interface, wherein the digital interface is operable to encode and decode the set of image data;
a set of Session Description Protocol (SDP) parameters; and at least one display device;
wherein the set of image data further includes primary color data for at least four primary color values, wherein the at least four primary color values include at least one white emitter;
wherein the at least one display device and the image data converter are in network communication; and wherein the image data converter is operable to convert the set of image data for display on the at least one display device.
[Claim 191 The system of claim 18, wherein the at least one white emitter includes at least three white emitters, wherein the at least three white emitters each have a different color temperature, and wherein the at least three white emitters include a mid-Kelvin white emitter.
[Claim 201 The system of claim 19, wherein the mid-Kelvin white emitter includes a green bias.
AMENDED SHEET (ARTICLE 19)
Applications Claiming Priority (11)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US16/860,769 US10950161B2 (en) | 2018-10-25 | 2020-04-28 | System and method for a six-primary wide gamut color system |
US16/860,769 | 2020-04-28 | ||
US16/887,807 | 2020-05-29 | ||
US16/887,807 US10950162B2 (en) | 2018-10-25 | 2020-05-29 | System and method for a six-primary wide gamut color system |
US17/009,408 | 2020-09-01 | ||
US17/009,408 US11043157B2 (en) | 2018-10-25 | 2020-09-01 | System and method for a six-primary wide gamut color system |
US17/060,959 US11062638B2 (en) | 2018-10-25 | 2020-10-01 | System and method for a multi-primary wide gamut color system |
US17/060,959 | 2020-10-01 | ||
US17/180,441 | 2021-02-19 | ||
US17/180,441 US11037481B1 (en) | 2018-10-25 | 2021-02-19 | System and method for a multi-primary wide gamut color system |
PCT/US2021/028857 WO2021222022A1 (en) | 2020-04-28 | 2021-04-23 | System and method for a multi-primary wide gamut color system |
Publications (1)
Publication Number | Publication Date |
---|---|
CA3181332A1 true CA3181332A1 (en) | 2021-11-04 |
Family
ID=78373858
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CA3181332A Pending CA3181332A1 (en) | 2020-04-28 | 2021-04-23 | System and method for a multi-primary wide gamut color system |
Country Status (8)
Country | Link |
---|---|
EP (1) | EP4143815A4 (en) |
JP (1) | JP2023524012A (en) |
KR (1) | KR20230003053A (en) |
CN (1) | CN115943455A (en) |
AU (1) | AU2021265750A1 (en) |
CA (1) | CA3181332A1 (en) |
MX (1) | MX2022013610A (en) |
WO (1) | WO2021222022A1 (en) |
Family Cites Families (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7436996B2 (en) * | 2001-06-07 | 2008-10-14 | Genoa Color Technologies Ltd | Device, system and method of data conversion for wide gamut displays |
WO2004040548A1 (en) * | 2002-10-31 | 2004-05-13 | Genoa Technologies Ltd. | System and method of selective adjustment of a color display |
US7598961B2 (en) * | 2003-10-21 | 2009-10-06 | Samsung Electronics Co., Ltd. | method and apparatus for converting from a source color space to a target color space |
US7619637B2 (en) * | 2004-04-09 | 2009-11-17 | Samsung Electronics Co., Ltd. | Systems and methods for improved gamut mapping from one image data set to another |
US7859554B2 (en) * | 2005-11-08 | 2010-12-28 | Young Garrett J | Apparatus, methods, and systems for multi-primary display or projection |
TWI346920B (en) * | 2006-11-30 | 2011-08-11 | Ind Tech Res Inst | Multi-color space display |
US20110273493A1 (en) * | 2010-05-10 | 2011-11-10 | Chimei Innolux Corporation | Pixel structure and display device having the same |
US20140225912A1 (en) * | 2013-02-11 | 2014-08-14 | Qualcomm Mems Technologies, Inc. | Reduced metamerism spectral color processing for multi-primary display devices |
US11062638B2 (en) * | 2018-10-25 | 2021-07-13 | Baylor University | System and method for a multi-primary wide gamut color system |
US11043157B2 (en) * | 2018-10-25 | 2021-06-22 | Baylor University | System and method for a six-primary wide gamut color system |
US10950161B2 (en) * | 2018-10-25 | 2021-03-16 | Baylor University | System and method for a six-primary wide gamut color system |
US10607527B1 (en) * | 2018-10-25 | 2020-03-31 | Baylor University | System and method for a six-primary wide gamut color system |
US10950162B2 (en) * | 2018-10-25 | 2021-03-16 | Baylor University | System and method for a six-primary wide gamut color system |
-
2021
- 2021-04-23 MX MX2022013610A patent/MX2022013610A/en unknown
- 2021-04-23 CN CN202180040475.1A patent/CN115943455A/en active Pending
- 2021-04-23 CA CA3181332A patent/CA3181332A1/en active Pending
- 2021-04-23 JP JP2022565933A patent/JP2023524012A/en active Pending
- 2021-04-23 AU AU2021265750A patent/AU2021265750A1/en active Pending
- 2021-04-23 EP EP21795330.6A patent/EP4143815A4/en active Pending
- 2021-04-23 WO PCT/US2021/028857 patent/WO2021222022A1/en unknown
- 2021-04-23 KR KR1020227041298A patent/KR20230003053A/en unknown
Also Published As
Publication number | Publication date |
---|---|
EP4143815A4 (en) | 2024-05-22 |
JP2023524012A (en) | 2023-06-08 |
AU2021265750A1 (en) | 2022-11-24 |
MX2022013610A (en) | 2023-02-02 |
WO2021222022A1 (en) | 2021-11-04 |
CN115943455A (en) | 2023-04-07 |
EP4143815A1 (en) | 2023-03-08 |
KR20230003053A (en) | 2023-01-05 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11651717B2 (en) | System and method for a multi-primary wide gamut color system | |
US11189214B2 (en) | System and method for a multi-primary wide gamut color system | |
US11315466B2 (en) | System and method for a multi-primary wide gamut color system | |
US11955044B2 (en) | System and method for a multi-primary wide gamut color system | |
US11893924B2 (en) | System and method for a multi-primary wide gamut color system | |
US11682333B2 (en) | System and method for a multi-primary wide gamut color system | |
US11694592B2 (en) | System and method for a multi-primary wide gamut color system | |
US11289003B2 (en) | System and method for a multi-primary wide gamut color system | |
US11373575B2 (en) | System and method for a multi-primary wide gamut color system | |
CA3181332A1 (en) | System and method for a multi-primary wide gamut color system |