US 11,677,928 B1
Method for image processing of image data for varying image quality levels on a two-dimensional display wall
Kimball D. Thurston, III, Wellington (NZ); Peter M. Hillman, Wellington (NZ); Joseph W. Marks, Boston, MA (US); Luca Fascione, Wellington (NZ); Millicent Lillian Maier, Wellington (NZ); Kenneth Gimpelson, Wellington (NZ); Dejan Momcilovic, Wellington (NZ); and Keith F. Miller, Wellington (NZ)
Assigned to Unity Technologies SF, San Francisco, CA (US)
Filed by Unity Technologies SF, San Francisco, CA (US)
Filed on Dec. 10, 2021, as Appl. No. 17/548,120.
Claims priority of provisional application 63/288,108, filed on Dec. 10, 2021.
Int. Cl. H04N 13/133 (2018.01); H04N 13/15 (2018.01); H04N 13/293 (2018.01); H04N 13/178 (2018.01); H04N 13/239 (2018.01); H04N 13/363 (2018.01); H04N 13/271 (2018.01); H04N 13/00 (2018.01)
CPC H04N 13/293 (2018.05) [H04N 13/178 (2018.05); H04N 13/239 (2018.05); H04N 13/271 (2018.05); H04N 13/363 (2018.05); H04N 2013/0081 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A computer-implemented method for processing, in an image processing system, a captured scene captured of a live action scene while a display wall is positioned to be part of the live action scene, wherein the display wall comprises one or more structures capable of displaying imagery, the method comprising:
receiving image data of the live action scene having a stage element and the display wall displaying a first rendering of a precursor image, wherein the image data is captured by at least one camera in at least one placement relative to the stage element and the display wall;
determining precursor metadata for the precursor image displayed on the display wall and display wall metadata for the display wall, wherein the precursor metadata comprises pixel display data for display wall pixels of the display wall, and wherein the display wall metadata comprises geometry data for a display wall position relative to the at least one camera;
accessing an image matte for the image data, wherein the image matte indicates a first portion associated with the stage element and a second portion associated with the precursor image on the display wall in the live action scene;
determining, using the image matte, a plurality of image quality levels for display wall portions of the display wall in the image data, wherein the display wall portions include one or more hidden portions that are hidden by at least one of the stage element or an additional stage element in the image data and one or more visible portions that are visible in the image data; and
adjusting one of the display wall pixels or background pixels for the display wall in the image data to the plurality of image quality levels using the display wall portions during one of capture of the live action scene or after capture of the image data, wherein adjusting the image data changes the one of the display wall pixels or the background pixels to the plurality of image quality levels.