US 12,357,046 B2
Smart article visual communication based on facial movement
Nicholas James Witchey, Laguna Hills, CA (US); and Patrick Soon-Shiong, Los Angeles, CA (US)
Filed by NantWorks, LLC, Culver City, CA (US)
Filed on Mar. 8, 2024, as Appl. No. 18/599,796.
Application 18/599,796 is a continuation of application No. 18/234,698, filed on Aug. 16, 2023, granted, now 11,974,619.
Application 18/234,698 is a continuation of application No. 17/892,256, filed on Aug. 22, 2022, granted, now 11,864,606, issued on Jan. 9, 2024.
Application 17/892,256 is a continuation of application No. 17/481,723, filed on Sep. 22, 2021, granted, now 11,457,680, issued on Oct. 4, 2022.
Application 17/481,723 is a continuation of application No. 16/990,781, filed on Aug. 11, 2020, granted, now 11,160,319, issued on Nov. 2, 2021.
Prior Publication US 2024/0251894 A1, Aug. 1, 2024
Int. Cl. A41D 27/08 (2006.01); A41D 1/00 (2018.01); A41D 13/11 (2006.01); A41D 31/30 (2019.01); A61B 5/00 (2006.01); A62B 23/02 (2006.01); G06F 1/16 (2006.01); G06F 3/01 (2006.01); G09G 3/00 (2006.01); G10L 15/08 (2006.01)
CPC A41D 27/085 (2013.01) [A41D 1/002 (2013.01); A41D 13/1192 (2013.01); A41D 31/305 (2019.02); A61B 5/6803 (2013.01); A62B 23/025 (2013.01); G06F 1/163 (2013.01); G06F 3/011 (2013.01); G09G 3/035 (2020.08); G09G 2300/026 (2013.01); G09G 2380/02 (2013.01); G09G 2380/08 (2013.01); G10L 15/08 (2013.01)] 16 Claims
OG exemplary drawing
 
1. A smart mask display system comprising:
a mask comprising at least one display that covers at least a portion of a face;
at least one sensor;
at least one computer readable non-transitory memory storing software instructions, at least one mapping function and renderable data files indexed according to sensor signatures; and
at least one processor coupled with the at least one computer readable non-transitory memory, the at least one sensor, and the at least one display, and that performs the following operations upon execution of the software instructions:
receiving a digital sensor signal from the at least one sensor, wherein the digital sensor signal comprises at least two sensor data modalities, and the at least two sensor data modalities include two of audio data, image data, accelerometer data, thermal data, stress data, strain data, pressure data, and location data;
generating at least one sensor signature from the digital sensor signal, including differentiating between two similar signatures based on the at least two sensor data modalities;
mapping the at least one sensor signature via the mapping function to at least one renderable data file, wherein the mapping function includes a k-nearest neighbors (kNN) algorithm trained to differentiate between two similar signatures to identify a corresponding set of images, and the at least one renderable data file is included in the corresponding set of images; and
rendering the at least one renderable data file on the display.