US 12,332,117 B2
Method and system for joint demosaicking and spectral signature estimation
Tom Vercauteren, London (GB); Michael Ebner, London (GB); Yijing Xie, London (GB); and Eli Nabavi, London (GB)
Assigned to Hypervision Surgical Limited, London (GB)
Appl. No. 18/008,062
Filed by Hypervision Surgical Limited, London (GB)
PCT Filed May 26, 2021, PCT No. PCT/GB2021/051280
§ 371(c)(1), (2) Date Dec. 2, 2022,
PCT Pub. No. WO2021/245374, PCT Pub. Date Dec. 9, 2021.
Claims priority of application No. 2008371 (GB), filed on Jun. 3, 2020; and application No. 2102400 (GB), filed on Feb. 19, 2021.
Prior Publication US 2023/0239583 A1, Jul. 27, 2023
Int. Cl. G01J 3/28 (2006.01); A61B 1/00 (2006.01); G06V 10/58 (2022.01); H04N 9/73 (2023.01); H04N 23/50 (2023.01); H04N 23/84 (2023.01)
CPC G01J 3/2823 (2013.01) [A61B 1/000094 (2022.02); A61B 1/000096 (2022.02); G06V 10/58 (2022.01); H04N 9/73 (2013.01); H04N 23/555 (2023.01); H04N 23/843 (2023.01)] 12 Claims
OG exemplary drawing
 
1. A method of determining parameters of a desired target image from hyperspectral imagery obtained from a surgical procedure, comprising:
capturing in real time hyperspectral snapshot mosaic images of a scene from the surgical procedure using a hyperspectral image sensor coupled to an optical scope, the snapshot mosaic images being of relatively low spatial and low spectral resolution;
undertaking spatio-spectrally aware demosaicking of the snapshot mosaic images, the demosaicking comprising an algorithm to optimise for a cost function accounting for spatial crosstalk across neighbouring pixels corresponding to different spectral bands in the snapshot mosaic image, upsampling of the snapshot mosaic images, and the application of a spectral calibration operator, to generate a virtual hypercube of the snapshot mosaic image data, the virtual hypercube comprising image data of relatively high spatial resolution compared to the snapshot mosaic images;
from the image data in the virtual hypercube, determining relatively high spatial resolution parameters of a desired target image; and
outputting in real time the determined relatively high-resolution parameters as representative of the desired target image.