US 12,125,593 B2
Systems and methods for fusing EEG and fMRI through hierarchical deep transcoding
Paul Sajda, New York, NY (US); and Xueqing Liu, New York, NY (US)
Assigned to The Trustees of Columbia University in the City of New York, New York, NY (US)
Filed by THE TRUSTEES OF COLUMBIA UNIVERSITY IN THE CITY OF NEW YORK, New York, NY (US)
Filed on Oct. 5, 2021, as Appl. No. 17/494,562.
Claims priority of provisional application 63/087,806, filed on Oct. 5, 2020.
Prior Publication US 2022/0215955 A1, Jul. 7, 2022
Int. Cl. G16H 50/20 (2018.01); G06T 7/00 (2017.01); G06T 9/00 (2006.01)
CPC G16H 50/20 (2018.01) [G06T 7/0012 (2013.01); G06T 9/002 (2013.01); G06T 2207/10088 (2013.01)] 18 Claims
OG exemplary drawing
 
1. A system for hierarchical deep transcoding, comprising:
a processor configured to
receive a functional magnetic resonance imaging (fMRI) data and/or an extracranial electroencephalogram (EEG) data, wherein the fMRI data and the EEG data are simultaneously acquired; and
reconstruct a latent source space from the fMRI data and/or the EEG data by decoding the EEG data and/or the fMRI data to the latent source space, wherein the processor is configured to transcode the EEG data to an fMRI signal or the fMRI data to an EEG signal.