| CPC H04N 25/47 (2023.01) [H04N 25/79 (2023.01)] | 14 Claims |
|
1. An integrated circuit for event sensing and processing, comprising: an event-driven sensor, an event-driven interface system and an event-driven processor, wherein:
the event-driven sensor, the event-driven interface system and the event-driven processor are coupled to a single chip;
the event-driven processor comprises a spiking neural network;
the event-driven interface system comprises at least one interface module, the interface module constitutes a programmable daisy chain and asynchronously processes the event received from the event-driven sensor;
the event-driven sensor is configured to: after an input device of the event-driven sensor detects an event generation signal and/or a change of the event generation signal, asynchronously generate and output an event, wherein the event comprises an event address that is either correlated to or identical with the event address of the input device, an output end of the event-driven sensor is coupled to an input end of the event-driven interface system;
the event-driven interface system is configured to: asynchronously receive the event and preprocess the received event, an output end of the event-driven interface system is coupled to an input end of the event-driven processor;
the event-driven processor is configured to: receive the preprocessed event from the event-driven interface system and asynchronously process the preprocessed event; and
the event-driven sensor, the event-driven interface system and the event-driven processor are coupled to the single chip through an interposer;
the interface module comprises one or more the following modules: copy module, merge module, sub-sampling module, ROI module and event routing module wherein:
the copy module is configured to: receive the events, perform a copy operation to obtain copied events and transfer the copied events to an external processing pipeline and transfer the events through the programmable daisy chain wherein the events are from the event-driven sensor or another interface module of the event-driven interface system;
the merge module is configured to receive events from two different sources at least, and transfer a part or all of the events to the downstream interface module through the programmable daisy chain, wherein the events are from the event-driven sensor or another interface module of the event-driven interface system and the events are also from the integrated circuit, a part/module from another integrated circuit or another event-driven sensor;
the sub-sampling module is configured to assign a single address to its received events;
the region of interest (ROI) module is configured to adjust a property of at least one event address and/or to discard events having properties outside of a range of programmable event address properties and transfer the non-discarded events through the programmable daisy chain, wherein the ROI module adjusts the event address by one or combination of shifting, flipping, swapping and/or rotating the property of the at least one event address;
the event routing module is configured to receive events, add header information to the received events, and output the events along with the header information to the event-driven processor and/or another event-driven processor or another processing pipeline;
the sub-sampling module comprises a division module, configured to route the event to a correlated scaling register of sub-sampling module according to the address of the received event; the scaling register is configured to divide, sub-sample, pool, and/or shift the received address and output the address to a address reassemble module of the sub-sampling module; wherein the address reassemble module is configured to adjust the event address according to a scaled address and forward the event with the adjusted address through the programmable daisy chain.
|