	US 12,219,254 B2
	Method, apparatus and system to combine frame image and event data
Daniele Perrone, Noisy le Grand (FR); Thibault Leblanc, Paris (FR); and Sylvain Brohan, Le Perreux sur Marne (FR)
Assigned to Prophesee, Paris (FR)
Appl. No. 18/003,302
Filed by Prophesee, Paris (FR)
PCT Filed Jun. 23, 2021, PCT No. PCT/EP2021/067128 § 371(c)(1), (2) Date Dec. 23, 2022, PCT Pub. No. WO2021/259994, PCT Pub. Date Dec. 30, 2021.
Claims priority of application No. 20305687 (EP), filed on Jun. 23, 2020.
Prior Publication US 2023/0254579 A1, Aug. 10, 2023
Int. Cl. H04N 23/68 (2023.01); H04N 23/80 (2023.01); H04N 23/83 (2023.01)

CPC H04N 23/683 (2023.01) [H04N 23/815 (2023.01); H04N 23/83 (2023.01)]

17 Claims

1. An image enhancement method, comprising:

capturing a reference image frame of a scene, by a frame-based rolling shutter sensor including rows of sensor elements, wherein the reference image frame contains artifacts and has an exposure duration;

obtaining a stream of events, by an event-based sensor which is synchronized with the frame-based sensor, at least during the exposure duration, wherein the events encode brightness changes of the scene corresponding to the reference image; and

deriving a corrected image frame without the artifacts by processing each row of the reference image frame using the stream of events.