US 12,444,187 B2
Radar and colocated camera systems and methods
Paul Stokes, Fleet (GB); Richard James Jales, Eastleigh (GB); Adam Murphy, Manchester, NH (US); Mark Johnson, Vannes (GB); Mark C. Rivers, Winchester (GB); Peter A. A. Stewart, Winchester (GB); Paul S. Chittendon, Portsmouth (GB); and Thomas Bonfield, Fareham (GB)
Assigned to Raymarine UK Limited, Fareham (GB)
Filed by Raymarine UK Limited, Fareham (GB)
Filed on Feb. 23, 2023, as Appl. No. 18/173,695.
Application 18/173,695 is a continuation of application No. PCT/US2021/048565, filed on Aug. 31, 2021.
Application 18/173,695 is a continuation of application No. 17/783,998, previously published as PCT/US2020/064388, filed on Dec. 10, 2020.
Application 18/173,695 is a continuation of application No. 17/025,864, filed on Sep. 18, 2020, granted, now 12,066,519.
Application PCT/US2021/048565 is a continuation of application No. PCT/US2019/027101, filed on Apr. 11, 2019.
Claims priority of provisional application 63/072,916, filed on Aug. 31, 2020.
Claims priority of provisional application 62/947,422, filed on Dec. 12, 2019.
Claims priority of provisional application 62/656,874, filed on Apr. 12, 2018.
Prior Publication US 2023/0215164 A1, Jul. 6, 2023
Int. Cl. G06V 20/00 (2022.01); G06T 3/40 (2024.01); G06V 10/44 (2022.01); G06V 10/82 (2022.01); G06V 20/05 (2022.01); G06V 20/40 (2022.01)
CPC G06V 20/00 (2022.01) [G06T 3/40 (2013.01); G06V 10/454 (2022.01); G06V 10/82 (2022.01); G06V 20/05 (2022.01); G06V 20/41 (2022.01)] 19 Claims
OG exemplary drawing
 
1. A system comprising:
a radar assembly configured to be mounted to a mobile structure, wherein the radar assembly comprises;
a radar antenna; and
an imaging system comprising at least one camera and coupled to rotate with the radar antenna and configured to provide first image data associated with the radar assembly; and
a logic device and a display configured to communicate with the logic device, wherein the logic device is configured to communicate with the radar assembly, wherein the logic device is configured to:
receive radar returns corresponding to a detected target from the radar assembly and the first image data corresponding to the radar returns from the imaging system;
generate radar image data based, at least in part, on the radar returns and the first image data corresponding to the radar returns; and
render the radar image data using the display, wherein the rendered radar image data is referenced to an absolute coordinate frame and/or a coordinate frame of the mobile structure;
wherein at least a first camera of the imaging system is coupled to rotate with the radar antenna about a rotational axis to capture images from different positions on a circumference of a first circle about the rotational axis, wherein at least two successive images captured from different positions overlap to provide a mechanism for generating a 3D representation of a surrounding environment by using the first camera as a single camera producing 360° scans of the surrounding environment.