US 12,066,579 B2
Real-time monitoring of surroundings of marine vessel
Santeri Vanhakartano, Helsinki (FI); Kalevi Tervo, Helsinki (FI); Eero Lehtovaara, Helsinki (FI); Antti Pehkonen, Tampere (FI); and Jari Saarinen, Espoo (FI)
Assigned to ABB Schweiz AG, Baden (CH)
Filed by ABB Schweiz AG, Baden (CH)
Filed on May 18, 2020, as Appl. No. 16/876,247.
Application 16/876,247 is a continuation of application No. PCT/EP2017/079573, filed on Nov. 17, 2017.
Prior Publication US 2020/0278433 A1, Sep. 3, 2020
Int. Cl. G01S 7/62 (2006.01); G01S 7/06 (2006.01); G01S 7/51 (2006.01); G01S 13/91 (2006.01); G01S 13/937 (2020.01); G01S 15/93 (2020.01); G01S 17/93 (2020.01); G06F 3/04815 (2022.01)
CPC G01S 7/6281 (2013.01) [G01S 7/062 (2013.01); G01S 7/51 (2013.01); G01S 7/6263 (2013.01); G01S 13/917 (2019.05); G01S 13/937 (2020.01); G01S 15/93 (2013.01); G01S 17/93 (2013.01); G06F 3/04815 (2013.01)] 22 Claims
OG exemplary drawing
 
1. A system for real-time monitoring of surroundings of a marine vessel, comprising:
one or more digital sensors and one or more object detection sensors of one or more observation sensors sensor modules configured and positioned to generate sensor data extending around the marine vessel, wherein the object detection sensors comprise one or more of a radar system, a lidar system, a sonar system, an ultrasound detection system, or an acoustic system;
one or more data processors, communicatively coupled with the one or more observation sensors sensor modules, wherein the one or more data processors are configured to:
detect one or more objects in the surroundings of the marine vessel based on analyzing the sensor data,
combine data from different sensors, and
map and visualize the detected one or more objects in relation to a virtual model of the marine vessel that is in scale and perspective of a view in real time, wherein the scale of the virtual model is a 1:1 scale, while receiving selection and viewing angle data input through a user interface from a mariner;
a transceiver, communicatively coupled with the one or more data processors, and configured to transmit the analyzed sensor data to a second marine vessel; and
the user interface, communicatively coupled with the one or more data processors, and configured to display the virtual model together with the visualized sensor data, and the detected one or more objects from at least two user selectable point of views to a mariner of the marine vessel using a split-screen technique.