| CPC B60W 40/09 (2013.01) [G06V 20/597 (2022.01); B60W 2420/403 (2013.01); B60W 2540/225 (2020.02); B60W 2540/229 (2020.02)] | 15 Claims |

|
1. A system for sensing and control of a vehicle, comprising:
one or more first sensors configured to sense an interior of the vehicle, wherein the one or more first sensors are configured to generate first sensor data based on sensing the interior of the vehicle;
one or more second sensors configured to sense an exterior of the vehicle, wherein the one or more second sensors are configured to generate second sensor data based on sensing the exterior of the vehicle;
a computing device, wherein the computing device is configured to detect a user indication of interest, wherein the computing device is configured to detect the user indication of interest based at least in part on a result of providing the first sensor data as input to an artificial neural network, wherein the computing device is configured to determine an item of interest based at least in part on the detected user indication of interest and the second sensor data;
a vehicle controller, wherein the vehicle controller is configured to receive information about the item of interest, wherein the vehicle controller is configured to control operation of the vehicle based on the information about the item of interest,
wherein the user indication of interest is a gesture,
wherein the computing device is configured to determine the item of interest based at least in part on calculation of a pointing vector,
wherein the computing device is configured to calculate the pointing vector based at least in part on the first sensor data,
wherein the computing device is configured to calculate the pointing vector based at least in part on a plurality of landmarks in the first sensor data, and
wherein the computing device is configured to calculate the pointing vector based at least in part on calculating a best-fit vector for the plurality of landmarks.
|