US 12,147,595 B2
Information processing system
Kenta Maruyama, Tokyo (JP); Junichiro Onaka, Tokyo (JP); Junya Obara, Tokyo (JP); and Yusuke Ishida, Tokyo (JP)
Assigned to HONDA MOTOR CO., LTD., Tokyo (JP)
Filed by HONDA MOTOR CO., LTD., Tokyo (JP)
Filed on Sep. 11, 2023, as Appl. No. 18/244,382.
Claims priority of application No. 2022-144359 (JP), filed on Sep. 12, 2022.
Prior Publication US 2024/0085976 A1, Mar. 14, 2024
Int. Cl. G06F 3/01 (2006.01); G06T 3/40 (2024.01); G06V 20/59 (2022.01); G06V 40/20 (2022.01)
CPC G06F 3/012 (2013.01) [G06F 3/017 (2013.01); G06T 3/40 (2013.01); G06V 20/59 (2022.01); G06V 40/28 (2022.01)] 10 Claims
OG exemplary drawing
 
1. An information processing system comprising:
a first device that is mounted in a mobile object which an occupant boards; and
a second device that is used by a user who is not the occupant at a place located outside of the mobile object and different from the mobile object,
wherein the first device includes:
a first communication device configured to communicate with a second communication device of the second device; and
a camera unit including one or more cameras including at least an inside camera that is provided on a predetermined seat of the mobile object and images an inside of the mobile object from a viewpoint of the predetermined seat,
wherein the second device includes:
the second communication device configured to communicate with the first communication device;
a detection device configured to detect an orientation direction of the user based on a face or sightline direction of the user, and detect a gesture of the user based on motions of feature points of the user; and
a display device configured to display an image corresponding to the orientation direction from the viewpoint of the predetermined seat out of images captured by the camera unit,
wherein the second device determines, within the image, an operation unit of the mobile object corresponding to the detected orientation direction and operation details on the operation unit corresponding to the detected gesture, and
wherein the second communication device transmits the determined operation details on the operation unit to the first communication device such that the operation unit is remotely operated by the user located outside of the mobile object according to the determined operation details.