US 12,299,213 B2
Activating a handheld device with universal pointing and interacting device
Eyal Shlomot, Long Beach, CA (US)
Filed by Eyal Shlomot, Long Beach, CA (US)
Filed on Jun. 19, 2023, as Appl. No. 18/211,313.
Application 18/211,313 is a continuation in part of application No. 17/524,769, filed on Nov. 12, 2021, abandoned.
Prior Publication US 2023/0384871 A1, Nov. 30, 2023
This patent is subject to a terminal disclaimer.
Int. Cl. G06F 3/03 (2006.01); G06F 3/0346 (2013.01); G06F 3/038 (2013.01); G06T 7/70 (2017.01); G06F 3/0354 (2013.01)
CPC G06F 3/0346 (2013.01) [G06F 3/0304 (2013.01); G06F 3/038 (2013.01); G06T 7/70 (2017.01); G06F 3/03545 (2013.01)] 19 Claims
OG exemplary drawing
 
1. A method of activating a screen of a handheld device by a universal pointing and interacting (UPI) device, the method comprises:
capturing at least one image by a camera of the UPI device positioned at a tip of the UPI device facing a frontal direction of a main axis of the UPI device, wherein the tip of the UPI device is a frontal end of the longest dimension of an elongated body of the UPI device and the main axis is the axis of the longest dimension of the elongated body of the UPI device;
processing by a computation component of the UPI device the at least one captured image to generate a frontal visual representation for the UPI device;
transmitting by a communication component the generated frontal visual representation for the UPI device from the UPI device to the handheld device;
capturing at least one of a front-facing image by a front-facing camera of the handheld device and a back-facing image by a back-facing camera of the handheld device;
processing by the handheld device the at least one of the front-facing image and the back-facing image to generate at least one of a front-facing visual representation and a back-facing visual representation for the handheld device;
estimating relative spatial relations between the UPI device and the handheld device, wherein the estimating is based on the transmitted frontal visual representation for the UPI device and the at least one of the front-facing visual representation and the back-facing visual representation for the handheld device;
activating the screen of the handheld based on the estimated relative spatial relations between the UPI device and the handheld device and based on activating signals from the UPI device provided by at least one of an accelerometer of the UPI device, a magnetometer of the UPI device, the camera of the UPI device, a gyroscope of the UPI device, a tactile sensor of the UPI device, a microphone of the UPI device and a fingerprint detection sensor of the UPI device.