US 12,329,515 B2
Deriving insights into motion of an object through computer vision
Paul Anthony Kruszewski, Westmount (CA); Wenxin Zhang, Verdun (CA); Robert Lacroix, Saint-Lambert (CA); and Ryan Russell, Bellevue, WA (US)
Assigned to Hinge Health, Inc., San Francisco, CA (US)
Filed by Hinge Health, Inc., San Francisco, CA (US)
Filed on Nov. 5, 2021, as Appl. No. 17/520,440.
Claims priority of provisional application 63/110,660, filed on Nov. 6, 2020.
Prior Publication US 2022/0142514 A1, May 12, 2022
Int. Cl. A61B 5/11 (2006.01); G06T 7/20 (2017.01); G06T 7/70 (2017.01); G06V 40/20 (2022.01)
CPC A61B 5/1128 (2013.01) [A61B 5/112 (2013.01); G06T 7/20 (2013.01); G06T 7/70 (2017.01); G06V 40/23 (2022.01); G06T 2207/20084 (2013.01); G06T 2207/30196 (2013.01)] 32 Claims
OG exemplary drawing
 
1. An apparatus for generating computer vision data, the apparatus comprising:
a camera configured to generate digital images of an environment in which an individual is situated over an interval of time;
a processor configured to:
generate computer vision data via an analysis of the digital images with a neural network,
wherein the neural network outputs, for each of the digital images, a pose of the individual so as to establish serialized poses of the individual over the interval of time, and
encode the computer vision data into a portable data structure; and
a communication module configured to communicate the digital images and the portable data structure to a second apparatus with a graphics processing unit, at which the digital images are stored and the portable data structure is decoded for analysis of the computer vision data and determination of a health status of the individual.
 
10. A method for determining, with a first computing device with a graphics processing unit, a health status of an individual through analysis of computer vision data generated by a second computing device with a central processing unit, the method comprising:
acquiring, by the second computing device, a series of digital images generated by a camera in rapid succession of an environment in which an individual is situated;
applying, by the second computing device, a model to the series of digital images to produce a series of outputs,
wherein each output in the series of outputs is representative of information regarding a spatial position of the individual as determined through analysis of a corresponding digital image of the series of digital images, and
wherein the series of outputs are collectively representative of computer vision data;
populating, by the second computing device, the series of outputs into a data structure that is transmitted to the first computing device;
assessing, by the first computing device based on the computer vision data in the data structure, health of the individual in real time; and
performing, by the first computing device, an action based on the health of the individual.
 
25. A system for assessing health of an individual, the system comprising:
a plurality of imaging apparatuses that are deployed in an environment in which an individual is situated,
wherein each imaging apparatus comprises:
an image sensor configured to produce digital images of the individual over an interval of time,
a central processing unit configured to:
generate a dataset that is representative of information related to the individual that is learned through analysis of the digital images, and
populate the dataset into a data structure, and
a communications interface via which the data structure exits the imaging apparatus; and
a processing apparatus that comprises:
a decoder,
a communications interface at which to receive a plurality of data structures from the plurality of imaging apparatuses, and
a graphics processing unit configured to:
provide the plurality of data structures to the decoder, so as to obtain a plurality of datasets, each of which corresponds to a different one of the plurality of data structures, and
assess health of the individual by examining the plurality of datasets that are output by the decoder for the plurality of data structures.