| CPC A61B 34/10 (2016.02) [A61B 5/0077 (2013.01); A61B 5/064 (2013.01); A61B 5/1079 (2013.01); A61B 5/1127 (2013.01); A61B 5/4504 (2013.01); A61B 5/4887 (2013.01); A61B 5/7425 (2013.01); A61B 34/20 (2016.02); A61B 90/361 (2016.02); G06T 19/006 (2013.01); G16H 50/50 (2018.01); A61B 5/11 (2013.01); A61B 5/743 (2013.01); A61B 2034/105 (2016.02); A61B 2034/107 (2016.02); A61B 2034/108 (2016.02); A61B 2034/2055 (2016.02); A61B 2034/2065 (2016.02); A61B 2034/252 (2016.02); A61B 2090/3983 (2016.02); A61B 2505/05 (2013.01); A61B 2576/00 (2013.01); G06T 2210/41 (2013.01)] | 19 Claims |

|
1. A system comprising:
a measurement device to (i) capture a live image of a bone of a limb of a patient in order to track one or more reference points positioned on one or more bones or an anatomy of the patient, and (ii) to collect information of a surgical device to track one or more reference points positioned on a surgical device;
one or more processors; and
data storage including instructions executable by the one or more processors for performing functions comprising:
tracking movement of the bone in physical space based on the tracked reference points positioned on the one or more of the bone or the anatomy of the patient;
tracking movement of the surgical device in physical space based on the tracked reference points positioned on the surgical device, wherein the surgical device has a known cutting plane associated with the surgical device; and
providing for display a virtual image overlaid onto the live image of the bone at a position onto the live image of the bone based on the movement of the surgical device in physical space, wherein the virtual image includes a display of a virtual cutting plane produced in reference to the surgical device as the surgical device moves in reference to the bone and includes information from the measurement device based on the live image of the bone of the limb of the patient indicating one or more of a lateral gap of a knee of the patient, a medial gap of the knee of the patient, an alignment of the knee of the patient, a flexion of a femoral cut, and a slope of a tibial cut.
|