US 12,033,261 B2
Contact-aware retargeting of motion
Ruben Villegas, Ann Arbor, MI (US); Jun Saito, Seattle, WA (US); Jimei Yang, Mountain View, CA (US); Duygu Ceylan Aksit, London (GB); and Aaron Hertzmann, San Francisco, CA (US)
Assigned to ADOBE INC., San Jose, CA (US)
Filed by Adobe Inc., San Jose, CA (US)
Filed on Jul. 26, 2021, as Appl. No. 17/385,559.
Prior Publication US 2023/0037339 A1, Feb. 9, 2023
Int. Cl. G06T 13/40 (2011.01); G06N 3/04 (2023.01); G06N 20/00 (2019.01); G06T 7/215 (2017.01); G06T 9/00 (2006.01); G06V 40/10 (2022.01)
CPC G06T 13/40 (2013.01) [G06N 3/04 (2013.01); G06N 20/00 (2019.01); G06T 7/215 (2017.01); G06T 9/00 (2013.01); G06V 40/103 (2022.01)] 20 Claims
OG exemplary drawing
 
1. A method performed by one or more computing devices, the method comprising:
receiving source motion for a source object over a time period, the source object characterized by a source object skeleton and a source object geometry, wherein the source object geometry includes multiple source skin vertices, wherein the source motion for the source object comprises a motion of the source object skeleton and a motion of the multiple source skin vertices included in the source object geometry over the time period, and wherein the source motion includes, at a first time frame in the time period, a contact between a first source vertex and a second source vertex of the multiple source skin vertices included in the source object geometry; and
retargeting, via a trained machine-learning model, the source motion to a target object, the target object characterized by a target object skeleton and a target object geometry, wherein the target object geometry is different from the source object geometry, wherein the target object geometry includes multiple target skin vertices that are different from the multiple source skin vertices included in the source object geometry,
wherein the retargeting includes:
calculating an energy function that includes a) a first constraint for preserving a contact between a first target vertex and a second target vertex of the target object geometry in a target motion based upon the contact between the first source vertex and the second source vertex of the source object geometry, and b) a second constraint for reducing self-penetration between the first target vertex and the second target vertex of the target object geometry in the target motion, and
causing, via the retargeting, the target object to have the target motion over the time period that is based upon the source motion, wherein the target motion describes that, at the first time frame in the time period, the first target vertex and the second target vertex of the multiple target skin vertices included in the target object geometry are in contact without any self-penetration of the target object geometry at the first target vertex and the second target vertex.