US 11,927,924 B2
Building system with user presentation composition based on building context
George R. Oliver, Milwaukee, WI (US); Justin J. Ploegert, Cudahy, WI (US); Karl F. Reichenberger, Mequon, WI (US); Sudhi R. Sinha, Milwaukee, WI (US); Sujith Ebenezer, Milwaukee, WI (US); and Youngchoon Park, Brookfield, WI (US)
Assigned to JOHNSON CONTROLS TECHNOLOGY COMPANY, Auburn Hills, MI (US)
Filed by Johnson Controls Technology Company, Auburn Hills, MI (US)
Filed on Feb. 22, 2023, as Appl. No. 18/112,650.
Application 18/112,650 is a continuation of application No. 17/549,741, filed on Dec. 13, 2021, granted, now 11,774,920.
Application 17/549,741 is a continuation of application No. 17/086,083, filed on Oct. 30, 2020, granted, now 11,226,598, issued on Jan. 18, 2022.
Application 17/086,083 is a continuation in part of application No. 16/688,819, filed on Nov. 19, 2019, granted, now 11,108,587, issued on Aug. 31, 2021.
Application 16/688,819 is a continuation of application No. 16/260,078, filed on Jan. 28, 2019, granted, now 10,505,756, issued on Dec. 10, 2019.
Application 16/260,078 is a continuation in part of application No. 16/048,052, filed on Jul. 27, 2018, granted, now 10,417,451, issued on Sep. 17, 2019.
Application 17/086,083 is a continuation in part of application No. 16/014,936, filed on Jun. 21, 2018, granted, now 11,226,597, issued on Jan. 18, 2022.
Application 16/014,936 is a continuation in part of application No. 16/008,885, filed on Jun. 14, 2018, granted, now 10,901,373, issued on Jan. 26, 2021.
Application 16/008,885 is a continuation in part of application No. 15/586,104, filed on May 3, 2017, granted, now 11,231,691, issued on Jan. 25, 2022.
Application 15/586,104 is a continuation of application No. 15/367,167, filed on Dec. 1, 2016, granted, now 9,817,383, issued on Nov. 14, 2017.
Claims priority of provisional application 62/951,892, filed on Dec. 20, 2019.
Claims priority of provisional application 62/929,610, filed on Nov. 1, 2019.
Claims priority of provisional application 62/611,974, filed on Dec. 29, 2017.
Claims priority of provisional application 62/611,984, filed on Dec. 29, 2017.
Claims priority of provisional application 62/564,247, filed on Sep. 27, 2017.
Claims priority of provisional application 62/523,211, filed on Jun. 21, 2017.
Claims priority of provisional application 62/520,380, filed on Jun. 15, 2017.
Claims priority of provisional application 62/360,935, filed on Jul. 11, 2016.
Claims priority of provisional application 62/331,888, filed on May 4, 2016.
Prior Publication US 2023/0324855 A1, Oct. 12, 2023
Int. Cl. G06F 16/245 (2019.01); G05B 13/02 (2006.01); G05B 13/04 (2006.01); G05B 15/02 (2006.01); G06F 16/903 (2019.01); H04L 12/28 (2006.01)
CPC G05B 13/0205 (2013.01) [G05B 13/0265 (2013.01); G05B 13/048 (2013.01); G05B 15/02 (2013.01); G06F 16/245 (2019.01); G06F 16/90335 (2019.01); H04L 12/2814 (2013.01); G05B 2219/2642 (2013.01)] 20 Claims
OG exemplary drawing
 
18. A method, comprising:
receiving, by one or more processing circuits, a string comprising unstructured data in a natural language from a user device of a user, the string representing a user question;
interpreting, by the one or more processing circuits, the user question by querying a digital twin with the string for a first context associated with the user question from contextual information of a building stored by the digital twin, wherein the digital twin stores the contextual information of the building through a plurality of entities and a plurality of relationships between the plurality of entities;
building, by the one or more processing circuits, a query data structure with a plurality of parameters, a first parameter of the plurality of parameters derived from the string and a second parameter of the plurality of parameters based on the first context;
querying, by the one or more processing circuits, the digital twin with the query data structure to extract a second context; and
composing, by the one or more processing circuits, a response comprising text in the natural language based on the second context.