US 12,315,513 B2
Dynamic service level assignment system for data processing manager
Tim Stonehocker, Sunnyvale, CA (US); Zizo Gowayyed, San Francisco, CA (US); Seyed Majid Emami, Cupertino, CA (US); Matthias Eichstaedt, San Jose, CA (US); Evelyn Jiang, Cupertino, CA (US); Ryan Berryhill, Toronto (CA); Mathieu Ramona, Cachan (FR); and Neil Veira, Toronto (CA)
Filed by SOUNDHOUND AI IP, LLC, Santa Clara, CA (US)
Filed on Apr. 17, 2024, as Appl. No. 18/637,771.
Application 18/637,771 is a continuation of application No. 17/447,823, filed on Sep. 16, 2021, granted, now 11,978,454.
Prior Publication US 2024/0296844 A1, Sep. 5, 2024
Int. Cl. G10L 15/30 (2013.01); G10L 15/16 (2006.01); G10L 15/26 (2006.01)
CPC G10L 15/30 (2013.01) [G10L 15/16 (2013.01); G10L 15/26 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A system for managing processing of data, the system comprising:
a queue manager configured to receive a request to process data using a service, add the request to a queue of incoming requests, and determine a queue depth representing a number of requests in the queue at a given time; and
a load supervisor configured to receive the request and the queue depth from the queue manager at a time that the request is at a head of the queue and assign a service level for the request based on the queue depth at the time that the request is at the head of the queue;
wherein the service has a first service level and a second service level that uses less computing resource than the first service level.