US 12,074,781 B2
Automated testing of a data service
Henrik Kotkas, Tallinn (EE); Hannes Rootsi, Tallinn (EE); Riivo Kikas, Tartu (EE); and Holger Biene, Elva (EE)
Assigned to Twilio Inc., San Francisco, CA (US)
Filed by Twilio Inc., San Francisco, CA (US)
Filed on Jul. 14, 2022, as Appl. No. 17/865,352.
Prior Publication US 2024/0022495 A1, Jan. 18, 2024
Int. Cl. H04L 43/55 (2022.01); H04L 43/106 (2022.01); H04L 45/302 (2022.01)
CPC H04L 43/55 (2022.05) [H04L 43/106 (2013.01); H04L 45/3065 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
selecting, by one or more processors, a candidate communication service to be tested for service quality;
performing, by the one or more processors, a first-phase test of the candidate communication service by providing predetermined input data to the candidate communication service and measuring a first quality metric resultant from the candidate communication service processing the predetermined input data;
determining, by the one or more processors, that the candidate communication service is to undergo a second-phase test based on the first quality metric resultant from the candidate communication service processing the predetermined input data;
performing, by the one or more processors, the second-phase test of the candidate communication service, the second-phase test including:
adding the candidate communication service to a pool of live communication services processing undetermined input data;
routing a portion of the undetermined input data to the candidate communication service; and
measuring a second quality metric resultant from the candidate communication service processing the routed portion of the undetermined input data processed by the pool of live communication services; and
based on the second quality metric, determining, by the one or more processors, whether the candidate communication service is to remain in the pool.