| CPC G06F 11/3608 (2013.01) | 20 Claims |

|
1. A system comprising:
one or more processors coupled with memory configured to:
provide, to a client device, one or more first data structures for a first stage of a test problem comprising a plurality of stages, the one or more first data structures comprising:
i) a description for generation of a client solution for the first stage at the client device and
ii) one or more test cases to evaluate the client solution for the first stage;
receive, from the client device, a client data structure comprising the client solution including a client computer code generated at the client device for the first stage;
determine, by evaluating the client solution using at least one input value and at least one output value of the one or more test cases, that the output of the client solution satisfies a validity condition corresponding to the at least one output value of the at least one or more test cases for the first stage; and
provide, to the client device, based on determining that the client solution satisfies the validity condition, one or more second data structures for a second stage of the test problem.
|