That could be Bayesian optimization, bandit optimization (another classic optimization strategy) or another algorithm. Indeed, it’s worth noting that Ax is framework-agnostic.

This article presents a sequential Monte Carlo (SMC) algorithm that can be used for any one-at-a-time Bayesian sequential design problem in the presence of model uncertainty where discrete data are ...