[FEATURE REQUEST]: Expand model space for unordered ChoiceParameters #5215

Motivation

Similar to the resolved issue #5209 / #5210, it would be wonderful to include completed trials (recorded data points) with unordered/categorical ChoiceParameters outside the declared values list.

In fact, Ax actually implies that such trials are being included by the output RuntimeWarning: Parameterization {'x1': 123, 'x2': 'abc'} is in out-of-design. Ax will still attach the trial for use in candidate generation. But it doesn't, and this leads to a DataRequiredError when calling client.get_next_trials() later.

Such implementation was shortly addressed in #5209 and #5210.

Describe the solution you'd like to see implemented in Ax.

Use completed trials (recorded data points) with unordered/categorical ChoiceParameters outside the declared values list for candidate generation.

Describe any alternatives you've considered to the above solution.

No response

Is this related to an existing issue in Ax or another repository? If so please include links to those Issues here.

#5209, #5210

Code of Conduct

• I agree to follow Ax's Code of Conduct