Parallel Predictive Entropy Search for Batch Global Optimization of Expensive Objective Functions

• DOI: 10.48550/arxiv.1511.07130
• Publication Date: 2015-01-01
• Authors: Shah, Amar; Ghahramani, Zoubin
• Keywords: FOS: Computer and information sciences; Computer Science - Machine Learning; Statistics - Machine Learning; Machine Learning (stat.ML); 0101 mathematics; 01 natural sciences; Machine Learning (cs.LG)

12 pages in Neural Information Processing Systems 2015<br/>We develop parallel predictive entropy search (PPES), a novel algorithm for Bayesian optimization of expensive black-box objective functions. At each iteration, PPES aims to select a batch of points which will maximize the information gain about the global maximizer of the objective. Well known strategies exist for suggesting a single evaluation point based on previous observations, while far fewer are known for selecting batches of points to evaluate in parallel. The few batch selection schemes that have been studied all resort to greedy methods to compute an optimal batch. To the best of our knowledge, PPES is the first non-greedy batch Bayesian optimization strategy. We demonstrate the benefit of this approach in optimization performance on both synthetic and real world applications, including problems in machine learning, rocket science and robotics.<br/>