Scalable Gaussian process structured prediction for grid factor graph applications

Bratieres, Sebastien, Quadrianto, Novi, Nowozin, Sebastian and Ghahramani, Zoubin (2014) Scalable Gaussian process structured prediction for grid factor graph applications. International Conference on Machine Learning (ICML), Beijing. Published in: Proceedings of the 32nd International Conference on Machine Learning; Beijing, China; 21 - 26 June 2014. 32 (2) 334-342. JMLR ISSN 1938-7228

PDF - Published Version
Available under License Creative Commons Attribution.

Download (867kB) | Preview
Official URL:


Structured prediction is an important and well studied problem with many applications across machine learning. GPstruct is a recently proposed structured prediction model that offers appealing properties such as being kernelised, non-parametric, and supporting Bayesian inference (Bratières et al. 2013). The model places a Gaussian process prior over energy functions which describe relationships between input variables and structured output variables. However, the memory demand of GPstruct is quadratic in the number of latent variables and training runtime scales cubically. This prevents GPstruct from being applied to problems involving grid factor graphs, which are prevalent in computer vision and spatial statistics applications. Here we explore a scalable approach to learning GPstruct models based on ensemble learning, with weak learners (predictors) trained on subsets of the latent variables and bootstrap data, which can easily be distributed. We show experiments with 4M latent variables on image segmentation. Our method outperforms widely-used conditional random field models trained with pseudo-likelihood. Moreover, in image segmentation problems it improves over recent state-of-the-art marginal optimisation methods in terms of predictive performance and uncertainty calibration. Finally, it generalises well on all training set sizes.

Item Type: Conference Proceedings
Additional Information: Proceedings of the 31 st International Conference on Machine Learning, Beijing, China, 2014
Schools and Departments: School of Engineering and Informatics > Informatics
Subjects: Q Science > QA Mathematics > QA0273 Probabilities. Mathematical statistics
Depositing User: Novi Quadrianto
Date Deposited: 18 Jun 2015 20:09
Last Modified: 16 Jun 2017 10:44

View download statistics for this item

📧 Request an update