This article relies largely or entirely on a single source. Relevant discussion may be found on the talk page. Please help improve this article by introducing citations to additional sources. Find sources: "Indian buffet process" – news · newspapers · books · scholar · JSTOR(June 2017)
In the mathematical theory of probability, the Indian buffet process (IBP) is a stochastic process defining a probability distribution over sparsebinary matrices with a finite number of rows and an infinite number of columns. This distribution is suitable to use as a prior for models with potentially infinite number of features. The form of the prior ensures that only a finite number of features will be present in any finite set of observations but more features may appear as more data points are observed.
Indian buffet process prioredit
Let be an binary matrix indicating the presence or absence of a latent feature. The IBP places the following prior on :
where is the number of non-zero columns in , is the number of ones in column of , is the -th harmonic number, and is the number of new dishes sampled by the -th customer. The parameter controls the expected number of features present in each observation.
In the Indian buffet process, the rows of correspond to customers and the columns correspond to dishes in an infinitely long buffet. The first customer takes the first dishes. The -th customer then takes dishes that have been previously sampled with probability , where is the number of people who have already sampled dish . He also takes new dishes. Therefore, is one if customer tried the -th dish and zero otherwise.
This process is infinitely exchangeable for an equivalence class of binary matrices defined by a left-ordered many-to-one function. is obtained by ordering the columns of the binary matrix from left to right by the magnitude of the binary number expressed by that column, taking the first row as the most significant bit.
T.L. Griffiths and Z. Ghahramani The Indian Buffet Process: An Introduction and Review, Journal of Machine Learning Research, pp. 1185–1224, 2011.
January 01, 1970
indian, buffet, process, this, article, relies, largely, entirely, single, source, relevant, discussion, found, talk, page, please, help, improve, this, article, introducing, citations, additional, sources, find, sources, news, newspapers, books, scholar, jsto. This article relies largely or entirely on a single source Relevant discussion may be found on the talk page Please help improve this article by introducing citations to additional sources Find sources Indian buffet process news newspapers books scholar JSTOR June 2017 In the mathematical theory of probability the Indian buffet process IBP is a stochastic process defining a probability distribution over sparse binary matrices with a finite number of rows and an infinite number of columns This distribution is suitable to use as a prior for models with potentially infinite number of features The form of the prior ensures that only a finite number of features will be present in any finite set of observations but more features may appear as more data points are observed Indian buffet process prior editLet Z displaystyle Z nbsp be an N K displaystyle N times K nbsp binary matrix indicating the presence or absence of a latent feature The IBP places the following prior on Z displaystyle Z nbsp p Z a K i 1 N K 1 i exp a H N k 1 K N m k m k 1 N displaystyle p Z frac alpha K prod i 1 N K 1 i exp alpha H N prod k 1 K frac N m k m k 1 N nbsp where K displaystyle K nbsp is the number of non zero columns in Z displaystyle Z nbsp m k displaystyle m k nbsp is the number of ones in column k displaystyle k nbsp of Z displaystyle Z nbsp H N displaystyle H N nbsp is the N displaystyle N nbsp th harmonic number and K 1 i displaystyle K 1 i nbsp is the number of new dishes sampled by the i displaystyle i nbsp th customer The parameter a displaystyle alpha nbsp controls the expected number of features present in each observation In the Indian buffet process the rows of Z displaystyle Z nbsp correspond to customers and the columns correspond to dishes in an infinitely long buffet The first customer takes the first P o i s s o n a displaystyle mathrm Poisson alpha nbsp dishes The i displaystyle i nbsp th customer then takes dishes that have been previously sampled with probability m k i displaystyle m k i nbsp where m k displaystyle m k nbsp is the number of people who have already sampled dish k displaystyle k nbsp He also takes P o i s s o n a i displaystyle mathrm Poisson alpha i nbsp new dishes Therefore z n k displaystyle z nk nbsp is one if customer n displaystyle n nbsp tried the k displaystyle k nbsp th dish and zero otherwise This process is infinitely exchangeable for an equivalence class of binary matrices defined by a left ordered many to one function lof Z displaystyle operatorname lof Z nbsp is obtained by ordering the columns of the binary matrix Z displaystyle Z nbsp from left to right by the magnitude of the binary number expressed by that column taking the first row as the most significant bit See also editChinese restaurant processReferences editT L Griffiths and Z Ghahramani The Indian Buffet Process An Introduction and Review Journal of Machine Learning Research pp 1185 1224 2011 Retrieved from https en wikipedia org w index php title Indian buffet process amp oldid 1186310268, wikipedia, wiki, book, books, library,