Andrew Ng has proven in his ICML-2004 paper that sample complexity grows linearly in the number of irrelevant features when using L2 regularisation (in logistic regression, support vector machine, and back-propagation neural network), but only logarithmically when using L1 regularisation (in logistic regression).
Friday, August 26, 2011
Sunday, July 03, 2011
New linear-time algorithm for suffix array construction
Juha Kärkkäinen, Peter Sanders , and Stefan Burkhardt: Linear Work Suffix Array Construction, Journal of the ACM (JACM), Volume 53 Issue 6, November 2006.
As the authors have said, this algorithm narrows the gap between suffix tree and suffix array, which are widely used and largely interchangeable index structures on strings and sequences. Usually theoreticians prefer the former due to linear-time construction algorithms and more explicit structure while practitioners prefer the latter due to its simplicity and space efficiency. Now there is one more reason for practitioners to stick with suffix array.
Friday, July 01, 2011
Research Impact for REF
The British government's emphasis on the practical impact of research in REF reminds me of Feynman's following words.
Physics [research] is like sex: sure, it may give some practical results, but that's not why we do it.
Friday, June 17, 2011
DiveRS'11
Pablo Castells, Jun Wang, Ruben Lara, and Dell Zhang are organising an ACM RecSys-2011 workshop on Novelty and Diversity in Recommender Systems (DiveRS). A special issue of ACM TIST in the scope of the workshop will be announced after the conference. Authors of accepted papers will be invited to submit an extended version.
A couple of metrics
It is often desirable to measure the dissimilarity or distance between items using a proper metric.
- Jaccard coefficient can be converted to a metric by by subtracting the Jaccard coefficient from 1.
- Kullback–Leibler divergence can be converted to a metric by taking the square root of its symmetric version Jensen–Shannon divergence.
