Smorgasbord - Politics, Lisp, Rails, Fencing, etc.

My musings on assortment of things ranging from politics, computer technology and programming to sports.

Friday, May 19, 2006


On this day:

Improving performance of classifier gem

In the post acts_as_classifier I had mentioned that the Bayesian classifier in the gem classifier needs some work. After, that I got some emails asking me more details about what it needs, I will briefly mention some of the points which I think can improve it. The current gem is absolutely ok, the features below will just add more value to it, and may help in improving classification accuracy.

1. It should take prior probability into consideration. For example, a certain kind of document may be likely to occur than the other, using prior probability will help in incorporating this factor into decision making.

2. While classifying, currently the probability P(x|y) is calculated as: the number of times the word has been in a particular category/ total number of words in that category.
Instead of using, total number of words in a category, use number of documents in that category. The latter is the standard technique and gives better result.

3. Cannot use cost-sensitive learning. This will help in scenarios where some kind of decisions are more important than others. For example in preliminary testing, not missing a tumor is more important than incorrectly giving the result that someone has a tumor.

4. Cannot use threshold in the classify method, but this can be easily worked around.

There are other fine tunings which can be done, but they are problem specific, and require some empirical experiments.

But despite all this, there is the standard disclaimer used in Machine Learning.

There is something called No-free-lunch.

3 Comments:

At Fri Jul 08, 05:23:00 PM 2016, Anonymous Anonymous said...

air max, sac longchamp, ray ban sunglasses, longchamp pas cher, ugg boots, ray ban sunglasses, nike free, oakley sunglasses, nike free, chanel handbags, cheap oakley sunglasses, nike outlet, louboutin, longchamp, nike roshe run, air jordan pas cher, tiffany jewelry, longchamp outlet, longchamp outlet, michael kors, prada outlet, louis vuitton outlet, louboutin outlet, louis vuitton, uggs on sale, ugg boots, louis vuitton, polo ralph lauren outlet, oakley sunglasses, louis vuitton, kate spade outlet, louboutin pas cher, polo ralph lauren outlet, tory burch outlet, tiffany and co, oakley sunglasses, ray ban sunglasses, ralph lauren pas cher, christian louboutin outlet, nike air max, nike air max, louboutin shoes, replica watches, jordan shoes, oakley sunglasses, gucci outlet, prada handbags, burberry, replica watches, louis vuitton outlet

 
At Fri Jul 08, 05:34:00 PM 2016, Anonymous Anonymous said...

ray ban uk, vanessa bruno, sac guess, air force, tn pas cher, coach outlet, michael kors, burberry outlet online, nike blazer, lululemon, vans pas cher, mulberry, michael kors, burberry, nike free run uk, nike roshe, ray ban pas cher, michael kors outlet, hollister pas cher, hollister, north face, hermes, new balance pas cher, coach purses, true religion outlet, nike air max, replica handbags, ugg boots, michael kors outlet, hogan, nike air max, true religion jeans, abercrombie and fitch, kate spade handbags, lacoste pas cher, true religion jeans, michael kors outlet, converse pas cher, coach outlet, timberland, nike air max, michael kors, ugg boots, michael kors outlet, true religion jeans, north face, michael kors, ralph lauren uk, oakley pas cher, michael kors outlet

 
At Fri Jul 08, 05:48:00 PM 2016, Anonymous Anonymous said...

bottes ugg, ugg pas cher, louis vuitton, pandora jewelry, moncler, moncler, doudoune canada goose, replica watches, louis vuitton, moncler, juicy couture outlet, moncler, juicy couture outlet, ugg,uggs,uggs canada, canada goose, ugg,ugg australia,ugg italia, pandora charms, canada goose, links of london, canada goose outlet, pandora charms, canada goose uk, canada goose, marc jacobs, moncler, wedding dresses, louis vuitton, canada goose outlet, karen millen, louis vuitton, moncler outlet, sac louis vuitton pas cher, coach outlet, moncler, swarovski, ugg boots uk, toms shoes, moncler, pandora jewelry, canada goose, montre pas cher, thomas sabo, supra shoes, hollister, swarovski crystal

 

Post a Comment

<< Home