etcML is a new and free tool that allows even novice user use the power of machine learning and text classification.
By Ajay Ohri, Mar 5, 2014.etcML.com is a new website that helps bring the power of machine learning to classifying text even to users who are not proficient in machine learning and text classification. It does so by creating an easy to use interface that helps a user upload data, create a classifier, and apply the classifier to predict. You can even use it to classify tweets for sentiment using an inbuilt classifier and integration with Twitter search.
The website is backed by a young team led by Richard Socher out of Stanford with faculty adviser as the famed professor Andrew Ng, creator of Coursera. The website is free and is currently at the status of a research project at Stanford. The same team has been behind the creation of NASENTwhich is an improved version of sentiment analysis algorithms.
There are other websites that promise to help users with easy machine learning classification includinggoogle prediction api and bigml.com, however the ease of usage helps make this a promising candidate to watch. This could potentially help widen the audience for the direct end users of machine learning classification (like marketing and product strategy) teams while creating a challenge for existing social media analysis tools like Radian6.
The basic process of text classification using etcml.com is as follows-
Step 1- choose among
upload dataset of text data, OR
choose existing text dataset, OR
classify tweets (publicly available text data)
Step 2 - choose among
existing classifiers models OR
your own classifier models
Step 3 predict the dataset using the chosen classifier.
You can then download the dataset with both the input text and the output classification labels.
An additional point is while the interface makes it very easy to explain classification (thus being of some use to the academic world), it also allows you to create public and private datasets as well as public and private classifiers.
It could thus potentially bring in a marketplace of both datasets and predictive models, both of which have been tried and tested without resounding success in separate formats.
For a sentiment analysis of tweets, it shows top positive , top negative and top neutral tweets, a graphical description of when the tweets happened and the ability to change the classification manually.
We noticed some caveats- while the tool allows manual intervention to change the labels, there is no way to feed this back automatically into the classifier that was originally used. This of course applies to the traditional text mining challenges of classifying sarcasm, slang or even double negatives. Another drawback is the lack of model diagnostics- especially the confusion matrix for the lift curve, Also needed is perhaps a paid version for tweets from a longer period (since Twitter sells the API data through resellers like Datasift). We noticed some API information and documentation herebut better bindings especially for Python, and R communities can only enhance the usage .
Overall better interfaces is something that should come to the data science world, and etcML.com is a great effort to make this possible.