- Shouldn't you link to the arxiv page instead of the PDFs in case there's a revision?
- What about a column for "area" as well? Would be nice to scroll through and see what areas have made progress relative to others lately.
- Some sort of very brief mini-about/summary at the top of the main page wouldn't hurt. A tagline of some sort.
- Now I notice there's an About under the hamburger menu -- why not just display HOME and ABOUT instead of hiding them in a menu? You don't have enough menu options to need to hide them in a hamburger menu.
We are an enthusiastic group of students trying to put in our two cents into the fast developing fields of Artificial Intelligence (AI) and Machine Learning (ML). ... One space we believe is currently not covered is that of an easily consultable repository for state of the art, quantifiable results across tasks. ... The main source of data is the community that can upload the relevant results of their field! We have further aggregated data from reading (a lot) of articles, from scraping the web, and from several existing datasets and websites. A portion of our dataset came from the Electronic Frontier Foundation’s "Measuring the Progress of AI Research."
Kudos for the effort. I wish more areas had something like this.
Hey. One of the creators here. Yes we are still missing several tasks and results, the idea is that this could be maintained by the community by making it easy to upload results.
Definitely help is appreciated
We are collecting a lot of feedback
Hey thanks for this. Please add a finance category. Timeseries has some overlap with finance but there is plenty of finance AI research that is not restricted to time series. Financial data has many distinct characteristics and interesting challenges.
Looks super cool! There is a bit of data clean up to do. Just looking at speech recognition: "WER" and "Word Error Rate" should be the same thing, and sometimes it seems to be on a scale of 0 to 1 and other times a percentage. Also the Switchboard test set is duplicated. Finally, it really should be marked when data is augmented; many of these numbers are trained on outside data, which says more about how much data the researchers have access to as opposed to the ML system design.
When I think of the things I would add to this, I realize how amazingly useful it would be to have more data on the tasks themselves. For starters, whether or not there is code and what license under which it is released, and for NLP what languages were used/are available for use. Also, sign language recognition fits somewhere between computer vision and NLP. If picked up by the community, this could become a huge knowledge base.