Web Directory

» (H)HMM Library and Designer
   This library allows probabilistic sequence models to be constructed through use of Hidden Markov models (HMMs) and Hierarchical Markov models HMMs (HHMMs) in Ocaml programming language. [GPL]
   http://connex.lip6.fr/%7ebinsztok/hhld.html

» Alexa - Top 20 Machine Learning Software Websites
   Top 20 machine learning software websites for this DMOZ category ranked by Alexa.com. [FREE]
   http://www.alexa.com/topsites/category/Top/Computers/Artificial_Intelligence/Machine_Learning/Software

» AliceBOT
   The famous free software BOT developed in promotion of AIML (Artificial Intelligence Markup Language). [FREE]
   http://alicebot.blogspot.com/

» An Object Oriented (OOP) Framework for Neural Networks in C#
   A handy basic Class and back progagator to create the framework for AI Neural Networks. [GPL]
   http://www.c-sharpcorner.com/UploadFile/rmcochran/AI_OOP_NeuralNet06192006090112AM/AI_OOP_NeuralNet.aspx

» ArrayMiner - ClassMarker
   Programmatically isolate similarities between scattered classes of genes. Expression driven. Utilizes a voting method along with a k-Nearest-Neighbors classification. Very rich graphical interface. Samples of an unknown class are possible given enough dat
   http://www.optimaldesign.com/ArrayMiner/ClassMarker.htm

» BETSY: A Bayesian Essay Test Scoring System
   A windows-based program that classifies text based on trained material. Designed for automated essay scoring, BETSY can be applied to any text classification task. [GPL]
   http://edres.org/betsy

» BNet EngineKit
   A developer toolkit for researchers and engineers to embed belief networks in software applications. Nice online demo. [Commercial]
   http://www.cra.com/commercial-products-services/bnet-engine-kit.asp

» Bayes Net Toolbox for Matlab
   Supports several inference algorithms and learning algorithms. Allows simulation of static and dynamic networks, including HMMs, IOHMMs, and Kalman filters. [GPL]
   http://code.google.com/p/bnt/

» Bayes++: Open Source Bayesian Filtering Classes
   A library of C++ classes for Bayesian Filtering of discrete systems. [MIT]
   http://bayesclasses.sourceforge.net/Bayes++.html

» BoosTexter: A Boosting-based System for Text Categorization
   A general purpose machine-learning program based on boosting for building a classifier from text and/or attribute-value data. [GPL]
   http://www.cs.princeton.edu/~schapire/boostexter.html

» Bow: A Toolkit for Statistical Language Modeling, Text Retrieval, Classification and Clustering
   A library of C code useful for writing statistical text analysis, language modeling, and information retrieval programs. The current distribution includes the library, as well as front-ends for document classification (rainbow), document retrieval (arrow)
   http://www.cs.cmu.edu/~mccallum/bow/

» C4.5 and FOIL
   The home page of R. Quinlan with FTP links to FOIL (inductive logic programming) and C4.5 (learning decision trees). [LGPL]
   http://www.rulequest.com/Personal/

» CHILL: Constructive Heuristics Induction for Language Learning
   A general approach to the problem of inducing natural language parsers. It uses an annotated corpus, and produces a parser by using ILP for inducing the rules that control the actions of a shift-reduce parser. [Free]
   http://www.cs.utexas.edu/users/ml/chill.html

» CMU Artificial Intelligence Repository
   The Carnegie Mellon University School of Computer Science select list of a few very good machine learning systems. A list of 4 FTP repository links is also listed for exploring. [GPL]
   http://www.cs.cmu.edu/Groups/AI/areas/learning/systems/0.html

» Classification Toolbox for MATLAB
   A complete set of algorithms for classification, clustering, feature selection and reduction for Matlab. [Free]
   http://www.yom-tov.info/toolbox.html

» Debellor
   Java framework for scalable machine learning and data mining. Processing of massive data made possible through data streaming. [GPL]
   http://www.debellor.org/

» ELIE: An Adaptive Information Extraction System
   A tool for adaptive information extraction from text. Also included are a number of other text processing tools for POS tagging, chunking, gazetteer, and stemming. [GPL]
   http://www.aidanf.net/elie

» Experience-based Language Acquisition
   Computational model of human language acquisition written in Java; currently acquires a protolanguage of nouns and verbs language based on visual perception. [BSD]
   http://sourceforge.net/projects/ebla

» Extreme Learning Machine
   generalized Single-hidden Layer Feed forward Networks (SLFNs) and how to build them. Since work as universal approximators with adjustable hidden parameters, all parameters of ELMs can be analytically determined instead of being tuned. Written in Matlab.
   http://www3.ntu.edu.sg/home/egbhuang/

» FastMix
   Generates Gaussian mixture models for large datasets using efficient KD-clustering algorithms. [Free]
   http://www.cs.cmu.edu/~psand/

» Fully Complex Machine Learning Algorithm: ELM
   Treatise on a newly discovered algorithm for feedforward neural network, ELM. Complete performance evaluation along with discussions in PDF format. [Free]
   http://www.ntu.edu.sg/home/egbhuang/C-ELM.pdf

» GAlib: Matthew's Genetic Algorithms Library
   A toolset of genetic algorithm objects for C++ to perform optimization. Uses any representation and genetic operators. The documentation contains implementation and examples. Nice screenshots. PVM for distributed, parallel implementations. Includes graphi
   http://lancet.mit.edu/ga/

» GMDH Shell: Predictive Data Mining Software
   Provides GMDH-based machine learning technology for classification, continuous value prediction and time series forecasting. The software uses multi-core processors and HPC Linux clusters. [Commercial]
   http://www.gmdhshell.com/

» GRIDLOCK: A Scalable Approach to Unifying Computer and Communications Security
   A globally specified and locally interpreted policy language based software for specification of network access control policy. [GPL]
   http://nsl.cs.columbia.edu/projects/gridlock/

» General Hidden Markov Model Library
   Hidden Markov Models software library from the Center of Applied Informatics, Cologne. Includes algorithms such as Viterbi, Baum-Welch, and Forward-Backward. [GPL]
   http://sourceforge.net/projects/ghmm

» Graclus: Efficient Graph Clustering Software
   A fast graph clustering software that computes normalized cut and ratio association for a given undirected graph without any eigenvector computation.
   http://www.cs.utexas.edu/users/dml/Software/graclus.html

» HMM: Pattern search and discovery
   A collection of tools for creating and using HMMs for biological sequences. [AFL]
   http://bioweb.pasteur.fr/seqanal/motif/sam-uk.html

» HMMER: Biosequence Analysis
   A tool used to build HMMs from multiple alignments and calculate e-scores. [GPL]
   http://hmmer.janelia.org/

» HRE API: A Portable Handwriting Recognition Engine
   This engine is a functionally complete interface for handwriting recognition. API was written in ANSI C and has minimal reliance on the Windows system. There is a version ported to Linux. [GPL]
   http://playground.sun.com/pub/multimedia/handwriting/hre.html

» ITI: Incremental Tree Inducer
   An algorithm that incrementally constructs decision trees from labeled examples. [AFL]
   http://www.cs.umass.edu/~lrn/iti/index.html

» International Cognitive Computing
   CAMBO, a multi-Expert System Generator. Artificial Intelligence, Machine Learning, Natural Language Processing, Knowledge Normalization, Knowledge Engineering. This system uses natural language processing to extract “natural” knowledge base representa
   http://www.cambo-2010.com

» JMLR Machine Learning Open Source Software
   Many algorithms, toolboxes and full languages are available for scientific computing. Abstracts, PDF, and source code is available. [GPL]
   http://jmlr.csail.mit.edu/mloss/

» JProGraM -- PRObabilistic GRAphical Models in Java
   JProGraM is a machine learning library which supports learning and inference algorithms for Bayesian networks, Markov random fields, hybrid random fields, probabilistic decision trees, dependency networks, and Parzen windows. [GPL]
   http://www.dii.unisi.it/%7efreno/JProGraM.html

» Jernigan's Lab
   Several Gaussian and ANisotropic network models to calculate magnitudes of motion-mean square amplitudes or directions of motion. Written in Fortran. [GPL]
   http://ribosome.bb.iastate.edu/software/

» KEEL: Knowledge Extraction based on Evolutionary Learning
   The aim of this project is to develop a Computational Environment for integrating the design and use of knowledge extraction models from data using evolutionary algorithms. Genetic learning may also be applied to the model. [GPL]
   http://sci2s.ugr.es/keel/

» Lemga: Learning Models and Generic Algorithms
   A library of classes for optimizing (training) the generic models. Written in C++. [GPL]
   http://www.work.caltech.edu/ling/lemga/

» LibML
   A machine learning library. New implementations of various machine learning algorithms. [GPL]
   http://savannah.nongnu.org/projects/libml/

» LingPipe: Natural Language Processor (NLP)
   A suite of Java libraries for the linguistic analysis of human language which can link entity mentions to database entries, uncover relations, cluster documents, and discover significant trends. [GPL]
   http://www.alias-i.com/lingpipe/

» Lush: An Object-oriented Programming Language for Machine Learning
   Made expressly for large-scale numerical and graphic applications, Lush can be used in programming scenarios where one needs to combine the flexibility of a high-level, weakly-typed interpreted language with the efficiency of a strongly-typed, native comp
   http://www.nec-labs.com/research/machine/ml_website/main/software.php?project=lush

» MALLET: Advanced Machine Learning for Language
   An integrated collection of Java code useful for statistical natural language processing, document classification, clustering, information extraction, and other machine learning applications to text. [GPL]
   http://mallet.cs.umass.edu/index.php/Main_Page

» MEME/MAST: Motif Discovery and Search
   A software package to discover motifs (highly conserved regions) in groups of related DNA or protein sequences and, search sequence databases using motifs. [Commercial]
   http://meme.sdsc.edu/meme/intro.html

» MIX: Software for Mixture Distributions
   Software for learning mixture distributions. Examples and two case studies are included. [Commercial]
   http://icarus.math.mcmaster.ca/peter/mix/mix.html

» MLPY Machine Learning
   A high performance Python package for predictive modeling. Fast N-dimentional array manipulation is performed via numpy using C code. New features include: OLS, Ridge Regression, Kernel Redge Regression, LASSO, LARS, Gradient descent for Regression, and K
   http://mloss.org/software/view/66/

» Machine Learning Repository
   Machine language tools including inductive systems (i.e. ILP and others), and other ML related links.
   http://scalab.uc3m.es/~dborrajo/ml-systems/

» Machine Learning Research Software in LISP
   FTP repository of common list algorithms and datasets for research. [GPL]
   http://www.cs.utexas.edu/~ml/ml-progs.html

» Machine Learning Software Collection of Peter Clark
   Various software packages from the staff and alumni of The University of Texas at Austin which include inductions, a partial lazy evaluation, and a derivative of the Theo system. [GPL]
   http://www.cs.utexas.edu/users/pclark/software/

» Machine Learning Software Packages
   Various classes, packages, macros and other software systems related to machine learning. [GPL]
   http://www.cs.cmu.edu/afs/cs/project/ai-repository/ai/areas/learning/systems/0.html

» Machine Learning and Data Mining Software
   Index of software links for computer learning software. Scroll down. [FREE]
   http://www.sciencemag.org/feature/data/compsci/machine_learning.dtl

» Machine Learning and Dragons - a Game
   A game programmed using evolutionary algorithm-based methodology allowing the game to learn by the player's decisions. There is also a method to use the alternative reinforcement learning decision tree to be used as well. Sourcecode is available for downl
   http://www.blendedtechnologies.com/machine-learning-and-dragons-a-game/177

» Machine Learning and Inference Laboratory
   Downloadable group of programs comprising the EMERALD machine learning system, (Experimental Machine Example-based Reasoning and Learning Disciple) integrates five modules (e.g. or 'robots'), each displaying a capability for machine learning, visualizatio
   http://www.mli.gmu.edu/msoftware.html

» Markov TheBeast
   A Markov Logic Interpreter that focuses on efficient MAP inference and Online Learning featuring MAP inference using Cutting Planes combined with Max-Walk-Sat programming, parametrized weights, a shell interpreter, and cardinality constraints. [GPL]
   http://code.google.com/p/thebeast/

» Maximum Entropy Modeling Toolkit
   A library of tools for constructing maximum entropy (maxent) model in either python or C++. Some program features are L-BFGS and GIS parameter estimation, and gaussian prior smoothing. [GPL]
   http://homepages.inf.ed.ac.uk/s0450736/maxent_toolkit.html

» Meta-MEME: Motif-based Hidden markov Modeling of Biological Sequences
   Software toolkit for building and using motif-based hidden Markov models of DNA and proteins. There is an online interactive version. Source written in C. [GPL]
   http://metameme.sdsc.edu/

» Milepost GCC Compiler
   A program compiler with built-in machine learning to find the most efficient compilation possible based upon the processor the program is run on. A collective optimization database, predictor web-service, and frameworks are available in order to make sugg
   http://ctuning.org/wiki/index.php/CTools:MilepostGCC

» NEC - Department of Machine Learning - Software
   Machine learning software projects from several members of the NEC staff. Sourcecode, Documentation, and some supporting publications are also available. [FREE]
   http://www.nec-labs.com/research/machine/ml_website/main/software.php

» NEITHER: A Propositional Theory Refinement
   A system to modify an incomplete or incorrect rule base to make it consistent with a set of input training examples. Written in C++ [Free]
   http://www.cs.utexas.edu/users/ml/neither.html

» NSP: N-gram Statistics Package
   Software for counting and analyzing word n-grams in text. This package provides standard tests of association for identifying word n-grams in large corpora and allows users to implement other tests with minimal scripting knowledge. Written in Perl. [GPL]
   http://www.d.umn.edu/~tpederse/nsp.html

» New Scientific Brainstorming Software for Inventors -- Windows, Mac and Linux
   A software developed to help your team brainstorm. Words are replaced programmatically in user's idea sentence with new words from program categories perhaps creating ideas not formerly thought of. Includes word categories. [Commercial]
   http://www.paramind.net/pmscientificversion.html

» Nieme: Classification, Regression, Ranking and Reinforcement Learning
   A machine learning library for classification, regression, ranking and reinforcement learning. It implements several well-known algorithms and is specially designed for large-scale applications. [GPL]
   http://nieme.lip6.fr/

» Nonparametric Classification with Polynomial MPMC Cascades
   Scalable non-parametric classification with Polynomial MPMC Cascades for use in Matlab. [GPL]
   http://cervisia.org/machine_learning_code.php

» ORANGE: Inter-active Machine Learning Data Mining components
   A component based framework for data input/output, preprocessing, predictive modelling, ensemble methods, and modelling validation. [GPL]
   http://www.ailab.si/orange

» Open Source Computer Vision Library
   Open source computer learning system making use of the Bayesian inferencing engine. [GPL]
   http://sourceforge.net/projects/opencvlibrary/

» OpenCyc
   Open source version of the Cyc technology, the world's largest and most complete general knowledge base and commonsense reasoning engine. Can be used as the basis of a wide variety of intelligent applications including; rapid development of an ontology in
   http://www.opencyc.org/

» PRAPI: Pattern Recognition Application Programmer's Interface
   A library for many pattern recognition tasks. The main focus of this package is on image analysis but utilizes a general architecture and XML-based data interchange format. Written in C++ [GPL]
   http://www.ee.oulu.fi/~topiolli/cppdocs/

» PRODIGY: An Architecture for Planning and Learning
   A system of research planning and learning utilizing explanation-based learning, partial evaluation, experimentation, graphical knowledge acquisition, automatic abstraction, mixed-initiative planning, and case-based reasoning. [Free]
   http://www.cs.cmu.edu/afs/cs.cmu.edu/project/prodigy/Web/prodigy-home.html

» Pattern Matching Pointers
   Using algorithms to address issues of searching and matching strings and more complicated patterns such as trees, regular expressions, graphs, point sets, and arrays. [GPL]
   http://www.cs.ucr.edu/~stelo/pattern.html

» Pfam: Database of Protein Families and HMMs
   A large collection of multiple sequence alignments and trained hidden Markov models covering many common protein domains. Alignments are included as well as models for 8296 protein families, based on the Swissprot 48.9 and SP-TrEMBL 31.9 protein sequence
   http://pfam.janelia.org/

» Probabilistic Networks Library (PNL), and Open Source Machine Learning Library (OpenML) by Intel
   Open source library of tools for building machine learning software based on Bayesian mathematical principles. Links on lower left of page article. [GPL]
   http://deviceforge.com/news/NS5332804106.html

» Rapid Miner
   The Rapid Miner toolset is an environment for machine learning through use of nested operators. Multiple experiments can be arbitrarily nested together through use of a graphical XML based user interface. (Formerly YALE) [GPL]
   http://rapid-i.com/

» SENNA: a Neural Network Architecture for Semantic Extraction.
   A language processor utilizing a neural network to split a sentence into its speech tags and other named entities. Source code is not available, only binaries. [FREE]
   http://www.nec-labs.com/research/machine/ml_website/main/software.php?project=senna

» SNoW: Sparse Network of Winnows
   A learning architecture specifically tailored for learning in very high-dimensional feature spaces. The current release uses sparse variations of Winnow, Perceptron, and Naive Bayes. [AFL]
   http://l2r.cs.uiuc.edu/~danr/snow.html

» SUBDUE: Graph Based Knowledge Discovery
   A program which discovers interesting and repetitive subgraphs in labeled graph representations using the minimum description length principle. Includes applications to molecular biology. [Free]
   http://ailab.wsu.edu/subdue/

» SUrrogate MOdeling (SUMO) Toolbox
   A Matlab toolbox that automatically builds surrogate models of a given data source within the accuracy and time constraints set by the user. Some key features are the inclusion of scalable regression models, knowledge discovery, best-in-class modelling te
   http://www.sumo.intec.ugent.be/?q=SUMO_toolbox

» Self-Taught: Software That Learns By Doing
   Short article on self-modifying software touching on co-training, partial-programming, and genetic programming (GP) methods of problem solving. [FREE]
   http://www.computerworld.com/softwaretopics/software/story/0,10801,108320,00.html

» SenseClusters
   Programs to cluster similar contexts together using unsupervised knowledge-lean methods for word sense discrimination, email categorization, and name discrimination. Written in Perl. [GNU]
   http://senseclusters.sourceforge.net/

» Software Packages for Graphical Models/Bayesian Networks
   Tools for modeling graphs and Bayesian networks. Scroll down. [AFL], [Commercial]
   http://www.ai.mit.edu/~murphyk/Software/bnsoft.html

» Sorting Algorithms for Machine Learning
   Various sorting algorithms including insertion, quick, merge, heap, Dutch National Flag, and radix with on-line demos. [Free]
   http://www.csse.monash.edu.au/%7Elloyd/tildeAlgDS/Sort/

» Spider: General Purpose Machine Learning Toolbox in Matlab
   An object orientated environment for machine learning in Matlab. Algorithms can be plugged together and can be compared with (e.g. model selection, statistical tests and visual plots). Algorithms may be downloaded separately. [GPL]
   http://www.kyb.tuebingen.mpg.de/bs/people/spider/index.html

» TIMBL: Tilburg Memory Based Learner
   A program implementing several memory-based learning techniques. These learners store representation of the training set explicitly, and classifies new cases by extrapolation from the most similar stored cases. [AFL]
   http://ilk.uvt.nl/software.html

» The AutoClass Project
   A database of cases described by a combination of real and discrete valued attributes, and automatically finds the natural classes in that data. It can be seen as a Naive Bayes classifier where the class node is hidden. [Free]
   http://ti.arc.nasa.gov/project/autoclass/

» The Leibniz Software System
   A formal system for constructing artificial intelligent software agents from the book, 'Design of Logic-based Intelligent Systems' covering such topics as production rules, neural nets, support vector machines, fuzzy logic, and Bayesian networks. License
   http://www.utdallas.edu/~klaus/Leibnizprogram/leibnizmain.html

» The Lisa Project
   A production rule based system implemented in a Common Lisp Object System (CLOS) for the development of Lisp based intelligent software agents. [LGPL]
   http://lisa.sourceforge.net/

» The PNC2 Rule Induction System
   Windows software tool that induces rules from your data using the PNC2 cluster algorithm. An integrated parameter-tuning component allows easy adjustment of the algorithms behavior to the given problem without requiring any further knowledge. [GPL]
   http://www.newty.de/pnc2/index.html

» The Torch Machine Learning Library
   This package forms a complete gradient descent machine learning library. Modules support vector machines in classification and regression, ensemble models such as bagging or adaboost, non-parametric models such as K-nearest neighbors, Parzen regression, a
   http://www.torch.ch/

» Tree Visualizer
   Software which allows one to navigate (fly) through the data tree, zoom in on interesting nodes, click on bars to get counts, and mark interesting places in the tree. Includes datasets for automobiles, voting, produce, and medical research. Uses LEDA, ([A
   http://www.sgi.com/tech/mlc/trees.html

» UCI Machine Learning
   A repository of databases, domain theories and data generators that are used by the machine learning community for the empirical analysis of machine learning algorithms at the University of California at Irvine. [Free]
   http://www.ics.uci.edu/~mlearn/MLRepository.html

» UMDHMM and other statistical programs
   This tool implements Hidden Markov Models and application to part-of-speech tagging. Also available; a multivariate hypothesis testing software for gaussian data, and a groundtruth/metadata editing and visualizing toolkit for OCR. [GPL]
   http://www.kanungo.com/software/software.html

» VIBES: Variational Inference for Bayesian Networks
   A software package which allows variance-modeled posterior inference to be performed automatically on a Bayesian network. [GPL]
   http://vibes.sourceforge.net/

» Weka 3: Data Mining Software
   A collection of tools that implement decision trees and tables, rule learners, Naive Bayes, support vector machines, voted perceptrons, multi-layer perceptron. Meta schemes include bagging, stacking, and boosting. Written in Java. [GPL]
   http://www.cs.waikato.ac.nz/~ml/weka/index.html

» What If: Web-based Scientific Discovery
   An algorithm engine which will calculate everything from symmetry, torsion angles, polar fraction through protein analysis and bond angles. Online version only. [Free]
   http://swift.cmbi.ru.nl/servers/html/index.html

» WinBUGS: The BUGS Project
   A stand-alone program to allow practical MCMC methods available to applied statisticians. Either a point and click interface can be used to control the analysis or a graphical interface can be constructed. The BUGs project also includes links to GeoBUGS f
   http://www.mrc-bsu.cam.ac.uk/bugs/winbugs/contents.shtml

» WinMine Toolkit
   A set of tools for Windows 2000/NT/XP that allow you to build statistical models from data. [Free]
   http://research.microsoft.com/~dmax/WinMine/tooldoc.htm

» aiParts
   C++ classes for multi-decision problems implementing the High-Hope technique with sample programs. [MIT]
   http://www.agt.net/public/bmarshal/aiparts/index.htm

» libarow
   A software and library for huge classification implemented with the Adaptive Regularization of Weight Vectors (AROW) algorithm. [MIT License]
   http://code.google.com/p/libarow/

» libbpfl - A Bayesian Probability Filtering Library
   A general purpose library for Bayesian filtering written in C++. [LGPL]
   http://libbpfl.sourceforge.net

» mPOEMS in JAVA
   A generic framework for the evolutionary search algorithm mPOEMS. It was designed to solve optimisation problems, with an unrestricted number of objectives. This site provides all sources and some exemplary implementations, e.g. of the n-hard knapsack pro
   http://code.google.com/p/mpoems-in-java/

» mloss : Machine Language Open Source Software
   A community effort listing of reproducible research via open source software, open access to data and results, and open standards for interchange. [FREE]
   http://mloss.org/software/

» shogun | A Large Scale Machine Learning Toolbox
   A generic SVN object interface with many implementations including OCAS, Liblinear, LibSVM, SVMLight, SVMLin, and GPDT. Each SVN provides efficitne implementations of the most common kernals such as Linear, Ploynomial, Gaussian, and Sigmond Kernel and oth
   http://www.shogun-toolbox.org/