Unsupervised learning of natural languages

Unsupervised learning of natural languages Proceedings of the National Academy of Sciences 102 (33), 11629-11634

Year

2005

Category

Machine Learning

Journal

PNAS

Authors

Z Solan, D Horn, E Ruppin, S Edelman

Abstract

We address the problem, fundamental to linguistics, bioinformatics, and certain other disciplines, of using corpora of raw symbolic sequential data to infer underlying rules that govern their production. Given a corpus of strings (such as text, transcribed speech, chromosome or protein sequence data, sheet music, etc.), our unsupervised algorithm recursively distills from it hierarchically structured patterns. The adios (automatic distillation of structure) algorithm relies on a statistical method for pattern extraction and on structured generalization, two processes that have been implicated in language acquisition. It has been evaluated on artificial context-free grammars with thousands of rules, on natural languages as diverse as English and Chinese, and on protein data correlating sequence with function. This unsupervised algorithm is capable of learning complex syntax, generating grammatical novel sentences, and proving useful in other fields that call for structure discovery from raw data, such as bioinformatics.

  • Let's Talk

    +++

    Let's Talk

    +++

    Let's Talk

    +++

    Let's Talk

    +++

    Let's Talk

    +++

    Let's Talk

    +++

    Let's Talk

    +++

    Let's Talk

    +++

    Let's Talk

    +++

    Let's Talk

    +++

    Let's Talk

    +++

    Let's Talk

    +++

    Let's Talk

Project in mind?

Let’s make your prdouct shine with AI

Premium AI solutions

services to help your business stand out.

  • Let's Talk

    +++

    Let's Talk

    +++

    Let's Talk

    +++

    Let's Talk

    +++

    Let's Talk

    +++

    Let's Talk

    +++

    Let's Talk

    +++

    Let's Talk

    +++

    Let's Talk

    +++

    Let's Talk

    +++

    Let's Talk

    +++

    Let's Talk

    +++

    Let's Talk

Project in mind?

Let’s make your prdouct shine with AI

Premium AI solutions

services to help your business stand out.

  • Let's Talk

    +++

    Let's Talk

    +++

    Let's Talk

    +++

    Let's Talk

    +++

    Let's Talk

    +++

    Let's Talk

    +++

    Let's Talk

    +++

    Let's Talk

    +++

    Let's Talk

    +++

    Let's Talk

    +++

    Let's Talk

    +++

    Let's Talk

    +++

    Let's Talk

Project in mind?

Let’s make your prdouct shine with AI

Premium AI solutions

services to help your business stand out.

Available