Lecture 1. Introduction - История изменений

Katya в 19:48, 5 ноября 2016

2016-11-05T19:48:34Z

← Предыдущая версия		Версия от 19:48, 5 ноября 2016
Строка 1:		Строка 1:
			Ekaterina Chernyak, Dmitry Ilvovsky

	== Brief history of NLP ==		== Brief history of NLP ==

Polidson в 20:40, 22 августа 2015

2015-08-22T20:40:22Z

← Предыдущая версия		Версия от 20:40, 22 августа 2015
Строка 1:		Строка 1:
	~~''' Lecture 1. Introduction '''~~

	== Brief history of NLP ==		== Brief history of NLP ==

Polidson: /* About this course */

2015-08-22T20:33:07Z

About this course

← Предыдущая версия		Версия от 20:33, 22 августа 2015
Строка 61:		Строка 61:

	== About this course ==		== About this course ==

			It covers the following topics:
			* Tokenization
			* POS tagging
			* Key word and phrase extraction
			* Parsing
			* Synonyms detection
			* Language sources
			* Topic modeling
			* Text visualisation

			You can try to use Python and R for various tasks.

Polidson: /* Main problems */

2015-08-22T20:31:51Z

Main problems

← Предыдущая версия		Версия от 20:31, 22 августа 2015
Строка 49:		Строка 49:

	== Main problems ==		== Main problems ==

			* Ambiguity
			** Lexical ambiguity:
			** Time flies like an arrow; fruit flies like a banana.
			* Syntactic ambiguity
			** Police help dog bite victim.
			** Wanted: a nurse for a baby about twenty years old.
			* Neologism: unfriend, retweet, instagram
			* Different spelling: NY, New York City, New-York
			* Non-standard language: HIIII, how are u? miss u SOOOO much:((((

	== About this course ==		== About this course ==

Polidson: /* NLP techniques */

2015-08-22T20:29:33Z

NLP techniques

@@ Строка 33: / Строка 33: @@
 == NLP techniques ==
 == Main problems ==
 == About this course ==

Polidson: Новая страница: «''' Lecture 1. Introduction ''' == Brief history of NLP == * January 7, 1954 — Georgetown experiment. Russian to English machine translation; * 1957 — Noam…»

2015-08-22T20:27:32Z

Новая страница: «''' Lecture 1. Introduction ''' == Brief history of NLP == * January 7, 1954 — Georgetown experiment. Russian to English machine translation; * 1957 — Noam…»

Новая страница

''' Lecture 1. Introduction '''

== Brief history of NLP ==

* January 7, 1954 — Georgetown experiment. Russian to English machine translation;
* 1957 — Noam Chomsky introduced "universal grammar";
* since 1961 — Brown Corpus;
* the late 1960's — ELIZA, a simulation of a psychotherapist;
* 1975 — Vector Space Model by Salton;
* up to the early 1980's — rule based approaches;
* after the early 1980's — machine learning, corpus linguistics;
* 1998 — Language Model by Ponte and Croft;
* since 1999 — topic modeling (LSI, pLSI, LDA, etc);
* 1999 — "Foundations of Statistical Natural Language Processing" by Manning and Shuetze;
* 2009 — "Natural Language Processing with Python" by Bird, Klein, and Loper.

== Major tasks of NLP ==

* Machine Translation
* Text classification
** Sentiment analysis
** Spam filtering
** Classification by topic or by genre
* Text clustering
* Named entity recognition
* Question answering
* Automatic summarization
* Natural language generation
* Speech recognition
* Spell checking
* User study design and evaluation

== NLP techniques ==

== Main problems ==

== About this course ==