7月 142015

~ This article is co-authored by Biljana Belamaric Wilsey and Teresa Jade, both of whom are linguists in SAS' Text Analytics R&D. When I learned to program in Python, I was reminded that you have to tell the computer everything explicitly; it does not understand the human world of nuance […]

The post Text analytics through linguists’ eyes: When is a period not a full stop? appeared first on The Text Frontier.

6月 262015

Double negatives seem to be everywhere, I have noticed them a lot in music recently. Since Pink Floyd sang "We don't need no education", to Rihanna's "I wasn’t looking for nobody when you looked my way". My own favourite song with a double negative is "I can't get no sleep" - Faithless. This […]

The post Why I’m not worried by double negatives? appeared first on The Text Frontier.

5月 072015

A while ago, I started this series on natural language processing (NLP), and discussed some of the challenges of computers interpreting meaning in human language based on strings of characters. I also mentioned that today’s NLP systems can do some amazing things, including enabling the transformation of unstructured data into […]

The post Behind the scenes in natural language processing: Overcoming key challenges of rule-based systems appeared first on The Text Frontier.

11月 122014
My Mum could have been a doctor – most can’t read her handwriting. It’s only because I’ve been trained to read it, I can. The analysis of unstructured data is similar. Text analysts can be quickly overwhelmed to learn that you have to manually develop a training corpus. Reading a […]
4月 082010
Singularity refers to the phenomenon of ever-increasing computer power reaching a point of such overwhelming memory and computing power that gives rise to a new level of intelligence here on earth. One of the main drivers in the singularity model is Moore’s Law which predicts exponential growth in computing power. In the view of singularity proponents, human processing capacity is limited to the evolutionary constraints imposed on the size of the human cranium.

At web sites such as Singularity University and in research articles such as, "The Unreasonable Effectiveness of data," singularity proponents predict with confidence that it is only a matter of time before computers achieve natural language processing capability, probably in many languages. Think about the implications of that. For one, language and speech translation would become a trivial problem.
Continue reading "Singularity, Moore’s Law and NLP"