AI Language Processing Interview Preparation Guide

Download PDF

Artificial intelligence language processing (AILP) is a field of computer science and linguistics concerned with the interactions between computers and human (natural) languages; it began as a branch of artificial intelligence. In theory, natural language processing is a very attractive method of human–computer interaction. Natural language understanding is sometimes referred to as an AI-complete problem because it seems to require extensive knowledge about the outside world and the ability to manipulate it.

Natural Language Processing (NLP) refers to AI method of communicating with an intelligent systems using a natural language such as English.

Processing of Natural Language is required when you want an intelligent system like robot to perform as per your instructions, when you want to hear decision from a dialogue based clinical expert system, etc.

There are two components of NLP as given:
★ Natural Language Understanding (NLU)
★ Natural Language Generation (NLG)

Understanding involves the following tasks −
Mapping the given input in natural language into useful representations.
Analyzing different aspects of the language.

It is the process of producing meaningful phrases and sentences in the form of natural language from some internal representation.
It involves:

Text planning:
It includes retrieving the relevant content from knowledge base.

Sentence planning:
It includes choosing required words, forming meaningful phrases, setting tone of the sentence.

Text Realization:
It is mapping sentence plan into sentence structure.

NL has an extremely rich form and structure.
It is very ambiguous. There can be different levels of ambiguity:
★ Lexical ambiguity
★ Syntax Level ambiguity
★ Referential ambiguity

It is at very primitive level such as word-level.
For example, treating the word "board" as noun or verb?

A sentence can be parsed in different ways.
For example, "He lifted the beetle with red cap." − Did he use cap to lift the beetle or he lifted a beetle that had red cap?

Referring to something using pronouns. For example, Rima went to Gauri. She said, "I am tired." − Exactly who is tired?

★ Phonology
★ Morphology
★ Morpheme
★ Syntax
★ Semantics
★ Pragmatics
★ Discourse
★ World Knowledge

It is study of organizing sound systematically.

It is a study of construction of words from primitive meaningful units.

It is primitive unit of meaning in a language.

It refers to arranging words to make a sentence. It also involves determining the structural role of words in the sentence and in phrases.

It is concerned with the meaning of words and how to combine words into meaningful phrases and sentences.

It deals with using and understanding sentences in different situations and how the interpretation of the sentence is affected.

It deals with how the immediately preceding sentence can affect the interpretation of the next sentence.

It includes the general knowledge about the world.

It draws the exact meaning or the dictionary meaning from the text. The text is checked for meaningfulness. It is done by mapping syntactic structures and objects in the task domain. The semantic analyzer disregards sentence such as "hot ice-cream".

It involves analysis of words in the sentence for grammar and arranging words in a manner that shows the relationship among the words. The sentence such as "The school goes to boy" is rejected by English syntactic analyzer.