NLP in Video Games

From the last few decades, NLP (Natural Language Processing) has obtained a high level of success in the field of Computer Science, Artificial Intelligence and Computational Logistics. NLP can also be used in video games, in fact, it is very interesting to use NLP in video games, as we can see games like Serious Games includes Communication aspects. In video games, the communication includes linguistic information that is passed either through spoken content or written content.

Now the question is why and where can we use NLP in video games?

There are some games that are related to pedagogy or teaching (Serious Games). So, NLP can be used in these games to achieve these objectives in the real sense. In other games, one can use the speech control using NLP so that the player can play the game by concentrating only on visuals rather on I/O. These things at last increases the realism of the game. Hence, this is the reason for using NLP in games.

We can use NLP to improve the internal algorithms of the game or human interaction with the game. This can be done if we change the state of the machine by using the user's input in the form of text or speech. This can be done to improve the working of internal algorithms of games. Here players, moderators and the trainers are the three main entities or actors that have been identified to support human interaction with the video games.

Left: an agent exploring the first room of MONTEZUMA’S REVENGE. Right: an example list of natural language instructions one might give the agent.

Main NLP techniques that are used in video games

Given below are some main NLP techniques that can be employed or evolved in the video games:

1. FSM (Finite State Machine):

FSM is a machine like Turing machine, which has a finite number of states. When a command is read, the state changes from the current state. this process is called transition. This can be used to show an action for a command sent by the user.

2. Expectation-Maximization (EM) and K-mean algorithm

EM is the method of finding Maximum Likelihood (ML) or Maximum Aposteriori (MAP). This algorithm is used to find the Expectation (E) Step. This is used in games like Eveil-3D and AutoMentor

3. Latent Semantic Analysis (LSA)

LSA assumes that words with similar context come together. Each word is associated with a vector.The similarity between words is calculated calculating cosine similarity between the vectors.

4. Support Vector Machines (SVM)

SVM is mostly a binary classification technique that separates the points of two different classes by a hyperplane which maximises the distance between the support vectors of the two classes.

Some of the pedagogical games that use NLP

1. Eveil-3D

This game is foreign language learning game. In this game, NLP is used for the development of reading and speaking competencies.

2. BOSS ( BOrder Security System)

BOSS is risk management training system. In this game, NLP is used for the development of soft skills and behavioral competencies.

3. AutoMentor and Land Science

This game is designed to replace or simulate a human mentor for guidance. In this game, NLP is used for the development of hard skills and scientific competencies.