Created an algorithm that automatically changes pronouns in police documents

The new algorithm was created during the Digital Breakthrough hackathon. Employees of the Center for Artificial Intelligence

Russian IT university won by developing a solution for the case of the Department of Information Technologies, Communications and Information Security of the Ministry of Internal Affairs of the Russian Federation. For 1st place in the competition they received 750 thousand rubles.

Hackathon participants were required to developan algorithm that conducts a linguistic analysis of documents, after which it converts a first-person narrative into a third-person text: for example, from the combination “I saw that Ivanov approached me” into “He saw that Ivanov approached him.” The Innopolis University team trained a neural network on a 12 GB news reports dataset. It marks the belonging of the predicate to the desired subject, determines the form of the word and morphological categories.

The neural network results were used to writePython algorithm based on heuristics and rules of the Russian language. The solution takes into account the special specifics of departmental texts (which are not always easy to read), and is also capable of processing literary texts. The algorithm processes pronouns, verbs, prepositions, quotes, direct speech, determines the belonging of pronouns to names and highlights characters, dates, amounts of money, locations.

Employees of a Russian IT university suggestedimplement the algorithm into a complex service with a web interface, where the user can insert text, download text files of different formats, audio files for speech recognition and images with text. Also a plugin for LibreOffice with the selection of the changed parts of the text is developed.

“The developed solution was tested by experts fromMinistry of Internal Affairs of the Russian Federation. The algorithm has shown excellent results using their examples. In 48 hours we have developed a cross-platform autonomous product that is ready for implementation in the department and is able to relieve law enforcement officers from routine tasks, ”said Semyon Kiselev, team leader, employee of the Center for Artificial Intelligence of Innopolis University.

Read also

Found the alleged kingdom of the disappeared Hittites. What have archaeologists found?

The Doomsday glacier turned out to be more dangerous than scientists thought. We tell the main thing

Voluntary death. We tell you how the euthanasia procedure works around the world