GAMING PROGRAM FOR THE DEVELOPMENT OF CHILDREN WITH SPECIAL NEEDS

Volodymyr Hrabovskyi, A. Harshyna

Abstract


Using Python and JavaScript, a web application has been created to improve the development of children with special needs, including children with autism and hearing impairments. To implement this task, the best and most effective method of presenting information for children – a game – is chosen. The part of the program designed for the development of children with autism contains games using a technique of visual presentation of cards with accompanying information. These games use real-time videos of children’s movements to improve their physical activity and memorize letters of alphabet. In addition to images of pictures, the game used to learn a sign language also employs audio and video materials. During implementation of our application, some of the approaches used in artificial intelligence systems are used. In particular, these are the methods of expert systems and pattern recognition based on computer vision. The databases and the knowledge required to run the program are created in JavaScript, and their application management is implemented using a Django framework. Software implementation of the program also uses the capabilities of specialized computer libraries, including PoseNet and p5.js.

Keywords: JavaScript, PoseNet, p5.js, Django, web-application, computer games.


Full Text:

PDF

References


А. А. Kolupaeva and L. O. Savchuk. Children with special educational needs and organization of their education. Kyiv: Publishing Group "ATOPOL", 2011 (in Ukrainian).

S. V Litovchenko, V. V. Zhuk and O. M. Taranchenko. Child with hearing impairmen. Kharkiv: Publishing House "Morning", VG "Kangaroo", 2018 (in Ukrainian).

I. Yu. Kulagina and V. N. Kolyutsky. Developmental psychology and age psychology. The full life cycle of human development. Moscow: Academic Project. 2015 (in Russian).

S. Russell and P. Norvig. Artificial intelligence: a modern approach, 2nd Ed. Moscow: Williams Publishing House, 2016 (in Russian).

D Jarratano and Mr. Riley. Expert systems: principles of development and programming, 4th ed. Moscow: Williams Publishing House, 2007 (in Russsian).

PyCharm. The Python IDE for Professional Developers. Online, Available: https://www.jetbrains.com/pycharm/ Accessed March. 18, 2021.

The Modern JavaScript Tutorial. Online, Available: https://javascript.info/ Accessed March. 18, 2021.

A. V. Anisimov, A. Yu. Doroshenko and S. D. Pogorilyi. Programming of numerical methods in Python: Kyiv: Publishing and Printing Center “Kyiv University”, 2014 (in Ukrainian).

TensorFlow.js is a library for machine learning in JavaScript Online., Available: https://www. tensorflow.org/js Accessed March. 18, 2021.

Pose Detection in the Browser: PoseNet Model Online., Available: https://github.com/tensorflow/tfjs-models/tree/master/posenet Accessed March. 18, 2021..

Pose estimation in real time directly in the browser with TensorFlow.JS. Online, Available: https://neurohive.io/ru/tutorial/ocenka-pozy-v-realnom-vremeni-prjamo-v-brauzere-s-tensorflow-js Accessed March. 18, 2021.

p5.js. Online, Available: https://p5js.org Accessed March. 18, 2021.

V. A. Dronov. Django 2.1. The practice of creating Web sites in Python. SPb.: BHV-Petersburg, 2019 (in Russian).




DOI: http://dx.doi.org/10.30970/eli.15.4

Refbacks

  • There are currently no refbacks.