Research

Computer scientist and psychologist trying to combine expertise from both disciplines into something cool.

My research activity focuses on:

  • the development of affective HCI/BCI interfaces (based on multimodal fusion of signals and contextual data)
  • methods for processing sensory data (including semantization of such data)
  • and the development of knowledge-based systems (in particular knowledge graphs and semantic web systems).

Research Projects and Grants

  • The hyPEr ExpeRt collaborative AI assistant (PEER)

    April 2024 - Now (Knowledge Representation & Reasoning Specialist)

    Project website: https://peer-ai.eu/
    Project budget: 7 737 900,00 EUR
    Funded by: European Union’s Horizon Europe research and innovation programme, grant agreement no. 101120406
    Project leader: Vrije Universiteit Brussel
    My involvement: April 2024 – Now (Knowledge Representation & Reasoning Specialist) [planned to 2027]
    My duties: Development of methods for interactive explainable artificial intelligence based on knowledge in the form of knowledge graphs

  • European Heritage in the Jagiellonian Library: Digital Authoring of the Berlin Collections. Core Facility (DiHeLib)

    September 2022 - January 2024 (AI Specialist)

    Project website: https://dihelib.id.uj.edu.pl/
    Project budget: [Unknown] PLN
    Funded by: Flagship Project funded by the Excellence Initiative – Jagiellonian University
    Project leader: prof. Jadwiga Kita-Huber
    My involvement: September 2022 – January 2024 (AI Specialist)
    My duties: Implementation of the prototype semantic knowledge base for processing information about Autographs Collection (with librarians, philologists, historians). Development of methods for knowledge graph processing (e.g., for social network analysis). Exploration of opportunities of automating the AI-based visual analysis of manuscripts.

  • Personality, Affective Context and the Brain (PANBA)

    January 2021 - May 2022 (Project leader)

    Project website: https://geist.re/pub:projects:panba:start
    Project budget: 48 430,00 PLN
    Funded by: Research minigrant in the DigiWorld Priority Research Area UJ, project no. U1U/P06/NO/02.02
    Project leader: Krzysztof Kutt
    My involvement: January 2021 – May 2022 (Project Leader)
    My duties: The project is aimed at analyzing data from the BIRAFFE2 experiment and preparing a new research procedure that includes the use of EEG.
    Video summary of the project (in Polish): PANBA: Kontekst afektywny, osobowość a mózg (YouTube)

  • AVA - Autonomous Voice Assistant, the development of platform for automation of deployment of virtual assistants for the e-commerce sector

    December 2020 – May 2023 (Senior AI Specialist)

    Project budget: 12 591 156,25 PLN
    Funded by: NCBiREuropean Regional Development Fund, Smart Growth Poland (Program Operacyjny Inteligentny Rozwój), project no. POIR.01.01.01-00-0744/19
    Project leader: Edrone Sp. z o.o.
    My involvement: December 2020 – May 2023 (Senior AI Specialist)
    My duties: Data analytics, machine learning and deep learning algorithms development.

  • Process-aware Analytics Support based on Conceptual Models for Event Logs (PACMEL)

    2021 (Knowledge Engineer)

    Project website: http://pacmel.geist.re/
    Project budget:
    346 445,00 EUR
    Funded by: NCNCHIST-ERA, project no. POIR.01.01.01-00-0744/19
    Project coordinator: Grzegorz J. Nalepa, PhD
    My involvement: 2021 (Knowledge Engineer)
    My duties: Knowledge engineering and related tasks.

  • New Generation TMS Development: Control of Transport and Distribution Processes and Data Sharing in the Cloud With the Use of AI Methods

    April 2020 – March 2021 (ML and Contextual Processing Consultant & Semantic Knowledge and Intelligent Sensors Consultant)

    Project budget: 3 365 835,84 PLN
    Funded by: NCBiREuropean Regional Development Fund, Regional Operational Program of the Lesser Poland Voivodship (Regionalny Program Operacyjny Województwa Małopolskiego), project no. RPMP.01.02.01-12-0116/19
    Project leader: Optidata Sp. z o.o.
    My involvement: April 2020 – March 2021 (ML and Contextual Processing Consultant & Semantic Knowledge and Intelligent Sensors Consultant)
    My duties: Research, preparation of prototypes and consultations for machine learning models, contextual processing tasks, knowledge graphs and intelligent sensors.

  • Sterowanie autonomicznym dronem za pomocą gogli (monookularu)

    July 2019 – September 2020 (Biophysiology Specialist)

    Project budget: [Unknown] PLN
    Funded by: NCBiR, project no. [Unknown]
    Project leader: SIMPRO Sp. z o.o.
    My involvement: July 2019 – September 2020 (Biophysiology Specialist)
    My duties: Development of EEG experimental protocols, data analysis, report preparation.

  • Technologia optymalizacji i automatyzacji procesu zarządzania powierzchniami reklamowymi wydawców w internecie

    May 2019 – November 2019 (Knowledge Engineering Specialist & Machine Learning Specialist)

    Project budget: 1 218 005,10 PLN
    Funded by: NCBiREuropean Regional Development Fund, Regional Operational Program of the Lesser Poland Voivodship (Regionalny Program Operacyjny Województwa Małopolskiego), project no. RPMP.01.02.01-12-0478/17-00
    Project leader: GrowMagick
    My involvement: May 2019 – November 2019 (Knowledge Engineering Specialist & Machine Learning Specialist)
    My duties: Preparation of a knowledge base covering the project area. Development of machine learning models. Integration of machine learning models with knowledge engineering approaches.

  • Rozwój technologii wnioskowania oraz predykcji zachowań konsumenckich dla automatyzacji procesów marketingowych oraz sprzedażowych

    June 2018 – August 2019 (Knowledge Representation & Machine Learning)

    Project budget: 4 208 539,61 PLN
    Funded by: NCBiR / European Regional Development Fund, Regional Operational Program of the Lesser Poland Voivodship (Regionalny Program Operacyjny Województwa Małopolskiego), project no. RPMP.01.02.01-12-0512/16-00
    Project leader: Synerise S.A.
    My involvement: June 2018 – August 2019
    My duties: Development of algorithms based on machine learning, artificial intelligence and semantic methods. Structured interviews conductance in the process of knowledge engineering. Preparation of reports and scientific analyzes.

  • AGH-UST research grants for young scientists

    2014-2019 (Project leader)

    2019.01-2019.12. Zebranie i analiza danych w pilotażowych eksperymentach z wykorzystaniem urządzeń mobilnych w informatyce afektywnej (AGH UST research grant for young scientists; Project Leader). Project related to our current affective experiments with BITalino. Project budget: 3 615,00 PLN

    2018.01-2018.12. Wykorzystanie popularnych urządzeń sensorycznych w informatyce afektywnej (AGH UST research grant for young scientists; Project Leader). Project related to evaluation of wearable biosensors: Empatica E4, Microsoft Band II, Arduino e-Health Kit, Bitalino. Project budget: 6 000,00 PLN

    2017.01-2017.12. Metody projektowania systemów z użyciem kolaboratywnej inżynierii wiedzy (AGH UST research grant for young scientists; Project Leader). Project related to my PhD thesis. Project budget: 5 500,00 PLN

    2016.01-2016.12. Metody projektowania systemów z użyciem kolaboratywnej inżynierii wiedzy (AGH UST research grant for young scientists; Project Leader). Project related to my PhD thesis. Project budget: 4 619,71 PLN

    2015.01-2015.12. Analiza możliwości rozbudowy interakcji systemów mobilnych z użytkownikiem o zbieranie i przetwarzanie danych biometrycznych (AGH UST research grant for young scientists; Project Leader). Side project related to testing of mobile devices: Emotiv EPOC+, Vuzix M100, Leap Motion, et al. Project budget: 5 000,00 PLN

    2014.01-2014.12. Metody regułowe i narzędzia analizy jakości kodu (AGH UST research grant for young scientists; Project Leader). Evaluation of results of my Master’s Thesis. Project budget: 4 000,00 PLN

  • Processes Semantics & Collaboration for Companies (Prosecco)

    March 2013 – July 2015 (Ontology engineering)

    Project website: http://prosecco.agh.edu.pl/
    Project budget: 2 854 545,00 PLN
    Funded by: NCBiR 1. Program Badań Stosowanych, project no. PBS1/B3/14/2012
    Project leader: AGH University of Science and Technology
    My involvement: March 2013 – July 2015
    My duties: Small & Medium Enterprises ontology engineering.

Software Tools, Solutions and Procedures

  • BIRAFFE: Bio-Reactions and Faces for Emotion-based Personalization for AI systems – a series of experiments, placed in affective computing area, aimed at development of smart, affordable & wearable solutions for personalization of AI systems. Prepared datasets are available online (see this page for more details). They consists of electrocardiogram (ECG), galvanic skin reaction (GSR), gyroscope and changes in facial expression signals recorded during affect elicitation by means of audio-visual stimuli (from IADS and IAPS databases) and our proof-of-concept affective games. All the signals were captured using portable and low-cost equipment: BITalino (r)evolution kit, Creative Live! web camera and Sony DualShock 4 gamepad. Besides the signals, the datasets consist also of subjects’ self-assessment of their affective state after each stimuli, “Big Five” personality traits assessment and game involvement-related metrics (since 2018.09)
  • BandReader: mobile data acquisition solution for wristbands (@Android), useful in affective solutions
  • Loki: Semantic Wiki plugin for DokuWiki: ideas, development and maintenance (since 2015.07)
  • Unit testing: Rule-Based Testing Framework for the Automation of the Unit Testing Process development. Framework is designed as Eclipse plugin. Specification is saved as decision tables in XTT2 notation. For more comprehensive description see paper (since 2012.10)

Papers

Full list of my papers is available here.

Conferences/Workshops attended:

  • 2024: AfCAI (IWINAC), YODA (JOWO/FOIS)
  • 2023: PP-RAI, ECAI
  • 2022: AfCAI (IWINAC), MRC (IJCAI/ECAI)
  • 2021: ICCS, MRC (ECAI)
  • 2020: MRC (ECAI), HAII (ECAI)
  • 2019: SEMANTiCS
  • 2018: AfCAI, ICAISC, HSI
  • 2017: ICAISC, FedCSIS, MCSS, LTC
  • 2016: AfCAI, AI*IA
  • 2015: CYBCONF, FedCSIS
  • 2014: ICAISC, KESE (ECAI)
  • 2013: KESE (KI)

Details of the presentations/papers can be found on the Papers page.

Conference Committees

2024

  1. Co-Chair and Co-Organizer of the ContemporarY Ontologies for Digital Archives (YODA) Workshop held as part of the JOWO 2024, July 15 – 19, 2024, Enschede, Netherlands.
  2. Co-Chair and Co-Organizer of the 5th Workshop on Affective Computing and Context Awareness in Ambient Intelligence (AfCAI 2024) held as part of the IWINAC2024, June 4 – June 7, 2024, Olhao, Algarve, Portugal.
  3. PC Member at 27th European Conference on Artificial Intelligence (ECAI 2024)
  4. PC Member of Applied Data Science Track at European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML PKDD 2024)

2023

  1. Organizing Committee Member at 26th European Conference on Artificial Intelligence (ECAI 2023), September 30 – October 4, 2023, Kraków, Poland.
  2. PC member of Young.AI track at 4th Polish Conference on Artificial Intelligence (PP-RAI’2023), April 24-26, 2023, Łódź, Poland.

2022

  1. Co-Chair and Co-Organizer of the 4th Workshop on Affective Computing and Context Awareness in Ambient Intelligence (AfCAI 2022) held as part of the IWINAC2022, May 31 – June 3, 2022, Tenerife, Canary Islands, Spain.

2020

  1. PC member of AI, Machine & Deep Learning in Societal Automation track at SA 2020: 2nd International Conference on Societal Automation, September 9-11, 2020, Funchal, Madeira, Portugal.

Reviewer

Verified list of (almost all) peer reviews is available at Publons profile.

Talks

  1. Krzysztof Kutt (21.03.2024). O potrzebie bogatych metadanych w bibliotekach cyfrowych [On the need for rich metadata in digital libraries]. Department of Computer Design and Graphics, Jagiellonian University, PL
  2. Krzysztof Kutt (15.11.2023). Grafy wiedzy. Czym są, jak je tworzyć i po co? [Knowledge Graphs. What are they, how to create them and why?]. Open Seminar of the European Heritage in the Jagiellonian Library: Digital Authoring of the Berlin Collections. Core Facility – DiHeLib project, Kraków, PL
  3. Krzysztof Kutt (13.11.2023). Knowledge Graphs​ for Manuscript Collections. “Enigmas of Chance” Seminar, Mark Kac Center for Complex Systems Research, Kraków, PL
  4. Roman Sosnowski, Piotr Tylus, Jadwiga Kita-Huber, Remigiusz Sapa, Grzegorz J. Nalepa & Krzysztof Kutt (08.12.2022). Digitalization of library handwriting resources and opportunities for Artificial Intelligence. The case of Autographa Sammlung in the Jagiellonian Library​. Artificial Intelligence in Research and Applications Seminar (AIRA) [slides]
  5. Grzegorz J. Nalepa, Szymon Bobek & Krzysztof Kutt (10.06.2022). Perspectives on Applications of Intelligent Systems in Humanized AI. Recent projects of the GEIST team. “Collective Intelligence in Information Systems” seminar, Wrocław, PL
  6. Krzysztof Kutt (18.11.2021). AI with psychology – a few words on affective adaptation and personalisation of intelligent systems. Artificial Intelligence in Research and Applications Seminar (AIRA) [slides]
  7. Krzysztof Kutt (27.05.2021). Knowledge Engineering with Semantic Wikis and Knowledge Graphs. Department of Computer Design and Graphics, Jagiellonian University, PL
  8. Krzysztof Kutt, Szymon Bobek, Grzegorz J. Nalepa (23.10.2019). Can a machine understand how you feel by watching you? Engineering Design Centre, Cambridge, UK
  9. Krzysztof Kutt (09.05.2018). Collaborative Knowledge Engineering. Methods and Tools for System Design. “Collective Intelligence in Information Systems” seminar, Wrocław, PL [slides]

Promoted student theses

  1. [2023, MSc Thesis] Sebastian Dadał, “Deep reinforcement learning in an OpenAI Gym environment”, Jagiellonian Uni
  2. [2023, MSc Thesis] Leszek Iwanowski, “Process Mining in Affective Games”, Jagiellonian Uni
  3. [2023, MSc Thesis] Łukasz Wójcik, “Development of single- and multimodal models of automatic emotion prediction”, Jagiellonian Uni
  4. [2022, MSc Thesis] Kacper Schnetzer, “Emotional reactions of artificial intelligence in exposure to affective images”, Jagiellonian Uni
  5. [2022, MSc Thesis] Mateusz Ocytko, “Using the Unity engine to create tower defense game for mobile devices”, Jagiellonian Uni
  6. [2022, MSc Thesis] Katarzyna Kołodziej, “Analysis and recognition of emotions based on interactions with the game engine”, Jagiellonian Uni
  7. [2022, MSc Thesis] Damian Topolski, “Prototype of weather-sensitive ecosystem simulation tool”, Jagiellonian Uni
  8. [2022, MSc Thesis] Łukasz Ściga, “Dynamic difficulty adjustment in game using affective feedback”, Jagiellonian Uni
  9. [2022, MSc Thesis] Agnieszka Konopka, “Interactive simulation of soft tissue behaviour resulting from pressure and cut”, Jagiellonian Uni
  10. [2022, MSc Thesis] Rafał Krzyś, “Affective music recommendation system with the use of EDGE AI”, Jagiellonian Uni
  11. [2022, MSc Thesis] Jan Ignatowicz, “Study of generative models in creating emotionally charged images”, Jagiellonian Uni
  12. [2021, MSc Thesis] Wojciech Wójciak, “Study of the impact of game elements on the user in horror games”, Jagiellonian Uni
  13. [2021, MSc Thesis] Damian Niżnik, “Research on the influence of computer game elements on emotional stabilization”, Jagiellonian Uni
  14. [2020, MSc Thesis] Radosław Wątroba, “Automatic generation of emotionally charged images”, AGH UST
  15. [2020, MSc Thesis] Maciej Mucha, “Design and implementation of a chatbot based on machine learning”, AGH UST
  16. [2020, MSc Thesis] Izabela Stechnij, “A software for analyzing understanding of decision models based on an eye tracking”, AGH UST
  17. [2020, MSc Thesis] Maciej Prażuch, “Geolocalization-based recommendations with the use of open datasets”, AGH UST
  18. [2020, MSc Thesis] Agnieszka Gazda, “Emotion prediction models in affective computing”, AGH UST
  19. [2020, MSc Thesis] Krzysztof Świder, “Design and implementation of mobile game that analyses contextual information”, AGH UST
  20. [2020, MSc Thesis] Szymon Majkut, “Design and implementation of an interactive historical atlas”, AGH UST
  21. [2020, MSc Thesis] Daniel Stefanik, “Methods of machine learning models explanation”, AGH UST
  22. [2020, MSc Thesis] Karol Sowa, “Ontology-based explainable machine learning models”, AGH UST
  23. [2020, MSc Thesis] Sebastian Skoczeń, “Intelligent talent database with recommendation mechanisms”, AGH UST
  24. [2020, BSc Thesis] Kamil Kwiatkowski, “Audio source separation using neural networks”, AGH UST
  25. [2020, BSc Thesis] Bartosz Sadłowski, “Determination of creditworthiness with the use of machine learning”, AGH UST
  26. [2020, BSc Thesis] Karolina Bogacka, “Methods of emotional filtering of the message stream”, AGH UST
  27. [2020, BSc Thesis] Bohdan Tomczykiewicz, “Comparison of methods for predicting match results on the example of League of Legends game”, AGH UST
  28. [2020, BSc Thesis] Juliusz Ryłko, “Mobile app for finding live amateur football matches”, AGH UST
  29. [2020, BSc Thesis] Mateusz Szymkowski, “Prediction of emotions based on sensory data and facial expressions”, AGH UST
  30. [2020, BSc Thesis] Łukasz Bednarski, “Artificial neural network visualisation methods”, AGH UST
  31. [2020, BSc Thesis] Kornel Wilk, “Building knowledge base by processing written language”, AGH UST
  32. [2020, BSc Thesis] Olga Mrozowicz, “Processing sketches of user interface to digital wireframes”, AGH UST
  33. [2020, BSc Thesis] Marcin Kamiński, “Web application for managing the machine learning process”, AGH UST
  34. [2019, MSc Thesis] Katarzyna Chrzanowska, “Design of an emotive interface based on EEG signal”, AGH UST
  35. [2019, MSc Thesis] Justyna Kułaga, “Sentiment analysis based system to warn against sending negative emails”, AGH UST
  36. [2019, MSc Thesis] Marcel Ghayyeda, “Project and implementation of a nurse scheduling assistant system”, AGH UST
  37. [2019, BSc Thesis] Marcin Jakubowski, “Mobile application for the prediction of emotion based on voice characteristics”, AGH UST
  38. [2019, BSc Thesis] Jarosław Kilian, “Emotion recognition model based on selected physiological signals”, AGH UST
  39. [2019, BSc Thesis] Agnieszka Barszcz, “Development of an emotions prediction model based on psychophysiological data”, AGH UST
  40. [2019, BSc Thesis] Paweł Dzień, “Design and implementation of tools for handling psychological experiments on a mobile platform”, AGH UST
  41. [2019, BSc Thesis] Maciej Mucha, “Design and implementation of emotionally charged images generator using the GAN method”, AGH UST
  42. [2019, BSc Thesis] Klaudia Budzyńska, “Design and implementation of face and handwritting recognition modules for the electronic class register”, AGH UST
  43. [2019, BSc Thesis] Maciej Prażuch, “Design and implementation of the gamification module for a semantic wiki”, AGH UST
  44. [2019, BSc Thesis] Natalia Materek, “Design and evaluation of interfaces for various user groups in a semantic wiki”, AGH UST
  45. [2019, BSc Thesis] Izabela Adamska, “Design of an adaptive semantic wiki user interface for various user groups”, AGH UST
  46. [2019, BSc Thesis] Szymon Majkut, “Design and implementation of a mobile tourist recommendation system”, AGH UST
  47. [2019, BSc Thesis] Sebastian Skoczeń, “A voice travel recommendation system using Linked Open Data”, AGH UST
  48. [2019, BSc Thesis] Kacper Leśniak, “Speaker recognition system based on GRU neural networks”, AGH UST