Alvaro E. Prieto | INTIA

A multi-criteria decision support system to evaluate the effectiveness of training courses on citizens' employability

Wed, 01 Jan 2025 00:00:00 +0000

Analysis of ChatGPT Performance in Computer Engineering Exams

Mon, 25 Mar 2024 00:00:00 +0000

JENUI 2023: best paper

Thu, 06 Jul 2023 00:00:00 +0000

On November 30, 2022, OpenAI introduced ChatGPT. Like most people, it caught us by surprise 🤯 with its incredible capabilities. From the very first moment we wondered what impact it would have on the different aspects of our daily lives: in Computer Engineering, in research and in teaching. From an idea proposed by our colleague Roberto, we decided to focus on the latter.

The result of several months of effort is our paper “Impact of ChatGPT on the evaluation methods of a Computer Engineering degree”, which we submitted to JENUI 2023 and for which we were awarded the best paper prize at the conference. In this edition, dominated by ChatGPT (something that has kept some speakers awake at night), the paper “Compete or not: analysis of Wooclap’s competition mode based on performance and audio processing”, by our colleagues from the University of Murcia, was also awarded.

Here you can see Roberto presenting our experience to the rest of the conference attendees (about 10 minutes plus the Q&A session):

As soon as the proceedings are published we will share them so you can read the paper and give us your opinion. In the meantime, here is the abstract:

Generative Artificial Intelligences have experienced significant evolution in recent years and, especially, in 2022. One of the AIs that has caused the most stir in the academic world is ChatGPT, which provides an interface that greatly simplifies the productive use of a large language model. These language models are capable of analyzing and generating texts with great speed and quality. These capabilities could have a relevant impact on teaching-learning methodologies and also on evaluation methods. In order to analyze the possible impact of ChatGPT on evaluation methods, in this work, ChatGPT’s ability to solve exams from 15 Software Engineering courses in a Computer Engineering degree has been tested. The results show that ChatGPT could have a clear impact on evaluation methods; as it is capable of passing a significant number of questions and problems of different nature in multiple courses. As a main contribution, a detailed study of the results by question and problem typology is provided, which allows establishing recommendations to be taken into account in the design of evaluation methods.

Interested in the topic? Want to collaborate? Get in touch with us and let’s talk.

Update: You can read the cited paper right here.

Impact of ChatGPT on the evaluation methods of a Computer Engineering degree

Wed, 05 Jul 2023 00:00:00 +0000

A Model-Driven Approach for Systematic Reproducibility and Replicability of Data Science Projects

Tue, 28 Jun 2022 00:00:00 +0000

CompareML: A Novel Approach to Supporting Preliminary Data Analysis Decision Making

Wed, 01 Jun 2022 00:00:00 +0000

SimulateIoT: Domain Specific Language to Design, Code Generation and Execute IoT Simulation Environments

Fri, 25 Jun 2021 00:00:00 +0000

Applying data driven decision making to rank vocational and educational training programs with TOPSIS

Mon, 01 Mar 2021 00:00:00 +0000

Framework for Prioritization of Open Data Publication: An Application to Smart Cities

Fri, 01 Jan 2021 00:00:00 +0000

Towards a Conceptual Framework for the Specification of Reproducible and Replicable Data Analysis Projects

Fri, 01 Jan 2021 00:00:00 +0000

Towards the use of Data Engineering, Advanced Visualization techniques and Association Rules to support knowledge discovery for public policies

Fri, 01 Jan 2021 00:00:00 +0000

Business Process Execution From the Alignment Between Business Processes and Web Services: A Semantic and Model-Driven Modernization Process

Wed, 01 Jan 2020 00:00:00 +0000

A High-Frequency Data-Driven Machine Learning Approach for Demand Forecasting in Smart Cities

Sat, 01 Jun 2019 00:00:00 +0000

A Hierarchical Adaptation Method for Administrative Workflows

Tue, 01 Jan 2019 00:00:00 +0000

Aligning Business Processes With the Services Layer Using a Semantic Approach

Tue, 01 Jan 2019 00:00:00 +0000

Supporting open dataset publication decisions based on Open Source Software reuse

Mon, 01 Jan 2018 00:00:00 +0000

MigraSOA: Migration of legacy web applications to service oriented architectures (SOA)

Sun, 01 Jan 2017 00:00:00 +0000

An Ontological Approach to the Hierarchical Adaptation of Workflows

Wed, 01 Jul 2015 00:00:00 +0000

Defining Reusable Administrative Processes using a Generic Ontology

Thu, 01 Mar 2012 00:00:00 +0000

Use of Ontologies as Representation Support of Workflows Oriented to Administrative Management

Tue, 01 Sep 2009 00:00:00 +0000