Abstract:

Developing digital skills is fundamental for students to participate effectively in today's society. Some of these skills are related to understanding how to effectively and ethically access, evaluate, use, and create information in digital environments. Also included are skills in searching online, evaluating the quality and credibility of information, and understanding online privacy and security issues. One of these fundamental skills is critical thinking and information evaluation, which promote the student to analyze and critically evaluate online information and discern between objective and biased information.

With the proliferation of tools for generating information using Generative Artificial Intelligence (GAI) techniques, the importance of critical thinking has been amplified. Students need to be aware that information generated by GAI always requires critical analysis to identify its veracity and relevance. Studies have shown that students often assume the first search engine results are the most relevant without reviewing and comparing the content of different results. This phenomenon is observed using Generative AI, where some students unquestioningly rely on its results.

It's crucial to comprehend the functioning and limitations of these technologies and to critically evaluate the results they produce. This understanding will enable students to approach the use of Generative AI with caution and critical thinking.

For the Artificial Intelligence course, a didactic sequence was designed to help students understand the functioning of Generative AI, compare the result of ChatGPT against the result obtained by a human, and understand the limitations of this large language model.

As the first part of the sequence, students solved a logic problem justifying the solution using propositional logic; as a next step, they tried to solve the problem with the support of ChatGPT, trying different prompts that allowed them to reach the answer that they already know is correct. Students noticed that the answer was mostly incorrect due to ChatGPT's inference strategies based on natural language processing rather than formal logic-based reasoning.

This sequence concludes with the analysis of the solutions generated by ChatGPT, considering logic-based reasoning, which allowed students to recognize the need to evaluate the IAG results critically.

Finally, teachers should also pay attention to the critical use and ethical assessment of IAG. To this end, it is essential that they develop these skills by experimenting in their courses and specific topics.

Keywords:

Critical Thinking, ChatGPT, logic problems.