Abstract:

This research attempts to understand if students find that AI enabled simulation helps to improve their understanding of a business environment. Students in a first year Bachelor of Commerce program, who are typically in their late teenage years or early 20s, often have little or no understanding of the business environment. In a first-year course we use teaching cases to help students better understand how information technology is used within a business. However, the cases, from a textbook, can be somewhat superficial. During the pandemic when students were required to learn entirely online, innovative approaches to teaching and learning were required. Case simulations supported by the IBM Watson AI engine were used in a three-year period, with the first two years being entirely online and the last year (2022) being in-person instruction.

The AI interprets student language and provides an appropriate response to their questions and statements. The AI also interprets the tone and intention of their questions. For example, a polite student inquirie receives a suitable response and answer, whereas a challenging or disrespectful question may see a challenging response and a rebuke from the simulation character. Some student inquiries may be superficial and the AI will ask for more detail and focus. This helps students to learn about the nuances in communicating with senior executives who may not fully understand, or care, how IT works. The simulation can direct the student to course readings to help them learn more about the topic they are exploring, such as Supply Chain Management, Enterprise Resource Planning, or Customer Relationship Management systems.

This research evaluates student reaction to the AI simulation as compared to textbook cases discussed in class. A key finding discussed is the importance of instructor guidance and interpretation of the AI experience. This research compares findings with research conducted by others in postsecondary education and makes recommendations on how to proceed with implementing AI to help students learn in the classroom. Further research is also described, where GPT4 will be used to augment the IBM Watson AI in Fall 2023, providing a richer dialogue with students.

Keywords:

AI, Teaching, Case Study, Simulation.