Conceptual Framework

This page will be used to elaborate on the conceptual framework for the research topic: AI for Real-Time Performance Assessment in Simulation-Based Training. As my research progresses, this page will be updated to reflect my positionally in regards to this research. To begin the process I used a mind-map to brainstorm what I think are the relevant elements of the study based on the question “Can AI be used to assess student pilots in real-time in a virtual flight simulator?”

Study Topic Mind Map – Used to reflect on and flesh-out the topic of study

What do we know and what do we not know?

Why will this research be important? What makes the topic of interest/study question(s) compelling?

Study Questions

The topic of study is the use of Artificial Intelligence to assess performance in real-time in simulation-based training. I expect to conduct the study using a flight simulator and military student pilots. The main question that I’m starting with is: “Can AI be used to assess student pilots in real-time in a virtual flight simulator?” Based on the mind map shown above, the question can be refined in several ways:

  • Can AI be as effective as a human instructor when assessing the performance of student pilots in a flight simulator?
  • What type of AI can effectively provide real-time assessment of performance in a flight simulator?
  • Can real-time assessment provide useful performance insight to instructors while pilots are flying the sim?

In addition, a few questions can be considered “derived” from the initial question:

  • Does the real-time feedback constitute a distraction when flying?
  • Can the methodology be applied in other fields or in other aviation contexts?
  • Can AI assessments be integrated with existing training management systems?

The next step is to correlate the primary study questions (which may change) with study goals. To do that an initial conceptual framework was started using a flow chart to map the three study questions through the expected phenomena to a set of 4 study goals as follows:

  • Determine whether an AI can consistently replicate human instructor test results.
  • Determine whether an AI can provide test results that a human instructor cannot provide
  • Evaluate the feedback generated by the AI in real-time to determine if it is useful for improving pilot performance
  • Determine if the instructor pilot can use AI to provide more accurate feedback during simulation training
Process flow is the basis of the Conceptual Framework