Evaluation Methods Technology Trends AICC Survey

Intended Respondents

This survey is directed toward the individual(s) in your organization who are involved with the analysis of training needs and the design of training solutions for your organization or for your customers, e.g., training program managers, instructional designers, training system designers, etc.

Specifically, this survey seeks information about the current evaluation practices you are using within your organization or for your customers to establish the effectiveness of an implemented training system. It also seeks your opinions about several current technology trends and issues.

Your responses to this survey will be held in strict confidence. No individual results will be released and only group summaries will be reported. Results from this survey will be available on the AICC website after they are compiled and summarized.

1 of 11

What are your major fields of training/learning interest (Choose one or more)?

Pilot

Maintenance

Cabin Crew

Dispatch

Other aviation

(Non-aviation) Regulatory Training

(Non-aviation) Corporate

(Non-aviation) Academia

(Non-aviation) Other

2 of 11

On what percentage of your training systems do you conduct any formative evaluation, e.g., measurement of training methods/processes, so that needed changes or modifications can be made in the early stages of development?

3 of 11

On what percentage of your training systems do you conduct any type of summative evaluation, e.g., measurement of final training system outcomes or results?

4 of 11

What percentage of your training systems are evaluated with reaction measures, e.g., how much the trainee liked the program or thought it would benefit him/her on the job?

5 of 11

What percentage of your training systems are evaluated with learning measures, e.g., how much knowledge and skill changed in the training setting, usually measured through methods such as demonstration or paper and pencil tests?

6 of 11

What percentage of your training systems are evaluated with behavior measures, e.g., how much behavior changes in the work place?

7 of 11

What percentage of your training systems are evaluated with results measures, e.g., how much organizational factors were affected, such as program cost or personnel turnover?

8 of 11

Do you conduct training effectiveness studies on new training methods, interventions, processes, and/or technologies?

Yes

If yes, please list some of the training capabilities for which you have conducted training effectiveness studies:

9 of 11

If you would be willing to discuss/share your findings with the AICC, please provide contact information:

10 of 11

Technology Trends and Issues

We would like to solicit your opinion regarding several instructional trends, technologies, or positions currently discussed within the training community. For each of these questions, please indicate your opinion.

11 of 11

If you would be willing to have the AICC contact you to follow up your comments on this survey, please fill in your email address here.

Questionmark Perception licensed to the DevTeam

	Definitely True	Probably True	Unsure; do not know	Probably False	Definitely False
The current generation “learns differently” than older adults did when they were that age.
Gaming technology for training is applicable across a wide range of training tasks.
Nearly everyone can learn effectively from gaming technology.
Providing training in a format that is consistent with an individual’s “learning style” will significantly increase learning performance.
Computerized methods to adjust training content according to performance (e.g., scores on embedded tests, actions taken in a simulation) will significantly increase learning performance.
Three-dimensional environments (virtual reality, virtual environments) represent an important extension to current training technologies, i.e., they are effective and applicable in a variety of training.
Effective training cannot be built from context-independent, re-usable (sharable) learning objects.
The need for maintenance training will subside over time as self-testing equipment and job-aiding technology becomes better.
The disciplined use of meta-data will end up saving the training community substantial costs in development compared to the cost of developing the meta-data initially given current technology.