Abstract
Artificial Intelligence (AI) can now automate the algorithm selection,feature engineering, and hyperparameter tuning steps in a machine learningworkflow. Commonly known as AutoML or AutoAI, these technologies aim to relievedata scientists from the tedious manual work. However, today's AutoAI systemsoften present only limited to no information about the process of how theyselect and generate model results. Thus, users often do not understand theprocess, neither do they trust the outputs. In this short paper, we provide afirst user evaluation by 10 data scientists of an experimental system,AutoAIViz, that aims to visualize AutoAI's model generation process. We findthat the proposed system helps users to complete the data science tasks, andincreases their understanding, toward the goal of increasing trust in theAutoAI system.