Ask Your Data - Supporting Data Science Processes by Combining AutoML and Conversational Interfaces

Data Science is increasingly applied for solving real-life problems, both in industry and in academic research, but mastering Data Science requires an interdisciplinary education that is still scarce on the market. Thus, there is a growing need for user-friendly tools that allow domain experts to directly apply data analysis methods to their datasets, without involving a Data Science expert. In this scenario, we present DSBot, an assistant that can analyze the user data and produce answers by mastering several Data Science techniques. DSBot understands the research question with the help of conversation interaction, produces a data science pipeline and automatically executes the pipeline in order to generate analysis. The strength of DSBot lies in the design of a rich domain specific language for modeling data analysis pipelines, the use of a suitable neural network for machine translation of research questions, the availability of a vast dictionary of pipelines for matching the translation output, and the use of natural language technology provided by a conversational agent. We benchmarked DSBot on two sets of 100 natural language questions and of 30 prediction tasks. We empirically evaluated the translation capabilities and the autoML performance of the system. In the translation task, it obtains a median BLEU score of 0.75. In prediction tasks, DSBot outperforms TPOT, an autoML tool, in 19 datasets out of 30.